2024-09-19T07:49:45.764 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T07:49:45.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T07:49:45.902 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911834 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/direct_io}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911834' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 1 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi027.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPSEV0RYFjENPFrLpxAOkEH6ThcJawq5VFOQ45a7UCGQijxcjW0O4jWUUr/B0j8F1XiyTqedJa7ggFzbGEHNDPM= smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNOGIdz/Z97AiooU2S9m8pqUk9hF6IUh6Ok1lHgXc8N7sI2jjsO+8OGm6XI5NNPmuwKjl1HtP01TZlmTbV1kBC4= smithi203.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHgCYfRYwxWV1zbDi+1a2jZOcRYWmdZWa3UrdXI88mzPhi7HvpI2bRK8qXqyl5FDcbvZwdmcUA4fOJZQc1yejZ0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - quiescer: null - workunit: clients: all: - direct_io teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T07:49:45.903 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T07:49:45.904 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T07:49:45.904 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T07:49:45.906 INFO:teuthology.task.internal:Checking packages... 2024-09-19T07:49:45.928 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T07:49:45.928 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T07:49:45.928 INFO:teuthology.packaging:ref: None 2024-09-19T07:49:45.928 INFO:teuthology.packaging:tag: None 2024-09-19T07:49:45.928 INFO:teuthology.packaging:branch: squid 2024-09-19T07:49:45.928 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:49:45.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T07:49:46.168 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T07:49:46.170 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T07:49:46.177 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T07:49:46.177 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T07:49:46.187 INFO:teuthology.task.internal:Saving configuration 2024-09-19T07:49:46.209 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T07:49:46.217 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T07:49:46.243 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911834', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 07:43:52.714359', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPSEV0RYFjENPFrLpxAOkEH6ThcJawq5VFOQ45a7UCGQijxcjW0O4jWUUr/B0j8F1XiyTqedJa7ggFzbGEHNDPM='} 2024-09-19T07:49:46.266 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911834', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 07:43:52.715744', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNOGIdz/Z97AiooU2S9m8pqUk9hF6IUh6Ok1lHgXc8N7sI2jjsO+8OGm6XI5NNPmuwKjl1HtP01TZlmTbV1kBC4='} 2024-09-19T07:49:46.289 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911834', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 07:43:52.717029', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHgCYfRYwxWV1zbDi+1a2jZOcRYWmdZWa3UrdXI88mzPhi7HvpI2bRK8qXqyl5FDcbvZwdmcUA4fOJZQc1yejZ0='} 2024-09-19T07:49:46.289 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T07:49:46.297 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T07:49:46.297 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T07:49:46.297 INFO:teuthology.task.internal:roles: ubuntu@smithi203.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T07:49:46.297 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T07:49:46.386 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd442947be0>, signals=[15]) 2024-09-19T07:49:46.386 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T07:49:46.393 INFO:teuthology.task.internal:Opening connections... 2024-09-19T07:49:46.393 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi027.front.sepia.ceph.com 2024-09-19T07:49:46.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:49:46.480 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2024-09-19T07:49:46.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:49:46.559 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi203.front.sepia.ceph.com 2024-09-19T07:49:46.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:49:46.637 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T07:49:46.644 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2024-09-19T07:49:46.665 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2024-09-19T07:49:46.666 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2024-09-19T07:49:46.724 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream" 2024-09-19T07:49:46.724 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="9" 2024-09-19T07:49:46.724 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos" 2024-09-19T07:49:46.724 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora" 2024-09-19T07:49:46.724 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="9" 2024-09-19T07:49:46.724 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el9" 2024-09-19T07:49:46.725 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T07:49:46.725 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2024-09-19T07:49:46.725 INFO:teuthology.orchestra.run.smithi027.stdout:LOGO="fedora-logo-icon" 2024-09-19T07:49:46.725 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T07:49:46.725 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/" 2024-09-19T07:49:46.725 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T07:49:46.725 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T07:49:46.725 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T07:49:46.726 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2024-09-19T07:49:46.746 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2024-09-19T07:49:46.765 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2024-09-19T07:49:46.765 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2024-09-19T07:49:46.824 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2024-09-19T07:49:46.824 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9" 2024-09-19T07:49:46.824 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2024-09-19T07:49:46.824 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2024-09-19T07:49:46.824 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9" 2024-09-19T07:49:46.824 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9" 2024-09-19T07:49:46.824 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T07:49:46.824 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2024-09-19T07:49:46.825 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon" 2024-09-19T07:49:46.825 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T07:49:46.825 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2024-09-19T07:49:46.825 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T07:49:46.825 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T07:49:46.825 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T07:49:46.825 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2024-09-19T07:49:46.847 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2024-09-19T07:49:46.867 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2024-09-19T07:49:46.867 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2024-09-19T07:49:46.925 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2024-09-19T07:49:46.926 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9" 2024-09-19T07:49:46.926 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2024-09-19T07:49:46.926 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2024-09-19T07:49:46.926 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9" 2024-09-19T07:49:46.926 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9" 2024-09-19T07:49:46.926 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T07:49:46.926 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2024-09-19T07:49:46.926 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon" 2024-09-19T07:49:46.926 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T07:49:46.926 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2024-09-19T07:49:46.926 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T07:49:46.927 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T07:49:46.927 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T07:49:46.927 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2024-09-19T07:49:46.946 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T07:49:46.955 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T07:49:46.962 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T07:49:46.962 DEBUG:teuthology.orchestra.run.smithi027:> test '!' -e /home/ubuntu/cephtest 2024-09-19T07:49:46.965 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2024-09-19T07:49:46.967 DEBUG:teuthology.orchestra.run.smithi203:> test '!' -e /home/ubuntu/cephtest 2024-09-19T07:49:46.984 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T07:49:46.990 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T07:49:46.990 DEBUG:teuthology.orchestra.run.smithi027:> test -z $(ls -A /var/lib/ceph) 2024-09-19T07:49:47.023 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2024-09-19T07:49:47.025 DEBUG:teuthology.orchestra.run.smithi203:> test -z $(ls -A /var/lib/ceph) 2024-09-19T07:49:47.131 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T07:49:47.207 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T07:49:47.221 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T07:49:47.221 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-19T07:49:47.221 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-19T07:49:47.222 DEBUG:teuthology.orchestra.run.smithi027:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T07:49:47.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:49:47.240 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2024-09-19T07:49:47.299 INFO:teuthology.orchestra.run.smithi027.stdout:5.14.0-503.el9.x86_64 2024-09-19T07:49:47.299 INFO:teuthology.task.kernel:Running kernel on smithi027: 5.14.0-503.el9.x86_64 2024-09-19T07:49:47.299 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum install -y kernel 2024-09-19T07:49:50.832 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.3 MB 00:01 2024-09-19T07:50:07.631 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - AppStream 1.3 MB/s | 20 MB 00:15 2024-09-19T07:50:12.199 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-19T07:50:14.549 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-19T07:50:15.489 INFO:teuthology.orchestra.run.smithi027.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-19T07:50:21.059 INFO:teuthology.orchestra.run.smithi027.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-19T07:50:23.041 INFO:teuthology.orchestra.run.smithi027.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T07:50:23.041 INFO:teuthology.orchestra.run.smithi027.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T07:50:23.143 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-19T07:50:23.153 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-19T07:50:23.153 INFO:teuthology.orchestra.run.smithi027.stdout: Package Architecture Version Repository Size 2024-09-19T07:50:23.153 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-19T07:50:23.154 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2024-09-19T07:50:23.154 INFO:teuthology.orchestra.run.smithi027.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T07:50:23.154 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2024-09-19T07:50:23.154 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T07:50:23.154 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T07:50:23.154 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T07:50:23.154 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T07:50:23.154 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2024-09-19T07:50:23.154 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-19T07:50:23.154 INFO:teuthology.orchestra.run.smithi027.stdout:Install 4 Packages 2024-09-19T07:50:23.154 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T07:50:23.155 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 79 M 2024-09-19T07:50:23.155 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 126 M 2024-09-19T07:50:23.155 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2024-09-19T07:50:23.327 INFO:teuthology.orchestra.run.smithi027.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 294 kB/s | 36 kB 00:00 2024-09-19T07:50:24.411 INFO:teuthology.orchestra.run.smithi027.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-09-19T07:50:36.377 INFO:teuthology.orchestra.run.smithi027.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 2.2 MB/s | 29 MB 00:13 2024-09-19T07:50:39.393 INFO:teuthology.orchestra.run.smithi027.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 2.1 MB/s | 35 MB 00:16 2024-09-19T07:50:39.394 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-19T07:50:39.394 INFO:teuthology.orchestra.run.smithi027.stdout:Total 4.9 MB/s | 79 MB 00:16 2024-09-19T07:50:40.107 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2024-09-19T07:50:40.539 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2024-09-19T07:50:40.540 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2024-09-19T07:50:41.551 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2024-09-19T07:50:41.551 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2024-09-19T07:50:44.141 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2024-09-19T07:50:44.823 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T07:50:44.904 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T07:50:47.784 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T07:50:47.914 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T07:50:53.134 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T07:50:53.173 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T07:50:58.412 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T07:51:38.470 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T07:51:38.510 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T07:51:38.851 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T07:51:38.851 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T07:51:38.851 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T07:51:38.852 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T07:51:39.641 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T07:51:39.641 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T07:51:39.641 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2024-09-19T07:51:39.641 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T07:51:39.642 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T07:51:39.642 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T07:51:39.642 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T07:51:39.642 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T07:51:39.642 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-19T07:51:40.020 DEBUG:teuthology.orchestra.run.smithi027:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T07:51:40.101 INFO:teuthology.orchestra.run.smithi027.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T07:51:40.102 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T07:51:40.102 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T07:51:40.102 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T07:51:40.102 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T07:51:40.102 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T07:51:40.102 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi027.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T07:51:40.102 DEBUG:teuthology.orchestra.run.smithi027:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T07:51:40.161 INFO:teuthology.orchestra.run.smithi027.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T07:51:40.162 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T07:51:40.162 DEBUG:teuthology.orchestra.run.smithi027:> sudo rpm -qi grub2-tools 2024-09-19T07:51:40.205 INFO:teuthology.orchestra.run.smithi027.stdout:Name : grub2-tools 2024-09-19T07:51:40.205 INFO:teuthology.orchestra.run.smithi027.stdout:Epoch : 1 2024-09-19T07:51:40.206 INFO:teuthology.orchestra.run.smithi027.stdout:Version : 2.06 2024-09-19T07:51:40.206 INFO:teuthology.orchestra.run.smithi027.stdout:Release : 82.el9 2024-09-19T07:51:40.206 INFO:teuthology.orchestra.run.smithi027.stdout:Architecture: x86_64 2024-09-19T07:51:40.206 INFO:teuthology.orchestra.run.smithi027.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T07:51:40.206 INFO:teuthology.orchestra.run.smithi027.stdout:Group : Unspecified 2024-09-19T07:51:40.206 INFO:teuthology.orchestra.run.smithi027.stdout:Size : 8274670 2024-09-19T07:51:40.206 INFO:teuthology.orchestra.run.smithi027.stdout:License : GPLv3+ 2024-09-19T07:51:40.206 INFO:teuthology.orchestra.run.smithi027.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T07:51:40.206 INFO:teuthology.orchestra.run.smithi027.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T07:51:40.206 INFO:teuthology.orchestra.run.smithi027.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T07:51:40.206 INFO:teuthology.orchestra.run.smithi027.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T07:51:40.206 INFO:teuthology.orchestra.run.smithi027.stdout:Packager : builder@centos.org 2024-09-19T07:51:40.207 INFO:teuthology.orchestra.run.smithi027.stdout:Vendor : CentOS 2024-09-19T07:51:40.207 INFO:teuthology.orchestra.run.smithi027.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T07:51:40.207 INFO:teuthology.orchestra.run.smithi027.stdout:Summary : Support tools for GRUB. 2024-09-19T07:51:40.207 INFO:teuthology.orchestra.run.smithi027.stdout:Description : 2024-09-19T07:51:40.207 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T07:51:40.207 INFO:teuthology.orchestra.run.smithi027.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T07:51:40.207 INFO:teuthology.orchestra.run.smithi027.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T07:51:40.207 INFO:teuthology.orchestra.run.smithi027.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T07:51:40.207 INFO:teuthology.orchestra.run.smithi027.stdout:hardware devices. 2024-09-19T07:51:40.207 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T07:51:40.207 INFO:teuthology.orchestra.run.smithi027.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T07:51:40.208 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T07:51:40.208 INFO:teuthology.task.kernel:Updating grub on smithi027 to boot 5.14.0-508.el9.x86_64 2024-09-19T07:51:40.208 DEBUG:teuthology.orchestra.run.smithi027:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T07:51:41.061 INFO:teuthology.orchestra.run.smithi027.stderr:Generating grub configuration file ... 2024-09-19T07:51:42.323 INFO:teuthology.orchestra.run.smithi027.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T07:51:42.352 INFO:teuthology.orchestra.run.smithi027.stderr:done 2024-09-19T07:51:42.355 DEBUG:teuthology.orchestra.run.smithi027:> mktemp 2024-09-19T07:51:42.370 INFO:teuthology.orchestra.run.smithi027.stdout:/tmp/tmp.nMa0qGTqkp 2024-09-19T07:51:42.371 DEBUG:teuthology.orchestra.run.smithi027:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nMa0qGTqkp 2024-09-19T07:51:42.438 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0666 /tmp/tmp.nMa0qGTqkp 2024-09-19T07:51:42.576 DEBUG:teuthology.orchestra.remote:smithi027:/tmp/tmp.nMa0qGTqkp is 6KB 2024-09-19T07:51:42.624 DEBUG:teuthology.orchestra.run.smithi027:> rm -fr /tmp/tmp.nMa0qGTqkp 2024-09-19T07:51:42.640 DEBUG:teuthology.orchestra.run.smithi027:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T07:51:42.710 INFO:teuthology.orchestra.run.smithi027.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T07:51:42.710 INFO:teuthology.orchestra.run.smithi027.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T07:51:42.711 INFO:teuthology.orchestra.run.smithi027.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T07:51:42.711 INFO:teuthology.orchestra.run.smithi027.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T07:51:42.712 DEBUG:teuthology.orchestra.run.smithi027:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T07:51:42.982 DEBUG:teuthology.orchestra.run.smithi027:> sudo shutdown -r now 2024-09-19T07:52:12.985 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T07:52:12.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-19T07:52:12.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:52:31.549 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-09-19T07:52:40.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-19T07:52:40.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:52:43.613 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-09-19T07:52:55.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-19T07:52:55.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:52:58.685 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-09-19T07:53:13.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-19T07:53:13.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:53:16.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-09-19T07:53:34.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-19T07:53:34.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:53:53.213 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-09-19T07:54:14.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-19T07:54:14.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:54:14.540 DEBUG:teuthology.orchestra.run.smithi027:> true 2024-09-19T07:54:14.901 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-19T07:54:14.901 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T07:54:14.901 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2024-09-19T07:54:14.918 INFO:teuthology.orchestra.run.smithi027.stdout:5.14.0-508.el9.x86_64 2024-09-19T07:54:14.918 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T07:54:14.918 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T07:54:14.918 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T07:54:15.919 DEBUG:teuthology.parallel:result is None 2024-09-19T07:54:15.920 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T07:54:15.927 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T07:54:15.927 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T07:54:15.930 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T07:54:15.932 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T07:54:15.951 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T07:54:15.958 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T07:54:15.968 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T07:54:15.968 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T07:54:15.989 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T07:54:15.992 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T07:54:16.089 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T07:54:16.095 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T07:54:16.095 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T07:54:16.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:54:16.113 DEBUG:teuthology.orchestra.run.smithi203:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T07:54:16.130 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:54:16.131 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T07:54:16.133 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T07:54:16.156 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T07:54:16.196 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T07:54:16.199 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T07:54:16.213 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T07:54:16.215 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T07:54:16.224 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T07:54:16.234 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T07:54:16.236 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T07:54:16.242 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T07:54:16.242 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T07:54:16.245 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T07:54:16.258 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T07:54:16.308 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T07:54:16.499 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T07:54:16.500 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T07:54:16.502 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T07:54:16.505 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T07:54:16.530 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T07:54:16.614 DEBUG:teuthology.orchestra.run.smithi027:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T07:54:16.663 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T07:54:16.759 DEBUG:teuthology.orchestra.run.smithi027:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T07:54:16.798 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-19T07:54:16.799 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T07:54:16.868 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T07:54:16.913 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T07:54:16.973 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T07:54:17.059 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T07:54:17.103 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T07:54:17.103 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T07:54:17.172 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T07:54:17.218 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T07:54:17.276 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T07:54:17.360 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T07:54:17.403 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T07:54:17.403 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T07:54:17.470 DEBUG:teuthology.orchestra.run.smithi027:> sudo service rsyslog restart 2024-09-19T07:54:17.473 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2024-09-19T07:54:17.476 DEBUG:teuthology.orchestra.run.smithi203:> sudo service rsyslog restart 2024-09-19T07:54:17.518 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:54:17.526 INFO:teuthology.orchestra.run.smithi027.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:54:17.547 INFO:teuthology.orchestra.run.smithi203.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:54:18.046 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T07:54:18.054 INFO:teuthology.task.internal:Starting timer... 2024-09-19T07:54:18.054 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T07:54:18.064 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T07:54:18.075 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T07:54:18.076 DEBUG:teuthology.orchestra.run.smithi027:> sudo service auditd rotate 2024-09-19T07:54:18.139 INFO:teuthology.orchestra.run.smithi027.stdout:Rotating logs: 2024-09-19T07:54:18.141 DEBUG:teuthology.orchestra.run.smithi155:> sudo service auditd rotate 2024-09-19T07:54:18.201 INFO:teuthology.orchestra.run.smithi155.stdout:Rotating logs: 2024-09-19T07:54:18.204 DEBUG:teuthology.orchestra.run.smithi203:> sudo service auditd rotate 2024-09-19T07:54:18.261 INFO:teuthology.orchestra.run.smithi203.stdout:Rotating logs: 2024-09-19T07:54:18.263 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T07:54:18.263 DEBUG:teuthology.orchestra.run.smithi027:> /usr/sbin/getenforce 2024-09-19T07:54:18.289 INFO:teuthology.orchestra.run.smithi027.stdout:Permissive 2024-09-19T07:54:18.289 DEBUG:teuthology.orchestra.run.smithi155:> /usr/sbin/getenforce 2024-09-19T07:54:18.313 INFO:teuthology.orchestra.run.smithi155.stdout:Permissive 2024-09-19T07:54:18.313 DEBUG:teuthology.orchestra.run.smithi203:> /usr/sbin/getenforce 2024-09-19T07:54:18.342 INFO:teuthology.orchestra.run.smithi203.stdout:Permissive 2024-09-19T07:54:18.342 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi027.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi155.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi203.front.sepia.ceph.com': 'permissive'} 2024-09-19T07:54:18.342 DEBUG:teuthology.orchestra.run.smithi027:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:54:18.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:54:18.372 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:54:18.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:54:18.402 DEBUG:teuthology.orchestra.run.smithi203:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:54:18.431 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:54:18.431 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T07:54:18.431 DEBUG:teuthology.orchestra.run.smithi027:> sudo /usr/sbin/setenforce permissive 2024-09-19T07:54:18.479 DEBUG:teuthology.orchestra.run.smithi155:> sudo /usr/sbin/setenforce permissive 2024-09-19T07:54:18.518 DEBUG:teuthology.orchestra.run.smithi203:> sudo /usr/sbin/setenforce permissive 2024-09-19T07:54:18.548 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T07:54:18.557 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T07:54:18.571 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T07:54:18.575 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi027.front.sepia.ceph.com,smithi155.front.sepia.ceph.com,smithi203.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T07:58:27.150 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi027.front.sepia.ceph.com'), Remote(name='ubuntu@smithi155.front.sepia.ceph.com'), Remote(name='ubuntu@smithi203.front.sepia.ceph.com')] 2024-09-19T07:58:27.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-19T07:58:27.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:58:27.229 DEBUG:teuthology.orchestra.run.smithi027:> true 2024-09-19T07:58:27.305 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-19T07:58:27.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-19T07:58:27.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:58:27.381 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-09-19T07:58:27.465 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-19T07:58:27.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-19T07:58:27.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:58:27.544 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-09-19T07:58:27.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-19T07:58:27.634 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T07:58:27.644 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T07:58:27.644 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T07:58:27.645 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:58:27.647 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T07:58:27.647 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:58:27.649 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T07:58:27.649 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:58:27.676 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T07:58:27.678 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T07:58:27.690 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T07:58:27.694 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T07:58:27.707 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T07:58:27.716 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: ntpd: command not found 2024-09-19T07:58:27.720 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: ntpd: command not found 2024-09-19T07:58:27.722 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T07:58:27.728 INFO:teuthology.orchestra.run.smithi027.stdout:506 Cannot talk to daemon 2024-09-19T07:58:27.731 INFO:teuthology.orchestra.run.smithi155.stdout:506 Cannot talk to daemon 2024-09-19T07:58:27.743 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T07:58:27.746 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T07:58:27.747 INFO:teuthology.orchestra.run.smithi203.stderr:sudo: ntpd: command not found 2024-09-19T07:58:27.758 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T07:58:27.759 INFO:teuthology.orchestra.run.smithi203.stdout:506 Cannot talk to daemon 2024-09-19T07:58:27.760 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T07:58:27.773 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T07:58:27.788 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T07:58:27.817 INFO:teuthology.orchestra.run.smithi027.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:58:27.821 INFO:teuthology.orchestra.run.smithi027.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:58:27.821 INFO:teuthology.orchestra.run.smithi027.stdout:=============================================================================== 2024-09-19T07:58:27.821 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:58:27.821 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:58:27.821 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:58:27.821 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:58:27.823 INFO:teuthology.orchestra.run.smithi155.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:58:27.826 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:58:27.826 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2024-09-19T07:58:27.826 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:58:27.826 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:58:27.826 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:58:27.826 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:58:27.845 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:58:27.847 INFO:teuthology.orchestra.run.smithi203.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:58:27.848 INFO:teuthology.orchestra.run.smithi203.stdout:=============================================================================== 2024-09-19T07:58:27.848 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:58:27.848 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:58:27.848 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:58:27.848 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:58:27.849 INFO:teuthology.run_tasks:Running task install... 2024-09-19T07:58:27.857 DEBUG:teuthology.task.install:project ceph 2024-09-19T07:58:27.857 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T07:58:27.857 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T07:58:27.857 INFO:teuthology.task.install:Using flavor: default 2024-09-19T07:58:27.863 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T07:58:27.863 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T07:58:27.863 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T07:58:27.864 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:58:27.866 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T07:58:27.866 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:58:27.867 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T07:58:27.867 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:58:28.021 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T07:58:28.021 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T07:58:28.028 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T07:58:28.028 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T07:58:28.062 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T07:58:28.062 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T07:58:28.133 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T07:58:28.133 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T07:58:28.133 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T07:58:28.138 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T07:58:28.139 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T07:58:28.139 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T07:58:28.159 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T07:58:28.159 DEBUG:teuthology.orchestra.run.smithi203:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T07:58:28.165 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T07:58:28.165 DEBUG:teuthology.orchestra.run.smithi155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T07:58:28.173 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T07:58:28.173 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-19T07:58:28.173 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T07:58:28.201 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T07:58:28.201 DEBUG:teuthology.orchestra.run.smithi027:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T07:58:28.225 DEBUG:teuthology.orchestra.run.smithi203:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T07:58:28.234 DEBUG:teuthology.orchestra.run.smithi155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T07:58:28.268 DEBUG:teuthology.orchestra.run.smithi027:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T07:58:28.300 DEBUG:teuthology.orchestra.run.smithi203:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T07:58:28.308 DEBUG:teuthology.orchestra.run.smithi155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T07:58:28.345 DEBUG:teuthology.orchestra.run.smithi027:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T07:58:28.364 INFO:teuthology.orchestra.run.smithi203.stdout:check_obsoletes = 1 2024-09-19T07:58:28.365 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum clean all 2024-09-19T07:58:28.373 INFO:teuthology.orchestra.run.smithi155.stdout:check_obsoletes = 1 2024-09-19T07:58:28.375 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum clean all 2024-09-19T07:58:28.413 INFO:teuthology.orchestra.run.smithi027.stdout:check_obsoletes = 1 2024-09-19T07:58:28.413 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum clean all 2024-09-19T07:58:28.592 INFO:teuthology.orchestra.run.smithi203.stdout:45 files removed 2024-09-19T07:58:28.599 INFO:teuthology.orchestra.run.smithi155.stdout:45 files removed 2024-09-19T07:58:28.619 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T07:58:28.626 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T07:58:28.649 INFO:teuthology.orchestra.run.smithi027.stdout:45 files removed 2024-09-19T07:58:28.676 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T07:58:29.172 INFO:teuthology.orchestra.run.smithi203.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-19T07:58:29.175 INFO:teuthology.orchestra.run.smithi155.stdout:ceph packages for x86_64 308 kB/s | 84 kB 00:00 2024-09-19T07:58:29.244 INFO:teuthology.orchestra.run.smithi027.stdout:ceph packages for x86_64 313 kB/s | 84 kB 00:00 2024-09-19T07:58:29.439 INFO:teuthology.orchestra.run.smithi203.stdout:ceph noarch packages 52 kB/s | 12 kB 00:00 2024-09-19T07:58:29.459 INFO:teuthology.orchestra.run.smithi155.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T07:58:29.528 INFO:teuthology.orchestra.run.smithi027.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T07:58:29.706 INFO:teuthology.orchestra.run.smithi203.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-19T07:58:29.735 INFO:teuthology.orchestra.run.smithi155.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-19T07:58:29.837 INFO:teuthology.orchestra.run.smithi027.stdout:ceph source packages 7.0 kB/s | 1.9 kB 00:00 2024-09-19T07:58:30.573 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 8.3 MB 00:00 2024-09-19T07:58:31.343 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.3 MB 00:01 2024-09-19T07:58:31.488 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.3 MB 00:01 2024-09-19T07:58:33.725 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 20 MB 00:02 2024-09-19T07:58:34.177 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-19T07:58:34.738 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 20 MB 00:02 2024-09-19T07:58:38.470 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-19T07:58:39.242 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-19T07:58:39.954 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 19 kB 00:00 2024-09-19T07:58:40.784 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-19T07:58:40.959 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-19T07:58:41.039 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.5 MB 00:02 2024-09-19T07:58:41.797 INFO:teuthology.orchestra.run.smithi203.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-19T07:58:42.798 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-19T07:58:44.169 INFO:teuthology.orchestra.run.smithi027.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-19T07:58:46.307 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-19T07:58:47.295 INFO:teuthology.orchestra.run.smithi203.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-19T07:58:48.453 INFO:teuthology.orchestra.run.smithi155.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T07:58:48.453 INFO:teuthology.orchestra.run.smithi155.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T07:58:48.467 INFO:teuthology.orchestra.run.smithi155.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T07:58:48.468 INFO:teuthology.orchestra.run.smithi155.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T07:58:48.469 INFO:teuthology.orchestra.run.smithi155.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T07:58:48.470 INFO:teuthology.orchestra.run.smithi155.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T07:58:48.472 INFO:teuthology.orchestra.run.smithi155.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T07:58:48.475 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T07:58:48.476 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T07:58:48.542 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-19T07:58:48.560 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================== 2024-09-19T07:58:48.561 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-09-19T07:58:48.561 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================== 2024-09-19T07:58:48.561 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-09-19T07:58:48.561 INFO:teuthology.orchestra.run.smithi155.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T07:58:48.561 INFO:teuthology.orchestra.run.smithi155.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T07:58:48.561 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T07:58:48.561 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T07:58:48.561 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T07:58:48.561 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T07:58:48.561 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T07:58:48.561 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T07:58:48.562 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T07:58:48.562 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T07:58:48.562 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T07:58:48.562 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T07:58:48.562 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T07:58:48.562 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T07:58:48.562 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T07:58:48.562 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T07:58:48.562 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T07:58:48.562 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T07:58:48.562 INFO:teuthology.orchestra.run.smithi155.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T07:58:48.562 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T07:58:48.562 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T07:58:48.563 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T07:58:48.563 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T07:58:48.563 INFO:teuthology.orchestra.run.smithi155.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T07:58:48.563 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T07:58:48.563 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T07:58:48.563 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T07:58:48.563 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T07:58:48.563 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T07:58:48.563 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T07:58:48.563 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T07:58:48.563 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T07:58:48.563 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T07:58:48.564 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T07:58:48.564 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T07:58:48.564 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T07:58:48.564 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T07:58:48.564 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrading: 2024-09-19T07:58:48.564 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T07:58:48.564 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T07:58:48.564 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T07:58:48.564 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T07:58:48.564 INFO:teuthology.orchestra.run.smithi155.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T07:58:48.564 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T07:58:48.564 INFO:teuthology.orchestra.run.smithi155.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T07:58:48.564 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T07:58:48.565 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-09-19T07:58:48.565 INFO:teuthology.orchestra.run.smithi155.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T07:58:48.565 INFO:teuthology.orchestra.run.smithi155.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T07:58:48.565 INFO:teuthology.orchestra.run.smithi155.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T07:58:48.565 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T07:58:48.565 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T07:58:48.565 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T07:58:48.565 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T07:58:48.565 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T07:58:48.565 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T07:58:48.565 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T07:58:48.566 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T07:58:48.566 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T07:58:48.566 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T07:58:48.566 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T07:58:48.566 INFO:teuthology.orchestra.run.smithi155.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T07:58:48.566 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T07:58:48.566 INFO:teuthology.orchestra.run.smithi155.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T07:58:48.566 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T07:58:48.566 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T07:58:48.566 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T07:58:48.566 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T07:58:48.566 INFO:teuthology.orchestra.run.smithi155.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T07:58:48.566 INFO:teuthology.orchestra.run.smithi155.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T07:58:48.566 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T07:58:48.567 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T07:58:48.567 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T07:58:48.567 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T07:58:48.567 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T07:58:48.567 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T07:58:48.567 INFO:teuthology.orchestra.run.smithi155.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T07:58:48.567 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T07:58:48.567 INFO:teuthology.orchestra.run.smithi155.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T07:58:48.567 INFO:teuthology.orchestra.run.smithi155.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T07:58:48.567 INFO:teuthology.orchestra.run.smithi155.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T07:58:48.567 INFO:teuthology.orchestra.run.smithi155.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T07:58:48.567 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T07:58:48.568 INFO:teuthology.orchestra.run.smithi155.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T07:58:48.568 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T07:58:48.568 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T07:58:48.568 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T07:58:48.568 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T07:58:48.568 INFO:teuthology.orchestra.run.smithi155.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T07:58:48.568 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T07:58:48.568 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T07:58:48.568 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T07:58:48.568 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T07:58:48.568 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T07:58:48.568 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T07:58:48.568 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T07:58:48.568 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T07:58:48.569 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T07:58:48.569 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T07:58:48.569 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T07:58:48.569 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T07:58:48.569 INFO:teuthology.orchestra.run.smithi155.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T07:58:48.569 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T07:58:48.569 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T07:58:48.569 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T07:58:48.569 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T07:58:48.569 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T07:58:48.569 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T07:58:48.569 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T07:58:48.570 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T07:58:48.570 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T07:58:48.570 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T07:58:48.570 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T07:58:48.570 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T07:58:48.570 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T07:58:48.570 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T07:58:48.570 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T07:58:48.570 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T07:58:48.570 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T07:58:48.570 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T07:58:48.570 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T07:58:48.570 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T07:58:48.570 INFO:teuthology.orchestra.run.smithi155.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T07:58:48.571 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T07:58:48.571 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T07:58:48.571 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T07:58:48.571 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T07:58:48.571 INFO:teuthology.orchestra.run.smithi155.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T07:58:48.571 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T07:58:48.571 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T07:58:48.571 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T07:58:48.571 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T07:58:48.571 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T07:58:48.571 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T07:58:48.571 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T07:58:48.571 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T07:58:48.571 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T07:58:48.572 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T07:58:48.572 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T07:58:48.572 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T07:58:48.572 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T07:58:48.572 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T07:58:48.572 INFO:teuthology.orchestra.run.smithi155.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T07:58:48.572 INFO:teuthology.orchestra.run.smithi155.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T07:58:48.572 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T07:58:48.572 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T07:58:48.572 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T07:58:48.572 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T07:58:48.572 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T07:58:48.572 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T07:58:48.572 INFO:teuthology.orchestra.run.smithi155.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T07:58:48.573 INFO:teuthology.orchestra.run.smithi155.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T07:58:48.573 INFO:teuthology.orchestra.run.smithi155.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T07:58:48.573 INFO:teuthology.orchestra.run.smithi155.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T07:58:48.573 INFO:teuthology.orchestra.run.smithi155.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T07:58:48.573 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T07:58:48.573 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T07:58:48.573 INFO:teuthology.orchestra.run.smithi155.stdout:Installing weak dependencies: 2024-09-19T07:58:48.573 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T07:58:48.573 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T07:58:48.573 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-09-19T07:58:48.573 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================== 2024-09-19T07:58:48.573 INFO:teuthology.orchestra.run.smithi155.stdout:Install 148 Packages 2024-09-19T07:58:48.573 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrade 8 Packages 2024-09-19T07:58:48.574 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T07:58:48.574 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 226 M 2024-09-19T07:58:48.574 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-09-19T07:58:48.933 INFO:teuthology.orchestra.run.smithi155.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 48 kB/s | 6.6 kB 00:00 2024-09-19T07:58:49.108 INFO:teuthology.orchestra.run.smithi155.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 5.0 MB/s | 896 kB 00:00 2024-09-19T07:58:49.184 INFO:teuthology.orchestra.run.smithi155.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.9 MB/s | 145 kB 00:00 2024-09-19T07:58:49.292 INFO:teuthology.orchestra.run.smithi155.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-19T07:58:49.384 INFO:teuthology.orchestra.run.smithi155.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 1.5 MB 00:00 2024-09-19T07:58:49.426 INFO:teuthology.orchestra.run.smithi155.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 9.9 MB/s | 2.4 MB 00:00 2024-09-19T07:58:49.540 INFO:teuthology.orchestra.run.smithi203.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T07:58:49.541 INFO:teuthology.orchestra.run.smithi203.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T07:58:49.555 INFO:teuthology.orchestra.run.smithi203.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T07:58:49.556 INFO:teuthology.orchestra.run.smithi203.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T07:58:49.557 INFO:teuthology.orchestra.run.smithi203.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T07:58:49.558 INFO:teuthology.orchestra.run.smithi203.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T07:58:49.560 INFO:teuthology.orchestra.run.smithi203.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T07:58:49.562 INFO:teuthology.orchestra.run.smithi203.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T07:58:49.564 INFO:teuthology.orchestra.run.smithi203.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T07:58:49.627 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-19T07:58:49.635 INFO:teuthology.orchestra.run.smithi155.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 19 MB/s | 4.7 MB 00:00 2024-09-19T07:58:49.643 INFO:teuthology.orchestra.run.smithi203.stdout:====================================================================================== 2024-09-19T07:58:49.643 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-09-19T07:58:49.643 INFO:teuthology.orchestra.run.smithi203.stdout:====================================================================================== 2024-09-19T07:58:49.643 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-19T07:58:49.643 INFO:teuthology.orchestra.run.smithi203.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T07:58:49.643 INFO:teuthology.orchestra.run.smithi203.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T07:58:49.643 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T07:58:49.643 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T07:58:49.643 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T07:58:49.644 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T07:58:49.644 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T07:58:49.644 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T07:58:49.644 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T07:58:49.644 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T07:58:49.644 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T07:58:49.644 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T07:58:49.644 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T07:58:49.644 INFO:teuthology.orchestra.run.smithi203.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T07:58:49.644 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T07:58:49.644 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T07:58:49.644 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T07:58:49.644 INFO:teuthology.orchestra.run.smithi203.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T07:58:49.645 INFO:teuthology.orchestra.run.smithi203.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T07:58:49.645 INFO:teuthology.orchestra.run.smithi203.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T07:58:49.645 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T07:58:49.645 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T07:58:49.645 INFO:teuthology.orchestra.run.smithi203.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T07:58:49.645 INFO:teuthology.orchestra.run.smithi203.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T07:58:49.645 INFO:teuthology.orchestra.run.smithi203.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T07:58:49.645 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T07:58:49.645 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T07:58:49.645 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T07:58:49.645 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T07:58:49.645 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T07:58:49.645 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T07:58:49.646 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T07:58:49.646 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T07:58:49.646 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T07:58:49.646 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T07:58:49.646 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T07:58:49.646 INFO:teuthology.orchestra.run.smithi203.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T07:58:49.646 INFO:teuthology.orchestra.run.smithi203.stdout:Upgrading: 2024-09-19T07:58:49.646 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T07:58:49.646 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T07:58:49.646 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T07:58:49.646 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T07:58:49.646 INFO:teuthology.orchestra.run.smithi203.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T07:58:49.646 INFO:teuthology.orchestra.run.smithi203.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T07:58:49.647 INFO:teuthology.orchestra.run.smithi203.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T07:58:49.647 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T07:58:49.647 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-09-19T07:58:49.647 INFO:teuthology.orchestra.run.smithi203.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T07:58:49.647 INFO:teuthology.orchestra.run.smithi203.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T07:58:49.647 INFO:teuthology.orchestra.run.smithi203.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T07:58:49.647 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T07:58:49.647 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T07:58:49.647 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T07:58:49.647 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T07:58:49.647 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T07:58:49.647 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T07:58:49.647 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T07:58:49.648 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T07:58:49.648 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T07:58:49.648 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T07:58:49.648 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T07:58:49.648 INFO:teuthology.orchestra.run.smithi203.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T07:58:49.648 INFO:teuthology.orchestra.run.smithi203.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T07:58:49.648 INFO:teuthology.orchestra.run.smithi203.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T07:58:49.648 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T07:58:49.648 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T07:58:49.648 INFO:teuthology.orchestra.run.smithi203.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T07:58:49.648 INFO:teuthology.orchestra.run.smithi203.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T07:58:49.648 INFO:teuthology.orchestra.run.smithi203.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T07:58:49.648 INFO:teuthology.orchestra.run.smithi203.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T07:58:49.648 INFO:teuthology.orchestra.run.smithi203.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T07:58:49.649 INFO:teuthology.orchestra.run.smithi203.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T07:58:49.649 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T07:58:49.649 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T07:58:49.649 INFO:teuthology.orchestra.run.smithi203.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T07:58:49.649 INFO:teuthology.orchestra.run.smithi203.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T07:58:49.649 INFO:teuthology.orchestra.run.smithi203.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T07:58:49.649 INFO:teuthology.orchestra.run.smithi203.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T07:58:49.649 INFO:teuthology.orchestra.run.smithi203.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T07:58:49.649 INFO:teuthology.orchestra.run.smithi203.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T07:58:49.649 INFO:teuthology.orchestra.run.smithi203.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T07:58:49.649 INFO:teuthology.orchestra.run.smithi203.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T07:58:49.649 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T07:58:49.649 INFO:teuthology.orchestra.run.smithi203.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T07:58:49.650 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T07:58:49.650 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T07:58:49.650 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T07:58:49.650 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T07:58:49.650 INFO:teuthology.orchestra.run.smithi203.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T07:58:49.650 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T07:58:49.650 INFO:teuthology.orchestra.run.smithi203.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T07:58:49.650 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T07:58:49.650 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T07:58:49.650 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T07:58:49.650 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T07:58:49.650 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T07:58:49.650 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T07:58:49.650 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T07:58:49.651 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T07:58:49.651 INFO:teuthology.orchestra.run.smithi203.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T07:58:49.651 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T07:58:49.651 INFO:teuthology.orchestra.run.smithi203.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T07:58:49.651 INFO:teuthology.orchestra.run.smithi203.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T07:58:49.651 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T07:58:49.651 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T07:58:49.651 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T07:58:49.651 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T07:58:49.651 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T07:58:49.651 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T07:58:49.651 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T07:58:49.651 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T07:58:49.652 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T07:58:49.652 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T07:58:49.652 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T07:58:49.652 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T07:58:49.652 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T07:58:49.652 INFO:teuthology.orchestra.run.smithi203.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T07:58:49.652 INFO:teuthology.orchestra.run.smithi203.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T07:58:49.652 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T07:58:49.652 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T07:58:49.652 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T07:58:49.652 INFO:teuthology.orchestra.run.smithi203.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T07:58:49.652 INFO:teuthology.orchestra.run.smithi203.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T07:58:49.652 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T07:58:49.652 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T07:58:49.653 INFO:teuthology.orchestra.run.smithi203.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T07:58:49.653 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T07:58:49.653 INFO:teuthology.orchestra.run.smithi203.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T07:58:49.653 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T07:58:49.653 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T07:58:49.653 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T07:58:49.653 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T07:58:49.653 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T07:58:49.653 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T07:58:49.653 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T07:58:49.653 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T07:58:49.653 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T07:58:49.653 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T07:58:49.653 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T07:58:49.654 INFO:teuthology.orchestra.run.smithi203.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T07:58:49.654 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T07:58:49.654 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T07:58:49.654 INFO:teuthology.orchestra.run.smithi203.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T07:58:49.654 INFO:teuthology.orchestra.run.smithi203.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T07:58:49.654 INFO:teuthology.orchestra.run.smithi203.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T07:58:49.654 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T07:58:49.654 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T07:58:49.654 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T07:58:49.654 INFO:teuthology.orchestra.run.smithi203.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T07:58:49.654 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T07:58:49.654 INFO:teuthology.orchestra.run.smithi203.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T07:58:49.654 INFO:teuthology.orchestra.run.smithi203.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T07:58:49.654 INFO:teuthology.orchestra.run.smithi203.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T07:58:49.655 INFO:teuthology.orchestra.run.smithi203.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T07:58:49.655 INFO:teuthology.orchestra.run.smithi203.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T07:58:49.655 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T07:58:49.655 INFO:teuthology.orchestra.run.smithi203.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T07:58:49.655 INFO:teuthology.orchestra.run.smithi203.stdout:Installing weak dependencies: 2024-09-19T07:58:49.655 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T07:58:49.655 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T07:58:49.655 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-19T07:58:49.655 INFO:teuthology.orchestra.run.smithi203.stdout:====================================================================================== 2024-09-19T07:58:49.655 INFO:teuthology.orchestra.run.smithi203.stdout:Install 148 Packages 2024-09-19T07:58:49.655 INFO:teuthology.orchestra.run.smithi203.stdout:Upgrade 8 Packages 2024-09-19T07:58:49.655 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T07:58:49.656 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 226 M 2024-09-19T07:58:49.656 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-19T07:58:49.874 INFO:teuthology.orchestra.run.smithi027.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T07:58:50.004 INFO:teuthology.orchestra.run.smithi155.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 18 MB/s | 21 MB 00:01 2024-09-19T07:58:50.044 INFO:teuthology.orchestra.run.smithi155.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 637 kB/s | 25 kB 00:00 2024-09-19T07:58:50.211 INFO:teuthology.orchestra.run.smithi155.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 18 MB/s | 11 MB 00:00 2024-09-19T07:58:50.269 INFO:teuthology.orchestra.run.smithi155.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T07:58:50.328 INFO:teuthology.orchestra.run.smithi155.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 463 kB/s | 27 kB 00:00 2024-09-19T07:58:50.379 INFO:teuthology.orchestra.run.smithi155.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 635 kB/s | 32 kB 00:00 2024-09-19T07:58:50.445 INFO:teuthology.orchestra.run.smithi155.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 11 MB/s | 751 kB 00:00 2024-09-19T07:58:50.512 INFO:teuthology.orchestra.run.smithi155.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.4 MB/s | 163 kB 00:00 2024-09-19T07:58:50.554 INFO:teuthology.orchestra.run.smithi203.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 37 kB/s | 6.6 kB 00:00 2024-09-19T07:58:50.579 INFO:teuthology.orchestra.run.smithi155.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.9 MB/s | 127 kB 00:00 2024-09-19T07:58:50.655 INFO:teuthology.orchestra.run.smithi155.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 6.6 MB/s | 506 kB 00:00 2024-09-19T07:58:50.855 INFO:teuthology.orchestra.run.smithi155.stdout:(18/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 17 MB 00:01 2024-09-19T07:58:50.897 INFO:teuthology.orchestra.run.smithi155.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 1.1 MB/s | 45 kB 00:00 2024-09-19T07:58:50.980 INFO:teuthology.orchestra.run.smithi203.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.1 MB/s | 896 kB 00:00 2024-09-19T07:58:50.997 INFO:teuthology.orchestra.run.smithi155.stdout:(20/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-19T07:58:51.022 INFO:teuthology.orchestra.run.smithi155.stdout:(21/156): python3-ceph-common-19.1.1-361.g2f599 1.1 MB/s | 136 kB 00:00 2024-09-19T07:58:51.056 INFO:teuthology.orchestra.run.smithi155.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.7 MB/s | 161 kB 00:00 2024-09-19T07:58:51.063 INFO:teuthology.orchestra.run.smithi203.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.7 MB/s | 145 kB 00:00 2024-09-19T07:58:51.098 INFO:teuthology.orchestra.run.smithi155.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 4.1 MB/s | 320 kB 00:00 2024-09-19T07:58:51.132 INFO:teuthology.orchestra.run.smithi155.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.9 MB/s | 300 kB 00:00 2024-09-19T07:58:51.157 INFO:teuthology.orchestra.run.smithi155.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T07:58:51.191 INFO:teuthology.orchestra.run.smithi155.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-19T07:58:51.266 INFO:teuthology.orchestra.run.smithi155.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.2 MB/s | 171 kB 00:00 2024-09-19T07:58:51.342 INFO:teuthology.orchestra.run.smithi155.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 424 kB/s | 32 kB 00:00 2024-09-19T07:58:51.408 INFO:teuthology.orchestra.run.smithi155.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.1 MB/s | 146 kB 00:00 2024-09-19T07:58:51.422 INFO:teuthology.orchestra.run.smithi203.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 5.2 MB/s | 5.4 MB 00:01 2024-09-19T07:58:51.463 INFO:teuthology.orchestra.run.smithi155.stdout:(30/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 10 MB/s | 3.1 MB 00:00 2024-09-19T07:58:51.689 INFO:teuthology.orchestra.run.smithi203.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 5.7 MB/s | 1.5 MB 00:00 2024-09-19T07:58:51.740 INFO:teuthology.orchestra.run.smithi203.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 3.5 MB/s | 2.4 MB 00:00 2024-09-19T07:58:52.030 INFO:teuthology.orchestra.run.smithi155.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 5.7 MB/s | 3.6 MB 00:00 2024-09-19T07:58:52.113 INFO:teuthology.orchestra.run.smithi155.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.9 MB/s | 249 kB 00:00 2024-09-19T07:58:52.123 INFO:teuthology.orchestra.run.smithi203.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-19T07:58:52.186 INFO:teuthology.orchestra.run.smithi027.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T07:58:52.187 INFO:teuthology.orchestra.run.smithi027.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T07:58:52.199 INFO:teuthology.orchestra.run.smithi027.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T07:58:52.200 INFO:teuthology.orchestra.run.smithi027.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T07:58:52.201 INFO:teuthology.orchestra.run.smithi027.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T07:58:52.202 INFO:teuthology.orchestra.run.smithi027.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T07:58:52.204 INFO:teuthology.orchestra.run.smithi027.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T07:58:52.206 INFO:teuthology.orchestra.run.smithi027.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T07:58:52.208 INFO:teuthology.orchestra.run.smithi027.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T07:58:52.239 INFO:teuthology.orchestra.run.smithi155.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 9.5 MB/s | 7.4 MB 00:00 2024-09-19T07:58:52.264 INFO:teuthology.orchestra.run.smithi155.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 328 kB/s | 49 kB 00:00 2024-09-19T07:58:52.277 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-19T07:58:52.292 INFO:teuthology.orchestra.run.smithi027.stdout:====================================================================================== 2024-09-19T07:58:52.292 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2024-09-19T07:58:52.292 INFO:teuthology.orchestra.run.smithi027.stdout:====================================================================================== 2024-09-19T07:58:52.292 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2024-09-19T07:58:52.292 INFO:teuthology.orchestra.run.smithi027.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T07:58:52.292 INFO:teuthology.orchestra.run.smithi027.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T07:58:52.293 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T07:58:52.293 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T07:58:52.293 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T07:58:52.293 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T07:58:52.294 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T07:58:52.294 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T07:58:52.294 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T07:58:52.294 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T07:58:52.294 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T07:58:52.295 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T07:58:52.295 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T07:58:52.295 INFO:teuthology.orchestra.run.smithi027.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T07:58:52.295 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T07:58:52.295 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T07:58:52.295 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T07:58:52.296 INFO:teuthology.orchestra.run.smithi027.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T07:58:52.296 INFO:teuthology.orchestra.run.smithi027.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T07:58:52.296 INFO:teuthology.orchestra.run.smithi027.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T07:58:52.296 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T07:58:52.296 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T07:58:52.297 INFO:teuthology.orchestra.run.smithi027.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T07:58:52.297 INFO:teuthology.orchestra.run.smithi027.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T07:58:52.297 INFO:teuthology.orchestra.run.smithi027.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T07:58:52.298 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T07:58:52.298 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T07:58:52.298 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T07:58:52.298 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T07:58:52.298 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T07:58:52.298 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T07:58:52.300 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T07:58:52.300 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T07:58:52.300 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T07:58:52.301 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T07:58:52.301 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T07:58:52.301 INFO:teuthology.orchestra.run.smithi027.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T07:58:52.301 INFO:teuthology.orchestra.run.smithi027.stdout:Upgrading: 2024-09-19T07:58:52.301 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T07:58:52.301 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T07:58:52.301 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T07:58:52.301 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T07:58:52.301 INFO:teuthology.orchestra.run.smithi027.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T07:58:52.301 INFO:teuthology.orchestra.run.smithi027.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T07:58:52.301 INFO:teuthology.orchestra.run.smithi027.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T07:58:52.301 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T07:58:52.301 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2024-09-19T07:58:52.302 INFO:teuthology.orchestra.run.smithi027.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T07:58:52.302 INFO:teuthology.orchestra.run.smithi027.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T07:58:52.302 INFO:teuthology.orchestra.run.smithi027.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T07:58:52.302 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T07:58:52.302 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T07:58:52.302 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T07:58:52.302 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T07:58:52.302 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T07:58:52.302 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T07:58:52.302 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T07:58:52.302 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T07:58:52.302 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T07:58:52.303 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T07:58:52.303 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T07:58:52.303 INFO:teuthology.orchestra.run.smithi027.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T07:58:52.303 INFO:teuthology.orchestra.run.smithi027.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T07:58:52.303 INFO:teuthology.orchestra.run.smithi027.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T07:58:52.303 INFO:teuthology.orchestra.run.smithi027.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T07:58:52.303 INFO:teuthology.orchestra.run.smithi027.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T07:58:52.303 INFO:teuthology.orchestra.run.smithi027.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T07:58:52.303 INFO:teuthology.orchestra.run.smithi027.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T07:58:52.303 INFO:teuthology.orchestra.run.smithi027.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T07:58:52.303 INFO:teuthology.orchestra.run.smithi027.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T07:58:52.303 INFO:teuthology.orchestra.run.smithi027.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T07:58:52.303 INFO:teuthology.orchestra.run.smithi027.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T07:58:52.303 INFO:teuthology.orchestra.run.smithi027.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T07:58:52.304 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T07:58:52.304 INFO:teuthology.orchestra.run.smithi027.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T07:58:52.304 INFO:teuthology.orchestra.run.smithi027.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T07:58:52.304 INFO:teuthology.orchestra.run.smithi027.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T07:58:52.304 INFO:teuthology.orchestra.run.smithi027.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T07:58:52.304 INFO:teuthology.orchestra.run.smithi027.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T07:58:52.304 INFO:teuthology.orchestra.run.smithi027.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T07:58:52.304 INFO:teuthology.orchestra.run.smithi027.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T07:58:52.304 INFO:teuthology.orchestra.run.smithi027.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T07:58:52.304 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T07:58:52.304 INFO:teuthology.orchestra.run.smithi027.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T07:58:52.304 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T07:58:52.304 INFO:teuthology.orchestra.run.smithi027.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T07:58:52.305 INFO:teuthology.orchestra.run.smithi027.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T07:58:52.305 INFO:teuthology.orchestra.run.smithi027.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T07:58:52.305 INFO:teuthology.orchestra.run.smithi027.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T07:58:52.305 INFO:teuthology.orchestra.run.smithi027.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T07:58:52.305 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T07:58:52.305 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T07:58:52.305 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T07:58:52.305 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T07:58:52.305 INFO:teuthology.orchestra.run.smithi027.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T07:58:52.305 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T07:58:52.305 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T07:58:52.305 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T07:58:52.305 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T07:58:52.306 INFO:teuthology.orchestra.run.smithi027.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T07:58:52.306 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T07:58:52.306 INFO:teuthology.orchestra.run.smithi027.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T07:58:52.306 INFO:teuthology.orchestra.run.smithi027.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T07:58:52.306 INFO:teuthology.orchestra.run.smithi027.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T07:58:52.306 INFO:teuthology.orchestra.run.smithi027.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T07:58:52.306 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T07:58:52.306 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T07:58:52.306 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T07:58:52.306 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T07:58:52.306 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T07:58:52.306 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T07:58:52.307 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T07:58:52.307 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T07:58:52.307 INFO:teuthology.orchestra.run.smithi027.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T07:58:52.307 INFO:teuthology.orchestra.run.smithi027.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T07:58:52.307 INFO:teuthology.orchestra.run.smithi027.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T07:58:52.307 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T07:58:52.307 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T07:58:52.307 INFO:teuthology.orchestra.run.smithi027.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T07:58:52.307 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T07:58:52.307 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T07:58:52.307 INFO:teuthology.orchestra.run.smithi027.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T07:58:52.307 INFO:teuthology.orchestra.run.smithi027.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T07:58:52.307 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T07:58:52.307 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T07:58:52.308 INFO:teuthology.orchestra.run.smithi027.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T07:58:52.308 INFO:teuthology.orchestra.run.smithi027.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T07:58:52.308 INFO:teuthology.orchestra.run.smithi027.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T07:58:52.308 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T07:58:52.308 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T07:58:52.308 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T07:58:52.308 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T07:58:52.308 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T07:58:52.308 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T07:58:52.308 INFO:teuthology.orchestra.run.smithi027.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T07:58:52.308 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T07:58:52.308 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T07:58:52.308 INFO:teuthology.orchestra.run.smithi027.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T07:58:52.309 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T07:58:52.309 INFO:teuthology.orchestra.run.smithi027.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T07:58:52.309 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T07:58:52.309 INFO:teuthology.orchestra.run.smithi027.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T07:58:52.309 INFO:teuthology.orchestra.run.smithi027.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T07:58:52.309 INFO:teuthology.orchestra.run.smithi027.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T07:58:52.309 INFO:teuthology.orchestra.run.smithi027.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T07:58:52.309 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T07:58:52.309 INFO:teuthology.orchestra.run.smithi027.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T07:58:52.309 INFO:teuthology.orchestra.run.smithi027.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T07:58:52.309 INFO:teuthology.orchestra.run.smithi027.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T07:58:52.309 INFO:teuthology.orchestra.run.smithi027.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T07:58:52.309 INFO:teuthology.orchestra.run.smithi027.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T07:58:52.310 INFO:teuthology.orchestra.run.smithi027.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T07:58:52.310 INFO:teuthology.orchestra.run.smithi027.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T07:58:52.310 INFO:teuthology.orchestra.run.smithi027.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T07:58:52.310 INFO:teuthology.orchestra.run.smithi027.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T07:58:52.310 INFO:teuthology.orchestra.run.smithi027.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T07:58:52.310 INFO:teuthology.orchestra.run.smithi027.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T07:58:52.310 INFO:teuthology.orchestra.run.smithi027.stdout:Installing weak dependencies: 2024-09-19T07:58:52.310 INFO:teuthology.orchestra.run.smithi027.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T07:58:52.310 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T07:58:52.310 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2024-09-19T07:58:52.310 INFO:teuthology.orchestra.run.smithi027.stdout:====================================================================================== 2024-09-19T07:58:52.310 INFO:teuthology.orchestra.run.smithi027.stdout:Install 148 Packages 2024-09-19T07:58:52.310 INFO:teuthology.orchestra.run.smithi027.stdout:Upgrade 8 Packages 2024-09-19T07:58:52.311 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T07:58:52.311 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 226 M 2024-09-19T07:58:52.311 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2024-09-19T07:58:52.640 INFO:teuthology.orchestra.run.smithi203.stdout:(8/156): ceph-radosgw-19.1.1-361.g2f599a46.el9. 21 MB/s | 11 MB 00:00 2024-09-19T07:58:52.682 INFO:teuthology.orchestra.run.smithi203.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 605 kB/s | 25 kB 00:00 2024-09-19T07:58:52.714 INFO:teuthology.orchestra.run.smithi155.stdout:(35/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 18 MB/s | 49 MB 00:02 2024-09-19T07:58:52.739 INFO:teuthology.orchestra.run.smithi155.stdout:(36/156): ceph-prometheus-alerts-19.1.1-361.g2f 33 kB/s | 16 kB 00:00 2024-09-19T07:58:52.765 INFO:teuthology.orchestra.run.smithi155.stdout:(37/156): ceph-volume-19.1.1-361.g2f599a46.el9. 569 kB/s | 285 kB 00:00 2024-09-19T07:58:52.815 INFO:teuthology.orchestra.run.smithi155.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 242 kB/s | 18 kB 00:00 2024-09-19T07:58:52.899 INFO:teuthology.orchestra.run.smithi155.stdout:(39/156): cephadm-19.1.1-361.g2f599a46.el9.noar 4.1 MB/s | 765 kB 00:00 2024-09-19T07:58:52.926 INFO:teuthology.orchestra.run.smithi027.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 27 kB/s | 6.6 kB 00:00 2024-09-19T07:58:52.957 INFO:teuthology.orchestra.run.smithi155.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 415 kB/s | 80 kB 00:00 2024-09-19T07:58:53.074 INFO:teuthology.orchestra.run.smithi155.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-19T07:58:53.108 INFO:teuthology.orchestra.run.smithi155.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 915 kB/s | 191 kB 00:00 2024-09-19T07:58:53.141 INFO:teuthology.orchestra.run.smithi155.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-19T07:58:53.168 INFO:teuthology.orchestra.run.smithi203.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 17 MB 00:01 2024-09-19T07:58:53.169 INFO:teuthology.orchestra.run.smithi155.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-19T07:58:53.200 INFO:teuthology.orchestra.run.smithi155.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-19T07:58:53.226 INFO:teuthology.orchestra.run.smithi155.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-19T07:58:53.268 INFO:teuthology.orchestra.run.smithi155.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 6.4 MB/s | 1.2 MB 00:00 2024-09-19T07:58:53.293 INFO:teuthology.orchestra.run.smithi155.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-19T07:58:53.376 INFO:teuthology.orchestra.run.smithi027.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.9 MB/s | 896 kB 00:00 2024-09-19T07:58:53.382 INFO:teuthology.orchestra.run.smithi203.stdout:(11/156): ceph-common-19.1.1-361.g2f599a46.el9. 7.1 MB/s | 21 MB 00:03 2024-09-19T07:58:53.416 INFO:teuthology.orchestra.run.smithi203.stdout:(12/156): cephfs-mirror-19.1.1-361.g2f599a46.el 912 kB/s | 228 kB 00:00 2024-09-19T07:58:53.418 INFO:teuthology.orchestra.run.smithi155.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 857 kB/s | 107 kB 00:00 2024-09-19T07:58:53.444 INFO:teuthology.orchestra.run.smithi155.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-09-19T07:58:53.461 INFO:teuthology.orchestra.run.smithi155.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 515 kB/s | 22 kB 00:00 2024-09-19T07:58:53.466 INFO:teuthology.orchestra.run.smithi203.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 323 kB/s | 27 kB 00:00 2024-09-19T07:58:53.500 INFO:teuthology.orchestra.run.smithi203.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 378 kB/s | 32 kB 00:00 2024-09-19T07:58:53.502 INFO:teuthology.orchestra.run.smithi155.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.9 MB/s | 943 kB 00:00 2024-09-19T07:58:53.526 INFO:teuthology.orchestra.run.smithi027.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 6.4 MB/s | 5.4 MB 00:00 2024-09-19T07:58:53.536 INFO:teuthology.orchestra.run.smithi155.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-19T07:58:53.551 INFO:teuthology.orchestra.run.smithi027.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 829 kB/s | 145 kB 00:00 2024-09-19T07:58:53.553 INFO:teuthology.orchestra.run.smithi155.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 355 kB/s | 33 kB 00:00 2024-09-19T07:58:53.570 INFO:teuthology.orchestra.run.smithi155.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 542 kB/s | 18 kB 00:00 2024-09-19T07:58:53.587 INFO:teuthology.orchestra.run.smithi155.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 334 kB/s | 11 kB 00:00 2024-09-19T07:58:53.592 INFO:teuthology.orchestra.run.smithi203.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.7 MB/s | 163 kB 00:00 2024-09-19T07:58:53.613 INFO:teuthology.orchestra.run.smithi155.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 160 kB 00:00 2024-09-19T07:58:53.630 INFO:teuthology.orchestra.run.smithi155.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-09-19T07:58:53.634 INFO:teuthology.orchestra.run.smithi203.stdout:(16/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 4.4 MB/s | 751 kB 00:00 2024-09-19T07:58:53.663 INFO:teuthology.orchestra.run.smithi155.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-09-19T07:58:53.693 INFO:teuthology.orchestra.run.smithi203.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 1.2 MB/s | 127 kB 00:00 2024-09-19T07:58:53.713 INFO:teuthology.orchestra.run.smithi155.stdout:(60/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-09-19T07:58:53.739 INFO:teuthology.orchestra.run.smithi155.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-19T07:58:53.764 INFO:teuthology.orchestra.run.smithi155.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-19T07:58:53.789 INFO:teuthology.orchestra.run.smithi155.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-19T07:58:53.823 INFO:teuthology.orchestra.run.smithi155.stdout:(64/156): libtool-2.4.6-46.el9.x86_64.rpm 2.9 MB/s | 581 kB 00:00 2024-09-19T07:58:53.848 INFO:teuthology.orchestra.run.smithi155.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 658 kB/s | 38 kB 00:00 2024-09-19T07:58:53.852 INFO:teuthology.orchestra.run.smithi027.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 7.3 MB/s | 2.4 MB 00:00 2024-09-19T07:58:53.874 INFO:teuthology.orchestra.run.smithi155.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-19T07:58:53.885 INFO:teuthology.orchestra.run.smithi203.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 2.0 MB/s | 506 kB 00:00 2024-09-19T07:58:53.941 INFO:teuthology.orchestra.run.smithi155.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-19T07:58:53.943 INFO:teuthology.orchestra.run.smithi203.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 774 kB/s | 45 kB 00:00 2024-09-19T07:58:54.007 INFO:teuthology.orchestra.run.smithi155.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-19T07:58:54.027 INFO:teuthology.orchestra.run.smithi203.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.6 MB/s | 136 kB 00:00 2024-09-19T07:58:54.060 INFO:teuthology.orchestra.run.smithi027.stdout:(6/156): ceph-common-19.1.1-361.g2f599a46.el9.x 15 MB/s | 21 MB 00:01 2024-09-19T07:58:54.074 INFO:teuthology.orchestra.run.smithi155.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 20 MB/s | 4.9 MB 00:00 2024-09-19T07:58:54.100 INFO:teuthology.orchestra.run.smithi155.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-19T07:58:54.133 INFO:teuthology.orchestra.run.smithi155.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 4.6 MB/s | 910 kB 00:00 2024-09-19T07:58:54.161 INFO:teuthology.orchestra.run.smithi203.stdout:(21/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 5.3 MB 00:00 2024-09-19T07:58:54.169 INFO:teuthology.orchestra.run.smithi027.stdout:(7/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 2.5 MB/s | 1.5 MB 00:00 2024-09-19T07:58:54.175 INFO:teuthology.orchestra.run.smithi155.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-19T07:58:54.186 INFO:teuthology.orchestra.run.smithi203.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.0 MB/s | 161 kB 00:00 2024-09-19T07:58:54.218 INFO:teuthology.orchestra.run.smithi155.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-19T07:58:54.236 INFO:teuthology.orchestra.run.smithi203.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 4.1 MB/s | 320 kB 00:00 2024-09-19T07:58:54.259 INFO:teuthology.orchestra.run.smithi155.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.5 MB/s | 61 kB 00:00 2024-09-19T07:58:54.277 INFO:teuthology.orchestra.run.smithi027.stdout:(8/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-19T07:58:54.295 INFO:teuthology.orchestra.run.smithi203.stdout:(24/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T07:58:54.320 INFO:teuthology.orchestra.run.smithi203.stdout:(25/156): python3-rbd-19.1.1-361.g2f599a46.el9. 2.2 MB/s | 300 kB 00:00 2024-09-19T07:58:54.335 INFO:teuthology.orchestra.run.smithi155.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-19T07:58:54.344 INFO:teuthology.orchestra.run.smithi027.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 377 kB/s | 25 kB 00:00 2024-09-19T07:58:54.360 INFO:teuthology.orchestra.run.smithi155.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-19T07:58:54.371 INFO:teuthology.orchestra.run.smithi203.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-19T07:58:54.397 INFO:teuthology.orchestra.run.smithi155.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-19T07:58:54.419 INFO:teuthology.orchestra.run.smithi155.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-09-19T07:58:54.444 INFO:teuthology.orchestra.run.smithi155.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-19T07:58:54.469 INFO:teuthology.orchestra.run.smithi155.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-19T07:58:54.471 INFO:teuthology.orchestra.run.smithi203.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 1.7 MB/s | 171 kB 00:00 2024-09-19T07:58:54.495 INFO:teuthology.orchestra.run.smithi155.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-19T07:58:54.571 INFO:teuthology.orchestra.run.smithi203.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 318 kB/s | 32 kB 00:00 2024-09-19T07:58:54.578 INFO:teuthology.orchestra.run.smithi155.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-19T07:58:54.604 INFO:teuthology.orchestra.run.smithi155.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-19T07:58:54.629 INFO:teuthology.orchestra.run.smithi155.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-19T07:58:54.654 INFO:teuthology.orchestra.run.smithi155.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T07:58:54.680 INFO:teuthology.orchestra.run.smithi155.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 838 kB/s | 42 kB 00:00 2024-09-19T07:58:54.680 INFO:teuthology.orchestra.run.smithi203.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.3 MB/s | 146 kB 00:00 2024-09-19T07:58:54.705 INFO:teuthology.orchestra.run.smithi155.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-19T07:58:54.730 INFO:teuthology.orchestra.run.smithi155.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-19T07:58:54.756 INFO:teuthology.orchestra.run.smithi155.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-19T07:58:54.773 INFO:teuthology.orchestra.run.smithi155.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-19T07:58:54.798 INFO:teuthology.orchestra.run.smithi155.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-19T07:58:54.882 INFO:teuthology.orchestra.run.smithi155.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-19T07:58:54.907 INFO:teuthology.orchestra.run.smithi155.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-09-19T07:58:54.932 INFO:teuthology.orchestra.run.smithi155.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-09-19T07:58:54.957 INFO:teuthology.orchestra.run.smithi155.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-19T07:58:54.974 INFO:teuthology.orchestra.run.smithi155.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 857 kB/s | 36 kB 00:00 2024-09-19T07:58:54.991 INFO:teuthology.orchestra.run.smithi155.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-19T07:58:55.016 INFO:teuthology.orchestra.run.smithi155.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 7.1 MB/s | 304 kB 00:00 2024-09-19T07:58:55.028 INFO:teuthology.orchestra.run.smithi027.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 17 MB/s | 17 MB 00:00 2024-09-19T07:58:55.042 INFO:teuthology.orchestra.run.smithi155.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T07:58:55.067 INFO:teuthology.orchestra.run.smithi155.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T07:58:55.093 INFO:teuthology.orchestra.run.smithi155.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T07:58:55.103 INFO:teuthology.orchestra.run.smithi027.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.0 MB/s | 228 kB 00:00 2024-09-19T07:58:55.105 INFO:teuthology.orchestra.run.smithi203.stdout:(30/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 4.0 MB/s | 3.1 MB 00:00 2024-09-19T07:58:55.109 INFO:teuthology.orchestra.run.smithi155.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-09-19T07:58:55.162 INFO:teuthology.orchestra.run.smithi027.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 464 kB/s | 27 kB 00:00 2024-09-19T07:58:55.193 INFO:teuthology.orchestra.run.smithi155.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 225 kB/s | 22 kB 00:00 2024-09-19T07:58:55.221 INFO:teuthology.orchestra.run.smithi027.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 543 kB/s | 32 kB 00:00 2024-09-19T07:58:55.221 INFO:teuthology.orchestra.run.smithi203.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 6.6 MB/s | 3.6 MB 00:00 2024-09-19T07:58:55.312 INFO:teuthology.orchestra.run.smithi027.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 8.0 MB/s | 751 kB 00:00 2024-09-19T07:58:55.352 INFO:teuthology.orchestra.run.smithi155.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-19T07:58:55.371 INFO:teuthology.orchestra.run.smithi027.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.7 MB/s | 163 kB 00:00 2024-09-19T07:58:55.394 INFO:teuthology.orchestra.run.smithi155.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.7 MB/s | 548 kB 00:00 2024-09-19T07:58:55.419 INFO:teuthology.orchestra.run.smithi155.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 861 kB/s | 19 kB 00:00 2024-09-19T07:58:55.429 INFO:teuthology.orchestra.run.smithi027.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 2.1 MB/s | 127 kB 00:00 2024-09-19T07:58:55.461 INFO:teuthology.orchestra.run.smithi155.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-19T07:58:55.496 INFO:teuthology.orchestra.run.smithi027.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 7.4 MB/s | 506 kB 00:00 2024-09-19T07:58:55.503 INFO:teuthology.orchestra.run.smithi155.stdout:(108/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-09-19T07:58:55.528 INFO:teuthology.orchestra.run.smithi155.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 389 kB/s | 26 kB 00:00 2024-09-19T07:58:55.562 INFO:teuthology.orchestra.run.smithi155.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T07:58:55.596 INFO:teuthology.orchestra.run.smithi155.stdout:(111/156): liboath-2.6.7-2.el9.x86_64.rpm 527 kB/s | 49 kB 00:00 2024-09-19T07:58:55.625 INFO:teuthology.orchestra.run.smithi155.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-09-19T07:58:55.671 INFO:teuthology.orchestra.run.smithi155.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-19T07:58:55.696 INFO:teuthology.orchestra.run.smithi203.stdout:(32/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 16 MB/s | 49 MB 00:03 2024-09-19T07:58:55.696 INFO:teuthology.orchestra.run.smithi155.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T07:58:55.721 INFO:teuthology.orchestra.run.smithi203.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 499 kB/s | 249 kB 00:00 2024-09-19T07:58:55.722 INFO:teuthology.orchestra.run.smithi155.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T07:58:55.747 INFO:teuthology.orchestra.run.smithi155.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 569 kB/s | 14 kB 00:00 2024-09-19T07:58:55.755 INFO:teuthology.orchestra.run.smithi203.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 846 kB/s | 49 kB 00:00 2024-09-19T07:58:55.772 INFO:teuthology.orchestra.run.smithi203.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 328 kB/s | 16 kB 00:00 2024-09-19T07:58:55.789 INFO:teuthology.orchestra.run.smithi027.stdout:(18/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 18 MB/s | 5.3 MB 00:00 2024-09-19T07:58:55.806 INFO:teuthology.orchestra.run.smithi155.stdout:(117/156): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-19T07:58:55.834 INFO:teuthology.orchestra.run.smithi203.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 3.7 MB/s | 285 kB 00:00 2024-09-19T07:58:55.839 INFO:teuthology.orchestra.run.smithi155.stdout:(118/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.4 MB/s | 839 kB 00:00 2024-09-19T07:58:55.847 INFO:teuthology.orchestra.run.smithi027.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 775 kB/s | 45 kB 00:00 2024-09-19T07:58:55.864 INFO:teuthology.orchestra.run.smithi203.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 8.1 MB/s | 765 kB 00:00 2024-09-19T07:58:55.873 INFO:teuthology.orchestra.run.smithi155.stdout:(119/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-09-19T07:58:55.889 INFO:teuthology.orchestra.run.smithi203.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 310 kB/s | 18 kB 00:00 2024-09-19T07:58:55.897 INFO:teuthology.orchestra.run.smithi027.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.7 MB/s | 136 kB 00:00 2024-09-19T07:58:55.907 INFO:teuthology.orchestra.run.smithi155.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-09-19T07:58:55.932 INFO:teuthology.orchestra.run.smithi155.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-19T07:58:55.956 INFO:teuthology.orchestra.run.smithi027.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.7 MB/s | 161 kB 00:00 2024-09-19T07:58:55.957 INFO:teuthology.orchestra.run.smithi155.stdout:(122/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-09-19T07:58:55.983 INFO:teuthology.orchestra.run.smithi155.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-19T07:58:56.008 INFO:teuthology.orchestra.run.smithi155.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-19T07:58:56.014 INFO:teuthology.orchestra.run.smithi027.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 5.4 MB/s | 320 kB 00:00 2024-09-19T07:58:56.033 INFO:teuthology.orchestra.run.smithi155.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-19T07:58:56.048 INFO:teuthology.orchestra.run.smithi203.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 434 kB/s | 80 kB 00:00 2024-09-19T07:58:56.058 INFO:teuthology.orchestra.run.smithi155.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-09-19T07:58:56.081 INFO:teuthology.orchestra.run.smithi027.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 4.4 MB/s | 300 kB 00:00 2024-09-19T07:58:56.084 INFO:teuthology.orchestra.run.smithi155.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-19T07:58:56.109 INFO:teuthology.orchestra.run.smithi155.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-19T07:58:56.134 INFO:teuthology.orchestra.run.smithi155.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T07:58:56.140 INFO:teuthology.orchestra.run.smithi203.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-19T07:58:56.159 INFO:teuthology.orchestra.run.smithi155.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T07:58:56.166 INFO:teuthology.orchestra.run.smithi203.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-19T07:58:56.185 INFO:teuthology.orchestra.run.smithi155.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T07:58:56.198 INFO:teuthology.orchestra.run.smithi027.stdout:(24/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 5.2 MB/s | 11 MB 00:02 2024-09-19T07:58:56.207 INFO:teuthology.orchestra.run.smithi203.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-19T07:58:56.218 INFO:teuthology.orchestra.run.smithi155.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-19T07:58:56.223 INFO:teuthology.orchestra.run.smithi027.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 701 kB/s | 99 kB 00:00 2024-09-19T07:58:56.249 INFO:teuthology.orchestra.run.smithi027.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T07:58:56.249 INFO:teuthology.orchestra.run.smithi203.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-09-19T07:58:56.252 INFO:teuthology.orchestra.run.smithi155.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-19T07:58:56.266 INFO:teuthology.orchestra.run.smithi203.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-19T07:58:56.277 INFO:teuthology.orchestra.run.smithi155.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-19T07:58:56.300 INFO:teuthology.orchestra.run.smithi203.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-19T07:58:56.303 INFO:teuthology.orchestra.run.smithi155.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T07:58:56.316 INFO:teuthology.orchestra.run.smithi027.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-19T07:58:56.326 INFO:teuthology.orchestra.run.smithi203.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-19T07:58:56.328 INFO:teuthology.orchestra.run.smithi155.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-19T07:58:56.345 INFO:teuthology.orchestra.run.smithi155.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 736 kB/s | 31 kB 00:00 2024-09-19T07:58:56.359 INFO:teuthology.orchestra.run.smithi203.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-19T07:58:56.362 INFO:teuthology.orchestra.run.smithi155.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-19T07:58:56.383 INFO:teuthology.orchestra.run.smithi027.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 19 MB/s | 3.1 MB 00:00 2024-09-19T07:58:56.395 INFO:teuthology.orchestra.run.smithi155.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.7 MB/s | 188 kB 00:00 2024-09-19T07:58:56.408 INFO:teuthology.orchestra.run.smithi027.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 345 kB/s | 32 kB 00:00 2024-09-19T07:58:56.434 INFO:teuthology.orchestra.run.smithi027.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.8 MB/s | 146 kB 00:00 2024-09-19T07:58:56.438 INFO:teuthology.orchestra.run.smithi155.stdout:(140/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-09-19T07:58:56.463 INFO:teuthology.orchestra.run.smithi155.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 354 kB/s | 36 kB 00:00 2024-09-19T07:58:56.489 INFO:teuthology.orchestra.run.smithi155.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 805 kB/s | 74 kB 00:00 2024-09-19T07:58:56.518 INFO:teuthology.orchestra.run.smithi155.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-19T07:58:56.547 INFO:teuthology.orchestra.run.smithi155.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-19T07:58:56.573 INFO:teuthology.orchestra.run.smithi155.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 342 kB/s | 20 kB 00:00 2024-09-19T07:58:56.584 INFO:teuthology.orchestra.run.smithi203.stdout:(48/156): ceph-mgr-diskprediction-local-19.1.1- 5.0 MB/s | 7.4 MB 00:01 2024-09-19T07:58:56.598 INFO:teuthology.orchestra.run.smithi155.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T07:58:56.632 INFO:teuthology.orchestra.run.smithi155.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-19T07:58:56.677 INFO:teuthology.orchestra.run.smithi203.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 1.9 MB/s | 689 kB 00:00 2024-09-19T07:58:56.682 INFO:teuthology.orchestra.run.smithi155.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T07:58:56.710 INFO:teuthology.orchestra.run.smithi203.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 943 kB 00:00 2024-09-19T07:58:56.736 INFO:teuthology.orchestra.run.smithi203.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 370 kB/s | 22 kB 00:00 2024-09-19T07:58:56.761 INFO:teuthology.orchestra.run.smithi203.stdout:(52/156): boost-program-options-1.75.0-8.el9.x8 608 kB/s | 107 kB 00:00 2024-09-19T07:58:56.786 INFO:teuthology.orchestra.run.smithi203.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-09-19T07:58:56.811 INFO:teuthology.orchestra.run.smithi203.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 432 kB/s | 33 kB 00:00 2024-09-19T07:58:56.837 INFO:teuthology.orchestra.run.smithi203.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-19T07:58:56.857 INFO:teuthology.orchestra.run.smithi155.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-19T07:58:56.862 INFO:teuthology.orchestra.run.smithi203.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-19T07:58:56.887 INFO:teuthology.orchestra.run.smithi203.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-19T07:58:56.912 INFO:teuthology.orchestra.run.smithi203.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-19T07:58:56.926 INFO:teuthology.orchestra.run.smithi027.stdout:(31/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 19 MB/s | 49 MB 00:02 2024-09-19T07:58:56.971 INFO:teuthology.orchestra.run.smithi203.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-19T07:58:56.992 INFO:teuthology.orchestra.run.smithi027.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 3.7 MB/s | 249 kB 00:00 2024-09-19T07:58:57.008 INFO:teuthology.orchestra.run.smithi155.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 8.4 MB/s | 3.2 MB 00:00 2024-09-19T07:58:57.051 INFO:teuthology.orchestra.run.smithi027.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 849 kB/s | 49 kB 00:00 2024-09-19T07:58:57.054 INFO:teuthology.orchestra.run.smithi203.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-09-19T07:58:57.072 INFO:teuthology.orchestra.run.smithi203.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 244 kB/s | 24 kB 00:00 2024-09-19T07:58:57.097 INFO:teuthology.orchestra.run.smithi203.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-19T07:58:57.144 INFO:teuthology.orchestra.run.smithi027.stdout:(34/156): ceph-mgr-diskprediction-local-19.1.1- 10 MB/s | 7.4 MB 00:00 2024-09-19T07:58:57.156 INFO:teuthology.orchestra.run.smithi203.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-19T07:58:57.168 INFO:teuthology.orchestra.run.smithi027.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 141 kB/s | 16 kB 00:00 2024-09-19T07:58:57.198 INFO:teuthology.orchestra.run.smithi203.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 928 kB/s | 38 kB 00:00 2024-09-19T07:58:57.225 INFO:teuthology.orchestra.run.smithi155.stdout:(151/156): NetworkManager-libnm-1.51.0-1.el9.x8 4.9 MB/s | 1.8 MB 00:00 2024-09-19T07:58:57.227 INFO:teuthology.orchestra.run.smithi027.stdout:(36/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 4.4 MB/s | 3.6 MB 00:00 2024-09-19T07:58:57.239 INFO:teuthology.orchestra.run.smithi203.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-09-19T07:58:57.250 INFO:teuthology.orchestra.run.smithi155.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 169 kB/s | 41 kB 00:00 2024-09-19T07:58:57.252 INFO:teuthology.orchestra.run.smithi027.stdout:(37/156): ceph-volume-19.1.1-361.g2f599a46.el9. 2.6 MB/s | 285 kB 00:00 2024-09-19T07:58:57.277 INFO:teuthology.orchestra.run.smithi027.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 364 kB/s | 18 kB 00:00 2024-09-19T07:58:57.317 INFO:teuthology.orchestra.run.smithi155.stdout:(153/156): NetworkManager-1.51.0-1.el9.x86_64.r 3.7 MB/s | 2.3 MB 00:00 2024-09-19T07:58:57.319 INFO:teuthology.orchestra.run.smithi027.stdout:(39/156): cephadm-19.1.1-361.g2f599a46.el9.noar 5.0 MB/s | 765 kB 00:00 2024-09-19T07:58:57.367 INFO:teuthology.orchestra.run.smithi155.stdout:(154/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.7 MB/s | 249 kB 00:00 2024-09-19T07:58:57.411 INFO:teuthology.orchestra.run.smithi027.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 503 kB/s | 80 kB 00:00 2024-09-19T07:58:57.470 INFO:teuthology.orchestra.run.smithi027.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-19T07:58:57.495 INFO:teuthology.orchestra.run.smithi027.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-19T07:58:57.521 INFO:teuthology.orchestra.run.smithi027.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-19T07:58:57.546 INFO:teuthology.orchestra.run.smithi027.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-19T07:58:57.550 INFO:teuthology.orchestra.run.smithi155.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 4.5 MB/s | 1.4 MB 00:00 2024-09-19T07:58:57.571 INFO:teuthology.orchestra.run.smithi027.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-19T07:58:57.597 INFO:teuthology.orchestra.run.smithi027.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T07:58:57.621 INFO:teuthology.orchestra.run.smithi027.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T07:58:57.672 INFO:teuthology.orchestra.run.smithi027.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-19T07:58:57.832 INFO:teuthology.orchestra.run.smithi203.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-09-19T07:58:58.339 INFO:teuthology.orchestra.run.smithi027.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 160 kB/s | 107 kB 00:00 2024-09-19T07:58:58.456 INFO:teuthology.orchestra.run.smithi027.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 802 kB/s | 689 kB 00:00 2024-09-19T07:58:58.476 INFO:teuthology.orchestra.run.smithi155.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.1 MB/s | 2.4 MB 00:01 2024-09-19T07:58:58.482 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-09-19T07:58:58.482 INFO:teuthology.orchestra.run.smithi155.stdout:Total 23 MB/s | 226 MB 00:09 2024-09-19T07:58:58.514 INFO:teuthology.orchestra.run.smithi027.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-19T07:58:58.615 INFO:teuthology.orchestra.run.smithi203.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-09-19T07:58:58.865 INFO:teuthology.orchestra.run.smithi027.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 41 kB/s | 22 kB 00:00 2024-09-19T07:58:59.065 INFO:teuthology.orchestra.run.smithi027.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2024-09-19T07:58:59.082 INFO:teuthology.orchestra.run.smithi203.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 1.9 MB/s | 910 kB 00:00 2024-09-19T07:58:59.183 INFO:teuthology.orchestra.run.smithi203.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 2.5 MB/s | 4.9 MB 00:01 2024-09-19T07:58:59.233 INFO:teuthology.orchestra.run.smithi203.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 914 kB/s | 137 kB 00:00 2024-09-19T07:58:59.240 INFO:teuthology.orchestra.run.smithi027.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 400 kB/s | 313 kB 00:00 2024-09-19T07:58:59.508 INFO:teuthology.orchestra.run.smithi203.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 4.4 MB 00:02 2024-09-19T07:58:59.590 INFO:teuthology.orchestra.run.smithi027.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 35 kB/s | 18 kB 00:00 2024-09-19T07:58:59.591 INFO:teuthology.orchestra.run.smithi203.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-19T07:58:59.687 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-09-19T07:58:59.724 INFO:teuthology.orchestra.run.smithi027.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-19T07:58:59.767 INFO:teuthology.orchestra.run.smithi203.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.9 MB/s | 1.0 MB 00:00 2024-09-19T07:58:59.817 INFO:teuthology.orchestra.run.smithi203.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-19T07:58:59.841 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-09-19T07:58:59.841 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-09-19T07:58:59.959 INFO:teuthology.orchestra.run.smithi203.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-19T07:58:59.999 INFO:teuthology.orchestra.run.smithi027.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.6 MB/s | 3.0 MB 00:01 2024-09-19T07:59:00.110 INFO:teuthology.orchestra.run.smithi203.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-09-19T07:59:00.151 INFO:teuthology.orchestra.run.smithi203.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 617 kB/s | 26 kB 00:00 2024-09-19T07:59:00.193 INFO:teuthology.orchestra.run.smithi203.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 460 kB/s | 19 kB 00:00 2024-09-19T07:59:00.300 INFO:teuthology.orchestra.run.smithi027.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 79 kB/s | 45 kB 00:00 2024-09-19T07:59:00.310 INFO:teuthology.orchestra.run.smithi203.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-19T07:59:00.325 INFO:teuthology.orchestra.run.smithi027.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 218 kB/s | 160 kB 00:00 2024-09-19T07:59:00.352 INFO:teuthology.orchestra.run.smithi203.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 838 kB/s | 35 kB 00:00 2024-09-19T07:59:00.900 INFO:teuthology.orchestra.run.smithi027.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 43 kB/s | 24 kB 00:00 2024-09-19T07:59:00.958 INFO:teuthology.orchestra.run.smithi027.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 691 kB/s | 662 kB 00:00 2024-09-19T07:59:01.242 INFO:teuthology.orchestra.run.smithi027.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 618 kB/s | 581 kB 00:00 2024-09-19T07:59:01.476 INFO:teuthology.orchestra.run.smithi027.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-09-19T07:59:01.651 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-09-19T07:59:01.651 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-09-19T07:59:01.743 INFO:teuthology.orchestra.run.smithi027.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 373 kB/s | 292 kB 00:00 2024-09-19T07:59:01.993 INFO:teuthology.orchestra.run.smithi027.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 251 kB/s | 188 kB 00:00 2024-09-19T07:59:02.019 INFO:teuthology.orchestra.run.smithi203.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 2.0 MB/s | 5.8 MB 00:02 2024-09-19T07:59:02.085 INFO:teuthology.orchestra.run.smithi027.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 64 kB/s | 38 kB 00:00 2024-09-19T07:59:02.161 INFO:teuthology.orchestra.run.smithi203.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 250 kB 00:00 2024-09-19T07:59:02.303 INFO:teuthology.orchestra.run.smithi203.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-09-19T07:59:02.411 INFO:teuthology.orchestra.run.smithi203.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 712 kB/s | 77 kB 00:00 2024-09-19T07:59:02.470 INFO:teuthology.orchestra.run.smithi203.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 723 kB/s | 42 kB 00:00 2024-09-19T07:59:02.537 INFO:teuthology.orchestra.run.smithi203.stdout:(86/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.3 MB/s | 5.1 MB 00:02 2024-09-19T07:59:02.621 INFO:teuthology.orchestra.run.smithi203.stdout:(87/156): python3-babel-2.9.1-2.el9.noarch.rpm 2.0 MB/s | 6.0 MB 00:03 2024-09-19T07:59:02.680 INFO:teuthology.orchestra.run.smithi203.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-19T07:59:02.705 INFO:teuthology.orchestra.run.smithi203.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 950 kB/s | 159 kB 00:00 2024-09-19T07:59:02.730 INFO:teuthology.orchestra.run.smithi203.stdout:(90/156): python3-protobuf-3.14.0-13.el9.noarch 1.0 MB/s | 269 kB 00:00 2024-09-19T07:59:02.747 INFO:teuthology.orchestra.run.smithi203.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 760 kB/s | 51 kB 00:00 2024-09-19T07:59:02.764 INFO:teuthology.orchestra.run.smithi203.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 907 kB/s | 54 kB 00:00 2024-09-19T07:59:02.790 INFO:teuthology.orchestra.run.smithi203.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 986 kB/s | 42 kB 00:00 2024-09-19T07:59:02.806 INFO:teuthology.orchestra.run.smithi203.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-19T07:59:02.848 INFO:teuthology.orchestra.run.smithi203.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 866 kB/s | 36 kB 00:00 2024-09-19T07:59:02.890 INFO:teuthology.orchestra.run.smithi203.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-19T07:59:02.932 INFO:teuthology.orchestra.run.smithi203.stdout:(97/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-09-19T07:59:02.943 INFO:teuthology.orchestra.run.smithi027.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.1 MB/s | 4.9 MB 00:01 2024-09-19T07:59:02.974 INFO:teuthology.orchestra.run.smithi203.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-19T07:59:03.058 INFO:teuthology.orchestra.run.smithi203.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.1 MB/s | 96 kB 00:00 2024-09-19T07:59:03.083 INFO:teuthology.orchestra.run.smithi203.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-09-19T07:59:03.093 INFO:teuthology.orchestra.run.smithi027.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:01 2024-09-19T07:59:03.134 INFO:teuthology.orchestra.run.smithi203.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 898 kB/s | 45 kB 00:00 2024-09-19T07:59:03.159 INFO:teuthology.orchestra.run.smithi203.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 633 kB/s | 64 kB 00:00 2024-09-19T07:59:03.160 INFO:teuthology.orchestra.run.smithi027.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-09-19T07:59:03.234 INFO:teuthology.orchestra.run.smithi203.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-09-19T07:59:03.293 INFO:teuthology.orchestra.run.smithi203.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T07:59:03.326 INFO:teuthology.orchestra.run.smithi203.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-19T07:59:03.352 INFO:teuthology.orchestra.run.smithi203.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-19T07:59:03.385 INFO:teuthology.orchestra.run.smithi203.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-09-19T07:59:03.436 INFO:teuthology.orchestra.run.smithi203.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 521 kB/s | 26 kB 00:00 2024-09-19T07:59:03.469 INFO:teuthology.orchestra.run.smithi203.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-19T07:59:03.503 INFO:teuthology.orchestra.run.smithi203.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-19T07:59:03.537 INFO:teuthology.orchestra.run.smithi203.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-19T07:59:03.604 INFO:teuthology.orchestra.run.smithi203.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-19T07:59:03.637 INFO:teuthology.orchestra.run.smithi203.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-19T07:59:03.671 INFO:teuthology.orchestra.run.smithi203.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-19T07:59:03.696 INFO:teuthology.orchestra.run.smithi203.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 743 kB/s | 43 kB 00:00 2024-09-19T07:59:03.722 INFO:teuthology.orchestra.run.smithi203.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-09-19T07:59:03.747 INFO:teuthology.orchestra.run.smithi203.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-19T07:59:03.772 INFO:teuthology.orchestra.run.smithi203.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T07:59:03.794 INFO:teuthology.orchestra.run.smithi027.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 196 kB/s | 137 kB 00:00 2024-09-19T07:59:03.814 INFO:teuthology.orchestra.run.smithi203.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-19T07:59:03.840 INFO:teuthology.orchestra.run.smithi203.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-19T07:59:03.852 INFO:teuthology.orchestra.run.smithi027.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 1.0 MB/s | 910 kB 00:00 2024-09-19T07:59:03.873 INFO:teuthology.orchestra.run.smithi203.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-19T07:59:03.899 INFO:teuthology.orchestra.run.smithi203.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-19T07:59:03.924 INFO:teuthology.orchestra.run.smithi203.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-19T07:59:03.949 INFO:teuthology.orchestra.run.smithi203.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 703 kB/s | 18 kB 00:00 2024-09-19T07:59:03.975 INFO:teuthology.orchestra.run.smithi203.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 924 kB/s | 23 kB 00:00 2024-09-19T07:59:04.025 INFO:teuthology.orchestra.run.smithi203.stdout:(126/156): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-09-19T07:59:04.050 INFO:teuthology.orchestra.run.smithi203.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-09-19T07:59:04.075 INFO:teuthology.orchestra.run.smithi203.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-19T07:59:04.101 INFO:teuthology.orchestra.run.smithi203.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T07:59:04.126 INFO:teuthology.orchestra.run.smithi203.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T07:59:04.151 INFO:teuthology.orchestra.run.smithi203.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T07:59:04.241 INFO:teuthology.orchestra.run.smithi203.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 5.4 MB/s | 1.0 MB 00:00 2024-09-19T07:59:04.278 INFO:teuthology.orchestra.run.smithi203.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 451 kB/s | 16 kB 00:00 2024-09-19T07:59:04.303 INFO:teuthology.orchestra.run.smithi203.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-19T07:59:04.328 INFO:teuthology.orchestra.run.smithi203.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-19T07:59:04.353 INFO:teuthology.orchestra.run.smithi203.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-19T07:59:04.379 INFO:teuthology.orchestra.run.smithi203.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-19T07:59:04.395 INFO:teuthology.orchestra.run.smithi027.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 4.7 MB/s | 5.8 MB 00:01 2024-09-19T07:59:04.404 INFO:teuthology.orchestra.run.smithi203.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T07:59:04.429 INFO:teuthology.orchestra.run.smithi203.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-19T07:59:04.455 INFO:teuthology.orchestra.run.smithi203.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-19T07:59:04.472 INFO:teuthology.orchestra.run.smithi203.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-19T07:59:04.497 INFO:teuthology.orchestra.run.smithi203.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T07:59:04.522 INFO:teuthology.orchestra.run.smithi203.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-19T07:59:04.556 INFO:teuthology.orchestra.run.smithi203.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 596 kB/s | 20 kB 00:00 2024-09-19T07:59:04.583 INFO:teuthology.orchestra.run.smithi203.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-19T07:59:04.603 INFO:teuthology.orchestra.run.smithi027.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 117 kB/s | 87 kB 00:00 2024-09-19T07:59:04.607 INFO:teuthology.orchestra.run.smithi203.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-19T07:59:04.665 INFO:teuthology.orchestra.run.smithi203.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-19T07:59:04.720 INFO:teuthology.orchestra.run.smithi027.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-19T07:59:04.916 INFO:teuthology.orchestra.run.smithi203.stdout:(148/156): librados2-19.1.1-361.g2f599a46.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-19T07:59:04.966 INFO:teuthology.orchestra.run.smithi203.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-19T07:59:05.200 INFO:teuthology.orchestra.run.smithi203.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 8.2 MB/s | 2.3 MB 00:00 2024-09-19T07:59:05.242 INFO:teuthology.orchestra.run.smithi203.stdout:(151/156): NetworkManager-libnm-1.51.0-1.el9.x8 6.6 MB/s | 1.8 MB 00:00 2024-09-19T07:59:05.258 INFO:teuthology.orchestra.run.smithi203.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 698 kB/s | 41 kB 00:00 2024-09-19T07:59:05.287 INFO:teuthology.orchestra.run.smithi027.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 90 kB/s | 61 kB 00:00 2024-09-19T07:59:05.292 INFO:teuthology.orchestra.run.smithi203.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 4.9 MB/s | 249 kB 00:00 2024-09-19T07:59:05.334 INFO:teuthology.orchestra.run.smithi203.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-09-19T07:59:05.401 INFO:teuthology.orchestra.run.smithi203.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-19T07:59:05.571 INFO:teuthology.orchestra.run.smithi027.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-09-19T07:59:05.604 INFO:teuthology.orchestra.run.smithi027.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 277 kB/s | 245 kB 00:00 2024-09-19T07:59:06.079 INFO:teuthology.orchestra.run.smithi027.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 40 kB/s | 19 kB 00:00 2024-09-19T07:59:06.104 INFO:teuthology.orchestra.run.smithi027.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 49 kB/s | 26 kB 00:00 2024-09-19T07:59:06.130 INFO:teuthology.orchestra.run.smithi027.stdout:(80/156): python3-jinja2-2.11.3-6.el9.noarch.rp 295 kB/s | 248 kB 00:00 2024-09-19T07:59:06.730 INFO:teuthology.orchestra.run.smithi027.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 56 kB/s | 35 kB 00:00 2024-09-19T07:59:06.789 INFO:teuthology.orchestra.run.smithi027.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 243 kB/s | 172 kB 00:00 2024-09-19T07:59:07.239 INFO:teuthology.orchestra.run.smithi027.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.6 MB/s | 5.1 MB 00:01 2024-09-19T07:59:07.539 INFO:teuthology.orchestra.run.smithi027.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 310 kB/s | 250 kB 00:00 2024-09-19T07:59:07.564 INFO:teuthology.orchestra.run.smithi027.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 287 kB/s | 222 kB 00:00 2024-09-19T07:59:07.873 INFO:teuthology.orchestra.run.smithi027.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 122 kB/s | 77 kB 00:00 2024-09-19T07:59:08.016 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-09-19T07:59:08.105 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T07:59:08.140 INFO:teuthology.orchestra.run.smithi027.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 70 kB/s | 42 kB 00:00 2024-09-19T07:59:08.151 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T07:59:08.222 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T07:59:08.264 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T07:59:08.289 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T07:59:08.332 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T07:59:08.348 INFO:teuthology.orchestra.run.smithi027.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 344 kB/s | 269 kB 00:00 2024-09-19T07:59:08.590 INFO:teuthology.orchestra.run.smithi027.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 222 kB/s | 159 kB 00:00 2024-09-19T07:59:08.662 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T07:59:08.774 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:59:08.913 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:59:08.932 INFO:teuthology.orchestra.run.smithi027.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 352 kB/s | 279 kB 00:00 2024-09-19T07:59:08.941 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:59:08.957 INFO:teuthology.orchestra.run.smithi027.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 84 kB/s | 51 kB 00:00 2024-09-19T07:59:09.033 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:59:09.063 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:59:09.199 INFO:teuthology.orchestra.run.smithi027.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 88 kB/s | 54 kB 00:00 2024-09-19T07:59:09.215 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T07:59:09.277 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T07:59:09.304 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:59:09.399 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:59:09.422 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:59:09.468 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:59:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:59:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:59:09.525 INFO:teuthology.orchestra.run.smithi027.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 73 kB/s | 42 kB 00:00 2024-09-19T07:59:09.709 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:59:09.775 INFO:teuthology.orchestra.run.smithi027.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 77 kB/s | 44 kB 00:00 2024-09-19T07:59:09.842 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:59:09.964 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T07:59:10.062 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:59:10.140 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:59:10.367 INFO:teuthology.orchestra.run.smithi027.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-19T07:59:10.374 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:59:10.392 INFO:teuthology.orchestra.run.smithi027.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 255 kB/s | 221 kB 00:00 2024-09-19T07:59:10.417 INFO:teuthology.orchestra.run.smithi027.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 56 kB/s | 36 kB 00:00 2024-09-19T07:59:10.478 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T07:59:10.576 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T07:59:10.616 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T07:59:10.659 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T07:59:10.733 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T07:59:10.786 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T07:59:10.826 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T07:59:10.870 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T07:59:10.911 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T07:59:10.947 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T07:59:10.993 INFO:teuthology.orchestra.run.smithi027.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 76 kB/s | 47 kB 00:00 2024-09-19T07:59:11.017 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T07:59:11.043 INFO:teuthology.orchestra.run.smithi027.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 92 kB/s | 58 kB 00:00 2024-09-19T07:59:11.069 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T07:59:11.100 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T07:59:11.144 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T07:59:11.185 INFO:teuthology.orchestra.run.smithi027.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 396 kB/s | 304 kB 00:00 2024-09-19T07:59:11.234 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T07:59:11.271 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T07:59:11.314 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T07:59:11.334 INFO:teuthology.orchestra.run.smithi203.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.9 MB/s | 16 MB 00:08 2024-09-19T07:59:11.340 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-19T07:59:11.340 INFO:teuthology.orchestra.run.smithi203.stdout:Total 10 MB/s | 226 MB 00:21 2024-09-19T07:59:11.343 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T07:59:11.415 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T07:59:11.466 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T07:59:11.549 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T07:59:11.643 INFO:teuthology.orchestra.run.smithi027.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 147 kB/s | 96 kB 00:00 2024-09-19T07:59:11.669 INFO:teuthology.orchestra.run.smithi027.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 102 kB/s | 64 kB 00:00 2024-09-19T07:59:11.693 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T07:59:11.744 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T07:59:11.777 INFO:teuthology.orchestra.run.smithi027.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 168 kB/s | 22 kB 00:00 2024-09-19T07:59:11.811 INFO:teuthology.orchestra.run.smithi027.stdout:(104/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 72 kB/s | 45 kB 00:00 2024-09-19T07:59:11.853 INFO:teuthology.orchestra.run.smithi027.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-19T07:59:11.878 INFO:teuthology.orchestra.run.smithi027.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 852 kB/s | 19 kB 00:00 2024-09-19T07:59:11.920 INFO:teuthology.orchestra.run.smithi027.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-19T07:59:11.937 INFO:teuthology.orchestra.run.smithi027.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-19T07:59:11.962 INFO:teuthology.orchestra.run.smithi027.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T07:59:11.987 INFO:teuthology.orchestra.run.smithi027.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T07:59:12.013 INFO:teuthology.orchestra.run.smithi027.stdout:(111/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-09-19T07:59:12.038 INFO:teuthology.orchestra.run.smithi027.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-19T07:59:12.088 INFO:teuthology.orchestra.run.smithi027.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-19T07:59:12.113 INFO:teuthology.orchestra.run.smithi027.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T07:59:12.139 INFO:teuthology.orchestra.run.smithi027.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T07:59:12.164 INFO:teuthology.orchestra.run.smithi027.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 568 kB/s | 14 kB 00:00 2024-09-19T07:59:12.206 INFO:teuthology.orchestra.run.smithi027.stdout:(117/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.2 MB/s | 839 kB 00:00 2024-09-19T07:59:12.231 INFO:teuthology.orchestra.run.smithi027.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-09-19T07:59:12.273 INFO:teuthology.orchestra.run.smithi027.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-19T07:59:12.279 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T07:59:12.365 INFO:teuthology.orchestra.run.smithi027.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-09-19T07:59:12.366 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T07:59:12.391 INFO:teuthology.orchestra.run.smithi027.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 1.8 MB/s | 220 kB 00:00 2024-09-19T07:59:12.402 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T07:59:12.424 INFO:teuthology.orchestra.run.smithi027.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-19T07:59:12.466 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T07:59:12.491 INFO:teuthology.orchestra.run.smithi027.stdout:(123/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.2 MB/s | 4.4 MB 00:00 2024-09-19T07:59:12.500 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T07:59:12.516 INFO:teuthology.orchestra.run.smithi027.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-09-19T07:59:12.541 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T07:59:12.542 INFO:teuthology.orchestra.run.smithi027.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-19T07:59:12.567 INFO:teuthology.orchestra.run.smithi027.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-19T07:59:12.577 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-19T07:59:12.592 INFO:teuthology.orchestra.run.smithi027.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-19T07:59:12.617 INFO:teuthology.orchestra.run.smithi027.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-19T07:59:12.651 INFO:teuthology.orchestra.run.smithi027.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-19T07:59:12.676 INFO:teuthology.orchestra.run.smithi027.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T07:59:12.702 INFO:teuthology.orchestra.run.smithi027.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T07:59:12.711 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T07:59:12.727 INFO:teuthology.orchestra.run.smithi027.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-09-19T07:59:12.730 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-19T07:59:12.730 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-19T07:59:12.760 INFO:teuthology.orchestra.run.smithi027.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-19T07:59:12.782 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T07:59:12.786 INFO:teuthology.orchestra.run.smithi027.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-19T07:59:12.802 INFO:teuthology.orchestra.run.smithi027.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-09-19T07:59:12.828 INFO:teuthology.orchestra.run.smithi027.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 678 kB/s | 28 kB 00:00 2024-09-19T07:59:12.837 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T07:59:12.853 INFO:teuthology.orchestra.run.smithi027.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-19T07:59:12.879 INFO:teuthology.orchestra.run.smithi027.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T07:59:12.904 INFO:teuthology.orchestra.run.smithi027.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-19T07:59:12.910 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T07:59:12.929 INFO:teuthology.orchestra.run.smithi027.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-19T07:59:12.941 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T07:59:12.971 INFO:teuthology.orchestra.run.smithi027.stdout:(141/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.4 MB/s | 2.0 MB 00:00 2024-09-19T07:59:12.977 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T07:59:12.996 INFO:teuthology.orchestra.run.smithi027.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 808 kB/s | 74 kB 00:00 2024-09-19T07:59:13.021 INFO:teuthology.orchestra.run.smithi027.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-19T07:59:13.024 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T07:59:13.055 INFO:teuthology.orchestra.run.smithi027.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 601 kB/s | 20 kB 00:00 2024-09-19T07:59:13.060 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T07:59:13.080 INFO:teuthology.orchestra.run.smithi027.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-09-19T07:59:13.104 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T07:59:13.114 INFO:teuthology.orchestra.run.smithi027.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T07:59:13.139 INFO:teuthology.orchestra.run.smithi027.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-19T07:59:13.146 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T07:59:13.189 INFO:teuthology.orchestra.run.smithi027.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T07:59:13.291 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T07:59:13.339 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T07:59:13.381 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T07:59:13.382 INFO:teuthology.orchestra.run.smithi027.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 13 MB/s | 3.2 MB 00:00 2024-09-19T07:59:13.432 INFO:teuthology.orchestra.run.smithi027.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 9.6 MB/s | 2.3 MB 00:00 2024-09-19T07:59:13.465 INFO:teuthology.orchestra.run.smithi027.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 1.2 MB/s | 41 kB 00:00 2024-09-19T07:59:13.485 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T07:59:13.499 INFO:teuthology.orchestra.run.smithi027.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 7.3 MB/s | 249 kB 00:00 2024-09-19T07:59:13.514 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T07:59:13.558 INFO:teuthology.orchestra.run.smithi027.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 10 MB/s | 1.8 MB 00:00 2024-09-19T07:59:13.600 INFO:teuthology.orchestra.run.smithi027.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-09-19T07:59:13.658 INFO:teuthology.orchestra.run.smithi027.stdout:(155/156): librados2-19.1.1-361.g2f599a46.el9.x 6.3 MB/s | 3.4 MB 00:00 2024-09-19T07:59:13.709 INFO:teuthology.orchestra.run.smithi027.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2024-09-19T07:59:13.715 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-19T07:59:13.715 INFO:teuthology.orchestra.run.smithi027.stdout:Total 11 MB/s | 226 MB 00:21 2024-09-19T07:59:13.819 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T07:59:13.872 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T07:59:13.897 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T07:59:13.979 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T07:59:14.109 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T07:59:14.154 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T07:59:14.182 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T07:59:14.216 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T07:59:14.255 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T07:59:14.295 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T07:59:14.325 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T07:59:14.360 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T07:59:14.394 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T07:59:14.435 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T07:59:14.470 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T07:59:14.557 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T07:59:14.600 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T07:59:14.604 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-19T07:59:14.604 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-19T07:59:14.640 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T07:59:14.744 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T07:59:14.799 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T07:59:14.952 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2024-09-19T07:59:15.121 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2024-09-19T07:59:15.121 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2024-09-19T07:59:15.531 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T07:59:15.582 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T07:59:15.616 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T07:59:15.718 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T07:59:15.771 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T07:59:15.824 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T07:59:15.912 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T07:59:15.952 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T07:59:16.136 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T07:59:16.166 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T07:59:16.244 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T07:59:16.899 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T07:59:17.016 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T07:59:17.457 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2024-09-19T07:59:17.458 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2024-09-19T07:59:18.265 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T07:59:18.346 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T07:59:18.375 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T07:59:18.407 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T07:59:18.718 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T07:59:18.754 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:59:18.844 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:59:18.867 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T07:59:18.903 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T07:59:19.385 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T07:59:19.431 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:59:19.503 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:59:19.533 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T07:59:21.024 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-19T07:59:21.154 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T07:59:21.284 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T07:59:21.465 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T07:59:21.506 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T07:59:21.531 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T07:59:21.575 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T07:59:21.859 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:59:21.888 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:59:21.905 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T07:59:22.016 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:59:22.139 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:59:22.175 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:59:22.267 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:59:22.305 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:59:22.442 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:59:22.452 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T07:59:22.475 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:59:22.510 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T07:59:22.538 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:59:22.564 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:59:22.564 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T07:59:22.564 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T07:59:22.565 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T07:59:22.593 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:59:22.626 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:59:22.648 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:59:22.694 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:59:22.716 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:59:22.738 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:59:22.926 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:59:23.062 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:59:23.190 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T07:59:23.287 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:59:23.366 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:59:23.606 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:59:23.718 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T07:59:23.818 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T07:59:23.856 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T07:59:23.898 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T07:59:23.976 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T07:59:24.020 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T07:59:24.060 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T07:59:24.113 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T07:59:24.153 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T07:59:24.182 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T07:59:24.247 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2024-09-19T07:59:24.251 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T07:59:24.312 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T07:59:24.343 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T07:59:24.381 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T07:59:24.387 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T07:59:24.420 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T07:59:24.464 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T07:59:24.474 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T07:59:24.498 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T07:59:24.515 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T07:59:24.540 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T07:59:24.542 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T07:59:24.570 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T07:59:24.596 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T07:59:24.647 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T07:59:24.719 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T07:59:24.793 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T07:59:24.934 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T07:59:24.940 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T07:59:24.996 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T07:59:25.049 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:59:25.199 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:59:25.225 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:59:25.318 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:59:25.346 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:59:25.514 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T07:59:25.522 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T07:59:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T07:59:25.601 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T07:59:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:59:25.630 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T07:59:25.673 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T07:59:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:59:25.711 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T07:59:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:59:25.761 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T07:59:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:59:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:59:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:59:25.929 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T07:59:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:59:25.998 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T07:59:26.061 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T07:59:26.134 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T07:59:26.166 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T07:59:26.175 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:59:26.203 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T07:59:26.249 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T07:59:26.294 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T07:59:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T07:59:26.345 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T07:59:26.387 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T07:59:26.416 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:59:26.481 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:59:26.521 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T07:59:26.581 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T07:59:26.623 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T07:59:26.719 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:59:26.724 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T07:59:26.766 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T07:59:26.813 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T07:59:26.832 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T07:59:26.847 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T07:59:26.872 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T07:59:26.927 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T07:59:26.946 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T07:59:26.970 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T07:59:27.013 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T07:59:27.074 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T07:59:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T07:59:27.114 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T07:59:27.139 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T07:59:27.142 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T07:59:27.176 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T07:59:27.179 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T07:59:27.215 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T07:59:27.223 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T07:59:27.255 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T07:59:27.256 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T07:59:27.283 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T07:59:27.294 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T07:59:27.328 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T07:59:27.354 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T07:59:27.362 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T07:59:27.403 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T07:59:27.406 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T07:59:27.436 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T07:59:27.438 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T07:59:27.479 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T07:59:27.524 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T07:59:27.558 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T07:59:27.569 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T07:59:27.591 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T07:59:27.608 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T07:59:27.635 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T07:59:27.654 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T07:59:27.721 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T07:59:27.727 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T07:59:27.769 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T07:59:27.776 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T07:59:27.846 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T07:59:27.992 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T07:59:28.056 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T07:59:28.491 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T07:59:28.612 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T07:59:28.616 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T07:59:28.650 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T07:59:28.694 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T07:59:28.729 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T07:59:28.757 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T07:59:28.781 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T07:59:28.806 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T07:59:28.819 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T07:59:28.849 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T07:59:28.862 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T07:59:28.936 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T07:59:28.989 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T07:59:29.025 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T07:59:29.080 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T07:59:29.136 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T07:59:29.173 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T07:59:29.201 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T07:59:29.209 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T07:59:29.247 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T07:59:29.284 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T07:59:29.286 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T07:59:29.332 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T07:59:29.366 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T07:59:29.410 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T07:59:29.452 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T07:59:29.596 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T07:59:29.637 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T07:59:29.679 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T07:59:29.933 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T07:59:29.946 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T07:59:30.050 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T07:59:30.062 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T07:59:30.102 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T07:59:30.143 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T07:59:30.169 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T07:59:30.281 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T07:59:30.416 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T07:59:30.459 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T07:59:30.482 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T07:59:30.517 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T07:59:30.556 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T07:59:30.596 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T07:59:30.625 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T07:59:30.660 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T07:59:30.693 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T07:59:30.735 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T07:59:30.777 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T07:59:30.867 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T07:59:30.917 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T07:59:30.947 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T07:59:31.054 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T07:59:31.108 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T07:59:31.272 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T07:59:31.357 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T07:59:31.385 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T07:59:31.435 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T07:59:31.744 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T07:59:31.782 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:59:31.869 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T07:59:31.872 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:59:31.903 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T07:59:31.920 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T07:59:31.939 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T07:59:31.954 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T07:59:32.058 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T07:59:32.110 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T07:59:32.155 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T07:59:32.253 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T07:59:32.290 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T07:59:32.432 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T07:59:32.469 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:59:32.473 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T07:59:32.512 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T07:59:32.540 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:59:32.571 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T07:59:32.592 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T07:59:33.295 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T07:59:33.424 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T07:59:34.305 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:59:34.305 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /sys 2024-09-19T07:59:34.305 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /proc 2024-09-19T07:59:34.305 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /mnt 2024-09-19T07:59:34.305 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /var/tmp 2024-09-19T07:59:34.306 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /home 2024-09-19T07:59:34.306 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /root 2024-09-19T07:59:34.306 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /tmp 2024-09-19T07:59:34.306 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T07:59:34.491 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:59:34.507 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:59:34.508 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:34.508 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T07:59:34.508 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T07:59:34.757 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T07:59:34.841 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:59:34.850 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T07:59:34.876 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:59:34.879 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T07:59:34.911 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T07:59:35.238 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T07:59:35.283 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:59:35.382 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:59:35.413 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T07:59:35.423 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:59:35.449 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T07:59:35.480 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:59:35.557 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:59:35.557 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T07:59:35.557 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T07:59:35.557 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T07:59:35.590 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:59:35.965 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T07:59:35.994 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:59:35.994 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:59:36.021 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:59:36.021 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:36.021 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T07:59:36.021 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:59:36.021 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:59:36.021 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T07:59:36.066 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:59:36.095 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T07:59:36.253 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:59:36.276 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:59:36.277 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:36.277 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T07:59:36.277 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:59:36.277 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:59:36.277 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T07:59:36.712 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:59:36.736 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:59:36.736 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:36.736 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T07:59:36.736 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:59:36.736 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:59:36.737 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T07:59:36.859 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T07:59:36.916 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T07:59:36.973 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T07:59:37.162 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T07:59:37.214 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T07:59:37.293 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T07:59:37.383 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T07:59:37.524 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T07:59:37.589 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T07:59:37.620 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T07:59:37.648 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T07:59:38.094 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:59:38.122 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:59:38.154 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T07:59:38.234 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T07:59:38.270 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:59:38.544 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:59:38.575 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:59:39.161 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:59:39.205 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:59:39.299 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:59:39.299 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T07:59:39.300 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T07:59:39.300 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T07:59:39.331 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:59:39.340 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:59:39.372 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:59:40.343 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:59:40.373 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:59:40.477 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:59:40.635 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T07:59:40.666 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:59:40.690 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:59:40.691 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:40.691 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T07:59:40.691 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:59:40.691 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:59:40.691 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T07:59:40.742 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:59:40.754 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:59:40.851 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T07:59:40.899 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T07:59:41.827 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T07:59:41.853 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:59:41.877 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:59:41.877 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:41.878 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T07:59:41.878 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:59:41.878 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:59:41.878 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T07:59:41.920 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:59:41.944 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:59:41.944 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:41.945 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T07:59:41.945 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T07:59:41.996 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:59:42.019 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:59:42.019 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:42.019 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T07:59:42.019 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:59:42.019 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:59:42.020 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T07:59:42.321 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:59:42.345 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:59:42.346 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:42.346 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T07:59:42.346 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:59:42.346 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:59:42.346 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T07:59:46.901 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T07:59:46.942 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T07:59:46.983 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T07:59:47.015 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T07:59:47.042 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T07:59:47.233 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T07:59:47.281 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T07:59:47.311 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T07:59:47.341 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T07:59:47.387 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T07:59:47.663 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:59:47.664 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /sys 2024-09-19T07:59:47.664 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /proc 2024-09-19T07:59:47.664 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /mnt 2024-09-19T07:59:47.664 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /var/tmp 2024-09-19T07:59:47.664 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /home 2024-09-19T07:59:47.664 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /root 2024-09-19T07:59:47.664 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /tmp 2024-09-19T07:59:47.664 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T07:59:47.839 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:59:47.855 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:59:47.855 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:47.856 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T07:59:47.856 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T07:59:48.010 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:59:48.052 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:59:48.073 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:59:48.931 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T07:59:49.016 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T07:59:49.057 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T07:59:49.139 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T07:59:49.178 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T07:59:49.203 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T07:59:49.229 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T07:59:49.229 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T07:59:49.313 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T07:59:49.313 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T07:59:49.334 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:59:49.361 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:59:49.361 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:49.361 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T07:59:49.362 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:59:49.362 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:59:49.362 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T07:59:49.397 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T07:59:49.422 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T07:59:49.428 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:59:49.428 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:59:49.593 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:59:49.607 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:59:49.607 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T07:59:49.617 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:59:49.617 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:49.617 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T07:59:49.617 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:59:49.617 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:59:49.617 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T07:59:49.692 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T07:59:49.754 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:59:50.061 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:59:50.085 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:59:50.085 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:50.085 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T07:59:50.085 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:59:50.085 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:59:50.085 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T07:59:50.199 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T07:59:50.247 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T07:59:50.303 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T07:59:50.494 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T07:59:50.545 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T07:59:50.614 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T07:59:50.703 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T07:59:50.841 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T07:59:50.888 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T07:59:50.920 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T07:59:50.948 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T07:59:51.342 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:59:51.343 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /sys 2024-09-19T07:59:51.343 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /proc 2024-09-19T07:59:51.343 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /mnt 2024-09-19T07:59:51.343 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /var/tmp 2024-09-19T07:59:51.343 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /home 2024-09-19T07:59:51.343 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /root 2024-09-19T07:59:51.343 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /tmp 2024-09-19T07:59:51.343 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T07:59:51.410 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:59:51.447 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:59:51.478 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T07:59:51.526 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:59:51.540 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T07:59:51.542 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:59:51.542 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:51.542 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T07:59:51.542 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T07:59:51.570 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:59:52.618 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:59:52.655 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:59:53.070 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:59:53.099 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:59:53.099 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:53.099 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T07:59:53.099 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:59:53.099 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:59:53.099 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T07:59:53.339 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:59:53.364 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:59:53.364 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:53.364 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T07:59:53.364 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:59:53.364 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:59:53.364 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T07:59:53.613 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:59:53.640 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:59:53.743 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:59:53.832 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:59:53.857 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:59:53.857 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:53.857 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T07:59:53.857 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:59:53.857 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:59:53.857 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T07:59:53.910 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T07:59:53.942 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:59:53.963 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T07:59:53.966 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:59:53.966 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:53.966 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T07:59:53.966 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:59:53.967 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:59:53.967 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T07:59:54.018 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:59:54.021 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T07:59:54.030 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:59:54.084 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T07:59:54.126 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T07:59:54.182 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T07:59:54.280 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T07:59:54.333 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T07:59:54.414 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T07:59:54.513 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T07:59:54.655 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T07:59:54.701 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T07:59:54.732 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T07:59:54.758 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T07:59:55.104 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T07:59:55.137 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:59:55.161 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:59:55.161 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:55.161 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T07:59:55.161 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:59:55.162 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:59:55.162 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T07:59:55.204 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:59:55.223 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:59:55.228 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:59:55.228 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:55.228 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T07:59:55.228 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T07:59:55.249 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:59:55.280 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:59:55.281 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T07:59:55.303 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:59:55.304 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:55.304 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T07:59:55.304 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:59:55.304 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:59:55.304 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T07:59:55.346 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T07:59:55.372 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:59:55.546 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:59:55.546 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T07:59:55.546 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T07:59:55.546 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T07:59:55.546 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T07:59:55.546 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T07:59:55.546 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T07:59:55.546 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T07:59:55.547 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:59:55.547 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:59:55.547 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:59:55.547 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T07:59:55.547 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T07:59:55.547 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:59:55.547 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T07:59:55.547 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T07:59:55.547 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T07:59:55.547 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T07:59:55.547 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T07:59:55.547 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T07:59:55.547 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T07:59:55.548 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T07:59:55.548 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T07:59:55.548 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T07:59:55.548 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T07:59:55.548 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T07:59:55.548 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T07:59:55.548 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T07:59:55.548 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T07:59:55.548 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T07:59:55.549 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T07:59:55.549 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T07:59:55.549 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T07:59:55.549 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T07:59:55.549 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T07:59:55.549 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T07:59:55.549 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T07:59:55.549 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T07:59:55.549 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T07:59:55.549 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T07:59:55.549 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T07:59:55.549 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T07:59:55.550 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T07:59:55.550 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T07:59:55.550 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T07:59:55.550 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T07:59:55.550 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T07:59:55.550 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T07:59:55.550 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T07:59:55.550 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T07:59:55.550 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T07:59:55.550 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T07:59:55.550 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T07:59:55.550 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T07:59:55.550 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T07:59:55.550 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T07:59:55.551 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T07:59:55.551 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T07:59:55.551 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T07:59:55.551 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T07:59:55.551 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T07:59:55.551 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T07:59:55.551 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T07:59:55.551 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T07:59:55.551 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T07:59:55.551 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T07:59:55.551 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T07:59:55.551 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T07:59:55.552 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T07:59:55.552 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T07:59:55.552 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T07:59:55.552 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T07:59:55.552 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T07:59:55.552 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T07:59:55.552 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T07:59:55.552 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T07:59:55.552 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T07:59:55.552 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T07:59:55.552 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T07:59:55.552 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T07:59:55.552 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T07:59:55.552 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T07:59:55.553 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T07:59:55.553 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T07:59:55.553 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T07:59:55.553 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T07:59:55.553 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T07:59:55.553 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T07:59:55.553 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T07:59:55.553 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T07:59:55.553 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T07:59:55.553 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T07:59:55.553 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T07:59:55.553 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T07:59:55.553 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T07:59:55.553 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T07:59:55.554 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T07:59:55.554 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T07:59:55.554 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T07:59:55.554 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T07:59:55.554 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T07:59:55.554 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T07:59:55.554 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T07:59:55.554 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T07:59:55.554 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T07:59:55.554 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T07:59:55.554 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T07:59:55.554 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T07:59:55.554 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T07:59:55.555 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T07:59:55.555 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T07:59:55.555 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T07:59:55.555 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T07:59:55.555 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T07:59:55.555 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T07:59:55.555 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T07:59:55.555 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T07:59:55.555 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T07:59:55.555 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T07:59:55.555 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T07:59:55.555 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T07:59:55.556 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T07:59:55.556 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T07:59:55.556 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T07:59:55.556 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T07:59:55.556 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T07:59:55.556 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T07:59:55.556 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T07:59:55.556 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T07:59:55.556 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T07:59:55.556 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T07:59:55.556 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T07:59:55.557 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T07:59:55.557 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T07:59:55.557 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T07:59:55.557 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T07:59:55.557 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T07:59:55.557 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T07:59:55.557 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T07:59:55.557 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T07:59:55.557 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T07:59:55.557 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T07:59:55.557 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T07:59:55.557 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T07:59:55.557 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T07:59:55.557 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T07:59:55.558 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T07:59:55.558 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T07:59:55.558 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T07:59:55.558 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T07:59:55.558 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T07:59:55.558 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T07:59:55.558 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T07:59:55.558 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T07:59:55.558 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T07:59:55.558 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T07:59:55.558 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T07:59:55.558 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T07:59:55.558 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T07:59:55.558 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T07:59:55.559 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T07:59:55.559 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T07:59:55.559 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T07:59:55.560 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T07:59:55.606 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:59:55.630 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:59:55.630 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:55.630 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T07:59:55.630 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:59:55.630 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:59:55.630 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T07:59:56.480 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:59:56.515 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:59:57.529 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:59:57.557 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:59:57.665 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:59:57.842 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T07:59:57.867 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:59:57.893 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:59:57.893 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:57.893 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T07:59:57.894 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:59:57.894 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:59:57.894 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T07:59:57.943 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:59:57.955 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:59:58.083 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T07:59:58.138 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:59:58.139 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T07:59:58.139 INFO:teuthology.orchestra.run.smithi155.stdout:Upgraded: 2024-09-19T07:59:58.139 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T07:59:58.139 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T07:59:58.139 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T07:59:58.139 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T07:59:58.139 INFO:teuthology.orchestra.run.smithi155.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.139 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.140 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T07:59:58.140 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T07:59:58.140 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-09-19T07:59:58.140 INFO:teuthology.orchestra.run.smithi155.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T07:59:58.140 INFO:teuthology.orchestra.run.smithi155.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T07:59:58.140 INFO:teuthology.orchestra.run.smithi155.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T07:59:58.140 INFO:teuthology.orchestra.run.smithi155.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T07:59:58.140 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.140 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.140 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.141 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.141 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:59:58.141 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.141 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.141 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.141 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:59:58.141 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:59:58.142 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:59:58.142 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:59:58.142 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:59:58.142 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.142 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.142 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:59:58.142 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.142 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.142 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.142 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:59:58.143 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:59:58.143 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.143 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.143 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:59:58.143 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T07:59:58.143 INFO:teuthology.orchestra.run.smithi155.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T07:59:58.143 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T07:59:58.144 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T07:59:58.144 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T07:59:58.144 INFO:teuthology.orchestra.run.smithi155.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T07:59:58.144 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T07:59:58.144 INFO:teuthology.orchestra.run.smithi155.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T07:59:58.144 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T07:59:58.144 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T07:59:58.144 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T07:59:58.144 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.144 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.145 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.145 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T07:59:58.145 INFO:teuthology.orchestra.run.smithi155.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T07:59:58.145 INFO:teuthology.orchestra.run.smithi155.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T07:59:58.145 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T07:59:58.145 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T07:59:58.145 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.145 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.145 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T07:59:58.145 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.145 INFO:teuthology.orchestra.run.smithi155.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T07:59:58.145 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T07:59:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T07:59:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T07:59:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T07:59:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T07:59:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T07:59:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T07:59:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T07:59:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T07:59:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T07:59:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T07:59:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T07:59:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T07:59:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T07:59:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T07:59:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T07:59:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T07:59:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T07:59:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T07:59:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T07:59:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T07:59:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T07:59:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T07:59:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T07:59:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T07:59:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T07:59:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T07:59:58.148 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T07:59:58.148 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T07:59:58.148 INFO:teuthology.orchestra.run.smithi155.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T07:59:58.148 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T07:59:58.148 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T07:59:58.148 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T07:59:58.148 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T07:59:58.148 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T07:59:58.149 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T07:59:58.149 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T07:59:58.149 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T07:59:58.149 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T07:59:58.149 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T07:59:58.149 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T07:59:58.149 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T07:59:58.150 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T07:59:58.150 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T07:59:58.150 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T07:59:58.150 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T07:59:58.150 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T07:59:58.150 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T07:59:58.150 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T07:59:58.150 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T07:59:58.150 INFO:teuthology.orchestra.run.smithi155.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T07:59:58.150 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T07:59:58.150 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T07:59:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T07:59:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T07:59:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T07:59:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T07:59:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T07:59:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T07:59:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T07:59:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T07:59:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T07:59:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T07:59:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T07:59:58.152 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T07:59:58.152 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.152 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T07:59:58.152 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T07:59:58.152 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T07:59:58.152 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T07:59:58.152 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T07:59:58.152 INFO:teuthology.orchestra.run.smithi155.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T07:59:58.152 INFO:teuthology.orchestra.run.smithi155.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T07:59:58.152 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T07:59:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T07:59:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T07:59:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T07:59:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T07:59:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T07:59:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T07:59:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T07:59:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:59:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T07:59:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T07:59:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T07:59:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T07:59:58.154 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T07:59:58.154 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T07:59:58.154 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T07:59:58.154 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T07:59:58.154 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-19T07:59:58.154 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T07:59:58.540 DEBUG:teuthology.parallel:result is None 2024-09-19T07:59:59.119 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T07:59:59.146 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:59:59.171 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:59:59.171 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:59.171 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T07:59:59.172 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:59:59.172 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:59:59.172 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T07:59:59.213 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:59:59.238 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:59:59.238 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:59.238 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T07:59:59.238 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T07:59:59.289 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:59:59.313 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:59:59.313 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:59.313 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T07:59:59.313 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:59:59.313 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:59:59.313 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T07:59:59.639 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:59:59.664 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:59:59.665 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:59:59.665 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T07:59:59.665 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:59:59.665 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:59:59.665 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:00:00.169 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:00:00.210 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:00:00.250 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:00:00.283 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:00:00.310 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:00:00.499 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:00:00.550 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:00:00.580 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:00:00.610 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:00:00.656 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:00:01.294 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:00:01.338 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:00:01.359 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:00:02.198 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:00:02.286 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:00:02.327 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:00:02.416 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:00:02.457 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:00:02.482 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:00:02.508 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:00:02.508 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:00:02.600 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:00:02.601 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:00:02.693 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:00:02.718 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:00:02.724 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:00:02.724 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:00:02.904 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:00:02.904 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:00:02.971 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:00:03.033 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:00:04.485 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:00:04.536 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:00:04.577 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:00:04.608 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:00:04.635 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:00:04.849 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:00:04.890 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:00:04.920 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:00:04.950 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:00:04.988 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:00:05.577 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:00:05.610 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:00:05.632 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:00:06.537 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:00:06.657 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:00:06.697 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:00:06.804 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:00:06.843 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:00:06.869 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:00:06.903 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:00:06.904 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:00:06.996 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:00:06.996 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:00:07.088 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:00:07.113 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:00:07.119 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:00:07.119 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:00:07.307 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:00:07.307 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:00:07.391 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:00:07.459 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:00:08.996 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:00:08.996 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:00:08.996 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:00:08.997 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:00:08.997 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:00:08.997 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:00:08.997 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:00:08.997 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:00:08.997 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:00:08.997 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:00:08.997 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:00:08.997 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:00:08.997 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:00:08.997 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:00:08.997 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:00:08.998 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:00:08.998 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:00:08.998 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:00:08.998 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:00:08.998 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:00:08.998 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:00:08.998 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:00:08.998 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:00:08.998 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:00:08.998 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:00:08.998 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:00:08.998 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:00:08.998 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:00:09.011 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:00:09.011 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:00:09.012 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:00:09.012 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:00:09.012 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:00:09.012 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:00:09.012 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:00:09.012 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:00:09.012 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:00:09.012 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:00:09.012 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:00:09.012 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:00:09.012 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:00:09.012 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:00:09.012 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:00:09.013 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:00:09.013 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:00:09.013 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:00:09.013 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:00:09.013 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:00:09.013 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:00:09.013 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:00:09.013 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:00:09.013 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:00:09.013 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:00:09.013 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:00:09.013 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:00:09.013 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:00:09.014 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:00:09.014 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:00:09.014 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:00:09.014 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:00:09.014 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:00:09.014 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:00:09.014 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:00:09.014 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:00:09.014 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:00:09.014 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:00:09.014 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:00:09.014 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:00:09.014 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:00:09.014 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:00:09.015 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:00:09.015 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:00:09.015 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:00:09.015 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:00:09.015 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:00:09.015 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:00:09.015 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:00:09.015 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:00:09.015 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:00:09.015 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:00:09.015 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:00:09.015 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:00:09.015 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:00:09.015 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:00:09.016 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:00:09.016 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:00:09.016 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:00:09.016 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:00:09.016 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:00:09.016 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:00:09.016 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:00:09.016 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:00:09.016 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:00:09.016 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:00:09.016 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:00:09.016 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:00:09.016 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:00:09.016 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:00:09.017 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:00:09.017 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:00:09.017 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:00:09.017 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:00:09.017 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:00:09.017 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:00:09.017 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:00:09.017 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:00:09.017 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:00:09.017 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:00:09.017 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:00:09.017 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:00:09.017 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:00:09.017 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:00:09.018 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:00:09.018 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:00:09.018 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:00:09.018 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:00:09.018 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:00:09.018 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:00:09.018 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:00:09.018 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:00:09.018 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:00:09.018 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:00:09.018 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:00:09.018 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:00:09.018 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:00:09.019 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:00:09.019 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:00:09.019 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:00:09.019 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:00:09.019 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:00:09.019 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:00:09.019 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:00:09.019 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:00:09.019 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:00:09.019 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:00:09.019 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:00:09.019 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:00:09.019 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:00:09.019 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:00:09.020 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:00:09.020 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:00:09.020 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:00:09.020 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:00:09.020 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:00:09.020 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:00:09.020 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:00:09.020 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:00:09.020 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:00:09.020 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:00:09.020 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:00:09.020 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:00:09.020 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:00:09.020 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:00:09.021 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:00:09.021 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:00:09.021 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:00:09.021 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:00:09.021 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:00:09.021 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:00:09.021 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:00:09.021 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:00:09.021 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:00:09.021 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:00:09.021 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:00:11.843 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:00:11.844 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:00:11.844 INFO:teuthology.orchestra.run.smithi203.stdout:Upgraded: 2024-09-19T08:00:11.844 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:00:11.844 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:00:11.844 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:00:11.844 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:00:11.844 INFO:teuthology.orchestra.run.smithi203.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.844 INFO:teuthology.orchestra.run.smithi203.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.844 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:00:11.844 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:00:11.845 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-19T08:00:11.845 INFO:teuthology.orchestra.run.smithi203.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:00:11.845 INFO:teuthology.orchestra.run.smithi203.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:00:11.845 INFO:teuthology.orchestra.run.smithi203.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:00:11.845 INFO:teuthology.orchestra.run.smithi203.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:00:11.845 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.845 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.845 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.845 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.845 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:00:11.845 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.845 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.846 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.846 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:00:11.846 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:00:11.846 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:00:11.846 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:00:11.846 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:00:11.846 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.846 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.846 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:00:11.846 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.846 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.846 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.846 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:00:11.847 INFO:teuthology.orchestra.run.smithi203.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:00:11.847 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.847 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.847 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:00:11.847 INFO:teuthology.orchestra.run.smithi203.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:00:11.847 INFO:teuthology.orchestra.run.smithi203.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:00:11.847 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:00:11.847 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:00:11.847 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:00:11.848 INFO:teuthology.orchestra.run.smithi203.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:00:11.848 INFO:teuthology.orchestra.run.smithi203.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:00:11.848 INFO:teuthology.orchestra.run.smithi203.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:00:11.848 INFO:teuthology.orchestra.run.smithi203.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:00:11.848 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:00:11.848 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:00:11.848 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.848 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.848 INFO:teuthology.orchestra.run.smithi203.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.848 INFO:teuthology.orchestra.run.smithi203.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:00:11.848 INFO:teuthology.orchestra.run.smithi203.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:00:11.848 INFO:teuthology.orchestra.run.smithi203.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:00:11.848 INFO:teuthology.orchestra.run.smithi203.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:00:11.849 INFO:teuthology.orchestra.run.smithi203.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:00:11.849 INFO:teuthology.orchestra.run.smithi203.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.849 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.849 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:00:11.849 INFO:teuthology.orchestra.run.smithi203.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.849 INFO:teuthology.orchestra.run.smithi203.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:00:11.849 INFO:teuthology.orchestra.run.smithi203.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:00:11.849 INFO:teuthology.orchestra.run.smithi203.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:00:11.849 INFO:teuthology.orchestra.run.smithi203.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:00:11.849 INFO:teuthology.orchestra.run.smithi203.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:00:11.849 INFO:teuthology.orchestra.run.smithi203.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:00:11.849 INFO:teuthology.orchestra.run.smithi203.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:00:11.849 INFO:teuthology.orchestra.run.smithi203.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:00:11.850 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:00:11.850 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:00:11.850 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:00:11.850 INFO:teuthology.orchestra.run.smithi203.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:00:11.850 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:00:11.850 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:00:11.850 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:00:11.850 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:00:11.850 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:00:11.850 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:00:11.850 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:00:11.851 INFO:teuthology.orchestra.run.smithi203.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:00:11.853 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:00:11.853 INFO:teuthology.orchestra.run.smithi203.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:00:11.853 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:00:11.853 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.853 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.853 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.853 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:00:11.853 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:00:11.853 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:00:11.853 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:00:11.853 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:00:11.854 INFO:teuthology.orchestra.run.smithi203.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:00:11.854 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:00:11.854 INFO:teuthology.orchestra.run.smithi203.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:00:11.854 INFO:teuthology.orchestra.run.smithi203.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:00:11.854 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:00:11.854 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:00:11.854 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:00:11.854 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:00:11.854 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:00:11.854 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:00:11.854 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:00:11.854 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:00:11.854 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:00:11.854 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:00:11.855 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:00:11.855 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:00:11.855 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:00:11.855 INFO:teuthology.orchestra.run.smithi203.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:00:11.855 INFO:teuthology.orchestra.run.smithi203.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:00:11.855 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:00:11.855 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:00:11.855 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:00:11.855 INFO:teuthology.orchestra.run.smithi203.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:00:11.855 INFO:teuthology.orchestra.run.smithi203.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:00:11.855 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:00:11.855 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:00:11.855 INFO:teuthology.orchestra.run.smithi203.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:00:11.855 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:00:11.856 INFO:teuthology.orchestra.run.smithi203.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:00:11.856 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:00:11.856 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:00:11.856 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:00:11.856 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:00:11.856 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:00:11.856 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:00:11.856 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.856 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.856 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:00:11.856 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:00:11.856 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:00:11.856 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.857 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:00:11.857 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:00:11.857 INFO:teuthology.orchestra.run.smithi203.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:00:11.857 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:00:11.857 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:00:11.857 INFO:teuthology.orchestra.run.smithi203.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:00:11.857 INFO:teuthology.orchestra.run.smithi203.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:00:11.857 INFO:teuthology.orchestra.run.smithi203.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:00:11.857 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:00:11.857 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:00:11.857 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:00:11.857 INFO:teuthology.orchestra.run.smithi203.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:00:11.857 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:00:11.857 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:00:11.857 INFO:teuthology.orchestra.run.smithi203.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:00:11.858 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.858 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.858 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:11.858 INFO:teuthology.orchestra.run.smithi203.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:00:11.858 INFO:teuthology.orchestra.run.smithi203.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:00:11.858 INFO:teuthology.orchestra.run.smithi203.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:00:11.858 INFO:teuthology.orchestra.run.smithi203.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:00:11.858 INFO:teuthology.orchestra.run.smithi203.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:00:11.858 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:00:11.859 INFO:teuthology.orchestra.run.smithi203.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:00:11.859 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:00:11.859 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-19T08:00:12.287 DEBUG:teuthology.parallel:result is None 2024-09-19T08:00:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:00:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:00:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:00:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:00:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:00:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:00:12.979 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:00:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:00:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:00:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:00:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:00:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:00:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:00:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:00:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:00:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:00:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:00:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:00:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:00:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:00:12.980 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:00:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:00:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:00:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:00:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:00:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:00:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:00:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:00:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:00:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:00:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:00:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:00:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:00:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:00:12.981 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:00:12.982 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:00:12.992 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:00:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:00:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:00:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:00:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:00:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:00:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:00:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:00:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:00:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:00:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:00:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:00:12.993 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:00:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:00:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:00:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:00:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:00:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:00:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:00:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:00:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:00:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:00:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:00:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:00:12.994 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:00:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:00:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:00:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:00:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:00:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:00:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:00:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:00:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:00:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:00:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:00:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:00:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:00:12.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:00:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:00:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:00:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:00:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:00:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:00:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:00:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:00:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:00:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:00:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:00:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:00:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:00:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:00:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:00:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:00:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:00:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:00:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:00:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:00:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:00:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:00:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:00:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:00:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:00:12.997 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:00:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:00:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:00:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:00:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:00:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:00:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:00:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:00:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:00:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:00:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:00:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:00:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:00:12.998 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:00:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:00:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:00:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:00:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:00:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:00:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:00:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:00:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:00:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:00:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:00:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:00:12.999 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:00:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:00:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:00:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:00:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:00:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:00:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:00:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:00:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:00:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:00:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:00:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:00:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:00:13.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:00:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:00:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:00:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:00:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:00:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:00:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:00:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:00:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:00:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:00:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:00:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:00:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:00:13.001 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:00:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:00:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:00:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:00:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:00:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:00:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:00:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:00:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:00:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:00:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:00:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:00:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:00:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:00:13.002 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:00:15.668 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:00:15.668 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:00:15.668 INFO:teuthology.orchestra.run.smithi027.stdout:Upgraded: 2024-09-19T08:00:15.668 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:00:15.668 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:00:15.668 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:00:15.668 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:00:15.668 INFO:teuthology.orchestra.run.smithi027.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.668 INFO:teuthology.orchestra.run.smithi027.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.668 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:00:15.669 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:00:15.669 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2024-09-19T08:00:15.669 INFO:teuthology.orchestra.run.smithi027.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:00:15.669 INFO:teuthology.orchestra.run.smithi027.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:00:15.669 INFO:teuthology.orchestra.run.smithi027.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:00:15.669 INFO:teuthology.orchestra.run.smithi027.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:00:15.669 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.669 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.669 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.669 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.669 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:00:15.669 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.669 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.670 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.670 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:00:15.670 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:00:15.670 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:00:15.670 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:00:15.670 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:00:15.670 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.670 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.670 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:00:15.670 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.670 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.670 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.670 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:00:15.671 INFO:teuthology.orchestra.run.smithi027.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:00:15.671 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.671 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.671 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:00:15.671 INFO:teuthology.orchestra.run.smithi027.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:00:15.671 INFO:teuthology.orchestra.run.smithi027.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:00:15.671 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:00:15.671 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:00:15.671 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:00:15.671 INFO:teuthology.orchestra.run.smithi027.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:00:15.671 INFO:teuthology.orchestra.run.smithi027.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:00:15.671 INFO:teuthology.orchestra.run.smithi027.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:00:15.671 INFO:teuthology.orchestra.run.smithi027.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:00:15.672 INFO:teuthology.orchestra.run.smithi027.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:00:15.672 INFO:teuthology.orchestra.run.smithi027.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:00:15.672 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.672 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.672 INFO:teuthology.orchestra.run.smithi027.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.672 INFO:teuthology.orchestra.run.smithi027.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:00:15.672 INFO:teuthology.orchestra.run.smithi027.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:00:15.672 INFO:teuthology.orchestra.run.smithi027.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:00:15.672 INFO:teuthology.orchestra.run.smithi027.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:00:15.672 INFO:teuthology.orchestra.run.smithi027.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:00:15.672 INFO:teuthology.orchestra.run.smithi027.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.672 INFO:teuthology.orchestra.run.smithi027.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.673 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:00:15.673 INFO:teuthology.orchestra.run.smithi027.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.673 INFO:teuthology.orchestra.run.smithi027.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:00:15.673 INFO:teuthology.orchestra.run.smithi027.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:00:15.673 INFO:teuthology.orchestra.run.smithi027.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:00:15.673 INFO:teuthology.orchestra.run.smithi027.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:00:15.673 INFO:teuthology.orchestra.run.smithi027.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:00:15.673 INFO:teuthology.orchestra.run.smithi027.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:00:15.673 INFO:teuthology.orchestra.run.smithi027.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:00:15.673 INFO:teuthology.orchestra.run.smithi027.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:00:15.673 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:00:15.673 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:00:15.674 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:00:15.674 INFO:teuthology.orchestra.run.smithi027.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:00:15.674 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:00:15.674 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:00:15.674 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:00:15.674 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:00:15.674 INFO:teuthology.orchestra.run.smithi027.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:00:15.674 INFO:teuthology.orchestra.run.smithi027.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:00:15.674 INFO:teuthology.orchestra.run.smithi027.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:00:15.674 INFO:teuthology.orchestra.run.smithi027.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:00:15.674 INFO:teuthology.orchestra.run.smithi027.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:00:15.674 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:00:15.674 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:00:15.675 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.675 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.675 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.675 INFO:teuthology.orchestra.run.smithi027.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:00:15.675 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:00:15.675 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:00:15.675 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:00:15.675 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:00:15.675 INFO:teuthology.orchestra.run.smithi027.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:00:15.675 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:00:15.675 INFO:teuthology.orchestra.run.smithi027.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:00:15.675 INFO:teuthology.orchestra.run.smithi027.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:00:15.675 INFO:teuthology.orchestra.run.smithi027.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:00:15.676 INFO:teuthology.orchestra.run.smithi027.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:00:15.676 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:00:15.676 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:00:15.676 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:00:15.676 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:00:15.676 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:00:15.676 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:00:15.676 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:00:15.676 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:00:15.676 INFO:teuthology.orchestra.run.smithi027.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:00:15.676 INFO:teuthology.orchestra.run.smithi027.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:00:15.676 INFO:teuthology.orchestra.run.smithi027.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:00:15.676 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:00:15.677 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:00:15.677 INFO:teuthology.orchestra.run.smithi027.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:00:15.677 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:00:15.677 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:00:15.677 INFO:teuthology.orchestra.run.smithi027.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:00:15.677 INFO:teuthology.orchestra.run.smithi027.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:00:15.677 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:00:15.677 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:00:15.677 INFO:teuthology.orchestra.run.smithi027.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:00:15.677 INFO:teuthology.orchestra.run.smithi027.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:00:15.677 INFO:teuthology.orchestra.run.smithi027.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:00:15.677 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:00:15.677 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:00:15.678 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:00:15.678 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:00:15.678 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:00:15.678 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:00:15.678 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.678 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.678 INFO:teuthology.orchestra.run.smithi027.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:00:15.678 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:00:15.678 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:00:15.678 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.678 INFO:teuthology.orchestra.run.smithi027.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:00:15.678 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:00:15.678 INFO:teuthology.orchestra.run.smithi027.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:00:15.679 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:00:15.679 INFO:teuthology.orchestra.run.smithi027.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:00:15.679 INFO:teuthology.orchestra.run.smithi027.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:00:15.679 INFO:teuthology.orchestra.run.smithi027.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:00:15.679 INFO:teuthology.orchestra.run.smithi027.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:00:15.679 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:00:15.679 INFO:teuthology.orchestra.run.smithi027.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:00:15.679 INFO:teuthology.orchestra.run.smithi027.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:00:15.679 INFO:teuthology.orchestra.run.smithi027.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:00:15.679 INFO:teuthology.orchestra.run.smithi027.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:00:15.679 INFO:teuthology.orchestra.run.smithi027.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:00:15.679 INFO:teuthology.orchestra.run.smithi027.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:00:15.679 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.680 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.680 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:00:15.680 INFO:teuthology.orchestra.run.smithi027.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:00:15.680 INFO:teuthology.orchestra.run.smithi027.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:00:15.680 INFO:teuthology.orchestra.run.smithi027.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:00:15.680 INFO:teuthology.orchestra.run.smithi027.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:00:15.680 INFO:teuthology.orchestra.run.smithi027.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:00:15.680 INFO:teuthology.orchestra.run.smithi027.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:00:15.680 INFO:teuthology.orchestra.run.smithi027.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:00:15.681 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:00:15.681 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-19T08:00:16.099 DEBUG:teuthology.parallel:result is None 2024-09-19T08:00:16.099 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:00:16.247 DEBUG:teuthology.orchestra.run.smithi027:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:00:16.271 INFO:teuthology.orchestra.run.smithi027.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:00:16.272 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:00:16.272 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:00:16.274 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:00:16.418 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:00:16.446 INFO:teuthology.orchestra.run.smithi155.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:00:16.446 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:00:16.446 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:00:16.448 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:00:16.589 DEBUG:teuthology.orchestra.run.smithi203:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:00:16.616 INFO:teuthology.orchestra.run.smithi203.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:00:16.616 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:00:16.616 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:00:16.618 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T08:00:16.619 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-19T08:00:16.619 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:00:16.650 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T08:00:16.650 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:00:16.683 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T08:00:16.684 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:00:16.717 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T08:00:16.717 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-19T08:00:16.717 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:00:16.745 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:00:16.812 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T08:00:16.812 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:00:16.838 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:00:16.904 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T08:00:16.904 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:00:16.934 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:00:17.004 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T08:00:17.004 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-19T08:00:17.004 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:00:17.031 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:00:17.098 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T08:00:17.098 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:00:17.124 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:00:17.191 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T08:00:17.191 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:00:17.221 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:00:17.292 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T08:00:17.292 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-19T08:00:17.292 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:00:17.319 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:00:17.386 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T08:00:17.386 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:00:17.411 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:00:17.476 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T08:00:17.477 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:00:17.507 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:00:17.576 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T08:00:17.687 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2}} 2024-09-19T08:00:17.687 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:00:17.687 INFO:tasks.cephadm:Cluster fsid is 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:00:17.688 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T08:00:17.688 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.27', 'mon.b': '172.21.15.155', 'mon.c': '172.21.15.203'} 2024-09-19T08:00:17.688 INFO:tasks.cephadm:First mon is mon.a on smithi027 2024-09-19T08:00:17.688 INFO:tasks.cephadm:First mgr is x 2024-09-19T08:00:17.688 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T08:00:17.689 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname $(hostname -s) 2024-09-19T08:00:17.717 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname $(hostname -s) 2024-09-19T08:00:17.743 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname $(hostname -s) 2024-09-19T08:00:17.773 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T08:00:17.773 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:00:17.912 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T08:00:18.048 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:00:18.050 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T08:00:18.050 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T08:00:18.050 DEBUG:teuthology.orchestra.run.smithi027:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:00:18.431 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:00 /home/ubuntu/cephtest/cephadm 2024-09-19T08:00:18.432 DEBUG:teuthology.orchestra.run.smithi155:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:00:18.812 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:00 /home/ubuntu/cephtest/cephadm 2024-09-19T08:00:18.813 DEBUG:teuthology.orchestra.run.smithi203:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:00:19.208 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:00 /home/ubuntu/cephtest/cephadm 2024-09-19T08:00:19.209 DEBUG:teuthology.orchestra.run.smithi027:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:00:19.239 DEBUG:teuthology.orchestra.run.smithi155:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:00:19.265 DEBUG:teuthology.orchestra.run.smithi203:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:00:19.381 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T08:00:19.381 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:00:19.390 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:00:19.404 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:00:20.874 INFO:teuthology.orchestra.run.smithi155.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:00:20.967 INFO:teuthology.orchestra.run.smithi027.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:00:21.022 INFO:teuthology.orchestra.run.smithi203.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:00:48.399 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-09-19T08:00:48.399 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:00:48.400 INFO:teuthology.orchestra.run.smithi155.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:00:48.400 INFO:teuthology.orchestra.run.smithi155.stdout: "repo_digests": [ 2024-09-19T08:00:48.400 INFO:teuthology.orchestra.run.smithi155.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:00:48.400 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-09-19T08:00:48.400 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-09-19T08:00:58.503 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-19T08:00:58.503 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:00:58.503 INFO:teuthology.orchestra.run.smithi203.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:00:58.503 INFO:teuthology.orchestra.run.smithi203.stdout: "repo_digests": [ 2024-09-19T08:00:58.503 INFO:teuthology.orchestra.run.smithi203.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:00:58.503 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-19T08:00:58.503 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-19T08:01:11.643 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:01:11.643 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:01:11.643 INFO:teuthology.orchestra.run.smithi027.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:01:11.643 INFO:teuthology.orchestra.run.smithi027.stdout: "repo_digests": [ 2024-09-19T08:01:11.643 INFO:teuthology.orchestra.run.smithi027.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:01:11.643 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-19T08:01:11.643 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:01:11.671 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /etc/ceph 2024-09-19T08:01:11.720 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph 2024-09-19T08:01:11.754 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /etc/ceph 2024-09-19T08:01:11.789 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 777 /etc/ceph 2024-09-19T08:01:11.815 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /etc/ceph 2024-09-19T08:01:11.845 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 777 /etc/ceph 2024-09-19T08:01:11.876 INFO:tasks.cephadm:Writing seed config... 2024-09-19T08:01:11.877 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T08:01:11.877 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T08:01:11.877 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T08:01:11.878 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T08:01:11.878 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T08:01:11.878 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-19T08:01:11.878 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T08:01:11.878 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T08:01:11.878 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T08:01:11.878 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T08:01:11.878 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T08:01:11.878 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T08:01:11.878 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T08:01:11.878 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T08:01:11.878 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T08:01:11.878 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T08:01:11.878 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T08:01:11.879 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T08:01:11.879 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T08:01:11.879 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T08:01:11.879 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T08:01:11.879 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-19T08:01:11.879 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T08:01:11.879 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T08:01:11.879 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T08:01:11.879 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T08:01:11.879 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T08:01:11.879 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T08:01:11.879 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T08:01:11.879 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T08:01:11.879 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T08:01:11.880 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T08:01:11.880 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-19T08:01:11.880 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T08:01:11.880 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-19T08:01:11.880 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-19T08:01:11.880 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T08:01:11.880 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T08:01:11.880 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-19T08:01:11.880 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T08:01:11.880 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T08:01:11.880 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T08:01:11.880 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T08:01:11.880 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T08:01:11.881 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T08:01:11.881 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T08:01:11.881 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-19T08:01:11.881 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-19T08:01:11.881 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T08:01:11.897 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 35b531b0-765d-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T08:01:11.898 DEBUG:teuthology.orchestra.run.smithi027:mon.a> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T08:01:11.940 DEBUG:teuthology.orchestra.run.smithi027:mgr.x> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T08:01:11.984 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T08:01:11.984 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid 35b531b0-765d-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.27 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:01:12.194 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:01:12.194 INFO:teuthology.orchestra.run.smithi027.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', '35b531b0-765d-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.27', '--skip-admin-label'] 2024-09-19T08:01:12.194 INFO:teuthology.orchestra.run.smithi027.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T08:01:12.195 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying podman|docker is present... 2024-09-19T08:01:12.219 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stdout 5.2.2 2024-09-19T08:01:12.219 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying lvm2 is present... 2024-09-19T08:01:12.219 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying time synchronization is in place... 2024-09-19T08:01:12.227 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T08:01:12.227 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T08:01:12.234 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T08:01:12.234 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-09-19T08:01:12.241 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout enabled 2024-09-19T08:01:12.247 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout active 2024-09-19T08:01:12.247 INFO:teuthology.orchestra.run.smithi027.stdout:Unit chronyd.service is enabled and running 2024-09-19T08:01:12.247 INFO:teuthology.orchestra.run.smithi027.stdout:Repeating the final host check... 2024-09-19T08:01:12.270 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stdout 5.2.2 2024-09-19T08:01:12.270 INFO:teuthology.orchestra.run.smithi027.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T08:01:12.270 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl is present 2024-09-19T08:01:12.270 INFO:teuthology.orchestra.run.smithi027.stdout:lvcreate is present 2024-09-19T08:01:12.280 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T08:01:12.280 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T08:01:12.283 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T08:01:12.283 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-09-19T08:01:12.290 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout enabled 2024-09-19T08:01:12.297 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout active 2024-09-19T08:01:12.297 INFO:teuthology.orchestra.run.smithi027.stdout:Unit chronyd.service is enabled and running 2024-09-19T08:01:12.297 INFO:teuthology.orchestra.run.smithi027.stdout:Host looks OK 2024-09-19T08:01:12.297 INFO:teuthology.orchestra.run.smithi027.stdout:Cluster fsid: 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:01:12.298 INFO:teuthology.orchestra.run.smithi027.stdout:Acquiring lock 140365436068864 on /run/cephadm/35b531b0-765d-11ef-bceb-c7b262605968.lock 2024-09-19T08:01:12.298 INFO:teuthology.orchestra.run.smithi027.stdout:Lock 140365436068864 acquired on /run/cephadm/35b531b0-765d-11ef-bceb-c7b262605968.lock 2024-09-19T08:01:12.298 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying IP 172.21.15.27 port 3300 ... 2024-09-19T08:01:12.299 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying IP 172.21.15.27 port 6789 ... 2024-09-19T08:01:12.299 INFO:teuthology.orchestra.run.smithi027.stdout:Base mon IP(s) is [172.21.15.27:3300, 172.21.15.27:6789], mon addrv is [v2:172.21.15.27:3300,v1:172.21.15.27:6789] 2024-09-19T08:01:12.302 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.27 metric 100 2024-09-19T08:01:12.302 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.27 metric 100 2024-09-19T08:01:12.304 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T08:01:12.304 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-19T08:01:12.305 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1781sec hoplimit 64 pref medium 2024-09-19T08:01:12.308 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T08:01:12.308 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T08:01:12.308 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T08:01:12.308 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-19T08:01:12.308 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2024-09-19T08:01:12.308 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T08:01:12.309 INFO:teuthology.orchestra.run.smithi027.stdout:Mon IP `172.21.15.27` is in CIDR network `172.21.0.0/20` 2024-09-19T08:01:12.309 INFO:teuthology.orchestra.run.smithi027.stdout:Mon IP `172.21.15.27` is in CIDR network `172.21.0.0/20` 2024-09-19T08:01:12.309 INFO:teuthology.orchestra.run.smithi027.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T08:01:12.309 INFO:teuthology.orchestra.run.smithi027.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T08:01:12.310 INFO:teuthology.orchestra.run.smithi027.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:01:13.221 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T08:01:13.221 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:01:13.221 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T08:01:13.221 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T08:01:13.221 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T08:01:13.221 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T08:01:13.221 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T08:01:14.058 INFO:teuthology.orchestra.run.smithi027.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T08:01:14.058 INFO:teuthology.orchestra.run.smithi027.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T08:01:14.058 INFO:teuthology.orchestra.run.smithi027.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T08:01:14.913 INFO:teuthology.orchestra.run.smithi027.stdout:stat: stdout 167 167 2024-09-19T08:01:14.913 INFO:teuthology.orchestra.run.smithi027.stdout:Creating initial keys... 2024-09-19T08:01:15.844 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-authtool: stdout AQBL2utmX8c3DhAA2+MxrgYdhR2b4cD65Cakbw== 2024-09-19T08:01:16.741 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-authtool: stdout AQBM2utm4coUCRAAw0TzORPWyNvXe/+8prQEwQ== 2024-09-19T08:01:17.605 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-authtool: stdout AQBN2utmslZ0AxAALfwQNJH1SlxeXGN1jTrA0w== 2024-09-19T08:01:17.606 INFO:teuthology.orchestra.run.smithi027.stdout:Creating initial monmap... 2024-09-19T08:01:18.514 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T08:01:18.514 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T08:01:18.514 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:01:18.514 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T08:01:18.514 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool for a [v2:172.21.15.27:3300,v1:172.21.15.27:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T08:01:18.514 INFO:teuthology.orchestra.run.smithi027.stdout:setting min_mon_release = quincy 2024-09-19T08:01:18.514 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: set fsid to 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:01:18.514 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T08:01:18.514 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:01:18.514 INFO:teuthology.orchestra.run.smithi027.stdout:Creating mon... 2024-09-19T08:01:19.427 INFO:teuthology.orchestra.run.smithi027.stdout:create mon.a on 2024-09-19T08:01:19.643 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T08:01:19.800 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T08:01:19.981 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-35b531b0-765d-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-35b531b0-765d-11ef-bceb-c7b262605968.target. 2024-09-19T08:01:19.981 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-35b531b0-765d-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-35b531b0-765d-11ef-bceb-c7b262605968.target. 2024-09-19T08:01:20.240 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-35b531b0-765d-11ef-bceb-c7b262605968@mon.a 2024-09-19T08:01:20.241 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Failed to reset failed state of unit ceph-35b531b0-765d-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-35b531b0-765d-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T08:01:20.427 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-35b531b0-765d-11ef-bceb-c7b262605968.target.wants/ceph-35b531b0-765d-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-35b531b0-765d-11ef-bceb-c7b262605968@.service. 2024-09-19T08:01:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:20 smithi027 systemd[1]: Starting Ceph mon.a for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:01:20.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:20 smithi027 podman[30826]: 2024-09-19 08:01:20.677104232 +0000 UTC m=+0.119732004 container create 0d15329650b8695535e3dc70ec56dc19f3c5798f0fe4da4690f7a649ab177344 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-a, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T08:01:20.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:20 smithi027 podman[30826]: 2024-09-19 08:01:20.586104224 +0000 UTC m=+0.028732008 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:01:20.960 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:01:20.960 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout disabled 2024-09-19T08:01:20.968 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:01:20.968 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-09-19T08:01:20.968 INFO:teuthology.orchestra.run.smithi027.stdout:firewalld.service is not enabled 2024-09-19T08:01:20.968 INFO:teuthology.orchestra.run.smithi027.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T08:01:20.969 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mon to start... 2024-09-19T08:01:20.969 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mon... 2024-09-19T08:01:21.042 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:20 smithi027 podman[30826]: 2024-09-19 08:01:20.887697768 +0000 UTC m=+0.330325551 container init 0d15329650b8695535e3dc70ec56dc19f3c5798f0fe4da4690f7a649ab177344 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T08:01:21.043 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:20 smithi027 podman[30826]: 2024-09-19 08:01:20.891195918 +0000 UTC m=+0.333823691 container start 0d15329650b8695535e3dc70ec56dc19f3c5798f0fe4da4690f7a649ab177344 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T08:01:21.043 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:20 smithi027 ceph-mon[30844]: mkfs 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:01:21.043 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:20 smithi027 ceph-mon[30844]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T08:01:21.043 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:20 smithi027 bash[30826]: 0d15329650b8695535e3dc70ec56dc19f3c5798f0fe4da4690f7a649ab177344 2024-09-19T08:01:21.043 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:20 smithi027 systemd[1]: Started Ceph mon.a for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:01:21.936 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:21 smithi027 ceph-mon[30844]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T08:01:21.936 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:21 smithi027 ceph-mon[30844]: monmap epoch 1 2024-09-19T08:01:21.936 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:21 smithi027 ceph-mon[30844]: fsid 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:01:21.936 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:21 smithi027 ceph-mon[30844]: last_changed 2024-09-19T08:01:17.912400+0000 2024-09-19T08:01:21.936 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:21 smithi027 ceph-mon[30844]: created 2024-09-19T08:01:17.912400+0000 2024-09-19T08:01:21.936 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:21 smithi027 ceph-mon[30844]: min_mon_release 19 (squid) 2024-09-19T08:01:21.936 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:21 smithi027 ceph-mon[30844]: election_strategy: 1 2024-09-19T08:01:21.936 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:21 smithi027 ceph-mon[30844]: 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-09-19T08:01:21.936 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:21 smithi027 ceph-mon[30844]: fsmap 2024-09-19T08:01:21.937 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:21 smithi027 ceph-mon[30844]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T08:01:21.937 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:21 smithi027 ceph-mon[30844]: mgrmap e1: no daemons active 2024-09-19T08:01:21.937 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:21 smithi027 ceph-mon[30844]: from='client.? 172.21.15.27:0/722206789' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T08:01:21.945 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T08:01:21.945 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout id: 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:01:21.946 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T08:01:21.946 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-19T08:01:21.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout services: 2024-09-19T08:01:21.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.538712s) 2024-09-19T08:01:21.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T08:01:21.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T08:01:21.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-19T08:01:21.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout data: 2024-09-19T08:01:21.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T08:01:21.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T08:01:21.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T08:01:21.949 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T08:01:21.949 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-19T08:01:21.949 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.394+0000 7fda82196640 1 Processor -- start 2024-09-19T08:01:21.949 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.394+0000 7fda82196640 1 -- start start 2024-09-19T08:01:21.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.395+0000 7fda82196640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda7c1075c0 0x7fda7c1079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:21.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.395+0000 7fda82196640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fda7c107f90 con 0x7fda7c1075c0 2024-09-19T08:01:21.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.395+0000 7fda7b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda7c1075c0 0x7fda7c1079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:21.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.395+0000 7fda7b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda7c1075c0 0x7fda7c1079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36752/0 (socket says 172.21.15.27:36752) 2024-09-19T08:01:21.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.395+0000 7fda7b7fe640 1 -- 172.21.15.27:0/643417037 learned_addr learned my addr 172.21.15.27:0/643417037 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:21.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.395+0000 7fda7b7fe640 1 -- 172.21.15.27:0/643417037 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7c1087c0 con 0x7fda7c1075c0 2024-09-19T08:01:21.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.397+0000 7fda7b7fe640 1 --2- 172.21.15.27:0/643417037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda7c1075c0 0x7fda7c1079c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fda6c009820 tx=0x7fda6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca1b72a677c0d95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:21.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.398+0000 7fda7a7fc640 1 -- 172.21.15.27:0/643417037 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda6c037070 con 0x7fda7c1075c0 2024-09-19T08:01:21.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.398+0000 7fda7a7fc640 1 -- 172.21.15.27:0/643417037 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda6c032440 con 0x7fda7c1075c0 2024-09-19T08:01:21.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.398+0000 7fda7a7fc640 1 -- 172.21.15.27:0/643417037 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda6c032740 con 0x7fda7c1075c0 2024-09-19T08:01:21.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.398+0000 7fda82196640 1 -- 172.21.15.27:0/643417037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda7c1075c0 msgr2=0x7fda7c1079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:21.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.398+0000 7fda82196640 1 --2- 172.21.15.27:0/643417037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda7c1075c0 0x7fda7c1079c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fda6c009820 tx=0x7fda6c02a270 comp rx=0 tx=0).stop 2024-09-19T08:01:21.951 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.398+0000 7fda82196640 1 -- 172.21.15.27:0/643417037 shutdown_connections 2024-09-19T08:01:21.951 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.398+0000 7fda82196640 1 --2- 172.21.15.27:0/643417037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda7c1075c0 0x7fda7c1079c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:21.951 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.398+0000 7fda82196640 1 -- 172.21.15.27:0/643417037 >> 172.21.15.27:0/643417037 conn(0x7fda7c102d90 msgr2=0x7fda7c1051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:21.951 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.398+0000 7fda82196640 1 -- 172.21.15.27:0/643417037 shutdown_connections 2024-09-19T08:01:21.951 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.398+0000 7fda82196640 1 -- 172.21.15.27:0/643417037 wait complete. 2024-09-19T08:01:21.951 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.399+0000 7fda82196640 1 Processor -- start 2024-09-19T08:01:21.951 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.399+0000 7fda82196640 1 -- start start 2024-09-19T08:01:21.951 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.399+0000 7fda82196640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda7c1075c0 0x7fda7c19ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:21.951 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.399+0000 7fda82196640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fda7c108d60 con 0x7fda7c1075c0 2024-09-19T08:01:21.951 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.400+0000 7fda7b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda7c1075c0 0x7fda7c19ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:21.951 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.400+0000 7fda7b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda7c1075c0 0x7fda7c19ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36756/0 (socket says 172.21.15.27:36756) 2024-09-19T08:01:21.951 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.400+0000 7fda7b7fe640 1 -- 172.21.15.27:0/722206789 learned_addr learned my addr 172.21.15.27:0/722206789 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:21.951 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.400+0000 7fda7b7fe640 1 -- 172.21.15.27:0/722206789 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7c19b2e0 con 0x7fda7c1075c0 2024-09-19T08:01:21.952 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.400+0000 7fda7b7fe640 1 --2- 172.21.15.27:0/722206789 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda7c1075c0 0x7fda7c19ada0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0090b0 tx=0x7fda6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:21.952 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.400+0000 7fda78ff9640 1 -- 172.21.15.27:0/722206789 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda6c041070 con 0x7fda7c1075c0 2024-09-19T08:01:21.952 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.400+0000 7fda78ff9640 1 -- 172.21.15.27:0/722206789 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda6c03c7a0 con 0x7fda7c1075c0 2024-09-19T08:01:21.952 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.400+0000 7fda82196640 1 -- 172.21.15.27:0/722206789 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda7c19b570 con 0x7fda7c1075c0 2024-09-19T08:01:21.952 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.400+0000 7fda78ff9640 1 -- 172.21.15.27:0/722206789 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda6c037040 con 0x7fda7c1075c0 2024-09-19T08:01:21.952 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.400+0000 7fda82196640 1 -- 172.21.15.27:0/722206789 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda7c19e220 con 0x7fda7c1075c0 2024-09-19T08:01:21.952 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.400+0000 7fda78ff9640 1 -- 172.21.15.27:0/722206789 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fda6c044070 con 0x7fda7c1075c0 2024-09-19T08:01:21.952 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.401+0000 7fda78ff9640 1 -- 172.21.15.27:0/722206789 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fda6c03d3f0 con 0x7fda7c1075c0 2024-09-19T08:01:21.952 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.401+0000 7fda82196640 1 -- 172.21.15.27:0/722206789 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda7c1093b0 con 0x7fda7c1075c0 2024-09-19T08:01:21.952 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.404+0000 7fda78ff9640 1 -- 172.21.15.27:0/722206789 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fda6c046450 con 0x7fda7c1075c0 2024-09-19T08:01:21.952 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.465+0000 7fda82196640 1 -- 172.21.15.27:0/722206789 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fda7c19e3f0 con 0x7fda7c1075c0 2024-09-19T08:01:21.952 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.465+0000 7fda78ff9640 1 -- 172.21.15.27:0/722206789 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fda6c046630 con 0x7fda7c1075c0 2024-09-19T08:01:21.952 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.466+0000 7fda82196640 1 -- 172.21.15.27:0/722206789 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda7c1075c0 msgr2=0x7fda7c19ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:21.953 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.466+0000 7fda82196640 1 --2- 172.21.15.27:0/722206789 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda7c1075c0 0x7fda7c19ada0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0090b0 tx=0x7fda6c0046c0 comp rx=0 tx=0).stop 2024-09-19T08:01:21.953 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.466+0000 7fda82196640 1 -- 172.21.15.27:0/722206789 shutdown_connections 2024-09-19T08:01:21.953 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.466+0000 7fda82196640 1 --2- 172.21.15.27:0/722206789 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda7c1075c0 0x7fda7c19ada0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:21.953 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.466+0000 7fda82196640 1 -- 172.21.15.27:0/722206789 >> 172.21.15.27:0/722206789 conn(0x7fda7c102d90 msgr2=0x7fda7c18f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:21.953 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.466+0000 7fda82196640 1 -- 172.21.15.27:0/722206789 shutdown_connections 2024-09-19T08:01:21.953 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:21.466+0000 7fda82196640 1 -- 172.21.15.27:0/722206789 wait complete. 2024-09-19T08:01:21.953 INFO:teuthology.orchestra.run.smithi027.stdout:mon is available 2024-09-19T08:01:21.953 INFO:teuthology.orchestra.run.smithi027.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T08:01:22.959 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:22 smithi027 ceph-mon[30844]: from='client.? 172.21.15.27:0/4165539975' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T08:01:22.959 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:22 smithi027 ceph-mon[30844]: from='client.? 172.21.15.27:0/4165539975' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T08:01:22.961 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-19T08:01:22.968 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T08:01:22.968 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout fsid = 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:01:22.968 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.27:3300,v1:172.21.15.27:6789] 2024-09-19T08:01:22.968 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T08:01:22.968 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T08:01:22.968 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T08:01:22.968 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T08:01:22.968 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-19T08:01:22.968 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T08:01:22.968 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T08:01:22.969 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-19T08:01:22.969 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T08:01:22.969 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T08:01:22.969 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T08:01:22.969 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T08:01:22.969 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T08:01:22.969 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T08:01:22.970 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.342+0000 7f6d7ca97640 1 Processor -- start 2024-09-19T08:01:22.970 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.342+0000 7f6d7ca97640 1 -- start start 2024-09-19T08:01:22.970 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.342+0000 7f6d7ca97640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d781080e0 0x7f6d7810a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:22.970 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.342+0000 7f6d7ca97640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6d7807bdd0 con 0x7f6d781080e0 2024-09-19T08:01:22.970 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.342+0000 7f6d7659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d781080e0 0x7f6d7810a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:22.970 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.342+0000 7f6d7659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d781080e0 0x7f6d7810a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36770/0 (socket says 172.21.15.27:36770) 2024-09-19T08:01:22.970 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.342+0000 7f6d7659c640 1 -- 172.21.15.27:0/4148124300 learned_addr learned my addr 172.21.15.27:0/4148124300 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:22.970 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.342+0000 7f6d7659c640 1 -- 172.21.15.27:0/4148124300 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d7810aa10 con 0x7f6d781080e0 2024-09-19T08:01:22.970 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.343+0000 7f6d7659c640 1 --2- 172.21.15.27:0/4148124300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d781080e0 0x7f6d7810a4d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6d68009820 tx=0x7f6d6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f39db798209f57c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:22.970 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.343+0000 7f6d7559a640 1 -- 172.21.15.27:0/4148124300 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d68037070 con 0x7f6d781080e0 2024-09-19T08:01:22.971 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.343+0000 7f6d7559a640 1 -- 172.21.15.27:0/4148124300 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d68032440 con 0x7f6d781080e0 2024-09-19T08:01:22.971 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.343+0000 7f6d7559a640 1 -- 172.21.15.27:0/4148124300 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d68032740 con 0x7f6d781080e0 2024-09-19T08:01:22.971 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.344+0000 7f6d7ca97640 1 -- 172.21.15.27:0/4148124300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d781080e0 msgr2=0x7f6d7810a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:22.971 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.344+0000 7f6d7ca97640 1 --2- 172.21.15.27:0/4148124300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d781080e0 0x7f6d7810a4d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6d68009820 tx=0x7f6d6802a270 comp rx=0 tx=0).stop 2024-09-19T08:01:22.971 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.344+0000 7f6d7ca97640 1 -- 172.21.15.27:0/4148124300 shutdown_connections 2024-09-19T08:01:22.971 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.344+0000 7f6d7ca97640 1 --2- 172.21.15.27:0/4148124300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d781080e0 0x7f6d7810a4d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:22.971 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.344+0000 7f6d7ca97640 1 -- 172.21.15.27:0/4148124300 >> 172.21.15.27:0/4148124300 conn(0x7f6d78101ca0 msgr2=0x7f6d781040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:22.971 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.344+0000 7f6d7ca97640 1 -- 172.21.15.27:0/4148124300 shutdown_connections 2024-09-19T08:01:22.971 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.344+0000 7f6d7ca97640 1 -- 172.21.15.27:0/4148124300 wait complete. 2024-09-19T08:01:22.972 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.345+0000 7f6d7ca97640 1 Processor -- start 2024-09-19T08:01:22.972 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.345+0000 7f6d7ca97640 1 -- start start 2024-09-19T08:01:22.972 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.345+0000 7f6d7ca97640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d781080e0 0x7f6d7819ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:22.972 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.345+0000 7f6d7ca97640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6d7810ae90 con 0x7f6d781080e0 2024-09-19T08:01:22.972 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.345+0000 7f6d7659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d781080e0 0x7f6d7819ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:22.972 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.345+0000 7f6d7659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d781080e0 0x7f6d7819ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36782/0 (socket says 172.21.15.27:36782) 2024-09-19T08:01:22.972 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.345+0000 7f6d7659c640 1 -- 172.21.15.27:0/4165539975 learned_addr learned my addr 172.21.15.27:0/4165539975 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:22.972 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.345+0000 7f6d7659c640 1 -- 172.21.15.27:0/4165539975 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d7819b290 con 0x7f6d781080e0 2024-09-19T08:01:22.972 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.345+0000 7f6d7659c640 1 --2- 172.21.15.27:0/4165539975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d781080e0 0x7f6d7819ad50 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6d680090b0 tx=0x7f6d680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:22.972 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.346+0000 7f6d6f7fe640 1 -- 172.21.15.27:0/4165539975 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d68041070 con 0x7f6d781080e0 2024-09-19T08:01:22.972 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.346+0000 7f6d6f7fe640 1 -- 172.21.15.27:0/4165539975 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d6803c7a0 con 0x7f6d781080e0 2024-09-19T08:01:22.972 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.346+0000 7f6d7ca97640 1 -- 172.21.15.27:0/4165539975 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d7819b520 con 0x7f6d781080e0 2024-09-19T08:01:22.973 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.346+0000 7f6d6f7fe640 1 -- 172.21.15.27:0/4165539975 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d68037040 con 0x7f6d781080e0 2024-09-19T08:01:22.973 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.346+0000 7f6d7ca97640 1 -- 172.21.15.27:0/4165539975 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d7819e210 con 0x7f6d781080e0 2024-09-19T08:01:22.973 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.346+0000 7f6d6f7fe640 1 -- 172.21.15.27:0/4165539975 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6d68044070 con 0x7f6d781080e0 2024-09-19T08:01:22.973 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.346+0000 7f6d6f7fe640 1 -- 172.21.15.27:0/4165539975 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6d6803d3f0 con 0x7f6d781080e0 2024-09-19T08:01:22.973 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.347+0000 7f6d7ca97640 1 -- 172.21.15.27:0/4165539975 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d78108540 con 0x7f6d781080e0 2024-09-19T08:01:22.973 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.349+0000 7f6d6f7fe640 1 -- 172.21.15.27:0/4165539975 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6d68046450 con 0x7f6d781080e0 2024-09-19T08:01:22.973 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.408+0000 7f6d7ca97640 1 -- 172.21.15.27:0/4165539975 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f6d7819ba00 con 0x7f6d781080e0 2024-09-19T08:01:22.973 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.411+0000 7f6d6f7fe640 1 -- 172.21.15.27:0/4165539975 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f6d7819ba00 con 0x7f6d781080e0 2024-09-19T08:01:22.973 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.412+0000 7f6d6f7fe640 1 -- 172.21.15.27:0/4165539975 <== mon.0 v2:172.21.15.27:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6d68056070 con 0x7f6d781080e0 2024-09-19T08:01:22.973 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.413+0000 7f6d7ca97640 1 -- 172.21.15.27:0/4165539975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d781080e0 msgr2=0x7f6d7819ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:22.973 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.413+0000 7f6d7ca97640 1 --2- 172.21.15.27:0/4165539975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d781080e0 0x7f6d7819ad50 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6d680090b0 tx=0x7f6d680046c0 comp rx=0 tx=0).stop 2024-09-19T08:01:22.973 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.413+0000 7f6d7ca97640 1 -- 172.21.15.27:0/4165539975 shutdown_connections 2024-09-19T08:01:22.973 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.413+0000 7f6d7ca97640 1 --2- 172.21.15.27:0/4165539975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d781080e0 0x7f6d7819ad50 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:22.974 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.413+0000 7f6d7ca97640 1 -- 172.21.15.27:0/4165539975 >> 172.21.15.27:0/4165539975 conn(0x7f6d78101ca0 msgr2=0x7f6d78102ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:22.974 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.413+0000 7f6d7ca97640 1 -- 172.21.15.27:0/4165539975 shutdown_connections 2024-09-19T08:01:22.974 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:22.413+0000 7f6d7ca97640 1 -- 172.21.15.27:0/4165539975 wait complete. 2024-09-19T08:01:22.974 INFO:teuthology.orchestra.run.smithi027.stdout:Generating new minimal ceph.conf... 2024-09-19T08:01:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:23 smithi027 ceph-mon[30844]: from='client.? 172.21.15.27:0/1548476882' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:01:23.989 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.341+0000 7f39e509e640 1 Processor -- start 2024-09-19T08:01:23.989 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.341+0000 7f39e509e640 1 -- start start 2024-09-19T08:01:23.989 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.342+0000 7f39e509e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39e0107620 0x7f39e0107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:23.989 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.342+0000 7f39e509e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f39e0107ff0 con 0x7f39e0107620 2024-09-19T08:01:23.989 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.342+0000 7f39ded9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39e0107620 0x7f39e0107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:23.990 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.342+0000 7f39ded9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39e0107620 0x7f39e0107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36792/0 (socket says 172.21.15.27:36792) 2024-09-19T08:01:23.990 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.342+0000 7f39ded9d640 1 -- 172.21.15.27:0/165636376 learned_addr learned my addr 172.21.15.27:0/165636376 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:23.990 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.342+0000 7f39ded9d640 1 -- 172.21.15.27:0/165636376 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e0108820 con 0x7f39e0107620 2024-09-19T08:01:23.990 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.343+0000 7f39ded9d640 1 --2- 172.21.15.27:0/165636376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39e0107620 0x7f39e0107a20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009820 tx=0x7f39d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406eba5a495f34b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:23.990 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.343+0000 7f39de59c640 1 -- 172.21.15.27:0/165636376 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39d0037070 con 0x7f39e0107620 2024-09-19T08:01:23.990 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.343+0000 7f39de59c640 1 -- 172.21.15.27:0/165636376 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39d0032900 con 0x7f39e0107620 2024-09-19T08:01:23.990 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.343+0000 7f39de59c640 1 -- 172.21.15.27:0/165636376 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39d0030850 con 0x7f39e0107620 2024-09-19T08:01:23.990 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.344+0000 7f39e509e640 1 -- 172.21.15.27:0/165636376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39e0107620 msgr2=0x7f39e0107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:23.990 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.344+0000 7f39e509e640 1 --2- 172.21.15.27:0/165636376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39e0107620 0x7f39e0107a20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009820 tx=0x7f39d002a270 comp rx=0 tx=0).stop 2024-09-19T08:01:23.990 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.344+0000 7f39e509e640 1 -- 172.21.15.27:0/165636376 shutdown_connections 2024-09-19T08:01:23.990 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.344+0000 7f39e509e640 1 --2- 172.21.15.27:0/165636376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39e0107620 0x7f39e0107a20 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.990 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.344+0000 7f39e509e640 1 -- 172.21.15.27:0/165636376 >> 172.21.15.27:0/165636376 conn(0x7f39e0102db0 msgr2=0x7f39e01051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:23.991 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.344+0000 7f39e509e640 1 -- 172.21.15.27:0/165636376 shutdown_connections 2024-09-19T08:01:23.991 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.344+0000 7f39e509e640 1 -- 172.21.15.27:0/165636376 wait complete. 2024-09-19T08:01:23.991 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.344+0000 7f39e509e640 1 Processor -- start 2024-09-19T08:01:23.991 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.344+0000 7f39e509e640 1 -- start start 2024-09-19T08:01:23.991 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.345+0000 7f39e509e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39e0107620 0x7f39e007db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:23.991 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.345+0000 7f39e509e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f39e010bbd0 con 0x7f39e0107620 2024-09-19T08:01:23.991 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.345+0000 7f39ded9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39e0107620 0x7f39e007db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:23.991 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.345+0000 7f39ded9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39e0107620 0x7f39e007db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36802/0 (socket says 172.21.15.27:36802) 2024-09-19T08:01:23.991 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.345+0000 7f39ded9d640 1 -- 172.21.15.27:0/1548476882 learned_addr learned my addr 172.21.15.27:0/1548476882 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:23.991 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.345+0000 7f39ded9d640 1 -- 172.21.15.27:0/1548476882 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e007e080 con 0x7f39e0107620 2024-09-19T08:01:23.991 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.345+0000 7f39ded9d640 1 --2- 172.21.15.27:0/1548476882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39e0107620 0x7f39e007db40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009940 tx=0x7f39d00326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:23.991 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.345+0000 7f39dcd99640 1 -- 172.21.15.27:0/1548476882 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39d0042070 con 0x7f39e0107620 2024-09-19T08:01:23.991 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.345+0000 7f39dcd99640 1 -- 172.21.15.27:0/1548476882 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39d0032be0 con 0x7f39e0107620 2024-09-19T08:01:23.991 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.345+0000 7f39e509e640 1 -- 172.21.15.27:0/1548476882 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e007c270 con 0x7f39e0107620 2024-09-19T08:01:23.992 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.345+0000 7f39dcd99640 1 -- 172.21.15.27:0/1548476882 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39d0037040 con 0x7f39e0107620 2024-09-19T08:01:23.992 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.346+0000 7f39e509e640 1 -- 172.21.15.27:0/1548476882 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e007c7b0 con 0x7f39e0107620 2024-09-19T08:01:23.992 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.346+0000 7f39dcd99640 1 -- 172.21.15.27:0/1548476882 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f39d0045070 con 0x7f39e0107620 2024-09-19T08:01:23.992 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.346+0000 7f39dcd99640 1 -- 172.21.15.27:0/1548476882 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f39d0047a30 con 0x7f39e0107620 2024-09-19T08:01:23.992 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.347+0000 7f39e509e640 1 -- 172.21.15.27:0/1548476882 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39e0107aa0 con 0x7f39e0107620 2024-09-19T08:01:23.992 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.349+0000 7f39dcd99640 1 -- 172.21.15.27:0/1548476882 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f39d0032d90 con 0x7f39e0107620 2024-09-19T08:01:23.992 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.408+0000 7f39e509e640 1 -- 172.21.15.27:0/1548476882 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f39e007cce0 con 0x7f39e0107620 2024-09-19T08:01:23.992 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.409+0000 7f39dcd99640 1 -- 172.21.15.27:0/1548476882 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f39d003d430 con 0x7f39e0107620 2024-09-19T08:01:23.992 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.409+0000 7f39e509e640 1 -- 172.21.15.27:0/1548476882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39e0107620 msgr2=0x7f39e007db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:23.992 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.409+0000 7f39e509e640 1 --2- 172.21.15.27:0/1548476882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39e0107620 0x7f39e007db40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009940 tx=0x7f39d00326e0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.992 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.409+0000 7f39e509e640 1 -- 172.21.15.27:0/1548476882 shutdown_connections 2024-09-19T08:01:23.992 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.409+0000 7f39e509e640 1 --2- 172.21.15.27:0/1548476882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39e0107620 0x7f39e007db40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.992 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.409+0000 7f39e509e640 1 -- 172.21.15.27:0/1548476882 >> 172.21.15.27:0/1548476882 conn(0x7f39e0102db0 msgr2=0x7f39e0103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:23.993 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.410+0000 7f39e509e640 1 -- 172.21.15.27:0/1548476882 shutdown_connections 2024-09-19T08:01:23.993 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:23.410+0000 7f39e509e640 1 -- 172.21.15.27:0/1548476882 wait complete. 2024-09-19T08:01:23.993 INFO:teuthology.orchestra.run.smithi027.stdout:Restarting the monitor... 2024-09-19T08:01:24.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:24 smithi027 systemd[1]: Stopping Ceph mon.a for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:01:24.594 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:24 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-a[30840]: 2024-09-19T08:01:24.261+0000 7f8ef2740640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:01:24.594 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:24 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-a[30840]: 2024-09-19T08:01:24.261+0000 7f8ef2740640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T08:01:24.594 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:24 smithi027 podman[31086]: 2024-09-19 08:01:24.363610803 +0000 UTC m=+0.203059819 container died 0d15329650b8695535e3dc70ec56dc19f3c5798f0fe4da4690f7a649ab177344 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T08:01:24.845 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:24 smithi027 podman[31086]: 2024-09-19 08:01:24.676991735 +0000 UTC m=+0.516440737 container cleanup 0d15329650b8695535e3dc70ec56dc19f3c5798f0fe4da4690f7a649ab177344 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T08:01:24.845 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:24 smithi027 bash[31086]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-a 2024-09-19T08:01:24.845 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:24 smithi027 podman[31099]: 2024-09-19 08:01:24.844666848 +0000 UTC m=+0.475238438 container remove 0d15329650b8695535e3dc70ec56dc19f3c5798f0fe4da4690f7a649ab177344 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-a, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T08:01:25.417 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 systemd[1]: ceph-35b531b0-765d-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T08:01:25.417 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 systemd[1]: Stopped Ceph mon.a for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:01:25.417 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 systemd[1]: Starting Ceph mon.a for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:01:25.417 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 podman[31191]: 2024-09-19 08:01:25.305117194 +0000 UTC m=+0.104196844 container create e1632427225ee992f26d1beeaafca2e1b19ae237bcea3faea757c52246f95f9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-a, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:01:25.417 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 podman[31191]: 2024-09-19 08:01:25.217235411 +0000 UTC m=+0.016315034 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:01:25.619 INFO:teuthology.orchestra.run.smithi027.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T08:01:25.840 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 podman[31191]: 2024-09-19 08:01:25.532253802 +0000 UTC m=+0.331333424 container init e1632427225ee992f26d1beeaafca2e1b19ae237bcea3faea757c52246f95f9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T08:01:25.840 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 podman[31191]: 2024-09-19 08:01:25.535424753 +0000 UTC m=+0.334504369 container start e1632427225ee992f26d1beeaafca2e1b19ae237bcea3faea757c52246f95f9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T08:01:25.840 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T08:01:25.840 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T08:01:25.840 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: pidfile_write: ignore empty --pid-file 2024-09-19T08:01:25.840 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: load: jerasure load: lrc 2024-09-19T08:01:25.841 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: RocksDB version: 7.9.2 2024-09-19T08:01:25.841 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Git sha 0 2024-09-19T08:01:25.841 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T08:01:25.841 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: DB SUMMARY 2024-09-19T08:01:25.841 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: DB Session ID: JVQI30JV2A8UK92PU5KT 2024-09-19T08:01:25.841 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: CURRENT file: CURRENT 2024-09-19T08:01:25.841 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T08:01:25.841 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T08:01:25.841 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T08:01:25.841 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105268 ; 2024-09-19T08:01:25.841 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.error_if_exists: 0 2024-09-19T08:01:25.841 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.create_if_missing: 0 2024-09-19T08:01:25.842 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.paranoid_checks: 1 2024-09-19T08:01:25.842 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T08:01:25.842 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T08:01:25.842 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T08:01:25.842 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.env: 0x55759a0eb940 2024-09-19T08:01:25.842 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T08:01:25.842 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.info_log: 0x55759b0a56e0 2024-09-19T08:01:25.842 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T08:01:25.842 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.statistics: (nil) 2024-09-19T08:01:25.844 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.use_fsync: 0 2024-09-19T08:01:25.844 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_log_file_size: 0 2024-09-19T08:01:25.844 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T08:01:25.844 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T08:01:25.844 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T08:01:25.844 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T08:01:25.844 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.allow_fallocate: 1 2024-09-19T08:01:25.845 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T08:01:25.845 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T08:01:25.845 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.use_direct_reads: 0 2024-09-19T08:01:25.845 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T08:01:25.845 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T08:01:25.845 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.db_log_dir: 2024-09-19T08:01:25.845 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.wal_dir: 2024-09-19T08:01:25.845 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T08:01:25.845 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T08:01:25.845 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T08:01:25.845 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T08:01:25.845 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T08:01:25.846 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T08:01:25.846 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T08:01:25.846 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T08:01:25.846 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.write_buffer_manager: 0x55759b0b4dc0 2024-09-19T08:01:25.846 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T08:01:25.846 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T08:01:25.846 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T08:01:25.846 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T08:01:25.846 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T08:01:25.846 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T08:01:25.846 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T08:01:25.846 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T08:01:25.847 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.unordered_write: 0 2024-09-19T08:01:25.847 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T08:01:25.847 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T08:01:25.847 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T08:01:25.847 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T08:01:25.847 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.row_cache: None 2024-09-19T08:01:25.847 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.wal_filter: None 2024-09-19T08:01:25.847 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T08:01:25.847 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T08:01:25.847 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.two_write_queues: 0 2024-09-19T08:01:25.847 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T08:01:25.847 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.wal_compression: 0 2024-09-19T08:01:25.847 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.atomic_flush: 0 2024-09-19T08:01:25.847 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T08:01:25.848 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T08:01:25.848 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T08:01:25.848 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.log_readahead_size: 0 2024-09-19T08:01:25.848 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T08:01:25.848 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T08:01:25.848 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T08:01:25.848 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T08:01:25.848 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T08:01:25.848 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T08:01:25.848 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T08:01:25.848 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_background_jobs: 2 2024-09-19T08:01:25.848 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_background_compactions: -1 2024-09-19T08:01:25.848 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_subcompactions: 1 2024-09-19T08:01:25.848 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T08:01:25.849 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T08:01:25.849 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T08:01:25.849 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T08:01:25.849 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T08:01:25.849 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T08:01:25.849 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T08:01:25.849 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T08:01:25.849 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_open_files: -1 2024-09-19T08:01:25.849 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T08:01:25.849 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T08:01:25.849 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T08:01:25.849 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T08:01:25.849 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_background_flushes: -1 2024-09-19T08:01:25.850 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Compression algorithms supported: 2024-09-19T08:01:25.850 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: kZSTD supported: 0 2024-09-19T08:01:25.850 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: kXpressCompression supported: 0 2024-09-19T08:01:25.850 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: kBZip2Compression supported: 0 2024-09-19T08:01:25.850 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T08:01:25.850 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: kLZ4Compression supported: 1 2024-09-19T08:01:25.850 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: kZlibCompression supported: 1 2024-09-19T08:01:25.850 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T08:01:25.850 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: kSnappyCompression supported: 1 2024-09-19T08:01:25.850 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T08:01:25.850 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T08:01:25.850 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T08:01:25.850 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T08:01:25.851 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T08:01:25.851 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.merge_operator: 2024-09-19T08:01:25.851 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compaction_filter: None 2024-09-19T08:01:25.851 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T08:01:25.851 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T08:01:25.851 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T08:01:25.851 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T08:01:25.851 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55759b0a5320) 2024-09-19T08:01:25.851 INFO:journalctl@ceph.mon.a.smithi027.stdout: cache_index_and_filter_blocks: 1 2024-09-19T08:01:25.851 INFO:journalctl@ceph.mon.a.smithi027.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T08:01:25.851 INFO:journalctl@ceph.mon.a.smithi027.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T08:01:25.851 INFO:journalctl@ceph.mon.a.smithi027.stdout: pin_top_level_index_and_filter: 1 2024-09-19T08:01:25.851 INFO:journalctl@ceph.mon.a.smithi027.stdout: index_type: 0 2024-09-19T08:01:25.851 INFO:journalctl@ceph.mon.a.smithi027.stdout: data_block_index_type: 0 2024-09-19T08:01:25.852 INFO:journalctl@ceph.mon.a.smithi027.stdout: index_shortening: 1 2024-09-19T08:01:25.852 INFO:journalctl@ceph.mon.a.smithi027.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T08:01:25.852 INFO:journalctl@ceph.mon.a.smithi027.stdout: checksum: 4 2024-09-19T08:01:25.852 INFO:journalctl@ceph.mon.a.smithi027.stdout: no_block_cache: 0 2024-09-19T08:01:25.852 INFO:journalctl@ceph.mon.a.smithi027.stdout: block_cache: 0x55759b0991f0 2024-09-19T08:01:25.852 INFO:journalctl@ceph.mon.a.smithi027.stdout: block_cache_name: BinnedLRUCache 2024-09-19T08:01:25.852 INFO:journalctl@ceph.mon.a.smithi027.stdout: block_cache_options: 2024-09-19T08:01:25.852 INFO:journalctl@ceph.mon.a.smithi027.stdout: capacity : 536870912 2024-09-19T08:01:25.852 INFO:journalctl@ceph.mon.a.smithi027.stdout: num_shard_bits : 4 2024-09-19T08:01:25.852 INFO:journalctl@ceph.mon.a.smithi027.stdout: strict_capacity_limit : 0 2024-09-19T08:01:25.852 INFO:journalctl@ceph.mon.a.smithi027.stdout: high_pri_pool_ratio: 0.000 2024-09-19T08:01:25.852 INFO:journalctl@ceph.mon.a.smithi027.stdout: block_cache_compressed: (nil) 2024-09-19T08:01:25.853 INFO:journalctl@ceph.mon.a.smithi027.stdout: persistent_cache: (nil) 2024-09-19T08:01:25.853 INFO:journalctl@ceph.mon.a.smithi027.stdout: block_size: 4096 2024-09-19T08:01:25.853 INFO:journalctl@ceph.mon.a.smithi027.stdout: block_size_deviation: 10 2024-09-19T08:01:25.853 INFO:journalctl@ceph.mon.a.smithi027.stdout: block_restart_interval: 16 2024-09-19T08:01:25.853 INFO:journalctl@ceph.mon.a.smithi027.stdout: index_block_restart_interval: 1 2024-09-19T08:01:25.853 INFO:journalctl@ceph.mon.a.smithi027.stdout: metadata_block_size: 4096 2024-09-19T08:01:25.853 INFO:journalctl@ceph.mon.a.smithi027.stdout: partition_filters: 0 2024-09-19T08:01:25.853 INFO:journalctl@ceph.mon.a.smithi027.stdout: use_delta_encoding: 1 2024-09-19T08:01:25.853 INFO:journalctl@ceph.mon.a.smithi027.stdout: filter_policy: bloomfilter 2024-09-19T08:01:25.853 INFO:journalctl@ceph.mon.a.smithi027.stdout: whole_key_filtering: 1 2024-09-19T08:01:25.853 INFO:journalctl@ceph.mon.a.smithi027.stdout: verify_compression: 0 2024-09-19T08:01:25.853 INFO:journalctl@ceph.mon.a.smithi027.stdout: read_amp_bytes_per_bit: 0 2024-09-19T08:01:25.854 INFO:journalctl@ceph.mon.a.smithi027.stdout: format_version: 5 2024-09-19T08:01:25.854 INFO:journalctl@ceph.mon.a.smithi027.stdout: enable_index_compression: 1 2024-09-19T08:01:25.854 INFO:journalctl@ceph.mon.a.smithi027.stdout: block_align: 0 2024-09-19T08:01:25.854 INFO:journalctl@ceph.mon.a.smithi027.stdout: max_auto_readahead_size: 262144 2024-09-19T08:01:25.854 INFO:journalctl@ceph.mon.a.smithi027.stdout: prepopulate_block_cache: 0 2024-09-19T08:01:25.854 INFO:journalctl@ceph.mon.a.smithi027.stdout: initial_auto_readahead_size: 8192 2024-09-19T08:01:25.854 INFO:journalctl@ceph.mon.a.smithi027.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T08:01:25.854 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T08:01:25.854 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T08:01:25.854 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compression: NoCompression 2024-09-19T08:01:25.854 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T08:01:25.854 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T08:01:25.854 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T08:01:25.854 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.num_levels: 7 2024-09-19T08:01:25.855 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T08:01:25.855 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T08:01:25.855 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T08:01:25.855 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T08:01:25.855 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T08:01:25.855 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T08:01:25.855 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T08:01:25.855 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:01:25.855 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T08:01:25.855 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T08:01:25.855 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:01:25.855 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:01:25.855 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T08:01:25.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T08:01:25.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T08:01:25.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T08:01:25.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:01:25.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:01:25.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T08:01:25.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T08:01:25.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:01:25.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T08:01:25.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T08:01:25.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T08:01:25.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T08:01:25.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T08:01:25.857 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T08:01:25.857 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T08:01:25.857 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T08:01:25.857 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T08:01:25.857 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T08:01:25.857 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T08:01:25.857 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T08:01:25.857 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T08:01:25.857 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T08:01:25.857 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T08:01:25.857 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T08:01:25.857 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T08:01:25.857 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T08:01:25.857 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T08:01:25.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T08:01:25.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T08:01:25.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T08:01:25.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T08:01:25.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T08:01:25.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T08:01:25.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T08:01:25.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T08:01:25.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T08:01:25.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T08:01:25.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T08:01:25.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T08:01:25.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T08:01:25.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T08:01:25.859 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.inplace_update_support: 0 2024-09-19T08:01:25.859 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T08:01:25.859 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T08:01:25.859 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T08:01:25.859 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T08:01:25.859 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.bloom_locality: 0 2024-09-19T08:01:25.859 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.max_successive_merges: 0 2024-09-19T08:01:25.859 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T08:01:25.859 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T08:01:25.859 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T08:01:25.859 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T08:01:25.859 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.ttl: 2592000 2024-09-19T08:01:25.859 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T08:01:25.860 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T08:01:25.860 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T08:01:25.860 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.enable_blob_files: false 2024-09-19T08:01:25.860 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.min_blob_size: 0 2024-09-19T08:01:25.860 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T08:01:25.860 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T08:01:25.860 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T08:01:25.860 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T08:01:25.860 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T08:01:25.860 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T08:01:25.860 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T08:01:25.860 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T08:01:25.860 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T08:01:25.860 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T08:01:25.861 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c0252101-ac1d-4089-93ce-0f9e805fc315 2024-09-19T08:01:25.861 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726732885562716, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T08:01:25.861 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T08:01:25.861 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726732885563890, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100335, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98220, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14290, "raw_average_key_size": 49, "raw_value_size": 90493, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726732885, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c0252101-ac1d-4089-93ce-0f9e805fc315", "db_session_id": "JVQI30JV2A8UK92PU5KT", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T08:01:25.861 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726732885563989, "job": 1, "event": "recovery_finished"} 2024-09-19T08:01:25.861 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T08:01:25.861 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T08:01:25.861 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55759b0c6e00 2024-09-19T08:01:25.861 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: DB pointer 0x55759b1c2000 2024-09-19T08:01:25.861 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T08:01:25.861 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T08:01:25.861 INFO:journalctl@ceph.mon.a.smithi027.stdout: ** DB Stats ** 2024-09-19T08:01:25.861 INFO:journalctl@ceph.mon.a.smithi027.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:01:25.862 INFO:journalctl@ceph.mon.a.smithi027.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T08:01:25.862 INFO:journalctl@ceph.mon.a.smithi027.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:01:25.862 INFO:journalctl@ceph.mon.a.smithi027.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:01:25.862 INFO:journalctl@ceph.mon.a.smithi027.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T08:01:25.862 INFO:journalctl@ceph.mon.a.smithi027.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:01:25.862 INFO:journalctl@ceph.mon.a.smithi027.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:01:25.862 INFO:journalctl@ceph.mon.a.smithi027.stdout: 2024-09-19T08:01:25.862 INFO:journalctl@ceph.mon.a.smithi027.stdout: ** Compaction Stats [default] ** 2024-09-19T08:01:25.862 INFO:journalctl@ceph.mon.a.smithi027.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:01:25.862 INFO:journalctl@ceph.mon.a.smithi027.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T08:01:25.862 INFO:journalctl@ceph.mon.a.smithi027.stdout: L0 2/0 99.84 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 124.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:01:25.862 INFO:journalctl@ceph.mon.a.smithi027.stdout: Sum 2/0 99.84 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 124.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:01:25.862 INFO:journalctl@ceph.mon.a.smithi027.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 124.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:01:25.863 INFO:journalctl@ceph.mon.a.smithi027.stdout: 2024-09-19T08:01:25.863 INFO:journalctl@ceph.mon.a.smithi027.stdout: ** Compaction Stats [default] ** 2024-09-19T08:01:25.863 INFO:journalctl@ceph.mon.a.smithi027.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:01:25.863 INFO:journalctl@ceph.mon.a.smithi027.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T08:01:25.863 INFO:journalctl@ceph.mon.a.smithi027.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 124.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:01:25.863 INFO:journalctl@ceph.mon.a.smithi027.stdout: 2024-09-19T08:01:25.863 INFO:journalctl@ceph.mon.a.smithi027.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T08:01:25.863 INFO:journalctl@ceph.mon.a.smithi027.stdout: 2024-09-19T08:01:25.863 INFO:journalctl@ceph.mon.a.smithi027.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:01:25.863 INFO:journalctl@ceph.mon.a.smithi027.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T08:01:25.863 INFO:journalctl@ceph.mon.a.smithi027.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T08:01:25.863 INFO:journalctl@ceph.mon.a.smithi027.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T08:01:25.863 INFO:journalctl@ceph.mon.a.smithi027.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T08:01:25.864 INFO:journalctl@ceph.mon.a.smithi027.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T08:01:25.864 INFO:journalctl@ceph.mon.a.smithi027.stdout: Cumulative compaction: 0.00 GB write, 28.13 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:01:25.864 INFO:journalctl@ceph.mon.a.smithi027.stdout: Interval compaction: 0.00 GB write, 28.13 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:01:25.864 INFO:journalctl@ceph.mon.a.smithi027.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T08:01:25.864 INFO:journalctl@ceph.mon.a.smithi027.stdout: Block cache BinnedLRUCache@0x55759b0991f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T08:01:25.864 INFO:journalctl@ceph.mon.a.smithi027.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T08:01:25.864 INFO:journalctl@ceph.mon.a.smithi027.stdout: 2024-09-19T08:01:25.864 INFO:journalctl@ceph.mon.a.smithi027.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T08:01:25.864 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: starting mon.a rank 0 at public addrs [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] at bind addrs [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:01:25.864 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: mon.a@-1(???) e1 preinit fsid 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:01:25.864 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: mon.a@-1(???).mds e1 new map 2024-09-19T08:01:25.864 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: mon.a@-1(???).mds e1 print_map 2024-09-19T08:01:25.864 INFO:journalctl@ceph.mon.a.smithi027.stdout: e1 2024-09-19T08:01:25.865 INFO:journalctl@ceph.mon.a.smithi027.stdout: btime 2024-09-19T08:01:20:929052+0000 2024-09-19T08:01:25.865 INFO:journalctl@ceph.mon.a.smithi027.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:01:25.865 INFO:journalctl@ceph.mon.a.smithi027.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:01:25.865 INFO:journalctl@ceph.mon.a.smithi027.stdout: legacy client fscid: -1 2024-09-19T08:01:25.865 INFO:journalctl@ceph.mon.a.smithi027.stdout: 2024-09-19T08:01:25.865 INFO:journalctl@ceph.mon.a.smithi027.stdout: No filesystems configured 2024-09-19T08:01:25.865 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T08:01:25.865 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:01:25.865 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:01:25.865 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:01:25.865 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T08:01:25.865 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 bash[31191]: e1632427225ee992f26d1beeaafca2e1b19ae237bcea3faea757c52246f95f9c 2024-09-19T08:01:25.865 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 systemd[1]: Started Ceph mon.a for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:01:25.865 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T08:01:25.866 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: monmap epoch 1 2024-09-19T08:01:25.866 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: fsid 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:01:25.866 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: last_changed 2024-09-19T08:01:17.912400+0000 2024-09-19T08:01:25.866 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: created 2024-09-19T08:01:17.912400+0000 2024-09-19T08:01:25.866 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: min_mon_release 19 (squid) 2024-09-19T08:01:25.866 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: election_strategy: 1 2024-09-19T08:01:25.866 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-09-19T08:01:25.866 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: fsmap 2024-09-19T08:01:25.866 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T08:01:25.866 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:25 smithi027 ceph-mon[31209]: mgrmap e1: no daemons active 2024-09-19T08:01:26.662 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.062+0000 7f8284b6d640 1 Processor -- start 2024-09-19T08:01:26.662 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.063+0000 7f8284b6d640 1 -- start start 2024-09-19T08:01:26.662 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.063+0000 7f8284b6d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82801080c0 0x7f828010a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:26.662 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.063+0000 7f8284b6d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f828007bdf0 con 0x7f82801080c0 2024-09-19T08:01:26.662 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.063+0000 7f827e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82801080c0 0x7f828010a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:26.662 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.063+0000 7f827e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82801080c0 0x7f828010a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36818/0 (socket says 172.21.15.27:36818) 2024-09-19T08:01:26.662 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.063+0000 7f827e59c640 1 -- 172.21.15.27:0/974971202 learned_addr learned my addr 172.21.15.27:0/974971202 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:26.662 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.063+0000 7f827e59c640 1 -- 172.21.15.27:0/974971202 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f828010a9f0 con 0x7f82801080c0 2024-09-19T08:01:26.663 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.065+0000 7f827e59c640 1 --2- 172.21.15.27:0/974971202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82801080c0 0x7f828010a4b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8270009820 tx=0x7f827002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0d0595fba1c9f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:26.663 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.065+0000 7f827dd9b640 1 -- 172.21.15.27:0/974971202 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8270037070 con 0x7f82801080c0 2024-09-19T08:01:26.663 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.065+0000 7f827dd9b640 1 -- 172.21.15.27:0/974971202 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8270032900 con 0x7f82801080c0 2024-09-19T08:01:26.663 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.065+0000 7f827dd9b640 1 -- 172.21.15.27:0/974971202 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8270030850 con 0x7f82801080c0 2024-09-19T08:01:26.663 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.066+0000 7f8284b6d640 1 -- 172.21.15.27:0/974971202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82801080c0 msgr2=0x7f828010a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:26.663 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.066+0000 7f8284b6d640 1 --2- 172.21.15.27:0/974971202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82801080c0 0x7f828010a4b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8270009820 tx=0x7f827002a270 comp rx=0 tx=0).stop 2024-09-19T08:01:26.663 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.066+0000 7f8284b6d640 1 -- 172.21.15.27:0/974971202 shutdown_connections 2024-09-19T08:01:26.663 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.066+0000 7f8284b6d640 1 --2- 172.21.15.27:0/974971202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82801080c0 0x7f828010a4b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:26.663 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.066+0000 7f8284b6d640 1 -- 172.21.15.27:0/974971202 >> 172.21.15.27:0/974971202 conn(0x7f8280101ca0 msgr2=0x7f82801040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:26.663 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.066+0000 7f8284b6d640 1 -- 172.21.15.27:0/974971202 shutdown_connections 2024-09-19T08:01:26.663 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.066+0000 7f8284b6d640 1 -- 172.21.15.27:0/974971202 wait complete. 2024-09-19T08:01:26.663 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.067+0000 7f8284b6d640 1 Processor -- start 2024-09-19T08:01:26.664 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.067+0000 7f8284b6d640 1 -- start start 2024-09-19T08:01:26.664 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.067+0000 7f8284b6d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82801080c0 0x7f828019b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:26.664 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.067+0000 7f8284b6d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f828010b9d0 con 0x7f82801080c0 2024-09-19T08:01:26.664 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.067+0000 7f827e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82801080c0 0x7f828019b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:26.664 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.067+0000 7f827e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82801080c0 0x7f828019b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36826/0 (socket says 172.21.15.27:36826) 2024-09-19T08:01:26.664 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.067+0000 7f827e59c640 1 -- 172.21.15.27:0/3569194291 learned_addr learned my addr 172.21.15.27:0/3569194291 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:26.664 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.067+0000 7f827e59c640 1 -- 172.21.15.27:0/3569194291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f828019bb20 con 0x7f82801080c0 2024-09-19T08:01:26.664 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.068+0000 7f827e59c640 1 --2- 172.21.15.27:0/3569194291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82801080c0 0x7f828019b5e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f82700097f0 tx=0x7f8270030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:26.664 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.068+0000 7f82777fe640 1 -- 172.21.15.27:0/3569194291 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8270042070 con 0x7f82801080c0 2024-09-19T08:01:26.664 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.068+0000 7f82777fe640 1 -- 172.21.15.27:0/3569194291 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8270032ca0 con 0x7f82801080c0 2024-09-19T08:01:26.665 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.068+0000 7f8284b6d640 1 -- 172.21.15.27:0/3569194291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f828019bdb0 con 0x7f82801080c0 2024-09-19T08:01:26.665 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.068+0000 7f82777fe640 1 -- 172.21.15.27:0/3569194291 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8270037040 con 0x7f82801080c0 2024-09-19T08:01:26.665 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.068+0000 7f8284b6d640 1 -- 172.21.15.27:0/3569194291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f828019eaa0 con 0x7f82801080c0 2024-09-19T08:01:26.665 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.068+0000 7f82777fe640 1 -- 172.21.15.27:0/3569194291 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8270045070 con 0x7f82801080c0 2024-09-19T08:01:26.665 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.068+0000 7f82777fe640 1 -- 172.21.15.27:0/3569194291 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8270047ad0 con 0x7f82801080c0 2024-09-19T08:01:26.665 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.069+0000 7f8284b6d640 1 -- 172.21.15.27:0/3569194291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8280108520 con 0x7f82801080c0 2024-09-19T08:01:26.665 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.071+0000 7f82777fe640 1 -- 172.21.15.27:0/3569194291 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f827003db10 con 0x7f82801080c0 2024-09-19T08:01:26.665 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.131+0000 7f8284b6d640 1 -- 172.21.15.27:0/3569194291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f828019f090 con 0x7f82801080c0 2024-09-19T08:01:26.665 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.135+0000 7f82777fe640 1 -- 172.21.15.27:0/3569194291 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f827003d430 con 0x7f82801080c0 2024-09-19T08:01:26.665 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.136+0000 7f8284b6d640 1 -- 172.21.15.27:0/3569194291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82801080c0 msgr2=0x7f828019b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:26.665 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.136+0000 7f8284b6d640 1 --2- 172.21.15.27:0/3569194291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82801080c0 0x7f828019b5e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f82700097f0 tx=0x7f8270030ec0 comp rx=0 tx=0).stop 2024-09-19T08:01:26.665 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.136+0000 7f8284b6d640 1 -- 172.21.15.27:0/3569194291 shutdown_connections 2024-09-19T08:01:26.665 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.136+0000 7f8284b6d640 1 --2- 172.21.15.27:0/3569194291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82801080c0 0x7f828019b5e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:26.666 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.136+0000 7f8284b6d640 1 -- 172.21.15.27:0/3569194291 >> 172.21.15.27:0/3569194291 conn(0x7f8280101ca0 msgr2=0x7f8280102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:26.666 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.136+0000 7f8284b6d640 1 -- 172.21.15.27:0/3569194291 shutdown_connections 2024-09-19T08:01:26.666 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:26.136+0000 7f8284b6d640 1 -- 172.21.15.27:0/3569194291 wait complete. 2024-09-19T08:01:26.666 INFO:teuthology.orchestra.run.smithi027.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T08:01:26.688 INFO:teuthology.orchestra.run.smithi027.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:01:26.688 INFO:teuthology.orchestra.run.smithi027.stdout:Creating mgr... 2024-09-19T08:01:26.688 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T08:01:26.689 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T08:01:26.947 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-35b531b0-765d-11ef-bceb-c7b262605968@mgr.x 2024-09-19T08:01:26.948 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Failed to reset failed state of unit ceph-35b531b0-765d-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-35b531b0-765d-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T08:01:27.106 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-35b531b0-765d-11ef-bceb-c7b262605968.target.wants/ceph-35b531b0-765d-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-35b531b0-765d-11ef-bceb-c7b262605968@.service. 2024-09-19T08:01:27.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:27 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3569194291' entity='client.admin' 2024-09-19T08:01:27.626 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:27 smithi027 podman[31422]: 2024-09-19 08:01:27.546076888 +0000 UTC m=+0.316602068 container start 868aa2f80ed4ee162d66968b98919cd5261dad1286bf241ccdd276d6cbf8a2f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:01:27.626 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:27 smithi027 bash[31422]: 868aa2f80ed4ee162d66968b98919cd5261dad1286bf241ccdd276d6cbf8a2f4 2024-09-19T08:01:27.640 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:01:27.640 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout disabled 2024-09-19T08:01:27.648 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:01:27.648 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-09-19T08:01:27.648 INFO:teuthology.orchestra.run.smithi027.stdout:firewalld.service is not enabled 2024-09-19T08:01:27.648 INFO:teuthology.orchestra.run.smithi027.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T08:01:27.657 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:01:27.657 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout disabled 2024-09-19T08:01:27.665 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:01:27.665 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-09-19T08:01:27.665 INFO:teuthology.orchestra.run.smithi027.stdout:firewalld.service is not enabled 2024-09-19T08:01:27.665 INFO:teuthology.orchestra.run.smithi027.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T08:01:27.665 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mgr to start... 2024-09-19T08:01:27.665 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mgr... 2024-09-19T08:01:27.882 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:27 smithi027 systemd[1]: Started Ceph mgr.x for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:01:27.882 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:27 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:27.672+0000 7fdc75da1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:01:27.882 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:27 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:27.739+0000 7fdc75da1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:01:28.139 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:27 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:27.899+0000 7fdc75da1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:01:28.139 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:27 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:27.968+0000 7fdc75da1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:01:28.139 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:28 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:28.128+0000 7fdc75da1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:01:28.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:28 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/76989309' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:01:28.502 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:28 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:28.278+0000 7fdc75da1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:01:28.726 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-19T08:01:28.729 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:01:28.729 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsid": "35b531b0-765d-11ef-bceb-c7b262605968", 2024-09-19T08:01:28.729 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:01:28.729 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:01:28.729 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:01:28.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:01:28.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:28.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:01:28.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:01:28.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:01:28.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:01:28.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:01:28.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:01:28.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:01:28.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T08:01:28.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:01:28.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:01:28.731 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:01:28.731 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:01:28.731 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:28.731 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:01:28.731 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:01:28.731 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:01:28.731 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:01:28.731 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:01:28.739 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:01:28.739 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:01:28.739 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:01:28.739 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:28.739 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:01:28.740 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:01:28.740 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:01:28.740 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:01:28.740 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:01:28.740 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:01:28.740 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:01:28.740 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:01:28.740 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:01:28.740 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:28.740 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:01:28.740 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:01:28.740 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:01:20:929052+0000", 2024-09-19T08:01:28.740 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:01:28.741 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:01:28.741 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:28.741 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:01:28.741 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T08:01:28.741 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:01:28.741 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:01:28.741 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:01:28.741 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:01:28.741 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:01:28.741 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:01:28.741 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:01:28.741 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:28.742 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:01:28.742 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:01:28.742 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:01:20.929719+0000", 2024-09-19T08:01:28.742 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:01:28.742 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:28.742 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:01:28.742 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:01:28.742 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.068+0000 7fcfe4f20640 1 Processor -- start 2024-09-19T08:01:28.742 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.068+0000 7fcfe4f20640 1 -- start start 2024-09-19T08:01:28.742 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.068+0000 7fcfe4f20640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe0108080 0x7fcfe010a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:28.742 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.069+0000 7fcfe4f20640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe007be30 con 0x7fcfe0108080 2024-09-19T08:01:28.742 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.069+0000 7fcfde59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe0108080 0x7fcfe010a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:28.742 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.069+0000 7fcfde59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe0108080 0x7fcfe010a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36850/0 (socket says 172.21.15.27:36850) 2024-09-19T08:01:28.743 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.069+0000 7fcfde59c640 1 -- 172.21.15.27:0/4268314741 learned_addr learned my addr 172.21.15.27:0/4268314741 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:28.743 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.069+0000 7fcfde59c640 1 -- 172.21.15.27:0/4268314741 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe010a9b0 con 0x7fcfe0108080 2024-09-19T08:01:28.743 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.070+0000 7fcfde59c640 1 --2- 172.21.15.27:0/4268314741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe0108080 0x7fcfe010a470 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0009820 tx=0x7fcfd002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a19a54deb027809 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:28.743 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.070+0000 7fcfdd59a640 1 -- 172.21.15.27:0/4268314741 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfd0037070 con 0x7fcfe0108080 2024-09-19T08:01:28.743 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.070+0000 7fcfdd59a640 1 -- 172.21.15.27:0/4268314741 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcfd0032900 con 0x7fcfe0108080 2024-09-19T08:01:28.743 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.070+0000 7fcfdd59a640 1 -- 172.21.15.27:0/4268314741 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfd0030850 con 0x7fcfe0108080 2024-09-19T08:01:28.743 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.071+0000 7fcfe4f20640 1 -- 172.21.15.27:0/4268314741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe0108080 msgr2=0x7fcfe010a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:28.743 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.071+0000 7fcfe4f20640 1 --2- 172.21.15.27:0/4268314741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe0108080 0x7fcfe010a470 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0009820 tx=0x7fcfd002a270 comp rx=0 tx=0).stop 2024-09-19T08:01:28.743 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.071+0000 7fcfe4f20640 1 -- 172.21.15.27:0/4268314741 shutdown_connections 2024-09-19T08:01:28.743 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.071+0000 7fcfe4f20640 1 --2- 172.21.15.27:0/4268314741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe0108080 0x7fcfe010a470 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:28.743 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.071+0000 7fcfe4f20640 1 -- 172.21.15.27:0/4268314741 >> 172.21.15.27:0/4268314741 conn(0x7fcfe0101ca0 msgr2=0x7fcfe01040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:28.743 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.071+0000 7fcfe4f20640 1 -- 172.21.15.27:0/4268314741 shutdown_connections 2024-09-19T08:01:28.743 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.071+0000 7fcfe4f20640 1 -- 172.21.15.27:0/4268314741 wait complete. 2024-09-19T08:01:28.743 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.072+0000 7fcfe4f20640 1 Processor -- start 2024-09-19T08:01:28.744 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.072+0000 7fcfe4f20640 1 -- start start 2024-09-19T08:01:28.744 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.072+0000 7fcfe4f20640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe0108080 0x7fcfe0107900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:28.744 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.072+0000 7fcfe4f20640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe010b9f0 con 0x7fcfe0108080 2024-09-19T08:01:28.744 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.072+0000 7fcfde59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe0108080 0x7fcfe0107900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:28.744 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.072+0000 7fcfde59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe0108080 0x7fcfe0107900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36860/0 (socket says 172.21.15.27:36860) 2024-09-19T08:01:28.744 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.072+0000 7fcfde59c640 1 -- 172.21.15.27:0/76989309 learned_addr learned my addr 172.21.15.27:0/76989309 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:28.744 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.072+0000 7fcfde59c640 1 -- 172.21.15.27:0/76989309 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe0107e40 con 0x7fcfe0108080 2024-09-19T08:01:28.744 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.073+0000 7fcfde59c640 1 --2- 172.21.15.27:0/76989309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe0108080 0x7fcfe0107900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00097f0 tx=0x7fcfd0030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:28.744 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.073+0000 7fcfcf7fe640 1 -- 172.21.15.27:0/76989309 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfd0042070 con 0x7fcfe0108080 2024-09-19T08:01:28.744 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.073+0000 7fcfcf7fe640 1 -- 172.21.15.27:0/76989309 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcfd0032ca0 con 0x7fcfe0108080 2024-09-19T08:01:28.744 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.073+0000 7fcfe4f20640 1 -- 172.21.15.27:0/76989309 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe0106030 con 0x7fcfe0108080 2024-09-19T08:01:28.744 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.073+0000 7fcfcf7fe640 1 -- 172.21.15.27:0/76989309 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfd0037040 con 0x7fcfe0108080 2024-09-19T08:01:28.744 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.073+0000 7fcfe4f20640 1 -- 172.21.15.27:0/76989309 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe0106570 con 0x7fcfe0108080 2024-09-19T08:01:28.744 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.073+0000 7fcfcf7fe640 1 -- 172.21.15.27:0/76989309 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcfd0045070 con 0x7fcfe0108080 2024-09-19T08:01:28.745 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.073+0000 7fcfcf7fe640 1 -- 172.21.15.27:0/76989309 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcfd0047b30 con 0x7fcfe0108080 2024-09-19T08:01:28.745 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.074+0000 7fcfe4f20640 1 -- 172.21.15.27:0/76989309 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfe01084e0 con 0x7fcfe0108080 2024-09-19T08:01:28.745 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.076+0000 7fcfcf7fe640 1 -- 172.21.15.27:0/76989309 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fcfd003db10 con 0x7fcfe0108080 2024-09-19T08:01:28.745 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.139+0000 7fcfe4f20640 1 -- 172.21.15.27:0/76989309 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fcfe0106870 con 0x7fcfe0108080 2024-09-19T08:01:28.745 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.139+0000 7fcfcf7fe640 1 -- 172.21.15.27:0/76989309 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fcfd003d430 con 0x7fcfe0108080 2024-09-19T08:01:28.745 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.140+0000 7fcfe4f20640 1 -- 172.21.15.27:0/76989309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe0108080 msgr2=0x7fcfe0107900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:28.745 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.141+0000 7fcfe4f20640 1 --2- 172.21.15.27:0/76989309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe0108080 0x7fcfe0107900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00097f0 tx=0x7fcfd0030ec0 comp rx=0 tx=0).stop 2024-09-19T08:01:28.745 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.141+0000 7fcfe4f20640 1 -- 172.21.15.27:0/76989309 shutdown_connections 2024-09-19T08:01:28.745 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.141+0000 7fcfe4f20640 1 --2- 172.21.15.27:0/76989309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe0108080 0x7fcfe0107900 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:28.745 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.141+0000 7fcfe4f20640 1 -- 172.21.15.27:0/76989309 >> 172.21.15.27:0/76989309 conn(0x7fcfe0101ca0 msgr2=0x7fcfe0102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:28.745 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.141+0000 7fcfe4f20640 1 -- 172.21.15.27:0/76989309 shutdown_connections 2024-09-19T08:01:28.745 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:28.141+0000 7fcfe4f20640 1 -- 172.21.15.27:0/76989309 wait complete. 2024-09-19T08:01:28.745 INFO:teuthology.orchestra.run.smithi027.stdout:mgr not available, waiting (1/15)... 2024-09-19T08:01:28.871 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:28 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:28.611+0000 7fdc75da1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:01:28.871 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:28 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:28.675+0000 7fdc75da1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:01:28.871 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:28 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:28.871+0000 7fdc75da1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:01:30.252 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:29 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:29.796+0000 7fdc75da1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:01:30.252 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:29 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:29.866+0000 7fdc75da1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:01:30.855 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:30 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:30.625+0000 7fdc75da1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:01:30.856 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:30 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:30.746+0000 7fdc75da1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:01:31.118 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:30 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:30.902+0000 7fdc75da1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:01:31.119 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:30 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:30.967+0000 7fdc75da1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:01:31.441 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:31 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/413420206' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:01:31.441 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:31 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:31.132+0000 7fdc75da1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:01:31.441 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:31 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:31.204+0000 7fdc75da1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:01:31.441 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:31 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:31.270+0000 7fdc75da1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:01:31.442 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:31 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:31.441+0000 7fdc75da1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:01:31.730 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:31 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:31.510+0000 7fdc75da1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:01:31.730 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:31 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:31.580+0000 7fdc75da1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:01:31.731 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:31 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:31.667+0000 7fdc75da1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:01:31.731 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:31 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:31.730+0000 7fdc75da1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:01:31.786 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-19T08:01:31.786 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:01:31.786 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsid": "35b531b0-765d-11ef-bceb-c7b262605968", 2024-09-19T08:01:31.787 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:01:31.787 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:01:31.787 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:01:31.787 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:01:31.787 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:31.787 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:01:31.787 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:01:31.787 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:01:31.787 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:01:31.787 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:01:31.787 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:01:31.787 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:01:31.787 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-19T08:01:31.788 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:01:31.788 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:01:31.788 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:01:31.788 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:01:31.788 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:31.788 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:01:31.788 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:01:31.788 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:01:31.788 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:01:31.788 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:01:31.797 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:01:31.797 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:01:31.797 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:01:31.797 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:31.797 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:01:31.797 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:01:31.797 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:01:31.797 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:01:31.797 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:01:31.797 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:01:31.798 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:01:31.798 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:01:31.798 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:01:31.798 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:31.798 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:01:31.798 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:01:31.798 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:01:20:929052+0000", 2024-09-19T08:01:31.798 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:01:31.798 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:01:31.798 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:31.798 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:01:31.798 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T08:01:31.798 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:01:31.798 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:01:31.799 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:01:31.799 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:01:31.799 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:01:31.799 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:01:31.799 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:01:31.799 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:31.799 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:01:31.799 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:01:31.799 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:01:20.929719+0000", 2024-09-19T08:01:31.799 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:01:31.799 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:31.799 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:01:31.799 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:01:31.800 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.126+0000 7fb998859640 1 Processor -- start 2024-09-19T08:01:31.800 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.126+0000 7fb998859640 1 -- start start 2024-09-19T08:01:31.800 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.126+0000 7fb998859640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb994108100 0x7fb99410a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:31.800 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.126+0000 7fb998859640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb99407bdb0 con 0x7fb994108100 2024-09-19T08:01:31.800 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.127+0000 7fb99259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb994108100 0x7fb99410a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:31.800 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.127+0000 7fb99259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb994108100 0x7fb99410a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48044/0 (socket says 172.21.15.27:48044) 2024-09-19T08:01:31.800 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.127+0000 7fb99259c640 1 -- 172.21.15.27:0/2924863893 learned_addr learned my addr 172.21.15.27:0/2924863893 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:31.800 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.127+0000 7fb99259c640 1 -- 172.21.15.27:0/2924863893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99410aa30 con 0x7fb994108100 2024-09-19T08:01:31.800 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.128+0000 7fb99259c640 1 --2- 172.21.15.27:0/2924863893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb994108100 0x7fb99410a4f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb984009820 tx=0x7fb98402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb6c67ff26aac3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:31.800 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.128+0000 7fb99159a640 1 -- 172.21.15.27:0/2924863893 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb984037070 con 0x7fb994108100 2024-09-19T08:01:31.800 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.128+0000 7fb99159a640 1 -- 172.21.15.27:0/2924863893 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb984032900 con 0x7fb994108100 2024-09-19T08:01:31.800 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.128+0000 7fb99159a640 1 -- 172.21.15.27:0/2924863893 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb984030850 con 0x7fb994108100 2024-09-19T08:01:31.800 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.129+0000 7fb998859640 1 -- 172.21.15.27:0/2924863893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb994108100 msgr2=0x7fb99410a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:31.800 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.129+0000 7fb998859640 1 --2- 172.21.15.27:0/2924863893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb994108100 0x7fb99410a4f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb984009820 tx=0x7fb98402a270 comp rx=0 tx=0).stop 2024-09-19T08:01:31.801 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.129+0000 7fb998859640 1 -- 172.21.15.27:0/2924863893 shutdown_connections 2024-09-19T08:01:31.801 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.129+0000 7fb998859640 1 --2- 172.21.15.27:0/2924863893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb994108100 0x7fb99410a4f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:31.801 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.129+0000 7fb998859640 1 -- 172.21.15.27:0/2924863893 >> 172.21.15.27:0/2924863893 conn(0x7fb994101ca0 msgr2=0x7fb9941040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:31.801 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.129+0000 7fb998859640 1 -- 172.21.15.27:0/2924863893 shutdown_connections 2024-09-19T08:01:31.801 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.129+0000 7fb998859640 1 -- 172.21.15.27:0/2924863893 wait complete. 2024-09-19T08:01:31.801 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.129+0000 7fb998859640 1 Processor -- start 2024-09-19T08:01:31.801 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.130+0000 7fb998859640 1 -- start start 2024-09-19T08:01:31.801 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.130+0000 7fb998859640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb994108100 0x7fb994107980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:31.802 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.130+0000 7fb998859640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb99410b9b0 con 0x7fb994108100 2024-09-19T08:01:31.802 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.130+0000 7fb99259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb994108100 0x7fb994107980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:31.802 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.130+0000 7fb99259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb994108100 0x7fb994107980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48050/0 (socket says 172.21.15.27:48050) 2024-09-19T08:01:31.802 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.130+0000 7fb99259c640 1 -- 172.21.15.27:0/413420206 learned_addr learned my addr 172.21.15.27:0/413420206 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:31.802 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.130+0000 7fb99259c640 1 -- 172.21.15.27:0/413420206 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb994107ec0 con 0x7fb994108100 2024-09-19T08:01:31.802 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.130+0000 7fb99259c640 1 --2- 172.21.15.27:0/413420206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb994108100 0x7fb994107980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb9840097f0 tx=0x7fb984030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:31.802 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.131+0000 7fb9837fe640 1 -- 172.21.15.27:0/413420206 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb984042070 con 0x7fb994108100 2024-09-19T08:01:31.802 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.131+0000 7fb9837fe640 1 -- 172.21.15.27:0/413420206 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb984032ca0 con 0x7fb994108100 2024-09-19T08:01:31.802 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.131+0000 7fb9837fe640 1 -- 172.21.15.27:0/413420206 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb984037040 con 0x7fb994108100 2024-09-19T08:01:31.802 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.131+0000 7fb998859640 1 -- 172.21.15.27:0/413420206 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9941060b0 con 0x7fb994108100 2024-09-19T08:01:31.802 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.131+0000 7fb998859640 1 -- 172.21.15.27:0/413420206 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9941065f0 con 0x7fb994108100 2024-09-19T08:01:31.802 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.131+0000 7fb9837fe640 1 -- 172.21.15.27:0/413420206 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb984045070 con 0x7fb994108100 2024-09-19T08:01:31.802 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.131+0000 7fb9837fe640 1 -- 172.21.15.27:0/413420206 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb984047a90 con 0x7fb994108100 2024-09-19T08:01:31.803 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.132+0000 7fb998859640 1 -- 172.21.15.27:0/413420206 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb994108560 con 0x7fb994108100 2024-09-19T08:01:31.803 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.134+0000 7fb9837fe640 1 -- 172.21.15.27:0/413420206 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb98403db10 con 0x7fb994108100 2024-09-19T08:01:31.803 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.196+0000 7fb998859640 1 -- 172.21.15.27:0/413420206 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb994106930 con 0x7fb994108100 2024-09-19T08:01:31.803 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.197+0000 7fb9837fe640 1 -- 172.21.15.27:0/413420206 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fb98403d430 con 0x7fb994108100 2024-09-19T08:01:31.803 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.198+0000 7fb998859640 1 -- 172.21.15.27:0/413420206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb994108100 msgr2=0x7fb994107980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:31.803 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.198+0000 7fb998859640 1 --2- 172.21.15.27:0/413420206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb994108100 0x7fb994107980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb9840097f0 tx=0x7fb984030ec0 comp rx=0 tx=0).stop 2024-09-19T08:01:31.803 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.198+0000 7fb998859640 1 -- 172.21.15.27:0/413420206 shutdown_connections 2024-09-19T08:01:31.803 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.198+0000 7fb998859640 1 --2- 172.21.15.27:0/413420206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb994108100 0x7fb994107980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:31.803 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.198+0000 7fb998859640 1 -- 172.21.15.27:0/413420206 >> 172.21.15.27:0/413420206 conn(0x7fb994101ca0 msgr2=0x7fb994102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:31.803 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.198+0000 7fb998859640 1 -- 172.21.15.27:0/413420206 shutdown_connections 2024-09-19T08:01:31.803 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:31.198+0000 7fb998859640 1 -- 172.21.15.27:0/413420206 wait complete. 2024-09-19T08:01:31.803 INFO:teuthology.orchestra.run.smithi027.stdout:mgr not available, waiting (2/15)... 2024-09-19T08:01:32.002 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:31 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:31.794+0000 7fdc75da1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:01:33.002 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:32 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:32.625+0000 7fdc75da1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:01:33.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:32 smithi027 ceph-mon[31209]: Activating manager daemon x 2024-09-19T08:01:33.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:32 smithi027 ceph-mon[31209]: mgrmap e2: x(active, starting, since 0.00311491s) 2024-09-19T08:01:33.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:32 smithi027 ceph-mon[31209]: from='mgr.14100 172.21.15.27:0/1516107925' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:01:33.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:32 smithi027 ceph-mon[31209]: from='mgr.14100 172.21.15.27:0/1516107925' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:01:33.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:32 smithi027 ceph-mon[31209]: from='mgr.14100 172.21.15.27:0/1516107925' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:01:33.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:32 smithi027 ceph-mon[31209]: from='mgr.14100 172.21.15.27:0/1516107925' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:01:33.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:32 smithi027 ceph-mon[31209]: from='mgr.14100 172.21.15.27:0/1516107925' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:01:33.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:32 smithi027 ceph-mon[31209]: Manager daemon x is now available 2024-09-19T08:01:33.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:32 smithi027 ceph-mon[31209]: from='mgr.14100 172.21.15.27:0/1516107925' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:01:33.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:32 smithi027 ceph-mon[31209]: from='mgr.14100 172.21.15.27:0/1516107925' entity='mgr.x' 2024-09-19T08:01:33.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:32 smithi027 ceph-mon[31209]: from='mgr.14100 172.21.15.27:0/1516107925' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:01:33.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:32 smithi027 ceph-mon[31209]: from='mgr.14100 172.21.15.27:0/1516107925' entity='mgr.x' 2024-09-19T08:01:33.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:32 smithi027 ceph-mon[31209]: from='mgr.14100 172.21.15.27:0/1516107925' entity='mgr.x' 2024-09-19T08:01:34.746 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:34 smithi027 ceph-mon[31209]: mgrmap e3: x(active, since 1.00638s) 2024-09-19T08:01:34.746 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:34 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/4003788333' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:01:34.998 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-19T08:01:35.001 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:01:35.001 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsid": "35b531b0-765d-11ef-bceb-c7b262605968", 2024-09-19T08:01:35.001 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:01:35.001 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:01:35.001 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:01:35.001 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:01:35.001 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:35.001 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:01:35.001 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:01:35.002 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:01:35.002 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:01:35.002 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:01:35.002 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:01:35.002 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:01:35.002 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-19T08:01:35.002 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:01:35.002 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:01:35.002 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:01:35.002 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:01:35.002 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:35.002 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:01:35.003 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:01:35.003 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:01:35.003 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:01:35.003 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:01:35.011 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:01:35.011 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:01:35.011 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:01:35.012 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:35.012 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:01:35.012 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:01:35.012 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:01:35.012 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:01:35.012 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:01:35.012 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:01:35.012 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:01:35.012 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:01:35.012 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:01:35.012 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:35.013 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:01:35.013 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:01:35.013 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:01:20:929052+0000", 2024-09-19T08:01:35.013 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:01:35.013 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:01:35.013 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:35.013 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:01:35.013 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:01:35.013 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:01:35.014 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:01:35.014 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:01:35.014 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:01:35.014 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:01:35.014 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:01:35.014 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:01:35.014 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:35.014 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:01:35.014 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:01:35.014 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:01:20.929719+0000", 2024-09-19T08:01:35.014 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:01:35.014 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:01:35.014 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:01:35.015 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:01:35.015 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.214+0000 7f55d95dd640 1 Processor -- start 2024-09-19T08:01:35.015 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.214+0000 7f55d95dd640 1 -- start start 2024-09-19T08:01:35.015 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.215+0000 7f55d95dd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55d4108080 0x7f55d410a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:35.015 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.215+0000 7f55d95dd640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f55d407be30 con 0x7f55d4108080 2024-09-19T08:01:35.015 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.215+0000 7f55d2ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55d4108080 0x7f55d410a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:35.015 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.215+0000 7f55d2ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55d4108080 0x7f55d410a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48134/0 (socket says 172.21.15.27:48134) 2024-09-19T08:01:35.015 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.215+0000 7f55d2ffd640 1 -- 172.21.15.27:0/2767971999 learned_addr learned my addr 172.21.15.27:0/2767971999 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:35.015 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.215+0000 7f55d2ffd640 1 -- 172.21.15.27:0/2767971999 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d410a9b0 con 0x7f55d4108080 2024-09-19T08:01:35.015 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.216+0000 7f55d2ffd640 1 --2- 172.21.15.27:0/2767971999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55d4108080 0x7f55d410a470 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f55c4009820 tx=0x7f55c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726dc39cbed5a001 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:35.015 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.216+0000 7f55d1ffb640 1 -- 172.21.15.27:0/2767971999 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55c4037070 con 0x7f55d4108080 2024-09-19T08:01:35.015 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.216+0000 7f55d1ffb640 1 -- 172.21.15.27:0/2767971999 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f55c4032900 con 0x7f55d4108080 2024-09-19T08:01:35.015 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.216+0000 7f55d1ffb640 1 -- 172.21.15.27:0/2767971999 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55c4030850 con 0x7f55d4108080 2024-09-19T08:01:35.016 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.217+0000 7f55d95dd640 1 -- 172.21.15.27:0/2767971999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55d4108080 msgr2=0x7f55d410a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:35.016 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.217+0000 7f55d95dd640 1 --2- 172.21.15.27:0/2767971999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55d4108080 0x7f55d410a470 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f55c4009820 tx=0x7f55c402a270 comp rx=0 tx=0).stop 2024-09-19T08:01:35.016 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.217+0000 7f55d95dd640 1 -- 172.21.15.27:0/2767971999 shutdown_connections 2024-09-19T08:01:35.016 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.217+0000 7f55d95dd640 1 --2- 172.21.15.27:0/2767971999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55d4108080 0x7f55d410a470 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:35.016 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.217+0000 7f55d95dd640 1 -- 172.21.15.27:0/2767971999 >> 172.21.15.27:0/2767971999 conn(0x7f55d4101ca0 msgr2=0x7f55d41040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:35.016 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.217+0000 7f55d95dd640 1 -- 172.21.15.27:0/2767971999 shutdown_connections 2024-09-19T08:01:35.016 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.217+0000 7f55d95dd640 1 -- 172.21.15.27:0/2767971999 wait complete. 2024-09-19T08:01:35.016 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.218+0000 7f55d95dd640 1 Processor -- start 2024-09-19T08:01:35.016 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.218+0000 7f55d95dd640 1 -- start start 2024-09-19T08:01:35.016 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.218+0000 7f55d95dd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55d4108080 0x7f55d4107900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:35.016 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.218+0000 7f55d95dd640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f55d410b9f0 con 0x7f55d4108080 2024-09-19T08:01:35.016 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.218+0000 7f55d2ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55d4108080 0x7f55d4107900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:35.017 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.218+0000 7f55d2ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55d4108080 0x7f55d4107900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48138/0 (socket says 172.21.15.27:48138) 2024-09-19T08:01:35.017 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.218+0000 7f55d2ffd640 1 -- 172.21.15.27:0/4003788333 learned_addr learned my addr 172.21.15.27:0/4003788333 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:35.017 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.218+0000 7f55d2ffd640 1 -- 172.21.15.27:0/4003788333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d4107e40 con 0x7f55d4108080 2024-09-19T08:01:35.017 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.219+0000 7f55d2ffd640 1 --2- 172.21.15.27:0/4003788333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55d4108080 0x7f55d4107900 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f55c40097f0 tx=0x7f55c4030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:35.017 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.219+0000 7f55bbfff640 1 -- 172.21.15.27:0/4003788333 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55c4042070 con 0x7f55d4108080 2024-09-19T08:01:35.017 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.219+0000 7f55d95dd640 1 -- 172.21.15.27:0/4003788333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d4106030 con 0x7f55d4108080 2024-09-19T08:01:35.017 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.219+0000 7f55bbfff640 1 -- 172.21.15.27:0/4003788333 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f55c4032ca0 con 0x7f55d4108080 2024-09-19T08:01:35.017 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.219+0000 7f55bbfff640 1 -- 172.21.15.27:0/4003788333 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55c4037040 con 0x7f55d4108080 2024-09-19T08:01:35.017 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.219+0000 7f55d95dd640 1 -- 172.21.15.27:0/4003788333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d4106570 con 0x7f55d4108080 2024-09-19T08:01:35.017 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.220+0000 7f55bbfff640 1 -- 172.21.15.27:0/4003788333 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7f55c4045070 con 0x7f55d4108080 2024-09-19T08:01:35.017 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.220+0000 7f55d95dd640 1 -- 172.21.15.27:0/4003788333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d41084e0 con 0x7f55d4108080 2024-09-19T08:01:35.017 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.220+0000 7f55bbfff640 1 --2- 172.21.15.27:0/4003788333 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7f55bc039050 0x7f55bc03b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:35.018 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.220+0000 7f55bbfff640 1 -- 172.21.15.27:0/4003788333 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f55c406bfe0 con 0x7f55d4108080 2024-09-19T08:01:35.018 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.220+0000 7f55d27fc640 1 --2- 172.21.15.27:0/4003788333 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7f55bc039050 0x7f55bc03b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:35.018 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.221+0000 7f55d27fc640 1 --2- 172.21.15.27:0/4003788333 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7f55bc039050 0x7f55bc03b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f55c80098c0 tx=0x7f55c8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:35.018 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.225+0000 7f55bbfff640 1 -- 172.21.15.27:0/4003788333 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f55c4045520 con 0x7f55d4108080 2024-09-19T08:01:35.018 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.469+0000 7f55d95dd640 1 -- 172.21.15.27:0/4003788333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f55d4106db0 con 0x7f55d4108080 2024-09-19T08:01:35.018 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.470+0000 7f55bbfff640 1 -- 172.21.15.27:0/4003788333 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f55c403cd10 con 0x7f55d4108080 2024-09-19T08:01:35.018 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.472+0000 7f55d95dd640 1 -- 172.21.15.27:0/4003788333 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7f55bc039050 msgr2=0x7f55bc03b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:35.018 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.472+0000 7f55d95dd640 1 --2- 172.21.15.27:0/4003788333 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7f55bc039050 0x7f55bc03b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f55c80098c0 tx=0x7f55c8006db0 comp rx=0 tx=0).stop 2024-09-19T08:01:35.018 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.472+0000 7f55d95dd640 1 -- 172.21.15.27:0/4003788333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55d4108080 msgr2=0x7f55d4107900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:35.018 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.472+0000 7f55d95dd640 1 --2- 172.21.15.27:0/4003788333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55d4108080 0x7f55d4107900 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f55c40097f0 tx=0x7f55c4030ec0 comp rx=0 tx=0).stop 2024-09-19T08:01:35.018 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.472+0000 7f55d95dd640 1 -- 172.21.15.27:0/4003788333 shutdown_connections 2024-09-19T08:01:35.018 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.472+0000 7f55d95dd640 1 --2- 172.21.15.27:0/4003788333 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7f55bc039050 0x7f55bc03b510 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:35.019 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.472+0000 7f55d95dd640 1 --2- 172.21.15.27:0/4003788333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55d4108080 0x7f55d4107900 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:35.019 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.472+0000 7f55d95dd640 1 -- 172.21.15.27:0/4003788333 >> 172.21.15.27:0/4003788333 conn(0x7f55d4101ca0 msgr2=0x7f55d4102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:35.019 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.472+0000 7f55d95dd640 1 -- 172.21.15.27:0/4003788333 shutdown_connections 2024-09-19T08:01:35.019 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:34.472+0000 7f55d95dd640 1 -- 172.21.15.27:0/4003788333 wait complete. 2024-09-19T08:01:35.019 INFO:teuthology.orchestra.run.smithi027.stdout:mgr is available 2024-09-19T08:01:36.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:35 smithi027 ceph-mon[31209]: mgrmap e4: x(active, since 2s) 2024-09-19T08:01:36.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:35 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/4101168689' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T08:01:40.482 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-19T08:01:40.482 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T08:01:40.482 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout fsid = 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:01:40.482 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.27:3300,v1:172.21.15.27:6789] 2024-09-19T08:01:40.482 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T08:01:40.483 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T08:01:40.483 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T08:01:40.483 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T08:01:40.483 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-19T08:01:40.483 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T08:01:40.483 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T08:01:40.483 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-19T08:01:40.483 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T08:01:40.483 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T08:01:40.483 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T08:01:40.484 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T08:01:40.484 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T08:01:40.484 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T08:01:40.484 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.380+0000 7f1bee0ed640 1 Processor -- start 2024-09-19T08:01:40.484 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.380+0000 7f1bee0ed640 1 -- start start 2024-09-19T08:01:40.484 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.380+0000 7f1bee0ed640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8107620 0x7f1be8107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.484 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.380+0000 7f1bee0ed640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1be8107ff0 con 0x7f1be8107620 2024-09-19T08:01:40.485 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.380+0000 7f1be77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8107620 0x7f1be8107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:40.485 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.380+0000 7f1be77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8107620 0x7f1be8107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48146/0 (socket says 172.21.15.27:48146) 2024-09-19T08:01:40.485 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.380+0000 7f1be77fe640 1 -- 172.21.15.27:0/4100232626 learned_addr learned my addr 172.21.15.27:0/4100232626 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:40.485 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.380+0000 7f1be77fe640 1 -- 172.21.15.27:0/4100232626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be8108820 con 0x7f1be8107620 2024-09-19T08:01:40.485 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.381+0000 7f1be77fe640 1 --2- 172.21.15.27:0/4100232626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8107620 0x7f1be8107a20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009820 tx=0x7f1bd802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4dff774e4612d8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:40.485 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.381+0000 7f1be67fc640 1 -- 172.21.15.27:0/4100232626 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bd8037070 con 0x7f1be8107620 2024-09-19T08:01:40.485 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.381+0000 7f1be67fc640 1 -- 172.21.15.27:0/4100232626 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1bd8032900 con 0x7f1be8107620 2024-09-19T08:01:40.485 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.381+0000 7f1be67fc640 1 -- 172.21.15.27:0/4100232626 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bd8030850 con 0x7f1be8107620 2024-09-19T08:01:40.485 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.382+0000 7f1bee0ed640 1 -- 172.21.15.27:0/4100232626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8107620 msgr2=0x7f1be8107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:40.486 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.382+0000 7f1bee0ed640 1 --2- 172.21.15.27:0/4100232626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8107620 0x7f1be8107a20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009820 tx=0x7f1bd802a270 comp rx=0 tx=0).stop 2024-09-19T08:01:40.486 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.382+0000 7f1bee0ed640 1 -- 172.21.15.27:0/4100232626 shutdown_connections 2024-09-19T08:01:40.486 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.382+0000 7f1bee0ed640 1 --2- 172.21.15.27:0/4100232626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8107620 0x7f1be8107a20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.486 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.382+0000 7f1bee0ed640 1 -- 172.21.15.27:0/4100232626 >> 172.21.15.27:0/4100232626 conn(0x7f1be8102db0 msgr2=0x7f1be81051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:40.486 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.382+0000 7f1bee0ed640 1 -- 172.21.15.27:0/4100232626 shutdown_connections 2024-09-19T08:01:40.486 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.382+0000 7f1bee0ed640 1 -- 172.21.15.27:0/4100232626 wait complete. 2024-09-19T08:01:40.486 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.383+0000 7f1bee0ed640 1 Processor -- start 2024-09-19T08:01:40.486 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.383+0000 7f1bee0ed640 1 -- start start 2024-09-19T08:01:40.486 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.383+0000 7f1bee0ed640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8107620 0x7f1be819b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.487 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.383+0000 7f1bee0ed640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1be810bbd0 con 0x7f1be8107620 2024-09-19T08:01:40.487 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.383+0000 7f1be77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8107620 0x7f1be819b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:40.487 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.383+0000 7f1be77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8107620 0x7f1be819b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48150/0 (socket says 172.21.15.27:48150) 2024-09-19T08:01:40.487 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.383+0000 7f1be77fe640 1 -- 172.21.15.27:0/4101168689 learned_addr learned my addr 172.21.15.27:0/4101168689 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:40.487 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.383+0000 7f1be77fe640 1 -- 172.21.15.27:0/4101168689 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be819bb90 con 0x7f1be8107620 2024-09-19T08:01:40.487 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.384+0000 7f1be77fe640 1 --2- 172.21.15.27:0/4101168689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8107620 0x7f1be819b650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009940 tx=0x7f1bd80326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:40.487 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.384+0000 7f1be4ff9640 1 -- 172.21.15.27:0/4101168689 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bd8042070 con 0x7f1be8107620 2024-09-19T08:01:40.487 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.384+0000 7f1be4ff9640 1 -- 172.21.15.27:0/4101168689 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1bd8032be0 con 0x7f1be8107620 2024-09-19T08:01:40.488 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.384+0000 7f1bee0ed640 1 -- 172.21.15.27:0/4101168689 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be819be20 con 0x7f1be8107620 2024-09-19T08:01:40.488 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.384+0000 7f1be4ff9640 1 -- 172.21.15.27:0/4101168689 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bd8037040 con 0x7f1be8107620 2024-09-19T08:01:40.488 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.384+0000 7f1bee0ed640 1 -- 172.21.15.27:0/4101168689 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be819eb10 con 0x7f1be8107620 2024-09-19T08:01:40.488 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.385+0000 7f1be4ff9640 1 -- 172.21.15.27:0/4101168689 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f1bd8045070 con 0x7f1be8107620 2024-09-19T08:01:40.488 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.385+0000 7f1bee0ed640 1 -- 172.21.15.27:0/4101168689 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1be810bd50 con 0x7f1be8107620 2024-09-19T08:01:40.488 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.385+0000 7f1be4ff9640 1 --2- 172.21.15.27:0/4101168689 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7f1bd00391b0 0x7f1bd003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.488 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.385+0000 7f1be4ff9640 1 -- 172.21.15.27:0/4101168689 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1bd806c0a0 con 0x7f1be8107620 2024-09-19T08:01:40.488 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.385+0000 7f1be6ffd640 1 --2- 172.21.15.27:0/4101168689 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7f1bd00391b0 0x7f1bd003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:40.488 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.385+0000 7f1be6ffd640 1 --2- 172.21.15.27:0/4101168689 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7f1bd00391b0 0x7f1bd003b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0098c0 tx=0x7f1bdc006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:40.488 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.390+0000 7f1be4ff9640 1 -- 172.21.15.27:0/4101168689 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1bd8045360 con 0x7f1be8107620 2024-09-19T08:01:40.489 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.565+0000 7f1bee0ed640 1 -- 172.21.15.27:0/4101168689 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f1be8107aa0 con 0x7f1be8107620 2024-09-19T08:01:40.489 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.566+0000 7f1be4ff9640 1 -- 172.21.15.27:0/4101168689 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f1bd8032d90 con 0x7f1be8107620 2024-09-19T08:01:40.489 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.568+0000 7f1bee0ed640 1 -- 172.21.15.27:0/4101168689 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7f1bd00391b0 msgr2=0x7f1bd003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:40.489 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.568+0000 7f1bee0ed640 1 --2- 172.21.15.27:0/4101168689 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7f1bd00391b0 0x7f1bd003b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0098c0 tx=0x7f1bdc006db0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.489 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.568+0000 7f1bee0ed640 1 -- 172.21.15.27:0/4101168689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8107620 msgr2=0x7f1be819b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:40.489 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.568+0000 7f1bee0ed640 1 --2- 172.21.15.27:0/4101168689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8107620 0x7f1be819b650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009940 tx=0x7f1bd80326e0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.489 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.568+0000 7f1bee0ed640 1 -- 172.21.15.27:0/4101168689 shutdown_connections 2024-09-19T08:01:40.489 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.568+0000 7f1bee0ed640 1 --2- 172.21.15.27:0/4101168689 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7f1bd00391b0 0x7f1bd003b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.489 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.568+0000 7f1bee0ed640 1 --2- 172.21.15.27:0/4101168689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8107620 0x7f1be819b650 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.489 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.568+0000 7f1bee0ed640 1 -- 172.21.15.27:0/4101168689 >> 172.21.15.27:0/4101168689 conn(0x7f1be8102db0 msgr2=0x7f1be8103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:40.489 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.568+0000 7f1bee0ed640 1 -- 172.21.15.27:0/4101168689 shutdown_connections 2024-09-19T08:01:40.490 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:35.568+0000 7f1bee0ed640 1 -- 172.21.15.27:0/4101168689 wait complete. 2024-09-19T08:01:40.490 INFO:teuthology.orchestra.run.smithi027.stdout:Enabling cephadm module... 2024-09-19T08:01:43.845 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:43 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/538492118' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T08:01:43.846 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:43 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: ignoring --setuser ceph since I am not root 2024-09-19T08:01:43.846 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:43 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: ignoring --setgroup ceph since I am not root 2024-09-19T08:01:43.846 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:43 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:43.785+0000 7faeceda2040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:01:43.846 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:43 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:43.844+0000 7faeceda2040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:01:44.152 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:44 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:43.998+0000 7faeceda2040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:01:44.152 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:44 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:44.068+0000 7faeceda2040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:01:44.419 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:44 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:44.222+0000 7faeceda2040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:01:44.419 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:44 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:44.369+0000 7faeceda2040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:01:44.704 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:44 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/538492118' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T08:01:44.704 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:44 smithi027 ceph-mon[31209]: mgrmap e5: x(active, since 11s) 2024-09-19T08:01:44.958 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:44 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:44.700+0000 7faeceda2040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:01:44.958 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:44 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:44.764+0000 7faeceda2040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:01:44.958 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:44 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:44.957+0000 7faeceda2040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:01:46.252 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:45 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:45.880+0000 7faeceda2040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:01:46.252 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:45 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:45.952+0000 7faeceda2040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:01:46.965 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:46 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:46.700+0000 7faeceda2040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:01:46.965 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:46 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:46.821+0000 7faeceda2040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:01:47.252 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:46 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:46.971+0000 7faeceda2040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:01:47.252 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:47 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:47.035+0000 7faeceda2040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:01:47.252 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:47 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:47.191+0000 7faeceda2040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:01:47.560 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:47 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:47.262+0000 7faeceda2040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:01:47.560 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:47 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:47.324+0000 7faeceda2040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:01:47.560 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:47 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:47.490+0000 7faeceda2040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:01:47.560 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:47 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:47.558+0000 7faeceda2040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:01:47.809 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:47 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:47.627+0000 7faeceda2040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:01:47.810 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:47 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:47.714+0000 7faeceda2040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:01:47.810 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:47 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:47.777+0000 7faeceda2040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:01:47.816 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.351+0000 7fc8940ac640 1 Processor -- start 2024-09-19T08:01:47.817 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.351+0000 7fc8940ac640 1 -- start start 2024-09-19T08:01:47.817 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.351+0000 7fc8940ac640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc88c107620 0x7fc88c107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:47.817 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.351+0000 7fc8940ac640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c107ff0 con 0x7fc88c107620 2024-09-19T08:01:47.817 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.351+0000 7fc891e48640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc88c107620 0x7fc88c107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:47.817 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.351+0000 7fc891e48640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc88c107620 0x7fc88c107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33628/0 (socket says 172.21.15.27:33628) 2024-09-19T08:01:47.817 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.351+0000 7fc891e48640 1 -- 172.21.15.27:0/454129567 learned_addr learned my addr 172.21.15.27:0/454129567 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:47.817 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.352+0000 7fc891e48640 1 -- 172.21.15.27:0/454129567 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c108820 con 0x7fc88c107620 2024-09-19T08:01:47.817 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.352+0000 7fc891e48640 1 --2- 172.21.15.27:0/454129567 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc88c107620 0x7fc88c107a20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc888009820 tx=0x7fc88802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65de785749e4fee2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:47.817 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.353+0000 7fc890e46640 1 -- 172.21.15.27:0/454129567 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc888037070 con 0x7fc88c107620 2024-09-19T08:01:47.817 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.353+0000 7fc890e46640 1 -- 172.21.15.27:0/454129567 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc888032900 con 0x7fc88c107620 2024-09-19T08:01:47.817 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.353+0000 7fc890e46640 1 -- 172.21.15.27:0/454129567 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc888030850 con 0x7fc88c107620 2024-09-19T08:01:47.817 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.353+0000 7fc8940ac640 1 -- 172.21.15.27:0/454129567 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc88c107620 msgr2=0x7fc88c107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:47.818 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.353+0000 7fc8940ac640 1 --2- 172.21.15.27:0/454129567 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc88c107620 0x7fc88c107a20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc888009820 tx=0x7fc88802a270 comp rx=0 tx=0).stop 2024-09-19T08:01:47.818 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.353+0000 7fc8940ac640 1 -- 172.21.15.27:0/454129567 shutdown_connections 2024-09-19T08:01:47.818 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.353+0000 7fc8940ac640 1 --2- 172.21.15.27:0/454129567 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc88c107620 0x7fc88c107a20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:47.818 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.353+0000 7fc8940ac640 1 -- 172.21.15.27:0/454129567 >> 172.21.15.27:0/454129567 conn(0x7fc88c102db0 msgr2=0x7fc88c1051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:47.818 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.353+0000 7fc8940ac640 1 -- 172.21.15.27:0/454129567 shutdown_connections 2024-09-19T08:01:47.818 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.353+0000 7fc8940ac640 1 -- 172.21.15.27:0/454129567 wait complete. 2024-09-19T08:01:47.818 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.354+0000 7fc8940ac640 1 Processor -- start 2024-09-19T08:01:47.818 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.354+0000 7fc8940ac640 1 -- start start 2024-09-19T08:01:47.818 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.354+0000 7fc8940ac640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc88c107620 0x7fc88c19b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:47.818 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.354+0000 7fc8940ac640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c10bbd0 con 0x7fc88c107620 2024-09-19T08:01:47.818 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.354+0000 7fc891e48640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc88c107620 0x7fc88c19b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:47.818 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.354+0000 7fc891e48640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc88c107620 0x7fc88c19b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33634/0 (socket says 172.21.15.27:33634) 2024-09-19T08:01:47.818 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.354+0000 7fc891e48640 1 -- 172.21.15.27:0/538492118 learned_addr learned my addr 172.21.15.27:0/538492118 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:47.819 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.354+0000 7fc891e48640 1 -- 172.21.15.27:0/538492118 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c19bb90 con 0x7fc88c107620 2024-09-19T08:01:47.819 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.355+0000 7fc891e48640 1 --2- 172.21.15.27:0/538492118 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc88c107620 0x7fc88c19b650 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc888009940 tx=0x7fc8880326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:47.819 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.355+0000 7fc882ffd640 1 -- 172.21.15.27:0/538492118 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc888042070 con 0x7fc88c107620 2024-09-19T08:01:47.819 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.355+0000 7fc882ffd640 1 -- 172.21.15.27:0/538492118 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc888032be0 con 0x7fc88c107620 2024-09-19T08:01:47.819 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.355+0000 7fc8940ac640 1 -- 172.21.15.27:0/538492118 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc88c19be20 con 0x7fc88c107620 2024-09-19T08:01:47.819 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.355+0000 7fc882ffd640 1 -- 172.21.15.27:0/538492118 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc888037040 con 0x7fc88c107620 2024-09-19T08:01:47.819 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.355+0000 7fc8940ac640 1 -- 172.21.15.27:0/538492118 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc88c19eb10 con 0x7fc88c107620 2024-09-19T08:01:47.819 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.356+0000 7fc882ffd640 1 -- 172.21.15.27:0/538492118 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fc888045070 con 0x7fc88c107620 2024-09-19T08:01:47.819 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.356+0000 7fc882ffd640 1 --2- 172.21.15.27:0/538492118 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7fc878039160 0x7fc87803b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:47.819 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.356+0000 7fc882ffd640 1 -- 172.21.15.27:0/538492118 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc88806c150 con 0x7fc88c107620 2024-09-19T08:01:47.819 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.356+0000 7fc8940ac640 1 -- 172.21.15.27:0/538492118 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc88c10bd50 con 0x7fc88c107620 2024-09-19T08:01:47.819 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.356+0000 7fc891647640 1 --2- 172.21.15.27:0/538492118 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7fc878039160 0x7fc87803b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:47.819 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.357+0000 7fc891647640 1 --2- 172.21.15.27:0/538492118 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7fc878039160 0x7fc87803b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0098c0 tx=0x7fc87c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:47.820 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.361+0000 7fc882ffd640 1 -- 172.21.15.27:0/538492118 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc88804b170 con 0x7fc88c107620 2024-09-19T08:01:47.820 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.582+0000 7fc8940ac640 1 -- 172.21.15.27:0/538492118 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fc88c19ece0 con 0x7fc88c107620 2024-09-19T08:01:47.820 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.634+0000 7fc882ffd640 1 -- 172.21.15.27:0/538492118 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fc88806bbb0 con 0x7fc88c107620 2024-09-19T08:01:47.820 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.635+0000 7fc882ffd640 1 -- 172.21.15.27:0/538492118 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fc888031ca0 con 0x7fc88c107620 2024-09-19T08:01:47.820 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.637+0000 7fc8940ac640 1 -- 172.21.15.27:0/538492118 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7fc878039160 msgr2=0x7fc87803b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:47.820 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.637+0000 7fc8940ac640 1 --2- 172.21.15.27:0/538492118 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7fc878039160 0x7fc87803b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0098c0 tx=0x7fc87c006db0 comp rx=0 tx=0).stop 2024-09-19T08:01:47.820 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.637+0000 7fc8940ac640 1 -- 172.21.15.27:0/538492118 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc88c107620 msgr2=0x7fc88c19b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:47.820 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.637+0000 7fc8940ac640 1 --2- 172.21.15.27:0/538492118 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc88c107620 0x7fc88c19b650 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc888009940 tx=0x7fc8880326e0 comp rx=0 tx=0).stop 2024-09-19T08:01:47.820 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.637+0000 7fc8940ac640 1 -- 172.21.15.27:0/538492118 shutdown_connections 2024-09-19T08:01:47.820 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.637+0000 7fc8940ac640 1 --2- 172.21.15.27:0/538492118 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7fc878039160 0x7fc87803b620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:47.820 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.637+0000 7fc8940ac640 1 --2- 172.21.15.27:0/538492118 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc88c107620 0x7fc88c19b650 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:47.820 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.637+0000 7fc8940ac640 1 -- 172.21.15.27:0/538492118 >> 172.21.15.27:0/538492118 conn(0x7fc88c102db0 msgr2=0x7fc88c103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:47.820 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.637+0000 7fc8940ac640 1 -- 172.21.15.27:0/538492118 shutdown_connections 2024-09-19T08:01:47.821 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:43.637+0000 7fc8940ac640 1 -- 172.21.15.27:0/538492118 wait complete. 2024-09-19T08:01:48.063 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:47 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:47.842+0000 7faeceda2040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:01:48.685 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:48 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1826480262' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T08:01:48.971 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:48 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:48.683+0000 7faeceda2040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:01:49.050 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:01:49.050 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T08:01:49.050 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:01:49.050 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T08:01:49.050 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T08:01:49.050 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:01:49.050 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.225+0000 7f72fef72640 1 Processor -- start 2024-09-19T08:01:49.050 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.225+0000 7f72fef72640 1 -- start start 2024-09-19T08:01:49.050 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.225+0000 7f72fef72640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72f81080c0 0x7f72f810a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:49.050 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.225+0000 7f72fef72640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f72f807bdf0 con 0x7f72f81080c0 2024-09-19T08:01:49.051 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.225+0000 7f72fcd0e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72f81080c0 0x7f72f810a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:49.051 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.225+0000 7f72fcd0e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72f81080c0 0x7f72f810a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33656/0 (socket says 172.21.15.27:33656) 2024-09-19T08:01:49.051 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.225+0000 7f72fcd0e640 1 -- 172.21.15.27:0/3472096686 learned_addr learned my addr 172.21.15.27:0/3472096686 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:49.051 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.225+0000 7f72fcd0e640 1 -- 172.21.15.27:0/3472096686 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f810a9f0 con 0x7f72f81080c0 2024-09-19T08:01:49.051 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.226+0000 7f72fcd0e640 1 --2- 172.21.15.27:0/3472096686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72f81080c0 0x7f72f810a4b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009820 tx=0x7f72ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fe6d3f9b7679b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:49.051 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.226+0000 7f72f77fe640 1 -- 172.21.15.27:0/3472096686 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ec037070 con 0x7f72f81080c0 2024-09-19T08:01:49.051 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.226+0000 7f72f77fe640 1 -- 172.21.15.27:0/3472096686 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f72ec032900 con 0x7f72f81080c0 2024-09-19T08:01:49.051 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.226+0000 7f72f77fe640 1 -- 172.21.15.27:0/3472096686 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ec030850 con 0x7f72f81080c0 2024-09-19T08:01:49.051 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.227+0000 7f72fef72640 1 -- 172.21.15.27:0/3472096686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72f81080c0 msgr2=0x7f72f810a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:49.051 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.227+0000 7f72fef72640 1 --2- 172.21.15.27:0/3472096686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72f81080c0 0x7f72f810a4b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009820 tx=0x7f72ec02a270 comp rx=0 tx=0).stop 2024-09-19T08:01:49.052 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.227+0000 7f72fef72640 1 -- 172.21.15.27:0/3472096686 shutdown_connections 2024-09-19T08:01:49.052 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.227+0000 7f72fef72640 1 --2- 172.21.15.27:0/3472096686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72f81080c0 0x7f72f810a4b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:49.052 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.227+0000 7f72fef72640 1 -- 172.21.15.27:0/3472096686 >> 172.21.15.27:0/3472096686 conn(0x7f72f8101ca0 msgr2=0x7f72f81040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:49.052 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.227+0000 7f72fef72640 1 -- 172.21.15.27:0/3472096686 shutdown_connections 2024-09-19T08:01:49.052 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.227+0000 7f72fef72640 1 -- 172.21.15.27:0/3472096686 wait complete. 2024-09-19T08:01:49.052 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.228+0000 7f72fef72640 1 Processor -- start 2024-09-19T08:01:49.052 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.228+0000 7f72fef72640 1 -- start start 2024-09-19T08:01:49.052 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.228+0000 7f72fef72640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72f81080c0 0x7f72f819b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:49.052 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.228+0000 7f72fef72640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f72f810b9d0 con 0x7f72f81080c0 2024-09-19T08:01:49.053 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.228+0000 7f72fcd0e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72f81080c0 0x7f72f819b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:49.053 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.228+0000 7f72fcd0e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72f81080c0 0x7f72f819b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33668/0 (socket says 172.21.15.27:33668) 2024-09-19T08:01:49.053 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.228+0000 7f72fcd0e640 1 -- 172.21.15.27:0/1826480262 learned_addr learned my addr 172.21.15.27:0/1826480262 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:49.053 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.228+0000 7f72fcd0e640 1 -- 172.21.15.27:0/1826480262 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f819bb20 con 0x7f72f81080c0 2024-09-19T08:01:49.053 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.229+0000 7f72fcd0e640 1 --2- 172.21.15.27:0/1826480262 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72f81080c0 0x7f72f819b5e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f72ec031000 tx=0x7f72ec0326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:49.053 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.229+0000 7f72f5ffb640 1 -- 172.21.15.27:0/1826480262 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ec042070 con 0x7f72f81080c0 2024-09-19T08:01:49.053 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.229+0000 7f72f5ffb640 1 -- 172.21.15.27:0/1826480262 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f72ec032be0 con 0x7f72f81080c0 2024-09-19T08:01:49.054 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.229+0000 7f72fef72640 1 -- 172.21.15.27:0/1826480262 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f819bdb0 con 0x7f72f81080c0 2024-09-19T08:01:49.054 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.229+0000 7f72f5ffb640 1 -- 172.21.15.27:0/1826480262 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ec037040 con 0x7f72f81080c0 2024-09-19T08:01:49.054 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.229+0000 7f72fef72640 1 -- 172.21.15.27:0/1826480262 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f819eaa0 con 0x7f72f81080c0 2024-09-19T08:01:49.054 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.230+0000 7f72fef72640 1 -- 172.21.15.27:0/1826480262 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f8108520 con 0x7f72f81080c0 2024-09-19T08:01:49.054 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.230+0000 7f72f5ffb640 1 -- 172.21.15.27:0/1826480262 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f72ec045070 con 0x7f72f81080c0 2024-09-19T08:01:49.054 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.230+0000 7f72f5ffb640 1 --2- 172.21.15.27:0/1826480262 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7f72e8039200 0x7f72e803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:49.054 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.231+0000 7f72f5ffb640 1 -- 172.21.15.27:0/1826480262 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f72ec06c170 con 0x7f72f81080c0 2024-09-19T08:01:49.054 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.231+0000 7f72f7fff640 1 -- 172.21.15.27:0/1826480262 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7f72e8039200 msgr2=0x7f72e803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/4146960985 2024-09-19T08:01:49.054 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.231+0000 7f72f7fff640 1 --2- 172.21.15.27:0/1826480262 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7f72e8039200 0x7f72e803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:01:49.054 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.235+0000 7f72f5ffb640 1 -- 172.21.15.27:0/1826480262 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f72ec02f2a0 con 0x7f72f81080c0 2024-09-19T08:01:49.054 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.432+0000 7f72f7fff640 1 -- 172.21.15.27:0/1826480262 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7f72e8039200 msgr2=0x7f72e803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/4146960985 2024-09-19T08:01:49.054 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.432+0000 7f72f7fff640 1 --2- 172.21.15.27:0/1826480262 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7f72e8039200 0x7f72e803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:01:49.055 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.459+0000 7f72fef72640 1 -- 172.21.15.27:0/1826480262 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f72f819ec70 con 0x7f72f81080c0 2024-09-19T08:01:49.055 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.460+0000 7f72f5ffb640 1 -- 172.21.15.27:0/1826480262 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f72ec032d90 con 0x7f72f81080c0 2024-09-19T08:01:49.055 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.462+0000 7f72fef72640 1 -- 172.21.15.27:0/1826480262 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7f72e8039200 msgr2=0x7f72e803b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:01:49.055 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.462+0000 7f72fef72640 1 --2- 172.21.15.27:0/1826480262 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7f72e8039200 0x7f72e803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:49.055 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.462+0000 7f72fef72640 1 -- 172.21.15.27:0/1826480262 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72f81080c0 msgr2=0x7f72f819b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:49.055 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.462+0000 7f72fef72640 1 --2- 172.21.15.27:0/1826480262 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72f81080c0 0x7f72f819b5e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f72ec031000 tx=0x7f72ec0326e0 comp rx=0 tx=0).stop 2024-09-19T08:01:49.055 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.462+0000 7f72fef72640 1 -- 172.21.15.27:0/1826480262 shutdown_connections 2024-09-19T08:01:49.055 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.462+0000 7f72fef72640 1 --2- 172.21.15.27:0/1826480262 >> [v2:172.21.15.27:6800/4146960985,v1:172.21.15.27:6801/4146960985] conn(0x7f72e8039200 0x7f72e803b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:49.055 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.462+0000 7f72fef72640 1 --2- 172.21.15.27:0/1826480262 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72f81080c0 0x7f72f819b5e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:49.055 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.462+0000 7f72fef72640 1 -- 172.21.15.27:0/1826480262 >> 172.21.15.27:0/1826480262 conn(0x7f72f8101ca0 msgr2=0x7f72f8102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:49.055 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.462+0000 7f72fef72640 1 -- 172.21.15.27:0/1826480262 shutdown_connections 2024-09-19T08:01:49.056 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:48.462+0000 7f72fef72640 1 -- 172.21.15.27:0/1826480262 wait complete. 2024-09-19T08:01:49.056 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for the mgr to restart... 2024-09-19T08:01:49.056 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mgr epoch 5... 2024-09-19T08:01:49.690 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:49 smithi027 ceph-mon[31209]: Active manager daemon x restarted 2024-09-19T08:01:49.691 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:49 smithi027 ceph-mon[31209]: Activating manager daemon x 2024-09-19T08:01:49.691 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:49 smithi027 ceph-mon[31209]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T08:01:49.691 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:49 smithi027 ceph-mon[31209]: mgrmap e6: x(active, starting, since 0.00374846s) 2024-09-19T08:01:49.691 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:49 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:01:49.691 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:49 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:01:49.691 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:49 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:01:49.691 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:49 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:01:49.691 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:49 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:01:49.691 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:49 smithi027 ceph-mon[31209]: Manager daemon x is now available 2024-09-19T08:01:49.691 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:49 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' 2024-09-19T08:01:49.692 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:49 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' 2024-09-19T08:01:49.692 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:49 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:01:49.692 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:49 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:01:49.692 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:49 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:01:49.692 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:49 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:01:50.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:01:50.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T08:01:50.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T08:01:50.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:01:50.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.431+0000 7f32af03e640 1 Processor -- start 2024-09-19T08:01:50.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.431+0000 7f32af03e640 1 -- start start 2024-09-19T08:01:50.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.432+0000 7f32af03e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32a81080b0 0x7f32a810a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:50.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.432+0000 7f32af03e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f32a807be40 con 0x7f32a81080b0 2024-09-19T08:01:50.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.432+0000 7f32acdda640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32a81080b0 0x7f32a810a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:50.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.432+0000 7f32acdda640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32a81080b0 0x7f32a810a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33764/0 (socket says 172.21.15.27:33764) 2024-09-19T08:01:50.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.432+0000 7f32acdda640 1 -- 172.21.15.27:0/2127856092 learned_addr learned my addr 172.21.15.27:0/2127856092 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:50.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.432+0000 7f32acdda640 1 -- 172.21.15.27:0/2127856092 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a810a9e0 con 0x7f32a81080b0 2024-09-19T08:01:50.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.433+0000 7f32acdda640 1 --2- 172.21.15.27:0/2127856092 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32a81080b0 0x7f32a810a4a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f329c009820 tx=0x7f329c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfed3b05dfcd07a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:50.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.433+0000 7f32a77fe640 1 -- 172.21.15.27:0/2127856092 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f329c037070 con 0x7f32a81080b0 2024-09-19T08:01:50.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.434+0000 7f32a77fe640 1 -- 172.21.15.27:0/2127856092 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f329c032900 con 0x7f32a81080b0 2024-09-19T08:01:50.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.434+0000 7f32a77fe640 1 -- 172.21.15.27:0/2127856092 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f329c030850 con 0x7f32a81080b0 2024-09-19T08:01:50.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.434+0000 7f32af03e640 1 -- 172.21.15.27:0/2127856092 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32a81080b0 msgr2=0x7f32a810a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:50.242 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.434+0000 7f32af03e640 1 --2- 172.21.15.27:0/2127856092 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32a81080b0 0x7f32a810a4a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f329c009820 tx=0x7f329c02a270 comp rx=0 tx=0).stop 2024-09-19T08:01:50.242 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.434+0000 7f32af03e640 1 -- 172.21.15.27:0/2127856092 shutdown_connections 2024-09-19T08:01:50.242 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.434+0000 7f32af03e640 1 --2- 172.21.15.27:0/2127856092 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32a81080b0 0x7f32a810a4a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:50.242 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.434+0000 7f32af03e640 1 -- 172.21.15.27:0/2127856092 >> 172.21.15.27:0/2127856092 conn(0x7f32a8101d10 msgr2=0x7f32a8104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:50.242 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.434+0000 7f32af03e640 1 -- 172.21.15.27:0/2127856092 shutdown_connections 2024-09-19T08:01:50.242 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.434+0000 7f32af03e640 1 -- 172.21.15.27:0/2127856092 wait complete. 2024-09-19T08:01:50.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.435+0000 7f32af03e640 1 Processor -- start 2024-09-19T08:01:50.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.435+0000 7f32af03e640 1 -- start start 2024-09-19T08:01:50.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.435+0000 7f32af03e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32a81080b0 0x7f32a8107930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:50.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.435+0000 7f32af03e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f32a810ba20 con 0x7f32a81080b0 2024-09-19T08:01:50.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.435+0000 7f32acdda640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32a81080b0 0x7f32a8107930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:50.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.435+0000 7f32acdda640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32a81080b0 0x7f32a8107930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33780/0 (socket says 172.21.15.27:33780) 2024-09-19T08:01:50.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.435+0000 7f32acdda640 1 -- 172.21.15.27:0/2763281606 learned_addr learned my addr 172.21.15.27:0/2763281606 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:50.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.435+0000 7f32acdda640 1 -- 172.21.15.27:0/2763281606 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a8107e70 con 0x7f32a81080b0 2024-09-19T08:01:50.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.436+0000 7f32acdda640 1 --2- 172.21.15.27:0/2763281606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32a81080b0 0x7f32a8107930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f329c032ce0 tx=0x7f329c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:50.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.436+0000 7f32a5ffb640 1 -- 172.21.15.27:0/2763281606 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f329c042070 con 0x7f32a81080b0 2024-09-19T08:01:50.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.436+0000 7f32a5ffb640 1 -- 172.21.15.27:0/2763281606 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f329c0308c0 con 0x7f32a81080b0 2024-09-19T08:01:50.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.436+0000 7f32af03e640 1 -- 172.21.15.27:0/2763281606 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a8106060 con 0x7f32a81080b0 2024-09-19T08:01:50.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.436+0000 7f32a5ffb640 1 -- 172.21.15.27:0/2763281606 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f329c037040 con 0x7f32a81080b0 2024-09-19T08:01:50.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.436+0000 7f32af03e640 1 -- 172.21.15.27:0/2763281606 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a81065a0 con 0x7f32a81080b0 2024-09-19T08:01:50.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.437+0000 7f32a5ffb640 1 -- 172.21.15.27:0/2763281606 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7f329c045070 con 0x7f32a81080b0 2024-09-19T08:01:50.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.437+0000 7f32a5ffb640 1 -- 172.21.15.27:0/2763281606 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f329c06bfb0 con 0x7f32a81080b0 2024-09-19T08:01:50.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.689+0000 7f32a5ffb640 1 -- 172.21.15.27:0/2763281606 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f329c06acd0 con 0x7f32a81080b0 2024-09-19T08:01:50.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.690+0000 7f32a5ffb640 1 --2- 172.21.15.27:0/2763281606 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f3298039cf0 0x7f329803c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:50.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.690+0000 7f32a5ffb640 1 -- 172.21.15.27:0/2763281606 --> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f329c00af30 con 0x7f3298039cf0 2024-09-19T08:01:50.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.690+0000 7f32a7fff640 1 --2- 172.21.15.27:0/2763281606 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f3298039cf0 0x7f329803c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:50.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.691+0000 7f32a7fff640 1 --2- 172.21.15.27:0/2763281606 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f3298039cf0 0x7f329803c0e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f32940098c0 tx=0x7f3294006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:50.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.691+0000 7f32a5ffb640 1 -- 172.21.15.27:0/2763281606 <== mgr.14118 v2:172.21.15.27:6800/538175414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f329c00af30 con 0x7f3298039cf0 2024-09-19T08:01:50.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.698+0000 7f32af03e640 1 -- 172.21.15.27:0/2763281606 --> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f32a8108510 con 0x7f3298039cf0 2024-09-19T08:01:50.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.699+0000 7f32a5ffb640 1 -- 172.21.15.27:0/2763281606 <== mgr.14118 v2:172.21.15.27:6800/538175414 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f32a8108510 con 0x7f3298039cf0 2024-09-19T08:01:50.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.699+0000 7f32af03e640 1 -- 172.21.15.27:0/2763281606 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f3298039cf0 msgr2=0x7f329803c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:50.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.699+0000 7f32af03e640 1 --2- 172.21.15.27:0/2763281606 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f3298039cf0 0x7f329803c0e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f32940098c0 tx=0x7f3294006db0 comp rx=0 tx=0).stop 2024-09-19T08:01:50.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.699+0000 7f32af03e640 1 -- 172.21.15.27:0/2763281606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32a81080b0 msgr2=0x7f32a8107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:50.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.699+0000 7f32af03e640 1 --2- 172.21.15.27:0/2763281606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32a81080b0 0x7f32a8107930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f329c032ce0 tx=0x7f329c032d10 comp rx=0 tx=0).stop 2024-09-19T08:01:50.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.699+0000 7f32af03e640 1 -- 172.21.15.27:0/2763281606 shutdown_connections 2024-09-19T08:01:50.246 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.699+0000 7f32af03e640 1 --2- 172.21.15.27:0/2763281606 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f3298039cf0 0x7f329803c0e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:50.246 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.699+0000 7f32af03e640 1 --2- 172.21.15.27:0/2763281606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32a81080b0 0x7f32a8107930 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:50.246 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.699+0000 7f32af03e640 1 -- 172.21.15.27:0/2763281606 >> 172.21.15.27:0/2763281606 conn(0x7f32a8101d10 msgr2=0x7f32a81028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:50.246 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.699+0000 7f32af03e640 1 -- 172.21.15.27:0/2763281606 shutdown_connections 2024-09-19T08:01:50.246 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:49.699+0000 7f32af03e640 1 -- 172.21.15.27:0/2763281606 wait complete. 2024-09-19T08:01:50.246 INFO:teuthology.orchestra.run.smithi027.stdout:mgr epoch 5 is available 2024-09-19T08:01:50.246 INFO:teuthology.orchestra.run.smithi027.stdout:Setting orchestrator backend to cephadm... 2024-09-19T08:01:50.815 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-mon[31209]: Found migration_current of "None". Setting to last migration. 2024-09-19T08:01:50.816 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-mon[31209]: mgrmap e7: x(active, since 1.00622s) 2024-09-19T08:01:50.816 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' 2024-09-19T08:01:50.816 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' 2024-09-19T08:01:51.252 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:50.966+0000 7fae3b8c7640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:08:01:50] ENGINE Error in HTTPServer.serve 2024-09-19T08:01:51.253 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: Traceback (most recent call last): 2024-09-19T08:01:51.253 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:01:51.253 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: self._connections.run(self.expiration_interval) 2024-09-19T08:01:51.253 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:01:51.253 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: self._run(expiration_interval) 2024-09-19T08:01:51.253 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:01:51.253 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:01:51.253 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:01:51.253 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:01:51.253 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:01:51.253 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: s = self.context.wrap_socket( 2024-09-19T08:01:51.254 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:01:51.254 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: return self.sslsocket_class._create( 2024-09-19T08:01:51.254 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:01:51.254 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: self.do_handshake() 2024-09-19T08:01:51.254 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:01:51.254 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: self._sslobj.do_handshake() 2024-09-19T08:01:51.254 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:01:51.254 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:01:51.527 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.613+0000 7f5b59e06640 1 Processor -- start 2024-09-19T08:01:51.527 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.613+0000 7f5b59e06640 1 -- start start 2024-09-19T08:01:51.527 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.613+0000 7f5b59e06640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b541080c0 0x7f5b5410a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:51.527 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.613+0000 7f5b59e06640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5407bdf0 con 0x7f5b541080c0 2024-09-19T08:01:51.527 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.614+0000 7f5b537fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b541080c0 0x7f5b5410a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:51.528 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.614+0000 7f5b537fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b541080c0 0x7f5b5410a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41774/0 (socket says 172.21.15.27:41774) 2024-09-19T08:01:51.528 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.614+0000 7f5b537fe640 1 -- 172.21.15.27:0/3410589980 learned_addr learned my addr 172.21.15.27:0/3410589980 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:51.528 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.614+0000 7f5b537fe640 1 -- 172.21.15.27:0/3410589980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b5410a9f0 con 0x7f5b541080c0 2024-09-19T08:01:51.528 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.614+0000 7f5b537fe640 1 --2- 172.21.15.27:0/3410589980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b541080c0 0x7f5b5410a4b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009820 tx=0x7f5b3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578cc33a5698bed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:51.528 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.615+0000 7f5b527fc640 1 -- 172.21.15.27:0/3410589980 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b3c037070 con 0x7f5b541080c0 2024-09-19T08:01:51.528 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.615+0000 7f5b527fc640 1 -- 172.21.15.27:0/3410589980 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5b3c032900 con 0x7f5b541080c0 2024-09-19T08:01:51.529 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.615+0000 7f5b527fc640 1 -- 172.21.15.27:0/3410589980 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b3c030850 con 0x7f5b541080c0 2024-09-19T08:01:51.529 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.615+0000 7f5b59e06640 1 -- 172.21.15.27:0/3410589980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b541080c0 msgr2=0x7f5b5410a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:51.529 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.615+0000 7f5b59e06640 1 --2- 172.21.15.27:0/3410589980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b541080c0 0x7f5b5410a4b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009820 tx=0x7f5b3c02a270 comp rx=0 tx=0).stop 2024-09-19T08:01:51.529 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.615+0000 7f5b59e06640 1 -- 172.21.15.27:0/3410589980 shutdown_connections 2024-09-19T08:01:51.529 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.615+0000 7f5b59e06640 1 --2- 172.21.15.27:0/3410589980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b541080c0 0x7f5b5410a4b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:51.530 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.615+0000 7f5b59e06640 1 -- 172.21.15.27:0/3410589980 >> 172.21.15.27:0/3410589980 conn(0x7f5b54101ca0 msgr2=0x7f5b541040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:51.530 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.615+0000 7f5b59e06640 1 -- 172.21.15.27:0/3410589980 shutdown_connections 2024-09-19T08:01:51.530 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.615+0000 7f5b59e06640 1 -- 172.21.15.27:0/3410589980 wait complete. 2024-09-19T08:01:51.530 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.616+0000 7f5b59e06640 1 Processor -- start 2024-09-19T08:01:51.530 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.616+0000 7f5b59e06640 1 -- start start 2024-09-19T08:01:51.530 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.616+0000 7f5b59e06640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b541080c0 0x7f5b5419d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:51.531 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.616+0000 7f5b59e06640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5410b9d0 con 0x7f5b541080c0 2024-09-19T08:01:51.531 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.616+0000 7f5b537fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b541080c0 0x7f5b5419d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:51.531 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.616+0000 7f5b537fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b541080c0 0x7f5b5419d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41788/0 (socket says 172.21.15.27:41788) 2024-09-19T08:01:51.531 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.616+0000 7f5b537fe640 1 -- 172.21.15.27:0/3534302968 learned_addr learned my addr 172.21.15.27:0/3534302968 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:51.531 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.617+0000 7f5b537fe640 1 -- 172.21.15.27:0/3534302968 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b5419dde0 con 0x7f5b541080c0 2024-09-19T08:01:51.531 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.617+0000 7f5b537fe640 1 --2- 172.21.15.27:0/3534302968 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b541080c0 0x7f5b5419d8a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c0097f0 tx=0x7f5b3c030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:51.532 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.617+0000 7f5b50ff9640 1 -- 172.21.15.27:0/3534302968 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b3c042070 con 0x7f5b541080c0 2024-09-19T08:01:51.532 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.617+0000 7f5b50ff9640 1 -- 172.21.15.27:0/3534302968 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5b3c032ca0 con 0x7f5b541080c0 2024-09-19T08:01:51.532 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.617+0000 7f5b50ff9640 1 -- 172.21.15.27:0/3534302968 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b3c037040 con 0x7f5b541080c0 2024-09-19T08:01:51.532 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.617+0000 7f5b59e06640 1 -- 172.21.15.27:0/3534302968 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b5419e070 con 0x7f5b541080c0 2024-09-19T08:01:51.532 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.617+0000 7f5b59e06640 1 -- 172.21.15.27:0/3534302968 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b541a0d60 con 0x7f5b541080c0 2024-09-19T08:01:51.533 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.618+0000 7f5b50ff9640 1 -- 172.21.15.27:0/3534302968 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f5b3c045070 con 0x7f5b541080c0 2024-09-19T08:01:51.533 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.618+0000 7f5b59e06640 1 -- 172.21.15.27:0/3534302968 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b54108520 con 0x7f5b541080c0 2024-09-19T08:01:51.533 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.619+0000 7f5b50ff9640 1 --2- 172.21.15.27:0/3534302968 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f5b400390a0 0x7f5b4003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:51.533 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.619+0000 7f5b50ff9640 1 -- 172.21.15.27:0/3534302968 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5b3c06c0b0 con 0x7f5b541080c0 2024-09-19T08:01:51.533 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.619+0000 7f5b52ffd640 1 --2- 172.21.15.27:0/3534302968 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f5b400390a0 0x7f5b4003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:51.533 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.619+0000 7f5b52ffd640 1 --2- 172.21.15.27:0/3534302968 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f5b400390a0 0x7f5b4003b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5b440098c0 tx=0x7f5b44006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:51.534 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.624+0000 7f5b50ff9640 1 -- 172.21.15.27:0/3534302968 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5b3c045360 con 0x7f5b541080c0 2024-09-19T08:01:51.534 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.815+0000 7f5b59e06640 1 -- 172.21.15.27:0/3534302968 --> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f5b54102f10 con 0x7f5b400390a0 2024-09-19T08:01:51.534 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.820+0000 7f5b50ff9640 1 -- 172.21.15.27:0/3534302968 <== mgr.14118 v2:172.21.15.27:6800/538175414 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5b54102f10 con 0x7f5b400390a0 2024-09-19T08:01:51.534 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.823+0000 7f5b59e06640 1 -- 172.21.15.27:0/3534302968 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f5b400390a0 msgr2=0x7f5b4003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:51.534 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.823+0000 7f5b59e06640 1 --2- 172.21.15.27:0/3534302968 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f5b400390a0 0x7f5b4003b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5b440098c0 tx=0x7f5b44006db0 comp rx=0 tx=0).stop 2024-09-19T08:01:51.534 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.823+0000 7f5b59e06640 1 -- 172.21.15.27:0/3534302968 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b541080c0 msgr2=0x7f5b5419d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:51.535 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.823+0000 7f5b59e06640 1 --2- 172.21.15.27:0/3534302968 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b541080c0 0x7f5b5419d8a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c0097f0 tx=0x7f5b3c030ec0 comp rx=0 tx=0).stop 2024-09-19T08:01:51.535 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.823+0000 7f5b59e06640 1 -- 172.21.15.27:0/3534302968 shutdown_connections 2024-09-19T08:01:51.535 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.823+0000 7f5b59e06640 1 --2- 172.21.15.27:0/3534302968 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f5b400390a0 0x7f5b4003b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:51.535 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.823+0000 7f5b59e06640 1 --2- 172.21.15.27:0/3534302968 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b541080c0 0x7f5b5419d8a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:51.535 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.823+0000 7f5b59e06640 1 -- 172.21.15.27:0/3534302968 >> 172.21.15.27:0/3534302968 conn(0x7f5b54101ca0 msgr2=0x7f5b54102800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:51.535 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.823+0000 7f5b59e06640 1 -- 172.21.15.27:0/3534302968 shutdown_connections 2024-09-19T08:01:51.536 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:50.823+0000 7f5b59e06640 1 -- 172.21.15.27:0/3534302968 wait complete. 2024-09-19T08:01:51.638 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:51 smithi027 ceph-mon[31209]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T08:01:51.639 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:51 smithi027 ceph-mon[31209]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T08:01:51.639 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:51 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' 2024-09-19T08:01:51.639 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:51 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:01:51.639 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:51 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:01:52.712 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:52 smithi027 ceph-mon[31209]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:01:52.712 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:52 smithi027 ceph-mon[31209]: [19/Sep/2024:08:01:50] ENGINE Bus STARTING 2024-09-19T08:01:52.712 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:52 smithi027 ceph-mon[31209]: [19/Sep/2024:08:01:50] ENGINE Serving on https://172.21.15.27:7150 2024-09-19T08:01:52.712 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:52 smithi027 ceph-mon[31209]: [19/Sep/2024:08:01:50] ENGINE Error in HTTPServer.serve 2024-09-19T08:01:52.712 INFO:journalctl@ceph.mon.a.smithi027.stdout: Traceback (most recent call last): 2024-09-19T08:01:52.712 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:01:52.712 INFO:journalctl@ceph.mon.a.smithi027.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:01:52.713 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:01:52.713 INFO:journalctl@ceph.mon.a.smithi027.stdout: self._run(expiration_interval) 2024-09-19T08:01:52.713 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:01:52.713 INFO:journalctl@ceph.mon.a.smithi027.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:01:52.713 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:01:52.713 INFO:journalctl@ceph.mon.a.smithi027.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:01:52.713 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:01:52.713 INFO:journalctl@ceph.mon.a.smithi027.stdout: s = self.context.wrap_socket( 2024-09-19T08:01:52.713 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:01:52.713 INFO:journalctl@ceph.mon.a.smithi027.stdout: return self.sslsocket_class._create( 2024-09-19T08:01:52.713 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:01:52.713 INFO:journalctl@ceph.mon.a.smithi027.stdout: self.do_handshake() 2024-09-19T08:01:52.713 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:01:52.714 INFO:journalctl@ceph.mon.a.smithi027.stdout: self._sslobj.do_handshake() 2024-09-19T08:01:52.714 INFO:journalctl@ceph.mon.a.smithi027.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:01:52.714 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:52 smithi027 ceph-mon[31209]: [19/Sep/2024:08:01:51] ENGINE Serving on http://172.21.15.27:8765 2024-09-19T08:01:52.714 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:52 smithi027 ceph-mon[31209]: [19/Sep/2024:08:01:51] ENGINE Bus STARTED 2024-09-19T08:01:52.714 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:52 smithi027 ceph-mon[31209]: mgrmap e8: x(active, since 2s) 2024-09-19T08:01:52.720 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T08:01:52.721 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.969+0000 7fe070a65640 1 Processor -- start 2024-09-19T08:01:52.721 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.969+0000 7fe070a65640 1 -- start start 2024-09-19T08:01:52.721 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.969+0000 7fe070a65640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe06c108100 0x7fe06c10a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:52.721 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.969+0000 7fe070a65640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c07be40 con 0x7fe06c108100 2024-09-19T08:01:52.721 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.970+0000 7fe06a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe06c108100 0x7fe06c10a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:52.721 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.970+0000 7fe06a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe06c108100 0x7fe06c10a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41804/0 (socket says 172.21.15.27:41804) 2024-09-19T08:01:52.721 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.970+0000 7fe06a59c640 1 -- 172.21.15.27:0/263282617 learned_addr learned my addr 172.21.15.27:0/263282617 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:52.721 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.970+0000 7fe06a59c640 1 -- 172.21.15.27:0/263282617 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe06c10aa30 con 0x7fe06c108100 2024-09-19T08:01:52.721 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.971+0000 7fe06a59c640 1 --2- 172.21.15.27:0/263282617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe06c108100 0x7fe06c10a4f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe054009820 tx=0x7fe05402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca59e14c7c48a5aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:52.722 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.971+0000 7fe06959a640 1 -- 172.21.15.27:0/263282617 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe054037070 con 0x7fe06c108100 2024-09-19T08:01:52.722 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.971+0000 7fe06959a640 1 -- 172.21.15.27:0/263282617 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe054032900 con 0x7fe06c108100 2024-09-19T08:01:52.722 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.971+0000 7fe06959a640 1 -- 172.21.15.27:0/263282617 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe054030850 con 0x7fe06c108100 2024-09-19T08:01:52.722 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.972+0000 7fe070a65640 1 -- 172.21.15.27:0/263282617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe06c108100 msgr2=0x7fe06c10a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:52.722 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.972+0000 7fe070a65640 1 --2- 172.21.15.27:0/263282617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe06c108100 0x7fe06c10a4f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe054009820 tx=0x7fe05402a270 comp rx=0 tx=0).stop 2024-09-19T08:01:52.722 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.972+0000 7fe070a65640 1 -- 172.21.15.27:0/263282617 shutdown_connections 2024-09-19T08:01:52.722 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.972+0000 7fe070a65640 1 --2- 172.21.15.27:0/263282617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe06c108100 0x7fe06c10a4f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:52.722 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.972+0000 7fe070a65640 1 -- 172.21.15.27:0/263282617 >> 172.21.15.27:0/263282617 conn(0x7fe06c101d20 msgr2=0x7fe06c104140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:52.723 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.972+0000 7fe070a65640 1 -- 172.21.15.27:0/263282617 shutdown_connections 2024-09-19T08:01:52.723 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.972+0000 7fe070a65640 1 -- 172.21.15.27:0/263282617 wait complete. 2024-09-19T08:01:52.723 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.972+0000 7fe070a65640 1 Processor -- start 2024-09-19T08:01:52.723 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.973+0000 7fe070a65640 1 -- start start 2024-09-19T08:01:52.723 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.973+0000 7fe070a65640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe06c108100 0x7fe06c19b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:52.723 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.973+0000 7fe070a65640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c10ba70 con 0x7fe06c108100 2024-09-19T08:01:52.723 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.973+0000 7fe06a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe06c108100 0x7fe06c19b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:52.723 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.973+0000 7fe06a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe06c108100 0x7fe06c19b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41810/0 (socket says 172.21.15.27:41810) 2024-09-19T08:01:52.723 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.973+0000 7fe06a59c640 1 -- 172.21.15.27:0/2963142115 learned_addr learned my addr 172.21.15.27:0/2963142115 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:52.724 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.973+0000 7fe06a59c640 1 -- 172.21.15.27:0/2963142115 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe06c19bb90 con 0x7fe06c108100 2024-09-19T08:01:52.724 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.973+0000 7fe06a59c640 1 --2- 172.21.15.27:0/2963142115 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe06c108100 0x7fe06c19b650 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe054032ce0 tx=0x7fe054032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:52.724 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.973+0000 7fe0637fe640 1 -- 172.21.15.27:0/2963142115 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe054042070 con 0x7fe06c108100 2024-09-19T08:01:52.724 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.974+0000 7fe0637fe640 1 -- 172.21.15.27:0/2963142115 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe0540308c0 con 0x7fe06c108100 2024-09-19T08:01:52.724 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.974+0000 7fe070a65640 1 -- 172.21.15.27:0/2963142115 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe06c19be20 con 0x7fe06c108100 2024-09-19T08:01:52.724 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.974+0000 7fe0637fe640 1 -- 172.21.15.27:0/2963142115 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe054037040 con 0x7fe06c108100 2024-09-19T08:01:52.724 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.974+0000 7fe070a65640 1 -- 172.21.15.27:0/2963142115 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe06c19eb10 con 0x7fe06c108100 2024-09-19T08:01:52.724 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.974+0000 7fe0637fe640 1 -- 172.21.15.27:0/2963142115 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fe054045070 con 0x7fe06c108100 2024-09-19T08:01:52.724 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.975+0000 7fe070a65640 1 -- 172.21.15.27:0/2963142115 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe06c108560 con 0x7fe06c108100 2024-09-19T08:01:52.725 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.975+0000 7fe0637fe640 1 --2- 172.21.15.27:0/2963142115 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fe058039200 0x7fe05803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:52.725 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.975+0000 7fe0637fe640 1 -- 172.21.15.27:0/2963142115 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe05406c320 con 0x7fe06c108100 2024-09-19T08:01:52.725 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.975+0000 7fe069d9b640 1 --2- 172.21.15.27:0/2963142115 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fe058039200 0x7fe05803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:52.725 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.975+0000 7fe069d9b640 1 --2- 172.21.15.27:0/2963142115 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fe058039200 0x7fe05803b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe05c0098c0 tx=0x7fe05c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:52.725 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:51.980+0000 7fe0637fe640 1 -- 172.21.15.27:0/2963142115 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe054045360 con 0x7fe06c108100 2024-09-19T08:01:52.725 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:52.156+0000 7fe070a65640 1 -- 172.21.15.27:0/2963142115 --> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fe06c103030 con 0x7fe058039200 2024-09-19T08:01:52.725 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:52.156+0000 7fe0637fe640 1 -- 172.21.15.27:0/2963142115 <== mgr.14118 v2:172.21.15.27:6800/538175414 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fe06c103030 con 0x7fe058039200 2024-09-19T08:01:52.725 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:52.158+0000 7fe070a65640 1 -- 172.21.15.27:0/2963142115 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fe058039200 msgr2=0x7fe05803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:52.725 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:52.158+0000 7fe070a65640 1 --2- 172.21.15.27:0/2963142115 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fe058039200 0x7fe05803b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe05c0098c0 tx=0x7fe05c006db0 comp rx=0 tx=0).stop 2024-09-19T08:01:52.725 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:52.158+0000 7fe070a65640 1 -- 172.21.15.27:0/2963142115 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe06c108100 msgr2=0x7fe06c19b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:52.725 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:52.158+0000 7fe070a65640 1 --2- 172.21.15.27:0/2963142115 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe06c108100 0x7fe06c19b650 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe054032ce0 tx=0x7fe054032d10 comp rx=0 tx=0).stop 2024-09-19T08:01:52.725 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:52.158+0000 7fe070a65640 1 -- 172.21.15.27:0/2963142115 shutdown_connections 2024-09-19T08:01:52.726 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:52.158+0000 7fe070a65640 1 --2- 172.21.15.27:0/2963142115 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fe058039200 0x7fe05803b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:52.726 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:52.158+0000 7fe070a65640 1 --2- 172.21.15.27:0/2963142115 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe06c108100 0x7fe06c19b650 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:52.726 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:52.158+0000 7fe070a65640 1 -- 172.21.15.27:0/2963142115 >> 172.21.15.27:0/2963142115 conn(0x7fe06c101d20 msgr2=0x7fe06c102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:52.726 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:52.159+0000 7fe070a65640 1 -- 172.21.15.27:0/2963142115 shutdown_connections 2024-09-19T08:01:52.726 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:52.159+0000 7fe070a65640 1 -- 172.21.15.27:0/2963142115 wait complete. 2024-09-19T08:01:52.726 INFO:teuthology.orchestra.run.smithi027.stdout:Generating ssh key... 2024-09-19T08:01:53.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:53 smithi027 ceph-mon[31209]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:01:53.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:53 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' 2024-09-19T08:01:53.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:53 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' 2024-09-19T08:01:53.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: Generating public/private rsa key pair. 2024-09-19T08:01:53.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: Your identification has been saved in /tmp/tmpvrpdcnrn/key 2024-09-19T08:01:53.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: Your public key has been saved in /tmp/tmpvrpdcnrn/key.pub 2024-09-19T08:01:53.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: The key fingerprint is: 2024-09-19T08:01:53.754 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: SHA256:HUKh7ogrqlal52XRpiK8DQqEZ9qBGIVO55bJGw/SQ+I ceph-35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:01:53.754 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: The key's randomart image is: 2024-09-19T08:01:53.754 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: +---[RSA 3072]----+ 2024-09-19T08:01:53.754 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: | o. o. | 2024-09-19T08:01:53.754 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: |oo o o | 2024-09-19T08:01:53.754 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: |*oB o . o . | 2024-09-19T08:01:53.755 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: |+E+@ o . = . | 2024-09-19T08:01:53.755 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: |.=+.O . S . | 2024-09-19T08:01:53.755 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: |o .O * + | 2024-09-19T08:01:53.756 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: |. + O = | 2024-09-19T08:01:53.756 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: |.o o o | 2024-09-19T08:01:53.757 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: |*.. | 2024-09-19T08:01:53.757 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:01:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: +----[SHA256]-----+ 2024-09-19T08:01:54.109 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.105+0000 7fc683b08640 1 Processor -- start 2024-09-19T08:01:54.109 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.105+0000 7fc683b08640 1 -- start start 2024-09-19T08:01:54.109 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.105+0000 7fc683b08640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc67c1080d0 0x7fc67c10a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:54.109 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.105+0000 7fc683b08640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc67c07be40 con 0x7fc67c1080d0 2024-09-19T08:01:54.109 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.105+0000 7fc6818a4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc67c1080d0 0x7fc67c10a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:54.109 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.105+0000 7fc6818a4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc67c1080d0 0x7fc67c10a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41818/0 (socket says 172.21.15.27:41818) 2024-09-19T08:01:54.110 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.105+0000 7fc6818a4640 1 -- 172.21.15.27:0/433627007 learned_addr learned my addr 172.21.15.27:0/433627007 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:54.110 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.106+0000 7fc6818a4640 1 -- 172.21.15.27:0/433627007 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc67c10aa00 con 0x7fc67c1080d0 2024-09-19T08:01:54.110 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.106+0000 7fc6818a4640 1 --2- 172.21.15.27:0/433627007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc67c1080d0 0x7fc67c10a4c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc678009820 tx=0x7fc67802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5196176f65d52e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:54.110 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.106+0000 7fc6808a2640 1 -- 172.21.15.27:0/433627007 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc678037070 con 0x7fc67c1080d0 2024-09-19T08:01:54.110 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.107+0000 7fc6808a2640 1 -- 172.21.15.27:0/433627007 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc678032900 con 0x7fc67c1080d0 2024-09-19T08:01:54.110 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.107+0000 7fc6808a2640 1 -- 172.21.15.27:0/433627007 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc678030850 con 0x7fc67c1080d0 2024-09-19T08:01:54.110 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.107+0000 7fc683b08640 1 -- 172.21.15.27:0/433627007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc67c1080d0 msgr2=0x7fc67c10a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:54.110 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.107+0000 7fc683b08640 1 --2- 172.21.15.27:0/433627007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc67c1080d0 0x7fc67c10a4c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc678009820 tx=0x7fc67802a270 comp rx=0 tx=0).stop 2024-09-19T08:01:54.110 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.107+0000 7fc683b08640 1 -- 172.21.15.27:0/433627007 shutdown_connections 2024-09-19T08:01:54.110 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.107+0000 7fc683b08640 1 --2- 172.21.15.27:0/433627007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc67c1080d0 0x7fc67c10a4c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:54.110 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.107+0000 7fc683b08640 1 -- 172.21.15.27:0/433627007 >> 172.21.15.27:0/433627007 conn(0x7fc67c101cb0 msgr2=0x7fc67c1040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:54.110 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.107+0000 7fc683b08640 1 -- 172.21.15.27:0/433627007 shutdown_connections 2024-09-19T08:01:54.110 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.107+0000 7fc683b08640 1 -- 172.21.15.27:0/433627007 wait complete. 2024-09-19T08:01:54.111 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.108+0000 7fc683b08640 1 Processor -- start 2024-09-19T08:01:54.111 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.108+0000 7fc683b08640 1 -- start start 2024-09-19T08:01:54.111 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.108+0000 7fc683b08640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc67c1080d0 0x7fc67c107950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:54.111 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.108+0000 7fc683b08640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc67c10ba40 con 0x7fc67c1080d0 2024-09-19T08:01:54.111 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.108+0000 7fc6818a4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc67c1080d0 0x7fc67c107950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:54.111 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.108+0000 7fc6818a4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc67c1080d0 0x7fc67c107950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41822/0 (socket says 172.21.15.27:41822) 2024-09-19T08:01:54.111 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.108+0000 7fc6818a4640 1 -- 172.21.15.27:0/2249415418 learned_addr learned my addr 172.21.15.27:0/2249415418 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:54.111 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.108+0000 7fc6818a4640 1 -- 172.21.15.27:0/2249415418 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc67c107e90 con 0x7fc67c1080d0 2024-09-19T08:01:54.111 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.109+0000 7fc6818a4640 1 --2- 172.21.15.27:0/2249415418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc67c1080d0 0x7fc67c107950 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc678031000 tx=0x7fc6780326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:54.111 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.109+0000 7fc672ffd640 1 -- 172.21.15.27:0/2249415418 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc678042070 con 0x7fc67c1080d0 2024-09-19T08:01:54.111 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.109+0000 7fc683b08640 1 -- 172.21.15.27:0/2249415418 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc67c106080 con 0x7fc67c1080d0 2024-09-19T08:01:54.111 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.109+0000 7fc672ffd640 1 -- 172.21.15.27:0/2249415418 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc678032be0 con 0x7fc67c1080d0 2024-09-19T08:01:54.111 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.109+0000 7fc672ffd640 1 -- 172.21.15.27:0/2249415418 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc678037040 con 0x7fc67c1080d0 2024-09-19T08:01:54.111 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.109+0000 7fc683b08640 1 -- 172.21.15.27:0/2249415418 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc67c1065c0 con 0x7fc67c1080d0 2024-09-19T08:01:54.112 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.110+0000 7fc672ffd640 1 -- 172.21.15.27:0/2249415418 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fc678045070 con 0x7fc67c1080d0 2024-09-19T08:01:54.112 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.110+0000 7fc683b08640 1 -- 172.21.15.27:0/2249415418 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc67c108530 con 0x7fc67c1080d0 2024-09-19T08:01:54.112 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.110+0000 7fc672ffd640 1 --2- 172.21.15.27:0/2249415418 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fc6680391b0 0x7fc66803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:54.112 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.110+0000 7fc672ffd640 1 -- 172.21.15.27:0/2249415418 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc67806c280 con 0x7fc67c1080d0 2024-09-19T08:01:54.112 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.110+0000 7fc6810a3640 1 --2- 172.21.15.27:0/2249415418 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fc6680391b0 0x7fc66803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:54.112 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.110+0000 7fc6810a3640 1 --2- 172.21.15.27:0/2249415418 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fc6680391b0 0x7fc66803b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc66c0098c0 tx=0x7fc66c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:54.112 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.115+0000 7fc672ffd640 1 -- 172.21.15.27:0/2249415418 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc67802f2a0 con 0x7fc67c1080d0 2024-09-19T08:01:54.112 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.290+0000 7fc683b08640 1 -- 172.21.15.27:0/2249415418 --> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fc67c102ff0 con 0x7fc6680391b0 2024-09-19T08:01:54.112 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.487+0000 7fc672ffd640 1 -- 172.21.15.27:0/2249415418 <== mgr.14118 v2:172.21.15.27:6800/538175414 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc67c102ff0 con 0x7fc6680391b0 2024-09-19T08:01:54.112 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.489+0000 7fc683b08640 1 -- 172.21.15.27:0/2249415418 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fc6680391b0 msgr2=0x7fc66803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:54.112 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.489+0000 7fc683b08640 1 --2- 172.21.15.27:0/2249415418 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fc6680391b0 0x7fc66803b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc66c0098c0 tx=0x7fc66c006db0 comp rx=0 tx=0).stop 2024-09-19T08:01:54.112 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.489+0000 7fc683b08640 1 -- 172.21.15.27:0/2249415418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc67c1080d0 msgr2=0x7fc67c107950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:54.113 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.489+0000 7fc683b08640 1 --2- 172.21.15.27:0/2249415418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc67c1080d0 0x7fc67c107950 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc678031000 tx=0x7fc6780326e0 comp rx=0 tx=0).stop 2024-09-19T08:01:54.113 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.489+0000 7fc683b08640 1 -- 172.21.15.27:0/2249415418 shutdown_connections 2024-09-19T08:01:54.113 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.489+0000 7fc683b08640 1 --2- 172.21.15.27:0/2249415418 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fc6680391b0 0x7fc66803b670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:54.113 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.489+0000 7fc683b08640 1 --2- 172.21.15.27:0/2249415418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc67c1080d0 0x7fc67c107950 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:54.113 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.489+0000 7fc683b08640 1 -- 172.21.15.27:0/2249415418 >> 172.21.15.27:0/2249415418 conn(0x7fc67c101cb0 msgr2=0x7fc67c1028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:54.113 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.489+0000 7fc683b08640 1 -- 172.21.15.27:0/2249415418 shutdown_connections 2024-09-19T08:01:54.113 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:53.489+0000 7fc683b08640 1 -- 172.21.15.27:0/2249415418 wait complete. 2024-09-19T08:01:54.658 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:54 smithi027 ceph-mon[31209]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:01:54.658 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:54 smithi027 ceph-mon[31209]: Generating ssh key... 2024-09-19T08:01:55.215 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDORjr1ipTu/+8J4NnLOmsfXyVpZcJkePd/6w7JHjPRp9G8Qi7Mhmf+sL56iOQDET7HABmXh/EoL1W3HNX279P3td7/RXDQg0ibIUKOd9Dj4dVwb2xJjp+BT8pCFFqNcdBAv8rjqGDquDQ+1VdIAEWYiMDAumSPdemY5yIfRdueehGQ0q+W8zdsjZ6sJG3CZ6lG6Ha5GkXTgf98xvLj2doodLwul5SpqdnomstcYtr950GVhmurvFOWJnUuJFCoq2PMwDtGPCYGkD9YxBpArV/czVGwjdscV9+o3/MZ4e8CYJq4o13Nf5BkrJ8IN3/7GsG7LjAF729ypXr8gCNyz/Q3/QlO5rg1t9d84B69pOU7TjWJYIpCru1mWk70sV80+2JKSgAGJOs/A3FJttCGrGwaegt2mTf76+KZR4tCkHA8urOQR6JyGEBV1ILy8OgMMoFXfys4fDlhucmmZmq5c2wKQGRriISdlh5X8Cst2XlKtV2T4VXrBkOdNt/tZrxHs+0= ceph-35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:01:55.215 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.469+0000 7f795550f640 1 Processor -- start 2024-09-19T08:01:55.215 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.469+0000 7f795550f640 1 -- start start 2024-09-19T08:01:55.215 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.470+0000 7f795550f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950108140 0x7f795010a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:55.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.470+0000 7f795550f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f795007bd70 con 0x7f7950108140 2024-09-19T08:01:55.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.470+0000 7f794effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950108140 0x7f795010a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:55.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.470+0000 7f794effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950108140 0x7f795010a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41836/0 (socket says 172.21.15.27:41836) 2024-09-19T08:01:55.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.470+0000 7f794effd640 1 -- 172.21.15.27:0/2507573232 learned_addr learned my addr 172.21.15.27:0/2507573232 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:55.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.470+0000 7f794effd640 1 -- 172.21.15.27:0/2507573232 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795010aa70 con 0x7f7950108140 2024-09-19T08:01:55.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.471+0000 7f794effd640 1 --2- 172.21.15.27:0/2507573232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950108140 0x7f795010a530 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7948009820 tx=0x7f794802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27169880dc928209 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:55.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.471+0000 7f794dffb640 1 -- 172.21.15.27:0/2507573232 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7948037070 con 0x7f7950108140 2024-09-19T08:01:55.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.471+0000 7f794dffb640 1 -- 172.21.15.27:0/2507573232 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7948032900 con 0x7f7950108140 2024-09-19T08:01:55.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.471+0000 7f794dffb640 1 -- 172.21.15.27:0/2507573232 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7948030850 con 0x7f7950108140 2024-09-19T08:01:55.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.471+0000 7f795550f640 1 -- 172.21.15.27:0/2507573232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950108140 msgr2=0x7f795010a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:55.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.471+0000 7f795550f640 1 --2- 172.21.15.27:0/2507573232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950108140 0x7f795010a530 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7948009820 tx=0x7f794802a270 comp rx=0 tx=0).stop 2024-09-19T08:01:55.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.472+0000 7f795550f640 1 -- 172.21.15.27:0/2507573232 shutdown_connections 2024-09-19T08:01:55.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.472+0000 7f795550f640 1 --2- 172.21.15.27:0/2507573232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950108140 0x7f795010a530 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:55.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.472+0000 7f795550f640 1 -- 172.21.15.27:0/2507573232 >> 172.21.15.27:0/2507573232 conn(0x7f7950101ca0 msgr2=0x7f79501040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:55.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.472+0000 7f795550f640 1 -- 172.21.15.27:0/2507573232 shutdown_connections 2024-09-19T08:01:55.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.472+0000 7f795550f640 1 -- 172.21.15.27:0/2507573232 wait complete. 2024-09-19T08:01:55.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.472+0000 7f795550f640 1 Processor -- start 2024-09-19T08:01:55.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.472+0000 7f795550f640 1 -- start start 2024-09-19T08:01:55.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.473+0000 7f795550f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950108140 0x7f795019b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:55.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.473+0000 7f795550f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f795010b9f0 con 0x7f7950108140 2024-09-19T08:01:55.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.473+0000 7f794effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950108140 0x7f795019b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:55.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.473+0000 7f794effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950108140 0x7f795019b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41848/0 (socket says 172.21.15.27:41848) 2024-09-19T08:01:55.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.473+0000 7f794effd640 1 -- 172.21.15.27:0/819888126 learned_addr learned my addr 172.21.15.27:0/819888126 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:01:55.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.473+0000 7f794effd640 1 -- 172.21.15.27:0/819888126 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795019bb70 con 0x7f7950108140 2024-09-19T08:01:55.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.473+0000 7f794effd640 1 --2- 172.21.15.27:0/819888126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950108140 0x7f795019b630 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f79480097f0 tx=0x7f7948030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:55.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.473+0000 7f7947fff640 1 -- 172.21.15.27:0/819888126 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7948042070 con 0x7f7950108140 2024-09-19T08:01:55.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.473+0000 7f7947fff640 1 -- 172.21.15.27:0/819888126 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7948032ca0 con 0x7f7950108140 2024-09-19T08:01:55.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.473+0000 7f7947fff640 1 -- 172.21.15.27:0/819888126 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7948037040 con 0x7f7950108140 2024-09-19T08:01:55.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.473+0000 7f795550f640 1 -- 172.21.15.27:0/819888126 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f795019be00 con 0x7f7950108140 2024-09-19T08:01:55.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.473+0000 7f795550f640 1 -- 172.21.15.27:0/819888126 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f795019eaf0 con 0x7f7950108140 2024-09-19T08:01:55.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.474+0000 7f7947fff640 1 -- 172.21.15.27:0/819888126 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f7948045070 con 0x7f7950108140 2024-09-19T08:01:55.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.474+0000 7f795550f640 1 -- 172.21.15.27:0/819888126 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79501085a0 con 0x7f7950108140 2024-09-19T08:01:55.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.475+0000 7f7947fff640 1 --2- 172.21.15.27:0/819888126 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f793c039200 0x7f793c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:55.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.475+0000 7f7947fff640 1 -- 172.21.15.27:0/819888126 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f794806c210 con 0x7f7950108140 2024-09-19T08:01:55.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.475+0000 7f794e7fc640 1 --2- 172.21.15.27:0/819888126 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f793c039200 0x7f793c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:55.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.475+0000 7f794e7fc640 1 --2- 172.21.15.27:0/819888126 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f793c039200 0x7f793c03b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f79380098c0 tx=0x7f7938006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:55.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.480+0000 7f7947fff640 1 -- 172.21.15.27:0/819888126 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7948045360 con 0x7f7950108140 2024-09-19T08:01:55.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.657+0000 7f795550f640 1 -- 172.21.15.27:0/819888126 --> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f7950102fc0 con 0x7f793c039200 2024-09-19T08:01:55.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.658+0000 7f7947fff640 1 -- 172.21.15.27:0/819888126 <== mgr.14118 v2:172.21.15.27:6800/538175414 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f7950102fc0 con 0x7f793c039200 2024-09-19T08:01:55.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.660+0000 7f795550f640 1 -- 172.21.15.27:0/819888126 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f793c039200 msgr2=0x7f793c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:55.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.660+0000 7f795550f640 1 --2- 172.21.15.27:0/819888126 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f793c039200 0x7f793c03b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f79380098c0 tx=0x7f7938006db0 comp rx=0 tx=0).stop 2024-09-19T08:01:55.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.660+0000 7f795550f640 1 -- 172.21.15.27:0/819888126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950108140 msgr2=0x7f795019b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:55.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.660+0000 7f795550f640 1 --2- 172.21.15.27:0/819888126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950108140 0x7f795019b630 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f79480097f0 tx=0x7f7948030ec0 comp rx=0 tx=0).stop 2024-09-19T08:01:55.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.660+0000 7f795550f640 1 -- 172.21.15.27:0/819888126 shutdown_connections 2024-09-19T08:01:55.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.660+0000 7f795550f640 1 --2- 172.21.15.27:0/819888126 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f793c039200 0x7f793c03b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:55.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.660+0000 7f795550f640 1 --2- 172.21.15.27:0/819888126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950108140 0x7f795019b630 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:55.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.660+0000 7f795550f640 1 -- 172.21.15.27:0/819888126 >> 172.21.15.27:0/819888126 conn(0x7f7950101ca0 msgr2=0x7f79501028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:55.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.660+0000 7f795550f640 1 -- 172.21.15.27:0/819888126 shutdown_connections 2024-09-19T08:01:55.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:54.660+0000 7f795550f640 1 -- 172.21.15.27:0/819888126 wait complete. 2024-09-19T08:01:55.220 INFO:teuthology.orchestra.run.smithi027.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T08:01:55.220 INFO:teuthology.orchestra.run.smithi027.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T08:01:55.221 INFO:teuthology.orchestra.run.smithi027.stdout:Adding host smithi027... 2024-09-19T08:01:55.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:55 smithi027 ceph-mon[31209]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:01:56.828 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:56 smithi027 ceph-mon[31209]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi027", "addr": "172.21.15.27", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:01:58.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:01:57 smithi027 ceph-mon[31209]: Deploying cephadm binary to smithi027 2024-09-19T08:02:00.248 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Added host 'smithi027' with addr '172.21.15.27' 2024-09-19T08:02:00.248 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.620+0000 7ff6a8433640 1 Processor -- start 2024-09-19T08:02:00.248 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.620+0000 7ff6a8433640 1 -- start start 2024-09-19T08:02:00.248 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.620+0000 7ff6a8433640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6a0108080 0x7ff6a010a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:00.248 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.620+0000 7ff6a8433640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a007be30 con 0x7ff6a0108080 2024-09-19T08:02:00.248 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.621+0000 7ff6a61cf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6a0108080 0x7ff6a010a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:00.248 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.621+0000 7ff6a61cf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6a0108080 0x7ff6a010a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41858/0 (socket says 172.21.15.27:41858) 2024-09-19T08:02:00.248 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.621+0000 7ff6a61cf640 1 -- 172.21.15.27:0/3728960799 learned_addr learned my addr 172.21.15.27:0/3728960799 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:00.249 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.621+0000 7ff6a61cf640 1 -- 172.21.15.27:0/3728960799 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a010a9b0 con 0x7ff6a0108080 2024-09-19T08:02:00.249 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.622+0000 7ff6a61cf640 1 --2- 172.21.15.27:0/3728960799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6a0108080 0x7ff6a010a470 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff698009820 tx=0x7ff69802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b452d420829a1c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:00.249 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.622+0000 7ff6a51cd640 1 -- 172.21.15.27:0/3728960799 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff698037070 con 0x7ff6a0108080 2024-09-19T08:02:00.249 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.622+0000 7ff6a51cd640 1 -- 172.21.15.27:0/3728960799 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff698032900 con 0x7ff6a0108080 2024-09-19T08:02:00.249 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.622+0000 7ff6a51cd640 1 -- 172.21.15.27:0/3728960799 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff698030850 con 0x7ff6a0108080 2024-09-19T08:02:00.249 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.622+0000 7ff6a8433640 1 -- 172.21.15.27:0/3728960799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6a0108080 msgr2=0x7ff6a010a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:00.249 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.622+0000 7ff6a8433640 1 --2- 172.21.15.27:0/3728960799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6a0108080 0x7ff6a010a470 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff698009820 tx=0x7ff69802a270 comp rx=0 tx=0).stop 2024-09-19T08:02:00.249 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.623+0000 7ff6a8433640 1 -- 172.21.15.27:0/3728960799 shutdown_connections 2024-09-19T08:02:00.249 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.623+0000 7ff6a8433640 1 --2- 172.21.15.27:0/3728960799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6a0108080 0x7ff6a010a470 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:00.249 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.623+0000 7ff6a8433640 1 -- 172.21.15.27:0/3728960799 >> 172.21.15.27:0/3728960799 conn(0x7ff6a0101ca0 msgr2=0x7ff6a01040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:00.249 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.623+0000 7ff6a8433640 1 -- 172.21.15.27:0/3728960799 shutdown_connections 2024-09-19T08:02:00.249 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.623+0000 7ff6a8433640 1 -- 172.21.15.27:0/3728960799 wait complete. 2024-09-19T08:02:00.250 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.623+0000 7ff6a8433640 1 Processor -- start 2024-09-19T08:02:00.250 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.623+0000 7ff6a8433640 1 -- start start 2024-09-19T08:02:00.250 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.623+0000 7ff6a8433640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6a0108080 0x7ff6a019b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:00.250 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.623+0000 7ff6a8433640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a010b9f0 con 0x7ff6a0108080 2024-09-19T08:02:00.250 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.624+0000 7ff6a61cf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6a0108080 0x7ff6a019b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:00.250 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.624+0000 7ff6a61cf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6a0108080 0x7ff6a019b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41868/0 (socket says 172.21.15.27:41868) 2024-09-19T08:02:00.250 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.624+0000 7ff6a61cf640 1 -- 172.21.15.27:0/1008958455 learned_addr learned my addr 172.21.15.27:0/1008958455 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:00.250 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.624+0000 7ff6a61cf640 1 -- 172.21.15.27:0/1008958455 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a019bb70 con 0x7ff6a0108080 2024-09-19T08:02:00.250 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.624+0000 7ff6a61cf640 1 --2- 172.21.15.27:0/1008958455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6a0108080 0x7ff6a019b630 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff6980097f0 tx=0x7ff698030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:00.250 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.624+0000 7ff69f7fe640 1 -- 172.21.15.27:0/1008958455 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff698042070 con 0x7ff6a0108080 2024-09-19T08:02:00.250 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.624+0000 7ff69f7fe640 1 -- 172.21.15.27:0/1008958455 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff698032ca0 con 0x7ff6a0108080 2024-09-19T08:02:00.250 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.624+0000 7ff6a8433640 1 -- 172.21.15.27:0/1008958455 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a019be00 con 0x7ff6a0108080 2024-09-19T08:02:00.250 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.624+0000 7ff69f7fe640 1 -- 172.21.15.27:0/1008958455 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff698037040 con 0x7ff6a0108080 2024-09-19T08:02:00.251 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.624+0000 7ff6a8433640 1 -- 172.21.15.27:0/1008958455 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6a019eaf0 con 0x7ff6a0108080 2024-09-19T08:02:00.251 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.625+0000 7ff69f7fe640 1 -- 172.21.15.27:0/1008958455 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7ff698045070 con 0x7ff6a0108080 2024-09-19T08:02:00.251 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.625+0000 7ff69f7fe640 1 --2- 172.21.15.27:0/1008958455 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7ff688039200 0x7ff68803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:00.251 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.625+0000 7ff69f7fe640 1 -- 172.21.15.27:0/1008958455 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff69806c250 con 0x7ff6a0108080 2024-09-19T08:02:00.251 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.625+0000 7ff6a8433640 1 -- 172.21.15.27:0/1008958455 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6a01084e0 con 0x7ff6a0108080 2024-09-19T08:02:00.251 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.625+0000 7ff6a59ce640 1 --2- 172.21.15.27:0/1008958455 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7ff688039200 0x7ff68803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:00.251 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.626+0000 7ff6a59ce640 1 --2- 172.21.15.27:0/1008958455 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7ff688039200 0x7ff68803b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff6940098c0 tx=0x7ff694006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:00.251 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.630+0000 7ff69f7fe640 1 -- 172.21.15.27:0/1008958455 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff698045520 con 0x7ff6a0108080 2024-09-19T08:02:00.251 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:55.813+0000 7ff6a8433640 1 -- 172.21.15.27:0/1008958455 --> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi027", "addr": "172.21.15.27", "target": ["mon-mgr", ""]}) -- 0x7ff6a0102f80 con 0x7ff688039200 2024-09-19T08:02:00.251 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:59.675+0000 7ff69f7fe640 1 -- 172.21.15.27:0/1008958455 <== mgr.14118 v2:172.21.15.27:6800/538175414 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7ff6a0102f80 con 0x7ff688039200 2024-09-19T08:02:00.251 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:59.679+0000 7ff6a8433640 1 -- 172.21.15.27:0/1008958455 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7ff688039200 msgr2=0x7ff68803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:00.251 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:59.679+0000 7ff6a8433640 1 --2- 172.21.15.27:0/1008958455 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7ff688039200 0x7ff68803b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff6940098c0 tx=0x7ff694006db0 comp rx=0 tx=0).stop 2024-09-19T08:02:00.251 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:59.679+0000 7ff6a8433640 1 -- 172.21.15.27:0/1008958455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6a0108080 msgr2=0x7ff6a019b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:00.252 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:59.679+0000 7ff6a8433640 1 --2- 172.21.15.27:0/1008958455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6a0108080 0x7ff6a019b630 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff6980097f0 tx=0x7ff698030ec0 comp rx=0 tx=0).stop 2024-09-19T08:02:00.252 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:59.679+0000 7ff6a8433640 1 -- 172.21.15.27:0/1008958455 shutdown_connections 2024-09-19T08:02:00.252 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:59.679+0000 7ff6a8433640 1 --2- 172.21.15.27:0/1008958455 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7ff688039200 0x7ff68803b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:00.252 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:59.679+0000 7ff6a8433640 1 --2- 172.21.15.27:0/1008958455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6a0108080 0x7ff6a019b630 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:00.252 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:59.679+0000 7ff6a8433640 1 -- 172.21.15.27:0/1008958455 >> 172.21.15.27:0/1008958455 conn(0x7ff6a0101ca0 msgr2=0x7ff6a0102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:00.252 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:59.679+0000 7ff6a8433640 1 -- 172.21.15.27:0/1008958455 shutdown_connections 2024-09-19T08:02:00.252 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:01:59.679+0000 7ff6a8433640 1 -- 172.21.15.27:0/1008958455 wait complete. 2024-09-19T08:02:00.252 INFO:teuthology.orchestra.run.smithi027.stdout:Deploying unmanaged mon service... 2024-09-19T08:02:00.745 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:00 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' 2024-09-19T08:02:00.745 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:00 smithi027 ceph-mon[31209]: Added host smithi027 2024-09-19T08:02:00.745 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:00 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:02:02.175 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:01 smithi027 ceph-mon[31209]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:02:02.175 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:01 smithi027 ceph-mon[31209]: Saving service mon spec with placement count:5 2024-09-19T08:02:02.175 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:01 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' 2024-09-19T08:02:02.175 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:01 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' 2024-09-19T08:02:02.441 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T08:02:02.441 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.744+0000 7fe78761d640 1 Processor -- start 2024-09-19T08:02:02.441 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.744+0000 7fe78761d640 1 -- start start 2024-09-19T08:02:02.441 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.745+0000 7fe78761d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe780107620 0x7fe780107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:02.442 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.745+0000 7fe78761d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe780107ff0 con 0x7fe780107620 2024-09-19T08:02:02.442 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.745+0000 7fe7853b9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe780107620 0x7fe780107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:02.442 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.745+0000 7fe7853b9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe780107620 0x7fe780107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60086/0 (socket says 172.21.15.27:60086) 2024-09-19T08:02:02.442 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.745+0000 7fe7853b9640 1 -- 172.21.15.27:0/641809340 learned_addr learned my addr 172.21.15.27:0/641809340 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:02.442 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.745+0000 7fe7853b9640 1 -- 172.21.15.27:0/641809340 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe780108820 con 0x7fe780107620 2024-09-19T08:02:02.442 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.746+0000 7fe7853b9640 1 --2- 172.21.15.27:0/641809340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe780107620 0x7fe780107a20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009820 tx=0x7fe77c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a3974c43b8f922 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:02.442 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.746+0000 7fe777fff640 1 -- 172.21.15.27:0/641809340 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe77c037070 con 0x7fe780107620 2024-09-19T08:02:02.442 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.746+0000 7fe777fff640 1 -- 172.21.15.27:0/641809340 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe77c032900 con 0x7fe780107620 2024-09-19T08:02:02.442 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.746+0000 7fe777fff640 1 -- 172.21.15.27:0/641809340 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe77c030850 con 0x7fe780107620 2024-09-19T08:02:02.442 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.747+0000 7fe78761d640 1 -- 172.21.15.27:0/641809340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe780107620 msgr2=0x7fe780107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:02.442 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.747+0000 7fe78761d640 1 --2- 172.21.15.27:0/641809340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe780107620 0x7fe780107a20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009820 tx=0x7fe77c02a270 comp rx=0 tx=0).stop 2024-09-19T08:02:02.442 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.747+0000 7fe78761d640 1 -- 172.21.15.27:0/641809340 shutdown_connections 2024-09-19T08:02:02.443 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.747+0000 7fe78761d640 1 --2- 172.21.15.27:0/641809340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe780107620 0x7fe780107a20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:02.443 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.747+0000 7fe78761d640 1 -- 172.21.15.27:0/641809340 >> 172.21.15.27:0/641809340 conn(0x7fe780102db0 msgr2=0x7fe7801051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:02.443 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.747+0000 7fe78761d640 1 -- 172.21.15.27:0/641809340 shutdown_connections 2024-09-19T08:02:02.443 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.747+0000 7fe78761d640 1 -- 172.21.15.27:0/641809340 wait complete. 2024-09-19T08:02:02.443 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.748+0000 7fe78761d640 1 Processor -- start 2024-09-19T08:02:02.443 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.748+0000 7fe78761d640 1 -- start start 2024-09-19T08:02:02.443 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.748+0000 7fe78761d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe780107620 0x7fe78019b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:02.443 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.748+0000 7fe78761d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe78010bbd0 con 0x7fe780107620 2024-09-19T08:02:02.443 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.748+0000 7fe7853b9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe780107620 0x7fe78019b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:02.443 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.748+0000 7fe7853b9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe780107620 0x7fe78019b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60094/0 (socket says 172.21.15.27:60094) 2024-09-19T08:02:02.443 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.748+0000 7fe7853b9640 1 -- 172.21.15.27:0/2921554915 learned_addr learned my addr 172.21.15.27:0/2921554915 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:02.443 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.748+0000 7fe7853b9640 1 -- 172.21.15.27:0/2921554915 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78019bb90 con 0x7fe780107620 2024-09-19T08:02:02.443 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.748+0000 7fe7853b9640 1 --2- 172.21.15.27:0/2921554915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe780107620 0x7fe78019b650 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009940 tx=0x7fe77c0326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:02.443 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.749+0000 7fe7767fc640 1 -- 172.21.15.27:0/2921554915 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe77c042070 con 0x7fe780107620 2024-09-19T08:02:02.444 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.749+0000 7fe7767fc640 1 -- 172.21.15.27:0/2921554915 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe77c032be0 con 0x7fe780107620 2024-09-19T08:02:02.444 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.749+0000 7fe78761d640 1 -- 172.21.15.27:0/2921554915 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe78019be20 con 0x7fe780107620 2024-09-19T08:02:02.444 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.749+0000 7fe7767fc640 1 -- 172.21.15.27:0/2921554915 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe77c037040 con 0x7fe780107620 2024-09-19T08:02:02.444 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.749+0000 7fe78761d640 1 -- 172.21.15.27:0/2921554915 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe78019eb10 con 0x7fe780107620 2024-09-19T08:02:02.444 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.750+0000 7fe7767fc640 1 -- 172.21.15.27:0/2921554915 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fe77c045070 con 0x7fe780107620 2024-09-19T08:02:02.444 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.750+0000 7fe7767fc640 1 --2- 172.21.15.27:0/2921554915 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fe76c0391b0 0x7fe76c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:02.444 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.750+0000 7fe78761d640 1 -- 172.21.15.27:0/2921554915 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe78010bd50 con 0x7fe780107620 2024-09-19T08:02:02.444 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.750+0000 7fe7767fc640 1 -- 172.21.15.27:0/2921554915 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe77c06c1e0 con 0x7fe780107620 2024-09-19T08:02:02.444 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.750+0000 7fe784bb8640 1 --2- 172.21.15.27:0/2921554915 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fe76c0391b0 0x7fe76c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:02.445 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.750+0000 7fe784bb8640 1 --2- 172.21.15.27:0/2921554915 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fe76c0391b0 0x7fe76c03b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe7700098c0 tx=0x7fe770006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:02.445 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.755+0000 7fe7767fc640 1 -- 172.21.15.27:0/2921554915 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe77c032d90 con 0x7fe780107620 2024-09-19T08:02:02.445 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.959+0000 7fe78761d640 1 -- 172.21.15.27:0/2921554915 --> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fe780104070 con 0x7fe76c0391b0 2024-09-19T08:02:02.445 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.963+0000 7fe7767fc640 1 -- 172.21.15.27:0/2921554915 <== mgr.14118 v2:172.21.15.27:6800/538175414 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe780104070 con 0x7fe76c0391b0 2024-09-19T08:02:02.445 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.965+0000 7fe78761d640 1 -- 172.21.15.27:0/2921554915 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fe76c0391b0 msgr2=0x7fe76c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:02.445 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.965+0000 7fe78761d640 1 --2- 172.21.15.27:0/2921554915 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fe76c0391b0 0x7fe76c03b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe7700098c0 tx=0x7fe770006db0 comp rx=0 tx=0).stop 2024-09-19T08:02:02.445 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.965+0000 7fe78761d640 1 -- 172.21.15.27:0/2921554915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe780107620 msgr2=0x7fe78019b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:02.445 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.965+0000 7fe78761d640 1 --2- 172.21.15.27:0/2921554915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe780107620 0x7fe78019b650 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009940 tx=0x7fe77c0326e0 comp rx=0 tx=0).stop 2024-09-19T08:02:02.445 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.965+0000 7fe78761d640 1 -- 172.21.15.27:0/2921554915 shutdown_connections 2024-09-19T08:02:02.445 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.965+0000 7fe78761d640 1 --2- 172.21.15.27:0/2921554915 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fe76c0391b0 0x7fe76c03b670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:02.445 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.965+0000 7fe78761d640 1 --2- 172.21.15.27:0/2921554915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe780107620 0x7fe78019b650 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:02.445 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.965+0000 7fe78761d640 1 -- 172.21.15.27:0/2921554915 >> 172.21.15.27:0/2921554915 conn(0x7fe780102db0 msgr2=0x7fe780103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:02.445 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.966+0000 7fe78761d640 1 -- 172.21.15.27:0/2921554915 shutdown_connections 2024-09-19T08:02:02.446 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:00.966+0000 7fe78761d640 1 -- 172.21.15.27:0/2921554915 wait complete. 2024-09-19T08:02:02.446 INFO:teuthology.orchestra.run.smithi027.stdout:Deploying unmanaged mgr service... 2024-09-19T08:02:03.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T08:02:03.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.794+0000 7f5cb2753640 1 Processor -- start 2024-09-19T08:02:03.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.794+0000 7f5cb2753640 1 -- start start 2024-09-19T08:02:03.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.794+0000 7f5cb2753640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cac1058f0 0x7f5cac105cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:03.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.794+0000 7f5cb2753640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5cac1062c0 con 0x7f5cac1058f0 2024-09-19T08:02:03.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.794+0000 7f5cabfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cac1058f0 0x7f5cac105cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:03.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.794+0000 7f5cabfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cac1058f0 0x7f5cac105cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60100/0 (socket says 172.21.15.27:60100) 2024-09-19T08:02:03.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.794+0000 7f5cabfff640 1 -- 172.21.15.27:0/1716444313 learned_addr learned my addr 172.21.15.27:0/1716444313 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:03.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.794+0000 7f5cabfff640 1 -- 172.21.15.27:0/1716444313 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cac1088d0 con 0x7f5cac1058f0 2024-09-19T08:02:03.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.795+0000 7f5cabfff640 1 --2- 172.21.15.27:0/1716444313 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cac1058f0 0x7f5cac105cf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c009820 tx=0x7f5c9c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560fd522faa5e3fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:03.608 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.795+0000 7f5caaffd640 1 -- 172.21.15.27:0/1716444313 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c9c037070 con 0x7f5cac1058f0 2024-09-19T08:02:03.608 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.795+0000 7f5caaffd640 1 -- 172.21.15.27:0/1716444313 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c9c032920 con 0x7f5cac1058f0 2024-09-19T08:02:03.608 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.795+0000 7f5caaffd640 1 -- 172.21.15.27:0/1716444313 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c9c030810 con 0x7f5cac1058f0 2024-09-19T08:02:03.608 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.796+0000 7f5cb2753640 1 -- 172.21.15.27:0/1716444313 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cac1058f0 msgr2=0x7f5cac105cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:03.608 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.796+0000 7f5cb2753640 1 --2- 172.21.15.27:0/1716444313 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cac1058f0 0x7f5cac105cf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c009820 tx=0x7f5c9c02a270 comp rx=0 tx=0).stop 2024-09-19T08:02:03.608 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.796+0000 7f5cb2753640 1 -- 172.21.15.27:0/1716444313 shutdown_connections 2024-09-19T08:02:03.608 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.796+0000 7f5cb2753640 1 --2- 172.21.15.27:0/1716444313 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cac1058f0 0x7f5cac105cf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:03.608 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.796+0000 7f5cb2753640 1 -- 172.21.15.27:0/1716444313 >> 172.21.15.27:0/1716444313 conn(0x7f5cac101460 msgr2=0x7f5cac103880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:03.608 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.796+0000 7f5cb2753640 1 -- 172.21.15.27:0/1716444313 shutdown_connections 2024-09-19T08:02:03.608 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.796+0000 7f5cb2753640 1 -- 172.21.15.27:0/1716444313 wait complete. 2024-09-19T08:02:03.608 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.796+0000 7f5cb2753640 1 Processor -- start 2024-09-19T08:02:03.608 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.797+0000 7f5cb2753640 1 -- start start 2024-09-19T08:02:03.608 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.797+0000 7f5cb2753640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cac1058f0 0x7f5cac19b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:03.609 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.797+0000 7f5cb2753640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5cac10bb00 con 0x7f5cac1058f0 2024-09-19T08:02:03.609 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.797+0000 7f5cabfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cac1058f0 0x7f5cac19b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:03.609 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.797+0000 7f5cabfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cac1058f0 0x7f5cac19b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60114/0 (socket says 172.21.15.27:60114) 2024-09-19T08:02:03.609 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.797+0000 7f5cabfff640 1 -- 172.21.15.27:0/1314765239 learned_addr learned my addr 172.21.15.27:0/1314765239 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:03.609 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.797+0000 7f5cabfff640 1 -- 172.21.15.27:0/1314765239 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cac19bbe0 con 0x7f5cac1058f0 2024-09-19T08:02:03.609 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.797+0000 7f5cabfff640 1 --2- 172.21.15.27:0/1314765239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cac1058f0 0x7f5cac19b6a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c0097f0 tx=0x7f5c9c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:03.609 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.797+0000 7f5ca97fa640 1 -- 172.21.15.27:0/1314765239 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c9c037040 con 0x7f5cac1058f0 2024-09-19T08:02:03.609 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.797+0000 7f5ca97fa640 1 -- 172.21.15.27:0/1314765239 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c9c030c40 con 0x7f5cac1058f0 2024-09-19T08:02:03.609 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.798+0000 7f5ca97fa640 1 -- 172.21.15.27:0/1314765239 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c9c03a5b0 con 0x7f5cac1058f0 2024-09-19T08:02:03.609 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.798+0000 7f5cb2753640 1 -- 172.21.15.27:0/1314765239 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cac19be70 con 0x7f5cac1058f0 2024-09-19T08:02:03.609 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.798+0000 7f5cb2753640 1 -- 172.21.15.27:0/1314765239 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cac19eb60 con 0x7f5cac1058f0 2024-09-19T08:02:03.609 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.798+0000 7f5ca97fa640 1 -- 172.21.15.27:0/1314765239 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f5c9c03a7a0 con 0x7f5cac1058f0 2024-09-19T08:02:03.609 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.799+0000 7f5ca97fa640 1 --2- 172.21.15.27:0/1314765239 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f5c94039200 0x7f5c9403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:03.610 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.799+0000 7f5ca97fa640 1 -- 172.21.15.27:0/1314765239 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5c9c06c6d0 con 0x7f5cac1058f0 2024-09-19T08:02:03.610 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.799+0000 7f5cb2753640 1 -- 172.21.15.27:0/1314765239 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cac105d70 con 0x7f5cac1058f0 2024-09-19T08:02:03.610 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.799+0000 7f5cab7fe640 1 --2- 172.21.15.27:0/1314765239 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f5c94039200 0x7f5c9403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:03.610 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.799+0000 7f5cab7fe640 1 --2- 172.21.15.27:0/1314765239 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f5c94039200 0x7f5c9403b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00098c0 tx=0x7f5ca0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:03.610 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:02.803+0000 7f5ca97fa640 1 -- 172.21.15.27:0/1314765239 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5c9c0371e0 con 0x7f5cac1058f0 2024-09-19T08:02:03.610 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.018+0000 7f5cb2753640 1 -- 172.21.15.27:0/1314765239 --> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f5cac102710 con 0x7f5c94039200 2024-09-19T08:02:03.610 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.023+0000 7f5ca97fa640 1 -- 172.21.15.27:0/1314765239 <== mgr.14118 v2:172.21.15.27:6800/538175414 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f5cac102710 con 0x7f5c94039200 2024-09-19T08:02:03.610 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.025+0000 7f5cb2753640 1 -- 172.21.15.27:0/1314765239 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f5c94039200 msgr2=0x7f5c9403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:03.610 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.025+0000 7f5cb2753640 1 --2- 172.21.15.27:0/1314765239 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f5c94039200 0x7f5c9403b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00098c0 tx=0x7f5ca0006db0 comp rx=0 tx=0).stop 2024-09-19T08:02:03.610 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.025+0000 7f5cb2753640 1 -- 172.21.15.27:0/1314765239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cac1058f0 msgr2=0x7f5cac19b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:03.610 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.025+0000 7f5cb2753640 1 --2- 172.21.15.27:0/1314765239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cac1058f0 0x7f5cac19b6a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c0097f0 tx=0x7f5c9c0327b0 comp rx=0 tx=0).stop 2024-09-19T08:02:03.610 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.025+0000 7f5cb2753640 1 -- 172.21.15.27:0/1314765239 shutdown_connections 2024-09-19T08:02:03.610 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.025+0000 7f5cb2753640 1 --2- 172.21.15.27:0/1314765239 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f5c94039200 0x7f5c9403b6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:03.611 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.025+0000 7f5cb2753640 1 --2- 172.21.15.27:0/1314765239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cac1058f0 0x7f5cac19b6a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:03.611 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.025+0000 7f5cb2753640 1 -- 172.21.15.27:0/1314765239 >> 172.21.15.27:0/1314765239 conn(0x7f5cac101460 msgr2=0x7f5cac102000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:03.611 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.025+0000 7f5cb2753640 1 -- 172.21.15.27:0/1314765239 shutdown_connections 2024-09-19T08:02:03.611 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.025+0000 7f5cb2753640 1 -- 172.21.15.27:0/1314765239 wait complete. 2024-09-19T08:02:04.172 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:03 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' 2024-09-19T08:02:04.172 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:03 smithi027 ceph-mon[31209]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:02:04.172 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:03 smithi027 ceph-mon[31209]: Saving service mgr spec with placement count:2 2024-09-19T08:02:04.172 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:03 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' 2024-09-19T08:02:05.217 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:05 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/429975450' entity='client.admin' 2024-09-19T08:02:05.217 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:05 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' 2024-09-19T08:02:05.224 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.974+0000 7f1050d17640 1 Processor -- start 2024-09-19T08:02:05.224 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.974+0000 7f1050d17640 1 -- start start 2024-09-19T08:02:05.224 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.974+0000 7f1050d17640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f104c1080c0 0x7f104c10a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:05.224 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.974+0000 7f1050d17640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f104c07bdf0 con 0x7f104c1080c0 2024-09-19T08:02:05.225 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.974+0000 7f104a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f104c1080c0 0x7f104c10a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:05.225 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.975+0000 7f104a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f104c1080c0 0x7f104c10a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60122/0 (socket says 172.21.15.27:60122) 2024-09-19T08:02:05.225 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.975+0000 7f104a59c640 1 -- 172.21.15.27:0/1453924892 learned_addr learned my addr 172.21.15.27:0/1453924892 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:05.225 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.975+0000 7f104a59c640 1 -- 172.21.15.27:0/1453924892 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104c10a9f0 con 0x7f104c1080c0 2024-09-19T08:02:05.225 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.976+0000 7f104a59c640 1 --2- 172.21.15.27:0/1453924892 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f104c1080c0 0x7f104c10a4b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f103c009820 tx=0x7f103c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38bcb80878ba4974 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:05.225 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.976+0000 7f104959a640 1 -- 172.21.15.27:0/1453924892 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f103c037070 con 0x7f104c1080c0 2024-09-19T08:02:05.225 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.976+0000 7f104959a640 1 -- 172.21.15.27:0/1453924892 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f103c032920 con 0x7f104c1080c0 2024-09-19T08:02:05.225 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.976+0000 7f104959a640 1 -- 172.21.15.27:0/1453924892 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f103c030810 con 0x7f104c1080c0 2024-09-19T08:02:05.225 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.977+0000 7f1050d17640 1 -- 172.21.15.27:0/1453924892 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f104c1080c0 msgr2=0x7f104c10a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:05.225 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.977+0000 7f1050d17640 1 --2- 172.21.15.27:0/1453924892 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f104c1080c0 0x7f104c10a4b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f103c009820 tx=0x7f103c02a270 comp rx=0 tx=0).stop 2024-09-19T08:02:05.225 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.977+0000 7f1050d17640 1 -- 172.21.15.27:0/1453924892 shutdown_connections 2024-09-19T08:02:05.225 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.977+0000 7f1050d17640 1 --2- 172.21.15.27:0/1453924892 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f104c1080c0 0x7f104c10a4b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:05.225 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.977+0000 7f1050d17640 1 -- 172.21.15.27:0/1453924892 >> 172.21.15.27:0/1453924892 conn(0x7f104c101ca0 msgr2=0x7f104c1040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:05.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.977+0000 7f1050d17640 1 -- 172.21.15.27:0/1453924892 shutdown_connections 2024-09-19T08:02:05.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.977+0000 7f1050d17640 1 -- 172.21.15.27:0/1453924892 wait complete. 2024-09-19T08:02:05.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.978+0000 7f1050d17640 1 Processor -- start 2024-09-19T08:02:05.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.978+0000 7f1050d17640 1 -- start start 2024-09-19T08:02:05.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.978+0000 7f1050d17640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f104c1080c0 0x7f104c1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:05.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.978+0000 7f1050d17640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f104c106ac0 con 0x7f104c1080c0 2024-09-19T08:02:05.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.978+0000 7f104a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f104c1080c0 0x7f104c1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:05.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.978+0000 7f104a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f104c1080c0 0x7f104c1993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60126/0 (socket says 172.21.15.27:60126) 2024-09-19T08:02:05.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.978+0000 7f104a59c640 1 -- 172.21.15.27:0/429975450 learned_addr learned my addr 172.21.15.27:0/429975450 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:05.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.978+0000 7f104a59c640 1 -- 172.21.15.27:0/429975450 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104c199910 con 0x7f104c1080c0 2024-09-19T08:02:05.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.979+0000 7f104a59c640 1 --2- 172.21.15.27:0/429975450 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f104c1080c0 0x7f104c1993d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f103c0097f0 tx=0x7f103c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:05.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.979+0000 7f103b7fe640 1 -- 172.21.15.27:0/429975450 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f103c037040 con 0x7f104c1080c0 2024-09-19T08:02:05.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.979+0000 7f103b7fe640 1 -- 172.21.15.27:0/429975450 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f103c030c40 con 0x7f104c1080c0 2024-09-19T08:02:05.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.979+0000 7f1050d17640 1 -- 172.21.15.27:0/429975450 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f104c199ba0 con 0x7f104c1080c0 2024-09-19T08:02:05.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.979+0000 7f103b7fe640 1 -- 172.21.15.27:0/429975450 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f103c03a5d0 con 0x7f104c1080c0 2024-09-19T08:02:05.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.979+0000 7f1050d17640 1 -- 172.21.15.27:0/429975450 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f104c199fc0 con 0x7f104c1080c0 2024-09-19T08:02:05.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.980+0000 7f103b7fe640 1 -- 172.21.15.27:0/429975450 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f103c03a850 con 0x7f104c1080c0 2024-09-19T08:02:05.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.980+0000 7f1050d17640 1 -- 172.21.15.27:0/429975450 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f104c107170 con 0x7f104c1080c0 2024-09-19T08:02:05.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.980+0000 7f103b7fe640 1 --2- 172.21.15.27:0/429975450 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f103403d610 0x7f103403fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:05.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.980+0000 7f103b7fe640 1 -- 172.21.15.27:0/429975450 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f103c06c830 con 0x7f104c1080c0 2024-09-19T08:02:05.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.980+0000 7f1049d9b640 1 --2- 172.21.15.27:0/429975450 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f103403d610 0x7f103403fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:05.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.981+0000 7f1049d9b640 1 --2- 172.21.15.27:0/429975450 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f103403d610 0x7f103403fad0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f10400098c0 tx=0x7f1040006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:05.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:03.985+0000 7f103b7fe640 1 -- 172.21.15.27:0/429975450 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f103c0371e0 con 0x7f104c1080c0 2024-09-19T08:02:05.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:04.172+0000 7f1050d17640 1 -- 172.21.15.27:0/429975450 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f104c193230 con 0x7f104c1080c0 2024-09-19T08:02:05.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:04.174+0000 7f103b7fe640 1 -- 172.21.15.27:0/429975450 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f103c030df0 con 0x7f104c1080c0 2024-09-19T08:02:05.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:04.176+0000 7f1050d17640 1 -- 172.21.15.27:0/429975450 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f103403d610 msgr2=0x7f103403fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:05.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:04.176+0000 7f1050d17640 1 --2- 172.21.15.27:0/429975450 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f103403d610 0x7f103403fad0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f10400098c0 tx=0x7f1040006db0 comp rx=0 tx=0).stop 2024-09-19T08:02:05.228 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:04.176+0000 7f1050d17640 1 -- 172.21.15.27:0/429975450 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f104c1080c0 msgr2=0x7f104c1993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:05.228 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:04.176+0000 7f1050d17640 1 --2- 172.21.15.27:0/429975450 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f104c1080c0 0x7f104c1993d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f103c0097f0 tx=0x7f103c0327b0 comp rx=0 tx=0).stop 2024-09-19T08:02:05.228 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:04.176+0000 7f1050d17640 1 -- 172.21.15.27:0/429975450 shutdown_connections 2024-09-19T08:02:05.228 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:04.176+0000 7f1050d17640 1 --2- 172.21.15.27:0/429975450 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f103403d610 0x7f103403fad0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:05.228 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:04.176+0000 7f1050d17640 1 --2- 172.21.15.27:0/429975450 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f104c1080c0 0x7f104c1993d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:05.228 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:04.176+0000 7f1050d17640 1 -- 172.21.15.27:0/429975450 >> 172.21.15.27:0/429975450 conn(0x7f104c101ca0 msgr2=0x7f104c102590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:05.228 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:04.177+0000 7f1050d17640 1 -- 172.21.15.27:0/429975450 shutdown_connections 2024-09-19T08:02:05.228 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:04.177+0000 7f1050d17640 1 -- 172.21.15.27:0/429975450 wait complete. 2024-09-19T08:02:06.457 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.640+0000 7f3eee754640 1 Processor -- start 2024-09-19T08:02:06.457 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.640+0000 7f3eee754640 1 -- start start 2024-09-19T08:02:06.457 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.640+0000 7f3eee754640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ee8108080 0x7f3ee810a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:06.457 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.640+0000 7f3eee754640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee807be30 con 0x7f3ee8108080 2024-09-19T08:02:06.457 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.640+0000 7f3ee7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ee8108080 0x7f3ee810a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:06.457 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.640+0000 7f3ee7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ee8108080 0x7f3ee810a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60128/0 (socket says 172.21.15.27:60128) 2024-09-19T08:02:06.457 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.640+0000 7f3ee7fff640 1 -- 172.21.15.27:0/3354854579 learned_addr learned my addr 172.21.15.27:0/3354854579 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:06.457 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.640+0000 7f3ee7fff640 1 -- 172.21.15.27:0/3354854579 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee810a9b0 con 0x7f3ee8108080 2024-09-19T08:02:06.458 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.641+0000 7f3ee7fff640 1 --2- 172.21.15.27:0/3354854579 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ee8108080 0x7f3ee810a470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009820 tx=0x7f3ed802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eaecd6b51a6cb4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:06.458 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.641+0000 7f3ee77fe640 1 -- 172.21.15.27:0/3354854579 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed8037070 con 0x7f3ee8108080 2024-09-19T08:02:06.458 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.642+0000 7f3ee77fe640 1 -- 172.21.15.27:0/3354854579 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ed8032920 con 0x7f3ee8108080 2024-09-19T08:02:06.458 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.642+0000 7f3ee77fe640 1 -- 172.21.15.27:0/3354854579 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed8030810 con 0x7f3ee8108080 2024-09-19T08:02:06.458 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.642+0000 7f3eee754640 1 -- 172.21.15.27:0/3354854579 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ee8108080 msgr2=0x7f3ee810a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:06.458 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.642+0000 7f3eee754640 1 --2- 172.21.15.27:0/3354854579 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ee8108080 0x7f3ee810a470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009820 tx=0x7f3ed802a270 comp rx=0 tx=0).stop 2024-09-19T08:02:06.458 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.642+0000 7f3eee754640 1 -- 172.21.15.27:0/3354854579 shutdown_connections 2024-09-19T08:02:06.458 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.642+0000 7f3eee754640 1 --2- 172.21.15.27:0/3354854579 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ee8108080 0x7f3ee810a470 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:06.458 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.642+0000 7f3eee754640 1 -- 172.21.15.27:0/3354854579 >> 172.21.15.27:0/3354854579 conn(0x7f3ee8101ca0 msgr2=0x7f3ee81040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:06.458 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.642+0000 7f3eee754640 1 -- 172.21.15.27:0/3354854579 shutdown_connections 2024-09-19T08:02:06.458 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.642+0000 7f3eee754640 1 -- 172.21.15.27:0/3354854579 wait complete. 2024-09-19T08:02:06.458 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.643+0000 7f3eee754640 1 Processor -- start 2024-09-19T08:02:06.458 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.643+0000 7f3eee754640 1 -- start start 2024-09-19T08:02:06.458 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.643+0000 7f3eee754640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ee8108080 0x7f3ee819b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:06.459 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.643+0000 7f3eee754640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee810ba30 con 0x7f3ee8108080 2024-09-19T08:02:06.459 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.643+0000 7f3ee7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ee8108080 0x7f3ee819b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:06.459 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.643+0000 7f3ee7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ee8108080 0x7f3ee819b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60132/0 (socket says 172.21.15.27:60132) 2024-09-19T08:02:06.459 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.643+0000 7f3ee7fff640 1 -- 172.21.15.27:0/3755299762 learned_addr learned my addr 172.21.15.27:0/3755299762 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:06.459 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.643+0000 7f3ee7fff640 1 -- 172.21.15.27:0/3755299762 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee819bb90 con 0x7f3ee8108080 2024-09-19T08:02:06.459 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.644+0000 7f3ee7fff640 1 --2- 172.21.15.27:0/3755299762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ee8108080 0x7f3ee819b650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8030420 tx=0x7f3ed8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:06.459 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.644+0000 7f3ee5ffb640 1 -- 172.21.15.27:0/3755299762 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed8037040 con 0x7f3ee8108080 2024-09-19T08:02:06.459 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.644+0000 7f3ee5ffb640 1 -- 172.21.15.27:0/3755299762 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ed8040070 con 0x7f3ee8108080 2024-09-19T08:02:06.459 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.644+0000 7f3eee754640 1 -- 172.21.15.27:0/3755299762 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee819be20 con 0x7f3ee8108080 2024-09-19T08:02:06.459 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.644+0000 7f3ee5ffb640 1 -- 172.21.15.27:0/3755299762 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed803a6e0 con 0x7f3ee8108080 2024-09-19T08:02:06.459 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.644+0000 7f3eee754640 1 -- 172.21.15.27:0/3755299762 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee819eb10 con 0x7f3ee8108080 2024-09-19T08:02:06.459 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.645+0000 7f3ee5ffb640 1 -- 172.21.15.27:0/3755299762 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f3ed803a9e0 con 0x7f3ee8108080 2024-09-19T08:02:06.459 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.645+0000 7f3eee754640 1 -- 172.21.15.27:0/3755299762 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ee81084e0 con 0x7f3ee8108080 2024-09-19T08:02:06.460 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.645+0000 7f3ee5ffb640 1 --2- 172.21.15.27:0/3755299762 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f3ed40391b0 0x7f3ed403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:06.460 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.645+0000 7f3ee5ffb640 1 -- 172.21.15.27:0/3755299762 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3ed806caa0 con 0x7f3ee8108080 2024-09-19T08:02:06.460 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.645+0000 7f3edffff640 1 --2- 172.21.15.27:0/3755299762 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f3ed40391b0 0x7f3ed403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:06.460 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.645+0000 7f3edffff640 1 --2- 172.21.15.27:0/3755299762 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f3ed40391b0 0x7f3ed403b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00098c0 tx=0x7f3ed0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:06.460 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.650+0000 7f3ee5ffb640 1 -- 172.21.15.27:0/3755299762 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3ed803add0 con 0x7f3ee8108080 2024-09-19T08:02:06.460 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.842+0000 7f3eee754640 1 -- 172.21.15.27:0/3755299762 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f3ee819f100 con 0x7f3ee8108080 2024-09-19T08:02:06.460 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.845+0000 7f3ee5ffb640 1 -- 172.21.15.27:0/3755299762 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f3ed8045460 con 0x7f3ee8108080 2024-09-19T08:02:06.460 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.848+0000 7f3eee754640 1 -- 172.21.15.27:0/3755299762 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f3ed40391b0 msgr2=0x7f3ed403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:06.460 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.848+0000 7f3eee754640 1 --2- 172.21.15.27:0/3755299762 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f3ed40391b0 0x7f3ed403b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00098c0 tx=0x7f3ed0006db0 comp rx=0 tx=0).stop 2024-09-19T08:02:06.460 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.848+0000 7f3eee754640 1 -- 172.21.15.27:0/3755299762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ee8108080 msgr2=0x7f3ee819b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:06.460 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.848+0000 7f3eee754640 1 --2- 172.21.15.27:0/3755299762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ee8108080 0x7f3ee819b650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8030420 tx=0x7f3ed8032670 comp rx=0 tx=0).stop 2024-09-19T08:02:06.460 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.849+0000 7f3eee754640 1 -- 172.21.15.27:0/3755299762 shutdown_connections 2024-09-19T08:02:06.460 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.849+0000 7f3eee754640 1 --2- 172.21.15.27:0/3755299762 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f3ed40391b0 0x7f3ed403b670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:06.461 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.849+0000 7f3eee754640 1 --2- 172.21.15.27:0/3755299762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ee8108080 0x7f3ee819b650 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:06.461 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.849+0000 7f3eee754640 1 -- 172.21.15.27:0/3755299762 >> 172.21.15.27:0/3755299762 conn(0x7f3ee8101ca0 msgr2=0x7f3ee8102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:06.461 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.849+0000 7f3eee754640 1 -- 172.21.15.27:0/3755299762 shutdown_connections 2024-09-19T08:02:06.461 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:05.849+0000 7f3eee754640 1 -- 172.21.15.27:0/3755299762 wait complete. 2024-09-19T08:02:06.461 INFO:teuthology.orchestra.run.smithi027.stdout:Enabling the dashboard module... 2024-09-19T08:02:06.852 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:06 smithi027 ceph-mon[31209]: from='mgr.14118 172.21.15.27:0/4087300697' entity='mgr.x' 2024-09-19T08:02:06.853 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:06 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3755299762' entity='client.admin' 2024-09-19T08:02:07.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:07 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2611555324' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T08:02:07.984 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:07 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: ignoring --setuser ceph since I am not root 2024-09-19T08:02:07.984 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:07 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: ignoring --setgroup ceph since I am not root 2024-09-19T08:02:07.984 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:07 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:07.858+0000 7fd369456040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:02:07.984 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:07 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:07.919+0000 7fd369456040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:02:08.252 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:08 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:08.076+0000 7fd369456040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:02:08.252 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:08 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:08.146+0000 7fd369456040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:02:08.671 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:08 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:08.305+0000 7fd369456040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:02:08.672 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:08 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:08.453+0000 7fd369456040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:02:08.679 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.862+0000 7fc369cd0640 1 Processor -- start 2024-09-19T08:02:08.679 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.863+0000 7fc369cd0640 1 -- start start 2024-09-19T08:02:08.679 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.863+0000 7fc369cd0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364108080 0x7fc36410a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:08.679 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.863+0000 7fc369cd0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc36407be30 con 0x7fc364108080 2024-09-19T08:02:08.679 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.863+0000 7fc3637fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364108080 0x7fc36410a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:08.679 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.863+0000 7fc3637fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364108080 0x7fc36410a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60144/0 (socket says 172.21.15.27:60144) 2024-09-19T08:02:08.679 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.863+0000 7fc3637fe640 1 -- 172.21.15.27:0/3093706414 learned_addr learned my addr 172.21.15.27:0/3093706414 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:08.679 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.863+0000 7fc3637fe640 1 -- 172.21.15.27:0/3093706414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36410a9b0 con 0x7fc364108080 2024-09-19T08:02:08.679 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.864+0000 7fc3637fe640 1 --2- 172.21.15.27:0/3093706414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364108080 0x7fc36410a470 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc354009820 tx=0x7fc35402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5c83f0be45fba7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:08.679 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.864+0000 7fc3627fc640 1 -- 172.21.15.27:0/3093706414 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc354037070 con 0x7fc364108080 2024-09-19T08:02:08.680 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.864+0000 7fc3627fc640 1 -- 172.21.15.27:0/3093706414 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc354032920 con 0x7fc364108080 2024-09-19T08:02:08.680 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.864+0000 7fc3627fc640 1 -- 172.21.15.27:0/3093706414 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc354030810 con 0x7fc364108080 2024-09-19T08:02:08.680 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.865+0000 7fc369cd0640 1 -- 172.21.15.27:0/3093706414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364108080 msgr2=0x7fc36410a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:08.680 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.865+0000 7fc369cd0640 1 --2- 172.21.15.27:0/3093706414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364108080 0x7fc36410a470 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc354009820 tx=0x7fc35402a270 comp rx=0 tx=0).stop 2024-09-19T08:02:08.680 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.865+0000 7fc369cd0640 1 -- 172.21.15.27:0/3093706414 shutdown_connections 2024-09-19T08:02:08.680 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.865+0000 7fc369cd0640 1 --2- 172.21.15.27:0/3093706414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364108080 0x7fc36410a470 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:08.680 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.865+0000 7fc369cd0640 1 -- 172.21.15.27:0/3093706414 >> 172.21.15.27:0/3093706414 conn(0x7fc364101ca0 msgr2=0x7fc3641040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:08.680 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.865+0000 7fc369cd0640 1 -- 172.21.15.27:0/3093706414 shutdown_connections 2024-09-19T08:02:08.680 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.865+0000 7fc369cd0640 1 -- 172.21.15.27:0/3093706414 wait complete. 2024-09-19T08:02:08.680 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.866+0000 7fc369cd0640 1 Processor -- start 2024-09-19T08:02:08.680 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.866+0000 7fc369cd0640 1 -- start start 2024-09-19T08:02:08.680 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.866+0000 7fc369cd0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364108080 0x7fc364107900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:08.680 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.866+0000 7fc369cd0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc36410ba30 con 0x7fc364108080 2024-09-19T08:02:08.681 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.866+0000 7fc3637fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364108080 0x7fc364107900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:08.681 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.866+0000 7fc3637fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364108080 0x7fc364107900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60158/0 (socket says 172.21.15.27:60158) 2024-09-19T08:02:08.681 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.866+0000 7fc3637fe640 1 -- 172.21.15.27:0/2611555324 learned_addr learned my addr 172.21.15.27:0/2611555324 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:08.681 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.866+0000 7fc3637fe640 1 -- 172.21.15.27:0/2611555324 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc364107e40 con 0x7fc364108080 2024-09-19T08:02:08.681 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.866+0000 7fc3637fe640 1 --2- 172.21.15.27:0/2611555324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364108080 0x7fc364107900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc354030420 tx=0x7fc354032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:08.681 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.867+0000 7fc360ff9640 1 -- 172.21.15.27:0/2611555324 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc354037040 con 0x7fc364108080 2024-09-19T08:02:08.681 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.867+0000 7fc360ff9640 1 -- 172.21.15.27:0/2611555324 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc354040070 con 0x7fc364108080 2024-09-19T08:02:08.681 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.867+0000 7fc369cd0640 1 -- 172.21.15.27:0/2611555324 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc364106030 con 0x7fc364108080 2024-09-19T08:02:08.681 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.867+0000 7fc360ff9640 1 -- 172.21.15.27:0/2611555324 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc35403a6e0 con 0x7fc364108080 2024-09-19T08:02:08.681 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.867+0000 7fc369cd0640 1 -- 172.21.15.27:0/2611555324 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc364106570 con 0x7fc364108080 2024-09-19T08:02:08.681 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.868+0000 7fc360ff9640 1 -- 172.21.15.27:0/2611555324 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fc35403bb20 con 0x7fc364108080 2024-09-19T08:02:08.681 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.868+0000 7fc360ff9640 1 --2- 172.21.15.27:0/2611555324 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fc350039200 0x7fc35003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:08.681 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.868+0000 7fc369cd0640 1 -- 172.21.15.27:0/2611555324 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3641084e0 con 0x7fc364108080 2024-09-19T08:02:08.682 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.868+0000 7fc360ff9640 1 -- 172.21.15.27:0/2611555324 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc35406c860 con 0x7fc364108080 2024-09-19T08:02:08.682 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.868+0000 7fc362ffd640 1 --2- 172.21.15.27:0/2611555324 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fc350039200 0x7fc35003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:08.682 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.868+0000 7fc362ffd640 1 --2- 172.21.15.27:0/2611555324 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fc350039200 0x7fc35003b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0098c0 tx=0x7fc34c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:08.682 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:06.873+0000 7fc360ff9640 1 -- 172.21.15.27:0/2611555324 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc35404a200 con 0x7fc364108080 2024-09-19T08:02:08.682 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:07.101+0000 7fc369cd0640 1 -- 172.21.15.27:0/2611555324 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fc3641069c0 con 0x7fc364108080 2024-09-19T08:02:08.682 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:07.700+0000 7fc360ff9640 1 -- 172.21.15.27:0/2611555324 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fc354031e80 con 0x7fc364108080 2024-09-19T08:02:08.682 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:07.702+0000 7fc360ff9640 1 -- 172.21.15.27:0/2611555324 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fc35403a8e0 con 0x7fc364108080 2024-09-19T08:02:08.682 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:07.704+0000 7fc369cd0640 1 -- 172.21.15.27:0/2611555324 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fc350039200 msgr2=0x7fc35003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:08.682 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:07.704+0000 7fc369cd0640 1 --2- 172.21.15.27:0/2611555324 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fc350039200 0x7fc35003b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0098c0 tx=0x7fc34c006db0 comp rx=0 tx=0).stop 2024-09-19T08:02:08.682 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:07.704+0000 7fc369cd0640 1 -- 172.21.15.27:0/2611555324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364108080 msgr2=0x7fc364107900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:08.682 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:07.704+0000 7fc369cd0640 1 --2- 172.21.15.27:0/2611555324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364108080 0x7fc364107900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc354030420 tx=0x7fc354032670 comp rx=0 tx=0).stop 2024-09-19T08:02:08.682 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:07.704+0000 7fc369cd0640 1 -- 172.21.15.27:0/2611555324 shutdown_connections 2024-09-19T08:02:08.682 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:07.704+0000 7fc369cd0640 1 --2- 172.21.15.27:0/2611555324 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7fc350039200 0x7fc35003b6c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:08.683 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:07.704+0000 7fc369cd0640 1 --2- 172.21.15.27:0/2611555324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364108080 0x7fc364107900 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:08.683 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:07.704+0000 7fc369cd0640 1 -- 172.21.15.27:0/2611555324 >> 172.21.15.27:0/2611555324 conn(0x7fc364101ca0 msgr2=0x7fc364102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:08.683 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:07.704+0000 7fc369cd0640 1 -- 172.21.15.27:0/2611555324 shutdown_connections 2024-09-19T08:02:08.683 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:07.704+0000 7fc369cd0640 1 -- 172.21.15.27:0/2611555324 wait complete. 2024-09-19T08:02:09.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:08 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2611555324' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T08:02:09.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:08 smithi027 ceph-mon[31209]: mgrmap e9: x(active, since 19s) 2024-09-19T08:02:09.002 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:08 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:08.789+0000 7fd369456040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:02:09.002 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:08 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:08.854+0000 7fd369456040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:02:09.294 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:09 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:09.055+0000 7fd369456040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:02:09.878 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:09 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3519748790' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T08:02:09.886 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:02:09.886 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T08:02:09.886 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:02:09.886 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T08:02:09.886 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T08:02:09.886 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:02:09.886 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.088+0000 7f2488a6f640 1 Processor -- start 2024-09-19T08:02:09.886 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.088+0000 7f2488a6f640 1 -- start start 2024-09-19T08:02:09.886 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.088+0000 7f2488a6f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2484108080 0x7f248410a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:09.887 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.088+0000 7f2488a6f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f248407be30 con 0x7f2484108080 2024-09-19T08:02:09.887 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.089+0000 7f248259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2484108080 0x7f248410a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:09.887 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.089+0000 7f248259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2484108080 0x7f248410a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60190/0 (socket says 172.21.15.27:60190) 2024-09-19T08:02:09.887 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.089+0000 7f248259c640 1 -- 172.21.15.27:0/3492831004 learned_addr learned my addr 172.21.15.27:0/3492831004 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:09.887 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.089+0000 7f248259c640 1 -- 172.21.15.27:0/3492831004 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248410a9b0 con 0x7f2484108080 2024-09-19T08:02:09.887 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.090+0000 7f248259c640 1 --2- 172.21.15.27:0/3492831004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2484108080 0x7f248410a470 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2474009820 tx=0x7f247402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703d8c0bf0765ad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:09.887 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.090+0000 7f248159a640 1 -- 172.21.15.27:0/3492831004 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2474037070 con 0x7f2484108080 2024-09-19T08:02:09.887 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.090+0000 7f248159a640 1 -- 172.21.15.27:0/3492831004 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2474032920 con 0x7f2484108080 2024-09-19T08:02:09.887 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.090+0000 7f248159a640 1 -- 172.21.15.27:0/3492831004 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2474030810 con 0x7f2484108080 2024-09-19T08:02:09.887 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.090+0000 7f2488a6f640 1 -- 172.21.15.27:0/3492831004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2484108080 msgr2=0x7f248410a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:09.887 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.090+0000 7f2488a6f640 1 --2- 172.21.15.27:0/3492831004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2484108080 0x7f248410a470 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2474009820 tx=0x7f247402a270 comp rx=0 tx=0).stop 2024-09-19T08:02:09.888 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.091+0000 7f2488a6f640 1 -- 172.21.15.27:0/3492831004 shutdown_connections 2024-09-19T08:02:09.888 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.091+0000 7f2488a6f640 1 --2- 172.21.15.27:0/3492831004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2484108080 0x7f248410a470 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:09.888 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.091+0000 7f2488a6f640 1 -- 172.21.15.27:0/3492831004 >> 172.21.15.27:0/3492831004 conn(0x7f2484101ca0 msgr2=0x7f24841040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:09.888 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.091+0000 7f2488a6f640 1 -- 172.21.15.27:0/3492831004 shutdown_connections 2024-09-19T08:02:09.888 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.091+0000 7f2488a6f640 1 -- 172.21.15.27:0/3492831004 wait complete. 2024-09-19T08:02:09.888 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.091+0000 7f2488a6f640 1 Processor -- start 2024-09-19T08:02:09.888 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.091+0000 7f2488a6f640 1 -- start start 2024-09-19T08:02:09.888 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.092+0000 7f2488a6f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2484108080 0x7f248419b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:09.888 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.092+0000 7f2488a6f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f248410ba30 con 0x7f2484108080 2024-09-19T08:02:09.888 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.092+0000 7f248259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2484108080 0x7f248419b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:09.888 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.092+0000 7f248259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2484108080 0x7f248419b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60204/0 (socket says 172.21.15.27:60204) 2024-09-19T08:02:09.888 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.092+0000 7f248259c640 1 -- 172.21.15.27:0/3519748790 learned_addr learned my addr 172.21.15.27:0/3519748790 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:09.888 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.092+0000 7f248259c640 1 -- 172.21.15.27:0/3519748790 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248419bb90 con 0x7f2484108080 2024-09-19T08:02:09.888 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.092+0000 7f248259c640 1 --2- 172.21.15.27:0/3519748790 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2484108080 0x7f248419b650 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2474030420 tx=0x7f2474032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:09.889 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.092+0000 7f24737fe640 1 -- 172.21.15.27:0/3519748790 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2474037040 con 0x7f2484108080 2024-09-19T08:02:09.889 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.092+0000 7f2488a6f640 1 -- 172.21.15.27:0/3519748790 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f248419be20 con 0x7f2484108080 2024-09-19T08:02:09.889 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.092+0000 7f24737fe640 1 -- 172.21.15.27:0/3519748790 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2474040070 con 0x7f2484108080 2024-09-19T08:02:09.889 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.092+0000 7f24737fe640 1 -- 172.21.15.27:0/3519748790 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f247403a6e0 con 0x7f2484108080 2024-09-19T08:02:09.889 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.093+0000 7f2488a6f640 1 -- 172.21.15.27:0/3519748790 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f248419eb10 con 0x7f2484108080 2024-09-19T08:02:09.889 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.093+0000 7f24737fe640 1 -- 172.21.15.27:0/3519748790 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f247403a9e0 con 0x7f2484108080 2024-09-19T08:02:09.889 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.094+0000 7f24737fe640 1 --2- 172.21.15.27:0/3519748790 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f246c039200 0x7f246c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:09.889 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.094+0000 7f24737fe640 1 -- 172.21.15.27:0/3519748790 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f247406d940 con 0x7f2484108080 2024-09-19T08:02:09.889 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.094+0000 7f2481d9b640 1 -- 172.21.15.27:0/3519748790 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f246c039200 msgr2=0x7f246c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/538175414 2024-09-19T08:02:09.889 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.094+0000 7f2481d9b640 1 --2- 172.21.15.27:0/3519748790 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f246c039200 0x7f246c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:02:09.889 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.094+0000 7f2488a6f640 1 -- 172.21.15.27:0/3519748790 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24841084e0 con 0x7f2484108080 2024-09-19T08:02:09.889 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.098+0000 7f24737fe640 1 -- 172.21.15.27:0/3519748790 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2474042e10 con 0x7f2484108080 2024-09-19T08:02:09.889 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.295+0000 7f2481d9b640 1 -- 172.21.15.27:0/3519748790 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f246c039200 msgr2=0x7f246c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/538175414 2024-09-19T08:02:09.890 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.295+0000 7f2481d9b640 1 --2- 172.21.15.27:0/3519748790 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f246c039200 0x7f246c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:02:09.890 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.322+0000 7f2488a6f640 1 -- 172.21.15.27:0/3519748790 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f248419ef90 con 0x7f2484108080 2024-09-19T08:02:09.890 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.323+0000 7f24737fe640 1 -- 172.21.15.27:0/3519748790 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f2474043b80 con 0x7f2484108080 2024-09-19T08:02:09.890 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.325+0000 7f2488a6f640 1 -- 172.21.15.27:0/3519748790 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f246c039200 msgr2=0x7f246c03b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:02:09.890 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.325+0000 7f2488a6f640 1 --2- 172.21.15.27:0/3519748790 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f246c039200 0x7f246c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:09.890 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.325+0000 7f2488a6f640 1 -- 172.21.15.27:0/3519748790 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2484108080 msgr2=0x7f248419b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:09.890 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.325+0000 7f2488a6f640 1 --2- 172.21.15.27:0/3519748790 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2484108080 0x7f248419b650 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2474030420 tx=0x7f2474032670 comp rx=0 tx=0).stop 2024-09-19T08:02:09.890 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.325+0000 7f2488a6f640 1 -- 172.21.15.27:0/3519748790 shutdown_connections 2024-09-19T08:02:09.890 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.325+0000 7f2488a6f640 1 --2- 172.21.15.27:0/3519748790 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f246c039200 0x7f246c03b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:09.890 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.325+0000 7f2488a6f640 1 --2- 172.21.15.27:0/3519748790 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2484108080 0x7f248419b650 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:09.890 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.325+0000 7f2488a6f640 1 -- 172.21.15.27:0/3519748790 >> 172.21.15.27:0/3519748790 conn(0x7f2484101ca0 msgr2=0x7f2484102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:09.890 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.325+0000 7f2488a6f640 1 -- 172.21.15.27:0/3519748790 shutdown_connections 2024-09-19T08:02:09.890 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:09.325+0000 7f2488a6f640 1 -- 172.21.15.27:0/3519748790 wait complete. 2024-09-19T08:02:09.890 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for the mgr to restart... 2024-09-19T08:02:09.891 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mgr epoch 9... 2024-09-19T08:02:10.137 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:10 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:10.009+0000 7fd369456040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:02:10.137 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:10 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:10.080+0000 7fd369456040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:02:11.107 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:10 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:10.836+0000 7fd369456040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:02:11.107 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:10 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:10.958+0000 7fd369456040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:02:11.398 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:11 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:11.107+0000 7fd369456040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:02:11.398 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:11 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:11.171+0000 7fd369456040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:02:11.398 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:11 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:11.328+0000 7fd369456040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:02:11.398 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:11 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:11.398+0000 7fd369456040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:02:11.695 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:11 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:11.461+0000 7fd369456040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:02:11.695 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:11 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:11.627+0000 7fd369456040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:02:11.696 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:11 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:11.695+0000 7fd369456040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:02:11.975 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:11 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:11.765+0000 7fd369456040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:02:11.975 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:11 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:11.851+0000 7fd369456040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:02:11.976 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:11 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:11.914+0000 7fd369456040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:02:11.976 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:11 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:11.975+0000 7fd369456040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:02:13.064 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:12 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:12.806+0000 7fd369456040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:02:13.064 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:12 smithi027 ceph-mon[31209]: Active manager daemon x restarted 2024-09-19T08:02:13.064 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:12 smithi027 ceph-mon[31209]: Activating manager daemon x 2024-09-19T08:02:13.064 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:12 smithi027 ceph-mon[31209]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T08:02:13.064 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:12 smithi027 ceph-mon[31209]: mgrmap e10: x(active, starting, since 0.00369328s) 2024-09-19T08:02:13.064 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:12 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:02:13.064 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:12 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:02:13.065 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:12 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:02:13.065 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:12 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:02:13.065 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:12 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:02:13.065 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:12 smithi027 ceph-mon[31209]: Manager daemon x is now available 2024-09-19T08:02:13.065 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:12 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:02:13.065 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:12 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:02:13.065 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:12 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:02:14.455 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:02:14.455 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T08:02:14.455 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T08:02:14.455 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:02:14.455 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.303+0000 7f965efc3640 1 Processor -- start 2024-09-19T08:02:14.455 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.303+0000 7f965efc3640 1 -- start start 2024-09-19T08:02:14.456 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.303+0000 7f965efc3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9658106500 0x7f9658106900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:14.456 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.303+0000 7f965efc3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9658106ed0 con 0x7f9658106500 2024-09-19T08:02:14.456 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.303+0000 7f965cd5f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9658106500 0x7f9658106900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:14.456 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.303+0000 7f965cd5f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9658106500 0x7f9658106900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41368/0 (socket says 172.21.15.27:41368) 2024-09-19T08:02:14.456 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.303+0000 7f965cd5f640 1 -- 172.21.15.27:0/3492585894 learned_addr learned my addr 172.21.15.27:0/3492585894 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:14.456 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.304+0000 7f965cd5f640 1 -- 172.21.15.27:0/3492585894 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9658107700 con 0x7f9658106500 2024-09-19T08:02:14.456 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.304+0000 7f965cd5f640 1 --2- 172.21.15.27:0/3492585894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9658106500 0x7f9658106900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f964c009820 tx=0x7f964c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98190bb5483daa86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:14.457 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.304+0000 7f96577fe640 1 -- 172.21.15.27:0/3492585894 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f964c037070 con 0x7f9658106500 2024-09-19T08:02:14.457 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.305+0000 7f96577fe640 1 -- 172.21.15.27:0/3492585894 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f964c032920 con 0x7f9658106500 2024-09-19T08:02:14.457 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.305+0000 7f96577fe640 1 -- 172.21.15.27:0/3492585894 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f964c030810 con 0x7f9658106500 2024-09-19T08:02:14.458 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.305+0000 7f965efc3640 1 -- 172.21.15.27:0/3492585894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9658106500 msgr2=0x7f9658106900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:14.458 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.305+0000 7f965efc3640 1 --2- 172.21.15.27:0/3492585894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9658106500 0x7f9658106900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f964c009820 tx=0x7f964c02a270 comp rx=0 tx=0).stop 2024-09-19T08:02:14.458 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.305+0000 7f965efc3640 1 -- 172.21.15.27:0/3492585894 shutdown_connections 2024-09-19T08:02:14.458 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.305+0000 7f965efc3640 1 --2- 172.21.15.27:0/3492585894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9658106500 0x7f9658106900 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:14.458 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.305+0000 7f965efc3640 1 -- 172.21.15.27:0/3492585894 >> 172.21.15.27:0/3492585894 conn(0x7f9658101d10 msgr2=0x7f9658104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:14.458 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.305+0000 7f965efc3640 1 -- 172.21.15.27:0/3492585894 shutdown_connections 2024-09-19T08:02:14.459 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.305+0000 7f965efc3640 1 -- 172.21.15.27:0/3492585894 wait complete. 2024-09-19T08:02:14.459 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.306+0000 7f965efc3640 1 Processor -- start 2024-09-19T08:02:14.459 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.306+0000 7f965efc3640 1 -- start start 2024-09-19T08:02:14.459 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.306+0000 7f965efc3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9658106500 0x7f9658191730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:14.459 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.306+0000 7f965efc3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f965810aab0 con 0x7f9658106500 2024-09-19T08:02:14.459 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.306+0000 7f965cd5f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9658106500 0x7f9658191730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:14.460 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.306+0000 7f965cd5f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9658106500 0x7f9658191730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41380/0 (socket says 172.21.15.27:41380) 2024-09-19T08:02:14.460 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.306+0000 7f965cd5f640 1 -- 172.21.15.27:0/1470716192 learned_addr learned my addr 172.21.15.27:0/1470716192 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:14.460 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.307+0000 7f965cd5f640 1 -- 172.21.15.27:0/1470716192 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9658191c70 con 0x7f9658106500 2024-09-19T08:02:14.460 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.307+0000 7f965cd5f640 1 --2- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9658106500 0x7f9658191730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f964c030560 tx=0x7f964c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:14.460 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.307+0000 7f9655ffb640 1 -- 172.21.15.27:0/1470716192 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f964c037040 con 0x7f9658106500 2024-09-19T08:02:14.460 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.307+0000 7f9655ffb640 1 -- 172.21.15.27:0/1470716192 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f964c040070 con 0x7f9658106500 2024-09-19T08:02:14.461 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.307+0000 7f965efc3640 1 -- 172.21.15.27:0/1470716192 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f965818fe60 con 0x7f9658106500 2024-09-19T08:02:14.461 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.307+0000 7f9655ffb640 1 -- 172.21.15.27:0/1470716192 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f964c03a740 con 0x7f9658106500 2024-09-19T08:02:14.461 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.307+0000 7f965efc3640 1 -- 172.21.15.27:0/1470716192 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96581903a0 con 0x7f9658106500 2024-09-19T08:02:14.461 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.308+0000 7f9655ffb640 1 -- 172.21.15.27:0/1470716192 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f964c03a9b0 con 0x7f9658106500 2024-09-19T08:02:14.461 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.308+0000 7f9655ffb640 1 --2- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f9648039200 0x7f964803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:14.461 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.308+0000 7f9655ffb640 1 -- 172.21.15.27:0/1470716192 --> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f964803bdd0 con 0x7f9648039200 2024-09-19T08:02:14.462 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.308+0000 7f9655ffb640 1 -- 172.21.15.27:0/1470716192 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f964c06c8e0 con 0x7f9658106500 2024-09-19T08:02:14.462 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.308+0000 7f9657fff640 1 -- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f9648039200 msgr2=0x7f964803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/538175414 2024-09-19T08:02:14.462 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.308+0000 7f9657fff640 1 --2- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f9648039200 0x7f964803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:02:14.462 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.509+0000 7f9657fff640 1 -- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f9648039200 msgr2=0x7f964803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/538175414 2024-09-19T08:02:14.462 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.509+0000 7f9657fff640 1 --2- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f9648039200 0x7f964803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:02:14.462 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.910+0000 7f9657fff640 1 -- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f9648039200 msgr2=0x7f964803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/538175414 2024-09-19T08:02:14.463 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:10.910+0000 7f9657fff640 1 --2- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f9648039200 0x7f964803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T08:02:14.463 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:11.711+0000 7f9657fff640 1 -- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f9648039200 msgr2=0x7f964803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/538175414 2024-09-19T08:02:14.463 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:11.711+0000 7f9657fff640 1 --2- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f9648039200 0x7f964803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T08:02:14.463 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:12.810+0000 7f9655ffb640 1 -- 172.21.15.27:0/1470716192 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f964c06b390 con 0x7f9658106500 2024-09-19T08:02:14.463 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:12.810+0000 7f9655ffb640 1 -- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f9648039200 msgr2=0x7f964803b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:02:14.463 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:12.810+0000 7f9655ffb640 1 --2- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f9648039200 0x7f964803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:14.464 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:13.812+0000 7f9655ffb640 1 -- 172.21.15.27:0/1470716192 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f964c03aca0 con 0x7f9658106500 2024-09-19T08:02:14.464 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:13.812+0000 7f9655ffb640 1 --2- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f964803ccc0 0x7f964803f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:14.464 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:13.812+0000 7f9655ffb640 1 -- 172.21.15.27:0/1470716192 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f964c02bba0 con 0x7f964803ccc0 2024-09-19T08:02:14.464 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:13.813+0000 7f9657fff640 1 --2- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f964803ccc0 0x7f964803f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:14.464 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:13.814+0000 7f9657fff640 1 --2- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f964803ccc0 0x7f964803f0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9644003980 tx=0x7f9644006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:14.465 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:13.815+0000 7f9655ffb640 1 -- 172.21.15.27:0/1470716192 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f964c02bba0 con 0x7f964803ccc0 2024-09-19T08:02:14.465 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:13.828+0000 7f965efc3640 1 -- 172.21.15.27:0/1470716192 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f965810ac30 con 0x7f964803ccc0 2024-09-19T08:02:14.465 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:13.828+0000 7f9655ffb640 1 -- 172.21.15.27:0/1470716192 <== mgr.14150 v2:172.21.15.27:6800/4220278108 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f965810ac30 con 0x7f964803ccc0 2024-09-19T08:02:14.465 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:13.828+0000 7f965efc3640 1 -- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f964803ccc0 msgr2=0x7f964803f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:14.465 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:13.828+0000 7f965efc3640 1 --2- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f964803ccc0 0x7f964803f0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9644003980 tx=0x7f9644006e10 comp rx=0 tx=0).stop 2024-09-19T08:02:14.465 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:13.828+0000 7f965efc3640 1 -- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9658106500 msgr2=0x7f9658191730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:14.466 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:13.828+0000 7f965efc3640 1 --2- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9658106500 0x7f9658191730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f964c030560 tx=0x7f964c032670 comp rx=0 tx=0).stop 2024-09-19T08:02:14.466 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:13.829+0000 7f965efc3640 1 -- 172.21.15.27:0/1470716192 shutdown_connections 2024-09-19T08:02:14.466 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:13.829+0000 7f965efc3640 1 --2- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f964803ccc0 0x7f964803f0b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:14.466 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:13.829+0000 7f965efc3640 1 --2- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:6800/538175414,v1:172.21.15.27:6801/538175414] conn(0x7f9648039200 0x7f964803b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:14.466 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:13.829+0000 7f965efc3640 1 --2- 172.21.15.27:0/1470716192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9658106500 0x7f9658191730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:14.466 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:13.829+0000 7f965efc3640 1 -- 172.21.15.27:0/1470716192 >> 172.21.15.27:0/1470716192 conn(0x7f9658101d10 msgr2=0x7f9658102c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:14.467 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:13.829+0000 7f965efc3640 1 -- 172.21.15.27:0/1470716192 shutdown_connections 2024-09-19T08:02:14.467 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:13.829+0000 7f965efc3640 1 -- 172.21.15.27:0/1470716192 wait complete. 2024-09-19T08:02:14.467 INFO:teuthology.orchestra.run.smithi027.stdout:mgr epoch 9 is available 2024-09-19T08:02:14.467 INFO:teuthology.orchestra.run.smithi027.stdout:Generating a dashboard self-signed certificate... 2024-09-19T08:02:14.752 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:14.566+0000 7fd2cef1f640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:08:02:14] ENGINE Error in HTTPServer.serve 2024-09-19T08:02:14.752 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: Traceback (most recent call last): 2024-09-19T08:02:14.752 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:02:14.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: self._connections.run(self.expiration_interval) 2024-09-19T08:02:14.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:02:14.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: self._run(expiration_interval) 2024-09-19T08:02:14.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:02:14.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:02:14.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:02:14.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:02:14.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:02:14.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: s = self.context.wrap_socket( 2024-09-19T08:02:14.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:02:14.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: return self.sslsocket_class._create( 2024-09-19T08:02:14.754 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:02:14.754 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: self.do_handshake() 2024-09-19T08:02:14.754 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:02:14.754 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: self._sslobj.do_handshake() 2024-09-19T08:02:14.754 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:02:14.754 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:02:15.116 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-mon[31209]: mgrmap e11: x(active, since 1.00657s) 2024-09-19T08:02:15.116 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-mon[31209]: [19/Sep/2024:08:02:14] ENGINE Bus STARTING 2024-09-19T08:02:15.117 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-mon[31209]: [19/Sep/2024:08:02:14] ENGINE Serving on http://172.21.15.27:8765 2024-09-19T08:02:15.117 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-mon[31209]: [19/Sep/2024:08:02:14] ENGINE Serving on https://172.21.15.27:7150 2024-09-19T08:02:15.117 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-mon[31209]: [19/Sep/2024:08:02:14] ENGINE Bus STARTED 2024-09-19T08:02:15.117 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-mon[31209]: [19/Sep/2024:08:02:14] ENGINE Error in HTTPServer.serve 2024-09-19T08:02:15.117 INFO:journalctl@ceph.mon.a.smithi027.stdout: Traceback (most recent call last): 2024-09-19T08:02:15.117 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:02:15.117 INFO:journalctl@ceph.mon.a.smithi027.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:02:15.117 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:02:15.117 INFO:journalctl@ceph.mon.a.smithi027.stdout: self._run(expiration_interval) 2024-09-19T08:02:15.117 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:02:15.117 INFO:journalctl@ceph.mon.a.smithi027.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:02:15.117 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:02:15.117 INFO:journalctl@ceph.mon.a.smithi027.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:02:15.118 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:02:15.118 INFO:journalctl@ceph.mon.a.smithi027.stdout: s = self.context.wrap_socket( 2024-09-19T08:02:15.118 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:02:15.118 INFO:journalctl@ceph.mon.a.smithi027.stdout: return self.sslsocket_class._create( 2024-09-19T08:02:15.118 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:02:15.118 INFO:journalctl@ceph.mon.a.smithi027.stdout: self.do_handshake() 2024-09-19T08:02:15.118 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:02:15.118 INFO:journalctl@ceph.mon.a.smithi027.stdout: self._sslobj.do_handshake() 2024-09-19T08:02:15.118 INFO:journalctl@ceph.mon.a.smithi027.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:02:15.118 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:16.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T08:02:16.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.201+0000 7f9721cd4640 1 Processor -- start 2024-09-19T08:02:16.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.201+0000 7f9721cd4640 1 -- start start 2024-09-19T08:02:16.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.201+0000 7f9721cd4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f971c1080c0 0x7f971c10a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:16.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.201+0000 7f9721cd4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f971c07bdf0 con 0x7f971c1080c0 2024-09-19T08:02:16.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.202+0000 7f971b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f971c1080c0 0x7f971c10a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:16.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.202+0000 7f971b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f971c1080c0 0x7f971c10a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41440/0 (socket says 172.21.15.27:41440) 2024-09-19T08:02:16.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.202+0000 7f971b7fe640 1 -- 172.21.15.27:0/1801372551 learned_addr learned my addr 172.21.15.27:0/1801372551 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:16.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.202+0000 7f971b7fe640 1 -- 172.21.15.27:0/1801372551 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f971c10a9f0 con 0x7f971c1080c0 2024-09-19T08:02:16.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.203+0000 7f971b7fe640 1 --2- 172.21.15.27:0/1801372551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f971c1080c0 0x7f971c10a4b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f970c009820 tx=0x7f970c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc6785a5ef8e1bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:16.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.203+0000 7f971a7fc640 1 -- 172.21.15.27:0/1801372551 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f970c037070 con 0x7f971c1080c0 2024-09-19T08:02:16.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.203+0000 7f971a7fc640 1 -- 172.21.15.27:0/1801372551 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f970c032920 con 0x7f971c1080c0 2024-09-19T08:02:16.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.203+0000 7f971a7fc640 1 -- 172.21.15.27:0/1801372551 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f970c030810 con 0x7f971c1080c0 2024-09-19T08:02:16.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.204+0000 7f9721cd4640 1 -- 172.21.15.27:0/1801372551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f971c1080c0 msgr2=0x7f971c10a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:16.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.204+0000 7f9721cd4640 1 --2- 172.21.15.27:0/1801372551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f971c1080c0 0x7f971c10a4b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f970c009820 tx=0x7f970c02a270 comp rx=0 tx=0).stop 2024-09-19T08:02:16.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.204+0000 7f9721cd4640 1 -- 172.21.15.27:0/1801372551 shutdown_connections 2024-09-19T08:02:16.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.204+0000 7f9721cd4640 1 --2- 172.21.15.27:0/1801372551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f971c1080c0 0x7f971c10a4b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:16.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.204+0000 7f9721cd4640 1 -- 172.21.15.27:0/1801372551 >> 172.21.15.27:0/1801372551 conn(0x7f971c101ca0 msgr2=0x7f971c1040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:16.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.204+0000 7f9721cd4640 1 -- 172.21.15.27:0/1801372551 shutdown_connections 2024-09-19T08:02:16.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.204+0000 7f9721cd4640 1 -- 172.21.15.27:0/1801372551 wait complete. 2024-09-19T08:02:16.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.204+0000 7f9721cd4640 1 Processor -- start 2024-09-19T08:02:16.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.205+0000 7f9721cd4640 1 -- start start 2024-09-19T08:02:16.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.205+0000 7f9721cd4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f971c1080c0 0x7f971c19b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:16.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.205+0000 7f9721cd4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f971c10ba10 con 0x7f971c1080c0 2024-09-19T08:02:16.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.205+0000 7f971b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f971c1080c0 0x7f971c19b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:16.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.205+0000 7f971b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f971c1080c0 0x7f971c19b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41454/0 (socket says 172.21.15.27:41454) 2024-09-19T08:02:16.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.205+0000 7f971b7fe640 1 -- 172.21.15.27:0/3274543110 learned_addr learned my addr 172.21.15.27:0/3274543110 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:16.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.205+0000 7f971b7fe640 1 -- 172.21.15.27:0/3274543110 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f971c19bb40 con 0x7f971c1080c0 2024-09-19T08:02:16.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.205+0000 7f971b7fe640 1 --2- 172.21.15.27:0/3274543110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f971c1080c0 0x7f971c19b600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f970c030420 tx=0x7f970c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:16.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.206+0000 7f9718ff9640 1 -- 172.21.15.27:0/3274543110 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f970c037040 con 0x7f971c1080c0 2024-09-19T08:02:16.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.206+0000 7f9718ff9640 1 -- 172.21.15.27:0/3274543110 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f970c040070 con 0x7f971c1080c0 2024-09-19T08:02:16.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.206+0000 7f9721cd4640 1 -- 172.21.15.27:0/3274543110 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f971c19bdd0 con 0x7f971c1080c0 2024-09-19T08:02:16.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.206+0000 7f9718ff9640 1 -- 172.21.15.27:0/3274543110 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f970c03a6e0 con 0x7f971c1080c0 2024-09-19T08:02:16.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.206+0000 7f9721cd4640 1 -- 172.21.15.27:0/3274543110 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f971c19eac0 con 0x7f971c1080c0 2024-09-19T08:02:16.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.207+0000 7f9721cd4640 1 -- 172.21.15.27:0/3274543110 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f971c108520 con 0x7f971c1080c0 2024-09-19T08:02:16.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.207+0000 7f9718ff9640 1 -- 172.21.15.27:0/3274543110 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f970c03bb20 con 0x7f971c1080c0 2024-09-19T08:02:16.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.207+0000 7f9718ff9640 1 --2- 172.21.15.27:0/3274543110 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f97040390f0 0x7f970403b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:16.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.207+0000 7f9718ff9640 1 -- 172.21.15.27:0/3274543110 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f970c06c800 con 0x7f971c1080c0 2024-09-19T08:02:16.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.207+0000 7f971affd640 1 --2- 172.21.15.27:0/3274543110 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f97040390f0 0x7f970403b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:16.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.208+0000 7f971affd640 1 --2- 172.21.15.27:0/3274543110 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f97040390f0 0x7f970403b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f97100098c0 tx=0x7f9710006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:16.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.212+0000 7f9718ff9640 1 -- 172.21.15.27:0/3274543110 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f970c038280 con 0x7f971c1080c0 2024-09-19T08:02:16.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.396+0000 7f9721cd4640 1 -- 172.21.15.27:0/3274543110 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f971c102f90 con 0x7f97040390f0 2024-09-19T08:02:16.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.498+0000 7f9718ff9640 1 -- 172.21.15.27:0/3274543110 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f971c102f90 con 0x7f97040390f0 2024-09-19T08:02:16.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.500+0000 7f9721cd4640 1 -- 172.21.15.27:0/3274543110 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f97040390f0 msgr2=0x7f970403b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:16.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.500+0000 7f9721cd4640 1 --2- 172.21.15.27:0/3274543110 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f97040390f0 0x7f970403b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f97100098c0 tx=0x7f9710006db0 comp rx=0 tx=0).stop 2024-09-19T08:02:16.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.500+0000 7f9721cd4640 1 -- 172.21.15.27:0/3274543110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f971c1080c0 msgr2=0x7f971c19b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:16.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.500+0000 7f9721cd4640 1 --2- 172.21.15.27:0/3274543110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f971c1080c0 0x7f971c19b600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f970c030420 tx=0x7f970c032670 comp rx=0 tx=0).stop 2024-09-19T08:02:16.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.500+0000 7f9721cd4640 1 -- 172.21.15.27:0/3274543110 shutdown_connections 2024-09-19T08:02:16.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.500+0000 7f9721cd4640 1 --2- 172.21.15.27:0/3274543110 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f97040390f0 0x7f970403b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:16.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.500+0000 7f9721cd4640 1 --2- 172.21.15.27:0/3274543110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f971c1080c0 0x7f971c19b600 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:16.073 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.500+0000 7f9721cd4640 1 -- 172.21.15.27:0/3274543110 >> 172.21.15.27:0/3274543110 conn(0x7f971c101ca0 msgr2=0x7f971c102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:16.073 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.501+0000 7f9721cd4640 1 -- 172.21.15.27:0/3274543110 shutdown_connections 2024-09-19T08:02:16.073 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:15.501+0000 7f9721cd4640 1 -- 172.21.15.27:0/3274543110 wait complete. 2024-09-19T08:02:16.073 INFO:teuthology.orchestra.run.smithi027.stdout:Creating initial admin user... 2024-09-19T08:02:16.465 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:16 smithi027 ceph-mon[31209]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:02:16.465 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:16 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:16.465 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:16 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:16.465 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:16 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:16.465 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:16 smithi027 ceph-mon[31209]: mgrmap e12: x(active, since 2s) 2024-09-19T08:02:17.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:17 smithi027 ceph-mon[31209]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:02:17.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:17 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:18.058 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$ex6DIsUpug2.xhjWn4qileORnHp25Y7SsptwH0ikquFOxAMDCtLPq", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726732936, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T08:02:18.058 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.468+0000 7f609cdbe640 1 Processor -- start 2024-09-19T08:02:18.058 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.468+0000 7f609cdbe640 1 -- start start 2024-09-19T08:02:18.059 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.468+0000 7f609cdbe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60981080c0 0x7f609810a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:18.059 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.468+0000 7f609cdbe640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f609807bdf0 con 0x7f60981080c0 2024-09-19T08:02:18.059 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.468+0000 7f609659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60981080c0 0x7f609810a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:18.059 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.468+0000 7f609659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60981080c0 0x7f609810a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41464/0 (socket says 172.21.15.27:41464) 2024-09-19T08:02:18.059 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.468+0000 7f609659c640 1 -- 172.21.15.27:0/2452325897 learned_addr learned my addr 172.21.15.27:0/2452325897 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:18.059 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.469+0000 7f609659c640 1 -- 172.21.15.27:0/2452325897 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609810a9f0 con 0x7f60981080c0 2024-09-19T08:02:18.059 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.469+0000 7f609659c640 1 --2- 172.21.15.27:0/2452325897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60981080c0 0x7f609810a4b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6088009820 tx=0x7f608802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a1cfc7761aeb2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:18.059 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.470+0000 7f609559a640 1 -- 172.21.15.27:0/2452325897 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6088037070 con 0x7f60981080c0 2024-09-19T08:02:18.060 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.470+0000 7f609559a640 1 -- 172.21.15.27:0/2452325897 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6088032920 con 0x7f60981080c0 2024-09-19T08:02:18.060 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.470+0000 7f609559a640 1 -- 172.21.15.27:0/2452325897 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6088030810 con 0x7f60981080c0 2024-09-19T08:02:18.060 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.470+0000 7f609cdbe640 1 -- 172.21.15.27:0/2452325897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60981080c0 msgr2=0x7f609810a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:18.060 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.470+0000 7f609cdbe640 1 --2- 172.21.15.27:0/2452325897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60981080c0 0x7f609810a4b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6088009820 tx=0x7f608802a270 comp rx=0 tx=0).stop 2024-09-19T08:02:18.060 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.470+0000 7f609cdbe640 1 -- 172.21.15.27:0/2452325897 shutdown_connections 2024-09-19T08:02:18.060 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.470+0000 7f609cdbe640 1 --2- 172.21.15.27:0/2452325897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60981080c0 0x7f609810a4b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:18.060 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.470+0000 7f609cdbe640 1 -- 172.21.15.27:0/2452325897 >> 172.21.15.27:0/2452325897 conn(0x7f6098101ca0 msgr2=0x7f60981040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:18.060 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.471+0000 7f609cdbe640 1 -- 172.21.15.27:0/2452325897 shutdown_connections 2024-09-19T08:02:18.060 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.471+0000 7f609cdbe640 1 -- 172.21.15.27:0/2452325897 wait complete. 2024-09-19T08:02:18.060 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.471+0000 7f609cdbe640 1 Processor -- start 2024-09-19T08:02:18.060 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.472+0000 7f609cdbe640 1 -- start start 2024-09-19T08:02:18.060 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.472+0000 7f609cdbe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60981080c0 0x7f6098107940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:18.060 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.472+0000 7f609cdbe640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f609810ba10 con 0x7f60981080c0 2024-09-19T08:02:18.061 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.472+0000 7f609659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60981080c0 0x7f6098107940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:18.061 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.472+0000 7f609659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60981080c0 0x7f6098107940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41472/0 (socket says 172.21.15.27:41472) 2024-09-19T08:02:18.061 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.472+0000 7f609659c640 1 -- 172.21.15.27:0/564987716 learned_addr learned my addr 172.21.15.27:0/564987716 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:18.061 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.472+0000 7f609659c640 1 -- 172.21.15.27:0/564987716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6098107e80 con 0x7f60981080c0 2024-09-19T08:02:18.061 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.472+0000 7f609659c640 1 --2- 172.21.15.27:0/564987716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60981080c0 0x7f6098107940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6088030420 tx=0x7f6088032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:18.061 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.473+0000 7f60877fe640 1 -- 172.21.15.27:0/564987716 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6088037040 con 0x7f60981080c0 2024-09-19T08:02:18.062 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.473+0000 7f60877fe640 1 -- 172.21.15.27:0/564987716 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6088040070 con 0x7f60981080c0 2024-09-19T08:02:18.062 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.473+0000 7f60877fe640 1 -- 172.21.15.27:0/564987716 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f608803a6e0 con 0x7f60981080c0 2024-09-19T08:02:18.062 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.473+0000 7f609cdbe640 1 -- 172.21.15.27:0/564987716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6098106070 con 0x7f60981080c0 2024-09-19T08:02:18.062 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.473+0000 7f609cdbe640 1 -- 172.21.15.27:0/564987716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60981065b0 con 0x7f60981080c0 2024-09-19T08:02:18.062 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.474+0000 7f60877fe640 1 -- 172.21.15.27:0/564987716 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f608803a990 con 0x7f60981080c0 2024-09-19T08:02:18.062 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.474+0000 7f609cdbe640 1 -- 172.21.15.27:0/564987716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6098108520 con 0x7f60981080c0 2024-09-19T08:02:18.062 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.474+0000 7f60877fe640 1 --2- 172.21.15.27:0/564987716 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6080039260 0x7f608003b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:18.063 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.474+0000 7f60877fe640 1 -- 172.21.15.27:0/564987716 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f608806c9b0 con 0x7f60981080c0 2024-09-19T08:02:18.063 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.474+0000 7f6095d9b640 1 --2- 172.21.15.27:0/564987716 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6080039260 0x7f608003b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:18.063 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.474+0000 7f6095d9b640 1 --2- 172.21.15.27:0/564987716 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6080039260 0x7f608003b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f608c0098c0 tx=0x7f608c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:18.063 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.483+0000 7f60877fe640 1 -- 172.21.15.27:0/564987716 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6088041270 con 0x7f60981080c0 2024-09-19T08:02:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.675+0000 7f609cdbe640 1 -- 172.21.15.27:0/564987716 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f6098106d50 con 0x7f6080039260 2024-09-19T08:02:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.924+0000 7f60877fe640 1 -- 172.21.15.27:0/564987716 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f6098106d50 con 0x7f6080039260 2024-09-19T08:02:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.926+0000 7f609cdbe640 1 -- 172.21.15.27:0/564987716 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6080039260 msgr2=0x7f608003b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.926+0000 7f609cdbe640 1 --2- 172.21.15.27:0/564987716 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6080039260 0x7f608003b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f608c0098c0 tx=0x7f608c006db0 comp rx=0 tx=0).stop 2024-09-19T08:02:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.926+0000 7f609cdbe640 1 -- 172.21.15.27:0/564987716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60981080c0 msgr2=0x7f6098107940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.926+0000 7f609cdbe640 1 --2- 172.21.15.27:0/564987716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60981080c0 0x7f6098107940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6088030420 tx=0x7f6088032670 comp rx=0 tx=0).stop 2024-09-19T08:02:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.926+0000 7f609cdbe640 1 -- 172.21.15.27:0/564987716 shutdown_connections 2024-09-19T08:02:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.926+0000 7f609cdbe640 1 --2- 172.21.15.27:0/564987716 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6080039260 0x7f608003b720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.926+0000 7f609cdbe640 1 --2- 172.21.15.27:0/564987716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60981080c0 0x7f6098107940 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:18.065 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.926+0000 7f609cdbe640 1 -- 172.21.15.27:0/564987716 >> 172.21.15.27:0/564987716 conn(0x7f6098101ca0 msgr2=0x7f60981028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:18.065 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.926+0000 7f609cdbe640 1 -- 172.21.15.27:0/564987716 shutdown_connections 2024-09-19T08:02:18.065 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:16.926+0000 7f609cdbe640 1 -- 172.21.15.27:0/564987716 wait complete. 2024-09-19T08:02:18.065 INFO:teuthology.orchestra.run.smithi027.stdout:Fetching dashboard port number... 2024-09-19T08:02:19.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:18 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1533535213' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T08:02:19.258 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T08:02:19.258 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.484+0000 7f2bada8d640 1 Processor -- start 2024-09-19T08:02:19.258 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.484+0000 7f2bada8d640 1 -- start start 2024-09-19T08:02:19.258 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.484+0000 7f2bada8d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ba807de90 0x7f2ba807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:19.259 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.484+0000 7f2bada8d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba807c8c0 con 0x7f2ba807de90 2024-09-19T08:02:19.259 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.485+0000 7f2ba77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ba807de90 0x7f2ba807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:19.259 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.485+0000 7f2ba77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ba807de90 0x7f2ba807c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41480/0 (socket says 172.21.15.27:41480) 2024-09-19T08:02:19.259 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.485+0000 7f2ba77fe640 1 -- 172.21.15.27:0/263507250 learned_addr learned my addr 172.21.15.27:0/263507250 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:19.259 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.485+0000 7f2ba77fe640 1 -- 172.21.15.27:0/263507250 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba807ca40 con 0x7f2ba807de90 2024-09-19T08:02:19.259 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.486+0000 7f2ba77fe640 1 --2- 172.21.15.27:0/263507250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ba807de90 0x7f2ba807c2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2b98009820 tx=0x7f2b9802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fab1e3857ef609f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:19.259 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.486+0000 7f2ba6ffd640 1 -- 172.21.15.27:0/263507250 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b98037070 con 0x7f2ba807de90 2024-09-19T08:02:19.259 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.486+0000 7f2ba6ffd640 1 -- 172.21.15.27:0/263507250 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b98032920 con 0x7f2ba807de90 2024-09-19T08:02:19.259 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.486+0000 7f2ba6ffd640 1 -- 172.21.15.27:0/263507250 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b98030810 con 0x7f2ba807de90 2024-09-19T08:02:19.259 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.486+0000 7f2bada8d640 1 -- 172.21.15.27:0/263507250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ba807de90 msgr2=0x7f2ba807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:19.259 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.486+0000 7f2bada8d640 1 --2- 172.21.15.27:0/263507250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ba807de90 0x7f2ba807c2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2b98009820 tx=0x7f2b9802a270 comp rx=0 tx=0).stop 2024-09-19T08:02:19.259 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.486+0000 7f2bada8d640 1 -- 172.21.15.27:0/263507250 shutdown_connections 2024-09-19T08:02:19.259 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.486+0000 7f2bada8d640 1 --2- 172.21.15.27:0/263507250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ba807de90 0x7f2ba807c2f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:19.260 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.486+0000 7f2bada8d640 1 -- 172.21.15.27:0/263507250 >> 172.21.15.27:0/263507250 conn(0x7f2ba8102db0 msgr2=0x7f2ba81051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:19.260 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.486+0000 7f2bada8d640 1 -- 172.21.15.27:0/263507250 shutdown_connections 2024-09-19T08:02:19.260 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.486+0000 7f2bada8d640 1 -- 172.21.15.27:0/263507250 wait complete. 2024-09-19T08:02:19.260 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.487+0000 7f2bada8d640 1 Processor -- start 2024-09-19T08:02:19.260 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.487+0000 7f2bada8d640 1 -- start start 2024-09-19T08:02:19.260 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.487+0000 7f2bada8d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ba807de90 0x7f2ba819d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:19.260 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.487+0000 7f2bada8d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba810dcd0 con 0x7f2ba807de90 2024-09-19T08:02:19.260 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.487+0000 7f2ba77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ba807de90 0x7f2ba819d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:19.260 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.487+0000 7f2ba77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ba807de90 0x7f2ba819d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41494/0 (socket says 172.21.15.27:41494) 2024-09-19T08:02:19.261 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.487+0000 7f2ba77fe640 1 -- 172.21.15.27:0/1533535213 learned_addr learned my addr 172.21.15.27:0/1533535213 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:19.261 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.488+0000 7f2ba77fe640 1 -- 172.21.15.27:0/1533535213 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba819dde0 con 0x7f2ba807de90 2024-09-19T08:02:19.261 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.488+0000 7f2ba77fe640 1 --2- 172.21.15.27:0/1533535213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ba807de90 0x7f2ba819d8a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2b980097f0 tx=0x7f2b980327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:19.261 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.488+0000 7f2ba57fa640 1 -- 172.21.15.27:0/1533535213 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b98037040 con 0x7f2ba807de90 2024-09-19T08:02:19.261 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.488+0000 7f2ba57fa640 1 -- 172.21.15.27:0/1533535213 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b98030c40 con 0x7f2ba807de90 2024-09-19T08:02:19.261 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.488+0000 7f2bada8d640 1 -- 172.21.15.27:0/1533535213 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ba819e070 con 0x7f2ba807de90 2024-09-19T08:02:19.261 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.488+0000 7f2ba57fa640 1 -- 172.21.15.27:0/1533535213 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b9803a5b0 con 0x7f2ba807de90 2024-09-19T08:02:19.261 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.488+0000 7f2bada8d640 1 -- 172.21.15.27:0/1533535213 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ba81a0d60 con 0x7f2ba807de90 2024-09-19T08:02:19.261 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.489+0000 7f2ba57fa640 1 -- 172.21.15.27:0/1533535213 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f2b9803a7a0 con 0x7f2ba807de90 2024-09-19T08:02:19.261 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.489+0000 7f2bada8d640 1 -- 172.21.15.27:0/1533535213 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ba807c370 con 0x7f2ba807de90 2024-09-19T08:02:19.261 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.489+0000 7f2ba57fa640 1 --2- 172.21.15.27:0/1533535213 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2b94039260 0x7f2b9403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:19.262 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.489+0000 7f2ba57fa640 1 -- 172.21.15.27:0/1533535213 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2b9806c7d0 con 0x7f2ba807de90 2024-09-19T08:02:19.262 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.489+0000 7f2b9ffff640 1 --2- 172.21.15.27:0/1533535213 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2b94039260 0x7f2b9403b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:19.262 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.490+0000 7f2b9ffff640 1 --2- 172.21.15.27:0/1533535213 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2b94039260 0x7f2b9403b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2b900098c0 tx=0x7f2b90006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:19.262 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.494+0000 7f2ba57fa640 1 -- 172.21.15.27:0/1533535213 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2b980371e0 con 0x7f2ba807de90 2024-09-19T08:02:19.262 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.669+0000 7f2bada8d640 1 -- 172.21.15.27:0/1533535213 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f2ba81a1350 con 0x7f2ba807de90 2024-09-19T08:02:19.262 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.669+0000 7f2ba57fa640 1 -- 172.21.15.27:0/1533535213 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f2b9803b3f0 con 0x7f2ba807de90 2024-09-19T08:02:19.262 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.672+0000 7f2bada8d640 1 -- 172.21.15.27:0/1533535213 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2b94039260 msgr2=0x7f2b9403b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:19.262 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.672+0000 7f2bada8d640 1 --2- 172.21.15.27:0/1533535213 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2b94039260 0x7f2b9403b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2b900098c0 tx=0x7f2b90006db0 comp rx=0 tx=0).stop 2024-09-19T08:02:19.262 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.672+0000 7f2bada8d640 1 -- 172.21.15.27:0/1533535213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ba807de90 msgr2=0x7f2ba819d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:19.262 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.672+0000 7f2bada8d640 1 --2- 172.21.15.27:0/1533535213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ba807de90 0x7f2ba819d8a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2b980097f0 tx=0x7f2b980327b0 comp rx=0 tx=0).stop 2024-09-19T08:02:19.262 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.672+0000 7f2bada8d640 1 -- 172.21.15.27:0/1533535213 shutdown_connections 2024-09-19T08:02:19.262 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.672+0000 7f2bada8d640 1 --2- 172.21.15.27:0/1533535213 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2b94039260 0x7f2b9403b720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:19.263 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.672+0000 7f2bada8d640 1 --2- 172.21.15.27:0/1533535213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ba807de90 0x7f2ba819d8a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:19.263 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.672+0000 7f2bada8d640 1 -- 172.21.15.27:0/1533535213 >> 172.21.15.27:0/1533535213 conn(0x7f2ba8102db0 msgr2=0x7f2ba81039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:19.263 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.673+0000 7f2bada8d640 1 -- 172.21.15.27:0/1533535213 shutdown_connections 2024-09-19T08:02:19.263 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:18.673+0000 7f2bada8d640 1 -- 172.21.15.27:0/1533535213 wait complete. 2024-09-19T08:02:19.264 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:02:19.264 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout disabled 2024-09-19T08:02:19.271 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:02:19.271 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-09-19T08:02:19.271 INFO:teuthology.orchestra.run.smithi027.stdout:firewalld.service is not enabled 2024-09-19T08:02:19.272 INFO:teuthology.orchestra.run.smithi027.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T08:02:19.273 INFO:teuthology.orchestra.run.smithi027.stdout:Ceph Dashboard is now available at: 2024-09-19T08:02:19.273 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:02:19.273 INFO:teuthology.orchestra.run.smithi027.stdout: URL: https://smithi027.front.sepia.ceph.com:8443/ 2024-09-19T08:02:19.273 INFO:teuthology.orchestra.run.smithi027.stdout: User: admin 2024-09-19T08:02:19.273 INFO:teuthology.orchestra.run.smithi027.stdout: Password: hd73xjqdeb 2024-09-19T08:02:19.274 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:02:19.274 INFO:teuthology.orchestra.run.smithi027.stdout:Saving cluster configuration to /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config directory 2024-09-19T08:02:20.531 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.640+0000 7f8ec2d5e640 1 Processor -- start 2024-09-19T08:02:20.531 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.640+0000 7f8ec2d5e640 1 -- start start 2024-09-19T08:02:20.531 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.641+0000 7f8ec2d5e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ebc108110 0x7f8ebc10a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:20.531 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.641+0000 7f8ec2d5e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc07be00 con 0x7f8ebc108110 2024-09-19T08:02:20.531 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.641+0000 7f8ec0afa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ebc108110 0x7f8ebc10a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:20.531 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.641+0000 7f8ec0afa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ebc108110 0x7f8ebc10a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41502/0 (socket says 172.21.15.27:41502) 2024-09-19T08:02:20.531 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.641+0000 7f8ec0afa640 1 -- 172.21.15.27:0/3131614235 learned_addr learned my addr 172.21.15.27:0/3131614235 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:20.531 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.641+0000 7f8ec0afa640 1 -- 172.21.15.27:0/3131614235 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ebc10aa40 con 0x7f8ebc108110 2024-09-19T08:02:20.532 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.642+0000 7f8ec0afa640 1 --2- 172.21.15.27:0/3131614235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ebc108110 0x7f8ebc10a500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0009820 tx=0x7f8eb002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ddf332039e30a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:20.532 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.642+0000 7f8ebb7fe640 1 -- 172.21.15.27:0/3131614235 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eb0037070 con 0x7f8ebc108110 2024-09-19T08:02:20.532 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.642+0000 7f8ebb7fe640 1 -- 172.21.15.27:0/3131614235 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8eb0032920 con 0x7f8ebc108110 2024-09-19T08:02:20.532 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.642+0000 7f8ebb7fe640 1 -- 172.21.15.27:0/3131614235 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eb0030810 con 0x7f8ebc108110 2024-09-19T08:02:20.532 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.643+0000 7f8ec2d5e640 1 -- 172.21.15.27:0/3131614235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ebc108110 msgr2=0x7f8ebc10a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:20.532 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.643+0000 7f8ec2d5e640 1 --2- 172.21.15.27:0/3131614235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ebc108110 0x7f8ebc10a500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0009820 tx=0x7f8eb002a270 comp rx=0 tx=0).stop 2024-09-19T08:02:20.532 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.643+0000 7f8ec2d5e640 1 -- 172.21.15.27:0/3131614235 shutdown_connections 2024-09-19T08:02:20.532 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.643+0000 7f8ec2d5e640 1 --2- 172.21.15.27:0/3131614235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ebc108110 0x7f8ebc10a500 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:20.532 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.643+0000 7f8ec2d5e640 1 -- 172.21.15.27:0/3131614235 >> 172.21.15.27:0/3131614235 conn(0x7f8ebc101cb0 msgr2=0x7f8ebc1040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:20.532 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.643+0000 7f8ec2d5e640 1 -- 172.21.15.27:0/3131614235 shutdown_connections 2024-09-19T08:02:20.532 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.643+0000 7f8ec2d5e640 1 -- 172.21.15.27:0/3131614235 wait complete. 2024-09-19T08:02:20.532 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.643+0000 7f8ec2d5e640 1 Processor -- start 2024-09-19T08:02:20.533 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.643+0000 7f8ec2d5e640 1 -- start start 2024-09-19T08:02:20.533 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.644+0000 7f8ec2d5e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ebc108110 0x7f8ebc19b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:20.533 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.644+0000 7f8ec2d5e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc10ba60 con 0x7f8ebc108110 2024-09-19T08:02:20.533 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.644+0000 7f8ec0afa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ebc108110 0x7f8ebc19b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:20.533 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.644+0000 7f8ec0afa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ebc108110 0x7f8ebc19b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41508/0 (socket says 172.21.15.27:41508) 2024-09-19T08:02:20.533 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.644+0000 7f8ec0afa640 1 -- 172.21.15.27:0/3112247110 learned_addr learned my addr 172.21.15.27:0/3112247110 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:20.533 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.644+0000 7f8ec0afa640 1 -- 172.21.15.27:0/3112247110 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ebc19bc00 con 0x7f8ebc108110 2024-09-19T08:02:20.533 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.644+0000 7f8ec0afa640 1 --2- 172.21.15.27:0/3112247110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ebc108110 0x7f8ebc19b6c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00097f0 tx=0x7f8eb00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:20.533 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.644+0000 7f8eb9ffb640 1 -- 172.21.15.27:0/3112247110 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eb0037040 con 0x7f8ebc108110 2024-09-19T08:02:20.533 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.644+0000 7f8eb9ffb640 1 -- 172.21.15.27:0/3112247110 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8eb0030c40 con 0x7f8ebc108110 2024-09-19T08:02:20.533 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.644+0000 7f8ec2d5e640 1 -- 172.21.15.27:0/3112247110 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ebc19be90 con 0x7f8ebc108110 2024-09-19T08:02:20.533 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.644+0000 7f8eb9ffb640 1 -- 172.21.15.27:0/3112247110 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eb003a5d0 con 0x7f8ebc108110 2024-09-19T08:02:20.533 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.644+0000 7f8ec2d5e640 1 -- 172.21.15.27:0/3112247110 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ebc19eb80 con 0x7f8ebc108110 2024-09-19T08:02:20.534 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.645+0000 7f8eb9ffb640 1 -- 172.21.15.27:0/3112247110 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f8eb003b3f0 con 0x7f8ebc108110 2024-09-19T08:02:20.534 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.645+0000 7f8ec2d5e640 1 -- 172.21.15.27:0/3112247110 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ebc108570 con 0x7f8ebc108110 2024-09-19T08:02:20.534 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.646+0000 7f8eb9ffb640 1 --2- 172.21.15.27:0/3112247110 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8eac039260 0x7f8eac03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:20.534 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.646+0000 7f8eb9ffb640 1 -- 172.21.15.27:0/3112247110 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8eb006c880 con 0x7f8ebc108110 2024-09-19T08:02:20.534 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.646+0000 7f8ebbfff640 1 --2- 172.21.15.27:0/3112247110 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8eac039260 0x7f8eac03b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:20.534 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.646+0000 7f8ebbfff640 1 --2- 172.21.15.27:0/3112247110 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8eac039260 0x7f8eac03b720 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80098c0 tx=0x7f8ea8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:20.534 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.650+0000 7f8eb9ffb640 1 -- 172.21.15.27:0/3112247110 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8eb003b6e0 con 0x7f8ebc108110 2024-09-19T08:02:20.534 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.721+0000 7f8eb9ffb640 1 -- 172.21.15.27:0/3112247110 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f8eb003a7c0 con 0x7f8ebc108110 2024-09-19T08:02:20.534 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.923+0000 7f8ec2d5e640 1 -- 172.21.15.27:0/3112247110 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f8ebc19ed50 con 0x7f8ebc108110 2024-09-19T08:02:20.534 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.925+0000 7f8eb9ffb640 1 -- 172.21.15.27:0/3112247110 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f8eb00701d0 con 0x7f8ebc108110 2024-09-19T08:02:20.534 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T08:02:20.534 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.927+0000 7f8ec2d5e640 1 -- 172.21.15.27:0/3112247110 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8eac039260 msgr2=0x7f8eac03b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:20.534 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.927+0000 7f8ec2d5e640 1 --2- 172.21.15.27:0/3112247110 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8eac039260 0x7f8eac03b720 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80098c0 tx=0x7f8ea8006db0 comp rx=0 tx=0).stop 2024-09-19T08:02:20.535 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.927+0000 7f8ec2d5e640 1 -- 172.21.15.27:0/3112247110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ebc108110 msgr2=0x7f8ebc19b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:20.535 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.927+0000 7f8ec2d5e640 1 --2- 172.21.15.27:0/3112247110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ebc108110 0x7f8ebc19b6c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00097f0 tx=0x7f8eb00327b0 comp rx=0 tx=0).stop 2024-09-19T08:02:20.535 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.927+0000 7f8ec2d5e640 1 -- 172.21.15.27:0/3112247110 shutdown_connections 2024-09-19T08:02:20.535 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.927+0000 7f8ec2d5e640 1 --2- 172.21.15.27:0/3112247110 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8eac039260 0x7f8eac03b720 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:20.535 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.927+0000 7f8ec2d5e640 1 --2- 172.21.15.27:0/3112247110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ebc108110 0x7f8ebc19b6c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:20.535 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.927+0000 7f8ec2d5e640 1 -- 172.21.15.27:0/3112247110 >> 172.21.15.27:0/3112247110 conn(0x7f8ebc101cb0 msgr2=0x7f8ebc1028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:20.535 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.928+0000 7f8ec2d5e640 1 -- 172.21.15.27:0/3112247110 shutdown_connections 2024-09-19T08:02:20.535 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-19T08:02:19.928+0000 7f8ec2d5e640 1 -- 172.21.15.27:0/3112247110 wait complete. 2024-09-19T08:02:20.535 INFO:teuthology.orchestra.run.smithi027.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T08:02:20.535 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:02:20.535 INFO:teuthology.orchestra.run.smithi027.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:02:20.535 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:02:20.535 INFO:teuthology.orchestra.run.smithi027.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T08:02:20.535 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:02:20.536 INFO:teuthology.orchestra.run.smithi027.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T08:02:20.536 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:02:20.536 INFO:teuthology.orchestra.run.smithi027.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T08:02:20.536 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:02:20.536 INFO:teuthology.orchestra.run.smithi027.stdout: ceph telemetry on 2024-09-19T08:02:20.536 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:02:20.536 INFO:teuthology.orchestra.run.smithi027.stdout:For more information see: 2024-09-19T08:02:20.536 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:02:20.536 INFO:teuthology.orchestra.run.smithi027.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T08:02:20.536 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:02:20.536 INFO:teuthology.orchestra.run.smithi027.stdout:Bootstrap complete. 2024-09-19T08:02:20.580 INFO:tasks.cephadm:Fetching config... 2024-09-19T08:02:20.581 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-19T08:02:20.581 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T08:02:20.599 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T08:02:20.599 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-19T08:02:20.599 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T08:02:20.656 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T08:02:20.656 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-19T08:02:20.656 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T08:02:20.724 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T08:02:20.724 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-19T08:02:20.724 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T08:02:20.782 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T08:02:20.782 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDORjr1ipTu/+8J4NnLOmsfXyVpZcJkePd/6w7JHjPRp9G8Qi7Mhmf+sL56iOQDET7HABmXh/EoL1W3HNX279P3td7/RXDQg0ibIUKOd9Dj4dVwb2xJjp+BT8pCFFqNcdBAv8rjqGDquDQ+1VdIAEWYiMDAumSPdemY5yIfRdueehGQ0q+W8zdsjZ6sJG3CZ6lG6Ha5GkXTgf98xvLj2doodLwul5SpqdnomstcYtr950GVhmurvFOWJnUuJFCoq2PMwDtGPCYGkD9YxBpArV/czVGwjdscV9+o3/MZ4e8CYJq4o13Nf5BkrJ8IN3/7GsG7LjAF729ypXr8gCNyz/Q3/QlO5rg1t9d84B69pOU7TjWJYIpCru1mWk70sV80+2JKSgAGJOs/A3FJttCGrGwaegt2mTf76+KZR4tCkHA8urOQR6JyGEBV1ILy8OgMMoFXfys4fDlhucmmZmq5c2wKQGRriISdlh5X8Cst2XlKtV2T4VXrBkOdNt/tZrxHs+0= ceph-35b531b0-765d-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:02:20.819 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:20 smithi027 ceph-mon[31209]: mgrmap e13: x(active, since 6s) 2024-09-19T08:02:20.819 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:20 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3112247110' entity='client.admin' 2024-09-19T08:02:20.855 INFO:teuthology.orchestra.run.smithi027.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDORjr1ipTu/+8J4NnLOmsfXyVpZcJkePd/6w7JHjPRp9G8Qi7Mhmf+sL56iOQDET7HABmXh/EoL1W3HNX279P3td7/RXDQg0ibIUKOd9Dj4dVwb2xJjp+BT8pCFFqNcdBAv8rjqGDquDQ+1VdIAEWYiMDAumSPdemY5yIfRdueehGQ0q+W8zdsjZ6sJG3CZ6lG6Ha5GkXTgf98xvLj2doodLwul5SpqdnomstcYtr950GVhmurvFOWJnUuJFCoq2PMwDtGPCYGkD9YxBpArV/czVGwjdscV9+o3/MZ4e8CYJq4o13Nf5BkrJ8IN3/7GsG7LjAF729ypXr8gCNyz/Q3/QlO5rg1t9d84B69pOU7TjWJYIpCru1mWk70sV80+2JKSgAGJOs/A3FJttCGrGwaegt2mTf76+KZR4tCkHA8urOQR6JyGEBV1ILy8OgMMoFXfys4fDlhucmmZmq5c2wKQGRriISdlh5X8Cst2XlKtV2T4VXrBkOdNt/tZrxHs+0= ceph-35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:02:20.867 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDORjr1ipTu/+8J4NnLOmsfXyVpZcJkePd/6w7JHjPRp9G8Qi7Mhmf+sL56iOQDET7HABmXh/EoL1W3HNX279P3td7/RXDQg0ibIUKOd9Dj4dVwb2xJjp+BT8pCFFqNcdBAv8rjqGDquDQ+1VdIAEWYiMDAumSPdemY5yIfRdueehGQ0q+W8zdsjZ6sJG3CZ6lG6Ha5GkXTgf98xvLj2doodLwul5SpqdnomstcYtr950GVhmurvFOWJnUuJFCoq2PMwDtGPCYGkD9YxBpArV/czVGwjdscV9+o3/MZ4e8CYJq4o13Nf5BkrJ8IN3/7GsG7LjAF729ypXr8gCNyz/Q3/QlO5rg1t9d84B69pOU7TjWJYIpCru1mWk70sV80+2JKSgAGJOs/A3FJttCGrGwaegt2mTf76+KZR4tCkHA8urOQR6JyGEBV1ILy8OgMMoFXfys4fDlhucmmZmq5c2wKQGRriISdlh5X8Cst2XlKtV2T4VXrBkOdNt/tZrxHs+0= ceph-35b531b0-765d-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:02:20.908 INFO:teuthology.orchestra.run.smithi155.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDORjr1ipTu/+8J4NnLOmsfXyVpZcJkePd/6w7JHjPRp9G8Qi7Mhmf+sL56iOQDET7HABmXh/EoL1W3HNX279P3td7/RXDQg0ibIUKOd9Dj4dVwb2xJjp+BT8pCFFqNcdBAv8rjqGDquDQ+1VdIAEWYiMDAumSPdemY5yIfRdueehGQ0q+W8zdsjZ6sJG3CZ6lG6Ha5GkXTgf98xvLj2doodLwul5SpqdnomstcYtr950GVhmurvFOWJnUuJFCoq2PMwDtGPCYGkD9YxBpArV/czVGwjdscV9+o3/MZ4e8CYJq4o13Nf5BkrJ8IN3/7GsG7LjAF729ypXr8gCNyz/Q3/QlO5rg1t9d84B69pOU7TjWJYIpCru1mWk70sV80+2JKSgAGJOs/A3FJttCGrGwaegt2mTf76+KZR4tCkHA8urOQR6JyGEBV1ILy8OgMMoFXfys4fDlhucmmZmq5c2wKQGRriISdlh5X8Cst2XlKtV2T4VXrBkOdNt/tZrxHs+0= ceph-35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:02:20.921 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDORjr1ipTu/+8J4NnLOmsfXyVpZcJkePd/6w7JHjPRp9G8Qi7Mhmf+sL56iOQDET7HABmXh/EoL1W3HNX279P3td7/RXDQg0ibIUKOd9Dj4dVwb2xJjp+BT8pCFFqNcdBAv8rjqGDquDQ+1VdIAEWYiMDAumSPdemY5yIfRdueehGQ0q+W8zdsjZ6sJG3CZ6lG6Ha5GkXTgf98xvLj2doodLwul5SpqdnomstcYtr950GVhmurvFOWJnUuJFCoq2PMwDtGPCYGkD9YxBpArV/czVGwjdscV9+o3/MZ4e8CYJq4o13Nf5BkrJ8IN3/7GsG7LjAF729ypXr8gCNyz/Q3/QlO5rg1t9d84B69pOU7TjWJYIpCru1mWk70sV80+2JKSgAGJOs/A3FJttCGrGwaegt2mTf76+KZR4tCkHA8urOQR6JyGEBV1ILy8OgMMoFXfys4fDlhucmmZmq5c2wKQGRriISdlh5X8Cst2XlKtV2T4VXrBkOdNt/tZrxHs+0= ceph-35b531b0-765d-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:02:20.962 INFO:teuthology.orchestra.run.smithi203.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDORjr1ipTu/+8J4NnLOmsfXyVpZcJkePd/6w7JHjPRp9G8Qi7Mhmf+sL56iOQDET7HABmXh/EoL1W3HNX279P3td7/RXDQg0ibIUKOd9Dj4dVwb2xJjp+BT8pCFFqNcdBAv8rjqGDquDQ+1VdIAEWYiMDAumSPdemY5yIfRdueehGQ0q+W8zdsjZ6sJG3CZ6lG6Ha5GkXTgf98xvLj2doodLwul5SpqdnomstcYtr950GVhmurvFOWJnUuJFCoq2PMwDtGPCYGkD9YxBpArV/czVGwjdscV9+o3/MZ4e8CYJq4o13Nf5BkrJ8IN3/7GsG7LjAF729ypXr8gCNyz/Q3/QlO5rg1t9d84B69pOU7TjWJYIpCru1mWk70sV80+2JKSgAGJOs/A3FJttCGrGwaegt2mTf76+KZR4tCkHA8urOQR6JyGEBV1ILy8OgMMoFXfys4fDlhucmmZmq5c2wKQGRriISdlh5X8Cst2XlKtV2T4VXrBkOdNt/tZrxHs+0= ceph-35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:02:20.976 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T08:02:21.232 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:02:21.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.723+0000 7f2c31d5b640 1 -- 172.21.15.27:0/847752253 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c2c1015e0 msgr2=0x7f2c2c1019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:21.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.723+0000 7f2c31d5b640 1 --2- 172.21.15.27:0/847752253 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c2c1015e0 0x7f2c2c1019e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c009880 tx=0x7f2c1c02a5d0 comp rx=0 tx=0).stop 2024-09-19T08:02:21.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.723+0000 7f2c31d5b640 1 -- 172.21.15.27:0/847752253 shutdown_connections 2024-09-19T08:02:21.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.723+0000 7f2c31d5b640 1 --2- 172.21.15.27:0/847752253 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c2c1015e0 0x7f2c2c1019e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:21.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.723+0000 7f2c31d5b640 1 -- 172.21.15.27:0/847752253 >> 172.21.15.27:0/847752253 conn(0x7f2c2c0fcd70 msgr2=0x7f2c2c0ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:21.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.723+0000 7f2c31d5b640 1 -- 172.21.15.27:0/847752253 shutdown_connections 2024-09-19T08:02:21.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.723+0000 7f2c31d5b640 1 -- 172.21.15.27:0/847752253 wait complete. 2024-09-19T08:02:21.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.724+0000 7f2c31d5b640 1 Processor -- start 2024-09-19T08:02:21.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.724+0000 7f2c31d5b640 1 -- start start 2024-09-19T08:02:21.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.724+0000 7f2c31d5b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c2c1015e0 0x7f2c2c075eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:21.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.724+0000 7f2c31d5b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c1076f0 con 0x7f2c2c1015e0 2024-09-19T08:02:21.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.724+0000 7f2c2b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c2c1015e0 0x7f2c2c075eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:21.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.725+0000 7f2c2b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c2c1015e0 0x7f2c2c075eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50642/0 (socket says 172.21.15.27:50642) 2024-09-19T08:02:21.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.725+0000 7f2c2b7fe640 1 -- 172.21.15.27:0/3251343947 learned_addr learned my addr 172.21.15.27:0/3251343947 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:21.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.725+0000 7f2c2b7fe640 1 -- 172.21.15.27:0/3251343947 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2c0763f0 con 0x7f2c2c1015e0 2024-09-19T08:02:21.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.725+0000 7f2c2b7fe640 1 --2- 172.21.15.27:0/3251343947 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c2c1015e0 0x7f2c2c075eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c004f60 tx=0x7f2c1c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:21.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.725+0000 7f2c28ff9640 1 -- 172.21.15.27:0/3251343947 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c1c03f070 con 0x7f2c2c1015e0 2024-09-19T08:02:21.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.725+0000 7f2c31d5b640 1 -- 172.21.15.27:0/3251343947 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c2c0745e0 con 0x7f2c2c1015e0 2024-09-19T08:02:21.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.725+0000 7f2c31d5b640 1 -- 172.21.15.27:0/3251343947 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c2c074b20 con 0x7f2c2c1015e0 2024-09-19T08:02:21.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.725+0000 7f2c28ff9640 1 -- 172.21.15.27:0/3251343947 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c1c004d40 con 0x7f2c2c1015e0 2024-09-19T08:02:21.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.725+0000 7f2c28ff9640 1 -- 172.21.15.27:0/3251343947 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c1c035030 con 0x7f2c2c1015e0 2024-09-19T08:02:21.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.726+0000 7f2c28ff9640 1 -- 172.21.15.27:0/3251343947 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f2c1c042070 con 0x7f2c2c1015e0 2024-09-19T08:02:21.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.726+0000 7f2c31d5b640 1 -- 172.21.15.27:0/3251343947 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c2c107e70 con 0x7f2c2c1015e0 2024-09-19T08:02:21.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.727+0000 7f2c28ff9640 1 --2- 172.21.15.27:0/3251343947 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2c14039300 0x7f2c1403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:21.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.727+0000 7f2c28ff9640 1 -- 172.21.15.27:0/3251343947 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2c1c06cff0 con 0x7f2c2c1015e0 2024-09-19T08:02:21.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.727+0000 7f2c2affd640 1 --2- 172.21.15.27:0/3251343947 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2c14039300 0x7f2c1403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:21.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.727+0000 7f2c2affd640 1 --2- 172.21.15.27:0/3251343947 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2c14039300 0x7f2c1403b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2c200098c0 tx=0x7f2c20006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:21.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.732+0000 7f2c28ff9640 1 -- 172.21.15.27:0/3251343947 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2c1c042360 con 0x7f2c2c1015e0 2024-09-19T08:02:21.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.909+0000 7f2c31d5b640 1 -- 172.21.15.27:0/3251343947 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f2c2c1901b0 con 0x7f2c2c1015e0 2024-09-19T08:02:21.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.911+0000 7f2c28ff9640 1 -- 172.21.15.27:0/3251343947 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f2c1c02f300 con 0x7f2c2c1015e0 2024-09-19T08:02:21.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.914+0000 7f2c31d5b640 1 -- 172.21.15.27:0/3251343947 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2c14039300 msgr2=0x7f2c1403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:21.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.914+0000 7f2c31d5b640 1 --2- 172.21.15.27:0/3251343947 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2c14039300 0x7f2c1403b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2c200098c0 tx=0x7f2c20006db0 comp rx=0 tx=0).stop 2024-09-19T08:02:21.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.914+0000 7f2c31d5b640 1 -- 172.21.15.27:0/3251343947 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c2c1015e0 msgr2=0x7f2c2c075eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:21.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.914+0000 7f2c31d5b640 1 --2- 172.21.15.27:0/3251343947 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c2c1015e0 0x7f2c2c075eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c004f60 tx=0x7f2c1c0048f0 comp rx=0 tx=0).stop 2024-09-19T08:02:21.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.914+0000 7f2c31d5b640 1 -- 172.21.15.27:0/3251343947 shutdown_connections 2024-09-19T08:02:21.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.914+0000 7f2c31d5b640 1 --2- 172.21.15.27:0/3251343947 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2c14039300 0x7f2c1403b7c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:21.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.914+0000 7f2c31d5b640 1 --2- 172.21.15.27:0/3251343947 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c2c1015e0 0x7f2c2c075eb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:21.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.914+0000 7f2c31d5b640 1 -- 172.21.15.27:0/3251343947 >> 172.21.15.27:0/3251343947 conn(0x7f2c2c0fcd70 msgr2=0x7f2c2c0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:21.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.914+0000 7f2c31d5b640 1 -- 172.21.15.27:0/3251343947 shutdown_connections 2024-09-19T08:02:21.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:21.914+0000 7f2c31d5b640 1 -- 172.21.15.27:0/3251343947 wait complete. 2024-09-19T08:02:22.471 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T08:02:22.472 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T08:02:22.909 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:02:23.117 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:22 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3251343947' entity='client.admin' 2024-09-19T08:02:23.117 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:22 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:23.117 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:22 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:23.118 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:22 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi027", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:02:23.118 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:22 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:23.118 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:22 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:02:23.118 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:22 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:23.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.697+0000 7ffaddd39640 1 -- 172.21.15.27:0/1368835215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffad8100540 msgr2=0x7ffad8100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:23.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.697+0000 7ffaddd39640 1 --2- 172.21.15.27:0/1368835215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffad8100540 0x7ffad8100940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009880 tx=0x7ffac002a5d0 comp rx=0 tx=0).stop 2024-09-19T08:02:23.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.697+0000 7ffaddd39640 1 -- 172.21.15.27:0/1368835215 shutdown_connections 2024-09-19T08:02:23.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.697+0000 7ffaddd39640 1 --2- 172.21.15.27:0/1368835215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffad8100540 0x7ffad8100940 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:23.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.697+0000 7ffaddd39640 1 -- 172.21.15.27:0/1368835215 >> 172.21.15.27:0/1368835215 conn(0x7ffad80fbcd0 msgr2=0x7ffad80fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:23.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.697+0000 7ffaddd39640 1 -- 172.21.15.27:0/1368835215 shutdown_connections 2024-09-19T08:02:23.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.697+0000 7ffaddd39640 1 -- 172.21.15.27:0/1368835215 wait complete. 2024-09-19T08:02:23.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.698+0000 7ffaddd39640 1 Processor -- start 2024-09-19T08:02:23.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.698+0000 7ffaddd39640 1 -- start start 2024-09-19T08:02:23.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.698+0000 7ffaddd39640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffad8100540 0x7ffad80fdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:23.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.698+0000 7ffaddd39640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ffad81065f0 con 0x7ffad8100540 2024-09-19T08:02:23.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.698+0000 7ffad77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffad8100540 0x7ffad80fdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:23.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.698+0000 7ffad77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffad8100540 0x7ffad80fdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50658/0 (socket says 172.21.15.27:50658) 2024-09-19T08:02:23.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.698+0000 7ffad77fe640 1 -- 172.21.15.27:0/227481572 learned_addr learned my addr 172.21.15.27:0/227481572 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:23.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.698+0000 7ffad77fe640 1 -- 172.21.15.27:0/227481572 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad80fe0d0 con 0x7ffad8100540 2024-09-19T08:02:23.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.699+0000 7ffad77fe640 1 --2- 172.21.15.27:0/227481572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffad8100540 0x7ffad80fdb90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffac0004f60 tx=0x7ffac00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:23.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.699+0000 7ffad4ff9640 1 -- 172.21.15.27:0/227481572 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffac003f070 con 0x7ffad8100540 2024-09-19T08:02:23.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.699+0000 7ffaddd39640 1 -- 172.21.15.27:0/227481572 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad80fc2c0 con 0x7ffad8100540 2024-09-19T08:02:23.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.699+0000 7ffad4ff9640 1 -- 172.21.15.27:0/227481572 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffac0004cc0 con 0x7ffad8100540 2024-09-19T08:02:23.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.699+0000 7ffad4ff9640 1 -- 172.21.15.27:0/227481572 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffac0035030 con 0x7ffad8100540 2024-09-19T08:02:23.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.699+0000 7ffaddd39640 1 -- 172.21.15.27:0/227481572 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad80fc800 con 0x7ffad8100540 2024-09-19T08:02:23.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.700+0000 7ffad4ff9640 1 -- 172.21.15.27:0/227481572 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7ffac0042070 con 0x7ffad8100540 2024-09-19T08:02:23.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.700+0000 7ffaddd39640 1 -- 172.21.15.27:0/227481572 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad8106d70 con 0x7ffad8100540 2024-09-19T08:02:23.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.700+0000 7ffad4ff9640 1 --2- 172.21.15.27:0/227481572 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ffac40392a0 0x7ffac403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:23.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.700+0000 7ffad4ff9640 1 -- 172.21.15.27:0/227481572 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ffac006d090 con 0x7ffad8100540 2024-09-19T08:02:23.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.700+0000 7ffad6ffd640 1 --2- 172.21.15.27:0/227481572 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ffac40392a0 0x7ffac403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:23.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.701+0000 7ffad6ffd640 1 --2- 172.21.15.27:0/227481572 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ffac40392a0 0x7ffac403b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffac80098c0 tx=0x7ffac8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:23.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.705+0000 7ffad4ff9640 1 -- 172.21.15.27:0/227481572 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffac00433b0 con 0x7ffad8100540 2024-09-19T08:02:23.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.885+0000 7ffaddd39640 1 -- 172.21.15.27:0/227481572 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7ffad81902b0 con 0x7ffac40392a0 2024-09-19T08:02:23.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.889+0000 7ffad4ff9640 1 -- 172.21.15.27:0/227481572 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ffad81902b0 con 0x7ffac40392a0 2024-09-19T08:02:23.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.891+0000 7ffaddd39640 1 -- 172.21.15.27:0/227481572 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ffac40392a0 msgr2=0x7ffac403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:23.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.891+0000 7ffaddd39640 1 --2- 172.21.15.27:0/227481572 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ffac40392a0 0x7ffac403b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffac80098c0 tx=0x7ffac8006db0 comp rx=0 tx=0).stop 2024-09-19T08:02:23.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.891+0000 7ffaddd39640 1 -- 172.21.15.27:0/227481572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffad8100540 msgr2=0x7ffad80fdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.891+0000 7ffaddd39640 1 --2- 172.21.15.27:0/227481572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffad8100540 0x7ffad80fdb90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffac0004f60 tx=0x7ffac00048f0 comp rx=0 tx=0).stop 2024-09-19T08:02:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.891+0000 7ffaddd39640 1 -- 172.21.15.27:0/227481572 shutdown_connections 2024-09-19T08:02:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.891+0000 7ffaddd39640 1 --2- 172.21.15.27:0/227481572 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ffac40392a0 0x7ffac403b760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.891+0000 7ffaddd39640 1 --2- 172.21.15.27:0/227481572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffad8100540 0x7ffad80fdb90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.891+0000 7ffaddd39640 1 -- 172.21.15.27:0/227481572 >> 172.21.15.27:0/227481572 conn(0x7ffad80fbcd0 msgr2=0x7ffad8069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.892+0000 7ffaddd39640 1 -- 172.21.15.27:0/227481572 shutdown_connections 2024-09-19T08:02:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:23.892+0000 7ffaddd39640 1 -- 172.21.15.27:0/227481572 wait complete. 2024-09-19T08:02:25.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:24 smithi027 ceph-mon[31209]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:02:25.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:24 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:25.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:24 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:02:25.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:24 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:02:25.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:24 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:02:25.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:24 smithi027 ceph-mon[31209]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-19T08:02:25.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:24 smithi027 ceph-mon[31209]: Updating smithi027:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:02:25.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:24 smithi027 ceph-mon[31209]: Updating smithi027:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:02:25.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:24 smithi027 ceph-mon[31209]: Updating smithi027:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:02:25.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:24 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:25.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:24 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:25.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:24 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:25.333 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi155 2024-09-19T08:02:25.333 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T08:02:25.334 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/etc/ceph/ceph.conf 2024-09-19T08:02:25.354 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T08:02:25.354 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:02:25.412 INFO:tasks.cephadm:Adding host smithi155 to orchestrator... 2024-09-19T08:02:25.413 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph orch host add smithi155 2024-09-19T08:02:25.667 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:02:26.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.091+0000 7f87e85f1640 1 -- 172.21.15.27:0/3672538722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87e0106540 msgr2=0x7f87e0106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:26.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.091+0000 7f87e85f1640 1 --2- 172.21.15.27:0/3672538722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87e0106540 0x7f87e0106920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009810 tx=0x7f87d802a540 comp rx=0 tx=0).stop 2024-09-19T08:02:26.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.091+0000 7f87e85f1640 1 -- 172.21.15.27:0/3672538722 shutdown_connections 2024-09-19T08:02:26.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.091+0000 7f87e85f1640 1 --2- 172.21.15.27:0/3672538722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87e0106540 0x7f87e0106920 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:26.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.091+0000 7f87e85f1640 1 -- 172.21.15.27:0/3672538722 >> 172.21.15.27:0/3672538722 conn(0x7f87e0077310 msgr2=0x7f87e00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:26.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.091+0000 7f87e85f1640 1 -- 172.21.15.27:0/3672538722 shutdown_connections 2024-09-19T08:02:26.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.091+0000 7f87e85f1640 1 -- 172.21.15.27:0/3672538722 wait complete. 2024-09-19T08:02:26.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.092+0000 7f87e85f1640 1 Processor -- start 2024-09-19T08:02:26.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.092+0000 7f87e85f1640 1 -- start start 2024-09-19T08:02:26.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.092+0000 7f87e85f1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87e0106540 0x7f87e0197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:26.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.092+0000 7f87e85f1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f87e010ab70 con 0x7f87e0106540 2024-09-19T08:02:26.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.092+0000 7f87e638d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87e0106540 0x7f87e0197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:26.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.092+0000 7f87e638d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87e0106540 0x7f87e0197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50664/0 (socket says 172.21.15.27:50664) 2024-09-19T08:02:26.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.092+0000 7f87e638d640 1 -- 172.21.15.27:0/2241392251 learned_addr learned my addr 172.21.15.27:0/2241392251 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:26.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.092+0000 7f87e638d640 1 -- 172.21.15.27:0/2241392251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e01984d0 con 0x7f87e0106540 2024-09-19T08:02:26.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.093+0000 7f87e638d640 1 --2- 172.21.15.27:0/2241392251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87e0106540 0x7f87e0197f90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009930 tx=0x7f87d8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:26.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.093+0000 7f87df7fe640 1 -- 172.21.15.27:0/2241392251 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87d8031400 con 0x7f87e0106540 2024-09-19T08:02:26.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.093+0000 7f87e85f1640 1 -- 172.21.15.27:0/2241392251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87e0198760 con 0x7f87e0106540 2024-09-19T08:02:26.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.093+0000 7f87df7fe640 1 -- 172.21.15.27:0/2241392251 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87d80035f0 con 0x7f87e0106540 2024-09-19T08:02:26.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.093+0000 7f87df7fe640 1 -- 172.21.15.27:0/2241392251 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87d803c440 con 0x7f87e0106540 2024-09-19T08:02:26.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.093+0000 7f87e85f1640 1 -- 172.21.15.27:0/2241392251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87e0198bc0 con 0x7f87e0106540 2024-09-19T08:02:26.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.094+0000 7f87df7fe640 1 -- 172.21.15.27:0/2241392251 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f87d8039040 con 0x7f87e0106540 2024-09-19T08:02:26.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.094+0000 7f87e85f1640 1 -- 172.21.15.27:0/2241392251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87e0101bb0 con 0x7f87e0106540 2024-09-19T08:02:26.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.094+0000 7f87df7fe640 1 --2- 172.21.15.27:0/2241392251 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f87c8039300 0x7f87c803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:26.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.094+0000 7f87df7fe640 1 -- 172.21.15.27:0/2241392251 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f87d806d540 con 0x7f87e0106540 2024-09-19T08:02:26.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.094+0000 7f87e5b8c640 1 --2- 172.21.15.27:0/2241392251 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f87c8039300 0x7f87c803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:26.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.094+0000 7f87e5b8c640 1 --2- 172.21.15.27:0/2241392251 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f87c8039300 0x7f87c803b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f87d400ad30 tx=0x7f87d40093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:26.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.099+0000 7f87df7fe640 1 -- 172.21.15.27:0/2241392251 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f87d8040030 con 0x7f87e0106540 2024-09-19T08:02:26.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:26.277+0000 7f87e85f1640 1 -- 172.21.15.27:0/2241392251 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi155", "target": ["mon-mgr", ""]}) -- 0x7f87e01069a0 con 0x7f87c8039300 2024-09-19T08:02:27.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:26 smithi027 ceph-mon[31209]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi155", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:02:28.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:27 smithi027 ceph-mon[31209]: Deploying cephadm binary to smithi155 2024-09-19T08:02:30.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:30.136+0000 7f87df7fe640 1 -- 172.21.15.27:0/2241392251 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f87e01069a0 con 0x7f87c8039300 2024-09-19T08:02:30.137 INFO:teuthology.orchestra.run.smithi027.stdout:Added host 'smithi155' with addr '172.21.15.155' 2024-09-19T08:02:30.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:30.138+0000 7f87e85f1640 1 -- 172.21.15.27:0/2241392251 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f87c8039300 msgr2=0x7f87c803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:30.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:30.138+0000 7f87e85f1640 1 --2- 172.21.15.27:0/2241392251 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f87c8039300 0x7f87c803b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f87d400ad30 tx=0x7f87d40093f0 comp rx=0 tx=0).stop 2024-09-19T08:02:30.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:30.138+0000 7f87e85f1640 1 -- 172.21.15.27:0/2241392251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87e0106540 msgr2=0x7f87e0197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:30.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:30.138+0000 7f87e85f1640 1 --2- 172.21.15.27:0/2241392251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87e0106540 0x7f87e0197f90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009930 tx=0x7f87d8004570 comp rx=0 tx=0).stop 2024-09-19T08:02:30.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:30.138+0000 7f87e85f1640 1 -- 172.21.15.27:0/2241392251 shutdown_connections 2024-09-19T08:02:30.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:30.138+0000 7f87e85f1640 1 --2- 172.21.15.27:0/2241392251 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f87c8039300 0x7f87c803b7c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:30.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:30.138+0000 7f87e85f1640 1 --2- 172.21.15.27:0/2241392251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87e0106540 0x7f87e0197f90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:30.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:30.138+0000 7f87e85f1640 1 -- 172.21.15.27:0/2241392251 >> 172.21.15.27:0/2241392251 conn(0x7f87e0077310 msgr2=0x7f87e00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:30.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:30.138+0000 7f87e85f1640 1 -- 172.21.15.27:0/2241392251 shutdown_connections 2024-09-19T08:02:30.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:30.138+0000 7f87e85f1640 1 -- 172.21.15.27:0/2241392251 wait complete. 2024-09-19T08:02:30.720 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T08:02:30.973 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:02:31.397 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:31 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:31.397 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:31 smithi027 ceph-mon[31209]: Added host smithi155 2024-09-19T08:02:31.397 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:31 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:02:31.397 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:31 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:31.398 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:31 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:31.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.397+0000 7fc561509640 1 -- 172.21.15.27:0/1722349003 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc55c106560 msgr2=0x7fc55c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:31.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.397+0000 7fc561509640 1 --2- 172.21.15.27:0/1722349003 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc55c106560 0x7fc55c106940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009880 tx=0x7fc54c02a5d0 comp rx=0 tx=0).stop 2024-09-19T08:02:31.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.397+0000 7fc561509640 1 -- 172.21.15.27:0/1722349003 shutdown_connections 2024-09-19T08:02:31.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.397+0000 7fc561509640 1 --2- 172.21.15.27:0/1722349003 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc55c106560 0x7fc55c106940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:31.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.397+0000 7fc561509640 1 -- 172.21.15.27:0/1722349003 >> 172.21.15.27:0/1722349003 conn(0x7fc55c0fc1b0 msgr2=0x7fc55c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:31.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.397+0000 7fc561509640 1 -- 172.21.15.27:0/1722349003 shutdown_connections 2024-09-19T08:02:31.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.397+0000 7fc561509640 1 -- 172.21.15.27:0/1722349003 wait complete. 2024-09-19T08:02:31.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.398+0000 7fc561509640 1 Processor -- start 2024-09-19T08:02:31.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.398+0000 7fc561509640 1 -- start start 2024-09-19T08:02:31.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.398+0000 7fc561509640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc55c106560 0x7fc55c197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:31.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.398+0000 7fc561509640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c10ab90 con 0x7fc55c106560 2024-09-19T08:02:31.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.399+0000 7fc55affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc55c106560 0x7fc55c197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:31.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.399+0000 7fc55affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc55c106560 0x7fc55c197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38198/0 (socket says 172.21.15.27:38198) 2024-09-19T08:02:31.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.399+0000 7fc55affd640 1 -- 172.21.15.27:0/1644188090 learned_addr learned my addr 172.21.15.27:0/1644188090 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:31.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.399+0000 7fc55affd640 1 -- 172.21.15.27:0/1644188090 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55c197640 con 0x7fc55c106560 2024-09-19T08:02:31.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.399+0000 7fc55affd640 1 --2- 172.21.15.27:0/1644188090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc55c106560 0x7fc55c197100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009230 tx=0x7fc54c003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:31.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.399+0000 7fc543fff640 1 -- 172.21.15.27:0/1644188090 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc54c03f070 con 0x7fc55c106560 2024-09-19T08:02:31.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.399+0000 7fc561509640 1 -- 172.21.15.27:0/1644188090 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc55c1978d0 con 0x7fc55c106560 2024-09-19T08:02:31.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.399+0000 7fc543fff640 1 -- 172.21.15.27:0/1644188090 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc54c03bd40 con 0x7fc55c106560 2024-09-19T08:02:31.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.399+0000 7fc543fff640 1 -- 172.21.15.27:0/1644188090 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc54c035030 con 0x7fc55c106560 2024-09-19T08:02:31.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.399+0000 7fc561509640 1 -- 172.21.15.27:0/1644188090 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc55c19b9d0 con 0x7fc55c106560 2024-09-19T08:02:31.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.400+0000 7fc543fff640 1 -- 172.21.15.27:0/1644188090 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc54c042070 con 0x7fc55c106560 2024-09-19T08:02:31.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.400+0000 7fc561509640 1 -- 172.21.15.27:0/1644188090 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc55c101bd0 con 0x7fc55c106560 2024-09-19T08:02:31.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.400+0000 7fc543fff640 1 --2- 172.21.15.27:0/1644188090 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc5440392a0 0x7fc54403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:31.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.401+0000 7fc543fff640 1 -- 172.21.15.27:0/1644188090 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc54c06cfd0 con 0x7fc55c106560 2024-09-19T08:02:31.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.401+0000 7fc55a7fc640 1 --2- 172.21.15.27:0/1644188090 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc5440392a0 0x7fc54403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:31.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.401+0000 7fc55a7fc640 1 --2- 172.21.15.27:0/1644188090 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc5440392a0 0x7fc54403b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc5500098c0 tx=0x7fc550006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:31.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.405+0000 7fc543fff640 1 -- 172.21.15.27:0/1644188090 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc54c03a890 con 0x7fc55c106560 2024-09-19T08:02:31.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.587+0000 7fc561509640 1 -- 172.21.15.27:0/1644188090 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc55c198460 con 0x7fc5440392a0 2024-09-19T08:02:31.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.588+0000 7fc543fff640 1 -- 172.21.15.27:0/1644188090 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7fc55c198460 con 0x7fc5440392a0 2024-09-19T08:02:31.589 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:02:31.589 INFO:teuthology.orchestra.run.smithi027.stdout:[{"addr": "172.21.15.27", "hostname": "smithi027", "labels": [], "status": ""}, {"addr": "172.21.15.155", "hostname": "smithi155", "labels": [], "status": ""}] 2024-09-19T08:02:31.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.590+0000 7fc561509640 1 -- 172.21.15.27:0/1644188090 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc5440392a0 msgr2=0x7fc54403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:31.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.590+0000 7fc561509640 1 --2- 172.21.15.27:0/1644188090 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc5440392a0 0x7fc54403b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc5500098c0 tx=0x7fc550006db0 comp rx=0 tx=0).stop 2024-09-19T08:02:31.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.590+0000 7fc561509640 1 -- 172.21.15.27:0/1644188090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc55c106560 msgr2=0x7fc55c197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:31.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.590+0000 7fc561509640 1 --2- 172.21.15.27:0/1644188090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc55c106560 0x7fc55c197100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009230 tx=0x7fc54c003d80 comp rx=0 tx=0).stop 2024-09-19T08:02:31.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.590+0000 7fc561509640 1 -- 172.21.15.27:0/1644188090 shutdown_connections 2024-09-19T08:02:31.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.590+0000 7fc561509640 1 --2- 172.21.15.27:0/1644188090 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc5440392a0 0x7fc54403b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:31.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.590+0000 7fc561509640 1 --2- 172.21.15.27:0/1644188090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc55c106560 0x7fc55c197100 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:31.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.590+0000 7fc561509640 1 -- 172.21.15.27:0/1644188090 >> 172.21.15.27:0/1644188090 conn(0x7fc55c0fc1b0 msgr2=0x7fc55c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:31.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.591+0000 7fc561509640 1 -- 172.21.15.27:0/1644188090 shutdown_connections 2024-09-19T08:02:31.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:31.591+0000 7fc561509640 1 -- 172.21.15.27:0/1644188090 wait complete. 2024-09-19T08:02:32.163 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi203 2024-09-19T08:02:32.163 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T08:02:32.163 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/etc/ceph/ceph.conf 2024-09-19T08:02:32.182 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T08:02:32.182 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:02:32.243 INFO:tasks.cephadm:Adding host smithi203 to orchestrator... 2024-09-19T08:02:32.243 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph orch host add smithi203 2024-09-19T08:02:32.498 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:02:32.736 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:32 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:32.736 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:32 smithi027 ceph-mon[31209]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:02:32.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.923+0000 7f2e4ad15640 1 -- 172.21.15.27:0/2675391581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e44107660 msgr2=0x7f2e44107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:32.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.923+0000 7f2e4ad15640 1 --2- 172.21.15.27:0/2675391581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e44107660 0x7f2e44107a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2e38009880 tx=0x7f2e3802a5d0 comp rx=0 tx=0).stop 2024-09-19T08:02:32.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.923+0000 7f2e4ad15640 1 -- 172.21.15.27:0/2675391581 shutdown_connections 2024-09-19T08:02:32.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.923+0000 7f2e4ad15640 1 --2- 172.21.15.27:0/2675391581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e44107660 0x7f2e44107a40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:32.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.923+0000 7f2e4ad15640 1 -- 172.21.15.27:0/2675391581 >> 172.21.15.27:0/2675391581 conn(0x7f2e440fd2b0 msgr2=0x7f2e440ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:32.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.923+0000 7f2e4ad15640 1 -- 172.21.15.27:0/2675391581 shutdown_connections 2024-09-19T08:02:32.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.923+0000 7f2e4ad15640 1 -- 172.21.15.27:0/2675391581 wait complete. 2024-09-19T08:02:32.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.924+0000 7f2e4ad15640 1 Processor -- start 2024-09-19T08:02:32.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.924+0000 7f2e4ad15640 1 -- start start 2024-09-19T08:02:32.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.924+0000 7f2e4ad15640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e44107660 0x7f2e440744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:32.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.924+0000 7f2e4ad15640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4410bc90 con 0x7f2e44107660 2024-09-19T08:02:32.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.924+0000 7f2e48ab1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e44107660 0x7f2e440744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:32.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.924+0000 7f2e48ab1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e44107660 0x7f2e440744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38214/0 (socket says 172.21.15.27:38214) 2024-09-19T08:02:32.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.924+0000 7f2e48ab1640 1 -- 172.21.15.27:0/455135354 learned_addr learned my addr 172.21.15.27:0/455135354 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:32.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.924+0000 7f2e48ab1640 1 -- 172.21.15.27:0/455135354 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e440763e0 con 0x7f2e44107660 2024-09-19T08:02:32.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.924+0000 7f2e48ab1640 1 --2- 172.21.15.27:0/455135354 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e44107660 0x7f2e440744f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2e38009230 tx=0x7f2e38003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:32.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.925+0000 7f2e41ffb640 1 -- 172.21.15.27:0/455135354 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e3803f070 con 0x7f2e44107660 2024-09-19T08:02:32.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.925+0000 7f2e41ffb640 1 -- 172.21.15.27:0/455135354 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e3803bc80 con 0x7f2e44107660 2024-09-19T08:02:32.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.925+0000 7f2e4ad15640 1 -- 172.21.15.27:0/455135354 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e44074a30 con 0x7f2e44107660 2024-09-19T08:02:32.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.925+0000 7f2e41ffb640 1 -- 172.21.15.27:0/455135354 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e38035030 con 0x7f2e44107660 2024-09-19T08:02:32.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.925+0000 7f2e4ad15640 1 -- 172.21.15.27:0/455135354 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e44074ef0 con 0x7f2e44107660 2024-09-19T08:02:32.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.926+0000 7f2e41ffb640 1 -- 172.21.15.27:0/455135354 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f2e38042070 con 0x7f2e44107660 2024-09-19T08:02:32.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.926+0000 7f2e41ffb640 1 --2- 172.21.15.27:0/455135354 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2e340392a0 0x7f2e3403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:32.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.926+0000 7f2e4ad15640 1 -- 172.21.15.27:0/455135354 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e44102cd0 con 0x7f2e44107660 2024-09-19T08:02:32.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.926+0000 7f2e41ffb640 1 -- 172.21.15.27:0/455135354 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2e3806cfd0 con 0x7f2e44107660 2024-09-19T08:02:32.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.926+0000 7f2e43fff640 1 --2- 172.21.15.27:0/455135354 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2e340392a0 0x7f2e3403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:32.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.926+0000 7f2e43fff640 1 --2- 172.21.15.27:0/455135354 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2e340392a0 0x7f2e3403b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2e300098c0 tx=0x7f2e30006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:32.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:32.931+0000 7f2e41ffb640 1 -- 172.21.15.27:0/455135354 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2e380372d0 con 0x7f2e44107660 2024-09-19T08:02:33.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:33.111+0000 7f2e4ad15640 1 -- 172.21.15.27:0/455135354 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi203", "target": ["mon-mgr", ""]}) -- 0x7f2e44075a90 con 0x7f2e340392a0 2024-09-19T08:02:34.147 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:33 smithi027 ceph-mon[31209]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:34.147 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:33 smithi027 ceph-mon[31209]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi203", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:02:35.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:35 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:35.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:35 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:35.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:35 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:35.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:35 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:35.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:35 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi155", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:02:35.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:35 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:02:35.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:35 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:02:35.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:35 smithi027 ceph-mon[31209]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-19T08:02:35.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:35 smithi027 ceph-mon[31209]: Deploying cephadm binary to smithi203 2024-09-19T08:02:35.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:35 smithi027 ceph-mon[31209]: Updating smithi155:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:02:35.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:35 smithi027 ceph-mon[31209]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:02:35.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:35 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:35.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:35 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:35.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:35 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:36.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:36 smithi027 ceph-mon[31209]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:36.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:36 smithi027 ceph-mon[31209]: Updating smithi155:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:02:37.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:37.177+0000 7f2e41ffb640 1 -- 172.21.15.27:0/455135354 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f2e44075a90 con 0x7f2e340392a0 2024-09-19T08:02:37.180 INFO:teuthology.orchestra.run.smithi027.stdout:Added host 'smithi203' with addr '172.21.15.203' 2024-09-19T08:02:37.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:37.180+0000 7f2e4ad15640 1 -- 172.21.15.27:0/455135354 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2e340392a0 msgr2=0x7f2e3403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:37.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:37.180+0000 7f2e4ad15640 1 --2- 172.21.15.27:0/455135354 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2e340392a0 0x7f2e3403b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2e300098c0 tx=0x7f2e30006db0 comp rx=0 tx=0).stop 2024-09-19T08:02:37.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:37.180+0000 7f2e4ad15640 1 -- 172.21.15.27:0/455135354 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e44107660 msgr2=0x7f2e440744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:37.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:37.180+0000 7f2e4ad15640 1 --2- 172.21.15.27:0/455135354 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e44107660 0x7f2e440744f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2e38009230 tx=0x7f2e38003d40 comp rx=0 tx=0).stop 2024-09-19T08:02:37.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:37.180+0000 7f2e4ad15640 1 -- 172.21.15.27:0/455135354 shutdown_connections 2024-09-19T08:02:37.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:37.180+0000 7f2e4ad15640 1 --2- 172.21.15.27:0/455135354 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2e340392a0 0x7f2e3403b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:37.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:37.180+0000 7f2e4ad15640 1 --2- 172.21.15.27:0/455135354 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e44107660 0x7f2e440744f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:37.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:37.180+0000 7f2e4ad15640 1 -- 172.21.15.27:0/455135354 >> 172.21.15.27:0/455135354 conn(0x7f2e440fd2b0 msgr2=0x7f2e440fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:37.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:37.180+0000 7f2e4ad15640 1 -- 172.21.15.27:0/455135354 shutdown_connections 2024-09-19T08:02:37.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:37.180+0000 7f2e4ad15640 1 -- 172.21.15.27:0/455135354 wait complete. 2024-09-19T08:02:37.773 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T08:02:38.025 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:02:38.420 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:38 smithi027 ceph-mon[31209]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:38.420 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:38 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:38.421 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:38 smithi027 ceph-mon[31209]: Added host smithi203 2024-09-19T08:02:38.421 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:38 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:02:38.421 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:38 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:38.421 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:38 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:38.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.503+0000 7f98d8514640 1 -- 172.21.15.27:0/2313612255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98d0106560 msgr2=0x7f98d0106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:38.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.503+0000 7f98d8514640 1 --2- 172.21.15.27:0/2313612255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98d0106560 0x7f98d0106940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f98cc009880 tx=0x7f98cc02a5d0 comp rx=0 tx=0).stop 2024-09-19T08:02:38.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.504+0000 7f98d8514640 1 -- 172.21.15.27:0/2313612255 shutdown_connections 2024-09-19T08:02:38.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.504+0000 7f98d8514640 1 --2- 172.21.15.27:0/2313612255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98d0106560 0x7f98d0106940 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:38.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.504+0000 7f98d8514640 1 -- 172.21.15.27:0/2313612255 >> 172.21.15.27:0/2313612255 conn(0x7f98d00fc1b0 msgr2=0x7f98d00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:38.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.504+0000 7f98d8514640 1 -- 172.21.15.27:0/2313612255 shutdown_connections 2024-09-19T08:02:38.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.504+0000 7f98d8514640 1 -- 172.21.15.27:0/2313612255 wait complete. 2024-09-19T08:02:38.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.504+0000 7f98d8514640 1 Processor -- start 2024-09-19T08:02:38.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.504+0000 7f98d8514640 1 -- start start 2024-09-19T08:02:38.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.504+0000 7f98d8514640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98d0106560 0x7f98d0197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:38.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.504+0000 7f98d8514640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f98d010ab90 con 0x7f98d0106560 2024-09-19T08:02:38.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.505+0000 7f98d62b0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98d0106560 0x7f98d0197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:38.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.505+0000 7f98d62b0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98d0106560 0x7f98d0197160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38228/0 (socket says 172.21.15.27:38228) 2024-09-19T08:02:38.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.505+0000 7f98d62b0640 1 -- 172.21.15.27:0/2320458889 learned_addr learned my addr 172.21.15.27:0/2320458889 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:38.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.505+0000 7f98d62b0640 1 -- 172.21.15.27:0/2320458889 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d01976a0 con 0x7f98d0106560 2024-09-19T08:02:38.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.505+0000 7f98d62b0640 1 --2- 172.21.15.27:0/2320458889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98d0106560 0x7f98d0197160 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f98cc009230 tx=0x7f98cc003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:38.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.505+0000 7f98c77fe640 1 -- 172.21.15.27:0/2320458889 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98cc03f070 con 0x7f98d0106560 2024-09-19T08:02:38.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.505+0000 7f98c77fe640 1 -- 172.21.15.27:0/2320458889 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98cc03bc80 con 0x7f98d0106560 2024-09-19T08:02:38.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.505+0000 7f98d8514640 1 -- 172.21.15.27:0/2320458889 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98d0197930 con 0x7f98d0106560 2024-09-19T08:02:38.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.505+0000 7f98c77fe640 1 -- 172.21.15.27:0/2320458889 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98cc035030 con 0x7f98d0106560 2024-09-19T08:02:38.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.505+0000 7f98d8514640 1 -- 172.21.15.27:0/2320458889 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98d019ba30 con 0x7f98d0106560 2024-09-19T08:02:38.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.506+0000 7f98c77fe640 1 -- 172.21.15.27:0/2320458889 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f98cc042070 con 0x7f98d0106560 2024-09-19T08:02:38.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.506+0000 7f98d8514640 1 -- 172.21.15.27:0/2320458889 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98d0101bd0 con 0x7f98d0106560 2024-09-19T08:02:38.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.506+0000 7f98c77fe640 1 --2- 172.21.15.27:0/2320458889 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f98bc039300 0x7f98bc03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:38.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.506+0000 7f98c77fe640 1 -- 172.21.15.27:0/2320458889 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f98cc06cfb0 con 0x7f98d0106560 2024-09-19T08:02:38.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.507+0000 7f98d5aaf640 1 --2- 172.21.15.27:0/2320458889 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f98bc039300 0x7f98bc03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:38.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.507+0000 7f98d5aaf640 1 --2- 172.21.15.27:0/2320458889 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f98bc039300 0x7f98bc03b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f98c00098c0 tx=0x7f98c0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:38.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.511+0000 7f98c77fe640 1 -- 172.21.15.27:0/2320458889 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f98cc0372d0 con 0x7f98d0106560 2024-09-19T08:02:38.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.694+0000 7f98d8514640 1 -- 172.21.15.27:0/2320458889 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f98d01984c0 con 0x7f98bc039300 2024-09-19T08:02:38.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.696+0000 7f98c77fe640 1 -- 172.21.15.27:0/2320458889 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f98d01984c0 con 0x7f98bc039300 2024-09-19T08:02:38.696 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:02:38.696 INFO:teuthology.orchestra.run.smithi027.stdout:[{"addr": "172.21.15.27", "hostname": "smithi027", "labels": [], "status": ""}, {"addr": "172.21.15.155", "hostname": "smithi155", "labels": [], "status": ""}, {"addr": "172.21.15.203", "hostname": "smithi203", "labels": [], "status": ""}] 2024-09-19T08:02:38.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.698+0000 7f98d8514640 1 -- 172.21.15.27:0/2320458889 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f98bc039300 msgr2=0x7f98bc03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:38.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.698+0000 7f98d8514640 1 --2- 172.21.15.27:0/2320458889 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f98bc039300 0x7f98bc03b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f98c00098c0 tx=0x7f98c0006db0 comp rx=0 tx=0).stop 2024-09-19T08:02:38.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.698+0000 7f98d8514640 1 -- 172.21.15.27:0/2320458889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98d0106560 msgr2=0x7f98d0197160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:38.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.698+0000 7f98d8514640 1 --2- 172.21.15.27:0/2320458889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98d0106560 0x7f98d0197160 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f98cc009230 tx=0x7f98cc003d40 comp rx=0 tx=0).stop 2024-09-19T08:02:38.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.698+0000 7f98d8514640 1 -- 172.21.15.27:0/2320458889 shutdown_connections 2024-09-19T08:02:38.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.698+0000 7f98d8514640 1 --2- 172.21.15.27:0/2320458889 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f98bc039300 0x7f98bc03b7c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:38.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.698+0000 7f98d8514640 1 --2- 172.21.15.27:0/2320458889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98d0106560 0x7f98d0197160 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:38.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.698+0000 7f98d8514640 1 -- 172.21.15.27:0/2320458889 >> 172.21.15.27:0/2320458889 conn(0x7f98d00fc1b0 msgr2=0x7f98d0069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:38.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.698+0000 7f98d8514640 1 -- 172.21.15.27:0/2320458889 shutdown_connections 2024-09-19T08:02:38.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:38.698+0000 7f98d8514640 1 -- 172.21.15.27:0/2320458889 wait complete. 2024-09-19T08:02:39.329 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T08:02:39.329 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T08:02:39.581 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:02:39.699 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:39 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:39.700 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:39 smithi027 ceph-mon[31209]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:02:40.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.009+0000 7f07c5a3f640 1 -- 172.21.15.27:0/1227950074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07c0106540 msgr2=0x7f07c0106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:40.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.009+0000 7f07c5a3f640 1 --2- 172.21.15.27:0/1227950074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07c0106540 0x7f07c0106920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009880 tx=0x7f07b002a5d0 comp rx=0 tx=0).stop 2024-09-19T08:02:40.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.009+0000 7f07c5a3f640 1 -- 172.21.15.27:0/1227950074 shutdown_connections 2024-09-19T08:02:40.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.009+0000 7f07c5a3f640 1 --2- 172.21.15.27:0/1227950074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07c0106540 0x7f07c0106920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:40.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.009+0000 7f07c5a3f640 1 -- 172.21.15.27:0/1227950074 >> 172.21.15.27:0/1227950074 conn(0x7f07c00fc130 msgr2=0x7f07c00fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:40.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.009+0000 7f07c5a3f640 1 -- 172.21.15.27:0/1227950074 shutdown_connections 2024-09-19T08:02:40.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.009+0000 7f07c5a3f640 1 -- 172.21.15.27:0/1227950074 wait complete. 2024-09-19T08:02:40.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.010+0000 7f07c5a3f640 1 Processor -- start 2024-09-19T08:02:40.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.010+0000 7f07c5a3f640 1 -- start start 2024-09-19T08:02:40.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.010+0000 7f07c5a3f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07c0106540 0x7f07c00fc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:40.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.010+0000 7f07c5a3f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f07c010ab70 con 0x7f07c0106540 2024-09-19T08:02:40.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.010+0000 7f07beffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07c0106540 0x7f07c00fc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:40.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.010+0000 7f07beffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07c0106540 0x7f07c00fc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38250/0 (socket says 172.21.15.27:38250) 2024-09-19T08:02:40.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.010+0000 7f07beffd640 1 -- 172.21.15.27:0/1606600541 learned_addr learned my addr 172.21.15.27:0/1606600541 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:02:40.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.010+0000 7f07beffd640 1 -- 172.21.15.27:0/1606600541 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c00fe4d0 con 0x7f07c0106540 2024-09-19T08:02:40.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.011+0000 7f07beffd640 1 --2- 172.21.15.27:0/1606600541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07c0106540 0x7f07c00fc5e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009230 tx=0x7f07b0003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:40.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.011+0000 7f07c4a3d640 1 -- 172.21.15.27:0/1606600541 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07b003f070 con 0x7f07c0106540 2024-09-19T08:02:40.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.011+0000 7f07c4a3d640 1 -- 172.21.15.27:0/1606600541 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07b003bc80 con 0x7f07c0106540 2024-09-19T08:02:40.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.011+0000 7f07c5a3f640 1 -- 172.21.15.27:0/1606600541 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c00fcb20 con 0x7f07c0106540 2024-09-19T08:02:40.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.011+0000 7f07c4a3d640 1 -- 172.21.15.27:0/1606600541 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07b0035030 con 0x7f07c0106540 2024-09-19T08:02:40.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.011+0000 7f07c5a3f640 1 -- 172.21.15.27:0/1606600541 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c00fcfe0 con 0x7f07c0106540 2024-09-19T08:02:40.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.012+0000 7f07c4a3d640 1 -- 172.21.15.27:0/1606600541 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f07b0042070 con 0x7f07c0106540 2024-09-19T08:02:40.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.012+0000 7f07c5a3f640 1 -- 172.21.15.27:0/1606600541 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c0101bb0 con 0x7f07c0106540 2024-09-19T08:02:40.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.012+0000 7f07c4a3d640 1 --2- 172.21.15.27:0/1606600541 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f07ac039300 0x7f07ac03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:40.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.012+0000 7f07c4a3d640 1 -- 172.21.15.27:0/1606600541 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f07b006d260 con 0x7f07c0106540 2024-09-19T08:02:40.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.012+0000 7f07b7fff640 1 --2- 172.21.15.27:0/1606600541 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f07ac039300 0x7f07ac03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:40.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.013+0000 7f07b7fff640 1 --2- 172.21.15.27:0/1606600541 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f07ac039300 0x7f07ac03b7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f07a80098c0 tx=0x7f07a8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:40.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.017+0000 7f07c4a3d640 1 -- 172.21.15.27:0/1606600541 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f07b00314c0 con 0x7f07c0106540 2024-09-19T08:02:40.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.201+0000 7f07c5a3f640 1 -- 172.21.15.27:0/1606600541 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f07c00fdb10 con 0x7f07c0106540 2024-09-19T08:02:40.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.531+0000 7f07c4a3d640 1 -- 172.21.15.27:0/1606600541 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f07b003a890 con 0x7f07c0106540 2024-09-19T08:02:40.532 INFO:teuthology.orchestra.run.smithi027.stderr:adjusted tunables profile to default 2024-09-19T08:02:40.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.534+0000 7f07c5a3f640 1 -- 172.21.15.27:0/1606600541 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f07ac039300 msgr2=0x7f07ac03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:40.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.534+0000 7f07c5a3f640 1 --2- 172.21.15.27:0/1606600541 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f07ac039300 0x7f07ac03b7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f07a80098c0 tx=0x7f07a8006db0 comp rx=0 tx=0).stop 2024-09-19T08:02:40.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.534+0000 7f07c5a3f640 1 -- 172.21.15.27:0/1606600541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07c0106540 msgr2=0x7f07c00fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:40.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.534+0000 7f07c5a3f640 1 --2- 172.21.15.27:0/1606600541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07c0106540 0x7f07c00fc5e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009230 tx=0x7f07b0003d40 comp rx=0 tx=0).stop 2024-09-19T08:02:40.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.534+0000 7f07c5a3f640 1 -- 172.21.15.27:0/1606600541 shutdown_connections 2024-09-19T08:02:40.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.534+0000 7f07c5a3f640 1 --2- 172.21.15.27:0/1606600541 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f07ac039300 0x7f07ac03b7c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:40.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.534+0000 7f07c5a3f640 1 --2- 172.21.15.27:0/1606600541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07c0106540 0x7f07c00fc5e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:40.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.534+0000 7f07c5a3f640 1 -- 172.21.15.27:0/1606600541 >> 172.21.15.27:0/1606600541 conn(0x7f07c00fc130 msgr2=0x7f07c0069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:40.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.534+0000 7f07c5a3f640 1 -- 172.21.15.27:0/1606600541 shutdown_connections 2024-09-19T08:02:40.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:02:40.534+0000 7f07c5a3f640 1 -- 172.21.15.27:0/1606600541 wait complete. 2024-09-19T08:02:40.829 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:40 smithi027 ceph-mon[31209]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:40.829 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:40 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1606600541' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T08:02:41.119 INFO:tasks.cephadm:Adding mon.a on smithi027 2024-09-19T08:02:41.119 INFO:tasks.cephadm:Adding mon.b on smithi155 2024-09-19T08:02:41.119 INFO:tasks.cephadm:Adding mon.c on smithi203 2024-09-19T08:02:41.120 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi027:172.21.15.27=a;smithi155:172.21.15.155=b;smithi203:172.21.15.203=c' 2024-09-19T08:02:41.444 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:02:41.491 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:02:42.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:41 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1606600541' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T08:02:42.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:41 smithi027 ceph-mon[31209]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:02:42.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:41 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:42.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:41 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:42.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:41 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:42.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:41 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:42.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:41 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi203", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:02:42.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:41 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:02:42.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:41 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:02:42.036 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.979+0000 7fabb647c640 1 -- 172.21.15.203:0/421087283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabb01020a0 msgr2=0x7fabb0104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:42.036 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.979+0000 7fabb647c640 1 --2- 172.21.15.203:0/421087283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabb01020a0 0x7fabb0104490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faba0009880 tx=0x7faba002a5d0 comp rx=0 tx=0).stop 2024-09-19T08:02:42.036 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.979+0000 7fabb647c640 1 -- 172.21.15.203:0/421087283 shutdown_connections 2024-09-19T08:02:42.036 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.979+0000 7fabb647c640 1 --2- 172.21.15.203:0/421087283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabb01020a0 0x7fabb0104490 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:42.036 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.979+0000 7fabb647c640 1 -- 172.21.15.203:0/421087283 >> 172.21.15.203:0/421087283 conn(0x7fabb00fbc80 msgr2=0x7fabb00fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:42.036 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.979+0000 7fabb647c640 1 -- 172.21.15.203:0/421087283 shutdown_connections 2024-09-19T08:02:42.036 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.979+0000 7fabb647c640 1 -- 172.21.15.203:0/421087283 wait complete. 2024-09-19T08:02:42.036 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.980+0000 7fabb647c640 1 Processor -- start 2024-09-19T08:02:42.036 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.980+0000 7fabb647c640 1 -- start start 2024-09-19T08:02:42.036 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.980+0000 7fabb647c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabb01020a0 0x7fabb0196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:42.037 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.980+0000 7fabb647c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fabb01076b0 con 0x7fabb01020a0 2024-09-19T08:02:42.037 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.980+0000 7fabaffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabb01020a0 0x7fabb0196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:42.037 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.980+0000 7fabaffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabb01020a0 0x7fabb0196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.203:34468/0 (socket says 172.21.15.203:34468) 2024-09-19T08:02:42.037 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.980+0000 7fabaffff640 1 -- 172.21.15.203:0/594214889 learned_addr learned my addr 172.21.15.203:0/594214889 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:02:42.037 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.980+0000 7fabaffff640 1 -- 172.21.15.203:0/594214889 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb0197240 con 0x7fabb01020a0 2024-09-19T08:02:42.037 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.981+0000 7fabaffff640 1 --2- 172.21.15.203:0/594214889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabb01020a0 0x7fabb0196d00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faba0004f60 tx=0x7faba00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:42.037 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.981+0000 7fabad7fa640 1 -- 172.21.15.203:0/594214889 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faba003f070 con 0x7fabb01020a0 2024-09-19T08:02:42.037 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.981+0000 7fabb647c640 1 -- 172.21.15.203:0/594214889 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb0197530 con 0x7fabb01020a0 2024-09-19T08:02:42.037 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.981+0000 7fabad7fa640 1 -- 172.21.15.203:0/594214889 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faba0003ad0 con 0x7fabb01020a0 2024-09-19T08:02:42.037 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.981+0000 7fabad7fa640 1 -- 172.21.15.203:0/594214889 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faba0035030 con 0x7fabb01020a0 2024-09-19T08:02:42.037 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.981+0000 7fabb647c640 1 -- 172.21.15.203:0/594214889 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb019a1b0 con 0x7fabb01020a0 2024-09-19T08:02:42.037 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.982+0000 7fabad7fa640 1 -- 172.21.15.203:0/594214889 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7faba0042070 con 0x7fabb01020a0 2024-09-19T08:02:42.038 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.982+0000 7fabb647c640 1 -- 172.21.15.203:0/594214889 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb0107e30 con 0x7fabb01020a0 2024-09-19T08:02:42.038 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.982+0000 7fabad7fa640 1 --2- 172.21.15.203:0/594214889 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fab980392a0 0x7fab9803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:42.038 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.982+0000 7fabad7fa640 1 -- 172.21.15.203:0/594214889 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7faba006d150 con 0x7fabb01020a0 2024-09-19T08:02:42.038 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.982+0000 7fabaf7fe640 1 --2- 172.21.15.203:0/594214889 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fab980392a0 0x7fab9803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:42.038 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.983+0000 7fabaf7fe640 1 --2- 172.21.15.203:0/594214889 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fab980392a0 0x7fab9803b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faba40098c0 tx=0x7faba4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:42.038 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:41.987+0000 7fabad7fa640 1 -- 172.21.15.203:0/594214889 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faba0039350 con 0x7fabb01020a0 2024-09-19T08:02:42.172 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:42.172+0000 7fabb647c640 1 -- 172.21.15.203:0/594214889 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi027:172.21.15.27=a;smithi155:172.21.15.155=b;smithi203:172.21.15.203=c", "target": ["mon-mgr", ""]}) -- 0x7fabb002d990 con 0x7fab980392a0 2024-09-19T08:02:42.177 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:42.177+0000 7fabad7fa640 1 -- 172.21.15.203:0/594214889 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fabb002d990 con 0x7fab980392a0 2024-09-19T08:02:42.177 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled mon update... 2024-09-19T08:02:42.179 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:42.179+0000 7fabb647c640 1 -- 172.21.15.203:0/594214889 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fab980392a0 msgr2=0x7fab9803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:42.179 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:42.179+0000 7fabb647c640 1 --2- 172.21.15.203:0/594214889 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fab980392a0 0x7fab9803b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faba40098c0 tx=0x7faba4006db0 comp rx=0 tx=0).stop 2024-09-19T08:02:42.179 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:42.179+0000 7fabb647c640 1 -- 172.21.15.203:0/594214889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabb01020a0 msgr2=0x7fabb0196d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:42.179 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:42.179+0000 7fabb647c640 1 --2- 172.21.15.203:0/594214889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabb01020a0 0x7fabb0196d00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faba0004f60 tx=0x7faba00048f0 comp rx=0 tx=0).stop 2024-09-19T08:02:42.179 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:42.179+0000 7fabb647c640 1 -- 172.21.15.203:0/594214889 shutdown_connections 2024-09-19T08:02:42.179 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:42.179+0000 7fabb647c640 1 --2- 172.21.15.203:0/594214889 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fab980392a0 0x7fab9803b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:42.180 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:42.179+0000 7fabb647c640 1 --2- 172.21.15.203:0/594214889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabb01020a0 0x7fabb0196d00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:42.180 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:42.179+0000 7fabb647c640 1 -- 172.21.15.203:0/594214889 >> 172.21.15.203:0/594214889 conn(0x7fabb00fbc80 msgr2=0x7fabb00fc730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:42.180 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:42.179+0000 7fabb647c640 1 -- 172.21.15.203:0/594214889 shutdown_connections 2024-09-19T08:02:42.180 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:42.179+0000 7fabb647c640 1 -- 172.21.15.203:0/594214889 wait complete. 2024-09-19T08:02:42.716 DEBUG:teuthology.orchestra.run.smithi155:mon.b> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T08:02:42.719 DEBUG:teuthology.orchestra.run.smithi203:mon.c> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T08:02:42.721 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:02:42.722 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:02:43.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:42 smithi027 ceph-mon[31209]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:43.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:42 smithi027 ceph-mon[31209]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-19T08:02:43.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:42 smithi027 ceph-mon[31209]: Updating smithi203:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:02:43.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:42 smithi027 ceph-mon[31209]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:02:43.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:42 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:43.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:42 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:43.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:42 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:43.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:42 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:43.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:42 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:02:43.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:42 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:02:43.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:42 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:02:43.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:42 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:43.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:42 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:02:43.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:42 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:02:44.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:43 smithi027 ceph-mon[31209]: Updating smithi203:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:02:44.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:43 smithi027 ceph-mon[31209]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi027:172.21.15.27=a;smithi155:172.21.15.155=b;smithi203:172.21.15.203=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:02:44.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:43 smithi027 ceph-mon[31209]: Saving service mon spec with placement smithi027:172.21.15.27=a;smithi155:172.21.15.155=b;smithi203:172.21.15.203=c;count:3 2024-09-19T08:02:44.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:43 smithi027 ceph-mon[31209]: Deploying daemon mon.c on smithi203 2024-09-19T08:02:44.321 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:02:45.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:44 smithi027 ceph-mon[31209]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:45.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.316+0000 7ff9f6772640 1 -- 172.21.15.203:0/1602877460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9f0106540 msgr2=0x7ff9f0106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:45.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.316+0000 7ff9f6772640 1 --2- 172.21.15.203:0/1602877460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9f0106540 0x7ff9f0106920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0009810 tx=0x7ff9e002a540 comp rx=0 tx=0).stop 2024-09-19T08:02:45.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.316+0000 7ff9f6772640 1 -- 172.21.15.203:0/1602877460 shutdown_connections 2024-09-19T08:02:45.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.316+0000 7ff9f6772640 1 --2- 172.21.15.203:0/1602877460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9f0106540 0x7ff9f0106920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:45.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.316+0000 7ff9f6772640 1 -- 172.21.15.203:0/1602877460 >> 172.21.15.203:0/1602877460 conn(0x7ff9f0077310 msgr2=0x7ff9f00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:45.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.316+0000 7ff9f6772640 1 -- 172.21.15.203:0/1602877460 shutdown_connections 2024-09-19T08:02:45.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.316+0000 7ff9f6772640 1 -- 172.21.15.203:0/1602877460 wait complete. 2024-09-19T08:02:45.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.317+0000 7ff9f6772640 1 Processor -- start 2024-09-19T08:02:45.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.317+0000 7ff9f6772640 1 -- start start 2024-09-19T08:02:45.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.317+0000 7ff9f6772640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9f0106540 0x7ff9f0197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:45.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.317+0000 7ff9f6772640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f010ab70 con 0x7ff9f0106540 2024-09-19T08:02:45.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.317+0000 7ff9effff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9f0106540 0x7ff9f0197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:45.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.317+0000 7ff9effff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9f0106540 0x7ff9f0197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.203:50428/0 (socket says 172.21.15.203:50428) 2024-09-19T08:02:45.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.317+0000 7ff9effff640 1 -- 172.21.15.203:0/2868266184 learned_addr learned my addr 172.21.15.203:0/2868266184 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:02:45.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.318+0000 7ff9effff640 1 -- 172.21.15.203:0/2868266184 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f0197650 con 0x7ff9f0106540 2024-09-19T08:02:45.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.318+0000 7ff9effff640 1 --2- 172.21.15.203:0/2868266184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9f0106540 0x7ff9f0197110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00045e0 tx=0x7ff9e0004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:45.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.318+0000 7ff9ed7fa640 1 -- 172.21.15.203:0/2868266184 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9e0030e70 con 0x7ff9f0106540 2024-09-19T08:02:45.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.318+0000 7ff9ed7fa640 1 -- 172.21.15.203:0/2868266184 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9e00318e0 con 0x7ff9f0106540 2024-09-19T08:02:45.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.318+0000 7ff9f6772640 1 -- 172.21.15.203:0/2868266184 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f01978e0 con 0x7ff9f0106540 2024-09-19T08:02:45.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.318+0000 7ff9ed7fa640 1 -- 172.21.15.203:0/2868266184 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9e00049c0 con 0x7ff9f0106540 2024-09-19T08:02:45.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.318+0000 7ff9f6772640 1 -- 172.21.15.203:0/2868266184 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f019b9e0 con 0x7ff9f0106540 2024-09-19T08:02:45.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.319+0000 7ff9ed7fa640 1 -- 172.21.15.203:0/2868266184 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7ff9e0039040 con 0x7ff9f0106540 2024-09-19T08:02:45.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.319+0000 7ff9f6772640 1 -- 172.21.15.203:0/2868266184 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9f0101bb0 con 0x7ff9f0106540 2024-09-19T08:02:45.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.319+0000 7ff9ed7fa640 1 --2- 172.21.15.203:0/2868266184 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff9d8039300 0x7ff9d803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:45.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.319+0000 7ff9ed7fa640 1 -- 172.21.15.203:0/2868266184 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff9e006d630 con 0x7ff9f0106540 2024-09-19T08:02:45.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.320+0000 7ff9ef7fe640 1 --2- 172.21.15.203:0/2868266184 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff9d8039300 0x7ff9d803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:45.321 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.320+0000 7ff9ef7fe640 1 --2- 172.21.15.203:0/2868266184 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff9d8039300 0x7ff9d803b7c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff9e40098c0 tx=0x7ff9e4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:45.324 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.324+0000 7ff9ed7fa640 1 -- 172.21.15.203:0/2868266184 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff9e0040030 con 0x7ff9f0106540 2024-09-19T08:02:45.580 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.580+0000 7ff9f6772640 1 -- 172.21.15.203:0/2868266184 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff9f0198470 con 0x7ff9f0106540 2024-09-19T08:02:45.580 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.580+0000 7ff9ed7fa640 1 -- 172.21.15.203:0/2868266184 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7ff9e0037d70 con 0x7ff9f0106540 2024-09-19T08:02:45.581 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:02:45.581 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"35b531b0-765d-11ef-bceb-c7b262605968","modified":"2024-09-19T08:01:17.912400Z","created":"2024-09-19T08:01:17.912400Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:02:45.581 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-09-19T08:02:45.583 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.582+0000 7ff9f6772640 1 -- 172.21.15.203:0/2868266184 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff9d8039300 msgr2=0x7ff9d803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:45.583 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.582+0000 7ff9f6772640 1 --2- 172.21.15.203:0/2868266184 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff9d8039300 0x7ff9d803b7c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff9e40098c0 tx=0x7ff9e4006db0 comp rx=0 tx=0).stop 2024-09-19T08:02:45.583 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.582+0000 7ff9f6772640 1 -- 172.21.15.203:0/2868266184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9f0106540 msgr2=0x7ff9f0197110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:45.583 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.582+0000 7ff9f6772640 1 --2- 172.21.15.203:0/2868266184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9f0106540 0x7ff9f0197110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00045e0 tx=0x7ff9e0004610 comp rx=0 tx=0).stop 2024-09-19T08:02:45.583 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.582+0000 7ff9f6772640 1 -- 172.21.15.203:0/2868266184 shutdown_connections 2024-09-19T08:02:45.583 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.582+0000 7ff9f6772640 1 --2- 172.21.15.203:0/2868266184 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff9d8039300 0x7ff9d803b7c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:45.583 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.582+0000 7ff9f6772640 1 --2- 172.21.15.203:0/2868266184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9f0106540 0x7ff9f0197110 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:45.583 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.582+0000 7ff9f6772640 1 -- 172.21.15.203:0/2868266184 >> 172.21.15.203:0/2868266184 conn(0x7ff9f0077310 msgr2=0x7ff9f00696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:45.583 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.583+0000 7ff9f6772640 1 -- 172.21.15.203:0/2868266184 shutdown_connections 2024-09-19T08:02:45.583 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:45.583+0000 7ff9f6772640 1 -- 172.21.15.203:0/2868266184 wait complete. 2024-09-19T08:02:46.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 podman[35178]: 2024-09-19 08:02:46.312361136 +0000 UTC m=+0.016108188 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:02:47.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:46 smithi027 ceph-mon[31209]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:47.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:46 smithi027 ceph-mon[31209]: from='client.? 172.21.15.203:0/2868266184' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:02:47.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 podman[35178]: 2024-09-19 08:02:46.665252907 +0000 UTC m=+0.368999945 container init 0541a1fc7087a177c1c5ca6b4d9081e452993507af6875b6bfa59c1185e2e198 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-c, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T08:02:47.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 podman[35178]: 2024-09-19 08:02:46.668431999 +0000 UTC m=+0.372179043 container start 0541a1fc7087a177c1c5ca6b4d9081e452993507af6875b6bfa59c1185e2e198 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T08:02:47.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T08:02:47.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T08:02:47.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: pidfile_write: ignore empty --pid-file 2024-09-19T08:02:47.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: load: jerasure load: lrc 2024-09-19T08:02:47.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: RocksDB version: 7.9.2 2024-09-19T08:02:47.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Git sha 0 2024-09-19T08:02:47.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T08:02:47.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: DB SUMMARY 2024-09-19T08:02:47.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: DB Session ID: NZRSYRXE7RWP0EWVLQ3R 2024-09-19T08:02:47.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: CURRENT file: CURRENT 2024-09-19T08:02:47.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T08:02:47.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T08:02:47.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-19T08:02:47.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-19T08:02:47.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.error_if_exists: 0 2024-09-19T08:02:47.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.create_if_missing: 0 2024-09-19T08:02:47.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.paranoid_checks: 1 2024-09-19T08:02:47.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T08:02:47.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T08:02:47.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T08:02:47.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.env: 0x5640e28ff940 2024-09-19T08:02:47.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T08:02:47.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.info_log: 0x5640e3f036e0 2024-09-19T08:02:47.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T08:02:47.012 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.statistics: (nil) 2024-09-19T08:02:47.012 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.use_fsync: 0 2024-09-19T08:02:47.012 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_log_file_size: 0 2024-09-19T08:02:47.012 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T08:02:47.012 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T08:02:47.012 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T08:02:47.012 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T08:02:47.012 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.allow_fallocate: 1 2024-09-19T08:02:47.012 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T08:02:47.013 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T08:02:47.013 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.use_direct_reads: 0 2024-09-19T08:02:47.013 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T08:02:47.013 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T08:02:47.013 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.db_log_dir: 2024-09-19T08:02:47.013 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.wal_dir: 2024-09-19T08:02:47.013 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T08:02:47.013 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T08:02:47.013 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T08:02:47.013 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T08:02:47.013 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T08:02:47.013 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T08:02:47.014 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T08:02:47.014 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T08:02:47.014 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.write_buffer_manager: 0x5640e3f12dc0 2024-09-19T08:02:47.014 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T08:02:47.014 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T08:02:47.014 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T08:02:47.014 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T08:02:47.014 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T08:02:47.014 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T08:02:47.014 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T08:02:47.014 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T08:02:47.014 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.unordered_write: 0 2024-09-19T08:02:47.014 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T08:02:47.014 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T08:02:47.015 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T08:02:47.015 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T08:02:47.015 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.row_cache: None 2024-09-19T08:02:47.015 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.wal_filter: None 2024-09-19T08:02:47.015 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T08:02:47.015 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T08:02:47.015 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.two_write_queues: 0 2024-09-19T08:02:47.015 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T08:02:47.015 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.wal_compression: 0 2024-09-19T08:02:47.015 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.atomic_flush: 0 2024-09-19T08:02:47.015 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T08:02:47.015 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T08:02:47.015 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T08:02:47.015 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.log_readahead_size: 0 2024-09-19T08:02:47.015 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T08:02:47.016 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T08:02:47.016 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T08:02:47.016 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T08:02:47.016 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T08:02:47.016 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T08:02:47.016 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T08:02:47.016 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_background_jobs: 2 2024-09-19T08:02:47.016 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_background_compactions: -1 2024-09-19T08:02:47.016 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_subcompactions: 1 2024-09-19T08:02:47.016 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T08:02:47.016 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T08:02:47.016 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T08:02:47.017 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T08:02:47.017 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T08:02:47.017 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T08:02:47.017 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T08:02:47.017 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T08:02:47.017 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_open_files: -1 2024-09-19T08:02:47.017 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T08:02:47.017 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T08:02:47.017 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T08:02:47.017 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T08:02:47.017 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_background_flushes: -1 2024-09-19T08:02:47.017 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Compression algorithms supported: 2024-09-19T08:02:47.017 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: kZSTD supported: 0 2024-09-19T08:02:47.017 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: kXpressCompression supported: 0 2024-09-19T08:02:47.018 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: kBZip2Compression supported: 0 2024-09-19T08:02:47.018 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T08:02:47.018 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: kLZ4Compression supported: 1 2024-09-19T08:02:47.018 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: kZlibCompression supported: 1 2024-09-19T08:02:47.018 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T08:02:47.018 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: kSnappyCompression supported: 1 2024-09-19T08:02:47.018 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T08:02:47.018 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T08:02:47.018 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-19T08:02:47.018 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T08:02:47.018 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T08:02:47.018 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.merge_operator: 2024-09-19T08:02:47.018 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compaction_filter: None 2024-09-19T08:02:47.019 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T08:02:47.019 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T08:02:47.019 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T08:02:47.019 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T08:02:47.019 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5640e3f03320) 2024-09-19T08:02:47.019 INFO:journalctl@ceph.mon.c.smithi203.stdout: cache_index_and_filter_blocks: 1 2024-09-19T08:02:47.019 INFO:journalctl@ceph.mon.c.smithi203.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T08:02:47.019 INFO:journalctl@ceph.mon.c.smithi203.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T08:02:47.019 INFO:journalctl@ceph.mon.c.smithi203.stdout: pin_top_level_index_and_filter: 1 2024-09-19T08:02:47.019 INFO:journalctl@ceph.mon.c.smithi203.stdout: index_type: 0 2024-09-19T08:02:47.019 INFO:journalctl@ceph.mon.c.smithi203.stdout: data_block_index_type: 0 2024-09-19T08:02:47.019 INFO:journalctl@ceph.mon.c.smithi203.stdout: index_shortening: 1 2024-09-19T08:02:47.019 INFO:journalctl@ceph.mon.c.smithi203.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T08:02:47.019 INFO:journalctl@ceph.mon.c.smithi203.stdout: checksum: 4 2024-09-19T08:02:47.020 INFO:journalctl@ceph.mon.c.smithi203.stdout: no_block_cache: 0 2024-09-19T08:02:47.020 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_cache: 0x5640e3ef71f0 2024-09-19T08:02:47.020 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_cache_name: BinnedLRUCache 2024-09-19T08:02:47.020 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_cache_options: 2024-09-19T08:02:47.020 INFO:journalctl@ceph.mon.c.smithi203.stdout: capacity : 536870912 2024-09-19T08:02:47.020 INFO:journalctl@ceph.mon.c.smithi203.stdout: num_shard_bits : 4 2024-09-19T08:02:47.020 INFO:journalctl@ceph.mon.c.smithi203.stdout: strict_capacity_limit : 0 2024-09-19T08:02:47.020 INFO:journalctl@ceph.mon.c.smithi203.stdout: high_pri_pool_ratio: 0.000 2024-09-19T08:02:47.020 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_cache_compressed: (nil) 2024-09-19T08:02:47.020 INFO:journalctl@ceph.mon.c.smithi203.stdout: persistent_cache: (nil) 2024-09-19T08:02:47.020 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_size: 4096 2024-09-19T08:02:47.020 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_size_deviation: 10 2024-09-19T08:02:47.020 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_restart_interval: 16 2024-09-19T08:02:47.020 INFO:journalctl@ceph.mon.c.smithi203.stdout: index_block_restart_interval: 1 2024-09-19T08:02:47.021 INFO:journalctl@ceph.mon.c.smithi203.stdout: metadata_block_size: 4096 2024-09-19T08:02:47.021 INFO:journalctl@ceph.mon.c.smithi203.stdout: partition_filters: 0 2024-09-19T08:02:47.021 INFO:journalctl@ceph.mon.c.smithi203.stdout: use_delta_encoding: 1 2024-09-19T08:02:47.021 INFO:journalctl@ceph.mon.c.smithi203.stdout: filter_policy: bloomfilter 2024-09-19T08:02:47.021 INFO:journalctl@ceph.mon.c.smithi203.stdout: whole_key_filtering: 1 2024-09-19T08:02:47.021 INFO:journalctl@ceph.mon.c.smithi203.stdout: verify_compression: 0 2024-09-19T08:02:47.021 INFO:journalctl@ceph.mon.c.smithi203.stdout: read_amp_bytes_per_bit: 0 2024-09-19T08:02:47.021 INFO:journalctl@ceph.mon.c.smithi203.stdout: format_version: 5 2024-09-19T08:02:47.021 INFO:journalctl@ceph.mon.c.smithi203.stdout: enable_index_compression: 1 2024-09-19T08:02:47.021 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_align: 0 2024-09-19T08:02:47.021 INFO:journalctl@ceph.mon.c.smithi203.stdout: max_auto_readahead_size: 262144 2024-09-19T08:02:47.021 INFO:journalctl@ceph.mon.c.smithi203.stdout: prepopulate_block_cache: 0 2024-09-19T08:02:47.021 INFO:journalctl@ceph.mon.c.smithi203.stdout: initial_auto_readahead_size: 8192 2024-09-19T08:02:47.022 INFO:journalctl@ceph.mon.c.smithi203.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T08:02:47.022 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T08:02:47.022 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T08:02:47.022 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compression: NoCompression 2024-09-19T08:02:47.022 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T08:02:47.022 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T08:02:47.022 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T08:02:47.022 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.num_levels: 7 2024-09-19T08:02:47.022 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T08:02:47.022 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T08:02:47.022 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T08:02:47.022 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T08:02:47.022 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T08:02:47.023 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T08:02:47.023 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T08:02:47.023 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:02:47.023 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T08:02:47.023 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T08:02:47.023 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:02:47.023 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:02:47.023 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T08:02:47.023 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T08:02:47.023 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T08:02:47.023 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T08:02:47.023 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:02:47.023 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:02:47.023 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T08:02:47.024 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T08:02:47.024 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:02:47.024 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T08:02:47.024 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T08:02:47.024 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T08:02:47.024 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T08:02:47.024 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T08:02:47.024 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T08:02:47.024 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T08:02:47.024 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T08:02:47.024 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T08:02:47.024 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T08:02:47.024 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T08:02:47.024 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T08:02:47.025 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T08:02:47.025 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T08:02:47.025 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T08:02:47.025 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T08:02:47.025 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T08:02:47.025 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T08:02:47.025 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T08:02:47.025 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T08:02:47.025 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T08:02:47.025 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T08:02:47.025 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T08:02:47.025 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T08:02:47.026 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T08:02:47.026 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T08:02:47.026 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T08:02:47.026 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T08:02:47.026 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T08:02:47.026 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T08:02:47.026 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T08:02:47.026 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T08:02:47.026 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T08:02:47.026 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.inplace_update_support: 0 2024-09-19T08:02:47.026 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T08:02:47.026 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T08:02:47.026 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T08:02:47.027 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T08:02:47.027 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.bloom_locality: 0 2024-09-19T08:02:47.027 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.max_successive_merges: 0 2024-09-19T08:02:47.027 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T08:02:47.027 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T08:02:47.027 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T08:02:47.027 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T08:02:47.027 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.ttl: 2592000 2024-09-19T08:02:47.027 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T08:02:47.027 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T08:02:47.027 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T08:02:47.027 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.enable_blob_files: false 2024-09-19T08:02:47.027 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.min_blob_size: 0 2024-09-19T08:02:47.028 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T08:02:47.028 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T08:02:47.028 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T08:02:47.028 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T08:02:47.028 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T08:02:47.028 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T08:02:47.028 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T08:02:47.028 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T08:02:47.028 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T08:02:47.028 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T08:02:47.028 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2798d2fd-8fa9-4a94-9ae6-c09df3703f83 2024-09-19T08:02:47.028 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726732966695943, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T08:02:47.029 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T08:02:47.029 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726732966696360, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726732966, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2798d2fd-8fa9-4a94-9ae6-c09df3703f83", "db_session_id": "NZRSYRXE7RWP0EWVLQ3R", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T08:02:47.029 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726732966696454, "job": 1, "event": "recovery_finished"} 2024-09-19T08:02:47.029 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T08:02:47.029 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T08:02:47.029 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5640e3f24e00 2024-09-19T08:02:47.029 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: DB pointer 0x5640e4020000 2024-09-19T08:02:47.029 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T08:02:47.029 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T08:02:47.029 INFO:journalctl@ceph.mon.c.smithi203.stdout: ** DB Stats ** 2024-09-19T08:02:47.029 INFO:journalctl@ceph.mon.c.smithi203.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:02:47.029 INFO:journalctl@ceph.mon.c.smithi203.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T08:02:47.030 INFO:journalctl@ceph.mon.c.smithi203.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:02:47.030 INFO:journalctl@ceph.mon.c.smithi203.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:02:47.030 INFO:journalctl@ceph.mon.c.smithi203.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T08:02:47.030 INFO:journalctl@ceph.mon.c.smithi203.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:02:47.030 INFO:journalctl@ceph.mon.c.smithi203.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:02:47.030 INFO:journalctl@ceph.mon.c.smithi203.stdout: 2024-09-19T08:02:47.030 INFO:journalctl@ceph.mon.c.smithi203.stdout: ** Compaction Stats [default] ** 2024-09-19T08:02:47.030 INFO:journalctl@ceph.mon.c.smithi203.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:02:47.030 INFO:journalctl@ceph.mon.c.smithi203.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T08:02:47.030 INFO:journalctl@ceph.mon.c.smithi203.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:02:47.030 INFO:journalctl@ceph.mon.c.smithi203.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:02:47.030 INFO:journalctl@ceph.mon.c.smithi203.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:02:47.030 INFO:journalctl@ceph.mon.c.smithi203.stdout: 2024-09-19T08:02:47.031 INFO:journalctl@ceph.mon.c.smithi203.stdout: ** Compaction Stats [default] ** 2024-09-19T08:02:47.031 INFO:journalctl@ceph.mon.c.smithi203.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:02:47.031 INFO:journalctl@ceph.mon.c.smithi203.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T08:02:47.031 INFO:journalctl@ceph.mon.c.smithi203.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:02:47.031 INFO:journalctl@ceph.mon.c.smithi203.stdout: 2024-09-19T08:02:47.031 INFO:journalctl@ceph.mon.c.smithi203.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T08:02:47.031 INFO:journalctl@ceph.mon.c.smithi203.stdout: 2024-09-19T08:02:47.031 INFO:journalctl@ceph.mon.c.smithi203.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:02:47.031 INFO:journalctl@ceph.mon.c.smithi203.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T08:02:47.031 INFO:journalctl@ceph.mon.c.smithi203.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T08:02:47.031 INFO:journalctl@ceph.mon.c.smithi203.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T08:02:47.031 INFO:journalctl@ceph.mon.c.smithi203.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T08:02:47.031 INFO:journalctl@ceph.mon.c.smithi203.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T08:02:47.032 INFO:journalctl@ceph.mon.c.smithi203.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:02:47.032 INFO:journalctl@ceph.mon.c.smithi203.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:02:47.032 INFO:journalctl@ceph.mon.c.smithi203.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T08:02:47.032 INFO:journalctl@ceph.mon.c.smithi203.stdout: Block cache BinnedLRUCache@0x5640e3ef71f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T08:02:47.032 INFO:journalctl@ceph.mon.c.smithi203.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T08:02:47.032 INFO:journalctl@ceph.mon.c.smithi203.stdout: 2024-09-19T08:02:47.032 INFO:journalctl@ceph.mon.c.smithi203.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T08:02:47.032 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-19T08:02:47.032 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: using public_addr v2:172.21.15.203:0/0 -> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-19T08:02:47.032 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: starting mon.c rank -1 at public addrs [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] at bind addrs [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:02:47.032 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: mon.c@-1(???) e0 preinit fsid 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:02:47.032 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: mon.c@-1(synchronizing).mds e1 new map 2024-09-19T08:02:47.032 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T08:02:47.032 INFO:journalctl@ceph.mon.c.smithi203.stdout: e1 2024-09-19T08:02:47.033 INFO:journalctl@ceph.mon.c.smithi203.stdout: btime 2024-09-19T08:01:20:929052+0000 2024-09-19T08:02:47.033 INFO:journalctl@ceph.mon.c.smithi203.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:02:47.033 INFO:journalctl@ceph.mon.c.smithi203.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:02:47.033 INFO:journalctl@ceph.mon.c.smithi203.stdout: legacy client fscid: -1 2024-09-19T08:02:47.033 INFO:journalctl@ceph.mon.c.smithi203.stdout: 2024-09-19T08:02:47.033 INFO:journalctl@ceph.mon.c.smithi203.stdout: No filesystems configured 2024-09-19T08:02:47.033 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T08:02:47.033 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T08:02:47.033 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T08:02:47.033 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T08:02:47.033 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T08:02:47.033 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T08:02:47.033 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T08:02:47.034 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:02:47.034 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:02:47.034 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:02:47.034 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:47.034 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-19T08:02:47.034 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: Updating smithi203:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:02:47.034 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:02:47.034 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:47.034 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:47.034 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:47.034 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:47.034 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:02:47.034 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:02:47.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:02:47.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:47.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:02:47.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:02:47.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: Updating smithi203:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:02:47.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi027:172.21.15.27=a;smithi155:172.21.15.155=b;smithi203:172.21.15.203=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:02:47.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: Saving service mon spec with placement smithi027:172.21.15.27=a;smithi155:172.21.15.155=b;smithi203:172.21.15.203=c;count:3 2024-09-19T08:02:47.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: Deploying daemon mon.c on smithi203 2024-09-19T08:02:47.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:47.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:47.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: from='client.? 172.21.15.203:0/2868266184' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:02:47.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 ceph-mon[35198]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T08:02:47.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 bash[35178]: 0541a1fc7087a177c1c5ca6b4d9081e452993507af6875b6bfa59c1185e2e198 2024-09-19T08:02:47.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:46 smithi203 systemd[1]: Started Ceph mon.c for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:02:47.240 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:02:47.241 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:02:47.499 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:02:52.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:02:52.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: mon.a calling monitor election 2024-09-19T08:02:52.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:52.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:52.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:52.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:52.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: mon.c calling monitor election 2024-09-19T08:02:52.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:52.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:52.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:52.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:52.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:52.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:02:52.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: monmap epoch 2 2024-09-19T08:02:52.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: fsid 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:02:52.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: last_changed 2024-09-19T08:02:46.721831+0000 2024-09-19T08:02:52.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: created 2024-09-19T08:01:17.912400+0000 2024-09-19T08:02:52.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: min_mon_release 19 (squid) 2024-09-19T08:02:52.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: election_strategy: 1 2024-09-19T08:02:52.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-09-19T08:02:52.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T08:02:52.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: fsmap 2024-09-19T08:02:52.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:02:52.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: mgrmap e13: x(active, since 38s) 2024-09-19T08:02:52.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: overall HEALTH_OK 2024-09-19T08:02:52.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:52.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:52.255 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:52.255 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:02:52.255 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:02:52.255 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:51 smithi027 ceph-mon[31209]: Deploying daemon mon.b on smithi155 2024-09-19T08:02:52.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:02:52.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: mon.a calling monitor election 2024-09-19T08:02:52.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:52.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:52.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:52.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:52.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: mon.c calling monitor election 2024-09-19T08:02:52.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:52.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:52.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:52.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:52.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:52.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:02:52.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: monmap epoch 2 2024-09-19T08:02:52.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: fsid 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:02:52.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: last_changed 2024-09-19T08:02:46.721831+0000 2024-09-19T08:02:52.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: created 2024-09-19T08:01:17.912400+0000 2024-09-19T08:02:52.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: min_mon_release 19 (squid) 2024-09-19T08:02:52.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: election_strategy: 1 2024-09-19T08:02:52.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-09-19T08:02:52.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T08:02:52.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: fsmap 2024-09-19T08:02:52.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:02:52.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: mgrmap e13: x(active, since 38s) 2024-09-19T08:02:52.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: overall HEALTH_OK 2024-09-19T08:02:52.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:52.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:52.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:52.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:02:52.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:02:52.261 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:51 smithi203 ceph-mon[35198]: Deploying daemon mon.b on smithi155 2024-09-19T08:02:52.328 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.327+0000 7fb8a6579640 1 -- 172.21.15.203:0/2841056326 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb888003530 msgr2=0x7fb8880059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:52.329 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.327+0000 7fb8a6579640 1 --2- 172.21.15.203:0/2841056326 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb888003530 0x7fb8880059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb8a01016a0 tx=0x7fb89002c490 comp rx=0 tx=0).stop 2024-09-19T08:02:52.329 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.328+0000 7fb8a6579640 1 -- 172.21.15.203:0/2841056326 shutdown_connections 2024-09-19T08:02:52.329 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.328+0000 7fb8a6579640 1 --2- 172.21.15.203:0/2841056326 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb888003530 0x7fb8880059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:52.329 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.328+0000 7fb8a6579640 1 -- 172.21.15.203:0/2841056326 >> 172.21.15.203:0/2841056326 conn(0x7fb8a00fc220 msgr2=0x7fb8a00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:52.329 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.328+0000 7fb8a6579640 1 -- 172.21.15.203:0/2841056326 shutdown_connections 2024-09-19T08:02:52.329 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.328+0000 7fb8a6579640 1 -- 172.21.15.203:0/2841056326 wait complete. 2024-09-19T08:02:52.329 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.328+0000 7fb8a6579640 1 Processor -- start 2024-09-19T08:02:52.329 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.329+0000 7fb8a6579640 1 -- start start 2024-09-19T08:02:52.331 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.329+0000 7fb8a6579640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb888003530 0x7fb8a0199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:52.331 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.329+0000 7fb8a6579640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8a01999c0 0x7fb8a019dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:52.331 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.329+0000 7fb8a6579640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a0108670 con 0x7fb888003530 2024-09-19T08:02:52.331 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.329+0000 7fb8a6579640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a01084f0 con 0x7fb8a01999c0 2024-09-19T08:02:52.331 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.329+0000 7fb89f7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8a01999c0 0x7fb8a019dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:52.331 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.329+0000 7fb89f7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8a01999c0 0x7fb8a019dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:55782/0 (socket says 172.21.15.203:55782) 2024-09-19T08:02:52.331 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.329+0000 7fb89f7fe640 1 -- 172.21.15.203:0/1153382388 learned_addr learned my addr 172.21.15.203:0/1153382388 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:02:52.331 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.330+0000 7fb89ffff640 1 --2- 172.21.15.203:0/1153382388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb888003530 0x7fb8a0199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:52.332 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.330+0000 7fb89f7fe640 1 -- 172.21.15.203:0/1153382388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8a01999c0 msgr2=0x7fb8a019dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T08:02:52.332 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.330+0000 7fb89f7fe640 1 -- 172.21.15.203:0/1153382388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8a01999c0 msgr2=0x7fb8a019dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:02:52.332 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.330+0000 7fb89f7fe640 1 --2- 172.21.15.203:0/1153382388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8a01999c0 0x7fb8a019dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:02:52.332 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.330+0000 7fb89f7fe640 1 --2- 172.21.15.203:0/1153382388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8a01999c0 0x7fb8a019dd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:02:52.332 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.330+0000 7fb89ffff640 1 -- 172.21.15.203:0/1153382388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8a01999c0 msgr2=0x7fb8a019dd50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:02:52.332 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.330+0000 7fb89ffff640 1 --2- 172.21.15.203:0/1153382388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8a01999c0 0x7fb8a019dd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:52.332 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.330+0000 7fb89ffff640 1 -- 172.21.15.203:0/1153382388 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a0199fe0 con 0x7fb888003530 2024-09-19T08:02:52.332 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.330+0000 7fb89ffff640 1 --2- 172.21.15.203:0/1153382388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb888003530 0x7fb8a0199480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb89002ca80 tx=0x7fb8900339a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:52.332 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.331+0000 7fb89d7fa640 1 -- 172.21.15.203:0/1153382388 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fb8900329e0 con 0x7fb888003530 2024-09-19T08:02:52.332 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.331+0000 7fb89d7fa640 1 -- 172.21.15.203:0/1153382388 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb890005520 con 0x7fb888003530 2024-09-19T08:02:52.332 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.331+0000 7fb8a6579640 1 -- 172.21.15.203:0/1153382388 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a019e290 con 0x7fb888003530 2024-09-19T08:02:52.332 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.331+0000 7fb89d7fa640 1 -- 172.21.15.203:0/1153382388 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fb890004bc0 con 0x7fb888003530 2024-09-19T08:02:52.333 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.331+0000 7fb8a6579640 1 -- 172.21.15.203:0/1153382388 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a019e820 con 0x7fb888003530 2024-09-19T08:02:52.333 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.332+0000 7fb89d7fa640 1 -- 172.21.15.203:0/1153382388 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fb890043020 con 0x7fb888003530 2024-09-19T08:02:52.334 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.332+0000 7fb8a6579640 1 -- 172.21.15.203:0/1153382388 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a019eb90 con 0x7fb888003530 2024-09-19T08:02:52.334 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.332+0000 7fb89d7fa640 1 --2- 172.21.15.203:0/1153382388 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fb88c039040 0x7fb88c03b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:52.334 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.332+0000 7fb89d7fa640 1 -- 172.21.15.203:0/1153382388 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb890041020 con 0x7fb888003530 2024-09-19T08:02:52.334 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.332+0000 7fb89f7fe640 1 --2- 172.21.15.203:0/1153382388 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fb88c039040 0x7fb88c03b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:52.334 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.333+0000 7fb89f7fe640 1 --2- 172.21.15.203:0/1153382388 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fb88c039040 0x7fb88c03b500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb894009100 tx=0x7fb894008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:52.337 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.337+0000 7fb89d7fa640 1 -- 172.21.15.203:0/1153382388 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb89004a020 con 0x7fb888003530 2024-09-19T08:02:52.574 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.574+0000 7fb8a6579640 1 -- 172.21.15.203:0/1153382388 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fb8a019a7e0 con 0x7fb888003530 2024-09-19T08:02:52.575 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.575+0000 7fb89d7fa640 1 -- 172.21.15.203:0/1153382388 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fb89003abb0 con 0x7fb888003530 2024-09-19T08:02:52.575 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:02:52.575 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":2,"fsid":"35b531b0-765d-11ef-bceb-c7b262605968","modified":"2024-09-19T08:02:46.721831Z","created":"2024-09-19T08:01:17.912400Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:3300","nonce":0},{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T08:02:52.575 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 2 2024-09-19T08:02:52.577 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.577+0000 7fb8a6579640 1 -- 172.21.15.203:0/1153382388 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fb88c039040 msgr2=0x7fb88c03b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:52.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.577+0000 7fb8a6579640 1 --2- 172.21.15.203:0/1153382388 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fb88c039040 0x7fb88c03b500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb894009100 tx=0x7fb894008040 comp rx=0 tx=0).stop 2024-09-19T08:02:52.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.577+0000 7fb8a6579640 1 -- 172.21.15.203:0/1153382388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb888003530 msgr2=0x7fb8a0199480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:52.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.577+0000 7fb8a6579640 1 --2- 172.21.15.203:0/1153382388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb888003530 0x7fb8a0199480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb89002ca80 tx=0x7fb8900339a0 comp rx=0 tx=0).stop 2024-09-19T08:02:52.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.577+0000 7fb8a6579640 1 -- 172.21.15.203:0/1153382388 shutdown_connections 2024-09-19T08:02:52.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.577+0000 7fb8a6579640 1 --2- 172.21.15.203:0/1153382388 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fb88c039040 0x7fb88c03b500 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:52.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.577+0000 7fb8a6579640 1 --2- 172.21.15.203:0/1153382388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8a01999c0 0x7fb8a019dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:52.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.577+0000 7fb8a6579640 1 --2- 172.21.15.203:0/1153382388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb888003530 0x7fb8a0199480 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:52.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.577+0000 7fb8a6579640 1 -- 172.21.15.203:0/1153382388 >> 172.21.15.203:0/1153382388 conn(0x7fb8a00fc220 msgr2=0x7fb8a006a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:52.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.577+0000 7fb8a6579640 1 -- 172.21.15.203:0/1153382388 shutdown_connections 2024-09-19T08:02:52.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:52.577+0000 7fb8a6579640 1 -- 172.21.15.203:0/1153382388 wait complete. 2024-09-19T08:02:52.939 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:52 smithi203 ceph-mon[35198]: from='client.? 172.21.15.203:0/1153382388' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:02:52.939 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:52 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:53.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:52 smithi027 ceph-mon[31209]: from='client.? 172.21.15.203:0/1153382388' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:02:53.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:52 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:54.251 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:02:54.252 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:02:54.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:02:53 smithi027 ceph-mon[31209]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:54.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:02:53 smithi203 ceph-mon[35198]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:54.506 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:02:54.968 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.940+0000 7fbcee32c640 1 -- 172.21.15.203:0/1046444957 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbce81028e0 msgr2=0x7fbce8102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:54.968 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.940+0000 7fbcee32c640 1 --2- 172.21.15.203:0/1046444957 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbce81028e0 0x7fbce8102cc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8009880 tx=0x7fbcd802a670 comp rx=0 tx=0).stop 2024-09-19T08:02:54.968 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.940+0000 7fbcee32c640 1 -- 172.21.15.203:0/1046444957 shutdown_connections 2024-09-19T08:02:54.968 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.940+0000 7fbcee32c640 1 --2- 172.21.15.203:0/1046444957 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbce81028e0 0x7fbce8102cc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:54.968 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.940+0000 7fbcee32c640 1 -- 172.21.15.203:0/1046444957 >> 172.21.15.203:0/1046444957 conn(0x7fbce80fc280 msgr2=0x7fbce80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:54.968 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.940+0000 7fbcee32c640 1 -- 172.21.15.203:0/1046444957 shutdown_connections 2024-09-19T08:02:54.968 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.940+0000 7fbcee32c640 1 -- 172.21.15.203:0/1046444957 wait complete. 2024-09-19T08:02:54.968 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.941+0000 7fbcee32c640 1 Processor -- start 2024-09-19T08:02:54.968 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.941+0000 7fbcee32c640 1 -- start start 2024-09-19T08:02:54.969 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.941+0000 7fbcee32c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbce81028e0 0x7fbce8197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:54.969 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.941+0000 7fbcee32c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbce8197990 0x7fbce819bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:54.969 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.941+0000 7fbcee32c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbce810bdb0 con 0x7fbce8197990 2024-09-19T08:02:54.969 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.941+0000 7fbcee32c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbce810bc30 con 0x7fbce81028e0 2024-09-19T08:02:54.969 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.941+0000 7fbce7fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbce81028e0 0x7fbce8197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:54.969 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.941+0000 7fbce7fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbce81028e0 0x7fbce8197450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:55788/0 (socket says 172.21.15.203:55788) 2024-09-19T08:02:54.969 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.941+0000 7fbce7fff640 1 -- 172.21.15.203:0/295810223 learned_addr learned my addr 172.21.15.203:0/295810223 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:02:54.969 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.941+0000 7fbce77fe640 1 --2- 172.21.15.203:0/295810223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbce8197990 0x7fbce819bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:54.969 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.941+0000 7fbce7fff640 1 -- 172.21.15.203:0/295810223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbce81028e0 msgr2=0x7fbce8197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T08:02:54.969 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.941+0000 7fbce7fff640 1 -- 172.21.15.203:0/295810223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbce81028e0 msgr2=0x7fbce8197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:02:54.969 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.941+0000 7fbce7fff640 1 --2- 172.21.15.203:0/295810223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbce81028e0 0x7fbce8197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:02:54.969 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.941+0000 7fbce7fff640 1 --2- 172.21.15.203:0/295810223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbce81028e0 0x7fbce8197450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:02:54.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.942+0000 7fbce77fe640 1 -- 172.21.15.203:0/295810223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbce81028e0 msgr2=0x7fbce8197450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:02:54.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.942+0000 7fbce77fe640 1 --2- 172.21.15.203:0/295810223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbce81028e0 0x7fbce8197450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:54.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.942+0000 7fbce77fe640 1 -- 172.21.15.203:0/295810223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce8197fb0 con 0x7fbce8197990 2024-09-19T08:02:54.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.942+0000 7fbce77fe640 1 --2- 172.21.15.203:0/295810223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbce8197990 0x7fbce819bd20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00b3d0 tx=0x7fbcdc00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:54.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.942+0000 7fbce57fa640 1 -- 172.21.15.203:0/295810223 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fbcdc011630 con 0x7fbce8197990 2024-09-19T08:02:54.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.942+0000 7fbcee32c640 1 -- 172.21.15.203:0/295810223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce819c260 con 0x7fbce8197990 2024-09-19T08:02:54.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.942+0000 7fbce57fa640 1 -- 172.21.15.203:0/295810223 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcdc011cb0 con 0x7fbce8197990 2024-09-19T08:02:54.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.942+0000 7fbce57fa640 1 -- 172.21.15.203:0/295810223 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fbcdc010df0 con 0x7fbce8197990 2024-09-19T08:02:54.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.942+0000 7fbcee32c640 1 -- 172.21.15.203:0/295810223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce819c7a0 con 0x7fbce8197990 2024-09-19T08:02:54.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.943+0000 7fbce57fa640 1 -- 172.21.15.203:0/295810223 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fbcdc018020 con 0x7fbce8197990 2024-09-19T08:02:54.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.943+0000 7fbcee32c640 1 -- 172.21.15.203:0/295810223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce806a450 con 0x7fbce8197990 2024-09-19T08:02:54.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.943+0000 7fbce57fa640 1 --2- 172.21.15.203:0/295810223 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fbcd0039040 0x7fbcd003b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:54.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.944+0000 7fbce57fa640 1 -- 172.21.15.203:0/295810223 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbcdc04bfb0 con 0x7fbce8197990 2024-09-19T08:02:54.971 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.944+0000 7fbce7fff640 1 --2- 172.21.15.203:0/295810223 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fbcd0039040 0x7fbcd003b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:54.971 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.944+0000 7fbce7fff640 1 --2- 172.21.15.203:0/295810223 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fbcd0039040 0x7fbcd003b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80096c0 tx=0x7fbcd8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:54.971 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:54.949+0000 7fbce57fa640 1 -- 172.21.15.203:0/295810223 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbcdc01f020 con 0x7fbce8197990 2024-09-19T08:02:55.180 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:55.179+0000 7fbcee32c640 1 -- 172.21.15.203:0/295810223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fbce819cab0 con 0x7fbce8197990 2024-09-19T08:02:55.181 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:55.180+0000 7fbce57fa640 1 -- 172.21.15.203:0/295810223 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fbcdc017500 con 0x7fbce8197990 2024-09-19T08:02:55.181 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:02:55.181 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":2,"fsid":"35b531b0-765d-11ef-bceb-c7b262605968","modified":"2024-09-19T08:02:46.721831Z","created":"2024-09-19T08:01:17.912400Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:3300","nonce":0},{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T08:02:55.181 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 2 2024-09-19T08:02:55.183 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:55.182+0000 7fbcee32c640 1 -- 172.21.15.203:0/295810223 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fbcd0039040 msgr2=0x7fbcd003b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:55.184 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:55.182+0000 7fbcee32c640 1 --2- 172.21.15.203:0/295810223 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fbcd0039040 0x7fbcd003b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80096c0 tx=0x7fbcd8031400 comp rx=0 tx=0).stop 2024-09-19T08:02:55.184 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:55.182+0000 7fbcee32c640 1 -- 172.21.15.203:0/295810223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbce8197990 msgr2=0x7fbce819bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:55.184 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:55.182+0000 7fbcee32c640 1 --2- 172.21.15.203:0/295810223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbce8197990 0x7fbce819bd20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00b3d0 tx=0x7fbcdc00b890 comp rx=0 tx=0).stop 2024-09-19T08:02:55.184 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:55.182+0000 7fbcee32c640 1 -- 172.21.15.203:0/295810223 shutdown_connections 2024-09-19T08:02:55.184 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:55.182+0000 7fbcee32c640 1 --2- 172.21.15.203:0/295810223 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fbcd0039040 0x7fbcd003b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:55.184 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:55.182+0000 7fbcee32c640 1 --2- 172.21.15.203:0/295810223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbce8197990 0x7fbce819bd20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:55.184 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:55.182+0000 7fbcee32c640 1 --2- 172.21.15.203:0/295810223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbce81028e0 0x7fbce8197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:55.184 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:55.182+0000 7fbcee32c640 1 -- 172.21.15.203:0/295810223 >> 172.21.15.203:0/295810223 conn(0x7fbce80fc280 msgr2=0x7fbce81056a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:55.184 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:55.182+0000 7fbcee32c640 1 -- 172.21.15.203:0/295810223 shutdown_connections 2024-09-19T08:02:55.184 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:02:55.182+0000 7fbcee32c640 1 -- 172.21.15.203:0/295810223 wait complete. 2024-09-19T08:02:55.660 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 podman[35343]: 2024-09-19 08:02:55.638663006 +0000 UTC m=+0.353751165 container start 5eee4da52791e89a80a4657be24183fed826111245e32506eaaec59b4c49388e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-b, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T08:02:55.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T08:02:55.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T08:02:55.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: pidfile_write: ignore empty --pid-file 2024-09-19T08:02:55.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: load: jerasure load: lrc 2024-09-19T08:02:55.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: RocksDB version: 7.9.2 2024-09-19T08:02:55.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Git sha 0 2024-09-19T08:02:55.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T08:02:55.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: DB SUMMARY 2024-09-19T08:02:55.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: DB Session ID: FYSN0SOHUCW13YLLU8TV 2024-09-19T08:02:55.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: CURRENT file: CURRENT 2024-09-19T08:02:55.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T08:02:55.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T08:02:55.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-19T08:02:55.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-19T08:02:55.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.error_if_exists: 0 2024-09-19T08:02:55.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.create_if_missing: 0 2024-09-19T08:02:55.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.paranoid_checks: 1 2024-09-19T08:02:55.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T08:02:55.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T08:02:55.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T08:02:55.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.env: 0x55a27131f940 2024-09-19T08:02:55.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T08:02:55.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.info_log: 0x55a272ee36e0 2024-09-19T08:02:55.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T08:02:55.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.statistics: (nil) 2024-09-19T08:02:55.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.use_fsync: 0 2024-09-19T08:02:55.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_log_file_size: 0 2024-09-19T08:02:55.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T08:02:55.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T08:02:55.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T08:02:55.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T08:02:55.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.allow_fallocate: 1 2024-09-19T08:02:55.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T08:02:55.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T08:02:55.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.use_direct_reads: 0 2024-09-19T08:02:55.991 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T08:02:55.991 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T08:02:55.991 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.db_log_dir: 2024-09-19T08:02:55.991 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.wal_dir: 2024-09-19T08:02:55.991 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T08:02:55.993 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T08:02:55.993 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T08:02:55.993 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T08:02:55.993 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T08:02:55.993 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T08:02:55.993 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T08:02:55.993 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T08:02:55.993 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.write_buffer_manager: 0x55a272ef2dc0 2024-09-19T08:02:55.993 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T08:02:55.993 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T08:02:55.993 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T08:02:55.993 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T08:02:55.993 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T08:02:55.994 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T08:02:55.994 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T08:02:55.994 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T08:02:55.994 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.unordered_write: 0 2024-09-19T08:02:55.994 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T08:02:55.994 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T08:02:55.994 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T08:02:55.994 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T08:02:55.994 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.row_cache: None 2024-09-19T08:02:55.994 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.wal_filter: None 2024-09-19T08:02:55.994 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T08:02:55.994 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T08:02:55.994 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.two_write_queues: 0 2024-09-19T08:02:55.995 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T08:02:55.995 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.wal_compression: 0 2024-09-19T08:02:55.995 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.atomic_flush: 0 2024-09-19T08:02:55.995 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T08:02:55.995 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T08:02:55.995 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T08:02:55.995 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.log_readahead_size: 0 2024-09-19T08:02:55.995 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T08:02:55.995 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T08:02:55.995 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T08:02:55.995 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T08:02:55.995 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T08:02:55.995 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T08:02:55.996 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T08:02:55.996 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_background_jobs: 2 2024-09-19T08:02:55.996 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_background_compactions: -1 2024-09-19T08:02:55.996 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_subcompactions: 1 2024-09-19T08:02:55.996 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T08:02:55.996 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T08:02:55.996 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T08:02:55.996 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T08:02:55.996 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T08:02:55.996 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T08:02:55.996 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T08:02:55.996 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T08:02:55.996 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_open_files: -1 2024-09-19T08:02:55.997 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T08:02:55.997 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T08:02:55.997 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T08:02:55.997 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T08:02:55.997 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_background_flushes: -1 2024-09-19T08:02:55.997 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Compression algorithms supported: 2024-09-19T08:02:55.997 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: kZSTD supported: 0 2024-09-19T08:02:55.997 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: kXpressCompression supported: 0 2024-09-19T08:02:55.997 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: kBZip2Compression supported: 0 2024-09-19T08:02:55.998 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T08:02:55.998 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: kLZ4Compression supported: 1 2024-09-19T08:02:55.998 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: kZlibCompression supported: 1 2024-09-19T08:02:55.998 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T08:02:55.998 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: kSnappyCompression supported: 1 2024-09-19T08:02:55.998 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T08:02:55.998 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T08:02:55.998 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-19T08:02:55.998 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T08:02:55.998 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T08:02:55.998 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.merge_operator: 2024-09-19T08:02:55.998 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compaction_filter: None 2024-09-19T08:02:55.998 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T08:02:55.998 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T08:02:55.999 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T08:02:55.999 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T08:02:55.999 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a272ee3320) 2024-09-19T08:02:55.999 INFO:journalctl@ceph.mon.b.smithi155.stdout: cache_index_and_filter_blocks: 1 2024-09-19T08:02:55.999 INFO:journalctl@ceph.mon.b.smithi155.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T08:02:55.999 INFO:journalctl@ceph.mon.b.smithi155.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T08:02:55.999 INFO:journalctl@ceph.mon.b.smithi155.stdout: pin_top_level_index_and_filter: 1 2024-09-19T08:02:55.999 INFO:journalctl@ceph.mon.b.smithi155.stdout: index_type: 0 2024-09-19T08:02:55.999 INFO:journalctl@ceph.mon.b.smithi155.stdout: data_block_index_type: 0 2024-09-19T08:02:55.999 INFO:journalctl@ceph.mon.b.smithi155.stdout: index_shortening: 1 2024-09-19T08:02:55.999 INFO:journalctl@ceph.mon.b.smithi155.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T08:02:55.999 INFO:journalctl@ceph.mon.b.smithi155.stdout: checksum: 4 2024-09-19T08:02:55.999 INFO:journalctl@ceph.mon.b.smithi155.stdout: no_block_cache: 0 2024-09-19T08:02:55.999 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_cache: 0x55a272ed71f0 2024-09-19T08:02:56.000 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_cache_name: BinnedLRUCache 2024-09-19T08:02:56.000 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_cache_options: 2024-09-19T08:02:56.000 INFO:journalctl@ceph.mon.b.smithi155.stdout: capacity : 536870912 2024-09-19T08:02:56.000 INFO:journalctl@ceph.mon.b.smithi155.stdout: num_shard_bits : 4 2024-09-19T08:02:56.000 INFO:journalctl@ceph.mon.b.smithi155.stdout: strict_capacity_limit : 0 2024-09-19T08:02:56.000 INFO:journalctl@ceph.mon.b.smithi155.stdout: high_pri_pool_ratio: 0.000 2024-09-19T08:02:56.000 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_cache_compressed: (nil) 2024-09-19T08:02:56.000 INFO:journalctl@ceph.mon.b.smithi155.stdout: persistent_cache: (nil) 2024-09-19T08:02:56.000 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_size: 4096 2024-09-19T08:02:56.000 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_size_deviation: 10 2024-09-19T08:02:56.000 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_restart_interval: 16 2024-09-19T08:02:56.000 INFO:journalctl@ceph.mon.b.smithi155.stdout: index_block_restart_interval: 1 2024-09-19T08:02:56.000 INFO:journalctl@ceph.mon.b.smithi155.stdout: metadata_block_size: 4096 2024-09-19T08:02:56.001 INFO:journalctl@ceph.mon.b.smithi155.stdout: partition_filters: 0 2024-09-19T08:02:56.001 INFO:journalctl@ceph.mon.b.smithi155.stdout: use_delta_encoding: 1 2024-09-19T08:02:56.001 INFO:journalctl@ceph.mon.b.smithi155.stdout: filter_policy: bloomfilter 2024-09-19T08:02:56.001 INFO:journalctl@ceph.mon.b.smithi155.stdout: whole_key_filtering: 1 2024-09-19T08:02:56.001 INFO:journalctl@ceph.mon.b.smithi155.stdout: verify_compression: 0 2024-09-19T08:02:56.001 INFO:journalctl@ceph.mon.b.smithi155.stdout: read_amp_bytes_per_bit: 0 2024-09-19T08:02:56.001 INFO:journalctl@ceph.mon.b.smithi155.stdout: format_version: 5 2024-09-19T08:02:56.001 INFO:journalctl@ceph.mon.b.smithi155.stdout: enable_index_compression: 1 2024-09-19T08:02:56.001 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_align: 0 2024-09-19T08:02:56.001 INFO:journalctl@ceph.mon.b.smithi155.stdout: max_auto_readahead_size: 262144 2024-09-19T08:02:56.001 INFO:journalctl@ceph.mon.b.smithi155.stdout: prepopulate_block_cache: 0 2024-09-19T08:02:56.001 INFO:journalctl@ceph.mon.b.smithi155.stdout: initial_auto_readahead_size: 8192 2024-09-19T08:02:56.002 INFO:journalctl@ceph.mon.b.smithi155.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T08:02:56.002 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T08:02:56.002 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T08:02:56.002 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compression: NoCompression 2024-09-19T08:02:56.002 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T08:02:56.002 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T08:02:56.002 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T08:02:56.002 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.num_levels: 7 2024-09-19T08:02:56.002 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T08:02:56.002 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T08:02:56.002 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T08:02:56.002 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T08:02:56.002 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T08:02:56.002 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T08:02:56.003 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T08:02:56.003 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:02:56.003 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T08:02:56.003 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T08:02:56.003 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:02:56.003 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:02:56.003 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T08:02:56.003 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T08:02:56.003 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T08:02:56.003 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T08:02:56.004 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:02:56.004 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:02:56.004 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T08:02:56.004 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T08:02:56.004 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:02:56.004 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T08:02:56.004 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T08:02:56.004 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T08:02:56.004 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T08:02:56.004 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T08:02:56.005 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T08:02:56.005 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T08:02:56.005 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T08:02:56.005 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T08:02:56.005 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T08:02:56.005 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T08:02:56.005 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T08:02:56.005 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T08:02:56.005 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T08:02:56.005 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T08:02:56.005 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T08:02:56.005 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T08:02:56.006 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T08:02:56.006 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T08:02:56.006 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T08:02:56.006 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T08:02:56.006 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T08:02:56.006 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T08:02:56.006 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T08:02:56.006 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T08:02:56.006 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T08:02:56.006 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T08:02:56.006 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T08:02:56.007 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T08:02:56.007 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T08:02:56.007 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T08:02:56.007 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T08:02:56.007 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T08:02:56.007 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.inplace_update_support: 0 2024-09-19T08:02:56.007 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T08:02:56.007 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T08:02:56.007 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T08:02:56.007 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T08:02:56.007 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.bloom_locality: 0 2024-09-19T08:02:56.007 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.max_successive_merges: 0 2024-09-19T08:02:56.007 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T08:02:56.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T08:02:56.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T08:02:56.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T08:02:56.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.ttl: 2592000 2024-09-19T08:02:56.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T08:02:56.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T08:02:56.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T08:02:56.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.enable_blob_files: false 2024-09-19T08:02:56.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.min_blob_size: 0 2024-09-19T08:02:56.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T08:02:56.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T08:02:56.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T08:02:56.009 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T08:02:56.009 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T08:02:56.009 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T08:02:56.009 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T08:02:56.009 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T08:02:56.009 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T08:02:56.009 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T08:02:56.009 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d6bc7839-b227-4a4e-8550-c4a1364d0b2f 2024-09-19T08:02:56.009 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726732975666004, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T08:02:56.009 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T08:02:56.009 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726732975666408, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726732975, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d6bc7839-b227-4a4e-8550-c4a1364d0b2f", "db_session_id": "FYSN0SOHUCW13YLLU8TV", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T08:02:56.009 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726732975666502, "job": 1, "event": "recovery_finished"} 2024-09-19T08:02:56.010 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T08:02:56.010 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T08:02:56.010 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a272f04e00 2024-09-19T08:02:56.010 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: DB pointer 0x55a273000000 2024-09-19T08:02:56.010 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T08:02:56.010 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T08:02:56.010 INFO:journalctl@ceph.mon.b.smithi155.stdout: ** DB Stats ** 2024-09-19T08:02:56.010 INFO:journalctl@ceph.mon.b.smithi155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:02:56.010 INFO:journalctl@ceph.mon.b.smithi155.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T08:02:56.010 INFO:journalctl@ceph.mon.b.smithi155.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:02:56.010 INFO:journalctl@ceph.mon.b.smithi155.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:02:56.010 INFO:journalctl@ceph.mon.b.smithi155.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T08:02:56.011 INFO:journalctl@ceph.mon.b.smithi155.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:02:56.011 INFO:journalctl@ceph.mon.b.smithi155.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:02:56.011 INFO:journalctl@ceph.mon.b.smithi155.stdout: 2024-09-19T08:02:56.011 INFO:journalctl@ceph.mon.b.smithi155.stdout: ** Compaction Stats [default] ** 2024-09-19T08:02:56.011 INFO:journalctl@ceph.mon.b.smithi155.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:02:56.011 INFO:journalctl@ceph.mon.b.smithi155.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T08:02:56.011 INFO:journalctl@ceph.mon.b.smithi155.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:02:56.011 INFO:journalctl@ceph.mon.b.smithi155.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:02:56.011 INFO:journalctl@ceph.mon.b.smithi155.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:02:56.011 INFO:journalctl@ceph.mon.b.smithi155.stdout: 2024-09-19T08:02:56.011 INFO:journalctl@ceph.mon.b.smithi155.stdout: ** Compaction Stats [default] ** 2024-09-19T08:02:56.011 INFO:journalctl@ceph.mon.b.smithi155.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:02:56.012 INFO:journalctl@ceph.mon.b.smithi155.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T08:02:56.012 INFO:journalctl@ceph.mon.b.smithi155.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:02:56.012 INFO:journalctl@ceph.mon.b.smithi155.stdout: 2024-09-19T08:02:56.012 INFO:journalctl@ceph.mon.b.smithi155.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T08:02:56.012 INFO:journalctl@ceph.mon.b.smithi155.stdout: 2024-09-19T08:02:56.012 INFO:journalctl@ceph.mon.b.smithi155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:02:56.012 INFO:journalctl@ceph.mon.b.smithi155.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T08:02:56.012 INFO:journalctl@ceph.mon.b.smithi155.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T08:02:56.012 INFO:journalctl@ceph.mon.b.smithi155.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T08:02:56.012 INFO:journalctl@ceph.mon.b.smithi155.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T08:02:56.012 INFO:journalctl@ceph.mon.b.smithi155.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T08:02:56.013 INFO:journalctl@ceph.mon.b.smithi155.stdout: Cumulative compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:02:56.013 INFO:journalctl@ceph.mon.b.smithi155.stdout: Interval compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:02:56.013 INFO:journalctl@ceph.mon.b.smithi155.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T08:02:56.013 INFO:journalctl@ceph.mon.b.smithi155.stdout: Block cache BinnedLRUCache@0x55a272ed71f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T08:02:56.013 INFO:journalctl@ceph.mon.b.smithi155.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T08:02:56.013 INFO:journalctl@ceph.mon.b.smithi155.stdout: 2024-09-19T08:02:56.013 INFO:journalctl@ceph.mon.b.smithi155.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T08:02:56.014 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-19T08:02:56.014 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: using public_addr v2:172.21.15.155:0/0 -> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] 2024-09-19T08:02:56.014 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: starting mon.b rank -1 at public addrs [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] at bind addrs [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:02:56.014 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: mon.b@-1(???) e0 preinit fsid 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:02:56.014 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: mon.b@-1(synchronizing).mds e1 new map 2024-09-19T08:02:56.014 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-19T08:02:56.014 INFO:journalctl@ceph.mon.b.smithi155.stdout: e1 2024-09-19T08:02:56.014 INFO:journalctl@ceph.mon.b.smithi155.stdout: btime 2024-09-19T08:01:20:929052+0000 2024-09-19T08:02:56.014 INFO:journalctl@ceph.mon.b.smithi155.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:02:56.014 INFO:journalctl@ceph.mon.b.smithi155.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:02:56.014 INFO:journalctl@ceph.mon.b.smithi155.stdout: legacy client fscid: -1 2024-09-19T08:02:56.014 INFO:journalctl@ceph.mon.b.smithi155.stdout: 2024-09-19T08:02:56.015 INFO:journalctl@ceph.mon.b.smithi155.stdout: No filesystems configured 2024-09-19T08:02:56.015 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T08:02:56.015 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T08:02:56.015 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T08:02:56.015 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T08:02:56.015 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T08:02:56.015 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T08:02:56.015 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T08:02:56.015 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:02:56.015 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:02:56.015 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:02:56.015 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:56.015 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-19T08:02:56.015 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: Updating smithi203:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:02:56.016 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:02:56.016 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:56.016 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:56.016 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:56.016 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:56.016 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:02:56.016 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:02:56.016 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:02:56.016 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:56.016 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:02:56.016 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:02:56.016 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: Updating smithi203:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:02:56.016 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi027:172.21.15.27=a;smithi155:172.21.15.155=b;smithi203:172.21.15.203=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:02:56.017 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: Saving service mon spec with placement smithi027:172.21.15.27=a;smithi155:172.21.15.155=b;smithi203:172.21.15.203=c;count:3 2024-09-19T08:02:56.017 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: Deploying daemon mon.c on smithi203 2024-09-19T08:02:56.017 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:56.017 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:56.017 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='client.? 172.21.15.203:0/2868266184' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:02:56.017 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:02:56.017 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: mon.a calling monitor election 2024-09-19T08:02:56.017 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:56.017 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:56.017 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:56.017 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:56.017 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: mon.c calling monitor election 2024-09-19T08:02:56.017 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:56.018 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:56.018 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:56.018 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:56.018 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:56.018 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:02:56.018 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: monmap epoch 2 2024-09-19T08:02:56.018 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: fsid 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:02:56.018 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: last_changed 2024-09-19T08:02:46.721831+0000 2024-09-19T08:02:56.018 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: created 2024-09-19T08:01:17.912400+0000 2024-09-19T08:02:56.018 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: min_mon_release 19 (squid) 2024-09-19T08:02:56.018 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: election_strategy: 1 2024-09-19T08:02:56.018 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-09-19T08:02:56.018 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T08:02:56.018 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: fsmap 2024-09-19T08:02:56.019 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:02:56.019 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: mgrmap e13: x(active, since 38s) 2024-09-19T08:02:56.019 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: overall HEALTH_OK 2024-09-19T08:02:56.019 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:56.019 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:56.019 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:02:56.019 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:02:56.019 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:02:56.019 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: Deploying daemon mon.b on smithi155 2024-09-19T08:02:56.019 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='client.? 172.21.15.203:0/1153382388' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:02:56.019 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:02:56.019 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:02:56.019 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 ceph-mon[35362]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T08:02:56.020 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 bash[35343]: 5eee4da52791e89a80a4657be24183fed826111245e32506eaaec59b4c49388e 2024-09-19T08:02:56.020 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:02:55 smithi155 systemd[1]: Started Ceph mon.b for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:02:56.802 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:02:56.802 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:02:57.058 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:03:01.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:01.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:03:01.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: mon.a calling monitor election 2024-09-19T08:03:01.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: mon.c calling monitor election 2024-09-19T08:03:01.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:01.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:03:01.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:01.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:01.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:01.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:01.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:01.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:01.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:01.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:03:01.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: monmap epoch 3 2024-09-19T08:03:01.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: fsid 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:03:01.004 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: last_changed 2024-09-19T08:02:55.691296+0000 2024-09-19T08:03:01.004 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: created 2024-09-19T08:01:17.912400+0000 2024-09-19T08:03:01.004 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: min_mon_release 19 (squid) 2024-09-19T08:03:01.004 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: election_strategy: 1 2024-09-19T08:03:01.004 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-09-19T08:03:01.004 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T08:03:01.004 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: 2: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-19T08:03:01.004 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: fsmap 2024-09-19T08:03:01.004 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:03:01.004 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: mgrmap e13: x(active, since 47s) 2024-09-19T08:03:01.004 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: overall HEALTH_OK 2024-09-19T08:03:01.004 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:01.005 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:01.005 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:01.005 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:03:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: mon.a calling monitor election 2024-09-19T08:03:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: mon.c calling monitor election 2024-09-19T08:03:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:03:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:03:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: monmap epoch 3 2024-09-19T08:03:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: fsid 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:03:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: last_changed 2024-09-19T08:02:55.691296+0000 2024-09-19T08:03:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: created 2024-09-19T08:01:17.912400+0000 2024-09-19T08:03:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: min_mon_release 19 (squid) 2024-09-19T08:03:01.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: election_strategy: 1 2024-09-19T08:03:01.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-09-19T08:03:01.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T08:03:01.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: 2: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-19T08:03:01.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: fsmap 2024-09-19T08:03:01.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:03:01.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: mgrmap e13: x(active, since 47s) 2024-09-19T08:03:01.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: overall HEALTH_OK 2024-09-19T08:03:01.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:01.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:01.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:01.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:01.066 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.064+0000 7f8d73320640 1 -- 172.21.15.203:0/4203574836 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d6c106630 msgr2=0x7f8d58005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:01.067 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.064+0000 7f8d73320640 1 --2- 172.21.15.203:0/4203574836 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d6c106630 0x7f8d58005580 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8d68014d10 tx=0x7f8d6802c570 comp rx=0 tx=0).stop 2024-09-19T08:03:01.067 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.064+0000 7f8d73320640 1 -- 172.21.15.203:0/4203574836 shutdown_connections 2024-09-19T08:03:01.067 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.064+0000 7f8d73320640 1 --2- 172.21.15.203:0/4203574836 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d6c106630 0x7f8d58005580 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:01.067 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.064+0000 7f8d73320640 1 -- 172.21.15.203:0/4203574836 >> 172.21.15.203:0/4203574836 conn(0x7f8d6c0fc220 msgr2=0x7f8d6c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:03:01.067 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.064+0000 7f8d73320640 1 -- 172.21.15.203:0/4203574836 shutdown_connections 2024-09-19T08:03:01.067 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.064+0000 7f8d73320640 1 -- 172.21.15.203:0/4203574836 wait complete. 2024-09-19T08:03:01.067 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.065+0000 7f8d73320640 1 Processor -- start 2024-09-19T08:03:01.067 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.065+0000 7f8d73320640 1 -- start start 2024-09-19T08:03:01.067 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.065+0000 7f8d73320640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d6c106630 0x7f8d6c1021f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:03:01.067 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.065+0000 7f8d73320640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d6c102730 0x7f8d6c102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:03:01.067 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.065+0000 7f8d73320640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c1a34b0 0x7f8d6c1a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:03:01.067 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.065+0000 7f8d73320640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c108660 con 0x7f8d6c102730 2024-09-19T08:03:01.068 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.065+0000 7f8d73320640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c1084e0 con 0x7f8d6c1a34b0 2024-09-19T08:03:01.068 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.065+0000 7f8d73320640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c1087e0 con 0x7f8d6c106630 2024-09-19T08:03:01.068 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.065+0000 7f8d710bc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d6c106630 0x7f8d6c1021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:03:01.068 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.066+0000 7f8d710bc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d6c106630 0x7f8d6c1021f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:45026/0 (socket says 172.21.15.203:45026) 2024-09-19T08:03:01.068 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.066+0000 7f8d710bc640 1 -- 172.21.15.203:0/80480608 learned_addr learned my addr 172.21.15.203:0/80480608 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:03:01.068 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.066+0000 7f8d708bb640 1 --2- 172.21.15.203:0/80480608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d6c102730 0x7f8d6c102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:03:01.068 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.066+0000 7f8d710bc640 1 -- 172.21.15.203:0/80480608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d6c106630 msgr2=0x7f8d6c1021f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T08:03:01.068 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.066+0000 7f8d710bc640 1 -- 172.21.15.203:0/80480608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d6c106630 msgr2=0x7f8d6c1021f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:03:01.068 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.066+0000 7f8d710bc640 1 --2- 172.21.15.203:0/80480608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d6c106630 0x7f8d6c1021f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:03:01.068 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.066+0000 7f8d718bd640 1 --2- 172.21.15.203:0/80480608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c1a34b0 0x7f8d6c1a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:03:01.068 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.066+0000 7f8d710bc640 1 --2- 172.21.15.203:0/80480608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d6c106630 0x7f8d6c1021f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:03:01.068 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.066+0000 7f8d718bd640 1 -- 172.21.15.203:0/80480608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c1a34b0 msgr2=0x7f8d6c1a58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-19T08:03:01.068 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.066+0000 7f8d718bd640 1 -- 172.21.15.203:0/80480608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c1a34b0 msgr2=0x7f8d6c1a58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:03:01.069 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.066+0000 7f8d718bd640 1 --2- 172.21.15.203:0/80480608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c1a34b0 0x7f8d6c1a58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:03:01.069 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.066+0000 7f8d718bd640 1 --2- 172.21.15.203:0/80480608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c1a34b0 0x7f8d6c1a58a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:03:01.069 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.066+0000 7f8d708bb640 1 -- 172.21.15.203:0/80480608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d6c106630 msgr2=0x7f8d6c1021f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:03:01.069 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.066+0000 7f8d708bb640 1 --2- 172.21.15.203:0/80480608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d6c106630 0x7f8d6c1021f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:01.069 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.066+0000 7f8d708bb640 1 -- 172.21.15.203:0/80480608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c1a34b0 msgr2=0x7f8d6c1a58a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:03:01.069 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.066+0000 7f8d708bb640 1 --2- 172.21.15.203:0/80480608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c1a34b0 0x7f8d6c1a58a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:01.069 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.066+0000 7f8d708bb640 1 -- 172.21.15.203:0/80480608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6c1a5f70 con 0x7f8d6c102730 2024-09-19T08:03:01.069 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.066+0000 7f8d708bb640 1 --2- 172.21.15.203:0/80480608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d6c102730 0x7f8d6c102b90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00b450 tx=0x7f8d5c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:03:01.069 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.067+0000 7f8d627fc640 1 -- 172.21.15.203:0/80480608 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c004230 con 0x7f8d6c102730 2024-09-19T08:03:01.069 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.067+0000 7f8d73320640 1 -- 172.21.15.203:0/80480608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6c1a6260 con 0x7f8d6c102730 2024-09-19T08:03:01.069 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.067+0000 7f8d627fc640 1 -- 172.21.15.203:0/80480608 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d5c0043d0 con 0x7f8d6c102730 2024-09-19T08:03:01.069 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.067+0000 7f8d627fc640 1 -- 172.21.15.203:0/80480608 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c003cb0 con 0x7f8d6c102730 2024-09-19T08:03:01.070 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.067+0000 7f8d73320640 1 -- 172.21.15.203:0/80480608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d6c1a67a0 con 0x7f8d6c102730 2024-09-19T08:03:01.070 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.068+0000 7f8d627fc640 1 -- 172.21.15.203:0/80480608 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f8d5c00f050 con 0x7f8d6c102730 2024-09-19T08:03:01.070 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.068+0000 7f8d73320640 1 -- 172.21.15.203:0/80480608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d6c109750 con 0x7f8d6c102730 2024-09-19T08:03:01.071 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.068+0000 7f8d627fc640 1 --2- 172.21.15.203:0/80480608 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8d50039730 0x7f8d5003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:03:01.071 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.068+0000 7f8d627fc640 1 -- 172.21.15.203:0/80480608 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8d5c04c310 con 0x7f8d6c102730 2024-09-19T08:03:01.071 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.068+0000 7f8d710bc640 1 --2- 172.21.15.203:0/80480608 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8d50039730 0x7f8d5003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:03:01.071 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.068+0000 7f8d710bc640 1 --2- 172.21.15.203:0/80480608 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8d50039730 0x7f8d5003bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8d68005e40 tx=0x7f8d68004f20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:03:01.073 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.073+0000 7f8d627fc640 1 -- 172.21.15.203:0/80480608 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8d5c00d040 con 0x7f8d6c102730 2024-09-19T08:03:01.322 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.322+0000 7f8d73320640 1 -- 172.21.15.203:0/80480608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f8d6c1a6b30 con 0x7f8d6c102730 2024-09-19T08:03:01.323 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.322+0000 7f8d627fc640 1 -- 172.21.15.203:0/80480608 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7f8d5c00d540 con 0x7f8d6c102730 2024-09-19T08:03:01.323 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:03:01.323 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":3,"fsid":"35b531b0-765d-11ef-bceb-c7b262605968","modified":"2024-09-19T08:02:55.691296Z","created":"2024-09-19T08:01:17.912400Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:3300","nonce":0},{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T08:03:01.323 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 3 2024-09-19T08:03:01.325 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.325+0000 7f8d73320640 1 -- 172.21.15.203:0/80480608 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8d50039730 msgr2=0x7f8d5003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:01.325 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.325+0000 7f8d73320640 1 --2- 172.21.15.203:0/80480608 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8d50039730 0x7f8d5003bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8d68005e40 tx=0x7f8d68004f20 comp rx=0 tx=0).stop 2024-09-19T08:03:01.325 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.325+0000 7f8d73320640 1 -- 172.21.15.203:0/80480608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d6c102730 msgr2=0x7f8d6c102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:01.325 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.325+0000 7f8d73320640 1 --2- 172.21.15.203:0/80480608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d6c102730 0x7f8d6c102b90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00b450 tx=0x7f8d5c00b910 comp rx=0 tx=0).stop 2024-09-19T08:03:01.326 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.325+0000 7f8d73320640 1 -- 172.21.15.203:0/80480608 shutdown_connections 2024-09-19T08:03:01.326 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.325+0000 7f8d73320640 1 --2- 172.21.15.203:0/80480608 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8d50039730 0x7f8d5003bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:01.326 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.325+0000 7f8d73320640 1 --2- 172.21.15.203:0/80480608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c1a34b0 0x7f8d6c1a58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:01.326 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.325+0000 7f8d73320640 1 --2- 172.21.15.203:0/80480608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d6c102730 0x7f8d6c102b90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:01.326 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.325+0000 7f8d73320640 1 --2- 172.21.15.203:0/80480608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d6c106630 0x7f8d6c1021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:01.326 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.325+0000 7f8d73320640 1 -- 172.21.15.203:0/80480608 >> 172.21.15.203:0/80480608 conn(0x7f8d6c0fc220 msgr2=0x7f8d6c06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:03:01.326 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.325+0000 7f8d73320640 1 -- 172.21.15.203:0/80480608 shutdown_connections 2024-09-19T08:03:01.326 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:01.325+0000 7f8d73320640 1 -- 172.21.15.203:0/80480608 wait complete. 2024-09-19T08:03:02.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:01 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:02.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:01 smithi203 ceph-mon[35198]: from='client.? 172.21.15.203:0/80480608' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:03:02.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:01 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:02.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:01 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:02.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:01 smithi027 ceph-mon[31209]: from='client.? 172.21.15.203:0/80480608' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:03:02.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:01 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:02.555 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T08:03:02.555 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T08:03:02.817 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:03:02.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:03:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: mon.a calling monitor election 2024-09-19T08:03:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: mon.c calling monitor election 2024-09-19T08:03:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:03:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:02.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:02.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:02.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:02.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:03:02.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: monmap epoch 3 2024-09-19T08:03:02.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: fsid 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:03:02.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: last_changed 2024-09-19T08:02:55.691296+0000 2024-09-19T08:03:02.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: created 2024-09-19T08:01:17.912400+0000 2024-09-19T08:03:02.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: min_mon_release 19 (squid) 2024-09-19T08:03:02.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: election_strategy: 1 2024-09-19T08:03:02.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-09-19T08:03:02.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T08:03:02.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: 2: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-19T08:03:02.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: fsmap 2024-09-19T08:03:02.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:03:02.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: mgrmap e13: x(active, since 47s) 2024-09-19T08:03:02.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: overall HEALTH_OK 2024-09-19T08:03:02.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:02.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:02.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:02.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:02.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:02.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: from='client.? 172.21.15.203:0/80480608' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:03:02.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:03.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.285+0000 7f79d7ce5640 1 -- 172.21.15.27:0/1540413940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79d0106540 msgr2=0x7f79d0106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:03.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.285+0000 7f79d7ce5640 1 --2- 172.21.15.27:0/1540413940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79d0106540 0x7f79d0106920 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009810 tx=0x7f79cc02a540 comp rx=0 tx=0).stop 2024-09-19T08:03:03.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.285+0000 7f79d7ce5640 1 -- 172.21.15.27:0/1540413940 shutdown_connections 2024-09-19T08:03:03.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.285+0000 7f79d7ce5640 1 --2- 172.21.15.27:0/1540413940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79d0106540 0x7f79d0106920 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:03.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.285+0000 7f79d7ce5640 1 -- 172.21.15.27:0/1540413940 >> 172.21.15.27:0/1540413940 conn(0x7f79d0077310 msgr2=0x7f79d00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:03:03.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.285+0000 7f79d7ce5640 1 -- 172.21.15.27:0/1540413940 shutdown_connections 2024-09-19T08:03:03.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.285+0000 7f79d7ce5640 1 -- 172.21.15.27:0/1540413940 wait complete. 2024-09-19T08:03:03.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.286+0000 7f79d7ce5640 1 Processor -- start 2024-09-19T08:03:03.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.286+0000 7f79d7ce5640 1 -- start start 2024-09-19T08:03:03.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.286+0000 7f79d7ce5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79d0106540 0x7f79d0198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:03:03.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.286+0000 7f79d7ce5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79d0198680 0x7f79d0198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:03:03.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.286+0000 7f79d7ce5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79d01a11b0 0x7f79d01a35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:03:03.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.286+0000 7f79d7ce5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f79d010ab20 con 0x7f79d0106540 2024-09-19T08:03:03.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.286+0000 7f79d7ce5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f79d010a9a0 con 0x7f79d0198680 2024-09-19T08:03:03.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.286+0000 7f79d7ce5640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f79d010aca0 con 0x7f79d01a11b0 2024-09-19T08:03:03.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.286+0000 7f79d5a81640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79d0106540 0x7f79d0198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:03:03.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.286+0000 7f79d5a81640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79d0106540 0x7f79d0198140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42398/0 (socket says 172.21.15.27:42398) 2024-09-19T08:03:03.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.286+0000 7f79d5a81640 1 -- 172.21.15.27:0/1485661967 learned_addr learned my addr 172.21.15.27:0/1485661967 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:03:03.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.286+0000 7f79d6282640 1 --2- 172.21.15.27:0/1485661967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79d01a11b0 0x7f79d01a35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:03:03.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.286+0000 7f79d5280640 1 --2- 172.21.15.27:0/1485661967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79d0198680 0x7f79d0198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:03:03.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.286+0000 7f79d5a81640 1 -- 172.21.15.27:0/1485661967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79d01a11b0 msgr2=0x7f79d01a35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:03.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.286+0000 7f79d5a81640 1 --2- 172.21.15.27:0/1485661967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79d01a11b0 0x7f79d01a35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:03.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.286+0000 7f79d5a81640 1 -- 172.21.15.27:0/1485661967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79d0198680 msgr2=0x7f79d0198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:03.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.286+0000 7f79d5a81640 1 --2- 172.21.15.27:0/1485661967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79d0198680 0x7f79d0198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:03.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.286+0000 7f79d5a81640 1 -- 172.21.15.27:0/1485661967 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d01a3d40 con 0x7f79d0106540 2024-09-19T08:03:03.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.287+0000 7f79d5a81640 1 --2- 172.21.15.27:0/1485661967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79d0106540 0x7f79d0198140 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f79cc0307a0 tx=0x7f79cc0307d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:03:03.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.287+0000 7f79c6ffd640 1 -- 172.21.15.27:0/1485661967 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc040070 con 0x7f79d0106540 2024-09-19T08:03:03.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.287+0000 7f79c6ffd640 1 -- 172.21.15.27:0/1485661967 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79cc004c70 con 0x7f79d0106540 2024-09-19T08:03:03.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.287+0000 7f79d7ce5640 1 -- 172.21.15.27:0/1485661967 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d01a3fd0 con 0x7f79d0106540 2024-09-19T08:03:03.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.287+0000 7f79c6ffd640 1 -- 172.21.15.27:0/1485661967 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc02f570 con 0x7f79d0106540 2024-09-19T08:03:03.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.287+0000 7f79d7ce5640 1 -- 172.21.15.27:0/1485661967 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d01a4480 con 0x7f79d0106540 2024-09-19T08:03:03.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.288+0000 7f79c6ffd640 1 -- 172.21.15.27:0/1485661967 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f79cc039040 con 0x7f79d0106540 2024-09-19T08:03:03.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.288+0000 7f79c6ffd640 1 --2- 172.21.15.27:0/1485661967 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f79bc039730 0x7f79bc03bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:03:03.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.288+0000 7f79c6ffd640 1 -- 172.21.15.27:0/1485661967 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f79cc06d870 con 0x7f79d0106540 2024-09-19T08:03:03.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.288+0000 7f79d5280640 1 --2- 172.21.15.27:0/1485661967 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f79bc039730 0x7f79bc03bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:03:03.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.288+0000 7f79d7ce5640 1 -- 172.21.15.27:0/1485661967 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79d0101bb0 con 0x7f79d0106540 2024-09-19T08:03:03.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.288+0000 7f79d5280640 1 --2- 172.21.15.27:0/1485661967 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f79bc039730 0x7f79bc03bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f79c0006fd0 tx=0x7f79c0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:03:03.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.293+0000 7f79c6ffd640 1 -- 172.21.15.27:0/1485661967 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f79cc031a70 con 0x7f79d0106540 2024-09-19T08:03:03.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.476+0000 7f79d7ce5640 1 -- 172.21.15.27:0/1485661967 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f79d01a46b0 con 0x7f79d0106540 2024-09-19T08:03:03.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.476+0000 7f79c6ffd640 1 -- 172.21.15.27:0/1485661967 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f79cc004e20 con 0x7f79d0106540 2024-09-19T08:03:03.477 INFO:teuthology.orchestra.run.smithi027.stdout:# minimal ceph.conf for 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:03:03.477 INFO:teuthology.orchestra.run.smithi027.stdout:[global] 2024-09-19T08:03:03.477 INFO:teuthology.orchestra.run.smithi027.stdout: fsid = 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:03:03.477 INFO:teuthology.orchestra.run.smithi027.stdout: mon_host = [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-19T08:03:03.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.478+0000 7f79d7ce5640 1 -- 172.21.15.27:0/1485661967 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f79bc039730 msgr2=0x7f79bc03bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:03.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.478+0000 7f79d7ce5640 1 --2- 172.21.15.27:0/1485661967 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f79bc039730 0x7f79bc03bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f79c0006fd0 tx=0x7f79c0008040 comp rx=0 tx=0).stop 2024-09-19T08:03:03.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.478+0000 7f79d7ce5640 1 -- 172.21.15.27:0/1485661967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79d0106540 msgr2=0x7f79d0198140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:03.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.478+0000 7f79d7ce5640 1 --2- 172.21.15.27:0/1485661967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79d0106540 0x7f79d0198140 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f79cc0307a0 tx=0x7f79cc0307d0 comp rx=0 tx=0).stop 2024-09-19T08:03:03.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.479+0000 7f79d7ce5640 1 -- 172.21.15.27:0/1485661967 shutdown_connections 2024-09-19T08:03:03.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.479+0000 7f79d7ce5640 1 --2- 172.21.15.27:0/1485661967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79d01a11b0 0x7f79d01a35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:03.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.479+0000 7f79d7ce5640 1 --2- 172.21.15.27:0/1485661967 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f79bc039730 0x7f79bc03bbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:03.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.479+0000 7f79d7ce5640 1 --2- 172.21.15.27:0/1485661967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79d0198680 0x7f79d0198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:03.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.479+0000 7f79d7ce5640 1 --2- 172.21.15.27:0/1485661967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79d0106540 0x7f79d0198140 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:03.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.479+0000 7f79d7ce5640 1 -- 172.21.15.27:0/1485661967 >> 172.21.15.27:0/1485661967 conn(0x7f79d0077310 msgr2=0x7f79d00fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:03:03.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.479+0000 7f79d7ce5640 1 -- 172.21.15.27:0/1485661967 shutdown_connections 2024-09-19T08:03:03.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:03.479+0000 7f79d7ce5640 1 -- 172.21.15.27:0/1485661967 wait complete. 2024-09-19T08:03:03.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: mon.b calling monitor election 2024-09-19T08:03:03.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-19T08:03:03.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-19T08:03:03.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-19T08:03:03.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: Updating smithi155:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:03:03.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: Updating smithi203:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:03:03.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: Updating smithi027:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:03:03.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T08:03:03.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: Reconfiguring daemon mon.a on smithi027 2024-09-19T08:03:03.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: mon.b calling monitor election 2024-09-19T08:03:03.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: mon.c calling monitor election 2024-09-19T08:03:03.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: mon.a calling monitor election 2024-09-19T08:03:03.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:03:03.754 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: monmap epoch 3 2024-09-19T08:03:03.754 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: fsid 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:03:03.754 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: last_changed 2024-09-19T08:02:55.691296+0000 2024-09-19T08:03:03.754 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: created 2024-09-19T08:01:17.912400+0000 2024-09-19T08:03:03.754 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: min_mon_release 19 (squid) 2024-09-19T08:03:03.754 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: election_strategy: 1 2024-09-19T08:03:03.754 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-09-19T08:03:03.754 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T08:03:03.754 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: 2: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-19T08:03:03.754 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: fsmap 2024-09-19T08:03:03.754 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:03:03.754 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: mgrmap e13: x(active, since 49s) 2024-09-19T08:03:03.754 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: overall HEALTH_OK 2024-09-19T08:03:03.754 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:03.755 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:03 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1485661967' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:03.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: mon.b calling monitor election 2024-09-19T08:03:03.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-19T08:03:03.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-19T08:03:03.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-19T08:03:03.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: Updating smithi155:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:03:03.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: Updating smithi203:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:03:03.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: Updating smithi027:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:03:03.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T08:03:03.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: Reconfiguring daemon mon.a on smithi027 2024-09-19T08:03:03.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: mon.b calling monitor election 2024-09-19T08:03:03.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: mon.c calling monitor election 2024-09-19T08:03:03.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: mon.a calling monitor election 2024-09-19T08:03:03.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:03:03.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: monmap epoch 3 2024-09-19T08:03:03.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: fsid 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:03:03.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: last_changed 2024-09-19T08:02:55.691296+0000 2024-09-19T08:03:03.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: created 2024-09-19T08:01:17.912400+0000 2024-09-19T08:03:03.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: min_mon_release 19 (squid) 2024-09-19T08:03:03.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: election_strategy: 1 2024-09-19T08:03:03.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-09-19T08:03:03.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T08:03:03.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: 2: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-19T08:03:03.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: fsmap 2024-09-19T08:03:03.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:03:03.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: mgrmap e13: x(active, since 49s) 2024-09-19T08:03:03.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: overall HEALTH_OK 2024-09-19T08:03:03.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:03.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:03 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1485661967' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:04.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: mon.b calling monitor election 2024-09-19T08:03:04.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-19T08:03:04.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-19T08:03:04.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-19T08:03:04.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: Updating smithi155:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:03:04.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: Updating smithi203:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:03:04.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: Updating smithi027:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:03:04.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T08:03:04.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: Reconfiguring daemon mon.a on smithi027 2024-09-19T08:03:04.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: mon.b calling monitor election 2024-09-19T08:03:04.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: mon.c calling monitor election 2024-09-19T08:03:04.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: mon.a calling monitor election 2024-09-19T08:03:04.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:03:04.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: monmap epoch 3 2024-09-19T08:03:04.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: fsid 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:03:04.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: last_changed 2024-09-19T08:02:55.691296+0000 2024-09-19T08:03:04.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: created 2024-09-19T08:01:17.912400+0000 2024-09-19T08:03:04.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: min_mon_release 19 (squid) 2024-09-19T08:03:04.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: election_strategy: 1 2024-09-19T08:03:04.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-09-19T08:03:04.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T08:03:04.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: 2: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-19T08:03:04.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: fsmap 2024-09-19T08:03:04.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:03:04.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: mgrmap e13: x(active, since 49s) 2024-09-19T08:03:04.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: overall HEALTH_OK 2024-09-19T08:03:04.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:04.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:03 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1485661967' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:04.083 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T08:03:04.084 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-19T08:03:04.084 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:03:04.113 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-19T08:03:04.113 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:03:04.178 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T08:03:04.179 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:03:04.211 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T08:03:04.211 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:03:04.279 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T08:03:04.280 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:03:04.312 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T08:03:04.312 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:03:04.382 INFO:tasks.cephadm:Adding mgr.x on smithi027 2024-09-19T08:03:04.383 INFO:tasks.cephadm:Adding mgr.y on smithi155 2024-09-19T08:03:04.383 INFO:tasks.cephadm:Adding mgr.z on smithi203 2024-09-19T08:03:04.383 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi027=x;smithi155=y;smithi203=z' 2024-09-19T08:03:04.669 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:03:04.911 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:04 smithi203 ceph-mon[35198]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:04.911 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:04 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:04.952 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:04 smithi027 ceph-mon[31209]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:04.952 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:04 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:04.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:04 smithi155 ceph-mon[35362]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:04.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:04 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:03:05.122 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.120+0000 7f9019c97640 1 -- 172.21.15.203:0/1623116056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90141016e0 msgr2=0x7f9014101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:05.123 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.120+0000 7f9019c97640 1 --2- 172.21.15.203:0/1623116056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90141016e0 0x7f9014101ae0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009880 tx=0x7f8ffc02a5d0 comp rx=0 tx=0).stop 2024-09-19T08:03:05.123 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.120+0000 7f9019c97640 1 -- 172.21.15.203:0/1623116056 shutdown_connections 2024-09-19T08:03:05.123 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.120+0000 7f9019c97640 1 --2- 172.21.15.203:0/1623116056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90141016e0 0x7f9014101ae0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:05.123 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.120+0000 7f9019c97640 1 -- 172.21.15.203:0/1623116056 >> 172.21.15.203:0/1623116056 conn(0x7f90140fce90 msgr2=0x7f90140ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:03:05.123 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.120+0000 7f9019c97640 1 -- 172.21.15.203:0/1623116056 shutdown_connections 2024-09-19T08:03:05.123 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.120+0000 7f9019c97640 1 -- 172.21.15.203:0/1623116056 wait complete. 2024-09-19T08:03:05.123 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.121+0000 7f9019c97640 1 Processor -- start 2024-09-19T08:03:05.123 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.121+0000 7f9019c97640 1 -- start start 2024-09-19T08:03:05.123 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.121+0000 7f9019c97640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90141016e0 0x7f9014196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:03:05.123 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.121+0000 7f9019c97640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9014197510 0x7f901419c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:03:05.123 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.121+0000 7f9019c97640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9014197990 0x7f901419eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:03:05.123 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.121+0000 7f9019c97640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f90141077d0 con 0x7f9014197990 2024-09-19T08:03:05.123 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.121+0000 7f9019c97640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9014107650 con 0x7f90141016e0 2024-09-19T08:03:05.124 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.121+0000 7f9019c97640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9014107950 con 0x7f9014197510 2024-09-19T08:03:05.124 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.121+0000 7f9012ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9014197510 0x7f901419c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:03:05.124 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.121+0000 7f9012ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9014197510 0x7f901419c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:45032/0 (socket says 172.21.15.203:45032) 2024-09-19T08:03:05.124 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.121+0000 7f9012ffd640 1 -- 172.21.15.203:0/401570055 learned_addr learned my addr 172.21.15.203:0/401570055 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:03:05.124 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.121+0000 7f9013fff640 1 --2- 172.21.15.203:0/401570055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9014197990 0x7f901419eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:03:05.124 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.121+0000 7f90137fe640 1 --2- 172.21.15.203:0/401570055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90141016e0 0x7f9014196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:03:05.124 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.122+0000 7f9012ffd640 1 -- 172.21.15.203:0/401570055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90141016e0 msgr2=0x7f9014196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:05.124 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.122+0000 7f9012ffd640 1 --2- 172.21.15.203:0/401570055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90141016e0 0x7f9014196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:05.124 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.122+0000 7f9012ffd640 1 -- 172.21.15.203:0/401570055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9014197990 msgr2=0x7f901419eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:05.124 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.122+0000 7f9012ffd640 1 --2- 172.21.15.203:0/401570055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9014197990 0x7f901419eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:05.124 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.122+0000 7f9012ffd640 1 -- 172.21.15.203:0/401570055 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901419f3d0 con 0x7f9014197510 2024-09-19T08:03:05.125 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.122+0000 7f9013fff640 1 --2- 172.21.15.203:0/401570055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9014197990 0x7f901419eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:03:05.125 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.122+0000 7f9012ffd640 1 --2- 172.21.15.203:0/401570055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9014197510 0x7f901419c580 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f900400b520 tx=0x7f900400b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:03:05.125 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.122+0000 7f9010ff9640 1 -- 172.21.15.203:0/401570055 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004004230 con 0x7f9014197510 2024-09-19T08:03:05.125 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.122+0000 7f9010ff9640 1 -- 172.21.15.203:0/401570055 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90040043d0 con 0x7f9014197510 2024-09-19T08:03:05.125 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.122+0000 7f9019c97640 1 -- 172.21.15.203:0/401570055 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f901419f6c0 con 0x7f9014197510 2024-09-19T08:03:05.125 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.122+0000 7f9010ff9640 1 -- 172.21.15.203:0/401570055 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004003d60 con 0x7f9014197510 2024-09-19T08:03:05.125 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.122+0000 7f9019c97640 1 -- 172.21.15.203:0/401570055 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f901419fc80 con 0x7f9014197510 2024-09-19T08:03:05.126 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.123+0000 7f9010ff9640 1 -- 172.21.15.203:0/401570055 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f900400e070 con 0x7f9014197510 2024-09-19T08:03:05.126 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.123+0000 7f9019c97640 1 -- 172.21.15.203:0/401570055 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9014190590 con 0x7f9014197510 2024-09-19T08:03:05.126 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.123+0000 7f9010ff9640 1 --2- 172.21.15.203:0/401570055 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f9000039730 0x7f900003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:03:05.126 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.123+0000 7f9010ff9640 1 -- 172.21.15.203:0/401570055 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f900404beb0 con 0x7f9014197510 2024-09-19T08:03:05.126 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.123+0000 7f90137fe640 1 --2- 172.21.15.203:0/401570055 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f9000039730 0x7f900003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:03:05.126 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.124+0000 7f90137fe640 1 --2- 172.21.15.203:0/401570055 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f9000039730 0x7f900003bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009230 tx=0x7f8ffc0315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:03:05.128 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.128+0000 7f9010ff9640 1 -- 172.21.15.203:0/401570055 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9004014020 con 0x7f9014197510 2024-09-19T08:03:05.306 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.306+0000 7f9019c97640 1 -- 172.21.15.203:0/401570055 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi027=x;smithi155=y;smithi203=z", "target": ["mon-mgr", ""]}) -- 0x7f90140626c0 con 0x7f9000039730 2024-09-19T08:03:05.311 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.311+0000 7f9010ff9640 1 -- 172.21.15.203:0/401570055 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f90140626c0 con 0x7f9000039730 2024-09-19T08:03:05.312 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled mgr update... 2024-09-19T08:03:05.314 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.313+0000 7f9019c97640 1 -- 172.21.15.203:0/401570055 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f9000039730 msgr2=0x7f900003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:05.314 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.313+0000 7f9019c97640 1 --2- 172.21.15.203:0/401570055 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f9000039730 0x7f900003bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009230 tx=0x7f8ffc0315d0 comp rx=0 tx=0).stop 2024-09-19T08:03:05.314 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.314+0000 7f9019c97640 1 -- 172.21.15.203:0/401570055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9014197510 msgr2=0x7f901419c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:05.314 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.314+0000 7f9019c97640 1 --2- 172.21.15.203:0/401570055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9014197510 0x7f901419c580 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f900400b520 tx=0x7f900400b9e0 comp rx=0 tx=0).stop 2024-09-19T08:03:05.314 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.314+0000 7f9019c97640 1 -- 172.21.15.203:0/401570055 shutdown_connections 2024-09-19T08:03:05.314 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.314+0000 7f9019c97640 1 --2- 172.21.15.203:0/401570055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9014197990 0x7f901419eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:05.314 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.314+0000 7f9019c97640 1 --2- 172.21.15.203:0/401570055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9014197510 0x7f901419c580 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:05.314 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.314+0000 7f9019c97640 1 --2- 172.21.15.203:0/401570055 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f9000039730 0x7f900003bbf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:05.314 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.314+0000 7f9019c97640 1 --2- 172.21.15.203:0/401570055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90141016e0 0x7f9014196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:05.314 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.314+0000 7f9019c97640 1 -- 172.21.15.203:0/401570055 >> 172.21.15.203:0/401570055 conn(0x7f90140fce90 msgr2=0x7f90140fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:03:05.314 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.314+0000 7f9019c97640 1 -- 172.21.15.203:0/401570055 shutdown_connections 2024-09-19T08:03:05.315 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:03:05.314+0000 7f9019c97640 1 -- 172.21.15.203:0/401570055 wait complete. 2024-09-19T08:03:05.961 DEBUG:teuthology.orchestra.run.smithi155:mgr.y> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T08:03:05.964 DEBUG:teuthology.orchestra.run.smithi203:mgr.z> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T08:03:05.966 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T08:03:05.966 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-19T08:03:05.966 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:03:05.987 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:03:05.987 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_1 2024-09-19T08:03:06.048 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:03:06.048 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:03:06.048 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T08:03:06.048 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:03:06.048 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:03:06.048 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-09-19 08:02:23.845893527 +0000 2024-09-19T08:03:06.048 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-09-19 07:57:52.430614795 +0000 2024-09-19T08:03:06.048 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-09-19 07:57:52.430614795 +0000 2024-09-19T08:03:06.048 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-09-19 07:57:52.430614795 +0000 2024-09-19T08:03:06.049 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:03:06.118 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-09-19T08:03:06.118 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-09-19T08:03:06.118 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000215101 s, 2.4 MB/s 2024-09-19T08:03:06.120 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:03:06.180 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_2 2024-09-19T08:03:06.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:06 smithi155 ceph-mon[35362]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:06.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:06 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:06.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:06 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:06.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:06 smithi155 ceph-mon[35362]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:03:06.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:06 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:03:06.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:06 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:03:06.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:06 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:06.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:06 smithi155 ceph-mon[35362]: Reconfiguring daemon mon.b on smithi155 2024-09-19T08:03:06.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:06 smithi155 ceph-mon[35362]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi027=x;smithi155=y;smithi203=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:03:06.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:06 smithi155 ceph-mon[35362]: Saving service mgr spec with placement smithi027=x;smithi155=y;smithi203=z;count:3 2024-09-19T08:03:06.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:06 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:06.239 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:03:06.239 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:03:06.239 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-19T08:03:06.239 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:03:06.239 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:03:06.239 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-09-19 08:02:23.871892891 +0000 2024-09-19T08:03:06.239 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-09-19 07:57:52.786605768 +0000 2024-09-19T08:03:06.239 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-09-19 07:57:52.786605768 +0000 2024-09-19T08:03:06.239 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-09-19 07:57:52.786605768 +0000 2024-09-19T08:03:06.240 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:03:06.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:06 smithi203 ceph-mon[35198]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:06.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:06 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:06.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:06 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:06.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:06 smithi203 ceph-mon[35198]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:03:06.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:06 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:03:06.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:06 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:03:06.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:06 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:06.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:06 smithi203 ceph-mon[35198]: Reconfiguring daemon mon.b on smithi155 2024-09-19T08:03:06.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:06 smithi203 ceph-mon[35198]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi027=x;smithi155=y;smithi203=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:03:06.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:06 smithi203 ceph-mon[35198]: Saving service mgr spec with placement smithi027=x;smithi155=y;smithi203=z;count:3 2024-09-19T08:03:06.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:06 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:06.304 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:06 smithi027 ceph-mon[31209]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:06.304 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:06 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:06.304 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:06 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:06.304 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:06 smithi027 ceph-mon[31209]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:03:06.304 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:06 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:03:06.304 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:06 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:03:06.304 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:06 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:06.304 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:06 smithi027 ceph-mon[31209]: Reconfiguring daemon mon.b on smithi155 2024-09-19T08:03:06.305 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:06 smithi027 ceph-mon[31209]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi027=x;smithi155=y;smithi203=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:03:06.305 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:06 smithi027 ceph-mon[31209]: Saving service mgr spec with placement smithi027=x;smithi155=y;smithi203=z;count:3 2024-09-19T08:03:06.305 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:06 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:06.306 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-09-19T08:03:06.306 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-09-19T08:03:06.306 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000213106 s, 2.4 MB/s 2024-09-19T08:03:06.308 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:03:06.367 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_3 2024-09-19T08:03:06.425 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:03:06.425 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:03:06.426 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T08:03:06.426 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:03:06.426 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:03:06.426 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-09-19 08:02:23.903892107 +0000 2024-09-19T08:03:06.426 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-09-19 07:57:53.127597121 +0000 2024-09-19T08:03:06.426 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-09-19 07:57:53.127597121 +0000 2024-09-19T08:03:06.426 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-09-19 07:57:53.127597121 +0000 2024-09-19T08:03:06.426 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:03:06.491 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-09-19T08:03:06.492 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-09-19T08:03:06.492 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000212578 s, 2.4 MB/s 2024-09-19T08:03:06.493 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:03:06.552 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_4 2024-09-19T08:03:06.610 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:03:06.610 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:03:06.611 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T08:03:06.611 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:03:06.611 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:03:06.611 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-09-19 08:02:23.937891275 +0000 2024-09-19T08:03:06.611 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-09-19 07:57:53.464588575 +0000 2024-09-19T08:03:06.611 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-09-19 07:57:53.464588575 +0000 2024-09-19T08:03:06.611 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-09-19 07:57:53.464588575 +0000 2024-09-19T08:03:06.611 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:03:06.677 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-09-19T08:03:06.677 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-09-19T08:03:06.677 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000210811 s, 2.4 MB/s 2024-09-19T08:03:06.678 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:03:06.737 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T08:03:06.737 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:03:06.753 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:03:06.754 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 2024-09-19T08:03:06.809 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:03:06.809 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:03:06.809 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-19T08:03:06.809 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:03:06.809 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:03:06.809 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-19 08:02:55.095123213 +0000 2024-09-19T08:03:06.810 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-19 07:58:06.417043610 +0000 2024-09-19T08:03:06.810 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-19 07:58:06.417043610 +0000 2024-09-19T08:03:06.810 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-19 07:58:06.417043610 +0000 2024-09-19T08:03:06.810 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:03:06.873 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-19T08:03:06.874 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-19T08:03:06.874 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000247402 s, 2.1 MB/s 2024-09-19T08:03:06.875 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:03:06.931 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 2024-09-19T08:03:06.987 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:03:06.987 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:03:06.987 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-19T08:03:06.987 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:03:06.987 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:03:06.987 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-19 08:02:55.096123193 +0000 2024-09-19T08:03:06.987 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-19 07:58:06.743036931 +0000 2024-09-19T08:03:06.987 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-19 07:58:06.743036931 +0000 2024-09-19T08:03:06.988 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-19 07:58:06.743036931 +0000 2024-09-19T08:03:06.988 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:03:07.051 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-19T08:03:07.051 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-19T08:03:07.051 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000176588 s, 2.9 MB/s 2024-09-19T08:03:07.052 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:03:07.109 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 2024-09-19T08:03:07.165 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:03:07.165 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:03:07.165 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T08:03:07.165 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:03:07.166 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:03:07.166 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-19 08:02:55.096123193 +0000 2024-09-19T08:03:07.166 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-19 07:58:07.118029248 +0000 2024-09-19T08:03:07.166 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-19 07:58:07.118029248 +0000 2024-09-19T08:03:07.166 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-19 07:58:07.118029248 +0000 2024-09-19T08:03:07.166 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:03:07.229 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-19T08:03:07.229 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-19T08:03:07.230 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000187718 s, 2.7 MB/s 2024-09-19T08:03:07.231 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:03:07.287 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 2024-09-19T08:03:07.342 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:03:07.342 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:03:07.342 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T08:03:07.342 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:03:07.343 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:03:07.343 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-19 08:02:55.096123193 +0000 2024-09-19T08:03:07.343 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-19 07:58:07.443022590 +0000 2024-09-19T08:03:07.343 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-19 07:58:07.443022590 +0000 2024-09-19T08:03:07.343 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-19 07:58:07.443022590 +0000 2024-09-19T08:03:07.343 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:03:07.406 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-19T08:03:07.406 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-19T08:03:07.407 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000214152 s, 2.4 MB/s 2024-09-19T08:03:07.408 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:03:07.464 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T08:03:07.464 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:03:07.481 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:03:07.481 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_1 2024-09-19T08:03:07.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:07 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:07.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:07 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:07.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:07 smithi155 ceph-mon[35362]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:03:07.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:07 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:03:07.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:07 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:03:07.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:07 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:07.488 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:07 smithi155 ceph-mon[35362]: Reconfiguring daemon mon.c on smithi203 2024-09-19T08:03:07.538 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:03:07.538 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:03:07.538 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-09-19T08:03:07.538 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:03:07.538 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:03:07.538 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-19 08:02:45.771245203 +0000 2024-09-19T08:03:07.538 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-19 07:58:00.027933123 +0000 2024-09-19T08:03:07.538 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-19 07:58:00.027933123 +0000 2024-09-19T08:03:07.538 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-09-19 07:58:00.027933123 +0000 2024-09-19T08:03:07.539 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:03:07.604 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-19T08:03:07.604 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-19T08:03:07.604 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000326859 s, 1.6 MB/s 2024-09-19T08:03:07.605 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:03:07.663 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_2 2024-09-19T08:03:07.682 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:07 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:07.682 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:07 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:07.682 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:07 smithi203 ceph-mon[35198]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:03:07.682 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:07 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:03:07.682 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:07 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:03:07.682 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:07 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:07.682 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:07 smithi203 ceph-mon[35198]: Reconfiguring daemon mon.c on smithi203 2024-09-19T08:03:07.698 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:03:07.698 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:03:07.698 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T08:03:07.698 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:03:07.698 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:03:07.698 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-19 08:02:45.771245203 +0000 2024-09-19T08:03:07.698 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-19 07:58:00.346924598 +0000 2024-09-19T08:03:07.699 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-19 07:58:00.346924598 +0000 2024-09-19T08:03:07.699 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-09-19 07:58:00.346924598 +0000 2024-09-19T08:03:07.699 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:03:07.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:07 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:07.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:07 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:07.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:07 smithi027 ceph-mon[31209]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:03:07.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:07 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:03:07.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:07 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:03:07.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:07 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:07.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:07 smithi027 ceph-mon[31209]: Reconfiguring daemon mon.c on smithi203 2024-09-19T08:03:07.764 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-19T08:03:07.765 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-19T08:03:07.765 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.0014859 s, 345 kB/s 2024-09-19T08:03:07.767 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:03:07.823 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_3 2024-09-19T08:03:07.878 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:03:07.878 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:03:07.879 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T08:03:07.879 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:03:07.879 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:03:07.879 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-19 08:02:45.771245203 +0000 2024-09-19T08:03:07.879 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-19 07:58:00.688915459 +0000 2024-09-19T08:03:07.879 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-19 07:58:00.688915459 +0000 2024-09-19T08:03:07.879 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-09-19 07:58:00.688915459 +0000 2024-09-19T08:03:07.879 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:03:07.943 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-19T08:03:07.944 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-19T08:03:07.944 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000202187 s, 2.5 MB/s 2024-09-19T08:03:07.946 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:03:08.005 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_4 2024-09-19T08:03:08.063 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:03:08.063 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:03:08.064 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-19T08:03:08.064 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:03:08.064 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:03:08.064 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-19 08:02:45.772245177 +0000 2024-09-19T08:03:08.065 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-19 07:58:01.017906667 +0000 2024-09-19T08:03:08.065 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-19 07:58:01.017906667 +0000 2024-09-19T08:03:08.065 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-09-19 07:58:01.017906667 +0000 2024-09-19T08:03:08.065 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:03:08.127 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-19T08:03:08.127 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-19T08:03:08.127 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000169319 s, 3.0 MB/s 2024-09-19T08:03:08.128 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:03:08.186 INFO:tasks.cephadm:Deploying osd.0 on smithi027 with /dev/vg_nvme/lv_4... 2024-09-19T08:03:08.187 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:03:08.450 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:03:08.855 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:08 smithi027 ceph-mon[31209]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:08.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:08 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:08.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:08 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:08.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:08 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:08.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:08 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:08.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:08 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:03:08.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:08 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:08.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:08 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:03:08.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:08 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:03:08.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:08 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:03:08.856 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:08 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:08.857 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:08 smithi027 ceph-mon[31209]: Deploying daemon mgr.z on smithi203 2024-09-19T08:03:09.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:08 smithi203 ceph-mon[35198]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:09.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:08 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:09.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:08 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:09.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:08 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:09.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:08 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:09.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:08 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:03:09.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:08 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:09.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:08 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:03:09.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:08 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:03:09.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:08 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:03:09.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:08 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:09.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:08 smithi203 ceph-mon[35198]: Deploying daemon mgr.z on smithi203 2024-09-19T08:03:09.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:08 smithi155 ceph-mon[35362]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:09.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:08 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:09.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:08 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:09.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:08 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:09.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:08 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:09.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:08 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:03:09.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:08 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:09.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:08 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:03:09.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:08 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:03:09.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:08 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:03:09.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:08 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:09.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:08 smithi155 ceph-mon[35362]: Deploying daemon mgr.z on smithi203 2024-09-19T08:03:09.705 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:09 smithi203 systemd[1]: Starting Ceph mgr.z for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:03:09.961 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:09 smithi203 podman[36996]: 2024-09-19 08:03:09.607414095 +0000 UTC m=+0.015888400 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:03:09.962 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:09 smithi203 podman[36996]: 2024-09-19 08:03:09.709278407 +0000 UTC m=+0.117752713 container create 8ba3e5d00917c80f6c05c23b6ae92e907fdc23267cd4dae8627d3fabeee024bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T08:03:09.962 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:09 smithi203 podman[36996]: 2024-09-19 08:03:09.962422797 +0000 UTC m=+0.370897100 container init 8ba3e5d00917c80f6c05c23b6ae92e907fdc23267cd4dae8627d3fabeee024bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4) 2024-09-19T08:03:10.258 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:09 smithi203 podman[36996]: 2024-09-19 08:03:09.965203044 +0000 UTC m=+0.373677347 container start 8ba3e5d00917c80f6c05c23b6ae92e907fdc23267cd4dae8627d3fabeee024bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T08:03:10.258 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:09 smithi203 ceph-mgr[37014]: -- 172.21.15.203:0/4165615773 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556cf80fd0e0 con 0x556cf80da800 2024-09-19T08:03:10.259 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:10 smithi203 bash[36996]: 8ba3e5d00917c80f6c05c23b6ae92e907fdc23267cd4dae8627d3fabeee024bf 2024-09-19T08:03:10.259 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:10 smithi203 systemd[1]: Started Ceph mgr.z for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:03:10.259 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:10 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:10.085+0000 7fcf8e48f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:03:10.259 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:10 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:10.147+0000 7fcf8e48f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:03:10.651 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:10 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:10.296+0000 7fcf8e48f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:03:10.651 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:10 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:10.362+0000 7fcf8e48f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:03:10.651 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:10 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:10.510+0000 7fcf8e48f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:03:10.651 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:10 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:10.651+0000 7fcf8e48f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:03:10.744 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:03:10.771 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi027:vg_nvme/lv_4 2024-09-19T08:03:10.905 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:10 smithi155 ceph-mon[35362]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:10.905 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:10 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:10.905 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:10 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:10.906 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:10 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:10.906 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:10 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:03:10.906 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:10 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:03:10.906 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:10 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:03:10.906 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:10 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:10.969 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:10 smithi203 ceph-mon[35198]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:10.969 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:10 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:10.969 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:10 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:10.969 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:10 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:10.969 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:10 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:03:10.969 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:10 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:03:10.969 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:10 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:03:10.969 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:10 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:11.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:10 smithi027 ceph-mon[31209]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:11.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:10 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:11.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:10 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:11.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:10 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:11.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:10 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:03:11.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:10 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:03:11.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:10 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:03:11.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:10 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:11.023 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:03:11.258 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:10 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:10.968+0000 7fcf8e48f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:03:11.258 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:11 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:11.029+0000 7fcf8e48f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:03:11.258 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:11 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:11.214+0000 7fcf8e48f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:03:11.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.469+0000 7f6873d04640 1 -- 172.21.15.27:0/1281193851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f686c1037c0 msgr2=0x7f686c10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:11.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.469+0000 7f6873d04640 1 --2- 172.21.15.27:0/1281193851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f686c1037c0 0x7f686c10a050 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6864009ca0 tx=0x7f686402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:03:11.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.469+0000 7f6873d04640 1 -- 172.21.15.27:0/1281193851 shutdown_connections 2024-09-19T08:03:11.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.469+0000 7f6873d04640 1 --2- 172.21.15.27:0/1281193851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f686c1037c0 0x7f686c10a050 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:11.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.469+0000 7f6873d04640 1 --2- 172.21.15.27:0/1281193851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f686c102e00 0x7f686c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:11.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.469+0000 7f6873d04640 1 --2- 172.21.15.27:0/1281193851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f686c101c00 0x7f686c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:11.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.469+0000 7f6873d04640 1 -- 172.21.15.27:0/1281193851 >> 172.21.15.27:0/1281193851 conn(0x7f686c0fd390 msgr2=0x7f686c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:03:11.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.470+0000 7f6873d04640 1 -- 172.21.15.27:0/1281193851 shutdown_connections 2024-09-19T08:03:11.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.470+0000 7f6873d04640 1 -- 172.21.15.27:0/1281193851 wait complete. 2024-09-19T08:03:11.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.470+0000 7f6873d04640 1 Processor -- start 2024-09-19T08:03:11.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.470+0000 7f6873d04640 1 -- start start 2024-09-19T08:03:11.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.470+0000 7f6873d04640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f686c101c00 0x7f686c197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:03:11.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.470+0000 7f6873d04640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f686c102e00 0x7f686c198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:03:11.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.470+0000 7f6873d04640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f686c1037c0 0x7f686c19f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:03:11.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.470+0000 7f6873d04640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f686c10d8b0 con 0x7f686c101c00 2024-09-19T08:03:11.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.470+0000 7f6873d04640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f686c10d730 con 0x7f686c102e00 2024-09-19T08:03:11.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.470+0000 7f6873d04640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f686c10da30 con 0x7f686c1037c0 2024-09-19T08:03:11.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.470+0000 7f6871aa0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f686c101c00 0x7f686c197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:03:11.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.470+0000 7f6871aa0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f686c101c00 0x7f686c197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58978/0 (socket says 172.21.15.27:58978) 2024-09-19T08:03:11.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.470+0000 7f6871aa0640 1 -- 172.21.15.27:0/2245233806 learned_addr learned my addr 172.21.15.27:0/2245233806 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:03:11.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.471+0000 7f687129f640 1 --2- 172.21.15.27:0/2245233806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f686c102e00 0x7f686c198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:03:11.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.471+0000 7f68722a1640 1 --2- 172.21.15.27:0/2245233806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f686c1037c0 0x7f686c19f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:03:11.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.471+0000 7f6871aa0640 1 -- 172.21.15.27:0/2245233806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f686c1037c0 msgr2=0x7f686c19f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:11.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.471+0000 7f6871aa0640 1 --2- 172.21.15.27:0/2245233806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f686c1037c0 0x7f686c19f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:11.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.471+0000 7f6871aa0640 1 -- 172.21.15.27:0/2245233806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f686c102e00 msgr2=0x7f686c198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:11.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.471+0000 7f6871aa0640 1 --2- 172.21.15.27:0/2245233806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f686c102e00 0x7f686c198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:11.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.471+0000 7f6871aa0640 1 -- 172.21.15.27:0/2245233806 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686c19fa80 con 0x7f686c101c00 2024-09-19T08:03:11.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.471+0000 7f687129f640 1 --2- 172.21.15.27:0/2245233806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f686c102e00 0x7f686c198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:03:11.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.471+0000 7f6871aa0640 1 --2- 172.21.15.27:0/2245233806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f686c101c00 0x7f686c197e50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f686800e9c0 tx=0x7f686800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:03:11.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.471+0000 7f685effd640 1 -- 172.21.15.27:0/2245233806 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686800cd80 con 0x7f686c101c00 2024-09-19T08:03:11.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.471+0000 7f685effd640 1 -- 172.21.15.27:0/2245233806 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68680035f0 con 0x7f686c101c00 2024-09-19T08:03:11.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.471+0000 7f6873d04640 1 -- 172.21.15.27:0/2245233806 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f686c19fd70 con 0x7f686c101c00 2024-09-19T08:03:11.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.471+0000 7f685effd640 1 -- 172.21.15.27:0/2245233806 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6868010690 con 0x7f686c101c00 2024-09-19T08:03:11.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.471+0000 7f6873d04640 1 -- 172.21.15.27:0/2245233806 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f686c1a0220 con 0x7f686c101c00 2024-09-19T08:03:11.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.472+0000 7f685effd640 1 -- 172.21.15.27:0/2245233806 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f6868004020 con 0x7f686c101c00 2024-09-19T08:03:11.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.472+0000 7f6873d04640 1 -- 172.21.15.27:0/2245233806 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f686c108f30 con 0x7f686c101c00 2024-09-19T08:03:11.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.472+0000 7f685effd640 1 --2- 172.21.15.27:0/2245233806 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6858039500 0x7f685803b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:03:11.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.472+0000 7f685effd640 1 -- 172.21.15.27:0/2245233806 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f686804c9f0 con 0x7f686c101c00 2024-09-19T08:03:11.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.473+0000 7f687129f640 1 --2- 172.21.15.27:0/2245233806 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6858039500 0x7f685803b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:03:11.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.473+0000 7f687129f640 1 --2- 172.21.15.27:0/2245233806 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6858039500 0x7f685803b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f686c199370 tx=0x7f6860005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:03:11.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.477+0000 7f685effd640 1 -- 172.21.15.27:0/2245233806 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f68680071c0 con 0x7f686c101c00 2024-09-19T08:03:11.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:11.666+0000 7f6873d04640 1 -- 172.21.15.27:0/2245233806 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f686c062630 con 0x7f6858039500 2024-09-19T08:03:11.874 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:11 smithi155 ceph-mon[35362]: Deploying daemon mgr.y on smithi155 2024-09-19T08:03:11.874 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:11 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:03:11.874 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:11 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:03:11.874 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:11 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:12.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:11 smithi203 ceph-mon[35198]: Deploying daemon mgr.y on smithi155 2024-09-19T08:03:12.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:11 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:03:12.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:11 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:03:12.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:11 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:12.078 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:11 smithi027 ceph-mon[31209]: Deploying daemon mgr.y on smithi155 2024-09-19T08:03:12.078 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:11 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:03:12.078 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:11 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:03:12.078 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:11 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:12.235 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:12 smithi155 systemd[1]: Starting Ceph mgr.y for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:03:12.487 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:12 smithi155 podman[36717]: 2024-09-19 08:03:12.235830911 +0000 UTC m=+0.087320594 container create fdcbf3cd445650728dcbddb2563ae454b9c30f702c98f291f3cb12c376741a50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T08:03:12.487 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:12 smithi155 podman[36717]: 2024-09-19 08:03:12.164149626 +0000 UTC m=+0.015639317 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:03:12.487 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:12 smithi155 podman[36717]: 2024-09-19 08:03:12.454613695 +0000 UTC m=+0.306103376 container init fdcbf3cd445650728dcbddb2563ae454b9c30f702c98f291f3cb12c376741a50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T08:03:12.488 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:12 smithi155 podman[36717]: 2024-09-19 08:03:12.457275312 +0000 UTC m=+0.308765002 container start fdcbf3cd445650728dcbddb2563ae454b9c30f702c98f291f3cb12c376741a50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T08:03:12.488 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:12 smithi155 ceph-mgr[36736]: -- 172.21.15.155:0/223810470 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561a86ffd0e0 con 0x561a86fda800 2024-09-19T08:03:12.508 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:12 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:12.098+0000 7fcf8e48f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:03:12.508 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:12 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:12.164+0000 7fcf8e48f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:03:12.809 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:12 smithi155 ceph-mon[35362]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:12.809 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:12 smithi155 ceph-mon[35362]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:03:12.809 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:12 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:12.809 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:12 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:12.809 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:12 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:12.809 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:12 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:12.809 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:12 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:12.809 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:12 smithi155 bash[36717]: fdcbf3cd445650728dcbddb2563ae454b9c30f702c98f291f3cb12c376741a50 2024-09-19T08:03:12.810 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:12 smithi155 systemd[1]: Started Ceph mgr.y for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:03:12.810 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:12 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:12.586+0000 7f8804843040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:03:12.810 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:12 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:12.651+0000 7f8804843040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:03:12.810 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:12 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:12.808+0000 7f8804843040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:03:12.959 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:12 smithi027 ceph-mon[31209]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:12.959 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:12 smithi027 ceph-mon[31209]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:03:12.959 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:12 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:12.959 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:12 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:12.959 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:12 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:12.960 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:12 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:12.960 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:12 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:13.008 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:12 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:12.897+0000 7fcf8e48f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:03:13.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:12 smithi203 ceph-mon[35198]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:13.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:12 smithi203 ceph-mon[35198]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:03:13.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:12 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:13.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:12 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:13.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:12 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:13.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:12 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:13.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:12 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:13.188 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:12 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:12.877+0000 7f8804843040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:03:13.188 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:13 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:13.034+0000 7f8804843040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:03:13.188 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:13 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:13.188+0000 7f8804843040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:03:13.351 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:13.027+0000 7fcf8e48f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:03:13.352 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:13.185+0000 7fcf8e48f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:03:13.352 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:13.246+0000 7fcf8e48f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:03:13.695 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:13.401+0000 7fcf8e48f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:03:13.695 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:13.473+0000 7fcf8e48f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:03:13.695 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:13.533+0000 7fcf8e48f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:03:13.695 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:13.695+0000 7fcf8e48f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:03:13.772 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:13 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:13.515+0000 7f8804843040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:03:13.772 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:13 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:13.578+0000 7f8804843040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:03:13.988 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:13 smithi203 ceph-mon[35198]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:13.988 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:13 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:13.989 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:13 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:13.989 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:13 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:13.989 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:13.761+0000 7fcf8e48f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:03:13.989 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:13.837+0000 7fcf8e48f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:03:13.989 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:13.924+0000 7fcf8e48f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:03:13.989 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:13.988+0000 7fcf8e48f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:03:14.237 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:13 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:13.772+0000 7f8804843040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:03:14.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:13 smithi155 ceph-mon[35362]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:14.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:13 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:14.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:13 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:14.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:13 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:14.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:13 smithi027 ceph-mon[31209]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:14.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:13 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:14.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:13 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:14.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:13 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:14.258 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:14.049+0000 7fcf8e48f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:03:14.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:14.966+0000 7f685effd640 1 -- 172.21.15.27:0/2245233806 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7f686800acf0 con 0x7f686c101c00 2024-09-19T08:03:14.968 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:14.968 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:14.968 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:14.968 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:03:14.968 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:14.968 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:14 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/404668426' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66fd6732-4cac-4eda-bf06-50638995ee80"}]: dispatch 2024-09-19T08:03:14.968 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:14 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/404668426' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66fd6732-4cac-4eda-bf06-50638995ee80"}]': finished 2024-09-19T08:03:14.968 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:14 smithi027 ceph-mon[31209]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:03:14.968 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:03:14.968 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:14 smithi027 ceph-mon[31209]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:03:14.968 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:03:14.969 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:03:14.969 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:14.969 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:14 smithi027 ceph-mon[31209]: Reconfiguring daemon mgr.x on smithi027 2024-09-19T08:03:14.969 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:14 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2935496468' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:03:14.969 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:14 smithi027 ceph-mon[31209]: Standby manager daemon z started 2024-09-19T08:03:14.969 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:14 smithi027 ceph-mon[31209]: from='mgr.? 172.21.15.203:0/2595646831' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:03:14.969 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:14 smithi027 ceph-mon[31209]: from='mgr.? 172.21.15.203:0/2595646831' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:03:14.969 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:14 smithi027 ceph-mon[31209]: from='mgr.? 172.21.15.203:0/2595646831' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:03:14.969 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:14 smithi027 ceph-mon[31209]: from='mgr.? 172.21.15.203:0/2595646831' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:03:14.987 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:14.661+0000 7f8804843040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:03:14.987 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:14.729+0000 7f8804843040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:03:14.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:14.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:14.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:14.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:03:14.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:14.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/404668426' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66fd6732-4cac-4eda-bf06-50638995ee80"}]: dispatch 2024-09-19T08:03:14.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/404668426' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66fd6732-4cac-4eda-bf06-50638995ee80"}]': finished 2024-09-19T08:03:14.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-mon[35362]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:03:14.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:03:14.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-mon[35362]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:03:14.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:03:14.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:03:14.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:14.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-mon[35362]: Reconfiguring daemon mgr.x on smithi027 2024-09-19T08:03:14.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2935496468' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:03:14.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-mon[35362]: Standby manager daemon z started 2024-09-19T08:03:14.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-mon[35362]: from='mgr.? 172.21.15.203:0/2595646831' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:03:14.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-mon[35362]: from='mgr.? 172.21.15.203:0/2595646831' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:03:14.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-mon[35362]: from='mgr.? 172.21.15.203:0/2595646831' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:03:14.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:14 smithi155 ceph-mon[35362]: from='mgr.? 172.21.15.203:0/2595646831' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:03:15.258 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:03:14.839+0000 7fcf8e48f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:03:15.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:15.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:15.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:15.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:03:15.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:15.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/404668426' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66fd6732-4cac-4eda-bf06-50638995ee80"}]: dispatch 2024-09-19T08:03:15.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/404668426' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66fd6732-4cac-4eda-bf06-50638995ee80"}]': finished 2024-09-19T08:03:15.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-mon[35198]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:03:15.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:03:15.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-mon[35198]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:03:15.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:03:15.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:03:15.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:15.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-mon[35198]: Reconfiguring daemon mgr.x on smithi027 2024-09-19T08:03:15.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2935496468' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:03:15.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-mon[35198]: Standby manager daemon z started 2024-09-19T08:03:15.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-mon[35198]: from='mgr.? 172.21.15.203:0/2595646831' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:03:15.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-mon[35198]: from='mgr.? 172.21.15.203:0/2595646831' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:03:15.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-mon[35198]: from='mgr.? 172.21.15.203:0/2595646831' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:03:15.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:14 smithi203 ceph-mon[35198]: from='mgr.? 172.21.15.203:0/2595646831' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:03:15.707 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:15 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:15.449+0000 7f8804843040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:03:15.707 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:15 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:15.564+0000 7f8804843040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:03:15.708 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:15 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:15.707+0000 7f8804843040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:03:15.968 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:15 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:15.769+0000 7f8804843040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:03:15.968 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:15 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:15.916+0000 7f8804843040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:03:16.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:15 smithi155 ceph-mon[35362]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:16.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:15 smithi155 ceph-mon[35362]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-19T08:03:16.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:15 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:03:16.237 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:15 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:15.986+0000 7f8804843040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:03:16.238 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:16 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:16.046+0000 7f8804843040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:03:16.238 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:16 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:16.201+0000 7f8804843040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:03:16.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:15 smithi027 ceph-mon[31209]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:16.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:15 smithi027 ceph-mon[31209]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-19T08:03:16.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:15 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:03:16.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:15 smithi203 ceph-mon[35198]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:16.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:15 smithi203 ceph-mon[35198]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-19T08:03:16.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:15 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:03:16.532 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:16 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:16.265+0000 7f8804843040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:03:16.533 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:16 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:16.332+0000 7f8804843040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:03:16.533 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:16 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:16.414+0000 7f8804843040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:03:16.533 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:16 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:16.473+0000 7f8804843040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:03:16.533 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:16 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:16.532+0000 7f8804843040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:03:17.737 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:03:17 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:03:17.318+0000 7f8804843040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:03:17.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:17.978+0000 7f685effd640 1 -- 172.21.15.27:0/2245233806 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f686804ea50 con 0x7f686c101c00 2024-09-19T08:03:18.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:17 smithi155 ceph-mon[35362]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:18.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:17 smithi155 ceph-mon[35362]: Standby manager daemon y started 2024-09-19T08:03:18.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:17 smithi155 ceph-mon[35362]: from='mgr.? 172.21.15.155:0/1634964960' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:03:18.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:17 smithi155 ceph-mon[35362]: from='mgr.? 172.21.15.155:0/1634964960' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:03:18.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:17 smithi155 ceph-mon[35362]: from='mgr.? 172.21.15.155:0/1634964960' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:03:18.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:17 smithi155 ceph-mon[35362]: from='mgr.? 172.21.15.155:0/1634964960' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:03:18.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:17 smithi027 ceph-mon[31209]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:18.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:17 smithi027 ceph-mon[31209]: Standby manager daemon y started 2024-09-19T08:03:18.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:17 smithi027 ceph-mon[31209]: from='mgr.? 172.21.15.155:0/1634964960' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:03:18.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:17 smithi027 ceph-mon[31209]: from='mgr.? 172.21.15.155:0/1634964960' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:03:18.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:17 smithi027 ceph-mon[31209]: from='mgr.? 172.21.15.155:0/1634964960' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:03:18.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:17 smithi027 ceph-mon[31209]: from='mgr.? 172.21.15.155:0/1634964960' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:03:18.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:17 smithi203 ceph-mon[35198]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:18.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:17 smithi203 ceph-mon[35198]: Standby manager daemon y started 2024-09-19T08:03:18.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:17 smithi203 ceph-mon[35198]: from='mgr.? 172.21.15.155:0/1634964960' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:03:18.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:17 smithi203 ceph-mon[35198]: from='mgr.? 172.21.15.155:0/1634964960' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:03:18.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:17 smithi203 ceph-mon[35198]: from='mgr.? 172.21.15.155:0/1634964960' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:03:18.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:17 smithi203 ceph-mon[35198]: from='mgr.? 172.21.15.155:0/1634964960' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:03:19.160 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:18 smithi027 ceph-mon[31209]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-19T08:03:19.160 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:18 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:03:19.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:18 smithi155 ceph-mon[35362]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-19T08:03:19.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:18 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:03:19.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:18 smithi203 ceph-mon[35198]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-19T08:03:19.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:18 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:03:20.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:19 smithi027 ceph-mon[31209]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:20.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:19 smithi155 ceph-mon[35362]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:20.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:19 smithi203 ceph-mon[35198]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:21.632 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:21 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:21.633 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:21 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:21.633 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:21 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:21.633 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:21 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:21.633 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:21 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:03:21.633 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:21 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:21.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:21 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:21.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:21 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:21.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:21 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:21.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:21 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:21.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:21 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:03:21.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:21 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:21.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:21 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:21.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:21 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:21.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:21 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:21.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:21 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:21.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:21 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:03:21.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:21 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:22.630 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:22 smithi027 ceph-mon[31209]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:22.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:22 smithi155 ceph-mon[35362]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:22.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:22 smithi203 ceph-mon[35198]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:23.739 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:23 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:03:23.739 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:23 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:23.739 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:23 smithi155 ceph-mon[35362]: Deploying daemon osd.0 on smithi027 2024-09-19T08:03:23.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:23 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:03:23.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:23 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:23.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:23 smithi027 ceph-mon[31209]: Deploying daemon osd.0 on smithi027 2024-09-19T08:03:23.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:23 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:03:23.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:23 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:23.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:23 smithi203 ceph-mon[35198]: Deploying daemon osd.0 on smithi027 2024-09-19T08:03:24.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:24 smithi155 ceph-mon[35362]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:24.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:24 smithi027 ceph-mon[31209]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:24.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:24 smithi203 ceph-mon[35198]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:26.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:26 smithi155 ceph-mon[35362]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:26.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:26 smithi027 ceph-mon[31209]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:26.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:26 smithi203 ceph-mon[35198]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:28.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:28 smithi027 ceph-mon[31209]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:28.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:28 smithi155 ceph-mon[35362]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:28.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:28 smithi203 ceph-mon[35198]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:29.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:29 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:29.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:29 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:29.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:29 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:29.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:29 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:29.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:29 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:29.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:29 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:29.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:29 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:29.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:29 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:29.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:29 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:30 smithi027 ceph-mon[31209]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:30.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:30 smithi155 ceph-mon[35362]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:30.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:30 smithi203 ceph-mon[35198]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:32.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:32 smithi027 ceph-mon[31209]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:32.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:32 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:32.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:32 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:32.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:32 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:32.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:32 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:03:32.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:32 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:32.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:32 smithi155 ceph-mon[35362]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:32.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:32 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:32.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:32 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:32.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:32 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:32.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:32 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:03:32.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:32 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:32.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:32 smithi203 ceph-mon[35198]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:32.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:32 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:32.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:32 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:32.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:32 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:32.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:32 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:03:32.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:32 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:33.087 INFO:teuthology.orchestra.run.smithi027.stdout:Created osd(s) 0 on host 'smithi027' 2024-09-19T08:03:33.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:33.087+0000 7f685effd640 1 -- 172.21.15.27:0/2245233806 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f686c062630 con 0x7f6858039500 2024-09-19T08:03:33.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:33.090+0000 7f6873d04640 1 -- 172.21.15.27:0/2245233806 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6858039500 msgr2=0x7f685803b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:33.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:33.090+0000 7f6873d04640 1 --2- 172.21.15.27:0/2245233806 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6858039500 0x7f685803b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f686c199370 tx=0x7f6860005f90 comp rx=0 tx=0).stop 2024-09-19T08:03:33.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:33.090+0000 7f6873d04640 1 -- 172.21.15.27:0/2245233806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f686c101c00 msgr2=0x7f686c197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:33.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:33.090+0000 7f6873d04640 1 --2- 172.21.15.27:0/2245233806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f686c101c00 0x7f686c197e50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f686800e9c0 tx=0x7f686800ee80 comp rx=0 tx=0).stop 2024-09-19T08:03:33.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:33.090+0000 7f6873d04640 1 -- 172.21.15.27:0/2245233806 shutdown_connections 2024-09-19T08:03:33.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:33.090+0000 7f6873d04640 1 --2- 172.21.15.27:0/2245233806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f686c1037c0 0x7f686c19f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:33.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:33.090+0000 7f6873d04640 1 --2- 172.21.15.27:0/2245233806 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6858039500 0x7f685803b9c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:33.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:33.090+0000 7f6873d04640 1 --2- 172.21.15.27:0/2245233806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f686c102e00 0x7f686c198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:33.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:33.090+0000 7f6873d04640 1 --2- 172.21.15.27:0/2245233806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f686c101c00 0x7f686c197e50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:33.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:33.090+0000 7f6873d04640 1 -- 172.21.15.27:0/2245233806 >> 172.21.15.27:0/2245233806 conn(0x7f686c0fd390 msgr2=0x7f686c106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:03:33.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:33.090+0000 7f6873d04640 1 -- 172.21.15.27:0/2245233806 shutdown_connections 2024-09-19T08:03:33.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:03:33.090+0000 7f6873d04640 1 -- 172.21.15.27:0/2245233806 wait complete. 2024-09-19T08:03:33.669 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:33 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:33.670 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:33 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:33.670 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:33 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:33.700 DEBUG:teuthology.orchestra.run.smithi027:osd.0> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T08:03:33.702 INFO:tasks.cephadm:Deploying osd.1 on smithi155 with /dev/vg_nvme/lv_4... 2024-09-19T08:03:33.703 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:03:33.726 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:33 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:33.726 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:33 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:33.726 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:33 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:33.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:33 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:33.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:33 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:33.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:33 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:33.948 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:03:34.685 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:34 smithi027 ceph-mon[31209]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:34.685 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:03:34 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-0[44813]: 2024-09-19T08:03:34.562+0000 7fa0d1c47640 -1 osd.0 0 log_to_monitors true 2024-09-19T08:03:34.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:34 smithi155 ceph-mon[35362]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:34.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:34 smithi203 ceph-mon[35198]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:35.689 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:35 smithi155 ceph-mon[35362]: from='osd.0 [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:03:35.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:35 smithi027 ceph-mon[31209]: from='osd.0 [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:03:35.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:35 smithi203 ceph-mon[35198]: from='osd.0 [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:03:36.380 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:03:36.410 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi155:vg_nvme/lv_4 2024-09-19T08:03:36.686 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:36 smithi155 ceph-mon[35362]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:36.687 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:36 smithi155 ceph-mon[35362]: from='osd.0 [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:03:36.687 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:36 smithi155 ceph-mon[35362]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:03:36.687 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:36 smithi155 ceph-mon[35362]: from='osd.0 [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-19T08:03:36.687 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:36 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:03:36.687 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:36 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:36.687 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:36 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:36.687 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:36 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:03:36.687 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:36 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:36.687 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:36 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:36.687 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:36 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:03:36.687 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:36 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:36.700 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:03:36.752 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:03:36 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-0[44813]: 2024-09-19T08:03:36.478+0000 7fa0cdbca640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T08:03:36.752 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:03:36 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-0[44813]: 2024-09-19T08:03:36.481+0000 7fa0c99f2640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:03:36.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:36 smithi027 ceph-mon[31209]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:36.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:36 smithi027 ceph-mon[31209]: from='osd.0 [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:03:36.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:36 smithi027 ceph-mon[31209]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:03:36.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:36 smithi027 ceph-mon[31209]: from='osd.0 [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-19T08:03:36.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:36 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:03:36.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:36 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:36.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:36 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:36.754 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:36 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:03:36.754 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:36 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:36.754 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:36 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:36.754 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:36 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:03:36.754 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:36 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:36.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:36 smithi203 ceph-mon[35198]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:36.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:36 smithi203 ceph-mon[35198]: from='osd.0 [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:03:36.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:36 smithi203 ceph-mon[35198]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:03:36.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:36 smithi203 ceph-mon[35198]: from='osd.0 [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-19T08:03:36.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:36 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:03:36.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:36 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:36.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:36 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:36.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:36 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:03:36.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:36 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:36.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:36 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:36.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:36 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:03:36.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:36 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:37.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.098+0000 7f9c106a1640 1 -- 172.21.15.155:0/90048470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c08100b00 msgr2=0x7f9c08100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:37.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.098+0000 7f9c106a1640 1 --2- 172.21.15.155:0/90048470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c08100b00 0x7f9c08100f00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9c04009900 tx=0x7f9c0402a410 comp rx=0 tx=0).stop 2024-09-19T08:03:37.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.098+0000 7f9c106a1640 1 -- 172.21.15.155:0/90048470 shutdown_connections 2024-09-19T08:03:37.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.098+0000 7f9c106a1640 1 --2- 172.21.15.155:0/90048470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c081026c0 0x7f9c08108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:37.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.098+0000 7f9c106a1640 1 --2- 172.21.15.155:0/90048470 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c08101d00 0x7f9c08102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:37.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.098+0000 7f9c106a1640 1 --2- 172.21.15.155:0/90048470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c08100b00 0x7f9c08100f00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:37.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.098+0000 7f9c106a1640 1 -- 172.21.15.155:0/90048470 >> 172.21.15.155:0/90048470 conn(0x7f9c080fc290 msgr2=0x7f9c080fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:03:37.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.098+0000 7f9c106a1640 1 -- 172.21.15.155:0/90048470 shutdown_connections 2024-09-19T08:03:37.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.098+0000 7f9c106a1640 1 -- 172.21.15.155:0/90048470 wait complete. 2024-09-19T08:03:37.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.099+0000 7f9c106a1640 1 Processor -- start 2024-09-19T08:03:37.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.099+0000 7f9c106a1640 1 -- start start 2024-09-19T08:03:37.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.099+0000 7f9c106a1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c08100b00 0x7f9c08197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:03:37.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.099+0000 7f9c106a1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c08101d00 0x7f9c081984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:03:37.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.099+0000 7f9c106a1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c081026c0 0x7f9c0819f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:03:37.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.099+0000 7f9c106a1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0810c780 con 0x7f9c08100b00 2024-09-19T08:03:37.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.099+0000 7f9c106a1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0810c600 con 0x7f9c081026c0 2024-09-19T08:03:37.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.099+0000 7f9c106a1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0810c900 con 0x7f9c08101d00 2024-09-19T08:03:37.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.099+0000 7f9c0ec3e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c081026c0 0x7f9c0819f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:03:37.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.099+0000 7f9c0ec3e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c081026c0 0x7f9c0819f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:49352/0 (socket says 172.21.15.155:49352) 2024-09-19T08:03:37.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.099+0000 7f9c0ec3e640 1 -- 172.21.15.155:0/2281326354 learned_addr learned my addr 172.21.15.155:0/2281326354 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-19T08:03:37.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.099+0000 7f9c0e43d640 1 --2- 172.21.15.155:0/2281326354 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c08100b00 0x7f9c08197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:03:37.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.100+0000 7f9c0dc3c640 1 --2- 172.21.15.155:0/2281326354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c08101d00 0x7f9c081984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:03:37.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.100+0000 7f9c0ec3e640 1 -- 172.21.15.155:0/2281326354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c08101d00 msgr2=0x7f9c081984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:37.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.100+0000 7f9c0ec3e640 1 --2- 172.21.15.155:0/2281326354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c08101d00 0x7f9c081984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:37.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.100+0000 7f9c0ec3e640 1 -- 172.21.15.155:0/2281326354 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c08100b00 msgr2=0x7f9c08197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:37.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.100+0000 7f9c0ec3e640 1 --2- 172.21.15.155:0/2281326354 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c08100b00 0x7f9c08197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:37.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.100+0000 7f9c0ec3e640 1 -- 172.21.15.155:0/2281326354 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0819fba0 con 0x7f9c081026c0 2024-09-19T08:03:37.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.100+0000 7f9c0dc3c640 1 --2- 172.21.15.155:0/2281326354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c08101d00 0x7f9c081984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:03:37.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.100+0000 7f9c0ec3e640 1 --2- 172.21.15.155:0/2281326354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c081026c0 0x7f9c0819f530 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9c00009fd0 tx=0x7f9c0000b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:03:37.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.100+0000 7f9bff7fe640 1 -- 172.21.15.155:0/2281326354 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c00017070 con 0x7f9c081026c0 2024-09-19T08:03:37.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.100+0000 7f9bff7fe640 1 -- 172.21.15.155:0/2281326354 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c00003e50 con 0x7f9c081026c0 2024-09-19T08:03:37.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.100+0000 7f9bff7fe640 1 -- 172.21.15.155:0/2281326354 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c000106c0 con 0x7f9c081026c0 2024-09-19T08:03:37.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.100+0000 7f9c106a1640 1 -- 172.21.15.155:0/2281326354 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0819fe90 con 0x7f9c081026c0 2024-09-19T08:03:37.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.100+0000 7f9c106a1640 1 -- 172.21.15.155:0/2281326354 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c081a0340 con 0x7f9c081026c0 2024-09-19T08:03:37.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.101+0000 7f9c106a1640 1 -- 172.21.15.155:0/2281326354 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c081a05a0 con 0x7f9c081026c0 2024-09-19T08:03:37.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.102+0000 7f9bff7fe640 1 -- 172.21.15.155:0/2281326354 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f9c00003970 con 0x7f9c081026c0 2024-09-19T08:03:37.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.103+0000 7f9bff7fe640 1 --2- 172.21.15.155:0/2281326354 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f9bf40a3260 0x7f9bf40a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:03:37.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.103+0000 7f9bff7fe640 1 -- 172.21.15.155:0/2281326354 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f9c000cda20 con 0x7f9c081026c0 2024-09-19T08:03:37.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.103+0000 7f9c0e43d640 1 --2- 172.21.15.155:0/2281326354 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f9bf40a3260 0x7f9bf40a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:03:37.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.104+0000 7f9c0e43d640 1 --2- 172.21.15.155:0/2281326354 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f9bf40a3260 0x7f9bf40a5720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9c04005ab0 tx=0x7f9c04000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:03:37.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.107+0000 7f9bff7fe640 1 -- 172.21.15.155:0/2281326354 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c0009c350 con 0x7f9c081026c0 2024-09-19T08:03:37.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:37.284+0000 7f9c106a1640 1 -- 172.21.15.155:0/2281326354 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9c0806aea0 con 0x7f9bf40a3260 2024-09-19T08:03:37.689 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:37 smithi155 ceph-mon[35362]: Detected new or changed devices on smithi027 2024-09-19T08:03:37.689 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:37 smithi155 ceph-mon[35362]: Adjusting osd_memory_target on smithi027 to 17088M 2024-09-19T08:03:37.689 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:37 smithi155 ceph-mon[35362]: from='osd.0 [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-19T08:03:37.689 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:37 smithi155 ceph-mon[35362]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:03:37.690 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:37 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:03:37.690 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:37 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:03:37.690 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:37 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:03:37.690 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:37 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:03:37.690 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:37 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:37.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:37 smithi027 ceph-mon[31209]: Detected new or changed devices on smithi027 2024-09-19T08:03:37.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:37 smithi027 ceph-mon[31209]: Adjusting osd_memory_target on smithi027 to 17088M 2024-09-19T08:03:37.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:37 smithi027 ceph-mon[31209]: from='osd.0 [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-19T08:03:37.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:37 smithi027 ceph-mon[31209]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:03:37.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:37 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:03:37.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:37 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:03:37.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:37 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:03:37.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:37 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:03:37.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:37 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:37.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:37 smithi203 ceph-mon[35198]: Detected new or changed devices on smithi027 2024-09-19T08:03:37.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:37 smithi203 ceph-mon[35198]: Adjusting osd_memory_target on smithi027 to 17088M 2024-09-19T08:03:37.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:37 smithi203 ceph-mon[35198]: from='osd.0 [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-19T08:03:37.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:37 smithi203 ceph-mon[35198]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:03:37.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:37 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:03:37.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:37 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:03:37.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:37 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:03:37.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:37 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:03:37.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:37 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:38.512 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:38 smithi155 ceph-mon[35362]: purged_snaps scrub starts 2024-09-19T08:03:38.512 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:38 smithi155 ceph-mon[35362]: purged_snaps scrub ok 2024-09-19T08:03:38.512 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:38 smithi155 ceph-mon[35362]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:38.512 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:38 smithi155 ceph-mon[35362]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:03:38.512 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:38 smithi155 ceph-mon[35362]: osd.0 [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250] boot 2024-09-19T08:03:38.512 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:38 smithi155 ceph-mon[35362]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:03:38.512 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:38 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:03:38.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:38 smithi027 ceph-mon[31209]: purged_snaps scrub starts 2024-09-19T08:03:38.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:38 smithi027 ceph-mon[31209]: purged_snaps scrub ok 2024-09-19T08:03:38.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:38 smithi027 ceph-mon[31209]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:38.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:38 smithi027 ceph-mon[31209]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:03:38.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:38 smithi027 ceph-mon[31209]: osd.0 [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250] boot 2024-09-19T08:03:38.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:38 smithi027 ceph-mon[31209]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:03:38.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:38 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:03:38.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:38 smithi203 ceph-mon[35198]: purged_snaps scrub starts 2024-09-19T08:03:38.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:38 smithi203 ceph-mon[35198]: purged_snaps scrub ok 2024-09-19T08:03:38.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:38 smithi203 ceph-mon[35198]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:03:38.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:38 smithi203 ceph-mon[35198]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:03:38.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:38 smithi203 ceph-mon[35198]: osd.0 [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250] boot 2024-09-19T08:03:38.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:38 smithi203 ceph-mon[35198]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:03:38.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:38 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:03:39.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:39 smithi027 ceph-mon[31209]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T08:03:39.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:39 smithi027 ceph-mon[31209]: from='client.? 172.21.15.155:0/1909940136' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36628767-66ac-433b-938e-10e75b51a877"}]: dispatch 2024-09-19T08:03:39.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:39 smithi027 ceph-mon[31209]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36628767-66ac-433b-938e-10e75b51a877"}]: dispatch 2024-09-19T08:03:39.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:39 smithi027 ceph-mon[31209]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36628767-66ac-433b-938e-10e75b51a877"}]': finished 2024-09-19T08:03:39.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:39 smithi027 ceph-mon[31209]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:03:39.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:39 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:03:39.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:39 smithi203 ceph-mon[35198]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T08:03:39.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:39 smithi203 ceph-mon[35198]: from='client.? 172.21.15.155:0/1909940136' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36628767-66ac-433b-938e-10e75b51a877"}]: dispatch 2024-09-19T08:03:39.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:39 smithi203 ceph-mon[35198]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36628767-66ac-433b-938e-10e75b51a877"}]: dispatch 2024-09-19T08:03:39.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:39 smithi203 ceph-mon[35198]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36628767-66ac-433b-938e-10e75b51a877"}]': finished 2024-09-19T08:03:39.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:39 smithi203 ceph-mon[35198]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:03:39.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:39 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:03:39.813 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:39 smithi155 ceph-mon[35362]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T08:03:39.813 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:39 smithi155 ceph-mon[35362]: from='client.? 172.21.15.155:0/1909940136' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36628767-66ac-433b-938e-10e75b51a877"}]: dispatch 2024-09-19T08:03:39.813 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:39 smithi155 ceph-mon[35362]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36628767-66ac-433b-938e-10e75b51a877"}]: dispatch 2024-09-19T08:03:39.813 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:39 smithi155 ceph-mon[35362]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36628767-66ac-433b-938e-10e75b51a877"}]': finished 2024-09-19T08:03:39.813 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:39 smithi155 ceph-mon[35362]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:03:39.813 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:39 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:03:40.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:40 smithi027 ceph-mon[31209]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:40.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:40 smithi027 ceph-mon[31209]: from='client.? 172.21.15.155:0/1501132574' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:03:40.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:40 smithi203 ceph-mon[35198]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:40.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:40 smithi203 ceph-mon[35198]: from='client.? 172.21.15.155:0/1501132574' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:03:40.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:40 smithi155 ceph-mon[35362]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:40.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:40 smithi155 ceph-mon[35362]: from='client.? 172.21.15.155:0/1501132574' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:03:42.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:42 smithi027 ceph-mon[31209]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:42.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:42 smithi203 ceph-mon[35198]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:42.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:42 smithi155 ceph-mon[35362]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:44.634 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:44 smithi155 ceph-mon[35362]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:44.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:44 smithi027 ceph-mon[31209]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:44.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:44 smithi203 ceph-mon[35198]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:46.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:46 smithi027 ceph-mon[31209]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:46.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:46 smithi203 ceph-mon[35198]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:46.811 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:46 smithi155 ceph-mon[35362]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:48.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:48 smithi203 ceph-mon[35198]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:48.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:48 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:03:48.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:48 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:48.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:48 smithi203 ceph-mon[35198]: Deploying daemon osd.1 on smithi155 2024-09-19T08:03:48.893 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:48 smithi155 ceph-mon[35362]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:48.893 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:48 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:03:48.893 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:48 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:48.893 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:48 smithi155 ceph-mon[35362]: Deploying daemon osd.1 on smithi155 2024-09-19T08:03:49.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:48 smithi027 ceph-mon[31209]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:49.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:48 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:03:49.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:48 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:49.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:48 smithi027 ceph-mon[31209]: Deploying daemon osd.1 on smithi155 2024-09-19T08:03:50.781 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:50 smithi155 ceph-mon[35362]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:51.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:50 smithi027 ceph-mon[31209]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:51.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:50 smithi203 ceph-mon[35198]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:52.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:52 smithi155 ceph-mon[35362]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:52.811 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:52 smithi203 ceph-mon[35198]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:53.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:52 smithi027 ceph-mon[31209]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:54.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:54 smithi155 ceph-mon[35362]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:54.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:54 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:54.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:54 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:54.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:54 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:55.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:54 smithi027 ceph-mon[31209]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:55.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:54 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:55.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:54 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:55.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:54 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:55.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:54 smithi203 ceph-mon[35198]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:55.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:54 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:55.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:54 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:55.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:54 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:56.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:56 smithi155 ceph-mon[35362]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:56.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:56 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:56.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:56 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:56.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:56 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:56.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:56 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:03:56.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:56 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:57.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:56 smithi027 ceph-mon[31209]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:57.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:56 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:57.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:56 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:57.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:56 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:57.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:56 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:03:57.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:56 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:57.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:56 smithi203 ceph-mon[35198]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:57.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:56 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:57.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:56 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:57.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:56 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:03:57.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:56 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:03:57.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:56 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:57.873 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 1 on host 'smithi155' 2024-09-19T08:03:57.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:57.872+0000 7f9bff7fe640 1 -- 172.21.15.155:0/2281326354 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9c0806aea0 con 0x7f9bf40a3260 2024-09-19T08:03:57.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:57.875+0000 7f9c106a1640 1 -- 172.21.15.155:0/2281326354 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f9bf40a3260 msgr2=0x7f9bf40a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:57.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:57.875+0000 7f9c106a1640 1 --2- 172.21.15.155:0/2281326354 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f9bf40a3260 0x7f9bf40a5720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9c04005ab0 tx=0x7f9c04000bc0 comp rx=0 tx=0).stop 2024-09-19T08:03:57.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:57.875+0000 7f9c106a1640 1 -- 172.21.15.155:0/2281326354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c081026c0 msgr2=0x7f9c0819f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:03:57.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:57.875+0000 7f9c106a1640 1 --2- 172.21.15.155:0/2281326354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c081026c0 0x7f9c0819f530 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9c00009fd0 tx=0x7f9c0000b260 comp rx=0 tx=0).stop 2024-09-19T08:03:57.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:57.875+0000 7f9c106a1640 1 -- 172.21.15.155:0/2281326354 shutdown_connections 2024-09-19T08:03:57.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:57.875+0000 7f9c106a1640 1 --2- 172.21.15.155:0/2281326354 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f9bf40a3260 0x7f9bf40a5720 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:57.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:57.875+0000 7f9c106a1640 1 --2- 172.21.15.155:0/2281326354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c081026c0 0x7f9c0819f530 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:57.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:57.875+0000 7f9c106a1640 1 --2- 172.21.15.155:0/2281326354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c08101d00 0x7f9c081984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:57.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:57.875+0000 7f9c106a1640 1 --2- 172.21.15.155:0/2281326354 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c08100b00 0x7f9c08197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:03:57.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:57.875+0000 7f9c106a1640 1 -- 172.21.15.155:0/2281326354 >> 172.21.15.155:0/2281326354 conn(0x7f9c080fc290 msgr2=0x7f9c0806a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:03:57.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:57.875+0000 7f9c106a1640 1 -- 172.21.15.155:0/2281326354 shutdown_connections 2024-09-19T08:03:57.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:03:57.875+0000 7f9c106a1640 1 -- 172.21.15.155:0/2281326354 wait complete. 2024-09-19T08:03:58.434 DEBUG:teuthology.orchestra.run.smithi155:osd.1> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T08:03:58.436 INFO:tasks.cephadm:Deploying osd.2 on smithi203 with /dev/vg_nvme/lv_4... 2024-09-19T08:03:58.436 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:03:58.690 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:03:58.723 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:58 smithi155 ceph-mon[35362]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:58.723 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:58 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:58.723 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:58 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:58.723 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:03:58 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:58.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:58 smithi203 ceph-mon[35198]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:58.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:58 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:58.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:58 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:58.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:03:58 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:59.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:58 smithi027 ceph-mon[31209]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:03:59.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:58 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:03:59.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:58 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:59.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:03:58 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:03:59.862 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:03:59 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-1[39838]: 2024-09-19T08:03:59.524+0000 7fde13623640 -1 osd.1 0 log_to_monitors true 2024-09-19T08:04:00.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:00 smithi203 ceph-mon[35198]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:04:00.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:00 smithi203 ceph-mon[35198]: from='osd.1 [v2:172.21.15.155:6800/3977510449,v1:172.21.15.155:6801/3977510449]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:04:00.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:00 smithi203 ceph-mon[35198]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:04:00.920 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:00 smithi155 ceph-mon[35362]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:04:00.920 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:00 smithi155 ceph-mon[35362]: from='osd.1 [v2:172.21.15.155:6800/3977510449,v1:172.21.15.155:6801/3977510449]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:04:00.920 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:00 smithi155 ceph-mon[35362]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:04:01.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:00 smithi027 ceph-mon[31209]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:04:01.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:00 smithi027 ceph-mon[31209]: from='osd.1 [v2:172.21.15.155:6800/3977510449,v1:172.21.15.155:6801/3977510449]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:04:01.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:00 smithi027 ceph-mon[31209]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:04:01.257 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:04:01.284 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_4 2024-09-19T08:04:01.531 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:04:01.786 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:01 smithi203 ceph-mon[35198]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:04:01.786 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:01 smithi203 ceph-mon[35198]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:04:01.786 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:01 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:04:01.786 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:01 smithi203 ceph-mon[35198]: from='osd.1 [v2:172.21.15.155:6800/3977510449,v1:172.21.15.155:6801/3977510449]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:04:01.787 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:01 smithi203 ceph-mon[35198]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:04:01.787 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:01 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:01.787 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:01 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:01.787 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:01 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:04:01.787 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:01 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:01.787 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:01 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:01.787 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:01 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:04:01.787 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:01 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:01.959 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.956+0000 7f26a2e7f640 1 -- 172.21.15.203:0/3218932743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f269c102e00 msgr2=0x7f269c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:04:01.959 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.956+0000 7f26a2e7f640 1 --2- 172.21.15.203:0/3218932743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f269c102e00 0x7f269c103280 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2688009900 tx=0x7f268802a410 comp rx=0 tx=0).stop 2024-09-19T08:04:01.959 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.957+0000 7f26a2e7f640 1 -- 172.21.15.203:0/3218932743 shutdown_connections 2024-09-19T08:04:01.960 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.957+0000 7f26a2e7f640 1 --2- 172.21.15.203:0/3218932743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f269c1037c0 0x7f269c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:01.960 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.957+0000 7f26a2e7f640 1 --2- 172.21.15.203:0/3218932743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f269c102e00 0x7f269c103280 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:01.960 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.957+0000 7f26a2e7f640 1 --2- 172.21.15.203:0/3218932743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f269c101c00 0x7f269c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:01.960 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.957+0000 7f26a2e7f640 1 -- 172.21.15.203:0/3218932743 >> 172.21.15.203:0/3218932743 conn(0x7f269c0fd390 msgr2=0x7f269c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:04:01.960 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.957+0000 7f26a2e7f640 1 -- 172.21.15.203:0/3218932743 shutdown_connections 2024-09-19T08:04:01.960 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.957+0000 7f26a2e7f640 1 -- 172.21.15.203:0/3218932743 wait complete. 2024-09-19T08:04:01.960 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.957+0000 7f26a2e7f640 1 Processor -- start 2024-09-19T08:04:01.960 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.957+0000 7f26a2e7f640 1 -- start start 2024-09-19T08:04:01.960 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.957+0000 7f26a2e7f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f269c101c00 0x7f269c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:04:01.960 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.957+0000 7f26a2e7f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f269c102e00 0x7f269c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:04:01.960 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.957+0000 7f26a2e7f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f269c1037c0 0x7f269c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:04:01.960 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.957+0000 7f26a2e7f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f269c10d880 con 0x7f269c102e00 2024-09-19T08:04:01.960 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.957+0000 7f26a2e7f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f269c10d700 con 0x7f269c101c00 2024-09-19T08:04:01.961 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.957+0000 7f26a2e7f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f269c10da00 con 0x7f269c1037c0 2024-09-19T08:04:01.961 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.958+0000 7f26a141c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f269c1037c0 0x7f269c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:04:01.961 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.958+0000 7f26a0c1b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f269c101c00 0x7f269c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:04:01.961 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.958+0000 7f26a141c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f269c1037c0 0x7f269c074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:38988/0 (socket says 172.21.15.203:38988) 2024-09-19T08:04:01.961 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.958+0000 7f26a141c640 1 -- 172.21.15.203:0/234977308 learned_addr learned my addr 172.21.15.203:0/234977308 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:04:01.961 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.958+0000 7f269bfff640 1 --2- 172.21.15.203:0/234977308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f269c102e00 0x7f269c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:04:01.961 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.958+0000 7f26a141c640 1 -- 172.21.15.203:0/234977308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f269c101c00 msgr2=0x7f269c075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:04:01.961 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.958+0000 7f26a141c640 1 --2- 172.21.15.203:0/234977308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f269c101c00 0x7f269c075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:01.961 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.958+0000 7f26a141c640 1 -- 172.21.15.203:0/234977308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f269c102e00 msgr2=0x7f269c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:04:01.961 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.958+0000 7f26a141c640 1 --2- 172.21.15.203:0/234977308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f269c102e00 0x7f269c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:01.961 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.958+0000 7f26a141c640 1 -- 172.21.15.203:0/234977308 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269c0753e0 con 0x7f269c1037c0 2024-09-19T08:04:01.961 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.958+0000 7f269bfff640 1 --2- 172.21.15.203:0/234977308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f269c102e00 0x7f269c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:04:01.961 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.958+0000 7f26a141c640 1 --2- 172.21.15.203:0/234977308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f269c1037c0 0x7f269c074b20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f269400eaa0 tx=0x7f269400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:04:01.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.958+0000 7f2699ffb640 1 -- 172.21.15.203:0/234977308 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269400cdb0 con 0x7f269c1037c0 2024-09-19T08:04:01.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.958+0000 7f2699ffb640 1 -- 172.21.15.203:0/234977308 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2694005020 con 0x7f269c1037c0 2024-09-19T08:04:01.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.958+0000 7f2699ffb640 1 -- 172.21.15.203:0/234977308 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26940116b0 con 0x7f269c1037c0 2024-09-19T08:04:01.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.958+0000 7f26a2e7f640 1 -- 172.21.15.203:0/234977308 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f269c1a2060 con 0x7f269c1037c0 2024-09-19T08:04:01.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.959+0000 7f26a2e7f640 1 -- 172.21.15.203:0/234977308 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f269c1a2570 con 0x7f269c1037c0 2024-09-19T08:04:01.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.960+0000 7f26a2e7f640 1 -- 172.21.15.203:0/234977308 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f269c108fb0 con 0x7f269c1037c0 2024-09-19T08:04:01.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.961+0000 7f2699ffb640 1 -- 172.21.15.203:0/234977308 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f2694005560 con 0x7f269c1037c0 2024-09-19T08:04:01.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.961+0000 7f2699ffb640 1 --2- 172.21.15.203:0/234977308 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f268c0a31b0 0x7f268c0a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:04:01.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.961+0000 7f2699ffb640 1 -- 172.21.15.203:0/234977308 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f26940ce190 con 0x7f269c1037c0 2024-09-19T08:04:01.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.962+0000 7f26a0c1b640 1 --2- 172.21.15.203:0/234977308 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f268c0a31b0 0x7f268c0a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:04:01.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.962+0000 7f26a0c1b640 1 --2- 172.21.15.203:0/234977308 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f268c0a31b0 0x7f268c0a5670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f269c102c60 tx=0x7f269000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:04:01.966 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:01.966+0000 7f2699ffb640 1 -- 172.21.15.203:0/234977308 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2694016030 con 0x7f269c1037c0 2024-09-19T08:04:01.987 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:04:01 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-1[39838]: 2024-09-19T08:04:01.542+0000 7fde0f5a6640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T08:04:01.987 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:04:01 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-1[39838]: 2024-09-19T08:04:01.545+0000 7fde0b3ce640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:04:01.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:01 smithi155 ceph-mon[35362]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:04:01.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:01 smithi155 ceph-mon[35362]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:04:01.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:01 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:04:01.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:01 smithi155 ceph-mon[35362]: from='osd.1 [v2:172.21.15.155:6800/3977510449,v1:172.21.15.155:6801/3977510449]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:04:01.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:01 smithi155 ceph-mon[35362]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:04:01.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:01 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:01.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:01 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:01.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:01 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:04:01.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:01 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:01.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:01 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:01.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:01 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:04:01.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:01 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:02.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:01 smithi027 ceph-mon[31209]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:04:02.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:01 smithi027 ceph-mon[31209]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:04:02.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:01 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:04:02.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:01 smithi027 ceph-mon[31209]: from='osd.1 [v2:172.21.15.155:6800/3977510449,v1:172.21.15.155:6801/3977510449]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:04:02.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:01 smithi027 ceph-mon[31209]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:04:02.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:01 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:02.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:01 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:02.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:01 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:04:02.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:01 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:02.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:01 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:02.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:01 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:04:02.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:01 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:02.139 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:02.139+0000 7f26a2e7f640 1 -- 172.21.15.203:0/234977308 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f269c062630 con 0x7f268c0a31b0 2024-09-19T08:04:02.859 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:02 smithi203 ceph-mon[35198]: purged_snaps scrub starts 2024-09-19T08:04:02.859 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:02 smithi203 ceph-mon[35198]: purged_snaps scrub ok 2024-09-19T08:04:02.859 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:02 smithi203 ceph-mon[35198]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:04:02.860 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:02 smithi203 ceph-mon[35198]: Detected new or changed devices on smithi155 2024-09-19T08:04:02.860 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:02 smithi203 ceph-mon[35198]: Adjusting osd_memory_target on smithi155 to 17088M 2024-09-19T08:04:02.860 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:02 smithi203 ceph-mon[35198]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:04:02.860 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:02 smithi203 ceph-mon[35198]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T08:04:02.860 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:02 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:04:02.860 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:02 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:04:02.860 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:02 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:04:02.860 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:02 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:04:02.860 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:02 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:02.903 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:02 smithi027 ceph-mon[31209]: purged_snaps scrub starts 2024-09-19T08:04:02.904 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:02 smithi027 ceph-mon[31209]: purged_snaps scrub ok 2024-09-19T08:04:02.904 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:02 smithi027 ceph-mon[31209]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:04:02.904 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:02 smithi027 ceph-mon[31209]: Detected new or changed devices on smithi155 2024-09-19T08:04:02.904 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:02 smithi027 ceph-mon[31209]: Adjusting osd_memory_target on smithi155 to 17088M 2024-09-19T08:04:02.904 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:02 smithi027 ceph-mon[31209]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:04:02.904 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:02 smithi027 ceph-mon[31209]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T08:04:02.904 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:02 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:04:02.904 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:02 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:04:02.904 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:02 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:04:02.904 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:02 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:04:02.904 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:02 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:02.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:02 smithi155 ceph-mon[35362]: purged_snaps scrub starts 2024-09-19T08:04:02.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:02 smithi155 ceph-mon[35362]: purged_snaps scrub ok 2024-09-19T08:04:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:02 smithi155 ceph-mon[35362]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:04:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:02 smithi155 ceph-mon[35362]: Detected new or changed devices on smithi155 2024-09-19T08:04:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:02 smithi155 ceph-mon[35362]: Adjusting osd_memory_target on smithi155 to 17088M 2024-09-19T08:04:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:02 smithi155 ceph-mon[35362]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:04:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:02 smithi155 ceph-mon[35362]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T08:04:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:04:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:04:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:04:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:04:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:03.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:03 smithi203 ceph-mon[35198]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:04:03.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:03 smithi203 ceph-mon[35198]: osd.1 [v2:172.21.15.155:6800/3977510449,v1:172.21.15.155:6801/3977510449] boot 2024-09-19T08:04:03.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:03 smithi203 ceph-mon[35198]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T08:04:03.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:03 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:04:03.854 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:03 smithi155 ceph-mon[35362]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:04:03.854 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:03 smithi155 ceph-mon[35362]: osd.1 [v2:172.21.15.155:6800/3977510449,v1:172.21.15.155:6801/3977510449] boot 2024-09-19T08:04:03.854 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:03 smithi155 ceph-mon[35362]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T08:04:03.855 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:03 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:04:04.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:03 smithi027 ceph-mon[31209]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:04:04.004 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:03 smithi027 ceph-mon[31209]: osd.1 [v2:172.21.15.155:6800/3977510449,v1:172.21.15.155:6801/3977510449] boot 2024-09-19T08:04:04.004 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:03 smithi027 ceph-mon[31209]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T08:04:04.004 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:03 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:04:04.969 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:04 smithi203 ceph-mon[35198]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:04.969 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:04 smithi203 ceph-mon[35198]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T08:04:04.970 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:04 smithi203 ceph-mon[35198]: from='client.? 172.21.15.203:0/2409578872' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3dc80404-a56b-456a-af02-f01e9c6c6dfe"}]: dispatch 2024-09-19T08:04:04.970 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:04 smithi203 ceph-mon[35198]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3dc80404-a56b-456a-af02-f01e9c6c6dfe"}]: dispatch 2024-09-19T08:04:04.970 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:04 smithi203 ceph-mon[35198]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3dc80404-a56b-456a-af02-f01e9c6c6dfe"}]': finished 2024-09-19T08:04:04.970 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:04 smithi203 ceph-mon[35198]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:04:04.970 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:04 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:04:04.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:04 smithi155 ceph-mon[35362]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:04.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:04 smithi155 ceph-mon[35362]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T08:04:04.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:04 smithi155 ceph-mon[35362]: from='client.? 172.21.15.203:0/2409578872' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3dc80404-a56b-456a-af02-f01e9c6c6dfe"}]: dispatch 2024-09-19T08:04:04.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:04 smithi155 ceph-mon[35362]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3dc80404-a56b-456a-af02-f01e9c6c6dfe"}]: dispatch 2024-09-19T08:04:04.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:04 smithi155 ceph-mon[35362]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3dc80404-a56b-456a-af02-f01e9c6c6dfe"}]': finished 2024-09-19T08:04:04.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:04 smithi155 ceph-mon[35362]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:04:04.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:04 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:04:05.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:04 smithi027 ceph-mon[31209]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:05.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:04 smithi027 ceph-mon[31209]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T08:04:05.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:04 smithi027 ceph-mon[31209]: from='client.? 172.21.15.203:0/2409578872' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3dc80404-a56b-456a-af02-f01e9c6c6dfe"}]: dispatch 2024-09-19T08:04:05.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:04 smithi027 ceph-mon[31209]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3dc80404-a56b-456a-af02-f01e9c6c6dfe"}]: dispatch 2024-09-19T08:04:05.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:04 smithi027 ceph-mon[31209]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3dc80404-a56b-456a-af02-f01e9c6c6dfe"}]': finished 2024-09-19T08:04:05.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:04 smithi027 ceph-mon[31209]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:04:05.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:04 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:04:05.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:05 smithi155 ceph-mon[35362]: from='client.? 172.21.15.203:0/1351020859' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:04:06.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:05 smithi027 ceph-mon[31209]: from='client.? 172.21.15.203:0/1351020859' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:04:06.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:05 smithi203 ceph-mon[35198]: from='client.? 172.21.15.203:0/1351020859' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:04:06.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:06 smithi155 ceph-mon[35362]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:07.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:06 smithi027 ceph-mon[31209]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:07.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:06 smithi203 ceph-mon[35198]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:08.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:08 smithi155 ceph-mon[35362]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:09.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:08 smithi027 ceph-mon[31209]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:09.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:08 smithi203 ceph-mon[35198]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:10.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:10 smithi203 ceph-mon[35198]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:10.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:10 smithi155 ceph-mon[35362]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:11.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:10 smithi027 ceph-mon[31209]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:12.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:12 smithi203 ceph-mon[35198]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:12.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:12 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:04:12.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:12 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:12.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:12 smithi155 ceph-mon[35362]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:12.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:12 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:04:12.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:12 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:13.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:12 smithi027 ceph-mon[31209]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:13.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:12 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:04:13.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:12 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:13.684 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:13 smithi203 ceph-mon[35198]: Deploying daemon osd.2 on smithi203 2024-09-19T08:04:13.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:13 smithi155 ceph-mon[35362]: Deploying daemon osd.2 on smithi203 2024-09-19T08:04:14.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:13 smithi027 ceph-mon[31209]: Deploying daemon osd.2 on smithi203 2024-09-19T08:04:14.866 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:14 smithi203 ceph-mon[35198]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:14.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:14 smithi155 ceph-mon[35362]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:15.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:14 smithi027 ceph-mon[31209]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:16.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:16 smithi155 ceph-mon[35362]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:17.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:16 smithi027 ceph-mon[31209]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:17.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:16 smithi203 ceph-mon[35198]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:18.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:18 smithi155 ceph-mon[35362]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:19.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:18 smithi027 ceph-mon[31209]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:19.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:18 smithi203 ceph-mon[35198]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:19.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:19 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:04:19.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:19 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:19.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:19 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:19.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:19 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:04:19.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:19 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:19.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:19 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:20.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:19 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:04:20.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:19 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:20.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:19 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:20.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:20 smithi155 ceph-mon[35362]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:21.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:20 smithi027 ceph-mon[31209]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:21.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:20 smithi203 ceph-mon[35198]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:22.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:22 smithi203 ceph-mon[35198]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:22.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:22 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:22.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:22 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:22.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:22 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:22.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:22 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:04:22.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:22 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:22.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:22 smithi155 ceph-mon[35362]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:22.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:22 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:22.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:22 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:22.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:22 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:22.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:22 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:04:22.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:22 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:22.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:22 smithi027 ceph-mon[31209]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:22.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:22 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:22.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:22 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:22.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:22 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:22.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:22 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:04:22.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:22 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:22.949 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:22.949+0000 7f2699ffb640 1 -- 172.21.15.203:0/234977308 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f269c062630 con 0x7f268c0a31b0 2024-09-19T08:04:22.950 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 2 on host 'smithi203' 2024-09-19T08:04:22.952 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:22.951+0000 7f26a2e7f640 1 -- 172.21.15.203:0/234977308 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f268c0a31b0 msgr2=0x7f268c0a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:04:22.952 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:22.951+0000 7f26a2e7f640 1 --2- 172.21.15.203:0/234977308 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f268c0a31b0 0x7f268c0a5670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f269c102c60 tx=0x7f269000b390 comp rx=0 tx=0).stop 2024-09-19T08:04:22.952 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:22.951+0000 7f26a2e7f640 1 -- 172.21.15.203:0/234977308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f269c1037c0 msgr2=0x7f269c074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:04:22.952 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:22.951+0000 7f26a2e7f640 1 --2- 172.21.15.203:0/234977308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f269c1037c0 0x7f269c074b20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f269400eaa0 tx=0x7f269400ef60 comp rx=0 tx=0).stop 2024-09-19T08:04:22.952 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:22.952+0000 7f26a2e7f640 1 -- 172.21.15.203:0/234977308 shutdown_connections 2024-09-19T08:04:22.952 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:22.952+0000 7f26a2e7f640 1 --2- 172.21.15.203:0/234977308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f269c1037c0 0x7f269c074b20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:22.952 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:22.952+0000 7f26a2e7f640 1 --2- 172.21.15.203:0/234977308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f269c102e00 0x7f269c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:22.952 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:22.952+0000 7f26a2e7f640 1 --2- 172.21.15.203:0/234977308 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f268c0a31b0 0x7f268c0a5670 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:22.952 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:22.952+0000 7f26a2e7f640 1 --2- 172.21.15.203:0/234977308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f269c101c00 0x7f269c075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:22.952 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:22.952+0000 7f26a2e7f640 1 -- 172.21.15.203:0/234977308 >> 172.21.15.203:0/234977308 conn(0x7f269c0fd390 msgr2=0x7f269c106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:04:22.953 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:22.952+0000 7f26a2e7f640 1 -- 172.21.15.203:0/234977308 shutdown_connections 2024-09-19T08:04:22.953 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:04:22.952+0000 7f26a2e7f640 1 -- 172.21.15.203:0/234977308 wait complete. 2024-09-19T08:04:23.568 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:23 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:04:23.568 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:23 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:23.569 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:23 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:23.595 DEBUG:teuthology.orchestra.run.smithi203:osd.2> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T08:04:23.597 INFO:tasks.cephadm:Deploying osd.3 on smithi027 with /dev/vg_nvme/lv_3... 2024-09-19T08:04:23.597 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:04:23.622 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:23 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:04:23.622 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:23 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:23.623 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:23 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:23.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:23 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:04:23.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:23 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:23.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:23 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:23.849 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:04:24.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:24 smithi155 ceph-mon[35362]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:24.738 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:24 smithi027 ceph-mon[31209]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:24.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:24 smithi203 ceph-mon[35198]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:25.067 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:04:24 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-2[40193]: 2024-09-19T08:04:24.797+0000 7f853da27640 -1 osd.2 0 log_to_monitors true 2024-09-19T08:04:25.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:25 smithi203 ceph-mon[35198]: from='osd.2 [v2:172.21.15.203:6800/3796057016,v1:172.21.15.203:6801/3796057016]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:04:25.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:25 smithi203 ceph-mon[35198]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:04:25.636 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:25 smithi027 ceph-mon[31209]: from='osd.2 [v2:172.21.15.203:6800/3796057016,v1:172.21.15.203:6801/3796057016]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:04:25.646 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:25 smithi027 ceph-mon[31209]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:04:25.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:25 smithi155 ceph-mon[35362]: from='osd.2 [v2:172.21.15.203:6800/3796057016,v1:172.21.15.203:6801/3796057016]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:04:25.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:25 smithi155 ceph-mon[35362]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:04:26.417 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:26 smithi203 ceph-mon[35198]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:26.417 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:26 smithi203 ceph-mon[35198]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:04:26.417 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:26 smithi203 ceph-mon[35198]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T08:04:26.417 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:26 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:04:26.417 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:26 smithi203 ceph-mon[35198]: from='osd.2 [v2:172.21.15.203:6800/3796057016,v1:172.21.15.203:6801/3796057016]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:04:26.417 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:26 smithi203 ceph-mon[35198]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:04:26.418 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:04:26 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-2[40193]: 2024-09-19T08:04:26.321+0000 7f85399aa640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T08:04:26.418 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:04:26 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-2[40193]: 2024-09-19T08:04:26.324+0000 7f85357d2640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:04:26.648 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:26 smithi027 ceph-mon[31209]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:26.648 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:26 smithi027 ceph-mon[31209]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:04:26.648 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:26 smithi027 ceph-mon[31209]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T08:04:26.648 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:26 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:04:26.648 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:26 smithi027 ceph-mon[31209]: from='osd.2 [v2:172.21.15.203:6800/3796057016,v1:172.21.15.203:6801/3796057016]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:04:26.649 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:26 smithi027 ceph-mon[31209]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:04:26.651 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:04:26.676 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi027:vg_nvme/lv_3 2024-09-19T08:04:26.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:26 smithi155 ceph-mon[35362]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:26.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:26 smithi155 ceph-mon[35362]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:04:26.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:26 smithi155 ceph-mon[35362]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T08:04:26.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:26 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:04:26.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:26 smithi155 ceph-mon[35362]: from='osd.2 [v2:172.21.15.203:6800/3796057016,v1:172.21.15.203:6801/3796057016]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:04:26.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:26 smithi155 ceph-mon[35362]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:04:26.972 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:04:27.351 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:27 smithi027 ceph-mon[31209]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:04:27.351 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:27 smithi027 ceph-mon[31209]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T08:04:27.351 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:27 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:04:27.351 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:27 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:04:27.351 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:27 smithi027 ceph-mon[31209]: Detected new or changed devices on smithi203 2024-09-19T08:04:27.352 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:27 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:27.352 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:27 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:27.352 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:27 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:04:27.352 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:27 smithi027 ceph-mon[31209]: Adjusting osd_memory_target on smithi203 to 17088M 2024-09-19T08:04:27.352 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:27 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:27.352 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:27 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:27.352 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:27 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:04:27.352 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:27 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:27.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.436+0000 7fa5bf8af640 1 -- 172.21.15.27:0/845010056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5b81037c0 msgr2=0x7fa5b810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:04:27.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.436+0000 7fa5bf8af640 1 --2- 172.21.15.27:0/845010056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5b81037c0 0x7fa5b810a050 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009ca0 tx=0x7fa5b002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:04:27.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.437+0000 7fa5bf8af640 1 -- 172.21.15.27:0/845010056 shutdown_connections 2024-09-19T08:04:27.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.437+0000 7fa5bf8af640 1 --2- 172.21.15.27:0/845010056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5b81037c0 0x7fa5b810a050 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:27.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.437+0000 7fa5bf8af640 1 --2- 172.21.15.27:0/845010056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5b8102e00 0x7fa5b8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:27.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.437+0000 7fa5bf8af640 1 --2- 172.21.15.27:0/845010056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5b8101c00 0x7fa5b8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:27.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.437+0000 7fa5bf8af640 1 -- 172.21.15.27:0/845010056 >> 172.21.15.27:0/845010056 conn(0x7fa5b80fd390 msgr2=0x7fa5b80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:04:27.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.437+0000 7fa5bf8af640 1 -- 172.21.15.27:0/845010056 shutdown_connections 2024-09-19T08:04:27.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.437+0000 7fa5bf8af640 1 -- 172.21.15.27:0/845010056 wait complete. 2024-09-19T08:04:27.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.437+0000 7fa5bf8af640 1 Processor -- start 2024-09-19T08:04:27.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.437+0000 7fa5bf8af640 1 -- start start 2024-09-19T08:04:27.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.437+0000 7fa5bf8af640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5b8101c00 0x7fa5b8197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:04:27.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.437+0000 7fa5bf8af640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5b8102e00 0x7fa5b81983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:04:27.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.437+0000 7fa5bf8af640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5b81037c0 0x7fa5b819f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:04:27.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.437+0000 7fa5bf8af640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b810d8d0 con 0x7fa5b8101c00 2024-09-19T08:04:27.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.437+0000 7fa5bf8af640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b810d750 con 0x7fa5b81037c0 2024-09-19T08:04:27.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.437+0000 7fa5bf8af640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b810da50 con 0x7fa5b8102e00 2024-09-19T08:04:27.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.438+0000 7fa5bd64b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5b8101c00 0x7fa5b8197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:04:27.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.438+0000 7fa5bd64b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5b8101c00 0x7fa5b8197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43066/0 (socket says 172.21.15.27:43066) 2024-09-19T08:04:27.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.438+0000 7fa5bd64b640 1 -- 172.21.15.27:0/666288010 learned_addr learned my addr 172.21.15.27:0/666288010 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:04:27.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.438+0000 7fa5bce4a640 1 --2- 172.21.15.27:0/666288010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5b8102e00 0x7fa5b81983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:04:27.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.438+0000 7fa5bde4c640 1 --2- 172.21.15.27:0/666288010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5b81037c0 0x7fa5b819f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:04:27.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.438+0000 7fa5bd64b640 1 -- 172.21.15.27:0/666288010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5b8102e00 msgr2=0x7fa5b81983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:04:27.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.438+0000 7fa5bd64b640 1 --2- 172.21.15.27:0/666288010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5b8102e00 0x7fa5b81983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:27.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.438+0000 7fa5bd64b640 1 -- 172.21.15.27:0/666288010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5b81037c0 msgr2=0x7fa5b819f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:04:27.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.438+0000 7fa5bd64b640 1 --2- 172.21.15.27:0/666288010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5b81037c0 0x7fa5b819f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:27.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.438+0000 7fa5bd64b640 1 -- 172.21.15.27:0/666288010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b819fac0 con 0x7fa5b8101c00 2024-09-19T08:04:27.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.438+0000 7fa5bd64b640 1 --2- 172.21.15.27:0/666288010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5b8101c00 0x7fa5b8197e90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400d950 tx=0x7fa5b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:04:27.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.438+0000 7fa5aa7fc640 1 -- 172.21.15.27:0/666288010 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4017070 con 0x7fa5b8101c00 2024-09-19T08:04:27.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.438+0000 7fa5aa7fc640 1 -- 172.21.15.27:0/666288010 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5b4009c30 con 0x7fa5b8101c00 2024-09-19T08:04:27.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.438+0000 7fa5bf8af640 1 -- 172.21.15.27:0/666288010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5b819fdb0 con 0x7fa5b8101c00 2024-09-19T08:04:27.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.438+0000 7fa5aa7fc640 1 -- 172.21.15.27:0/666288010 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b400f600 con 0x7fa5b8101c00 2024-09-19T08:04:27.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.438+0000 7fa5bf8af640 1 -- 172.21.15.27:0/666288010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5b81a0210 con 0x7fa5b8101c00 2024-09-19T08:04:27.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.439+0000 7fa5bf8af640 1 -- 172.21.15.27:0/666288010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5b8108f30 con 0x7fa5b8101c00 2024-09-19T08:04:27.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.440+0000 7fa5aa7fc640 1 -- 172.21.15.27:0/666288010 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fa5b401a070 con 0x7fa5b8101c00 2024-09-19T08:04:27.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.441+0000 7fa5aa7fc640 1 --2- 172.21.15.27:0/666288010 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fa5a40a3260 0x7fa5a40a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:04:27.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.441+0000 7fa5bce4a640 1 --2- 172.21.15.27:0/666288010 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fa5a40a3260 0x7fa5a40a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:04:27.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.441+0000 7fa5aa7fc640 1 -- 172.21.15.27:0/666288010 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7fa5b40cdbd0 con 0x7fa5b8101c00 2024-09-19T08:04:27.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.442+0000 7fa5bce4a640 1 --2- 172.21.15.27:0/666288010 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fa5a40a3260 0x7fa5a40a5720 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa5b81993b0 tx=0x7fa5ac00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:04:27.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.446+0000 7fa5aa7fc640 1 -- 172.21.15.27:0/666288010 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa5b4009de0 con 0x7fa5b8101c00 2024-09-19T08:04:27.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:27.632+0000 7fa5bf8af640 1 -- 172.21.15.27:0/666288010 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa5b8062630 con 0x7fa5a40a3260 2024-09-19T08:04:27.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:27 smithi155 ceph-mon[35362]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:04:27.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:27 smithi155 ceph-mon[35362]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T08:04:27.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:27 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:04:27.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:27 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:04:27.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:27 smithi155 ceph-mon[35362]: Detected new or changed devices on smithi203 2024-09-19T08:04:27.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:27 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:27.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:27 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:27.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:27 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:04:27.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:27 smithi155 ceph-mon[35362]: Adjusting osd_memory_target on smithi203 to 17088M 2024-09-19T08:04:27.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:27 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:27.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:27 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:27.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:27 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:04:27.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:27 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:27.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:27 smithi203 ceph-mon[35198]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:04:27.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:27 smithi203 ceph-mon[35198]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T08:04:27.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:27 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:04:27.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:27 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:04:27.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:27 smithi203 ceph-mon[35198]: Detected new or changed devices on smithi203 2024-09-19T08:04:27.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:27 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:27.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:27 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:27.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:27 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:04:27.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:27 smithi203 ceph-mon[35198]: Adjusting osd_memory_target on smithi203 to 17088M 2024-09-19T08:04:27.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:27 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:27.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:27 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:27.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:27 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:04:27.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:27 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:28.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:28 smithi155 ceph-mon[35362]: purged_snaps scrub starts 2024-09-19T08:04:28.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:28 smithi155 ceph-mon[35362]: purged_snaps scrub ok 2024-09-19T08:04:28.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:28 smithi155 ceph-mon[35362]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:28.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:28 smithi155 ceph-mon[35362]: osd.2 [v2:172.21.15.203:6800/3796057016,v1:172.21.15.203:6801/3796057016] boot 2024-09-19T08:04:28.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:28 smithi155 ceph-mon[35362]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T08:04:28.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:28 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:04:28.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:28 smithi155 ceph-mon[35362]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:04:28.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:28 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:04:28.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:28 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:04:28.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:28 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:28.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:28 smithi027 ceph-mon[31209]: purged_snaps scrub starts 2024-09-19T08:04:28.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:28 smithi027 ceph-mon[31209]: purged_snaps scrub ok 2024-09-19T08:04:28.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:28 smithi027 ceph-mon[31209]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:28.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:28 smithi027 ceph-mon[31209]: osd.2 [v2:172.21.15.203:6800/3796057016,v1:172.21.15.203:6801/3796057016] boot 2024-09-19T08:04:28.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:28 smithi027 ceph-mon[31209]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T08:04:28.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:28 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:04:28.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:28 smithi027 ceph-mon[31209]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:04:28.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:28 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:04:28.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:28 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:04:28.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:28 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:28.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:28 smithi203 ceph-mon[35198]: purged_snaps scrub starts 2024-09-19T08:04:28.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:28 smithi203 ceph-mon[35198]: purged_snaps scrub ok 2024-09-19T08:04:28.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:28 smithi203 ceph-mon[35198]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:04:28.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:28 smithi203 ceph-mon[35198]: osd.2 [v2:172.21.15.203:6800/3796057016,v1:172.21.15.203:6801/3796057016] boot 2024-09-19T08:04:28.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:28 smithi203 ceph-mon[35198]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T08:04:28.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:28 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:04:28.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:28 smithi203 ceph-mon[35198]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:04:28.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:28 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:04:28.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:28 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:04:28.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:28 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:29.714 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:29 smithi027 ceph-mon[31209]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T08:04:29.714 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:29 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:04:29.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:29 smithi155 ceph-mon[35362]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T08:04:29.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:29 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:04:29.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:29 smithi203 ceph-mon[35198]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T08:04:29.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:29 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:04:30.600 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:30 smithi027 ceph-mon[31209]: pgmap v77: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:30.600 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:30 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:04:30.600 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:30 smithi027 ceph-mon[31209]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T08:04:30.600 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:30 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:04:30.600 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:30 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/479673703' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a51077d0-5e04-49b5-bb3e-91711cc45ff1"}]: dispatch 2024-09-19T08:04:30.600 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:30 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:04:30.600 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:30 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/479673703' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a51077d0-5e04-49b5-bb3e-91711cc45ff1"}]': finished 2024-09-19T08:04:30.600 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:30 smithi027 ceph-mon[31209]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:04:30.600 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:30 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:04:30.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:30 smithi155 ceph-mon[35362]: pgmap v77: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:30.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:30 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:04:30.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:30 smithi155 ceph-mon[35362]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T08:04:30.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:30 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:04:30.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:30 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/479673703' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a51077d0-5e04-49b5-bb3e-91711cc45ff1"}]: dispatch 2024-09-19T08:04:30.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:30 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:04:30.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:30 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/479673703' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a51077d0-5e04-49b5-bb3e-91711cc45ff1"}]': finished 2024-09-19T08:04:30.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:30 smithi155 ceph-mon[35362]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:04:30.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:30 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:04:30.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:30 smithi203 ceph-mon[35198]: pgmap v77: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:30.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:30 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:04:30.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:30 smithi203 ceph-mon[35198]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T08:04:30.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:30 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:04:30.760 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:30 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/479673703' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a51077d0-5e04-49b5-bb3e-91711cc45ff1"}]: dispatch 2024-09-19T08:04:30.760 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:30 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:04:30.760 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:30 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/479673703' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a51077d0-5e04-49b5-bb3e-91711cc45ff1"}]': finished 2024-09-19T08:04:30.760 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:30 smithi203 ceph-mon[35198]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:04:30.760 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:30 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:04:31.002 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:04:30 smithi027 sudo[49661]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:04:31.002 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:04:30 smithi027 sudo[49661]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:04:31.003 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:04:30 smithi027 sudo[49661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:04:31.003 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:04:30 smithi027 sudo[49661]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:04:31.480 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:04:31 smithi027 sudo[49710]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:04:31.480 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:04:31 smithi027 sudo[49710]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:04:31.480 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:04:31 smithi027 sudo[49710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:04:31.480 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:04:31 smithi027 sudo[49710]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:04:31.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:31.485+0000 7fa5aa7fc640 1 -- 172.21.15.27:0/666288010 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa5b4097f40 con 0x7fa5b8101c00 2024-09-19T08:04:31.588 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:31 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/12729768' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:04:31.588 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:31 smithi155 ceph-mon[35362]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:04:31.588 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:31 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:04:31.589 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:31 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:31.589 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:04:31 smithi155 sudo[43940]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:04:31.589 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:04:31 smithi155 sudo[43940]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:04:31.589 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:04:31 smithi155 sudo[43940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:04:31.589 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:04:31 smithi155 sudo[43940]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:04:31.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:31 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/12729768' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:04:31.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:31 smithi027 ceph-mon[31209]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:04:31.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:31 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:04:31.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:31 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:31.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:31 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/12729768' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:04:31.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:31 smithi203 ceph-mon[35198]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:04:31.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:31 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:04:31.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:31 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:31.987 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:04:31 smithi155 sudo[43943]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:04:31.987 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:04:31 smithi155 sudo[43943]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:04:31.987 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:04:31 smithi155 sudo[43943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:04:31.987 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:04:31 smithi155 sudo[43943]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:04:32.116 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:04:31 smithi203 sudo[44098]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:04:32.116 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:04:31 smithi203 sudo[44098]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:04:32.116 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:04:31 smithi203 sudo[44098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:04:32.116 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:04:31 smithi203 sudo[44098]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:04:32.508 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:04:32 smithi203 sudo[44101]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:04:32.509 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:04:32 smithi203 sudo[44101]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:04:32.509 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:04:32 smithi203 sudo[44101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:04:32.509 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:04:32 smithi203 sudo[44101]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:04:32.926 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:32 smithi027 sudo[50090]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:04:32.926 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:32 smithi027 sudo[50090]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:04:32.926 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:32 smithi027 sudo[50090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:04:32.926 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:32 smithi027 sudo[50090]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:04:33.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:33 smithi027 sudo[50282]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:04:33.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:33 smithi027 sudo[50282]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:04:33.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:33 smithi027 sudo[50282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:04:33.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:33 smithi027 sudo[50282]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:04:33.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:33 smithi027 ceph-mon[31209]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:33.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:33 smithi027 ceph-mon[31209]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:04:33.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:33 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:33.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:33 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:33.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:33 smithi027 ceph-mon[31209]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:04:33.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:33 smithi155 ceph-mon[35362]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:33.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:33 smithi155 ceph-mon[35362]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:04:33.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:33 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:33.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:33 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:33.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:33 smithi155 ceph-mon[35362]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:04:33.543 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:33 smithi203 sudo[44104]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:04:33.543 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:33 smithi203 sudo[44104]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:04:33.543 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:33 smithi203 sudo[44104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:04:33.543 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:33 smithi203 sudo[44104]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:04:34.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:33 smithi203 sudo[44107]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:04:34.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:33 smithi203 sudo[44107]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:04:34.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:33 smithi203 sudo[44107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:04:34.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:33 smithi203 sudo[44107]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:04:34.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:33 smithi203 ceph-mon[35198]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:34.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:33 smithi203 ceph-mon[35198]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:04:34.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:33 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:34.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:33 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:34.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:33 smithi203 ceph-mon[35198]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:04:34.039 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:33 smithi155 sudo[43946]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:04:34.039 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:33 smithi155 sudo[43946]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:04:34.039 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:33 smithi155 sudo[43946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:04:34.040 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:33 smithi155 sudo[43946]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:04:34.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:34 smithi027 ceph-mon[31209]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:34.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:34 smithi027 ceph-mon[31209]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:04:34.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:04:34.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:04:34.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:04:34.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:34 smithi027 ceph-mon[31209]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:04:34.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:04:34.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:04:34.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:04:34.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:34 smithi027 ceph-mon[31209]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:04:34.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:34 smithi027 ceph-mon[31209]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:04:34.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:04:34.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:04:34.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:04:34.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:34 smithi027 ceph-mon[31209]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:04:34.463 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:34 smithi155 sudo[43949]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:04:34.464 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:34 smithi155 sudo[43949]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:04:34.464 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:34 smithi155 sudo[43949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:04:34.464 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:34 smithi155 sudo[43949]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:04:34.464 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:34 smithi155 ceph-mon[35362]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:34.464 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:34 smithi155 ceph-mon[35362]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:04:34.464 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:04:34.464 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:04:34.464 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:04:34.464 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:34 smithi155 ceph-mon[35362]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:04:34.464 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:04:34.464 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:04:34.464 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:04:34.465 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:34 smithi155 ceph-mon[35362]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:04:34.465 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:34 smithi155 ceph-mon[35362]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:04:34.465 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:04:34.465 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:04:34.465 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:04:34.465 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:34 smithi155 ceph-mon[35362]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:04:34.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:34 smithi203 ceph-mon[35198]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:34.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:34 smithi203 ceph-mon[35198]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:04:34.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:04:34.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:04:34.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:04:34.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:34 smithi203 ceph-mon[35198]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:04:34.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:04:34.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:04:34.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:04:34.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:34 smithi203 ceph-mon[35198]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:04:34.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:34 smithi203 ceph-mon[35198]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:04:34.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:04:34.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:04:34.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:04:34.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:34 smithi203 ceph-mon[35198]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:04:36.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:36 smithi027 ceph-mon[31209]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:36.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:36 smithi155 ceph-mon[35362]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:36.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:36 smithi203 ceph-mon[35198]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:38.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:38 smithi027 ceph-mon[31209]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:38.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:38 smithi155 ceph-mon[35362]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:38.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:38 smithi203 ceph-mon[35198]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:39.443 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:39 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:04:39.443 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:39 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:39.443 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:39 smithi027 ceph-mon[31209]: Deploying daemon osd.3 on smithi027 2024-09-19T08:04:39.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:39 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:04:39.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:39 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:39.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:39 smithi155 ceph-mon[35362]: Deploying daemon osd.3 on smithi027 2024-09-19T08:04:39.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:39 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:04:39.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:39 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:39.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:39 smithi203 ceph-mon[35198]: Deploying daemon osd.3 on smithi027 2024-09-19T08:04:40.381 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:40 smithi027 ceph-mon[31209]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T08:04:40.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:40 smithi155 ceph-mon[35362]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T08:04:40.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:40 smithi203 ceph-mon[35198]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T08:04:42.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:42 smithi027 ceph-mon[31209]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T08:04:42.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:42 smithi155 ceph-mon[35362]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T08:04:42.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:42 smithi203 ceph-mon[35198]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T08:04:44.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:44 smithi027 ceph-mon[31209]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T08:04:44.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:44 smithi155 ceph-mon[35362]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T08:04:44.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:44 smithi203 ceph-mon[35198]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T08:04:46.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:46 smithi155 ceph-mon[35362]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T08:04:46.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:46 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:04:46.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:46 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:46.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:46 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:46.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:46 smithi027 ceph-mon[31209]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T08:04:46.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:46 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:04:46.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:46 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:46.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:46 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:46.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:46 smithi203 ceph-mon[35198]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T08:04:46.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:46 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:04:46.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:46 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:46.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:46 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:48.426 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:48 smithi027 ceph-mon[31209]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 851 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T08:04:48.427 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:48 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:48.427 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:48 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:48.427 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:48 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:48.427 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:48 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:04:48.427 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:48 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:48.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:48 smithi155 ceph-mon[35362]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 851 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T08:04:48.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:48 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:48.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:48 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:48.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:48 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:48.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:48 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:04:48.488 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:48 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:48.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:48 smithi203 ceph-mon[35198]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 851 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T08:04:48.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:48 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:48.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:48 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:48.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:48 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:48.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:48 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:04:48.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:48 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:49.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:49.149+0000 7fa5aa7fc640 1 -- 172.21.15.27:0/666288010 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa5b8062630 con 0x7fa5a40a3260 2024-09-19T08:04:49.150 INFO:teuthology.orchestra.run.smithi027.stdout:Created osd(s) 3 on host 'smithi027' 2024-09-19T08:04:49.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:49.151+0000 7fa5bf8af640 1 -- 172.21.15.27:0/666288010 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fa5a40a3260 msgr2=0x7fa5a40a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:04:49.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:49.151+0000 7fa5bf8af640 1 --2- 172.21.15.27:0/666288010 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fa5a40a3260 0x7fa5a40a5720 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa5b81993b0 tx=0x7fa5ac00b390 comp rx=0 tx=0).stop 2024-09-19T08:04:49.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:49.151+0000 7fa5bf8af640 1 -- 172.21.15.27:0/666288010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5b8101c00 msgr2=0x7fa5b8197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:04:49.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:49.151+0000 7fa5bf8af640 1 --2- 172.21.15.27:0/666288010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5b8101c00 0x7fa5b8197e90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400d950 tx=0x7fa5b400de10 comp rx=0 tx=0).stop 2024-09-19T08:04:49.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:49.152+0000 7fa5bf8af640 1 -- 172.21.15.27:0/666288010 shutdown_connections 2024-09-19T08:04:49.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:49.152+0000 7fa5bf8af640 1 --2- 172.21.15.27:0/666288010 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fa5a40a3260 0x7fa5a40a5720 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:49.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:49.152+0000 7fa5bf8af640 1 --2- 172.21.15.27:0/666288010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5b81037c0 0x7fa5b819f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:49.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:49.152+0000 7fa5bf8af640 1 --2- 172.21.15.27:0/666288010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5b8102e00 0x7fa5b81983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:49.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:49.152+0000 7fa5bf8af640 1 --2- 172.21.15.27:0/666288010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5b8101c00 0x7fa5b8197e90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:49.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:49.152+0000 7fa5bf8af640 1 -- 172.21.15.27:0/666288010 >> 172.21.15.27:0/666288010 conn(0x7fa5b80fd390 msgr2=0x7fa5b8106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:04:49.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:49.152+0000 7fa5bf8af640 1 -- 172.21.15.27:0/666288010 shutdown_connections 2024-09-19T08:04:49.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:04:49.152+0000 7fa5bf8af640 1 -- 172.21.15.27:0/666288010 wait complete. 2024-09-19T08:04:49.768 DEBUG:teuthology.orchestra.run.smithi027:osd.3> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T08:04:49.770 INFO:tasks.cephadm:Deploying osd.4 on smithi155 with /dev/vg_nvme/lv_3... 2024-09-19T08:04:49.771 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:04:50.027 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:04:50.284 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:50 smithi027 ceph-mon[31209]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 851 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T08:04:50.285 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:50 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:04:50.285 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:50 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:50.285 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:50 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:50.385 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:50 smithi155 ceph-mon[35362]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 851 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T08:04:50.385 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:50 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:04:50.385 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:50 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:50.385 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:50 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:50.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:50 smithi203 ceph-mon[35198]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 851 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T08:04:50.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:50 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:04:50.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:50 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:50.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:50 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:51.182 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:51 smithi027 ceph-mon[31209]: from='osd.3 [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:04:51.182 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 19 08:04:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-3[51684]: 2024-09-19T08:04:50.889+0000 7f26844ee640 -1 osd.3 0 log_to_monitors true 2024-09-19T08:04:51.387 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:51 smithi155 ceph-mon[35362]: from='osd.3 [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:04:51.514 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:51 smithi203 ceph-mon[35198]: from='osd.3 [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:04:52.359 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:52 smithi155 ceph-mon[35362]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:52.359 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:52 smithi155 ceph-mon[35362]: from='osd.3 [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:04:52.359 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:52 smithi155 ceph-mon[35362]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T08:04:52.359 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:52 smithi155 ceph-mon[35362]: from='osd.3 [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-19T08:04:52.359 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:52 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:04:52.409 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:52 smithi203 ceph-mon[35198]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:52.410 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:52 smithi203 ceph-mon[35198]: from='osd.3 [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:04:52.410 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:52 smithi203 ceph-mon[35198]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T08:04:52.410 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:52 smithi203 ceph-mon[35198]: from='osd.3 [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-19T08:04:52.410 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:52 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:04:52.455 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:52 smithi027 ceph-mon[31209]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:52.455 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:52 smithi027 ceph-mon[31209]: from='osd.3 [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:04:52.455 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:52 smithi027 ceph-mon[31209]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T08:04:52.456 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:52 smithi027 ceph-mon[31209]: from='osd.3 [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-19T08:04:52.456 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:52 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:04:52.752 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 19 08:04:52 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-3[51684]: 2024-09-19T08:04:52.515+0000 7f2680471640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T08:04:52.752 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 19 08:04:52 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-3[51684]: 2024-09-19T08:04:52.520+0000 7f2678291640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:04:52.802 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:04:52.830 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi155:vg_nvme/lv_3 2024-09-19T08:04:53.088 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:04:53.351 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:53 smithi155 ceph-mon[35362]: from='osd.3 [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-19T08:04:53.352 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:53 smithi155 ceph-mon[35362]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T08:04:53.352 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:53 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:04:53.352 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:53 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:04:53.352 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:53 smithi155 ceph-mon[35362]: from='osd.3 [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347]' entity='osd.3' 2024-09-19T08:04:53.352 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:53 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:53.352 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:53 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:53.352 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:53 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:04:53.352 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:53 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:04:53.352 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:53 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:53.352 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:53 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:53.352 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:53 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:04:53.352 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:53 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:53.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:53 smithi027 ceph-mon[31209]: from='osd.3 [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-19T08:04:53.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:53 smithi027 ceph-mon[31209]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T08:04:53.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:53 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:04:53.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:53 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:04:53.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:53 smithi027 ceph-mon[31209]: from='osd.3 [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347]' entity='osd.3' 2024-09-19T08:04:53.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:53 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:53.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:53 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:53.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:53 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:04:53.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:53 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:04:53.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:53 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:53.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:53 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:53.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:53 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:04:53.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:53 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:53.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:53 smithi203 ceph-mon[35198]: from='osd.3 [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-19T08:04:53.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:53 smithi203 ceph-mon[35198]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T08:04:53.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:53 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:04:53.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:53 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:04:53.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:53 smithi203 ceph-mon[35198]: from='osd.3 [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347]' entity='osd.3' 2024-09-19T08:04:53.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:53 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:53.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:53 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:53.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:53 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:04:53.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:53 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:04:53.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:53 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:53.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:53 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:53.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:53 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:04:53.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:53 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:04:53.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.576+0000 7f9846f0a640 1 -- 172.21.15.155:0/2390484595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9840102eb0 msgr2=0x7f9840103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:04:53.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.576+0000 7f9846f0a640 1 --2- 172.21.15.155:0/2390484595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9840102eb0 0x7f9840103330 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f982c009900 tx=0x7f982c02a410 comp rx=0 tx=0).stop 2024-09-19T08:04:53.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.576+0000 7f9846f0a640 1 -- 172.21.15.155:0/2390484595 shutdown_connections 2024-09-19T08:04:53.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.576+0000 7f9846f0a640 1 --2- 172.21.15.155:0/2390484595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9840103870 0x7f984010a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:53.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.576+0000 7f9846f0a640 1 --2- 172.21.15.155:0/2390484595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9840102eb0 0x7f9840103330 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:53.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.576+0000 7f9846f0a640 1 --2- 172.21.15.155:0/2390484595 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98400ffed0 0x7f98401002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:53.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.576+0000 7f9846f0a640 1 -- 172.21.15.155:0/2390484595 >> 172.21.15.155:0/2390484595 conn(0x7f98400fba40 msgr2=0x7f98400fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:04:53.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.576+0000 7f9846f0a640 1 -- 172.21.15.155:0/2390484595 shutdown_connections 2024-09-19T08:04:53.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.576+0000 7f9846f0a640 1 -- 172.21.15.155:0/2390484595 wait complete. 2024-09-19T08:04:53.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.577+0000 7f9846f0a640 1 Processor -- start 2024-09-19T08:04:53.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.577+0000 7f9846f0a640 1 -- start start 2024-09-19T08:04:53.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.577+0000 7f9846f0a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98400ffed0 0x7f9840102810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:04:53.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.577+0000 7f9846f0a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9840102eb0 0x7f9840100e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:04:53.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.577+0000 7f9846f0a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9840103870 0x7f98401013a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:04:53.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.577+0000 7f9846f0a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f984010d890 con 0x7f9840103870 2024-09-19T08:04:53.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.577+0000 7f9846f0a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f984010d710 con 0x7f98400ffed0 2024-09-19T08:04:53.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.577+0000 7f9846f0a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f984010da10 con 0x7f9840102eb0 2024-09-19T08:04:53.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.577+0000 7f9844ca6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98400ffed0 0x7f9840102810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:04:53.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.577+0000 7f9844ca6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98400ffed0 0x7f9840102810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54196/0 (socket says 172.21.15.155:54196) 2024-09-19T08:04:53.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.577+0000 7f9844ca6640 1 -- 172.21.15.155:0/731051862 learned_addr learned my addr 172.21.15.155:0/731051862 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-19T08:04:53.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.577+0000 7f983ffff640 1 --2- 172.21.15.155:0/731051862 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9840102eb0 0x7f9840100e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:04:53.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.577+0000 7f98454a7640 1 --2- 172.21.15.155:0/731051862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9840103870 0x7f98401013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:04:53.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.578+0000 7f9844ca6640 1 -- 172.21.15.155:0/731051862 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9840102eb0 msgr2=0x7f9840100e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:04:53.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.578+0000 7f9844ca6640 1 --2- 172.21.15.155:0/731051862 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9840102eb0 0x7f9840100e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:53.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.578+0000 7f9844ca6640 1 -- 172.21.15.155:0/731051862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9840103870 msgr2=0x7f98401013a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:04:53.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.578+0000 7f9844ca6640 1 --2- 172.21.15.155:0/731051862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9840103870 0x7f98401013a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:04:53.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.578+0000 7f9844ca6640 1 -- 172.21.15.155:0/731051862 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9840101c60 con 0x7f98400ffed0 2024-09-19T08:04:53.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.578+0000 7f9844ca6640 1 --2- 172.21.15.155:0/731051862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98400ffed0 0x7f9840102810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f983400d770 tx=0x7f983400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:04:53.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.578+0000 7f983dffb640 1 -- 172.21.15.155:0/731051862 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834017070 con 0x7f98400ffed0 2024-09-19T08:04:53.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.578+0000 7f983dffb640 1 -- 172.21.15.155:0/731051862 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9834009c30 con 0x7f98400ffed0 2024-09-19T08:04:53.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.578+0000 7f9846f0a640 1 -- 172.21.15.155:0/731051862 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98401a2130 con 0x7f98400ffed0 2024-09-19T08:04:53.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.578+0000 7f983dffb640 1 -- 172.21.15.155:0/731051862 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834003dd0 con 0x7f98400ffed0 2024-09-19T08:04:53.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.578+0000 7f9846f0a640 1 -- 172.21.15.155:0/731051862 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98401a2640 con 0x7f98400ffed0 2024-09-19T08:04:53.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.579+0000 7f9846f0a640 1 -- 172.21.15.155:0/731051862 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9840109170 con 0x7f98400ffed0 2024-09-19T08:04:53.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.580+0000 7f983dffb640 1 -- 172.21.15.155:0/731051862 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9834003fb0 con 0x7f98400ffed0 2024-09-19T08:04:53.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.581+0000 7f983dffb640 1 --2- 172.21.15.155:0/731051862 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f98300a3240 0x7f98300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:04:53.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.581+0000 7f983dffb640 1 -- 172.21.15.155:0/731051862 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3702+0+0 (secure 0 0 0) 0x7f98340cdff0 con 0x7f98400ffed0 2024-09-19T08:04:53.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.581+0000 7f983ffff640 1 --2- 172.21.15.155:0/731051862 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f98300a3240 0x7f98300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:04:53.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.582+0000 7f983ffff640 1 --2- 172.21.15.155:0/731051862 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f98300a3240 0x7f98300a5700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f982c000c00 tx=0x7f982c031540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:04:53.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.586+0000 7f983dffb640 1 -- 172.21.15.155:0/731051862 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9834009de0 con 0x7f98400ffed0 2024-09-19T08:04:53.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:04:53.765+0000 7f9846f0a640 1 -- 172.21.15.155:0/731051862 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9840062630 con 0x7f98300a3240 2024-09-19T08:04:54.421 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:54 smithi155 ceph-mon[35362]: purged_snaps scrub starts 2024-09-19T08:04:54.421 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:54 smithi155 ceph-mon[35362]: purged_snaps scrub ok 2024-09-19T08:04:54.421 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:54 smithi155 ceph-mon[35362]: Detected new or changed devices on smithi027 2024-09-19T08:04:54.421 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:54 smithi155 ceph-mon[35362]: Adjusting osd_memory_target on smithi027 to 8544M 2024-09-19T08:04:54.421 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:54 smithi155 ceph-mon[35362]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:54.421 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:54 smithi155 ceph-mon[35362]: osd.3 [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347] boot 2024-09-19T08:04:54.421 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:54 smithi155 ceph-mon[35362]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:04:54.421 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:54 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:04:54.421 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:54 smithi155 ceph-mon[35362]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:04:54.421 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:54 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:04:54.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:54 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:04:54.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:54 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:54.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:54 smithi027 ceph-mon[31209]: purged_snaps scrub starts 2024-09-19T08:04:54.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:54 smithi027 ceph-mon[31209]: purged_snaps scrub ok 2024-09-19T08:04:54.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:54 smithi027 ceph-mon[31209]: Detected new or changed devices on smithi027 2024-09-19T08:04:54.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:54 smithi027 ceph-mon[31209]: Adjusting osd_memory_target on smithi027 to 8544M 2024-09-19T08:04:54.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:54 smithi027 ceph-mon[31209]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:54.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:54 smithi027 ceph-mon[31209]: osd.3 [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347] boot 2024-09-19T08:04:54.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:54 smithi027 ceph-mon[31209]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:04:54.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:54 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:04:54.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:54 smithi027 ceph-mon[31209]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:04:54.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:54 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:04:54.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:54 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:04:54.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:54 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:54.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:54 smithi203 ceph-mon[35198]: purged_snaps scrub starts 2024-09-19T08:04:54.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:54 smithi203 ceph-mon[35198]: purged_snaps scrub ok 2024-09-19T08:04:54.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:54 smithi203 ceph-mon[35198]: Detected new or changed devices on smithi027 2024-09-19T08:04:54.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:54 smithi203 ceph-mon[35198]: Adjusting osd_memory_target on smithi027 to 8544M 2024-09-19T08:04:54.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:54 smithi203 ceph-mon[35198]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:04:54.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:54 smithi203 ceph-mon[35198]: osd.3 [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347] boot 2024-09-19T08:04:54.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:54 smithi203 ceph-mon[35198]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:04:54.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:54 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:04:54.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:54 smithi203 ceph-mon[35198]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:04:54.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:54 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:04:54.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:54 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:04:54.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:54 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:04:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:55 smithi155 ceph-mon[35362]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T08:04:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:55 smithi155 ceph-mon[35362]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T08:04:55.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:55 smithi027 ceph-mon[31209]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T08:04:55.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:55 smithi027 ceph-mon[31209]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T08:04:55.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:55 smithi203 ceph-mon[35198]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T08:04:55.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:55 smithi203 ceph-mon[35198]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T08:04:56.678 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:56 smithi155 ceph-mon[35362]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:04:56.678 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:56 smithi155 ceph-mon[35362]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T08:04:56.678 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:56 smithi155 ceph-mon[35362]: from='client.? 172.21.15.155:0/2831116968' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df35548-90b4-434d-8d7e-c037072c9ae4"}]: dispatch 2024-09-19T08:04:56.678 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:56 smithi155 ceph-mon[35362]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df35548-90b4-434d-8d7e-c037072c9ae4"}]: dispatch 2024-09-19T08:04:56.678 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:56 smithi155 ceph-mon[35362]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0df35548-90b4-434d-8d7e-c037072c9ae4"}]': finished 2024-09-19T08:04:56.678 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:56 smithi155 ceph-mon[35362]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:04:56.679 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:56 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:04:57.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:56 smithi027 ceph-mon[31209]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:04:57.073 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:56 smithi027 ceph-mon[31209]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T08:04:57.073 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:56 smithi027 ceph-mon[31209]: from='client.? 172.21.15.155:0/2831116968' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df35548-90b4-434d-8d7e-c037072c9ae4"}]: dispatch 2024-09-19T08:04:57.073 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:56 smithi027 ceph-mon[31209]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df35548-90b4-434d-8d7e-c037072c9ae4"}]: dispatch 2024-09-19T08:04:57.074 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:56 smithi027 ceph-mon[31209]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0df35548-90b4-434d-8d7e-c037072c9ae4"}]': finished 2024-09-19T08:04:57.074 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:56 smithi027 ceph-mon[31209]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:04:57.074 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:56 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:04:57.074 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:56 smithi203 ceph-mon[35198]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:04:57.074 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:56 smithi203 ceph-mon[35198]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T08:04:57.074 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:56 smithi203 ceph-mon[35198]: from='client.? 172.21.15.155:0/2831116968' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df35548-90b4-434d-8d7e-c037072c9ae4"}]: dispatch 2024-09-19T08:04:57.075 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:56 smithi203 ceph-mon[35198]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df35548-90b4-434d-8d7e-c037072c9ae4"}]: dispatch 2024-09-19T08:04:57.075 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:56 smithi203 ceph-mon[35198]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0df35548-90b4-434d-8d7e-c037072c9ae4"}]': finished 2024-09-19T08:04:57.075 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:56 smithi203 ceph-mon[35198]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:04:57.075 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:56 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:04:57.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:57 smithi155 ceph-mon[35362]: from='client.? 172.21.15.155:0/2605865361' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:04:58.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:57 smithi027 ceph-mon[31209]: from='client.? 172.21.15.155:0/2605865361' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:04:58.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:57 smithi203 ceph-mon[35198]: from='client.? 172.21.15.155:0/2605865361' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:04:58.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:04:58 smithi155 ceph-mon[35362]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:04:59.001 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:04:58 smithi027 ceph-mon[31209]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:04:59.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:04:58 smithi203 ceph-mon[35198]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:05:00.912 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:00 smithi155 ceph-mon[35362]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-09-19T08:05:01.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:00 smithi027 ceph-mon[31209]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-09-19T08:05:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:00 smithi203 ceph-mon[35198]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-09-19T08:05:02.946 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:02 smithi155 ceph-mon[35362]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:05:03.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:02 smithi027 ceph-mon[31209]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:05:03.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:02 smithi203 ceph-mon[35198]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:05:04.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:04 smithi155 ceph-mon[35362]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T08:05:04.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:04 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:05:04.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:04 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:05.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:04 smithi027 ceph-mon[31209]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T08:05:05.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:04 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:05:05.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:04 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:05.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:04 smithi203 ceph-mon[35198]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T08:05:05.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:04 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:05:05.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:04 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:05.875 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:05 smithi155 ceph-mon[35362]: Deploying daemon osd.4 on smithi155 2024-09-19T08:05:06.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:05 smithi027 ceph-mon[31209]: Deploying daemon osd.4 on smithi155 2024-09-19T08:05:06.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:05 smithi203 ceph-mon[35198]: Deploying daemon osd.4 on smithi155 2024-09-19T08:05:06.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:06 smithi155 ceph-mon[35362]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T08:05:07.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:06 smithi027 ceph-mon[31209]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T08:05:07.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:06 smithi203 ceph-mon[35198]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T08:05:08.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:08 smithi155 ceph-mon[35362]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T08:05:09.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:08 smithi027 ceph-mon[31209]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T08:05:09.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:08 smithi203 ceph-mon[35198]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T08:05:10.855 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:10 smithi155 ceph-mon[35362]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:05:11.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:10 smithi027 ceph-mon[31209]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:05:11.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:10 smithi203 ceph-mon[35198]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:05:11.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:11 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:05:11.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:11 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:11.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:11 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:12.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:11 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:05:12.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:11 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:12.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:11 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:12.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:11 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:05:12.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:11 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:12.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:11 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:12.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:12 smithi155 ceph-mon[35362]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:05:13.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:12 smithi027 ceph-mon[31209]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:05:13.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:12 smithi203 ceph-mon[35198]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:05:14.810 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:14 smithi155 ceph-mon[35362]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:05:14.810 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:14.810 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:14.810 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:14.810 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:05:14.811 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:14.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:05:14.854+0000 7f983dffb640 1 -- 172.21.15.155:0/731051862 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9840062630 con 0x7f98300a3240 2024-09-19T08:05:14.855 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 4 on host 'smithi155' 2024-09-19T08:05:14.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:05:14.856+0000 7f9846f0a640 1 -- 172.21.15.155:0/731051862 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f98300a3240 msgr2=0x7f98300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:05:14.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:05:14.856+0000 7f9846f0a640 1 --2- 172.21.15.155:0/731051862 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f98300a3240 0x7f98300a5700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f982c000c00 tx=0x7f982c031540 comp rx=0 tx=0).stop 2024-09-19T08:05:14.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:05:14.856+0000 7f9846f0a640 1 -- 172.21.15.155:0/731051862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98400ffed0 msgr2=0x7f9840102810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:05:14.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:05:14.856+0000 7f9846f0a640 1 --2- 172.21.15.155:0/731051862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98400ffed0 0x7f9840102810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f983400d770 tx=0x7f983400dc30 comp rx=0 tx=0).stop 2024-09-19T08:05:14.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:05:14.856+0000 7f9846f0a640 1 -- 172.21.15.155:0/731051862 shutdown_connections 2024-09-19T08:05:14.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:05:14.856+0000 7f9846f0a640 1 --2- 172.21.15.155:0/731051862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9840103870 0x7f98401013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:05:14.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:05:14.856+0000 7f9846f0a640 1 --2- 172.21.15.155:0/731051862 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9840102eb0 0x7f9840100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:05:14.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:05:14.856+0000 7f9846f0a640 1 --2- 172.21.15.155:0/731051862 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f98300a3240 0x7f98300a5700 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:05:14.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:05:14.856+0000 7f9846f0a640 1 --2- 172.21.15.155:0/731051862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98400ffed0 0x7f9840102810 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:05:14.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:05:14.856+0000 7f9846f0a640 1 -- 172.21.15.155:0/731051862 >> 172.21.15.155:0/731051862 conn(0x7f98400fba40 msgr2=0x7f9840106340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:05:14.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:05:14.856+0000 7f9846f0a640 1 -- 172.21.15.155:0/731051862 shutdown_connections 2024-09-19T08:05:14.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:05:14.856+0000 7f9846f0a640 1 -- 172.21.15.155:0/731051862 wait complete. 2024-09-19T08:05:15.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:14 smithi027 ceph-mon[31209]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:05:15.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:15.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:15.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:15.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:05:15.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:15.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:14 smithi203 ceph-mon[35198]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:05:15.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:15.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:15.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:15.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:05:15.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:15.498 DEBUG:teuthology.orchestra.run.smithi155:osd.4> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T08:05:15.501 INFO:tasks.cephadm:Deploying osd.5 on smithi203 with /dev/vg_nvme/lv_3... 2024-09-19T08:05:15.501 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:05:15.714 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:15 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:05:15.715 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:15 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:15.715 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:15 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:15.758 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:05:15.879 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:15 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:05:15.879 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:15 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:15.879 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:15 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:16.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:15 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:05:16.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:15 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:16.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:15 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:16.487 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:05:16 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4[46700]: 2024-09-19T08:05:16.206+0000 7f81c6e9b640 -1 osd.4 0 log_to_monitors true 2024-09-19T08:05:16.779 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:16 smithi155 ceph-mon[35362]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:05:16.780 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:16 smithi155 ceph-mon[35362]: from='osd.4 [v2:172.21.15.155:6808/569913150,v1:172.21.15.155:6809/569913150]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:05:16.780 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:16 smithi155 ceph-mon[35362]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:05:16.872 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:16 smithi203 ceph-mon[35198]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:05:16.872 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:16 smithi203 ceph-mon[35198]: from='osd.4 [v2:172.21.15.155:6808/569913150,v1:172.21.15.155:6809/569913150]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:05:16.872 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:16 smithi203 ceph-mon[35198]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:05:17.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:16 smithi027 ceph-mon[31209]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:05:17.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:16 smithi027 ceph-mon[31209]: from='osd.4 [v2:172.21.15.155:6808/569913150,v1:172.21.15.155:6809/569913150]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:05:17.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:16 smithi027 ceph-mon[31209]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:05:18.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:17 smithi155 ceph-mon[35362]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:05:18.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:17 smithi155 ceph-mon[35362]: from='osd.4 [v2:172.21.15.155:6808/569913150,v1:172.21.15.155:6809/569913150]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:05:18.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:17 smithi155 ceph-mon[35362]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:05:18.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:17 smithi155 ceph-mon[35362]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T08:05:18.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:17 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:05:18.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:17 smithi155 ceph-mon[35362]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:05:18.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:17 smithi027 ceph-mon[31209]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:05:18.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:17 smithi027 ceph-mon[31209]: from='osd.4 [v2:172.21.15.155:6808/569913150,v1:172.21.15.155:6809/569913150]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:05:18.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:17 smithi027 ceph-mon[31209]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:05:18.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:17 smithi027 ceph-mon[31209]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T08:05:18.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:17 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:05:18.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:17 smithi027 ceph-mon[31209]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:05:18.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:17 smithi203 ceph-mon[35198]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:05:18.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:17 smithi203 ceph-mon[35198]: from='osd.4 [v2:172.21.15.155:6808/569913150,v1:172.21.15.155:6809/569913150]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:05:18.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:17 smithi203 ceph-mon[35198]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:05:18.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:17 smithi203 ceph-mon[35198]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T08:05:18.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:17 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:05:18.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:17 smithi203 ceph-mon[35198]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:05:18.341 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:05:18.368 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_3 2024-09-19T08:05:18.626 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:05:18.737 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:05:18 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4[46700]: 2024-09-19T08:05:18.254+0000 7f81c2e1e640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T08:05:18.737 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:05:18 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4[46700]: 2024-09-19T08:05:18.259+0000 7f81bac3e640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:05:18.912 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:18 smithi203 ceph-mon[35198]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:05:18.913 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:18 smithi203 ceph-mon[35198]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T08:05:18.913 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:18 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:05:18.913 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:18 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:05:18.913 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:18 smithi203 ceph-mon[35198]: from='osd.4 ' entity='osd.4' 2024-09-19T08:05:18.913 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:18 smithi203 ceph-mon[35198]: Detected new or changed devices on smithi155 2024-09-19T08:05:18.913 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:18 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:18.913 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:18 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:18.913 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:18 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:05:18.913 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:18 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:05:18.913 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:18 smithi203 ceph-mon[35198]: Adjusting osd_memory_target on smithi155 to 8544M 2024-09-19T08:05:18.914 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:18 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:18.914 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:18 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:18.914 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:18 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:05:18.914 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:18 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:19.151 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.128+0000 7f536681d640 1 -- 172.21.15.203:0/3351343646 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5360100ad0 msgr2=0x7f5360100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:05:19.151 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.128+0000 7f536681d640 1 --2- 172.21.15.203:0/3351343646 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5360100ad0 0x7f5360100ed0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5350009900 tx=0x7f535002a410 comp rx=0 tx=0).stop 2024-09-19T08:05:19.151 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.128+0000 7f536681d640 1 -- 172.21.15.203:0/3351343646 shutdown_connections 2024-09-19T08:05:19.151 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.129+0000 7f536681d640 1 --2- 172.21.15.203:0/3351343646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5360102690 0x7f5360108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:05:19.152 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.129+0000 7f536681d640 1 --2- 172.21.15.203:0/3351343646 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5360101cd0 0x7f5360102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:05:19.152 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.129+0000 7f536681d640 1 --2- 172.21.15.203:0/3351343646 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5360100ad0 0x7f5360100ed0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:05:19.152 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.129+0000 7f536681d640 1 -- 172.21.15.203:0/3351343646 >> 172.21.15.203:0/3351343646 conn(0x7f53600fc280 msgr2=0x7f53600fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:05:19.152 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.129+0000 7f536681d640 1 -- 172.21.15.203:0/3351343646 shutdown_connections 2024-09-19T08:05:19.152 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.129+0000 7f536681d640 1 -- 172.21.15.203:0/3351343646 wait complete. 2024-09-19T08:05:19.152 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.129+0000 7f536681d640 1 Processor -- start 2024-09-19T08:05:19.152 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.129+0000 7f536681d640 1 -- start start 2024-09-19T08:05:19.152 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.129+0000 7f536681d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5360100ad0 0x7f5360197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:05:19.152 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.129+0000 7f536681d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5360101cd0 0x7f5360198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:05:19.152 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.129+0000 7f536681d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5360102690 0x7f536019f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:05:19.152 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.129+0000 7f536681d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f536010d880 con 0x7f5360101cd0 2024-09-19T08:05:19.153 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.130+0000 7f536681d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f536010d700 con 0x7f5360100ad0 2024-09-19T08:05:19.153 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.130+0000 7f536681d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f536010da00 con 0x7f5360102690 2024-09-19T08:05:19.157 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.130+0000 7f5364dba640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5360102690 0x7f536019f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:05:19.157 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.130+0000 7f535ffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5360100ad0 0x7f5360197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:05:19.157 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.130+0000 7f5364dba640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5360102690 0x7f536019f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:56780/0 (socket says 172.21.15.203:56780) 2024-09-19T08:05:19.157 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.130+0000 7f5364dba640 1 -- 172.21.15.203:0/333485779 learned_addr learned my addr 172.21.15.203:0/333485779 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:05:19.157 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.130+0000 7f535f7fe640 1 --2- 172.21.15.203:0/333485779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5360101cd0 0x7f5360198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:05:19.157 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.130+0000 7f5364dba640 1 -- 172.21.15.203:0/333485779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5360100ad0 msgr2=0x7f5360197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:05:19.157 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.130+0000 7f5364dba640 1 --2- 172.21.15.203:0/333485779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5360100ad0 0x7f5360197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:05:19.157 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.130+0000 7f5364dba640 1 -- 172.21.15.203:0/333485779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5360101cd0 msgr2=0x7f5360198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:05:19.157 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.130+0000 7f5364dba640 1 --2- 172.21.15.203:0/333485779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5360101cd0 0x7f5360198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:05:19.158 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.130+0000 7f5364dba640 1 -- 172.21.15.203:0/333485779 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f536019fb50 con 0x7f5360102690 2024-09-19T08:05:19.158 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.130+0000 7f535ffff640 1 --2- 172.21.15.203:0/333485779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5360100ad0 0x7f5360197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:05:19.158 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.130+0000 7f5364dba640 1 --2- 172.21.15.203:0/333485779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5360102690 0x7f536019f4e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f535800eb10 tx=0x7f535800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:05:19.158 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.130+0000 7f535d7fa640 1 -- 172.21.15.203:0/333485779 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5358004b20 con 0x7f5360102690 2024-09-19T08:05:19.158 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.130+0000 7f535d7fa640 1 -- 172.21.15.203:0/333485779 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5358004cc0 con 0x7f5360102690 2024-09-19T08:05:19.158 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.130+0000 7f536681d640 1 -- 172.21.15.203:0/333485779 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f536019fe40 con 0x7f5360102690 2024-09-19T08:05:19.158 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.130+0000 7f535d7fa640 1 -- 172.21.15.203:0/333485779 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5358010760 con 0x7f5360102690 2024-09-19T08:05:19.158 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.130+0000 7f536681d640 1 -- 172.21.15.203:0/333485779 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53601a02f0 con 0x7f5360102690 2024-09-19T08:05:19.158 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.132+0000 7f536681d640 1 -- 172.21.15.203:0/333485779 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5360107f40 con 0x7f5360102690 2024-09-19T08:05:19.158 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.133+0000 7f535d7fa640 1 -- 172.21.15.203:0/333485779 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5358005020 con 0x7f5360102690 2024-09-19T08:05:19.158 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.133+0000 7f535d7fa640 1 --2- 172.21.15.203:0/333485779 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f53480a3270 0x7f53480a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:05:19.159 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.133+0000 7f535d7fa640 1 -- 172.21.15.203:0/333485779 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 3821+0+0 (secure 0 0 0) 0x7f53580cec40 con 0x7f5360102690 2024-09-19T08:05:19.159 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.134+0000 7f535ffff640 1 --2- 172.21.15.203:0/333485779 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f53480a3270 0x7f53480a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:05:19.159 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.134+0000 7f535ffff640 1 --2- 172.21.15.203:0/333485779 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f53480a3270 0x7f53480a5730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5350005ab0 tx=0x7f5350000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:05:19.159 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.138+0000 7f535d7fa640 1 -- 172.21.15.203:0/333485779 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f535809caf0 con 0x7f5360102690 2024-09-19T08:05:19.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:18 smithi155 ceph-mon[35362]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:05:19.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:18 smithi155 ceph-mon[35362]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T08:05:19.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:18 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:05:19.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:18 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:05:19.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:18 smithi155 ceph-mon[35362]: from='osd.4 ' entity='osd.4' 2024-09-19T08:05:19.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:18 smithi155 ceph-mon[35362]: Detected new or changed devices on smithi155 2024-09-19T08:05:19.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:18 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:19.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:18 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:19.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:18 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:05:19.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:18 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:05:19.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:18 smithi155 ceph-mon[35362]: Adjusting osd_memory_target on smithi155 to 8544M 2024-09-19T08:05:19.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:18 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:19.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:18 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:19.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:18 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:05:19.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:18 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:19.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:18 smithi027 ceph-mon[31209]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:05:19.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:18 smithi027 ceph-mon[31209]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T08:05:19.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:18 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:05:19.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:18 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:05:19.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:18 smithi027 ceph-mon[31209]: from='osd.4 ' entity='osd.4' 2024-09-19T08:05:19.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:18 smithi027 ceph-mon[31209]: Detected new or changed devices on smithi155 2024-09-19T08:05:19.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:18 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:19.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:18 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:19.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:18 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:05:19.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:18 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:05:19.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:18 smithi027 ceph-mon[31209]: Adjusting osd_memory_target on smithi155 to 8544M 2024-09-19T08:05:19.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:18 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:19.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:18 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:19.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:18 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:05:19.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:18 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:19.321 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:19.320+0000 7f536681d640 1 -- 172.21.15.203:0/333485779 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f5360062630 con 0x7f53480a3270 2024-09-19T08:05:19.970 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:19 smithi203 ceph-mon[35198]: purged_snaps scrub starts 2024-09-19T08:05:19.971 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:19 smithi203 ceph-mon[35198]: purged_snaps scrub ok 2024-09-19T08:05:19.971 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:19 smithi203 ceph-mon[35198]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:05:19.971 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:19 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:05:19.971 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:19 smithi203 ceph-mon[35198]: osd.4 [v2:172.21.15.155:6808/569913150,v1:172.21.15.155:6809/569913150] boot 2024-09-19T08:05:19.971 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:19 smithi203 ceph-mon[35198]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T08:05:19.971 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:19 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:05:19.971 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:19 smithi203 ceph-mon[35198]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:05:19.971 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:19 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:05:19.971 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:19 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:05:19.971 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:19 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:20.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:19 smithi155 ceph-mon[35362]: purged_snaps scrub starts 2024-09-19T08:05:20.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:19 smithi155 ceph-mon[35362]: purged_snaps scrub ok 2024-09-19T08:05:20.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:19 smithi155 ceph-mon[35362]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:05:20.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:19 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:05:20.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:19 smithi155 ceph-mon[35362]: osd.4 [v2:172.21.15.155:6808/569913150,v1:172.21.15.155:6809/569913150] boot 2024-09-19T08:05:20.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:19 smithi155 ceph-mon[35362]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T08:05:20.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:19 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:05:20.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:19 smithi155 ceph-mon[35362]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:05:20.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:19 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:05:20.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:19 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:05:20.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:19 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:20.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:19 smithi027 ceph-mon[31209]: purged_snaps scrub starts 2024-09-19T08:05:20.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:19 smithi027 ceph-mon[31209]: purged_snaps scrub ok 2024-09-19T08:05:20.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:19 smithi027 ceph-mon[31209]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:05:20.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:19 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:05:20.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:19 smithi027 ceph-mon[31209]: osd.4 [v2:172.21.15.155:6808/569913150,v1:172.21.15.155:6809/569913150] boot 2024-09-19T08:05:20.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:19 smithi027 ceph-mon[31209]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T08:05:20.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:19 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:05:20.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:19 smithi027 ceph-mon[31209]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:05:20.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:19 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:05:20.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:19 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:05:20.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:19 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:22.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:21 smithi155 ceph-mon[35362]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:22.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:21 smithi155 ceph-mon[35362]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T08:05:22.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:21 smithi155 ceph-mon[35362]: from='client.? 172.21.15.203:0/3589188161' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de193c5f-1019-43e5-9f4f-6c2aaa4330e1"}]: dispatch 2024-09-19T08:05:22.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:21 smithi155 ceph-mon[35362]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de193c5f-1019-43e5-9f4f-6c2aaa4330e1"}]: dispatch 2024-09-19T08:05:22.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:21 smithi155 ceph-mon[35362]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de193c5f-1019-43e5-9f4f-6c2aaa4330e1"}]': finished 2024-09-19T08:05:22.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:21 smithi155 ceph-mon[35362]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:05:22.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:21 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:05:22.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:21 smithi027 ceph-mon[31209]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:22.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:21 smithi027 ceph-mon[31209]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T08:05:22.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:21 smithi027 ceph-mon[31209]: from='client.? 172.21.15.203:0/3589188161' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de193c5f-1019-43e5-9f4f-6c2aaa4330e1"}]: dispatch 2024-09-19T08:05:22.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:21 smithi027 ceph-mon[31209]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de193c5f-1019-43e5-9f4f-6c2aaa4330e1"}]: dispatch 2024-09-19T08:05:22.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:21 smithi027 ceph-mon[31209]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de193c5f-1019-43e5-9f4f-6c2aaa4330e1"}]': finished 2024-09-19T08:05:22.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:21 smithi027 ceph-mon[31209]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:05:22.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:21 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:05:22.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:21 smithi203 ceph-mon[35198]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:22.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:21 smithi203 ceph-mon[35198]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T08:05:22.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:21 smithi203 ceph-mon[35198]: from='client.? 172.21.15.203:0/3589188161' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de193c5f-1019-43e5-9f4f-6c2aaa4330e1"}]: dispatch 2024-09-19T08:05:22.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:21 smithi203 ceph-mon[35198]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de193c5f-1019-43e5-9f4f-6c2aaa4330e1"}]: dispatch 2024-09-19T08:05:22.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:21 smithi203 ceph-mon[35198]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de193c5f-1019-43e5-9f4f-6c2aaa4330e1"}]': finished 2024-09-19T08:05:22.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:21 smithi203 ceph-mon[35198]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:05:22.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:21 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:05:23.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:22 smithi155 ceph-mon[35362]: from='client.? 172.21.15.203:0/2684669503' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:05:23.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:22 smithi027 ceph-mon[31209]: from='client.? 172.21.15.203:0/2684669503' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:05:23.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:22 smithi203 ceph-mon[35198]: from='client.? 172.21.15.203:0/2684669503' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:05:24.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:23 smithi155 ceph-mon[35362]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:24.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:23 smithi027 ceph-mon[31209]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:24.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:23 smithi203 ceph-mon[35198]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:26.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:25 smithi155 ceph-mon[35362]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:26.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:25 smithi027 ceph-mon[31209]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:26.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:25 smithi203 ceph-mon[35198]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:28.225 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:27 smithi203 ceph-mon[35198]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:28.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:27 smithi155 ceph-mon[35362]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:28.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:27 smithi027 ceph-mon[31209]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:30.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:29 smithi203 ceph-mon[35198]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:30.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:29 smithi155 ceph-mon[35362]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:30.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:29 smithi027 ceph-mon[31209]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:31.128 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:30 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:05:31.128 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:30 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:31.128 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:30 smithi203 ceph-mon[35198]: Deploying daemon osd.5 on smithi203 2024-09-19T08:05:31.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:30 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:05:31.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:30 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:31.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:30 smithi155 ceph-mon[35362]: Deploying daemon osd.5 on smithi203 2024-09-19T08:05:31.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:30 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:05:31.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:30 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:31.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:30 smithi027 ceph-mon[31209]: Deploying daemon osd.5 on smithi203 2024-09-19T08:05:32.127 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:31 smithi203 ceph-mon[35198]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:32.153 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:31 smithi027 ceph-mon[31209]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:32.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:31 smithi155 ceph-mon[35362]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:34.040 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:33 smithi203 ceph-mon[35198]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:34.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:33 smithi155 ceph-mon[35362]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:34.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:33 smithi027 ceph-mon[31209]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:36.066 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:35 smithi203 ceph-mon[35198]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:36.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:35 smithi155 ceph-mon[35362]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:36.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:35 smithi027 ceph-mon[31209]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:37.196 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:36 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:05:37.196 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:36 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:37.196 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:36 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:37.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:36 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:05:37.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:36 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:37.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:36 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:37.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:36 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:05:37.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:36 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:37.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:36 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:38.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:38 smithi155 ceph-mon[35362]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:39.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:38 smithi027 ceph-mon[31209]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:39.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:38 smithi203 ceph-mon[35198]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:40.029 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:40.029+0000 7f535d7fa640 1 -- 172.21.15.203:0/333485779 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5360062630 con 0x7f53480a3270 2024-09-19T08:05:40.030 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 5 on host 'smithi203' 2024-09-19T08:05:40.032 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:40.031+0000 7f536681d640 1 -- 172.21.15.203:0/333485779 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f53480a3270 msgr2=0x7f53480a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:05:40.032 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:40.031+0000 7f536681d640 1 --2- 172.21.15.203:0/333485779 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f53480a3270 0x7f53480a5730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5350005ab0 tx=0x7f5350000bc0 comp rx=0 tx=0).stop 2024-09-19T08:05:40.032 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:40.031+0000 7f536681d640 1 -- 172.21.15.203:0/333485779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5360102690 msgr2=0x7f536019f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:05:40.032 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:40.031+0000 7f536681d640 1 --2- 172.21.15.203:0/333485779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5360102690 0x7f536019f4e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f535800eb10 tx=0x7f535800c2d0 comp rx=0 tx=0).stop 2024-09-19T08:05:40.032 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:40.031+0000 7f536681d640 1 -- 172.21.15.203:0/333485779 shutdown_connections 2024-09-19T08:05:40.032 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:40.031+0000 7f536681d640 1 --2- 172.21.15.203:0/333485779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5360102690 0x7f536019f4e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:05:40.032 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:40.031+0000 7f536681d640 1 --2- 172.21.15.203:0/333485779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5360101cd0 0x7f5360198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:05:40.032 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:40.031+0000 7f536681d640 1 --2- 172.21.15.203:0/333485779 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f53480a3270 0x7f53480a5730 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:05:40.032 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:40.031+0000 7f536681d640 1 --2- 172.21.15.203:0/333485779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5360100ad0 0x7f5360197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:05:40.033 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:40.031+0000 7f536681d640 1 -- 172.21.15.203:0/333485779 >> 172.21.15.203:0/333485779 conn(0x7f53600fc280 msgr2=0x7f5360105110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:05:40.033 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:40.031+0000 7f536681d640 1 -- 172.21.15.203:0/333485779 shutdown_connections 2024-09-19T08:05:40.033 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:05:40.031+0000 7f536681d640 1 -- 172.21.15.203:0/333485779 wait complete. 2024-09-19T08:05:40.721 DEBUG:teuthology.orchestra.run.smithi203:osd.5> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T08:05:40.723 INFO:tasks.cephadm:Deploying osd.6 on smithi027 with /dev/vg_nvme/lv_2... 2024-09-19T08:05:40.723 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:05:40.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:40 smithi155 ceph-mon[35362]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:40.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:40 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:40.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:40 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:40.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:40 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:40.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:40 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:40.989 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:05:41.001 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:40 smithi027 ceph-mon[31209]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:41.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:40 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:41.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:40 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:41.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:40 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:41.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:40 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:40 smithi203 ceph-mon[35198]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:40 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:40 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:40 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:40 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:42.913 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:42 smithi203 ceph-mon[35198]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:42.914 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:42 smithi203 ceph-mon[35198]: from='osd.5 [v2:172.21.15.203:6808/991491203,v1:172.21.15.203:6809/991491203]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:05:42.914 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:42 smithi203 ceph-mon[35198]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:05:42.914 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:05:42 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:05:42.536+0000 7f05c6ebf640 -1 osd.5 0 log_to_monitors true 2024-09-19T08:05:42.931 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:42 smithi027 ceph-mon[31209]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:42.931 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:42 smithi027 ceph-mon[31209]: from='osd.5 [v2:172.21.15.203:6808/991491203,v1:172.21.15.203:6809/991491203]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:05:42.931 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:42 smithi027 ceph-mon[31209]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:05:42.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:42 smithi155 ceph-mon[35362]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:42.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:42 smithi155 ceph-mon[35362]: from='osd.5 [v2:172.21.15.203:6808/991491203,v1:172.21.15.203:6809/991491203]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:05:42.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:42 smithi155 ceph-mon[35362]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:05:43.773 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:05:43.799 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi027:vg_nvme/lv_2 2024-09-19T08:05:43.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:43 smithi155 ceph-mon[35362]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:05:43.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:43 smithi155 ceph-mon[35362]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T08:05:43.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:43 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:05:43.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:43 smithi155 ceph-mon[35362]: from='osd.5 [v2:172.21.15.203:6808/991491203,v1:172.21.15.203:6809/991491203]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:05:43.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:43 smithi155 ceph-mon[35362]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:05:43.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:43 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:43.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:43 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:43.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:43 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:05:43.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:43 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:05:43.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:43 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:43.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:43 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:43.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:43 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:05:43.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:43 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:44.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:43 smithi027 ceph-mon[31209]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:05:44.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:43 smithi027 ceph-mon[31209]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T08:05:44.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:43 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:05:44.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:43 smithi027 ceph-mon[31209]: from='osd.5 [v2:172.21.15.203:6808/991491203,v1:172.21.15.203:6809/991491203]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:05:44.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:43 smithi027 ceph-mon[31209]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:05:44.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:43 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:44.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:43 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:44.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:43 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:05:44.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:43 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:05:44.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:43 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:44.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:43 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:44.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:43 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:05:44.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:43 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:44.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:43 smithi203 ceph-mon[35198]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:05:44.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:43 smithi203 ceph-mon[35198]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T08:05:44.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:43 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:05:44.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:43 smithi203 ceph-mon[35198]: from='osd.5 [v2:172.21.15.203:6808/991491203,v1:172.21.15.203:6809/991491203]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:05:44.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:43 smithi203 ceph-mon[35198]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:05:44.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:43 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:44.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:43 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:44.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:43 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:05:44.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:43 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:05:44.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:43 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:44.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:43 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:44.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:43 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:05:44.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:43 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:44.070 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:05:44.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:05:44 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:05:44.149+0000 7f05c2e42640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T08:05:44.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:05:44 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:05:44.156+0000 7f05bac62640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:05:44.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.660+0000 7f53c68b2640 1 -- 172.21.15.27:0/2807152913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53c0101c00 msgr2=0x7f53c0102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:05:44.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.660+0000 7f53c68b2640 1 --2- 172.21.15.27:0/2807152913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53c0101c00 0x7f53c0102000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f53b0009900 tx=0x7f53b002a3f0 comp rx=0 tx=0).stop 2024-09-19T08:05:44.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.660+0000 7f53c68b2640 1 -- 172.21.15.27:0/2807152913 shutdown_connections 2024-09-19T08:05:44.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.660+0000 7f53c68b2640 1 --2- 172.21.15.27:0/2807152913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53c01037c0 0x7f53c010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:05:44.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.660+0000 7f53c68b2640 1 --2- 172.21.15.27:0/2807152913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53c0102e00 0x7f53c0103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:05:44.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.660+0000 7f53c68b2640 1 --2- 172.21.15.27:0/2807152913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53c0101c00 0x7f53c0102000 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:05:44.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.660+0000 7f53c68b2640 1 -- 172.21.15.27:0/2807152913 >> 172.21.15.27:0/2807152913 conn(0x7f53c00fd390 msgr2=0x7f53c00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:05:44.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.660+0000 7f53c68b2640 1 -- 172.21.15.27:0/2807152913 shutdown_connections 2024-09-19T08:05:44.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.660+0000 7f53c68b2640 1 -- 172.21.15.27:0/2807152913 wait complete. 2024-09-19T08:05:44.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.660+0000 7f53c68b2640 1 Processor -- start 2024-09-19T08:05:44.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.660+0000 7f53c68b2640 1 -- start start 2024-09-19T08:05:44.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.661+0000 7f53c68b2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53c0101c00 0x7f53c0075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:05:44.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.661+0000 7f53c68b2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53c0102e00 0x7f53c00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:05:44.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.661+0000 7f53c68b2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53c01037c0 0x7f53c0074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:05:44.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.661+0000 7f53c68b2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f53c010d860 con 0x7f53c0102e00 2024-09-19T08:05:44.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.661+0000 7f53c68b2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f53c010d6e0 con 0x7f53c01037c0 2024-09-19T08:05:44.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.661+0000 7f53c68b2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f53c010d9e0 con 0x7f53c0101c00 2024-09-19T08:05:44.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.661+0000 7f53bf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53c0102e00 0x7f53c00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:05:44.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.661+0000 7f53bf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53c0102e00 0x7f53c00745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40862/0 (socket says 172.21.15.27:40862) 2024-09-19T08:05:44.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.661+0000 7f53bf7fe640 1 -- 172.21.15.27:0/24213119 learned_addr learned my addr 172.21.15.27:0/24213119 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:05:44.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.661+0000 7f53bf7fe640 1 -- 172.21.15.27:0/24213119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53c0101c00 msgr2=0x7f53c0075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:05:44.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.661+0000 7f53bf7fe640 1 --2- 172.21.15.27:0/24213119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53c0101c00 0x7f53c0075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:05:44.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.661+0000 7f53bf7fe640 1 -- 172.21.15.27:0/24213119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53c01037c0 msgr2=0x7f53c0074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:05:44.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.661+0000 7f53bf7fe640 1 --2- 172.21.15.27:0/24213119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53c01037c0 0x7f53c0074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:05:44.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.661+0000 7f53bf7fe640 1 -- 172.21.15.27:0/24213119 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c00753e0 con 0x7f53c0102e00 2024-09-19T08:05:44.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.661+0000 7f53bf7fe640 1 --2- 172.21.15.27:0/24213119 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53c0102e00 0x7f53c00745e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f53b400c920 tx=0x7f53b400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:05:44.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.662+0000 7f53bd7fa640 1 -- 172.21.15.27:0/24213119 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b4007c70 con 0x7f53c0102e00 2024-09-19T08:05:44.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.662+0000 7f53bd7fa640 1 -- 172.21.15.27:0/24213119 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53b4007e10 con 0x7f53c0102e00 2024-09-19T08:05:44.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.662+0000 7f53c68b2640 1 -- 172.21.15.27:0/24213119 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c01a1fb0 con 0x7f53c0102e00 2024-09-19T08:05:44.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.662+0000 7f53bd7fa640 1 -- 172.21.15.27:0/24213119 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b4018890 con 0x7f53c0102e00 2024-09-19T08:05:44.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.662+0000 7f53c68b2640 1 -- 172.21.15.27:0/24213119 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c01a2460 con 0x7f53c0102e00 2024-09-19T08:05:44.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.663+0000 7f53c68b2640 1 -- 172.21.15.27:0/24213119 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c0108f30 con 0x7f53c0102e00 2024-09-19T08:05:44.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.664+0000 7f53bd7fa640 1 -- 172.21.15.27:0/24213119 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f53b4018a70 con 0x7f53c0102e00 2024-09-19T08:05:44.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.665+0000 7f53bd7fa640 1 --2- 172.21.15.27:0/24213119 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f53a80a3240 0x7f53a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:05:44.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.665+0000 7f53bffff640 1 --2- 172.21.15.27:0/24213119 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f53a80a3240 0x7f53a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:05:44.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.665+0000 7f53bd7fa640 1 -- 172.21.15.27:0/24213119 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4253+0+0 (secure 0 0 0) 0x7f53b40ceb00 con 0x7f53c0102e00 2024-09-19T08:05:44.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.665+0000 7f53bffff640 1 --2- 172.21.15.27:0/24213119 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f53a80a3240 0x7f53a80a5700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f53b00096c0 tx=0x7f53b0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:05:44.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.669+0000 7f53bd7fa640 1 -- 172.21.15.27:0/24213119 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f53b4014030 con 0x7f53c0102e00 2024-09-19T08:05:44.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:05:44.862+0000 7f53c68b2640 1 -- 172.21.15.27:0/24213119 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f53c0062630 con 0x7f53a80a3240 2024-09-19T08:05:44.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:44 smithi155 ceph-mon[35362]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:44.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:44 smithi155 ceph-mon[35362]: Detected new or changed devices on smithi203 2024-09-19T08:05:44.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:44 smithi155 ceph-mon[35362]: Adjusting osd_memory_target on smithi203 to 8544M 2024-09-19T08:05:44.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:44 smithi155 ceph-mon[35362]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:05:44.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:44 smithi155 ceph-mon[35362]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T08:05:44.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:44 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:05:44.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:44 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:05:44.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:44 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:05:44.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:44 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:44.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:44 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:05:44.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:44 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:44.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:44 smithi155 ceph-mon[35362]: from='osd.5 ' entity='osd.5' 2024-09-19T08:05:45.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:44 smithi027 ceph-mon[31209]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:45.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:44 smithi027 ceph-mon[31209]: Detected new or changed devices on smithi203 2024-09-19T08:05:45.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:44 smithi027 ceph-mon[31209]: Adjusting osd_memory_target on smithi203 to 8544M 2024-09-19T08:05:45.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:44 smithi027 ceph-mon[31209]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:05:45.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:44 smithi027 ceph-mon[31209]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T08:05:45.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:44 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:05:45.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:44 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:05:45.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:44 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:05:45.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:44 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:45.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:44 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:05:45.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:44 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:45.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:44 smithi027 ceph-mon[31209]: from='osd.5 ' entity='osd.5' 2024-09-19T08:05:45.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:44 smithi203 ceph-mon[35198]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:05:45.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:44 smithi203 ceph-mon[35198]: Detected new or changed devices on smithi203 2024-09-19T08:05:45.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:44 smithi203 ceph-mon[35198]: Adjusting osd_memory_target on smithi203 to 8544M 2024-09-19T08:05:45.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:44 smithi203 ceph-mon[35198]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:05:45.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:44 smithi203 ceph-mon[35198]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T08:05:45.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:44 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:05:45.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:44 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:05:45.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:44 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:05:45.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:44 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:45.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:44 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:05:45.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:44 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:05:45.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:44 smithi203 ceph-mon[35198]: from='osd.5 ' entity='osd.5' 2024-09-19T08:05:45.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:45 smithi155 ceph-mon[35362]: purged_snaps scrub starts 2024-09-19T08:05:45.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:45 smithi155 ceph-mon[35362]: purged_snaps scrub ok 2024-09-19T08:05:45.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:45 smithi155 ceph-mon[35362]: osd.5 [v2:172.21.15.203:6808/991491203,v1:172.21.15.203:6809/991491203] boot 2024-09-19T08:05:45.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:45 smithi155 ceph-mon[35362]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T08:05:45.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:45 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:05:45.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:45 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:05:45.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:45 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:05:45.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:45 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:45.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:45 smithi155 ceph-mon[35362]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T08:05:46.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:45 smithi027 ceph-mon[31209]: purged_snaps scrub starts 2024-09-19T08:05:46.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:45 smithi027 ceph-mon[31209]: purged_snaps scrub ok 2024-09-19T08:05:46.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:45 smithi027 ceph-mon[31209]: osd.5 [v2:172.21.15.203:6808/991491203,v1:172.21.15.203:6809/991491203] boot 2024-09-19T08:05:46.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:45 smithi027 ceph-mon[31209]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T08:05:46.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:45 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:05:46.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:45 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:05:46.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:45 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:05:46.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:45 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:46.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:45 smithi027 ceph-mon[31209]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T08:05:46.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:45 smithi203 ceph-mon[35198]: purged_snaps scrub starts 2024-09-19T08:05:46.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:45 smithi203 ceph-mon[35198]: purged_snaps scrub ok 2024-09-19T08:05:46.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:45 smithi203 ceph-mon[35198]: osd.5 [v2:172.21.15.203:6808/991491203,v1:172.21.15.203:6809/991491203] boot 2024-09-19T08:05:46.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:45 smithi203 ceph-mon[35198]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T08:05:46.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:45 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:05:46.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:45 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:05:46.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:45 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:05:46.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:45 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:46.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:45 smithi203 ceph-mon[35198]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T08:05:46.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:46 smithi155 ceph-mon[35362]: from='client.14376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:05:46.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:46 smithi155 ceph-mon[35362]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:05:46.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:46 smithi155 ceph-mon[35362]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T08:05:47.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:46 smithi027 ceph-mon[31209]: from='client.14376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:05:47.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:46 smithi027 ceph-mon[31209]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:05:47.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:46 smithi027 ceph-mon[31209]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T08:05:47.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:46 smithi203 ceph-mon[35198]: from='client.14376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:05:47.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:46 smithi203 ceph-mon[35198]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:05:47.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:46 smithi203 ceph-mon[35198]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T08:05:47.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:47 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3998197782' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28938e4f-9f22-466f-8cf7-62ee56a0c926"}]: dispatch 2024-09-19T08:05:47.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:47 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3998197782' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28938e4f-9f22-466f-8cf7-62ee56a0c926"}]': finished 2024-09-19T08:05:47.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:47 smithi155 ceph-mon[35362]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:05:47.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:47 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:05:48.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:47 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3998197782' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28938e4f-9f22-466f-8cf7-62ee56a0c926"}]: dispatch 2024-09-19T08:05:48.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:47 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3998197782' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28938e4f-9f22-466f-8cf7-62ee56a0c926"}]': finished 2024-09-19T08:05:48.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:47 smithi027 ceph-mon[31209]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:05:48.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:47 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:05:48.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:47 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3998197782' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28938e4f-9f22-466f-8cf7-62ee56a0c926"}]: dispatch 2024-09-19T08:05:48.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:47 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3998197782' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28938e4f-9f22-466f-8cf7-62ee56a0c926"}]': finished 2024-09-19T08:05:48.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:47 smithi203 ceph-mon[35198]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:05:48.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:47 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:05:48.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:48 smithi155 ceph-mon[35362]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:05:48.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:48 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3056935969' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:05:48.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:48 smithi155 ceph-mon[35362]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:05:48.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:48 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:05:49.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:48 smithi027 ceph-mon[31209]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:05:49.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:48 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3056935969' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:05:49.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:48 smithi027 ceph-mon[31209]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:05:49.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:48 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:05:49.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:48 smithi203 ceph-mon[35198]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:05:49.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:48 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3056935969' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:05:49.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:48 smithi203 ceph-mon[35198]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:05:49.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:48 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:05:51.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:50 smithi027 ceph-mon[31209]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T08:05:51.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:50 smithi203 ceph-mon[35198]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T08:05:51.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:50 smithi155 ceph-mon[35362]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T08:05:52.924 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:52 smithi027 ceph-mon[31209]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-19T08:05:53.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:52 smithi203 ceph-mon[35198]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-19T08:05:53.039 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:52 smithi155 ceph-mon[35362]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-19T08:05:54.926 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:54 smithi027 ceph-mon[31209]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T08:05:55.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:54 smithi203 ceph-mon[35198]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T08:05:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:54 smithi155 ceph-mon[35362]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T08:05:57.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:56 smithi027 ceph-mon[31209]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:05:57.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:56 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:05:57.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:56 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:57.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:56 smithi203 ceph-mon[35198]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:05:57.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:56 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:05:57.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:56 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:57.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:56 smithi155 ceph-mon[35362]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:05:57.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:56 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:05:57.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:56 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:05:57.824 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:57 smithi027 ceph-mon[31209]: Deploying daemon osd.6 on smithi027 2024-09-19T08:05:58.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:57 smithi203 ceph-mon[35198]: Deploying daemon osd.6 on smithi027 2024-09-19T08:05:58.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:57 smithi155 ceph-mon[35362]: Deploying daemon osd.6 on smithi027 2024-09-19T08:05:59.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:05:58 smithi027 ceph-mon[31209]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T08:05:59.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:05:58 smithi203 ceph-mon[35198]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T08:05:59.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:05:58 smithi155 ceph-mon[35362]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T08:06:00.974 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:00 smithi027 ceph-mon[31209]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:06:01.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:00 smithi155 ceph-mon[35362]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:06:01.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:00 smithi203 ceph-mon[35198]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:06:02.892 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:02 smithi027 ceph-mon[31209]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:06:02.892 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:02 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:06:02.892 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:02 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:02.893 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:02 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:03.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:02 smithi155 ceph-mon[35362]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:06:03.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:06:03.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:03.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:03.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:02 smithi203 ceph-mon[35198]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:06:03.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:02 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:06:03.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:02 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:03.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:02 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:05.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:04 smithi203 ceph-mon[35198]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:06:05.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:04 smithi155 ceph-mon[35362]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:06:05.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:04 smithi027 ceph-mon[31209]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:06:05.662 INFO:teuthology.orchestra.run.smithi027.stdout:Created osd(s) 6 on host 'smithi027' 2024-09-19T08:06:05.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:06:05.662+0000 7f53bd7fa640 1 -- 172.21.15.27:0/24213119 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f53c0062630 con 0x7f53a80a3240 2024-09-19T08:06:05.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:06:05.664+0000 7f53c68b2640 1 -- 172.21.15.27:0/24213119 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f53a80a3240 msgr2=0x7f53a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:06:05.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:06:05.664+0000 7f53c68b2640 1 --2- 172.21.15.27:0/24213119 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f53a80a3240 0x7f53a80a5700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f53b00096c0 tx=0x7f53b0031400 comp rx=0 tx=0).stop 2024-09-19T08:06:05.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:06:05.664+0000 7f53c68b2640 1 -- 172.21.15.27:0/24213119 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53c0102e00 msgr2=0x7f53c00745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:06:05.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:06:05.664+0000 7f53c68b2640 1 --2- 172.21.15.27:0/24213119 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53c0102e00 0x7f53c00745e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f53b400c920 tx=0x7f53b400cde0 comp rx=0 tx=0).stop 2024-09-19T08:06:05.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:06:05.664+0000 7f53c68b2640 1 -- 172.21.15.27:0/24213119 shutdown_connections 2024-09-19T08:06:05.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:06:05.664+0000 7f53c68b2640 1 --2- 172.21.15.27:0/24213119 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f53a80a3240 0x7f53a80a5700 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:05.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:06:05.664+0000 7f53c68b2640 1 --2- 172.21.15.27:0/24213119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53c01037c0 0x7f53c0074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:05.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:06:05.664+0000 7f53c68b2640 1 --2- 172.21.15.27:0/24213119 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53c0102e00 0x7f53c00745e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:05.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:06:05.664+0000 7f53c68b2640 1 --2- 172.21.15.27:0/24213119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53c0101c00 0x7f53c0075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:05.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:06:05.664+0000 7f53c68b2640 1 -- 172.21.15.27:0/24213119 >> 172.21.15.27:0/24213119 conn(0x7f53c00fd390 msgr2=0x7f53c0106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:06:05.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:06:05.664+0000 7f53c68b2640 1 -- 172.21.15.27:0/24213119 shutdown_connections 2024-09-19T08:06:05.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:06:05.664+0000 7f53c68b2640 1 -- 172.21.15.27:0/24213119 wait complete. 2024-09-19T08:06:06.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:05 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:06.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:05 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:06.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:05 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:06.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:05 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:06:06.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:05 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:06.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:05 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:06:06.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:05 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:06.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:05 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:06.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:05 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:06.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:05 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:06.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:05 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:06.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:05 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:06:06.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:05 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:06.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:05 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:06:06.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:05 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:06.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:05 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:06.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:05 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:06.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:05 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:06.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:05 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:06.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:05 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:06:06.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:05 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:06.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:05 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:06:06.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:05 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:06.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:05 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:06.345 DEBUG:teuthology.orchestra.run.smithi027:osd.6> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T08:06:06.347 INFO:tasks.cephadm:Deploying osd.7 on smithi155 with /dev/vg_nvme/lv_2... 2024-09-19T08:06:06.348 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:06:06.603 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:06:06.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:06 smithi155 ceph-mon[35362]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:06:07.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:06 smithi027 ceph-mon[31209]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:06:07.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:06 smithi203 ceph-mon[35198]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:06:07.872 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:07 smithi027 ceph-mon[31209]: from='osd.6 [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:06:07.873 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:06:07 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:06:07.640+0000 7fd493af5640 -1 osd.6 0 log_to_monitors true 2024-09-19T08:06:08.109 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:07 smithi155 ceph-mon[35362]: from='osd.6 [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:06:08.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:07 smithi203 ceph-mon[35198]: from='osd.6 [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:06:09.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:08 smithi155 ceph-mon[35362]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:06:09.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:08 smithi155 ceph-mon[35362]: from='osd.6 [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:06:09.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:08 smithi155 ceph-mon[35362]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T08:06:09.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:08 smithi155 ceph-mon[35362]: from='osd.6 [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-19T08:06:09.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:08 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:06:09.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:08 smithi027 ceph-mon[31209]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:06:09.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:08 smithi027 ceph-mon[31209]: from='osd.6 [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:06:09.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:08 smithi027 ceph-mon[31209]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T08:06:09.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:08 smithi027 ceph-mon[31209]: from='osd.6 [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-19T08:06:09.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:08 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:06:09.253 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:06:08 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:06:08.808+0000 7fd48fa78640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T08:06:09.253 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:06:08 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:06:08.819+0000 7fd48b8a0640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:06:09.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:08 smithi203 ceph-mon[35198]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:06:09.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:08 smithi203 ceph-mon[35198]: from='osd.6 [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:06:09.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:08 smithi203 ceph-mon[35198]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T08:06:09.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:08 smithi203 ceph-mon[35198]: from='osd.6 [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-19T08:06:09.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:08 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:06:09.284 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:06:09.310 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi155:vg_nvme/lv_2 2024-09-19T08:06:09.560 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:06:09.985 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:09 smithi155 ceph-mon[35362]: from='osd.6 [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-19T08:06:09.985 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:09 smithi155 ceph-mon[35362]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T08:06:09.985 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:09 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:06:09.985 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:09 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:06:09.985 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:09 smithi155 ceph-mon[35362]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:06:09.985 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:09 smithi155 ceph-mon[35362]: Detected new or changed devices on smithi027 2024-09-19T08:06:09.985 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:09 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:09.985 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:09 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:09.985 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:09 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:06:09.985 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:09 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:06:09.985 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:09 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:06:09.986 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:09 smithi155 ceph-mon[35362]: Adjusting osd_memory_target on smithi027 to 5696M 2024-09-19T08:06:09.986 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:09 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:09.986 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:09 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:09.986 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:09 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:06:09.986 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:09 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:10.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.068+0000 7fb3d02b3640 1 -- 172.21.15.155:0/3908708334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3c8102e00 msgr2=0x7fb3c8103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:06:10.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.068+0000 7fb3d02b3640 1 --2- 172.21.15.155:0/3908708334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3c8102e00 0x7fb3c8103280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009900 tx=0x7fb3b802a410 comp rx=0 tx=0).stop 2024-09-19T08:06:10.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.068+0000 7fb3d02b3640 1 -- 172.21.15.155:0/3908708334 shutdown_connections 2024-09-19T08:06:10.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.068+0000 7fb3d02b3640 1 --2- 172.21.15.155:0/3908708334 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3c81037c0 0x7fb3c810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:10.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.068+0000 7fb3d02b3640 1 --2- 172.21.15.155:0/3908708334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3c8102e00 0x7fb3c8103280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:10.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.068+0000 7fb3d02b3640 1 --2- 172.21.15.155:0/3908708334 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3c8101c00 0x7fb3c8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:10.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.068+0000 7fb3d02b3640 1 -- 172.21.15.155:0/3908708334 >> 172.21.15.155:0/3908708334 conn(0x7fb3c80fd390 msgr2=0x7fb3c80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:06:10.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.068+0000 7fb3d02b3640 1 -- 172.21.15.155:0/3908708334 shutdown_connections 2024-09-19T08:06:10.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.068+0000 7fb3d02b3640 1 -- 172.21.15.155:0/3908708334 wait complete. 2024-09-19T08:06:10.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.069+0000 7fb3d02b3640 1 Processor -- start 2024-09-19T08:06:10.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.069+0000 7fb3d02b3640 1 -- start start 2024-09-19T08:06:10.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.069+0000 7fb3d02b3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3c8101c00 0x7fb3c8197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:06:10.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.069+0000 7fb3d02b3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3c8102e00 0x7fb3c81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:06:10.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.069+0000 7fb3d02b3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3c81037c0 0x7fb3c819f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:06:10.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.069+0000 7fb3d02b3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c810d8e0 con 0x7fb3c8101c00 2024-09-19T08:06:10.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.069+0000 7fb3d02b3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c810d760 con 0x7fb3c81037c0 2024-09-19T08:06:10.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.069+0000 7fb3d02b3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c810da60 con 0x7fb3c8102e00 2024-09-19T08:06:10.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.069+0000 7fb3ce850640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3c81037c0 0x7fb3c819f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:06:10.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.069+0000 7fb3ce04f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3c8101c00 0x7fb3c8197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:06:10.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.069+0000 7fb3ce850640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3c81037c0 0x7fb3c819f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33890/0 (socket says 172.21.15.155:33890) 2024-09-19T08:06:10.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.069+0000 7fb3ce850640 1 -- 172.21.15.155:0/484755284 learned_addr learned my addr 172.21.15.155:0/484755284 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-19T08:06:10.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.069+0000 7fb3cd84e640 1 --2- 172.21.15.155:0/484755284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3c8102e00 0x7fb3c81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:06:10.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.070+0000 7fb3ce850640 1 -- 172.21.15.155:0/484755284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3c8102e00 msgr2=0x7fb3c81983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:06:10.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.070+0000 7fb3ce850640 1 --2- 172.21.15.155:0/484755284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3c8102e00 0x7fb3c81983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:10.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.070+0000 7fb3ce850640 1 -- 172.21.15.155:0/484755284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3c8101c00 msgr2=0x7fb3c8197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:06:10.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.070+0000 7fb3ce850640 1 --2- 172.21.15.155:0/484755284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3c8101c00 0x7fb3c8197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:10.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.070+0000 7fb3ce850640 1 -- 172.21.15.155:0/484755284 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c819fae0 con 0x7fb3c81037c0 2024-09-19T08:06:10.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.070+0000 7fb3ce850640 1 --2- 172.21.15.155:0/484755284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3c81037c0 0x7fb3c819f470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb3c000b970 tx=0x7fb3c000be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:06:10.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.070+0000 7fb3bf7fe640 1 -- 172.21.15.155:0/484755284 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0019070 con 0x7fb3c81037c0 2024-09-19T08:06:10.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.070+0000 7fb3d02b3640 1 -- 172.21.15.155:0/484755284 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c819fdd0 con 0x7fb3c81037c0 2024-09-19T08:06:10.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.070+0000 7fb3bf7fe640 1 -- 172.21.15.155:0/484755284 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3c000cb40 con 0x7fb3c81037c0 2024-09-19T08:06:10.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.070+0000 7fb3bf7fe640 1 -- 172.21.15.155:0/484755284 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0007610 con 0x7fb3c81037c0 2024-09-19T08:06:10.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.070+0000 7fb3d02b3640 1 -- 172.21.15.155:0/484755284 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c81a0300 con 0x7fb3c81037c0 2024-09-19T08:06:10.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.071+0000 7fb3d02b3640 1 -- 172.21.15.155:0/484755284 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3c8108f30 con 0x7fb3c81037c0 2024-09-19T08:06:10.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.072+0000 7fb3bf7fe640 1 -- 172.21.15.155:0/484755284 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb3c001c070 con 0x7fb3c81037c0 2024-09-19T08:06:10.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.073+0000 7fb3bf7fe640 1 --2- 172.21.15.155:0/484755284 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fb3b40a3270 0x7fb3b40a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:06:10.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.073+0000 7fb3bf7fe640 1 -- 172.21.15.155:0/484755284 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4965+0+0 (secure 0 0 0) 0x7fb3c00ce600 con 0x7fb3c81037c0 2024-09-19T08:06:10.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.073+0000 7fb3ce04f640 1 --2- 172.21.15.155:0/484755284 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fb3b40a3270 0x7fb3b40a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:06:10.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.073+0000 7fb3ce04f640 1 --2- 172.21.15.155:0/484755284 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fb3b40a3270 0x7fb3b40a5730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8102c60 tx=0x7fb3c4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:06:10.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.076+0000 7fb3bf7fe640 1 -- 172.21.15.155:0/484755284 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb3c009b9e0 con 0x7fb3c81037c0 2024-09-19T08:06:10.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:10.250+0000 7fb3d02b3640 1 -- 172.21.15.155:0/484755284 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fb3c8062630 con 0x7fb3b40a3270 2024-09-19T08:06:10.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:09 smithi027 ceph-mon[31209]: from='osd.6 [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-19T08:06:10.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:09 smithi027 ceph-mon[31209]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T08:06:10.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:09 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:06:10.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:09 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:06:10.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:09 smithi027 ceph-mon[31209]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:06:10.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:09 smithi027 ceph-mon[31209]: Detected new or changed devices on smithi027 2024-09-19T08:06:10.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:09 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:10.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:09 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:10.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:09 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:06:10.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:09 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:06:10.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:09 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:06:10.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:09 smithi027 ceph-mon[31209]: Adjusting osd_memory_target on smithi027 to 5696M 2024-09-19T08:06:10.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:09 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:10.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:09 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:10.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:09 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:06:10.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:09 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:10.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:09 smithi203 ceph-mon[35198]: from='osd.6 [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-19T08:06:10.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:09 smithi203 ceph-mon[35198]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T08:06:10.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:09 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:06:10.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:09 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:06:10.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:09 smithi203 ceph-mon[35198]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:06:10.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:09 smithi203 ceph-mon[35198]: Detected new or changed devices on smithi027 2024-09-19T08:06:10.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:09 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:10.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:09 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:10.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:09 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:06:10.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:09 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:06:10.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:09 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:06:10.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:09 smithi203 ceph-mon[35198]: Adjusting osd_memory_target on smithi027 to 5696M 2024-09-19T08:06:10.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:09 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:10.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:09 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:10.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:09 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:06:10.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:09 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:10.971 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:10 smithi155 ceph-mon[35362]: purged_snaps scrub starts 2024-09-19T08:06:10.972 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:10 smithi155 ceph-mon[35362]: purged_snaps scrub ok 2024-09-19T08:06:10.972 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:10 smithi155 ceph-mon[35362]: osd.6 [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131] boot 2024-09-19T08:06:10.972 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:10 smithi155 ceph-mon[35362]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T08:06:10.972 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:10 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:06:10.972 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:10 smithi155 ceph-mon[35362]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:06:10.972 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:10 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:06:10.972 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:10 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:06:10.972 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:10 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:11.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:10 smithi027 ceph-mon[31209]: purged_snaps scrub starts 2024-09-19T08:06:11.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:10 smithi027 ceph-mon[31209]: purged_snaps scrub ok 2024-09-19T08:06:11.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:10 smithi027 ceph-mon[31209]: osd.6 [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131] boot 2024-09-19T08:06:11.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:10 smithi027 ceph-mon[31209]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T08:06:11.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:10 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:06:11.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:10 smithi027 ceph-mon[31209]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:06:11.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:10 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:06:11.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:10 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:06:11.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:10 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:11.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:10 smithi203 ceph-mon[35198]: purged_snaps scrub starts 2024-09-19T08:06:11.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:10 smithi203 ceph-mon[35198]: purged_snaps scrub ok 2024-09-19T08:06:11.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:10 smithi203 ceph-mon[35198]: osd.6 [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131] boot 2024-09-19T08:06:11.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:10 smithi203 ceph-mon[35198]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T08:06:11.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:10 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:06:11.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:10 smithi203 ceph-mon[35198]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:06:11.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:10 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:06:11.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:10 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:06:11.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:10 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:11.917 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:11 smithi155 ceph-mon[35362]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T08:06:11.917 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:11 smithi155 ceph-mon[35362]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:12.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:11 smithi027 ceph-mon[31209]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T08:06:12.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:11 smithi027 ceph-mon[31209]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:12.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:11 smithi203 ceph-mon[35198]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T08:06:12.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:11 smithi203 ceph-mon[35198]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:13.169 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:12 smithi027 ceph-mon[31209]: from='client.? 172.21.15.155:0/4042080219' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "855f1728-be52-4445-8561-a90c08f2b2c0"}]: dispatch 2024-09-19T08:06:13.170 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:12 smithi027 ceph-mon[31209]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "855f1728-be52-4445-8561-a90c08f2b2c0"}]: dispatch 2024-09-19T08:06:13.170 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:12 smithi027 ceph-mon[31209]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "855f1728-be52-4445-8561-a90c08f2b2c0"}]': finished 2024-09-19T08:06:13.170 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:12 smithi027 ceph-mon[31209]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T08:06:13.170 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:12 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:06:13.222 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:12 smithi155 ceph-mon[35362]: from='client.? 172.21.15.155:0/4042080219' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "855f1728-be52-4445-8561-a90c08f2b2c0"}]: dispatch 2024-09-19T08:06:13.222 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:12 smithi155 ceph-mon[35362]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "855f1728-be52-4445-8561-a90c08f2b2c0"}]: dispatch 2024-09-19T08:06:13.222 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:12 smithi155 ceph-mon[35362]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "855f1728-be52-4445-8561-a90c08f2b2c0"}]': finished 2024-09-19T08:06:13.222 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:12 smithi155 ceph-mon[35362]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T08:06:13.222 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:12 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:06:13.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:12 smithi203 ceph-mon[35198]: from='client.? 172.21.15.155:0/4042080219' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "855f1728-be52-4445-8561-a90c08f2b2c0"}]: dispatch 2024-09-19T08:06:13.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:12 smithi203 ceph-mon[35198]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "855f1728-be52-4445-8561-a90c08f2b2c0"}]: dispatch 2024-09-19T08:06:13.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:12 smithi203 ceph-mon[35198]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "855f1728-be52-4445-8561-a90c08f2b2c0"}]': finished 2024-09-19T08:06:13.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:12 smithi203 ceph-mon[35198]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T08:06:13.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:12 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:06:14.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:13 smithi155 ceph-mon[35362]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:14.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:13 smithi155 ceph-mon[35362]: from='client.? 172.21.15.155:0/66393316' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:06:14.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:13 smithi027 ceph-mon[31209]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:14.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:13 smithi027 ceph-mon[31209]: from='client.? 172.21.15.155:0/66393316' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:06:14.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:13 smithi203 ceph-mon[35198]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:14.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:13 smithi203 ceph-mon[35198]: from='client.? 172.21.15.155:0/66393316' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:06:16.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:15 smithi155 ceph-mon[35362]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:16.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:15 smithi027 ceph-mon[31209]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:16.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:15 smithi203 ceph-mon[35198]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:18.159 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:17 smithi155 ceph-mon[35362]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:18.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:17 smithi027 ceph-mon[31209]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:18.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:17 smithi203 ceph-mon[35198]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:20.177 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:19 smithi155 ceph-mon[35362]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:20.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:19 smithi027 ceph-mon[31209]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:20.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:19 smithi203 ceph-mon[35198]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:22.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:21 smithi155 ceph-mon[35362]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:22.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:21 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:06:22.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:21 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:22.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:21 smithi155 ceph-mon[35362]: Deploying daemon osd.7 on smithi155 2024-09-19T08:06:22.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:21 smithi027 ceph-mon[31209]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:22.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:21 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:06:22.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:21 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:22.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:21 smithi027 ceph-mon[31209]: Deploying daemon osd.7 on smithi155 2024-09-19T08:06:22.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:21 smithi203 ceph-mon[35198]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:22.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:21 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:06:22.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:21 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:22.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:21 smithi203 ceph-mon[35198]: Deploying daemon osd.7 on smithi155 2024-09-19T08:06:24.167 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:23 smithi155 ceph-mon[35362]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:24.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:23 smithi027 ceph-mon[31209]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:24.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:23 smithi203 ceph-mon[35198]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:25.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:25 smithi155 ceph-mon[35362]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:26.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:25 smithi027 ceph-mon[31209]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:26.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:25 smithi203 ceph-mon[35198]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:27.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:27 smithi155 ceph-mon[35362]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:27.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:27 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:06:27.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:27 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:27.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:27 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:28.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:27 smithi027 ceph-mon[31209]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:28.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:27 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:06:28.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:27 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:28.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:27 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:28.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:27 smithi203 ceph-mon[35198]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:28.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:27 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:06:28.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:27 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:28.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:27 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:30.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:29 smithi155 ceph-mon[35362]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:30.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:29 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:30.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:29 smithi027 ceph-mon[31209]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:30.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:29 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:30.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:29 smithi203 ceph-mon[35198]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:30.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:29 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:30.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:30.940+0000 7fb3bf7fe640 1 -- 172.21.15.155:0/484755284 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb3c8062630 con 0x7fb3b40a3270 2024-09-19T08:06:30.941 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 7 on host 'smithi155' 2024-09-19T08:06:30.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:30.943+0000 7fb3d02b3640 1 -- 172.21.15.155:0/484755284 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fb3b40a3270 msgr2=0x7fb3b40a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:06:30.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:30.943+0000 7fb3d02b3640 1 --2- 172.21.15.155:0/484755284 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fb3b40a3270 0x7fb3b40a5730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8102c60 tx=0x7fb3c4005f90 comp rx=0 tx=0).stop 2024-09-19T08:06:30.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:30.943+0000 7fb3d02b3640 1 -- 172.21.15.155:0/484755284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3c81037c0 msgr2=0x7fb3c819f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:06:30.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:30.943+0000 7fb3d02b3640 1 --2- 172.21.15.155:0/484755284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3c81037c0 0x7fb3c819f470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb3c000b970 tx=0x7fb3c000be30 comp rx=0 tx=0).stop 2024-09-19T08:06:30.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:30.943+0000 7fb3d02b3640 1 -- 172.21.15.155:0/484755284 shutdown_connections 2024-09-19T08:06:30.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:30.943+0000 7fb3d02b3640 1 --2- 172.21.15.155:0/484755284 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fb3b40a3270 0x7fb3b40a5730 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:30.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:30.943+0000 7fb3d02b3640 1 --2- 172.21.15.155:0/484755284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3c81037c0 0x7fb3c819f470 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:30.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:30.943+0000 7fb3d02b3640 1 --2- 172.21.15.155:0/484755284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3c8102e00 0x7fb3c81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:30.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:30.943+0000 7fb3d02b3640 1 --2- 172.21.15.155:0/484755284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3c8101c00 0x7fb3c8197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:30.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:30.943+0000 7fb3d02b3640 1 -- 172.21.15.155:0/484755284 >> 172.21.15.155:0/484755284 conn(0x7fb3c80fd390 msgr2=0x7fb3c8106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:06:30.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:30.943+0000 7fb3d02b3640 1 -- 172.21.15.155:0/484755284 shutdown_connections 2024-09-19T08:06:30.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:06:30.943+0000 7fb3d02b3640 1 -- 172.21.15.155:0/484755284 wait complete. 2024-09-19T08:06:31.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:30 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:31.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:30 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:31.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:30 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:06:31.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:30 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:31.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:30 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:06:31.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:30 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:31.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:30 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:31.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:30 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:31.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:30 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:31.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:30 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:06:31.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:30 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:31.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:30 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:06:31.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:30 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:31.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:30 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:31.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:30 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:31.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:30 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:31.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:30 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:06:31.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:30 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:31.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:30 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:06:31.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:30 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:31.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:30 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:31.642 DEBUG:teuthology.orchestra.run.smithi155:osd.7> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T08:06:31.644 INFO:tasks.cephadm:Deploying osd.8 on smithi203 with /dev/vg_nvme/lv_2... 2024-09-19T08:06:31.645 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:06:31.899 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:06:32.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:31 smithi155 ceph-mon[35362]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:32.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:31 smithi027 ceph-mon[31209]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:32.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:31 smithi203 ceph-mon[35198]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:33.904 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:06:33 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:06:33.608+0000 7f85dd57b640 -1 osd.7 0 log_to_monitors true 2024-09-19T08:06:34.014 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:33 smithi203 ceph-mon[35198]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:34.015 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:33 smithi203 ceph-mon[35198]: from='osd.7 [v2:172.21.15.155:6816/2047506436,v1:172.21.15.155:6817/2047506436]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:06:34.015 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:33 smithi203 ceph-mon[35198]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:06:34.202 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:33 smithi155 ceph-mon[35362]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:34.202 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:33 smithi155 ceph-mon[35362]: from='osd.7 [v2:172.21.15.155:6816/2047506436,v1:172.21.15.155:6817/2047506436]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:06:34.202 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:33 smithi155 ceph-mon[35362]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:06:34.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:33 smithi027 ceph-mon[31209]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:34.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:33 smithi027 ceph-mon[31209]: from='osd.7 [v2:172.21.15.155:6816/2047506436,v1:172.21.15.155:6817/2047506436]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:06:34.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:33 smithi027 ceph-mon[31209]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:06:34.681 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:06:34.707 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_2 2024-09-19T08:06:34.957 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:06:35.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:34 smithi203 ceph-mon[35198]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:06:35.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:34 smithi203 ceph-mon[35198]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T08:06:35.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:06:35.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:34 smithi203 ceph-mon[35198]: from='osd.7 [v2:172.21.15.155:6816/2047506436,v1:172.21.15.155:6817/2047506436]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:06:35.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:34 smithi203 ceph-mon[35198]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:06:35.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:34 smithi203 ceph-mon[35198]: Detected new or changed devices on smithi155 2024-09-19T08:06:35.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:35.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:35.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:06:35.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:06:35.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:06:35.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:34 smithi203 ceph-mon[35198]: Adjusting osd_memory_target on smithi155 to 5696M 2024-09-19T08:06:35.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:35.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:35.234 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:06:35.234 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:35.237 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:06:34 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:06:34.974+0000 7f85d94fe640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T08:06:35.237 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:06:34 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:06:34.983+0000 7f85d5326640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:06:35.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:34 smithi155 ceph-mon[35362]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:06:35.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:34 smithi155 ceph-mon[35362]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T08:06:35.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:06:35.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:34 smithi155 ceph-mon[35362]: from='osd.7 [v2:172.21.15.155:6816/2047506436,v1:172.21.15.155:6817/2047506436]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:06:35.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:34 smithi155 ceph-mon[35362]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:06:35.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:34 smithi155 ceph-mon[35362]: Detected new or changed devices on smithi155 2024-09-19T08:06:35.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:35.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:35.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:06:35.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:06:35.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:06:35.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:34 smithi155 ceph-mon[35362]: Adjusting osd_memory_target on smithi155 to 5696M 2024-09-19T08:06:35.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:35.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:35.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:06:35.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:35.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:34 smithi027 ceph-mon[31209]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:06:35.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:34 smithi027 ceph-mon[31209]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T08:06:35.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:06:35.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:34 smithi027 ceph-mon[31209]: from='osd.7 [v2:172.21.15.155:6816/2047506436,v1:172.21.15.155:6817/2047506436]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:06:35.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:34 smithi027 ceph-mon[31209]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:06:35.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:34 smithi027 ceph-mon[31209]: Detected new or changed devices on smithi155 2024-09-19T08:06:35.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:35.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:35.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:06:35.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:06:35.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:06:35.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:34 smithi027 ceph-mon[31209]: Adjusting osd_memory_target on smithi155 to 5696M 2024-09-19T08:06:35.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:35.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:35.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:06:35.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:35.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.448+0000 7f1696a40640 1 -- 172.21.15.203:0/1241839054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1690104fd0 msgr2=0x7f16901073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:06:35.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.448+0000 7f1696a40640 1 --2- 172.21.15.203:0/1241839054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1690104fd0 0x7f16901073c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1684009900 tx=0x7f168402a410 comp rx=0 tx=0).stop 2024-09-19T08:06:35.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.448+0000 7f1696a40640 1 -- 172.21.15.203:0/1241839054 shutdown_connections 2024-09-19T08:06:35.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.448+0000 7f1696a40640 1 --2- 172.21.15.203:0/1241839054 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1690107900 0x7f1690109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:35.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.448+0000 7f1696a40640 1 --2- 172.21.15.203:0/1241839054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1690104fd0 0x7f16901073c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:35.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.448+0000 7f1696a40640 1 --2- 172.21.15.203:0/1241839054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16901026a0 0x7f1690104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:35.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.448+0000 7f1696a40640 1 -- 172.21.15.203:0/1241839054 >> 172.21.15.203:0/1241839054 conn(0x7f16900fc2a0 msgr2=0x7f16900fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:06:35.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.448+0000 7f1696a40640 1 -- 172.21.15.203:0/1241839054 shutdown_connections 2024-09-19T08:06:35.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.448+0000 7f1696a40640 1 -- 172.21.15.203:0/1241839054 wait complete. 2024-09-19T08:06:35.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.448+0000 7f1696a40640 1 Processor -- start 2024-09-19T08:06:35.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.448+0000 7f1696a40640 1 -- start start 2024-09-19T08:06:35.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.449+0000 7f1696a40640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16901026a0 0x7f1690197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:06:35.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.449+0000 7f1696a40640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1690104fd0 0x7f1690198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:06:35.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.449+0000 7f1696a40640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1690107900 0x7f169019f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:06:35.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.449+0000 7f1696a40640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f169010d8a0 con 0x7f1690107900 2024-09-19T08:06:35.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.449+0000 7f1696a40640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f169010d720 con 0x7f1690104fd0 2024-09-19T08:06:35.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.449+0000 7f1696a40640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f169010da20 con 0x7f16901026a0 2024-09-19T08:06:35.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.449+0000 7f168ffff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16901026a0 0x7f1690197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:06:35.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.449+0000 7f168ffff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16901026a0 0x7f1690197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:57036/0 (socket says 172.21.15.203:57036) 2024-09-19T08:06:35.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.449+0000 7f168ffff640 1 -- 172.21.15.203:0/1792343 learned_addr learned my addr 172.21.15.203:0/1792343 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:06:35.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.449+0000 7f168f7fe640 1 --2- 172.21.15.203:0/1792343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1690104fd0 0x7f1690198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:06:35.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.449+0000 7f1694fdd640 1 --2- 172.21.15.203:0/1792343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1690107900 0x7f169019f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:06:35.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.449+0000 7f168ffff640 1 -- 172.21.15.203:0/1792343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1690104fd0 msgr2=0x7f1690198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:06:35.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.449+0000 7f168ffff640 1 --2- 172.21.15.203:0/1792343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1690104fd0 0x7f1690198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:35.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.449+0000 7f168ffff640 1 -- 172.21.15.203:0/1792343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1690107900 msgr2=0x7f169019f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:06:35.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.449+0000 7f168ffff640 1 --2- 172.21.15.203:0/1792343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1690107900 0x7f169019f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:35.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.449+0000 7f168ffff640 1 -- 172.21.15.203:0/1792343 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169019fb20 con 0x7f16901026a0 2024-09-19T08:06:35.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.449+0000 7f168f7fe640 1 --2- 172.21.15.203:0/1792343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1690104fd0 0x7f1690198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:06:35.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.449+0000 7f168ffff640 1 --2- 172.21.15.203:0/1792343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16901026a0 0x7f1690197ef0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f168000e9f0 tx=0x7f168000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:06:35.468 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.449+0000 7f168d7fa640 1 -- 172.21.15.203:0/1792343 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168000cd80 con 0x7f16901026a0 2024-09-19T08:06:35.468 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.450+0000 7f168d7fa640 1 -- 172.21.15.203:0/1792343 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1680005500 con 0x7f16901026a0 2024-09-19T08:06:35.468 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.450+0000 7f1696a40640 1 -- 172.21.15.203:0/1792343 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f169019fe10 con 0x7f16901026a0 2024-09-19T08:06:35.468 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.450+0000 7f168d7fa640 1 -- 172.21.15.203:0/1792343 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1680010690 con 0x7f16901026a0 2024-09-19T08:06:35.468 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.450+0000 7f1696a40640 1 -- 172.21.15.203:0/1792343 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16901a0200 con 0x7f16901026a0 2024-09-19T08:06:35.468 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.450+0000 7f1696a40640 1 -- 172.21.15.203:0/1792343 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16900fdd90 con 0x7f16901026a0 2024-09-19T08:06:35.468 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.452+0000 7f168d7fa640 1 -- 172.21.15.203:0/1792343 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f16800046c0 con 0x7f16901026a0 2024-09-19T08:06:35.468 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.452+0000 7f168d7fa640 1 --2- 172.21.15.203:0/1792343 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f16780a3270 0x7f16780a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:06:35.468 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.452+0000 7f168d7fa640 1 -- 172.21.15.203:0/1792343 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5117+0+0 (secure 0 0 0) 0x7f16800cf1c0 con 0x7f16901026a0 2024-09-19T08:06:35.468 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.453+0000 7f168f7fe640 1 --2- 172.21.15.203:0/1792343 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f16780a3270 0x7f16780a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:06:35.468 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.453+0000 7f168f7fe640 1 --2- 172.21.15.203:0/1792343 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f16780a3270 0x7f16780a5730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1684006010 tx=0x7f1684032dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:06:35.468 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.457+0000 7f168d7fa640 1 -- 172.21.15.203:0/1792343 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f168009cb60 con 0x7f16901026a0 2024-09-19T08:06:35.641 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:35.641+0000 7f1696a40640 1 -- 172.21.15.203:0/1792343 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1690062630 con 0x7f16780a3270 2024-09-19T08:06:36.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:35 smithi155 ceph-mon[35362]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:36.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:35 smithi155 ceph-mon[35362]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:06:36.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:35 smithi155 ceph-mon[35362]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T08:06:36.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:35 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:06:36.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:35 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:06:36.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:35 smithi155 ceph-mon[35362]: osd.7 [v2:172.21.15.155:6816/2047506436,v1:172.21.15.155:6817/2047506436] boot 2024-09-19T08:06:36.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:35 smithi155 ceph-mon[35362]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T08:06:36.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:35 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:06:36.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:35 smithi155 ceph-mon[35362]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:06:36.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:35 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:06:36.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:35 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:06:36.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:35 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:36.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:35 smithi027 ceph-mon[31209]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:36.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:35 smithi027 ceph-mon[31209]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:06:36.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:35 smithi027 ceph-mon[31209]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T08:06:36.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:35 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:06:36.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:35 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:06:36.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:35 smithi027 ceph-mon[31209]: osd.7 [v2:172.21.15.155:6816/2047506436,v1:172.21.15.155:6817/2047506436] boot 2024-09-19T08:06:36.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:35 smithi027 ceph-mon[31209]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T08:06:36.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:35 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:06:36.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:35 smithi027 ceph-mon[31209]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:06:36.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:35 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:06:36.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:35 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:06:36.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:35 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:36.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:35 smithi203 ceph-mon[35198]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:06:36.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:35 smithi203 ceph-mon[35198]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:06:36.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:35 smithi203 ceph-mon[35198]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T08:06:36.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:35 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:06:36.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:35 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:06:36.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:35 smithi203 ceph-mon[35198]: osd.7 [v2:172.21.15.155:6816/2047506436,v1:172.21.15.155:6817/2047506436] boot 2024-09-19T08:06:36.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:35 smithi203 ceph-mon[35198]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T08:06:36.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:35 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:06:36.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:35 smithi203 ceph-mon[35198]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:06:36.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:35 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:06:36.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:35 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:06:36.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:35 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:37.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:36 smithi155 ceph-mon[35362]: purged_snaps scrub starts 2024-09-19T08:06:37.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:36 smithi155 ceph-mon[35362]: purged_snaps scrub ok 2024-09-19T08:06:37.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:36 smithi155 ceph-mon[35362]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T08:06:37.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:36 smithi027 ceph-mon[31209]: purged_snaps scrub starts 2024-09-19T08:06:37.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:36 smithi027 ceph-mon[31209]: purged_snaps scrub ok 2024-09-19T08:06:37.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:36 smithi027 ceph-mon[31209]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T08:06:37.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:36 smithi203 ceph-mon[35198]: purged_snaps scrub starts 2024-09-19T08:06:37.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:36 smithi203 ceph-mon[35198]: purged_snaps scrub ok 2024-09-19T08:06:37.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:36 smithi203 ceph-mon[35198]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T08:06:38.710 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:38 smithi203 ceph-mon[35198]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:38.710 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:38 smithi203 ceph-mon[35198]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T08:06:38.711 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:38 smithi203 ceph-mon[35198]: from='client.? 172.21.15.203:0/3760117932' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d7a8ffd-a039-403e-8b9a-c80e19fd67ec"}]: dispatch 2024-09-19T08:06:38.711 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:38 smithi203 ceph-mon[35198]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d7a8ffd-a039-403e-8b9a-c80e19fd67ec"}]: dispatch 2024-09-19T08:06:38.711 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:38 smithi203 ceph-mon[35198]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d7a8ffd-a039-403e-8b9a-c80e19fd67ec"}]': finished 2024-09-19T08:06:38.711 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:38 smithi203 ceph-mon[35198]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:06:38.711 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:38 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:06:38.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:38 smithi155 ceph-mon[35362]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:38.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:38 smithi155 ceph-mon[35362]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T08:06:38.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:38 smithi155 ceph-mon[35362]: from='client.? 172.21.15.203:0/3760117932' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d7a8ffd-a039-403e-8b9a-c80e19fd67ec"}]: dispatch 2024-09-19T08:06:38.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:38 smithi155 ceph-mon[35362]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d7a8ffd-a039-403e-8b9a-c80e19fd67ec"}]: dispatch 2024-09-19T08:06:38.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:38 smithi155 ceph-mon[35362]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d7a8ffd-a039-403e-8b9a-c80e19fd67ec"}]': finished 2024-09-19T08:06:38.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:38 smithi155 ceph-mon[35362]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:06:38.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:38 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:06:39.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:38 smithi027 ceph-mon[31209]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:39.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:38 smithi027 ceph-mon[31209]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T08:06:39.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:38 smithi027 ceph-mon[31209]: from='client.? 172.21.15.203:0/3760117932' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d7a8ffd-a039-403e-8b9a-c80e19fd67ec"}]: dispatch 2024-09-19T08:06:39.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:38 smithi027 ceph-mon[31209]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d7a8ffd-a039-403e-8b9a-c80e19fd67ec"}]: dispatch 2024-09-19T08:06:39.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:38 smithi027 ceph-mon[31209]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d7a8ffd-a039-403e-8b9a-c80e19fd67ec"}]': finished 2024-09-19T08:06:39.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:38 smithi027 ceph-mon[31209]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:06:39.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:38 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:06:39.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:39 smithi155 ceph-mon[35362]: from='client.? 172.21.15.203:0/4000657209' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:06:39.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:39 smithi155 ceph-mon[35362]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T08:06:39.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:39 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:06:40.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:39 smithi027 ceph-mon[31209]: from='client.? 172.21.15.203:0/4000657209' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:06:40.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:39 smithi027 ceph-mon[31209]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T08:06:40.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:39 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:06:40.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:39 smithi203 ceph-mon[35198]: from='client.? 172.21.15.203:0/4000657209' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:06:40.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:39 smithi203 ceph-mon[35198]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T08:06:40.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:39 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:06:40.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:40 smithi155 ceph-mon[35362]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:41.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:40 smithi027 ceph-mon[31209]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:40 smithi203 ceph-mon[35198]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:42.937 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:42 smithi027 ceph-mon[31209]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:42.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:42 smithi155 ceph-mon[35362]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:43.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:42 smithi203 ceph-mon[35198]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:44.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:44 smithi203 ceph-mon[35198]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:44.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:44 smithi155 ceph-mon[35362]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:45.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:44 smithi027 ceph-mon[31209]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:46.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:46 smithi203 ceph-mon[35198]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:46.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:46 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:06:46.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:46 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:46.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:46 smithi155 ceph-mon[35362]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:46.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:46 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:06:46.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:46 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:47.005 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:46 smithi027 ceph-mon[31209]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:47.005 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:46 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:06:47.005 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:46 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:47.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:47 smithi155 ceph-mon[35362]: Deploying daemon osd.8 on smithi203 2024-09-19T08:06:48.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:47 smithi027 ceph-mon[31209]: Deploying daemon osd.8 on smithi203 2024-09-19T08:06:48.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:47 smithi203 ceph-mon[35198]: Deploying daemon osd.8 on smithi203 2024-09-19T08:06:48.708 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:48 smithi203 ceph-mon[35198]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:48.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:48 smithi155 ceph-mon[35362]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:49.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:48 smithi027 ceph-mon[31209]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:50.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:50 smithi155 ceph-mon[35362]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:51.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:50 smithi027 ceph-mon[31209]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:51.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:50 smithi203 ceph-mon[35198]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:52.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:52 smithi155 ceph-mon[35362]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:53.001 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:52 smithi027 ceph-mon[31209]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:53.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:52 smithi203 ceph-mon[35198]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:53.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:53 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:06:53.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:53 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:53.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:53 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:54.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:53 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:06:54.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:53 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:54.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:53 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:54.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:53 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:06:54.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:53 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:54.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:53 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:54.955 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:54 smithi203 ceph-mon[35198]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:54.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:54 smithi155 ceph-mon[35362]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:55.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:54 smithi027 ceph-mon[31209]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:56.836 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:56 smithi203 ceph-mon[35198]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:56.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:56 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:56.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:56 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:56.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:56 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:56.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:56 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:06:56.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:56 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:56.880 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:56.879+0000 7f168d7fa640 1 -- 172.21.15.203:0/1792343 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1690062630 con 0x7f16780a3270 2024-09-19T08:06:56.880 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 8 on host 'smithi203' 2024-09-19T08:06:56.882 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:56.882+0000 7f1696a40640 1 -- 172.21.15.203:0/1792343 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f16780a3270 msgr2=0x7f16780a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:06:56.883 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:56.882+0000 7f1696a40640 1 --2- 172.21.15.203:0/1792343 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f16780a3270 0x7f16780a5730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1684006010 tx=0x7f1684032dd0 comp rx=0 tx=0).stop 2024-09-19T08:06:56.883 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:56.882+0000 7f1696a40640 1 -- 172.21.15.203:0/1792343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16901026a0 msgr2=0x7f1690197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:06:56.883 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:56.882+0000 7f1696a40640 1 --2- 172.21.15.203:0/1792343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16901026a0 0x7f1690197ef0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f168000e9f0 tx=0x7f168000edf0 comp rx=0 tx=0).stop 2024-09-19T08:06:56.883 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:56.882+0000 7f1696a40640 1 -- 172.21.15.203:0/1792343 shutdown_connections 2024-09-19T08:06:56.883 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:56.882+0000 7f1696a40640 1 --2- 172.21.15.203:0/1792343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1690107900 0x7f169019f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:56.883 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:56.882+0000 7f1696a40640 1 --2- 172.21.15.203:0/1792343 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f16780a3270 0x7f16780a5730 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:56.883 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:56.882+0000 7f1696a40640 1 --2- 172.21.15.203:0/1792343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1690104fd0 0x7f1690198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:56.883 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:56.882+0000 7f1696a40640 1 --2- 172.21.15.203:0/1792343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16901026a0 0x7f1690197ef0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:06:56.883 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:56.882+0000 7f1696a40640 1 -- 172.21.15.203:0/1792343 >> 172.21.15.203:0/1792343 conn(0x7f16900fc2a0 msgr2=0x7f1690102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:06:56.883 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:56.882+0000 7f1696a40640 1 -- 172.21.15.203:0/1792343 shutdown_connections 2024-09-19T08:06:56.883 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:06:56.882+0000 7f1696a40640 1 -- 172.21.15.203:0/1792343 wait complete. 2024-09-19T08:06:56.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:56 smithi155 ceph-mon[35362]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:56.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:56 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:56.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:56 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:56.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:56 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:56.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:56 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:06:56.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:56 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:57.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:56 smithi027 ceph-mon[31209]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:57.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:56 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:57.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:56 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:57.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:56 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:06:57.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:56 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:06:57.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:56 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:57.568 DEBUG:teuthology.orchestra.run.smithi203:osd.8> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T08:06:57.571 INFO:tasks.cephadm:Deploying osd.9 on smithi027 with /dev/vg_nvme/lv_1... 2024-09-19T08:06:57.571 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T08:06:57.821 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:57 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:06:57.821 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:57 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:57.821 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:57 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:57.839 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:06:57.961 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:57 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:06:57.961 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:57 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:57.961 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:57 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:57.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:57 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:06:57.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:57 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:57.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:57 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:06:58.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:58 smithi203 ceph-mon[35198]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:58.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:58 smithi203 ceph-mon[35198]: from='osd.8 [v2:172.21.15.203:6816/199970687,v1:172.21.15.203:6817/199970687]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:06:58.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:58 smithi203 ceph-mon[35198]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:06:58.759 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:06:58 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:06:58.477+0000 7fcfe58b5640 -1 osd.8 0 log_to_monitors true 2024-09-19T08:06:58.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:58 smithi027 ceph-mon[31209]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:58.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:58 smithi027 ceph-mon[31209]: from='osd.8 [v2:172.21.15.203:6816/199970687,v1:172.21.15.203:6817/199970687]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:06:58.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:58 smithi027 ceph-mon[31209]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:06:58.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:58 smithi155 ceph-mon[35362]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:06:58.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:58 smithi155 ceph-mon[35362]: from='osd.8 [v2:172.21.15.203:6816/199970687,v1:172.21.15.203:6817/199970687]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:06:58.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:58 smithi155 ceph-mon[35362]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:07:00.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:59 smithi155 ceph-mon[35362]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:07:00.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:59 smithi155 ceph-mon[35362]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T08:07:00.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:59 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:07:00.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:59 smithi155 ceph-mon[35362]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:07:00.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:59 smithi155 ceph-mon[35362]: from='osd.8 [v2:172.21.15.203:6816/199970687,v1:172.21.15.203:6817/199970687]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:07:00.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:06:59 smithi155 ceph-mon[35362]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:07:00.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:59 smithi027 ceph-mon[31209]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:07:00.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:59 smithi027 ceph-mon[31209]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T08:07:00.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:59 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:07:00.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:59 smithi027 ceph-mon[31209]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:07:00.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:59 smithi027 ceph-mon[31209]: from='osd.8 [v2:172.21.15.203:6816/199970687,v1:172.21.15.203:6817/199970687]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:07:00.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:06:59 smithi027 ceph-mon[31209]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:07:00.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:59 smithi203 ceph-mon[35198]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:07:00.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:59 smithi203 ceph-mon[35198]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T08:07:00.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:59 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:07:00.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:59 smithi203 ceph-mon[35198]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:07:00.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:59 smithi203 ceph-mon[35198]: from='osd.8 [v2:172.21.15.203:6816/199970687,v1:172.21.15.203:6817/199970687]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:07:00.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:06:59 smithi203 ceph-mon[35198]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:07:00.671 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:07:00.697 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi027:vg_nvme/lv_1 2024-09-19T08:07:00.701 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:07:00.309+0000 7fcfe1838640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T08:07:00.701 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:07:00.317+0000 7fcfd9658640 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:07:00.971 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:07:00.991 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:00 smithi027 ceph-mon[31209]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:07:00.991 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:00 smithi027 ceph-mon[31209]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T08:07:00.991 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:07:00.991 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:07:00.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:00 smithi027 ceph-mon[31209]: from='osd.8 ' entity='osd.8' 2024-09-19T08:07:00.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:00 smithi027 ceph-mon[31209]: osd.8 [v2:172.21.15.203:6816/199970687,v1:172.21.15.203:6817/199970687] boot 2024-09-19T08:07:00.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:00 smithi027 ceph-mon[31209]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T08:07:00.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:07:00.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:00 smithi027 ceph-mon[31209]: Detected new or changed devices on smithi203 2024-09-19T08:07:00.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:00.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:00.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:00.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:00.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:00.993 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:00 smithi027 ceph-mon[31209]: Adjusting osd_memory_target on smithi203 to 5696M 2024-09-19T08:07:00.993 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:00.993 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:00.993 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:07:00.993 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-mon[35198]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:07:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-mon[35198]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T08:07:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:07:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:07:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-mon[35198]: from='osd.8 ' entity='osd.8' 2024-09-19T08:07:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-mon[35198]: osd.8 [v2:172.21.15.203:6816/199970687,v1:172.21.15.203:6817/199970687] boot 2024-09-19T08:07:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-mon[35198]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T08:07:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:07:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-mon[35198]: Detected new or changed devices on smithi203 2024-09-19T08:07:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-mon[35198]: Adjusting osd_memory_target on smithi203 to 5696M 2024-09-19T08:07:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:07:01.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:01.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:00 smithi155 ceph-mon[35362]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:07:01.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:00 smithi155 ceph-mon[35362]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T08:07:01.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:00 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:07:01.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:00 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:07:01.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:00 smithi155 ceph-mon[35362]: from='osd.8 ' entity='osd.8' 2024-09-19T08:07:01.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:00 smithi155 ceph-mon[35362]: osd.8 [v2:172.21.15.203:6816/199970687,v1:172.21.15.203:6817/199970687] boot 2024-09-19T08:07:01.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:00 smithi155 ceph-mon[35362]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T08:07:01.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:00 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:07:01.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:00 smithi155 ceph-mon[35362]: Detected new or changed devices on smithi203 2024-09-19T08:07:01.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:00 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:01.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:00 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:01.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:00 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:01.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:00 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:01.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:00 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:01.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:00 smithi155 ceph-mon[35362]: Adjusting osd_memory_target on smithi203 to 5696M 2024-09-19T08:07:01.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:00 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:01.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:00 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:01.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:00 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:07:01.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:00 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:01.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.460+0000 7feb907df640 1 -- 172.21.15.27:0/41830089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb880ffef0 msgr2=0x7feb881002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:07:01.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.460+0000 7feb907df640 1 --2- 172.21.15.27:0/41830089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb880ffef0 0x7feb881002f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feb84009930 tx=0x7feb8402a420 comp rx=0 tx=0).stop 2024-09-19T08:07:01.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.460+0000 7feb907df640 1 -- 172.21.15.27:0/41830089 shutdown_connections 2024-09-19T08:07:01.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.460+0000 7feb907df640 1 --2- 172.21.15.27:0/41830089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb88103930 0x7feb8810a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:01.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.460+0000 7feb907df640 1 --2- 172.21.15.27:0/41830089 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb88102f70 0x7feb881033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:01.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.460+0000 7feb907df640 1 --2- 172.21.15.27:0/41830089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb880ffef0 0x7feb881002f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:01.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.460+0000 7feb907df640 1 -- 172.21.15.27:0/41830089 >> 172.21.15.27:0/41830089 conn(0x7feb880fba40 msgr2=0x7feb880fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:07:01.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.460+0000 7feb907df640 1 -- 172.21.15.27:0/41830089 shutdown_connections 2024-09-19T08:07:01.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.460+0000 7feb907df640 1 -- 172.21.15.27:0/41830089 wait complete. 2024-09-19T08:07:01.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.461+0000 7feb907df640 1 Processor -- start 2024-09-19T08:07:01.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.461+0000 7feb907df640 1 -- start start 2024-09-19T08:07:01.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.461+0000 7feb907df640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb880ffef0 0x7feb88197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:07:01.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.461+0000 7feb907df640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb88102f70 0x7feb88198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:07:01.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.461+0000 7feb907df640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb88103930 0x7feb8819f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:07:01.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.461+0000 7feb907df640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7feb8810d890 con 0x7feb88103930 2024-09-19T08:07:01.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.461+0000 7feb907df640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feb8810d710 con 0x7feb880ffef0 2024-09-19T08:07:01.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.461+0000 7feb907df640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feb8810da10 con 0x7feb88102f70 2024-09-19T08:07:01.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.461+0000 7feb8ed7c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb88103930 0x7feb8819f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:07:01.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.461+0000 7feb8ed7c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb88103930 0x7feb8819f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36340/0 (socket says 172.21.15.27:36340) 2024-09-19T08:07:01.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.461+0000 7feb8ed7c640 1 -- 172.21.15.27:0/211023135 learned_addr learned my addr 172.21.15.27:0/211023135 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:07:01.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.461+0000 7feb8e57b640 1 --2- 172.21.15.27:0/211023135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb880ffef0 0x7feb88197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:07:01.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.461+0000 7feb8dd7a640 1 --2- 172.21.15.27:0/211023135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb88102f70 0x7feb88198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:07:01.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.462+0000 7feb8ed7c640 1 -- 172.21.15.27:0/211023135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb88102f70 msgr2=0x7feb88198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:07:01.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.462+0000 7feb8ed7c640 1 --2- 172.21.15.27:0/211023135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb88102f70 0x7feb88198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:01.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.462+0000 7feb8ed7c640 1 -- 172.21.15.27:0/211023135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb880ffef0 msgr2=0x7feb88197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:07:01.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.462+0000 7feb8ed7c640 1 --2- 172.21.15.27:0/211023135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb880ffef0 0x7feb88197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:01.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.462+0000 7feb8ed7c640 1 -- 172.21.15.27:0/211023135 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8819fb70 con 0x7feb88103930 2024-09-19T08:07:01.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.462+0000 7feb8ed7c640 1 --2- 172.21.15.27:0/211023135 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb88103930 0x7feb8819f500 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feb8000cce0 tx=0x7feb8000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:07:01.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.462+0000 7feb7f7fe640 1 -- 172.21.15.27:0/211023135 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8000f450 con 0x7feb88103930 2024-09-19T08:07:01.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.462+0000 7feb7f7fe640 1 -- 172.21.15.27:0/211023135 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb8000fad0 con 0x7feb88103930 2024-09-19T08:07:01.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.462+0000 7feb907df640 1 -- 172.21.15.27:0/211023135 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8819fe60 con 0x7feb88103930 2024-09-19T08:07:01.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.462+0000 7feb7f7fe640 1 -- 172.21.15.27:0/211023135 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80018c10 con 0x7feb88103930 2024-09-19T08:07:01.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.462+0000 7feb907df640 1 -- 172.21.15.27:0/211023135 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb881a0310 con 0x7feb88103930 2024-09-19T08:07:01.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.463+0000 7feb907df640 1 -- 172.21.15.27:0/211023135 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb881091c0 con 0x7feb88103930 2024-09-19T08:07:01.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.464+0000 7feb7f7fe640 1 -- 172.21.15.27:0/211023135 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7feb8000f5f0 con 0x7feb88103930 2024-09-19T08:07:01.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.465+0000 7feb7f7fe640 1 --2- 172.21.15.27:0/211023135 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7feb740a32f0 0x7feb740a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:07:01.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.465+0000 7feb8e57b640 1 --2- 172.21.15.27:0/211023135 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7feb740a32f0 0x7feb740a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:07:01.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.465+0000 7feb7f7fe640 1 -- 172.21.15.27:0/211023135 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5862+0+0 (secure 0 0 0) 0x7feb800cf4b0 con 0x7feb88103930 2024-09-19T08:07:01.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.466+0000 7feb8e57b640 1 --2- 172.21.15.27:0/211023135 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7feb740a32f0 0x7feb740a57b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feb84009900 tx=0x7feb840315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:07:01.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.470+0000 7feb7f7fe640 1 -- 172.21.15.27:0/211023135 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feb80014030 con 0x7feb88103930 2024-09-19T08:07:01.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:01.656+0000 7feb907df640 1 -- 172.21.15.27:0/211023135 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7feb88062630 con 0x7feb740a32f0 2024-09-19T08:07:02.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:01 smithi027 ceph-mon[31209]: purged_snaps scrub starts 2024-09-19T08:07:02.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:01 smithi027 ceph-mon[31209]: purged_snaps scrub ok 2024-09-19T08:07:02.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:01 smithi027 ceph-mon[31209]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:07:02.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:01 smithi027 ceph-mon[31209]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T08:07:02.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:01 smithi027 ceph-mon[31209]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:07:02.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:01 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:07:02.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:01 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:07:02.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:01 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:02.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:01 smithi155 ceph-mon[35362]: purged_snaps scrub starts 2024-09-19T08:07:02.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:01 smithi155 ceph-mon[35362]: purged_snaps scrub ok 2024-09-19T08:07:02.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:01 smithi155 ceph-mon[35362]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:07:02.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:01 smithi155 ceph-mon[35362]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T08:07:02.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:01 smithi155 ceph-mon[35362]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:07:02.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:01 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:07:02.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:01 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:07:02.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:01 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:02.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:01 smithi203 ceph-mon[35198]: purged_snaps scrub starts 2024-09-19T08:07:02.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:01 smithi203 ceph-mon[35198]: purged_snaps scrub ok 2024-09-19T08:07:02.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:01 smithi203 ceph-mon[35198]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:07:02.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:01 smithi203 ceph-mon[35198]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T08:07:02.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:01 smithi203 ceph-mon[35198]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:07:02.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:01 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:07:02.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:01 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:07:02.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:01 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:03.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:03 smithi155 ceph-mon[35362]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T08:07:03.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:03 smithi027 ceph-mon[31209]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T08:07:04.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:03 smithi203 ceph-mon[35198]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T08:07:04.918 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:04 smithi027 ceph-mon[31209]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:04.918 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:04 smithi027 ceph-mon[31209]: osdmap e59: 9 total, 9 up, 9 in 2024-09-19T08:07:04.918 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:04 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2283023136' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cdb90242-80a1-4cef-b5e3-ddecb05664e1"}]: dispatch 2024-09-19T08:07:04.918 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:04 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2283023136' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cdb90242-80a1-4cef-b5e3-ddecb05664e1"}]': finished 2024-09-19T08:07:04.918 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:04 smithi027 ceph-mon[31209]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T08:07:04.918 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:04 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:07:04.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:04 smithi155 ceph-mon[35362]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:04.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:04 smithi155 ceph-mon[35362]: osdmap e59: 9 total, 9 up, 9 in 2024-09-19T08:07:04.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:04 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2283023136' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cdb90242-80a1-4cef-b5e3-ddecb05664e1"}]: dispatch 2024-09-19T08:07:04.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:04 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2283023136' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cdb90242-80a1-4cef-b5e3-ddecb05664e1"}]': finished 2024-09-19T08:07:04.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:04 smithi155 ceph-mon[35362]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T08:07:04.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:04 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:07:05.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:04 smithi203 ceph-mon[35198]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:05.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:04 smithi203 ceph-mon[35198]: osdmap e59: 9 total, 9 up, 9 in 2024-09-19T08:07:05.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:04 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2283023136' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cdb90242-80a1-4cef-b5e3-ddecb05664e1"}]: dispatch 2024-09-19T08:07:05.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:04 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2283023136' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cdb90242-80a1-4cef-b5e3-ddecb05664e1"}]': finished 2024-09-19T08:07:05.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:04 smithi203 ceph-mon[35198]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T08:07:05.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:04 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:07:05.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:05 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/245848031' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:07:06.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:05 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/245848031' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:07:06.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:05 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/245848031' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:07:06.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:06 smithi155 ceph-mon[35362]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:07.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:06 smithi027 ceph-mon[31209]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:07.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:06 smithi203 ceph-mon[35198]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:08.903 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:08 smithi027 ceph-mon[31209]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-19T08:07:08.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:08 smithi155 ceph-mon[35362]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-19T08:07:09.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:08 smithi203 ceph-mon[35198]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-19T08:07:10.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:10 smithi027 ceph-mon[31209]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T08:07:10.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:10 smithi155 ceph-mon[35362]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T08:07:11.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:10 smithi203 ceph-mon[35198]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T08:07:12.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:12 smithi155 ceph-mon[35362]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:07:13.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:12 smithi027 ceph-mon[31209]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:07:13.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:12 smithi203 ceph-mon[35198]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:07:13.956 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:13 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T08:07:13.957 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:13 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:13.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:13 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T08:07:13.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:13 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:14.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:13 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T08:07:14.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:13 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:14.971 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:14 smithi027 ceph-mon[31209]: Deploying daemon osd.9 on smithi027 2024-09-19T08:07:14.971 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:14 smithi027 ceph-mon[31209]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T08:07:14.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:14 smithi155 ceph-mon[35362]: Deploying daemon osd.9 on smithi027 2024-09-19T08:07:14.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:14 smithi155 ceph-mon[35362]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T08:07:15.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:14 smithi203 ceph-mon[35198]: Deploying daemon osd.9 on smithi027 2024-09-19T08:07:15.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:14 smithi203 ceph-mon[35198]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T08:07:16.906 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:16 smithi027 ceph-mon[31209]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T08:07:16.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:16 smithi155 ceph-mon[35362]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T08:07:17.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:16 smithi203 ceph-mon[35198]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T08:07:18.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:18 smithi027 ceph-mon[31209]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:07:18.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:18 smithi155 ceph-mon[35362]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:07:19.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:18 smithi203 ceph-mon[35198]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:07:19.910 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:19 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:07:19.911 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:19 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:19.911 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:19 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:19.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:19 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:07:19.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:19 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:19.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:19 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:20.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:19 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:07:20.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:19 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:20.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:19 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:20.935 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:20 smithi027 ceph-mon[31209]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:20.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:20 smithi155 ceph-mon[35362]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:21.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:20 smithi203 ceph-mon[35198]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:22.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:22.609+0000 7feb7f7fe640 1 -- 172.21.15.27:0/211023135 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7feb88062630 con 0x7feb740a32f0 2024-09-19T08:07:22.610 INFO:teuthology.orchestra.run.smithi027.stdout:Created osd(s) 9 on host 'smithi027' 2024-09-19T08:07:22.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:22.612+0000 7feb907df640 1 -- 172.21.15.27:0/211023135 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7feb740a32f0 msgr2=0x7feb740a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:07:22.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:22.612+0000 7feb907df640 1 --2- 172.21.15.27:0/211023135 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7feb740a32f0 0x7feb740a57b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feb84009900 tx=0x7feb840315b0 comp rx=0 tx=0).stop 2024-09-19T08:07:22.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:22.612+0000 7feb907df640 1 -- 172.21.15.27:0/211023135 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb88103930 msgr2=0x7feb8819f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:07:22.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:22.612+0000 7feb907df640 1 --2- 172.21.15.27:0/211023135 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb88103930 0x7feb8819f500 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feb8000cce0 tx=0x7feb8000a620 comp rx=0 tx=0).stop 2024-09-19T08:07:22.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:22.612+0000 7feb907df640 1 -- 172.21.15.27:0/211023135 shutdown_connections 2024-09-19T08:07:22.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:22.612+0000 7feb907df640 1 --2- 172.21.15.27:0/211023135 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb88103930 0x7feb8819f500 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:22.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:22.612+0000 7feb907df640 1 --2- 172.21.15.27:0/211023135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb88102f70 0x7feb88198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:22.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:22.612+0000 7feb907df640 1 --2- 172.21.15.27:0/211023135 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7feb740a32f0 0x7feb740a57b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:22.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:22.612+0000 7feb907df640 1 --2- 172.21.15.27:0/211023135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb880ffef0 0x7feb88197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:22.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:22.612+0000 7feb907df640 1 -- 172.21.15.27:0/211023135 >> 172.21.15.27:0/211023135 conn(0x7feb880fba40 msgr2=0x7feb88106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:07:22.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:22.612+0000 7feb907df640 1 -- 172.21.15.27:0/211023135 shutdown_connections 2024-09-19T08:07:22.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:07:22.612+0000 7feb907df640 1 -- 172.21.15.27:0/211023135 wait complete. 2024-09-19T08:07:22.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:22 smithi027 ceph-mon[31209]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:22.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:22 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:22.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:22 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:22.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:22 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:22.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:22 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:07:22.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:22 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:22.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:22 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:07:22.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:22 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:22.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:22 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:22.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:22 smithi155 ceph-mon[35362]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:22.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:22 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:22.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:22 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:22.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:22 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:22.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:22 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:07:22.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:22 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:22.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:22 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:07:22.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:22 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:22.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:22 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:23.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:22 smithi203 ceph-mon[35198]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:23.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:22 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:23.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:22 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:23.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:22 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:23.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:22 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:07:23.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:22 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:23.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:22 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:07:23.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:22 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:23.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:22 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:23.428 DEBUG:teuthology.orchestra.run.smithi027:osd.9> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T08:07:23.430 INFO:tasks.cephadm:Deploying osd.10 on smithi155 with /dev/vg_nvme/lv_1... 2024-09-19T08:07:23.430 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T08:07:23.690 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:07:24.817 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:24 smithi155 ceph-mon[35362]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:24.825 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:24 smithi027 ceph-mon[31209]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:25.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:24 smithi203 ceph-mon[35198]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:25.502 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:07:25 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:07:25.162+0000 7f2eb9609640 -1 osd.9 0 log_to_monitors true 2024-09-19T08:07:25.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:25 smithi155 ceph-mon[35362]: from='osd.9 [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T08:07:25.999 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:25 smithi027 ceph-mon[31209]: from='osd.9 [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T08:07:26.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:25 smithi203 ceph-mon[35198]: from='osd.9 [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T08:07:26.421 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:07:26.446 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi155:vg_nvme/lv_1 2024-09-19T08:07:26.691 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:07:26.956 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:26 smithi155 ceph-mon[35362]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:26.956 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:26 smithi155 ceph-mon[35362]: from='osd.9 [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T08:07:26.956 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:26 smithi155 ceph-mon[35362]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T08:07:26.956 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:26 smithi155 ceph-mon[35362]: from='osd.9 [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-19T08:07:26.956 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:26 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:07:26.956 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:26 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:26.956 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:26 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:26.956 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:26 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:26.956 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:26 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:26.956 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:26 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:26.957 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:26 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:26.957 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:26 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:26.957 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:26 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:26.957 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:26 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:07:26.957 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:26 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:27.007 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:07:26 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:07:26.702+0000 7f2eb558c640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T08:07:27.007 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:07:26 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:07:26.716+0000 7f2eb13b4640 -1 osd.9 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:07:27.007 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:26 smithi027 ceph-mon[31209]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:27.008 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:26 smithi027 ceph-mon[31209]: from='osd.9 [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T08:07:27.008 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:26 smithi027 ceph-mon[31209]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T08:07:27.008 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:26 smithi027 ceph-mon[31209]: from='osd.9 [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-19T08:07:27.008 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:26 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:07:27.008 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:26 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:27.008 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:26 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:27.008 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:26 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:27.009 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:26 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:27.009 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:26 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:27.009 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:26 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:27.009 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:26 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:27.009 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:26 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:27.009 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:26 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:07:27.009 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:26 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:27.011 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:26 smithi203 ceph-mon[35198]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:27.011 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:26 smithi203 ceph-mon[35198]: from='osd.9 [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T08:07:27.011 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:26 smithi203 ceph-mon[35198]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T08:07:27.011 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:26 smithi203 ceph-mon[35198]: from='osd.9 [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-19T08:07:27.011 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:26 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:07:27.011 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:26 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:27.011 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:26 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:27.012 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:26 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:27.012 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:26 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:27.012 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:26 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:27.012 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:26 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:27.012 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:26 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:27.012 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:26 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:27.012 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:26 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:07:27.012 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:26 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:27.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.162+0000 7fe329ce0640 1 -- 172.21.15.155:0/1897601244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe324107900 msgr2=0x7fe324109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:07:27.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.162+0000 7fe329ce0640 1 --2- 172.21.15.155:0/1897601244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe324107900 0x7fe324109d50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009ca0 tx=0x7fe31c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:07:27.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.162+0000 7fe329ce0640 1 -- 172.21.15.155:0/1897601244 shutdown_connections 2024-09-19T08:07:27.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.162+0000 7fe329ce0640 1 --2- 172.21.15.155:0/1897601244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe324107900 0x7fe324109d50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:27.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.162+0000 7fe329ce0640 1 --2- 172.21.15.155:0/1897601244 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe324104fd0 0x7fe3241073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:27.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.162+0000 7fe329ce0640 1 --2- 172.21.15.155:0/1897601244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3241026a0 0x7fe324104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:27.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.162+0000 7fe329ce0640 1 -- 172.21.15.155:0/1897601244 >> 172.21.15.155:0/1897601244 conn(0x7fe3240fc2a0 msgr2=0x7fe3240fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:07:27.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.162+0000 7fe329ce0640 1 -- 172.21.15.155:0/1897601244 shutdown_connections 2024-09-19T08:07:27.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.162+0000 7fe329ce0640 1 -- 172.21.15.155:0/1897601244 wait complete. 2024-09-19T08:07:27.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.163+0000 7fe329ce0640 1 Processor -- start 2024-09-19T08:07:27.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.163+0000 7fe329ce0640 1 -- start start 2024-09-19T08:07:27.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.163+0000 7fe329ce0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3241026a0 0x7fe324197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:07:27.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.163+0000 7fe329ce0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe324104fd0 0x7fe324198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:07:27.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.163+0000 7fe329ce0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe324107900 0x7fe32419f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:07:27.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.163+0000 7fe329ce0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe32410d8c0 con 0x7fe324104fd0 2024-09-19T08:07:27.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.163+0000 7fe329ce0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe32410d740 con 0x7fe3241026a0 2024-09-19T08:07:27.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.163+0000 7fe329ce0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe32410da40 con 0x7fe324107900 2024-09-19T08:07:27.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.163+0000 7fe3237fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3241026a0 0x7fe324197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:07:27.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.164+0000 7fe3237fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3241026a0 0x7fe324197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:38540/0 (socket says 172.21.15.155:38540) 2024-09-19T08:07:27.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.164+0000 7fe3237fe640 1 -- 172.21.15.155:0/1748615715 learned_addr learned my addr 172.21.15.155:0/1748615715 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-19T08:07:27.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.164+0000 7fe322ffd640 1 --2- 172.21.15.155:0/1748615715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe324104fd0 0x7fe324198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:07:27.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.164+0000 7fe323fff640 1 --2- 172.21.15.155:0/1748615715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe324107900 0x7fe32419f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:07:27.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.164+0000 7fe3237fe640 1 -- 172.21.15.155:0/1748615715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe324107900 msgr2=0x7fe32419f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:07:27.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.164+0000 7fe3237fe640 1 --2- 172.21.15.155:0/1748615715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe324107900 0x7fe32419f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:27.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.164+0000 7fe3237fe640 1 -- 172.21.15.155:0/1748615715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe324104fd0 msgr2=0x7fe324198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:07:27.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.164+0000 7fe3237fe640 1 --2- 172.21.15.155:0/1748615715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe324104fd0 0x7fe324198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:27.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.164+0000 7fe3237fe640 1 -- 172.21.15.155:0/1748615715 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32419fb20 con 0x7fe3241026a0 2024-09-19T08:07:27.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.164+0000 7fe3237fe640 1 --2- 172.21.15.155:0/1748615715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3241026a0 0x7fe324197ef0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00c970 tx=0x7fe30c00ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:07:27.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.164+0000 7fe320ff9640 1 -- 172.21.15.155:0/1748615715 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c007bb0 con 0x7fe3241026a0 2024-09-19T08:07:27.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.164+0000 7fe329ce0640 1 -- 172.21.15.155:0/1748615715 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32419fe10 con 0x7fe3241026a0 2024-09-19T08:07:27.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.164+0000 7fe320ff9640 1 -- 172.21.15.155:0/1748615715 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe30c007d50 con 0x7fe3241026a0 2024-09-19T08:07:27.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.164+0000 7fe320ff9640 1 -- 172.21.15.155:0/1748615715 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c00f450 con 0x7fe3241026a0 2024-09-19T08:07:27.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.164+0000 7fe329ce0640 1 -- 172.21.15.155:0/1748615715 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3241a0260 con 0x7fe3241026a0 2024-09-19T08:07:27.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.165+0000 7fe329ce0640 1 -- 172.21.15.155:0/1748615715 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3240fdd90 con 0x7fe3241026a0 2024-09-19T08:07:27.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.167+0000 7fe320ff9640 1 -- 172.21.15.155:0/1748615715 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe30c004fa0 con 0x7fe3241026a0 2024-09-19T08:07:27.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.167+0000 7fe320ff9640 1 --2- 172.21.15.155:0/1748615715 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe3100a32f0 0x7fe3100a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:07:27.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.167+0000 7fe320ff9640 1 -- 172.21.15.155:0/1748615715 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5981+0+0 (secure 0 0 0) 0x7fe30c0cf1d0 con 0x7fe3241026a0 2024-09-19T08:07:27.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.168+0000 7fe322ffd640 1 --2- 172.21.15.155:0/1748615715 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe3100a32f0 0x7fe3100a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:07:27.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.168+0000 7fe322ffd640 1 --2- 172.21.15.155:0/1748615715 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe3100a32f0 0x7fe3100a57b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe324199410 tx=0x7fe31400b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:07:27.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.171+0000 7fe320ff9640 1 -- 172.21.15.155:0/1748615715 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe30c014030 con 0x7fe3241026a0 2024-09-19T08:07:27.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:27.346+0000 7fe329ce0640 1 -- 172.21.15.155:0/1748615715 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe324062630 con 0x7fe3100a32f0 2024-09-19T08:07:27.974 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:27 smithi155 ceph-mon[35362]: Detected new or changed devices on smithi027 2024-09-19T08:07:27.974 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:27 smithi155 ceph-mon[35362]: Adjusting osd_memory_target on smithi027 to 4272M 2024-09-19T08:07:27.974 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:27 smithi155 ceph-mon[35362]: from='osd.9 [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-19T08:07:27.974 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:27 smithi155 ceph-mon[35362]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T08:07:27.974 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:27 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:07:27.975 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:27 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:07:27.975 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:27 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:07:27.975 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:27 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:07:27.975 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:27 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:28.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:27 smithi027 ceph-mon[31209]: Detected new or changed devices on smithi027 2024-09-19T08:07:28.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:27 smithi027 ceph-mon[31209]: Adjusting osd_memory_target on smithi027 to 4272M 2024-09-19T08:07:28.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:27 smithi027 ceph-mon[31209]: from='osd.9 [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-19T08:07:28.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:27 smithi027 ceph-mon[31209]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T08:07:28.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:27 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:07:28.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:27 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:07:28.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:27 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:07:28.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:27 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:07:28.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:27 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:28.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:27 smithi203 ceph-mon[35198]: Detected new or changed devices on smithi027 2024-09-19T08:07:28.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:27 smithi203 ceph-mon[35198]: Adjusting osd_memory_target on smithi027 to 4272M 2024-09-19T08:07:28.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:27 smithi203 ceph-mon[35198]: from='osd.9 [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-19T08:07:28.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:27 smithi203 ceph-mon[35198]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T08:07:28.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:27 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:07:28.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:27 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:07:28.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:27 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:07:28.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:27 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:07:28.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:27 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:28.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:28 smithi155 ceph-mon[35362]: purged_snaps scrub starts 2024-09-19T08:07:28.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:28 smithi155 ceph-mon[35362]: purged_snaps scrub ok 2024-09-19T08:07:28.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:28 smithi155 ceph-mon[35362]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:28.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:28 smithi155 ceph-mon[35362]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:07:28.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:28 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:07:28.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:28 smithi155 ceph-mon[35362]: osd.9 [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483] boot 2024-09-19T08:07:28.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:28 smithi155 ceph-mon[35362]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T08:07:28.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:28 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:07:29.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:28 smithi027 ceph-mon[31209]: purged_snaps scrub starts 2024-09-19T08:07:29.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:28 smithi027 ceph-mon[31209]: purged_snaps scrub ok 2024-09-19T08:07:29.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:28 smithi027 ceph-mon[31209]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:29.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:28 smithi027 ceph-mon[31209]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:07:29.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:28 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:07:29.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:28 smithi027 ceph-mon[31209]: osd.9 [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483] boot 2024-09-19T08:07:29.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:28 smithi027 ceph-mon[31209]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T08:07:29.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:28 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:07:29.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:28 smithi203 ceph-mon[35198]: purged_snaps scrub starts 2024-09-19T08:07:29.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:28 smithi203 ceph-mon[35198]: purged_snaps scrub ok 2024-09-19T08:07:29.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:28 smithi203 ceph-mon[35198]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:07:29.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:28 smithi203 ceph-mon[35198]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:07:29.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:28 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:07:29.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:28 smithi203 ceph-mon[35198]: osd.9 [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483] boot 2024-09-19T08:07:29.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:28 smithi203 ceph-mon[35198]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T08:07:29.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:28 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:07:29.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:29 smithi155 ceph-mon[35362]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T08:07:29.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:29 smithi155 ceph-mon[35362]: from='client.? 172.21.15.155:0/1629564621' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7f4c9da-d913-47a5-8629-53de21efe8c5"}]: dispatch 2024-09-19T08:07:29.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:29 smithi155 ceph-mon[35362]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7f4c9da-d913-47a5-8629-53de21efe8c5"}]: dispatch 2024-09-19T08:07:29.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:29 smithi155 ceph-mon[35362]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7f4c9da-d913-47a5-8629-53de21efe8c5"}]': finished 2024-09-19T08:07:29.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:29 smithi155 ceph-mon[35362]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T08:07:29.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:29 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:07:30.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:29 smithi027 ceph-mon[31209]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T08:07:30.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:29 smithi027 ceph-mon[31209]: from='client.? 172.21.15.155:0/1629564621' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7f4c9da-d913-47a5-8629-53de21efe8c5"}]: dispatch 2024-09-19T08:07:30.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:29 smithi027 ceph-mon[31209]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7f4c9da-d913-47a5-8629-53de21efe8c5"}]: dispatch 2024-09-19T08:07:30.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:29 smithi027 ceph-mon[31209]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7f4c9da-d913-47a5-8629-53de21efe8c5"}]': finished 2024-09-19T08:07:30.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:29 smithi027 ceph-mon[31209]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T08:07:30.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:29 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:07:30.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:29 smithi203 ceph-mon[35198]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T08:07:30.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:29 smithi203 ceph-mon[35198]: from='client.? 172.21.15.155:0/1629564621' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7f4c9da-d913-47a5-8629-53de21efe8c5"}]: dispatch 2024-09-19T08:07:30.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:29 smithi203 ceph-mon[35198]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7f4c9da-d913-47a5-8629-53de21efe8c5"}]: dispatch 2024-09-19T08:07:30.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:29 smithi203 ceph-mon[35198]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7f4c9da-d913-47a5-8629-53de21efe8c5"}]': finished 2024-09-19T08:07:30.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:29 smithi203 ceph-mon[35198]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T08:07:30.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:29 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:07:30.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:30 smithi155 ceph-mon[35362]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:30.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:30 smithi155 ceph-mon[35362]: from='client.? 172.21.15.155:0/4290693739' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:07:31.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:30 smithi027 ceph-mon[31209]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:31.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:30 smithi027 ceph-mon[31209]: from='client.? 172.21.15.155:0/4290693739' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:07:31.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:30 smithi203 ceph-mon[35198]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:31.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:30 smithi203 ceph-mon[35198]: from='client.? 172.21.15.155:0/4290693739' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:07:32.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:32 smithi155 ceph-mon[35362]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:33.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:32 smithi027 ceph-mon[31209]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:33.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:32 smithi203 ceph-mon[35198]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:34.838 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:34 smithi155 ceph-mon[35362]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:35.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:34 smithi027 ceph-mon[31209]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:35.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:34 smithi203 ceph-mon[35198]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:36.861 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:36 smithi155 ceph-mon[35362]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:37.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:36 smithi027 ceph-mon[31209]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:37.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:36 smithi203 ceph-mon[35198]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:38.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:37 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T08:07:38.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:37 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:38.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:37 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T08:07:38.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:37 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:38.073 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:37 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T08:07:38.073 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:37 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:39.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:38 smithi027 ceph-mon[31209]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:39.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:38 smithi027 ceph-mon[31209]: Deploying daemon osd.10 on smithi155 2024-09-19T08:07:39.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:38 smithi203 ceph-mon[35198]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:39.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:38 smithi203 ceph-mon[35198]: Deploying daemon osd.10 on smithi155 2024-09-19T08:07:39.069 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:38 smithi155 ceph-mon[35362]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:39.069 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:38 smithi155 ceph-mon[35362]: Deploying daemon osd.10 on smithi155 2024-09-19T08:07:40.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:40 smithi155 ceph-mon[35362]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:41.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:40 smithi027 ceph-mon[31209]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:40 smithi203 ceph-mon[35198]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:42.844 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:42 smithi155 ceph-mon[35362]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:43.004 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:42 smithi027 ceph-mon[31209]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:43.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:42 smithi203 ceph-mon[35198]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:44.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:43 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:07:44.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:43 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:44.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:43 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:44.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:43 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:07:44.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:43 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:44.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:43 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:44.092 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:43 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:07:44.093 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:43 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:44.093 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:43 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:45.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:44 smithi203 ceph-mon[35198]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:45.119 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:44 smithi155 ceph-mon[35362]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:45.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:44 smithi027 ceph-mon[31209]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:46.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:46 smithi155 ceph-mon[35362]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:46.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:46 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:46.851 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:46 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:46.851 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:46 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:46.851 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:46 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:07:46.851 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:46 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:46.891 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 10 on host 'smithi155' 2024-09-19T08:07:46.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:46.891+0000 7fe320ff9640 1 -- 172.21.15.155:0/1748615715 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fe324062630 con 0x7fe3100a32f0 2024-09-19T08:07:46.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:46.893+0000 7fe329ce0640 1 -- 172.21.15.155:0/1748615715 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe3100a32f0 msgr2=0x7fe3100a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:07:46.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:46.893+0000 7fe329ce0640 1 --2- 172.21.15.155:0/1748615715 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe3100a32f0 0x7fe3100a57b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe324199410 tx=0x7fe31400b590 comp rx=0 tx=0).stop 2024-09-19T08:07:46.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:46.893+0000 7fe329ce0640 1 -- 172.21.15.155:0/1748615715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3241026a0 msgr2=0x7fe324197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:07:46.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:46.893+0000 7fe329ce0640 1 --2- 172.21.15.155:0/1748615715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3241026a0 0x7fe324197ef0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00c970 tx=0x7fe30c00ce30 comp rx=0 tx=0).stop 2024-09-19T08:07:46.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:46.893+0000 7fe329ce0640 1 -- 172.21.15.155:0/1748615715 shutdown_connections 2024-09-19T08:07:46.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:46.893+0000 7fe329ce0640 1 --2- 172.21.15.155:0/1748615715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe324107900 0x7fe32419f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:46.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:46.893+0000 7fe329ce0640 1 --2- 172.21.15.155:0/1748615715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe324104fd0 0x7fe324198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:46.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:46.893+0000 7fe329ce0640 1 --2- 172.21.15.155:0/1748615715 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe3100a32f0 0x7fe3100a57b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:46.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:46.893+0000 7fe329ce0640 1 --2- 172.21.15.155:0/1748615715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3241026a0 0x7fe324197ef0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:46.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:46.893+0000 7fe329ce0640 1 -- 172.21.15.155:0/1748615715 >> 172.21.15.155:0/1748615715 conn(0x7fe3240fc2a0 msgr2=0x7fe324102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:07:46.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:46.894+0000 7fe329ce0640 1 -- 172.21.15.155:0/1748615715 shutdown_connections 2024-09-19T08:07:46.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:07:46.894+0000 7fe329ce0640 1 -- 172.21.15.155:0/1748615715 wait complete. 2024-09-19T08:07:47.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:46 smithi203 ceph-mon[35198]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:47.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:46 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:47.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:46 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:47.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:46 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:47.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:46 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:07:47.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:46 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:47.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:46 smithi027 ceph-mon[31209]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:47.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:46 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:47.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:46 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:47.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:46 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:47.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:46 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:07:47.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:46 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:47.516 DEBUG:teuthology.orchestra.run.smithi155:osd.10> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T08:07:47.518 INFO:tasks.cephadm:Deploying osd.11 on smithi203 with /dev/vg_nvme/lv_1... 2024-09-19T08:07:47.519 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T08:07:47.776 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:07:47.897 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:47 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:07:47.897 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:47 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:47.897 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:47 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:48.017 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:47 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:07:48.017 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:47 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:48.017 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:47 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:48.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:47 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:07:48.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:47 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:48.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:47 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:48.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:48 smithi155 ceph-mon[35362]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:49.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:48 smithi203 ceph-mon[35198]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:49.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:48 smithi027 ceph-mon[31209]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:49.487 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:07:49 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:07:49.194+0000 7f8780d59640 -1 osd.10 0 log_to_monitors true 2024-09-19T08:07:50.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:49 smithi203 ceph-mon[35198]: from='osd.10 [v2:172.21.15.155:6824/1687418565,v1:172.21.15.155:6825/1687418565]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:07:50.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:49 smithi203 ceph-mon[35198]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:07:50.160 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:49 smithi155 ceph-mon[35362]: from='osd.10 [v2:172.21.15.155:6824/1687418565,v1:172.21.15.155:6825/1687418565]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:07:50.161 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:49 smithi155 ceph-mon[35362]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:07:50.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:49 smithi027 ceph-mon[31209]: from='osd.10 [v2:172.21.15.155:6824/1687418565,v1:172.21.15.155:6825/1687418565]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:07:50.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:49 smithi027 ceph-mon[31209]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:07:50.520 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:07:50.548 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_1 2024-09-19T08:07:50.803 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:07:51.034 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:50 smithi203 ceph-mon[35198]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:51.034 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:50 smithi203 ceph-mon[35198]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T08:07:51.034 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:50 smithi203 ceph-mon[35198]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T08:07:51.034 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:50 smithi203 ceph-mon[35198]: from='osd.10 [v2:172.21.15.155:6824/1687418565,v1:172.21.15.155:6825/1687418565]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:07:51.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:50 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:07:51.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:50 smithi203 ceph-mon[35198]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:07:51.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:50 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:51.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:50 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:51.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:50 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:51.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:50 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:51.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:50 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:51.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:50 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:51.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:50 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:51.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:50 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:51.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:50 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:07:51.035 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:50 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:51.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:07:50 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:07:50.781+0000 7f877ccdc640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T08:07:51.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:07:50 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:07:50.792+0000 7f8778b04640 -1 osd.10 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:07:51.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:50 smithi155 ceph-mon[35362]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:51.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:50 smithi155 ceph-mon[35362]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T08:07:51.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:50 smithi155 ceph-mon[35362]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T08:07:51.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:50 smithi155 ceph-mon[35362]: from='osd.10 [v2:172.21.15.155:6824/1687418565,v1:172.21.15.155:6825/1687418565]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:07:51.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:50 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:07:51.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:50 smithi155 ceph-mon[35362]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:07:51.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:50 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:51.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:50 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:51.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:50 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:51.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:50 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:51.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:50 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:51.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:50 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:51.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:50 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:51.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:50 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:51.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:50 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:07:51.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:50 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:51.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:50 smithi027 ceph-mon[31209]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:51.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:50 smithi027 ceph-mon[31209]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T08:07:51.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:50 smithi027 ceph-mon[31209]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T08:07:51.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:50 smithi027 ceph-mon[31209]: from='osd.10 [v2:172.21.15.155:6824/1687418565,v1:172.21.15.155:6825/1687418565]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:07:51.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:50 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:07:51.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:50 smithi027 ceph-mon[31209]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:07:51.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:50 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:51.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:50 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:51.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:50 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:51.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:50 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:51.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:50 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:51.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:50 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:07:51.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:50 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:51.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:50 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:51.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:50 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:07:51.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:50 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:07:51.316 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.300+0000 7f7064899640 1 -- 172.21.15.203:0/4171886946 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7060101cd0 msgr2=0x7f7060102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:07:51.317 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.300+0000 7f7064899640 1 --2- 172.21.15.203:0/4171886946 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7060101cd0 0x7f7060102150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7048009900 tx=0x7f704802a410 comp rx=0 tx=0).stop 2024-09-19T08:07:51.317 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.300+0000 7f7064899640 1 -- 172.21.15.203:0/4171886946 shutdown_connections 2024-09-19T08:07:51.317 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.300+0000 7f7064899640 1 --2- 172.21.15.203:0/4171886946 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7060102690 0x7f7060108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:51.317 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.300+0000 7f7064899640 1 --2- 172.21.15.203:0/4171886946 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7060101cd0 0x7f7060102150 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:51.317 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.300+0000 7f7064899640 1 --2- 172.21.15.203:0/4171886946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7060100ad0 0x7f7060100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:51.317 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.300+0000 7f7064899640 1 -- 172.21.15.203:0/4171886946 >> 172.21.15.203:0/4171886946 conn(0x7f70600fc280 msgr2=0x7f70600fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:07:51.317 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.300+0000 7f7064899640 1 -- 172.21.15.203:0/4171886946 shutdown_connections 2024-09-19T08:07:51.317 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.300+0000 7f7064899640 1 -- 172.21.15.203:0/4171886946 wait complete. 2024-09-19T08:07:51.317 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.301+0000 7f7064899640 1 Processor -- start 2024-09-19T08:07:51.317 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.301+0000 7f7064899640 1 -- start start 2024-09-19T08:07:51.317 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.301+0000 7f7064899640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7060100ad0 0x7f7060104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:07:51.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.301+0000 7f7064899640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7060101cd0 0x7f70601030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:07:51.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.301+0000 7f7064899640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7060102690 0x7f70601035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:07:51.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.301+0000 7f7064899640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f706010c750 con 0x7f7060101cd0 2024-09-19T08:07:51.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.301+0000 7f7064899640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f706010c5d0 con 0x7f7060100ad0 2024-09-19T08:07:51.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.301+0000 7f7064899640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f706010c8d0 con 0x7f7060102690 2024-09-19T08:07:51.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.301+0000 7f705ed9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7060102690 0x7f70601035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:07:51.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.301+0000 7f705e59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7060100ad0 0x7f7060104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:07:51.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.301+0000 7f705ed9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7060102690 0x7f70601035f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:54990/0 (socket says 172.21.15.203:54990) 2024-09-19T08:07:51.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.301+0000 7f705ed9d640 1 -- 172.21.15.203:0/3563756318 learned_addr learned my addr 172.21.15.203:0/3563756318 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:07:51.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.301+0000 7f705dd9b640 1 --2- 172.21.15.203:0/3563756318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7060101cd0 0x7f70601030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:07:51.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.302+0000 7f705e59c640 1 -- 172.21.15.203:0/3563756318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7060102690 msgr2=0x7f70601035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:07:51.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.302+0000 7f705e59c640 1 --2- 172.21.15.203:0/3563756318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7060102690 0x7f70601035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:51.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.302+0000 7f705e59c640 1 -- 172.21.15.203:0/3563756318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7060101cd0 msgr2=0x7f70601030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:07:51.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.302+0000 7f705e59c640 1 --2- 172.21.15.203:0/3563756318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7060101cd0 0x7f70601030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:07:51.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.302+0000 7f705e59c640 1 -- 172.21.15.203:0/3563756318 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7060103eb0 con 0x7f7060100ad0 2024-09-19T08:07:51.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.302+0000 7f705ed9d640 1 --2- 172.21.15.203:0/3563756318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7060102690 0x7f70601035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:07:51.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.302+0000 7f705e59c640 1 --2- 172.21.15.203:0/3563756318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7060100ad0 0x7f7060104a60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7060101b30 tx=0x7f705000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:07:51.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.302+0000 7f70577fe640 1 -- 172.21.15.203:0/3563756318 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7050003d80 con 0x7f7060100ad0 2024-09-19T08:07:51.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.302+0000 7f7064899640 1 -- 172.21.15.203:0/3563756318 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70601a20d0 con 0x7f7060100ad0 2024-09-19T08:07:51.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.302+0000 7f70577fe640 1 -- 172.21.15.203:0/3563756318 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f705000ce20 con 0x7f7060100ad0 2024-09-19T08:07:51.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.302+0000 7f70577fe640 1 -- 172.21.15.203:0/3563756318 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70500116d0 con 0x7f7060100ad0 2024-09-19T08:07:51.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.302+0000 7f7064899640 1 -- 172.21.15.203:0/3563756318 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70601a25e0 con 0x7f7060100ad0 2024-09-19T08:07:51.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.303+0000 7f7064899640 1 -- 172.21.15.203:0/3563756318 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70601a2870 con 0x7f7060100ad0 2024-09-19T08:07:51.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.304+0000 7f70577fe640 1 -- 172.21.15.203:0/3563756318 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7050004270 con 0x7f7060100ad0 2024-09-19T08:07:51.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.306+0000 7f70577fe640 1 --2- 172.21.15.203:0/3563756318 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f704c0a3240 0x7f704c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:07:51.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.306+0000 7f70577fe640 1 -- 172.21.15.203:0/3563756318 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6414+0+0 (secure 0 0 0) 0x7f70500cf620 con 0x7f7060100ad0 2024-09-19T08:07:51.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.306+0000 7f705dd9b640 1 --2- 172.21.15.203:0/3563756318 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f704c0a3240 0x7f704c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:07:51.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.307+0000 7f705dd9b640 1 --2- 172.21.15.203:0/3563756318 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f704c0a3240 0x7f704c0a5700 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f70480314e0 tx=0x7f7048000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:07:51.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.309+0000 7f70577fe640 1 -- 172.21.15.203:0/3563756318 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7050015030 con 0x7f7060100ad0 2024-09-19T08:07:51.490 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:07:51.490+0000 7f7064899640 1 -- 172.21.15.203:0/3563756318 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f706006a730 con 0x7f704c0a3240 2024-09-19T08:07:52.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:51 smithi203 ceph-mon[35198]: Detected new or changed devices on smithi155 2024-09-19T08:07:52.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:51 smithi203 ceph-mon[35198]: Adjusting osd_memory_target on smithi155 to 4272M 2024-09-19T08:07:52.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:51 smithi203 ceph-mon[35198]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:07:52.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:51 smithi203 ceph-mon[35198]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T08:07:52.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:51 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:07:52.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:51 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:07:52.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:51 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:07:52.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:51 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:07:52.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:51 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:52.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:51 smithi203 ceph-mon[35198]: osd.10 [v2:172.21.15.155:6824/1687418565,v1:172.21.15.155:6825/1687418565] boot 2024-09-19T08:07:52.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:51 smithi203 ceph-mon[35198]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T08:07:52.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:51 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:07:52.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:51 smithi155 ceph-mon[35362]: Detected new or changed devices on smithi155 2024-09-19T08:07:52.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:51 smithi155 ceph-mon[35362]: Adjusting osd_memory_target on smithi155 to 4272M 2024-09-19T08:07:52.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:51 smithi155 ceph-mon[35362]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:07:52.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:51 smithi155 ceph-mon[35362]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T08:07:52.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:51 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:07:52.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:51 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:07:52.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:51 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:07:52.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:51 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:07:52.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:51 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:52.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:51 smithi155 ceph-mon[35362]: osd.10 [v2:172.21.15.155:6824/1687418565,v1:172.21.15.155:6825/1687418565] boot 2024-09-19T08:07:52.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:51 smithi155 ceph-mon[35362]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T08:07:52.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:51 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:07:52.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:51 smithi027 ceph-mon[31209]: Detected new or changed devices on smithi155 2024-09-19T08:07:52.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:51 smithi027 ceph-mon[31209]: Adjusting osd_memory_target on smithi155 to 4272M 2024-09-19T08:07:52.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:51 smithi027 ceph-mon[31209]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:07:52.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:51 smithi027 ceph-mon[31209]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T08:07:52.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:51 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:07:52.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:51 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:07:52.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:51 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:07:52.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:51 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:07:52.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:51 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:07:52.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:51 smithi027 ceph-mon[31209]: osd.10 [v2:172.21.15.155:6824/1687418565,v1:172.21.15.155:6825/1687418565] boot 2024-09-19T08:07:52.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:51 smithi027 ceph-mon[31209]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T08:07:52.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:51 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:07:53.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:52 smithi203 ceph-mon[35198]: purged_snaps scrub starts 2024-09-19T08:07:53.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:52 smithi203 ceph-mon[35198]: purged_snaps scrub ok 2024-09-19T08:07:53.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:52 smithi203 ceph-mon[35198]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:53.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:52 smithi203 ceph-mon[35198]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:07:53.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:52 smithi203 ceph-mon[35198]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T08:07:53.138 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:52 smithi155 ceph-mon[35362]: purged_snaps scrub starts 2024-09-19T08:07:53.139 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:52 smithi155 ceph-mon[35362]: purged_snaps scrub ok 2024-09-19T08:07:53.139 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:52 smithi155 ceph-mon[35362]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:53.139 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:52 smithi155 ceph-mon[35362]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:07:53.139 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:52 smithi155 ceph-mon[35362]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T08:07:53.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:52 smithi027 ceph-mon[31209]: purged_snaps scrub starts 2024-09-19T08:07:53.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:52 smithi027 ceph-mon[31209]: purged_snaps scrub ok 2024-09-19T08:07:53.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:52 smithi027 ceph-mon[31209]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:07:53.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:52 smithi027 ceph-mon[31209]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:07:53.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:52 smithi027 ceph-mon[31209]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T08:07:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:54 smithi155 ceph-mon[35362]: pgmap v229: 1 pgs: 1 peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:07:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:54 smithi155 ceph-mon[35362]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T08:07:55.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:54 smithi155 ceph-mon[35362]: from='client.? 172.21.15.203:0/1289041110' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45c11a90-585e-46fa-a5a0-51a29e29eba0"}]: dispatch 2024-09-19T08:07:55.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:54 smithi155 ceph-mon[35362]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45c11a90-585e-46fa-a5a0-51a29e29eba0"}]: dispatch 2024-09-19T08:07:55.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:54 smithi155 ceph-mon[35362]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "45c11a90-585e-46fa-a5a0-51a29e29eba0"}]': finished 2024-09-19T08:07:55.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:54 smithi155 ceph-mon[35362]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T08:07:55.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:54 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:07:55.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:54 smithi027 ceph-mon[31209]: pgmap v229: 1 pgs: 1 peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:07:55.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:54 smithi027 ceph-mon[31209]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T08:07:55.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:54 smithi027 ceph-mon[31209]: from='client.? 172.21.15.203:0/1289041110' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45c11a90-585e-46fa-a5a0-51a29e29eba0"}]: dispatch 2024-09-19T08:07:55.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:54 smithi027 ceph-mon[31209]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45c11a90-585e-46fa-a5a0-51a29e29eba0"}]: dispatch 2024-09-19T08:07:55.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:54 smithi027 ceph-mon[31209]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "45c11a90-585e-46fa-a5a0-51a29e29eba0"}]': finished 2024-09-19T08:07:55.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:54 smithi027 ceph-mon[31209]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T08:07:55.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:54 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:07:55.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:54 smithi203 ceph-mon[35198]: pgmap v229: 1 pgs: 1 peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:07:55.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:54 smithi203 ceph-mon[35198]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T08:07:55.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:54 smithi203 ceph-mon[35198]: from='client.? 172.21.15.203:0/1289041110' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45c11a90-585e-46fa-a5a0-51a29e29eba0"}]: dispatch 2024-09-19T08:07:55.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:54 smithi203 ceph-mon[35198]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45c11a90-585e-46fa-a5a0-51a29e29eba0"}]: dispatch 2024-09-19T08:07:55.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:54 smithi203 ceph-mon[35198]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "45c11a90-585e-46fa-a5a0-51a29e29eba0"}]': finished 2024-09-19T08:07:55.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:54 smithi203 ceph-mon[35198]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T08:07:55.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:54 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:07:56.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:55 smithi155 ceph-mon[35362]: from='client.? 172.21.15.203:0/4074632109' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:07:56.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:55 smithi155 ceph-mon[35362]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T08:07:56.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:07:56.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:55 smithi027 ceph-mon[31209]: from='client.? 172.21.15.203:0/4074632109' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:07:56.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:55 smithi027 ceph-mon[31209]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T08:07:56.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:55 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:07:56.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:55 smithi203 ceph-mon[35198]: from='client.? 172.21.15.203:0/4074632109' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:07:56.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:55 smithi203 ceph-mon[35198]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T08:07:56.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:55 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:07:57.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:56 smithi155 ceph-mon[35362]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:07:57.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:56 smithi027 ceph-mon[31209]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:07:57.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:56 smithi203 ceph-mon[35198]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:07:59.138 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:07:58 smithi203 ceph-mon[35198]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-09-19T08:07:59.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:07:58 smithi155 ceph-mon[35362]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-09-19T08:07:59.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:07:58 smithi027 ceph-mon[31209]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-09-19T08:08:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:00 smithi203 ceph-mon[35198]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:08:01.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:00 smithi155 ceph-mon[35362]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:08:01.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:00 smithi027 ceph-mon[31209]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:08:03.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:02 smithi203 ceph-mon[35198]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-19T08:08:03.053 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:02 smithi027 ceph-mon[31209]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-19T08:08:03.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:02 smithi155 ceph-mon[35362]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-19T08:08:04.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:03 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T08:08:04.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:03 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:04.068 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:03 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T08:08:04.069 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:03 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:04.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:03 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T08:08:04.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:03 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:05.046 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:04 smithi203 ceph-mon[35198]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-19T08:08:05.046 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:04 smithi203 ceph-mon[35198]: Deploying daemon osd.11 on smithi203 2024-09-19T08:08:05.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:04 smithi155 ceph-mon[35362]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-19T08:08:05.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:04 smithi155 ceph-mon[35362]: Deploying daemon osd.11 on smithi203 2024-09-19T08:08:05.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:04 smithi027 ceph-mon[31209]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-19T08:08:05.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:04 smithi027 ceph-mon[31209]: Deploying daemon osd.11 on smithi203 2024-09-19T08:08:06.850 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:06 smithi203 ceph-mon[35198]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:08:07.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:06 smithi155 ceph-mon[35362]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:08:07.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:06 smithi027 ceph-mon[31209]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:08:09.126 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:08 smithi203 ceph-mon[35198]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T08:08:09.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:08 smithi155 ceph-mon[35362]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T08:08:09.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:08 smithi027 ceph-mon[31209]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T08:08:09.930 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:09 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:08:09.931 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:09 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:09.931 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:09 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:10.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:09 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:08:10.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:09 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:10.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:09 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:10.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:09 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:08:10.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:09 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:10.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:09 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:10.988 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:10 smithi203 ceph-mon[35198]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:08:11.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:10 smithi155 ceph-mon[35362]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:08:11.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:10 smithi027 ceph-mon[31209]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:08:12.610 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:12.610+0000 7f70577fe640 1 -- 172.21.15.203:0/3563756318 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f706006a730 con 0x7f704c0a3240 2024-09-19T08:08:12.611 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 11 on host 'smithi203' 2024-09-19T08:08:12.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:12.613+0000 7f7064899640 1 -- 172.21.15.203:0/3563756318 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f704c0a3240 msgr2=0x7f704c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:12.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:12.613+0000 7f7064899640 1 --2- 172.21.15.203:0/3563756318 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f704c0a3240 0x7f704c0a5700 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f70480314e0 tx=0x7f7048000bc0 comp rx=0 tx=0).stop 2024-09-19T08:08:12.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:12.613+0000 7f7064899640 1 -- 172.21.15.203:0/3563756318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7060100ad0 msgr2=0x7f7060104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:12.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:12.613+0000 7f7064899640 1 --2- 172.21.15.203:0/3563756318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7060100ad0 0x7f7060104a60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7060101b30 tx=0x7f705000ee80 comp rx=0 tx=0).stop 2024-09-19T08:08:12.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:12.613+0000 7f7064899640 1 -- 172.21.15.203:0/3563756318 shutdown_connections 2024-09-19T08:08:12.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:12.613+0000 7f7064899640 1 --2- 172.21.15.203:0/3563756318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7060102690 0x7f70601035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:12.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:12.613+0000 7f7064899640 1 --2- 172.21.15.203:0/3563756318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7060101cd0 0x7f70601030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:12.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:12.613+0000 7f7064899640 1 --2- 172.21.15.203:0/3563756318 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f704c0a3240 0x7f704c0a5700 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:12.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:12.613+0000 7f7064899640 1 --2- 172.21.15.203:0/3563756318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7060100ad0 0x7f7060104a60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:12.614 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:12.613+0000 7f7064899640 1 -- 172.21.15.203:0/3563756318 >> 172.21.15.203:0/3563756318 conn(0x7f70600fc280 msgr2=0x7f706006a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:12.614 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:12.613+0000 7f7064899640 1 -- 172.21.15.203:0/3563756318 shutdown_connections 2024-09-19T08:08:12.614 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:12.613+0000 7f7064899640 1 -- 172.21.15.203:0/3563756318 wait complete. 2024-09-19T08:08:13.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:12 smithi155 ceph-mon[35362]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:08:13.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:12 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:13.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:12 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:13.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:12 smithi027 ceph-mon[31209]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:08:13.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:12 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:13.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:12 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:13.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:12 smithi203 ceph-mon[35198]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:08:13.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:12 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:13.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:12 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:13.350 DEBUG:teuthology.orchestra.run.smithi203:osd.11> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T08:08:13.353 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T08:08:13.353 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:08:13.625 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:08:14.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.112+0000 7f8a692c8640 1 -- 172.21.15.27:0/3484591389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a64101c00 msgr2=0x7f8a64102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:14.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.112+0000 7f8a692c8640 1 --2- 172.21.15.27:0/3484591389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a64101c00 0x7f8a64102000 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8a54009900 tx=0x7f8a5402a410 comp rx=0 tx=0).stop 2024-09-19T08:08:14.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.112+0000 7f8a692c8640 1 -- 172.21.15.27:0/3484591389 shutdown_connections 2024-09-19T08:08:14.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.112+0000 7f8a692c8640 1 --2- 172.21.15.27:0/3484591389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a641037c0 0x7f8a6410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:14.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.112+0000 7f8a692c8640 1 --2- 172.21.15.27:0/3484591389 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a64102e00 0x7f8a64103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:14.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.112+0000 7f8a692c8640 1 --2- 172.21.15.27:0/3484591389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a64101c00 0x7f8a64102000 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:14.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.112+0000 7f8a692c8640 1 -- 172.21.15.27:0/3484591389 >> 172.21.15.27:0/3484591389 conn(0x7f8a640fd390 msgr2=0x7f8a640ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:14.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.112+0000 7f8a692c8640 1 -- 172.21.15.27:0/3484591389 shutdown_connections 2024-09-19T08:08:14.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.112+0000 7f8a692c8640 1 -- 172.21.15.27:0/3484591389 wait complete. 2024-09-19T08:08:14.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.113+0000 7f8a692c8640 1 Processor -- start 2024-09-19T08:08:14.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.113+0000 7f8a692c8640 1 -- start start 2024-09-19T08:08:14.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.113+0000 7f8a692c8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a64101c00 0x7f8a64075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:14.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.113+0000 7f8a692c8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a64102e00 0x7f8a640745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:14.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.113+0000 7f8a692c8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a641037c0 0x7f8a64074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:14.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.113+0000 7f8a692c8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6410d8e0 con 0x7f8a641037c0 2024-09-19T08:08:14.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.113+0000 7f8a692c8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6410d760 con 0x7f8a64102e00 2024-09-19T08:08:14.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.113+0000 7f8a692c8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6410da60 con 0x7f8a64101c00 2024-09-19T08:08:14.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.113+0000 7f8a637fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a641037c0 0x7f8a64074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:14.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.113+0000 7f8a637fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a641037c0 0x7f8a64074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37890/0 (socket says 172.21.15.27:37890) 2024-09-19T08:08:14.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.113+0000 7f8a62ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a64101c00 0x7f8a64075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:14.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.113+0000 7f8a637fe640 1 -- 172.21.15.27:0/4062448122 learned_addr learned my addr 172.21.15.27:0/4062448122 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:08:14.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.113+0000 7f8a627fc640 1 --2- 172.21.15.27:0/4062448122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a64102e00 0x7f8a640745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:14.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.114+0000 7f8a637fe640 1 -- 172.21.15.27:0/4062448122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a64101c00 msgr2=0x7f8a64075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:14.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.114+0000 7f8a637fe640 1 --2- 172.21.15.27:0/4062448122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a64101c00 0x7f8a64075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:14.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.114+0000 7f8a637fe640 1 -- 172.21.15.27:0/4062448122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a64102e00 msgr2=0x7f8a640745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:14.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.114+0000 7f8a637fe640 1 --2- 172.21.15.27:0/4062448122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a64102e00 0x7f8a640745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:14.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.114+0000 7f8a637fe640 1 -- 172.21.15.27:0/4062448122 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a640753e0 con 0x7f8a641037c0 2024-09-19T08:08:14.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.114+0000 7f8a62ffd640 1 --2- 172.21.15.27:0/4062448122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a64101c00 0x7f8a64075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:08:14.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.114+0000 7f8a637fe640 1 --2- 172.21.15.27:0/4062448122 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a641037c0 0x7f8a64074b20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c00b970 tx=0x7f8a5c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:14.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.114+0000 7f8a4bfff640 1 -- 172.21.15.27:0/4062448122 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c019070 con 0x7f8a641037c0 2024-09-19T08:08:14.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.114+0000 7f8a692c8640 1 -- 172.21.15.27:0/4062448122 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a641a2090 con 0x7f8a641037c0 2024-09-19T08:08:14.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.114+0000 7f8a4bfff640 1 -- 172.21.15.27:0/4062448122 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a5c014440 con 0x7f8a641037c0 2024-09-19T08:08:14.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.114+0000 7f8a4bfff640 1 -- 172.21.15.27:0/4062448122 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0075d0 con 0x7f8a641037c0 2024-09-19T08:08:14.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.114+0000 7f8a692c8640 1 -- 172.21.15.27:0/4062448122 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a641a2620 con 0x7f8a641037c0 2024-09-19T08:08:14.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.115+0000 7f8a692c8640 1 -- 172.21.15.27:0/4062448122 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a64109000 con 0x7f8a641037c0 2024-09-19T08:08:14.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.116+0000 7f8a4bfff640 1 -- 172.21.15.27:0/4062448122 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8a5c01c070 con 0x7f8a641037c0 2024-09-19T08:08:14.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.117+0000 7f8a4bfff640 1 --2- 172.21.15.27:0/4062448122 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8a4c0a3240 0x7f8a4c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:14.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.117+0000 7f8a62ffd640 1 --2- 172.21.15.27:0/4062448122 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8a4c0a3240 0x7f8a4c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:14.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.117+0000 7f8a4bfff640 1 -- 172.21.15.27:0/4062448122 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6809+0+0 (secure 0 0 0) 0x7f8a5c0cece0 con 0x7f8a641037c0 2024-09-19T08:08:14.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.117+0000 7f8a62ffd640 1 --2- 172.21.15.27:0/4062448122 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8a4c0a3240 0x7f8a4c0a5700 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8a54005ab0 tx=0x7f8a54000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:14.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.120+0000 7f8a4bfff640 1 -- 172.21.15.27:0/4062448122 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8a5c09b990 con 0x7f8a641037c0 2024-09-19T08:08:14.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.295+0000 7f8a692c8640 1 -- 172.21.15.27:0/4062448122 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f8a64062df0 con 0x7f8a641037c0 2024-09-19T08:08:14.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.295+0000 7f8a4bfff640 1 -- 172.21.15.27:0/4062448122 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f8a5c09fc90 con 0x7f8a641037c0 2024-09-19T08:08:14.295 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:08:14.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.297+0000 7f8a692c8640 1 -- 172.21.15.27:0/4062448122 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8a4c0a3240 msgr2=0x7f8a4c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:14.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.297+0000 7f8a692c8640 1 --2- 172.21.15.27:0/4062448122 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8a4c0a3240 0x7f8a4c0a5700 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8a54005ab0 tx=0x7f8a54000bc0 comp rx=0 tx=0).stop 2024-09-19T08:08:14.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.297+0000 7f8a692c8640 1 -- 172.21.15.27:0/4062448122 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a641037c0 msgr2=0x7f8a64074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:14.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.297+0000 7f8a692c8640 1 --2- 172.21.15.27:0/4062448122 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a641037c0 0x7f8a64074b20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c00b970 tx=0x7f8a5c00bd70 comp rx=0 tx=0).stop 2024-09-19T08:08:14.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.297+0000 7f8a692c8640 1 -- 172.21.15.27:0/4062448122 shutdown_connections 2024-09-19T08:08:14.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.297+0000 7f8a692c8640 1 --2- 172.21.15.27:0/4062448122 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a641037c0 0x7f8a64074b20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:14.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.297+0000 7f8a692c8640 1 --2- 172.21.15.27:0/4062448122 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8a4c0a3240 0x7f8a4c0a5700 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:14.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.297+0000 7f8a692c8640 1 --2- 172.21.15.27:0/4062448122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a64102e00 0x7f8a640745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:14.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.297+0000 7f8a692c8640 1 --2- 172.21.15.27:0/4062448122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a64101c00 0x7f8a64075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:14.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.297+0000 7f8a692c8640 1 -- 172.21.15.27:0/4062448122 >> 172.21.15.27:0/4062448122 conn(0x7f8a640fd390 msgr2=0x7f8a641061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:14.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.298+0000 7f8a692c8640 1 -- 172.21.15.27:0/4062448122 shutdown_connections 2024-09-19T08:08:14.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:14.298+0000 7f8a692c8640 1 -- 172.21.15.27:0/4062448122 wait complete. 2024-09-19T08:08:14.545 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:14 smithi027 ceph-mon[31209]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:08:14.545 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:14.545 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:14.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:14 smithi203 ceph-mon[35198]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:08:14.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:14.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:14.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:14 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/4062448122' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:08:14.829 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:14 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/4062448122' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:08:14.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:14 smithi155 ceph-mon[35362]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:08:14.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:14.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:14.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:14 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/4062448122' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:08:15.165 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1726733271,"num_in_osds":12,"osd_in_since":1726733274,"num_remapped_pgs":0} 2024-09-19T08:08:15.493 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:08:15 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:08:15.214+0000 7f7338d5e640 -1 osd.11 0 log_to_monitors true 2024-09-19T08:08:15.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:15 smithi027 ceph-mon[31209]: from='osd.11 [v2:172.21.15.203:6824/224768827,v1:172.21.15.203:6825/224768827]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:08:15.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:15 smithi027 ceph-mon[31209]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:08:15.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:15 smithi203 ceph-mon[35198]: from='osd.11 [v2:172.21.15.203:6824/224768827,v1:172.21.15.203:6825/224768827]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:08:15.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:15 smithi203 ceph-mon[35198]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:08:15.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:15 smithi155 ceph-mon[35362]: from='osd.11 [v2:172.21.15.203:6824/224768827,v1:172.21.15.203:6825/224768827]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:08:15.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:15 smithi155 ceph-mon[35362]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:08:16.166 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:08:16.437 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:08:16.706 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:16 smithi203 ceph-mon[35198]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:08:16.706 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:16 smithi203 ceph-mon[35198]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T08:08:16.706 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:16 smithi203 ceph-mon[35198]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T08:08:16.706 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:16 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:08:16.707 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:16 smithi203 ceph-mon[35198]: from='osd.11 [v2:172.21.15.203:6824/224768827,v1:172.21.15.203:6825/224768827]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:08:16.707 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:16 smithi203 ceph-mon[35198]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:08:16.863 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:16 smithi027 ceph-mon[31209]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:08:16.863 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:16 smithi027 ceph-mon[31209]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T08:08:16.863 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:16 smithi027 ceph-mon[31209]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T08:08:16.863 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:16 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:08:16.863 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:16 smithi027 ceph-mon[31209]: from='osd.11 [v2:172.21.15.203:6824/224768827,v1:172.21.15.203:6825/224768827]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:08:16.863 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:16 smithi027 ceph-mon[31209]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:08:16.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.949+0000 7f41d4914640 1 -- 172.21.15.27:0/2439148261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41d0102660 msgr2=0x7f41d0104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:16.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.949+0000 7f41d4914640 1 --2- 172.21.15.27:0/2439148261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41d0102660 0x7f41d0104a50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009900 tx=0x7f41c002a410 comp rx=0 tx=0).stop 2024-09-19T08:08:16.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.949+0000 7f41d4914640 1 -- 172.21.15.27:0/2439148261 shutdown_connections 2024-09-19T08:08:16.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.949+0000 7f41d4914640 1 --2- 172.21.15.27:0/2439148261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41d01078c0 0x7f41d0109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:16.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.949+0000 7f41d4914640 1 --2- 172.21.15.27:0/2439148261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41d0104f90 0x7f41d0107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:16.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.949+0000 7f41d4914640 1 --2- 172.21.15.27:0/2439148261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41d0102660 0x7f41d0104a50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:16.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.949+0000 7f41d4914640 1 -- 172.21.15.27:0/2439148261 >> 172.21.15.27:0/2439148261 conn(0x7f41d00fc280 msgr2=0x7f41d00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:16.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.949+0000 7f41d4914640 1 -- 172.21.15.27:0/2439148261 shutdown_connections 2024-09-19T08:08:16.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.949+0000 7f41d4914640 1 -- 172.21.15.27:0/2439148261 wait complete. 2024-09-19T08:08:16.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.950+0000 7f41d4914640 1 Processor -- start 2024-09-19T08:08:16.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.950+0000 7f41d4914640 1 -- start start 2024-09-19T08:08:16.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.950+0000 7f41d4914640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41d0102660 0x7f41d0101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:16.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.950+0000 7f41d4914640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41d0104f90 0x7f41d0100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:16.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.950+0000 7f41d4914640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41d01078c0 0x7f41d0100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:16.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.950+0000 7f41d4914640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f41d010d870 con 0x7f41d0102660 2024-09-19T08:08:16.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.950+0000 7f41d4914640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f41d010d6f0 con 0x7f41d0104f90 2024-09-19T08:08:16.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.950+0000 7f41d4914640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f41d010d9f0 con 0x7f41d01078c0 2024-09-19T08:08:16.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.950+0000 7f41ce59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41d0102660 0x7f41d0101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:16.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.950+0000 7f41ce59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41d0102660 0x7f41d0101fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37910/0 (socket says 172.21.15.27:37910) 2024-09-19T08:08:16.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.950+0000 7f41ce59c640 1 -- 172.21.15.27:0/120013178 learned_addr learned my addr 172.21.15.27:0/120013178 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:08:16.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.950+0000 7f41ced9d640 1 --2- 172.21.15.27:0/120013178 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41d01078c0 0x7f41d0100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:16.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.950+0000 7f41cdd9b640 1 --2- 172.21.15.27:0/120013178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41d0104f90 0x7f41d0100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:16.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.951+0000 7f41ce59c640 1 -- 172.21.15.27:0/120013178 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41d01078c0 msgr2=0x7f41d0100b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:16.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.951+0000 7f41ce59c640 1 --2- 172.21.15.27:0/120013178 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41d01078c0 0x7f41d0100b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:16.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.951+0000 7f41ce59c640 1 -- 172.21.15.27:0/120013178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41d0104f90 msgr2=0x7f41d0100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:16.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.951+0000 7f41ce59c640 1 --2- 172.21.15.27:0/120013178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41d0104f90 0x7f41d0100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:16.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.951+0000 7f41ce59c640 1 -- 172.21.15.27:0/120013178 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d0101410 con 0x7f41d0102660 2024-09-19T08:08:16.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.951+0000 7f41ce59c640 1 --2- 172.21.15.27:0/120013178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41d0102660 0x7f41d0101fc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009230 tx=0x7f41c0004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:16.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.951+0000 7f41bf7fe640 1 -- 172.21.15.27:0/120013178 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c003f030 con 0x7f41d0102660 2024-09-19T08:08:16.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.951+0000 7f41d4914640 1 -- 172.21.15.27:0/120013178 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d01a2050 con 0x7f41d0102660 2024-09-19T08:08:16.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.951+0000 7f41d4914640 1 -- 172.21.15.27:0/120013178 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d01a2550 con 0x7f41d0102660 2024-09-19T08:08:16.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.951+0000 7f41bf7fe640 1 -- 172.21.15.27:0/120013178 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41c0003ce0 con 0x7f41d0102660 2024-09-19T08:08:16.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.951+0000 7f41bf7fe640 1 -- 172.21.15.27:0/120013178 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0035070 con 0x7f41d0102660 2024-09-19T08:08:16.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.952+0000 7f41d4914640 1 -- 172.21.15.27:0/120013178 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41b00052c0 con 0x7f41d0102660 2024-09-19T08:08:16.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.953+0000 7f41bf7fe640 1 -- 172.21.15.27:0/120013178 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f41c0042030 con 0x7f41d0102660 2024-09-19T08:08:16.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.954+0000 7f41bf7fe640 1 --2- 172.21.15.27:0/120013178 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f41b80a32c0 0x7f41b80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:16.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.954+0000 7f41cdd9b640 1 --2- 172.21.15.27:0/120013178 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f41b80a32c0 0x7f41b80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:16.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.954+0000 7f41bf7fe640 1 -- 172.21.15.27:0/120013178 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6847+0+0 (secure 0 0 0) 0x7f41c00ef7a0 con 0x7f41d0102660 2024-09-19T08:08:16.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.954+0000 7f41cdd9b640 1 --2- 172.21.15.27:0/120013178 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f41b80a32c0 0x7f41b80a5780 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f41d0101d40 tx=0x7f41c400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:16.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:16.958+0000 7f41bf7fe640 1 -- 172.21.15.27:0/120013178 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f41c00bc430 con 0x7f41d0102660 2024-09-19T08:08:16.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:16 smithi155 ceph-mon[35362]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:08:16.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:16 smithi155 ceph-mon[35362]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T08:08:16.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:16 smithi155 ceph-mon[35362]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T08:08:16.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:16 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:08:16.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:16 smithi155 ceph-mon[35362]: from='osd.11 [v2:172.21.15.203:6824/224768827,v1:172.21.15.203:6825/224768827]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:08:16.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:16 smithi155 ceph-mon[35362]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:08:17.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:08:16 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:08:16.916+0000 7f7334ce1640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T08:08:17.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:08:16 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:08:16.927+0000 7f732cb01640 -1 osd.11 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:08:17.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:17.136+0000 7f41d4914640 1 -- 172.21.15.27:0/120013178 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f41b0005880 con 0x7f41d0102660 2024-09-19T08:08:17.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:17.136+0000 7f41bf7fe640 1 -- 172.21.15.27:0/120013178 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7f41c00c0730 con 0x7f41d0102660 2024-09-19T08:08:17.136 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:08:17.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:17.138+0000 7f41d4914640 1 -- 172.21.15.27:0/120013178 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f41b80a32c0 msgr2=0x7f41b80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:17.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:17.138+0000 7f41d4914640 1 --2- 172.21.15.27:0/120013178 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f41b80a32c0 0x7f41b80a5780 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f41d0101d40 tx=0x7f41c400b390 comp rx=0 tx=0).stop 2024-09-19T08:08:17.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:17.138+0000 7f41d4914640 1 -- 172.21.15.27:0/120013178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41d0102660 msgr2=0x7f41d0101fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:17.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:17.138+0000 7f41d4914640 1 --2- 172.21.15.27:0/120013178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41d0102660 0x7f41d0101fc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009230 tx=0x7f41c0004360 comp rx=0 tx=0).stop 2024-09-19T08:08:17.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:17.138+0000 7f41d4914640 1 -- 172.21.15.27:0/120013178 shutdown_connections 2024-09-19T08:08:17.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:17.138+0000 7f41d4914640 1 --2- 172.21.15.27:0/120013178 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41d01078c0 0x7f41d0100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:17.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:17.138+0000 7f41d4914640 1 --2- 172.21.15.27:0/120013178 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f41b80a32c0 0x7f41b80a5780 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:17.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:17.138+0000 7f41d4914640 1 --2- 172.21.15.27:0/120013178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41d0104f90 0x7f41d0100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:17.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:17.138+0000 7f41d4914640 1 --2- 172.21.15.27:0/120013178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41d0102660 0x7f41d0101fc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:17.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:17.138+0000 7f41d4914640 1 -- 172.21.15.27:0/120013178 >> 172.21.15.27:0/120013178 conn(0x7f41d00fc280 msgr2=0x7f41d0103080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:17.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:17.138+0000 7f41d4914640 1 -- 172.21.15.27:0/120013178 shutdown_connections 2024-09-19T08:08:17.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:17.138+0000 7f41d4914640 1 -- 172.21.15.27:0/120013178 wait complete. 2024-09-19T08:08:17.762 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:08:17.762 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T08:08:17.762 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:08:17.762 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:08:17.762 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: Detected new or changed devices on smithi203 2024-09-19T08:08:17.762 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:17.762 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:17.762 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:08:17.762 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:08:17.762 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:08:17.763 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:08:17.763 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: Adjusting osd_memory_target on smithi203 to 4272M 2024-09-19T08:08:17.763 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:17.763 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:17.763 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:08:17.763 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:17.763 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:08:17.763 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:17.763 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:08:17.763 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:17.763 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: from='osd.11 ' entity='osd.11' 2024-09-19T08:08:17.763 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:17 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/120013178' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:08:17.764 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1726733271,"num_in_osds":12,"osd_in_since":1726733274,"num_remapped_pgs":0} 2024-09-19T08:08:17.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:08:17.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T08:08:17.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:08:17.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:08:17.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: Detected new or changed devices on smithi203 2024-09-19T08:08:17.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:17.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:17.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:08:17.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:08:17.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:08:17.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:08:17.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: Adjusting osd_memory_target on smithi203 to 4272M 2024-09-19T08:08:17.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:17.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:17.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:08:17.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:17.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:08:17.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:17.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:08:17.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:17.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: from='osd.11 ' entity='osd.11' 2024-09-19T08:08:17.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:17 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/120013178' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:08:18.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:08:18.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T08:08:18.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:08:18.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:08:18.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: Detected new or changed devices on smithi203 2024-09-19T08:08:18.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:18.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:18.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:08:18.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:08:18.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:08:18.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:08:18.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: Adjusting osd_memory_target on smithi203 to 4272M 2024-09-19T08:08:18.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:18.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:18.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:08:18.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:18.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:08:18.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:18.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:08:18.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:18.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: from='osd.11 ' entity='osd.11' 2024-09-19T08:08:18.010 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:17 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/120013178' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:08:18.766 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:08:18.794 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:18 smithi027 ceph-mon[31209]: purged_snaps scrub starts 2024-09-19T08:08:18.795 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:18 smithi027 ceph-mon[31209]: purged_snaps scrub ok 2024-09-19T08:08:18.795 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:18 smithi027 ceph-mon[31209]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:08:18.795 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:18 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:08:18.795 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:18 smithi027 ceph-mon[31209]: osd.11 [v2:172.21.15.203:6824/224768827,v1:172.21.15.203:6825/224768827] boot 2024-09-19T08:08:18.795 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:18 smithi027 ceph-mon[31209]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T08:08:18.795 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:18 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:08:18.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:18 smithi155 ceph-mon[35362]: purged_snaps scrub starts 2024-09-19T08:08:18.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:18 smithi155 ceph-mon[35362]: purged_snaps scrub ok 2024-09-19T08:08:18.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:18 smithi155 ceph-mon[35362]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:08:18.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:18 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:08:18.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:18 smithi155 ceph-mon[35362]: osd.11 [v2:172.21.15.203:6824/224768827,v1:172.21.15.203:6825/224768827] boot 2024-09-19T08:08:18.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:18 smithi155 ceph-mon[35362]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T08:08:18.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:18 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:08:19.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:18 smithi203 ceph-mon[35198]: purged_snaps scrub starts 2024-09-19T08:08:19.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:18 smithi203 ceph-mon[35198]: purged_snaps scrub ok 2024-09-19T08:08:19.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:18 smithi203 ceph-mon[35198]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:08:19.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:18 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:08:19.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:18 smithi203 ceph-mon[35198]: osd.11 [v2:172.21.15.203:6824/224768827,v1:172.21.15.203:6825/224768827] boot 2024-09-19T08:08:19.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:18 smithi203 ceph-mon[35198]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T08:08:19.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:18 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:08:19.034 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:08:19.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.487+0000 7f595a504640 1 -- 172.21.15.27:0/387464566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59541017a0 msgr2=0x7f5954109040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:19.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.487+0000 7f595a504640 1 --2- 172.21.15.27:0/387464566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59541017a0 0x7f5954109040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f594c009ca0 tx=0x7f594c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:08:19.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.487+0000 7f595a504640 1 -- 172.21.15.27:0/387464566 shutdown_connections 2024-09-19T08:08:19.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.487+0000 7f595a504640 1 --2- 172.21.15.27:0/387464566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59541017a0 0x7f5954109040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:19.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.487+0000 7f595a504640 1 --2- 172.21.15.27:0/387464566 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5954100de0 0x7f5954101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:19.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.487+0000 7f595a504640 1 --2- 172.21.15.27:0/387464566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59541020a0 0x7f59541024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:19.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.487+0000 7f595a504640 1 -- 172.21.15.27:0/387464566 >> 172.21.15.27:0/387464566 conn(0x7f59540fba40 msgr2=0x7f59540fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:19.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.487+0000 7f595a504640 1 -- 172.21.15.27:0/387464566 shutdown_connections 2024-09-19T08:08:19.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.487+0000 7f595a504640 1 -- 172.21.15.27:0/387464566 wait complete. 2024-09-19T08:08:19.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.488+0000 7f595a504640 1 Processor -- start 2024-09-19T08:08:19.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.488+0000 7f595a504640 1 -- start start 2024-09-19T08:08:19.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.488+0000 7f595a504640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5954100de0 0x7f595410b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:19.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.488+0000 7f595a504640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59541017a0 0x7f5954109ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:19.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.488+0000 7f595a504640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59541020a0 0x7f595410a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:19.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.488+0000 7f595a504640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f595410d930 con 0x7f5954100de0 2024-09-19T08:08:19.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.488+0000 7f595a504640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f595410d7b0 con 0x7f59541017a0 2024-09-19T08:08:19.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.488+0000 7f595a504640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f595410dab0 con 0x7f59541020a0 2024-09-19T08:08:19.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.489+0000 7f5953fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5954100de0 0x7f595410b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:19.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.489+0000 7f5953fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5954100de0 0x7f595410b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37918/0 (socket says 172.21.15.27:37918) 2024-09-19T08:08:19.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.489+0000 7f5953fff640 1 -- 172.21.15.27:0/413610546 learned_addr learned my addr 172.21.15.27:0/413610546 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:08:19.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.489+0000 7f5958aa1640 1 --2- 172.21.15.27:0/413610546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59541020a0 0x7f595410a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:19.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.489+0000 7f59537fe640 1 --2- 172.21.15.27:0/413610546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59541017a0 0x7f5954109ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:19.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.489+0000 7f5953fff640 1 -- 172.21.15.27:0/413610546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59541020a0 msgr2=0x7f595410a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:19.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.489+0000 7f5953fff640 1 --2- 172.21.15.27:0/413610546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59541020a0 0x7f595410a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:19.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.489+0000 7f5953fff640 1 -- 172.21.15.27:0/413610546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59541017a0 msgr2=0x7f5954109ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:19.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.489+0000 7f5953fff640 1 --2- 172.21.15.27:0/413610546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59541017a0 0x7f5954109ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:19.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.489+0000 7f5953fff640 1 -- 172.21.15.27:0/413610546 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595410a8c0 con 0x7f5954100de0 2024-09-19T08:08:19.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.489+0000 7f5958aa1640 1 --2- 172.21.15.27:0/413610546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59541020a0 0x7f595410a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:08:19.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.489+0000 7f59537fe640 1 --2- 172.21.15.27:0/413610546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59541017a0 0x7f5954109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:08:19.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.489+0000 7f5953fff640 1 --2- 172.21.15.27:0/413610546 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5954100de0 0x7f595410b470 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f594400c970 tx=0x7f594400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:19.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.489+0000 7f59517fa640 1 -- 172.21.15.27:0/413610546 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5944004220 con 0x7f5954100de0 2024-09-19T08:08:19.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.489+0000 7f595a504640 1 -- 172.21.15.27:0/413610546 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59541a1fd0 con 0x7f5954100de0 2024-09-19T08:08:19.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.489+0000 7f59517fa640 1 -- 172.21.15.27:0/413610546 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59440043c0 con 0x7f5954100de0 2024-09-19T08:08:19.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.489+0000 7f59517fa640 1 -- 172.21.15.27:0/413610546 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594400f450 con 0x7f5954100de0 2024-09-19T08:08:19.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.489+0000 7f595a504640 1 -- 172.21.15.27:0/413610546 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59541a2480 con 0x7f5954100de0 2024-09-19T08:08:19.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.490+0000 7f595a504640 1 -- 172.21.15.27:0/413610546 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5954107f70 con 0x7f5954100de0 2024-09-19T08:08:19.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.491+0000 7f59517fa640 1 -- 172.21.15.27:0/413610546 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f59440079b0 con 0x7f5954100de0 2024-09-19T08:08:19.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.492+0000 7f59517fa640 1 --2- 172.21.15.27:0/413610546 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f593c0a3240 0x7f593c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:19.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.492+0000 7f59537fe640 1 --2- 172.21.15.27:0/413610546 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f593c0a3240 0x7f593c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:19.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.492+0000 7f59517fa640 1 -- 172.21.15.27:0/413610546 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f59440cf2c0 con 0x7f5954100de0 2024-09-19T08:08:19.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.493+0000 7f59537fe640 1 --2- 172.21.15.27:0/413610546 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f593c0a3240 0x7f593c0a5700 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f595410b1f0 tx=0x7f5948005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:19.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.496+0000 7f59517fa640 1 -- 172.21.15.27:0/413610546 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5944014030 con 0x7f5954100de0 2024-09-19T08:08:19.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.670+0000 7f595a504640 1 -- 172.21.15.27:0/413610546 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5954062e20 con 0x7f5954100de0 2024-09-19T08:08:19.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.671+0000 7f59517fa640 1 -- 172.21.15.27:0/413610546 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7f594409c480 con 0x7f5954100de0 2024-09-19T08:08:19.670 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:08:19.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.673+0000 7f595a504640 1 -- 172.21.15.27:0/413610546 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f593c0a3240 msgr2=0x7f593c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:19.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.673+0000 7f595a504640 1 --2- 172.21.15.27:0/413610546 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f593c0a3240 0x7f593c0a5700 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f595410b1f0 tx=0x7f5948005d90 comp rx=0 tx=0).stop 2024-09-19T08:08:19.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.673+0000 7f595a504640 1 -- 172.21.15.27:0/413610546 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5954100de0 msgr2=0x7f595410b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:19.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.673+0000 7f595a504640 1 --2- 172.21.15.27:0/413610546 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5954100de0 0x7f595410b470 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f594400c970 tx=0x7f594400ce30 comp rx=0 tx=0).stop 2024-09-19T08:08:19.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.673+0000 7f595a504640 1 -- 172.21.15.27:0/413610546 shutdown_connections 2024-09-19T08:08:19.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.673+0000 7f595a504640 1 --2- 172.21.15.27:0/413610546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59541020a0 0x7f595410a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:19.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.673+0000 7f595a504640 1 --2- 172.21.15.27:0/413610546 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f593c0a3240 0x7f593c0a5700 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:19.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.673+0000 7f595a504640 1 --2- 172.21.15.27:0/413610546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59541017a0 0x7f5954109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:19.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.673+0000 7f595a504640 1 --2- 172.21.15.27:0/413610546 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5954100de0 0x7f595410b470 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:19.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.673+0000 7f595a504640 1 -- 172.21.15.27:0/413610546 >> 172.21.15.27:0/413610546 conn(0x7f59540fba40 msgr2=0x7f5954105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:19.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.673+0000 7f595a504640 1 -- 172.21.15.27:0/413610546 shutdown_connections 2024-09-19T08:08:19.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:19.673+0000 7f595a504640 1 -- 172.21.15.27:0/413610546 wait complete. 2024-09-19T08:08:20.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:19 smithi155 ceph-mon[35362]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:20.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:19 smithi155 ceph-mon[35362]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T08:08:20.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:19 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/413610546' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:08:20.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:19 smithi027 ceph-mon[31209]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:20.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:19 smithi027 ceph-mon[31209]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T08:08:20.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:19 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/413610546' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:08:20.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:19 smithi203 ceph-mon[35198]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:20.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:19 smithi203 ceph-mon[35198]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T08:08:20.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:19 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/413610546' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:08:20.427 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":76,"num_osds":12,"num_up_osds":12,"osd_up_since":1726733297,"num_in_osds":12,"osd_in_since":1726733274,"num_remapped_pgs":0} 2024-09-19T08:08:20.427 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:08:20.728 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:08:21.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.162+0000 7f00a7893640 1 -- 172.21.15.27:0/760206197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00a0101410 msgr2=0x7f00a010d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:21.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.162+0000 7f00a7893640 1 --2- 172.21.15.27:0/760206197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00a0101410 0x7f00a010d940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0098009cd0 tx=0x7f009802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:08:21.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.163+0000 7f00a7893640 1 -- 172.21.15.27:0/760206197 shutdown_connections 2024-09-19T08:08:21.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.163+0000 7f00a7893640 1 --2- 172.21.15.27:0/760206197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00a0101410 0x7f00a010d940 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:21.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.163+0000 7f00a7893640 1 --2- 172.21.15.27:0/760206197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00a0100a70 0x7f00a0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:21.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.163+0000 7f00a7893640 1 --2- 172.21.15.27:0/760206197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00a0106a70 0x7f00a0106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:21.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.163+0000 7f00a7893640 1 -- 172.21.15.27:0/760206197 >> 172.21.15.27:0/760206197 conn(0x7f00a00fc790 msgr2=0x7f00a00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:21.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.163+0000 7f00a7893640 1 -- 172.21.15.27:0/760206197 shutdown_connections 2024-09-19T08:08:21.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.163+0000 7f00a7893640 1 -- 172.21.15.27:0/760206197 wait complete. 2024-09-19T08:08:21.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.163+0000 7f00a7893640 1 Processor -- start 2024-09-19T08:08:21.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.163+0000 7f00a7893640 1 -- start start 2024-09-19T08:08:21.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.163+0000 7f00a7893640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00a0100a70 0x7f00a010e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:21.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.164+0000 7f00a7893640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00a0101410 0x7f00a010e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:21.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.164+0000 7f00a7893640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00a0106a70 0x7f00a010ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:21.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.164+0000 7f00a7893640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f00a0111fb0 con 0x7f00a0101410 2024-09-19T08:08:21.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.164+0000 7f00a7893640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f00a0111e30 con 0x7f00a0100a70 2024-09-19T08:08:21.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.164+0000 7f00a7893640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f00a0112130 con 0x7f00a0106a70 2024-09-19T08:08:21.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.164+0000 7f00a4e2e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00a0101410 0x7f00a010e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:21.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.164+0000 7f00a4e2e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00a0101410 0x7f00a010e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54162/0 (socket says 172.21.15.27:54162) 2024-09-19T08:08:21.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.164+0000 7f00a4e2e640 1 -- 172.21.15.27:0/1804683834 learned_addr learned my addr 172.21.15.27:0/1804683834 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:08:21.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.164+0000 7f00a5e30640 1 --2- 172.21.15.27:0/1804683834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00a0106a70 0x7f00a010ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:21.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.164+0000 7f00a562f640 1 --2- 172.21.15.27:0/1804683834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00a0100a70 0x7f00a010e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:21.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.164+0000 7f00a4e2e640 1 -- 172.21.15.27:0/1804683834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00a0106a70 msgr2=0x7f00a010ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:21.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.164+0000 7f00a4e2e640 1 --2- 172.21.15.27:0/1804683834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00a0106a70 0x7f00a010ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:21.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.164+0000 7f00a4e2e640 1 -- 172.21.15.27:0/1804683834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00a0100a70 msgr2=0x7f00a010e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:21.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.164+0000 7f00a4e2e640 1 --2- 172.21.15.27:0/1804683834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00a0100a70 0x7f00a010e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:21.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.164+0000 7f00a4e2e640 1 -- 172.21.15.27:0/1804683834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a01a6970 con 0x7f00a0101410 2024-09-19T08:08:21.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.164+0000 7f00a562f640 1 --2- 172.21.15.27:0/1804683834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00a0100a70 0x7f00a010e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:08:21.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.164+0000 7f00a4e2e640 1 --2- 172.21.15.27:0/1804683834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00a0101410 0x7f00a010e910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f009400d770 tx=0x7f009400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:21.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.164+0000 7f00927fc640 1 -- 172.21.15.27:0/1804683834 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0094017070 con 0x7f00a0101410 2024-09-19T08:08:21.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.164+0000 7f00927fc640 1 -- 172.21.15.27:0/1804683834 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0094005500 con 0x7f00a0101410 2024-09-19T08:08:21.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.164+0000 7f00a7893640 1 -- 172.21.15.27:0/1804683834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a01a6c60 con 0x7f00a0101410 2024-09-19T08:08:21.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.165+0000 7f00927fc640 1 -- 172.21.15.27:0/1804683834 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0094004e00 con 0x7f00a0101410 2024-09-19T08:08:21.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.165+0000 7f00a7893640 1 -- 172.21.15.27:0/1804683834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a01a7150 con 0x7f00a0101410 2024-09-19T08:08:21.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.166+0000 7f00a7893640 1 -- 172.21.15.27:0/1804683834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00a0100ed0 con 0x7f00a0101410 2024-09-19T08:08:21.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.167+0000 7f00927fc640 1 -- 172.21.15.27:0/1804683834 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0094004fa0 con 0x7f00a0101410 2024-09-19T08:08:21.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.168+0000 7f00927fc640 1 --2- 172.21.15.27:0/1804683834 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f008c0a3240 0x7f008c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:21.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.168+0000 7f00a562f640 1 --2- 172.21.15.27:0/1804683834 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f008c0a3240 0x7f008c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:21.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.168+0000 7f00927fc640 1 -- 172.21.15.27:0/1804683834 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f00940ceef0 con 0x7f00a0101410 2024-09-19T08:08:21.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.168+0000 7f00a562f640 1 --2- 172.21.15.27:0/1804683834 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f008c0a3240 0x7f008c0a5700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f009c009930 tx=0x7f009c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:21.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.172+0000 7f00927fc640 1 -- 172.21.15.27:0/1804683834 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f009409c0b0 con 0x7f00a0101410 2024-09-19T08:08:21.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.350+0000 7f00a7893640 1 -- 172.21.15.27:0/1804683834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00a0109030 con 0x7f00a0101410 2024-09-19T08:08:21.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.351+0000 7f00927fc640 1 -- 172.21.15.27:0/1804683834 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+18454 (secure 0 0 0) 0x7f009409b9b0 con 0x7f00a0101410 2024-09-19T08:08:21.351 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:08:21.351 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":76,"fsid":"35b531b0-765d-11ef-bceb-c7b262605968","created":"2024-09-19T08:01:20.929241+0000","modified":"2024-09-19T08:08:18.920352+0000","last_up_change":"2024-09-19T08:08:17.919001+0000","last_in_change":"2024-09-19T08:07:54.277124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:04:29.312984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66fd6732-4cac-4eda-bf06-50638995ee80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6803","nonce":3645201250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6805","nonce":3645201250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6809","nonce":3645201250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6807","nonce":3645201250}]},"public_addr":"172.21.15.27:6803/3645201250","cluster_addr":"172.21.15.27:6805/3645201250","heartbeat_back_addr":"172.21.15.27:6809/3645201250","heartbeat_front_addr":"172.21.15.27:6807/3645201250","state":["exists","up"]},{"osd":1,"uuid":"36628767-66ac-433b-938e-10e75b51a877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6801","nonce":3977510449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6803","nonce":3977510449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6807","nonce":3977510449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6805","nonce":3977510449}]},"public_addr":"172.21.15.155:6801/3977510449","cluster_addr":"172.21.15.155:6803/3977510449","heartbeat_back_addr":"172.21.15.155:6807/3977510449","heartbeat_front_addr":"172.21.15.155:6805/3977510449","state":["exists","up"]},{"osd":2,"uuid":"3dc80404-a56b-456a-af02-f01e9c6c6dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6801","nonce":3796057016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6803","nonce":3796057016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6807","nonce":3796057016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6805","nonce":3796057016}]},"public_addr":"172.21.15.203:6801/3796057016","cluster_addr":"172.21.15.203:6803/3796057016","heartbeat_back_addr":"172.21.15.203:6807/3796057016","heartbeat_front_addr":"172.21.15.203:6805/3796057016","state":["exists","up"]},{"osd":3,"uuid":"a51077d0-5e04-49b5-bb3e-91711cc45ff1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6811","nonce":1608304347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6813","nonce":1608304347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6817","nonce":1608304347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6815","nonce":1608304347}]},"public_addr":"172.21.15.27:6811/1608304347","cluster_addr":"172.21.15.27:6813/1608304347","heartbeat_back_addr":"172.21.15.27:6817/1608304347","heartbeat_front_addr":"172.21.15.27:6815/1608304347","state":["exists","up"]},{"osd":4,"uuid":"0df35548-90b4-434d-8d7e-c037072c9ae4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6809","nonce":569913150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6811","nonce":569913150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6815","nonce":569913150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6813","nonce":569913150}]},"public_addr":"172.21.15.155:6809/569913150","cluster_addr":"172.21.15.155:6811/569913150","heartbeat_back_addr":"172.21.15.155:6815/569913150","heartbeat_front_addr":"172.21.15.155:6813/569913150","state":["exists","up"]},{"osd":5,"uuid":"de193c5f-1019-43e5-9f4f-6c2aaa4330e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6809","nonce":991491203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6811","nonce":991491203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6815","nonce":991491203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6813","nonce":991491203}]},"public_addr":"172.21.15.203:6809/991491203","cluster_addr":"172.21.15.203:6811/991491203","heartbeat_back_addr":"172.21.15.203:6815/991491203","heartbeat_front_addr":"172.21.15.203:6813/991491203","state":["exists","up"]},{"osd":6,"uuid":"28938e4f-9f22-466f-8cf7-62ee56a0c926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6819","nonce":3516868131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6821","nonce":3516868131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6825","nonce":3516868131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6823","nonce":3516868131}]},"public_addr":"172.21.15.27:6819/3516868131","cluster_addr":"172.21.15.27:6821/3516868131","heartbeat_back_addr":"172.21.15.27:6825/3516868131","heartbeat_front_addr":"172.21.15.27:6823/3516868131","state":["exists","up"]},{"osd":7,"uuid":"855f1728-be52-4445-8561-a90c08f2b2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6817","nonce":2047506436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6819","nonce":2047506436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6823","nonce":2047506436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6821","nonce":2047506436}]},"public_addr":"172.21.15.155:6817/2047506436","cluster_addr":"172.21.15.155:6819/2047506436","heartbeat_back_addr":"172.21.15.155:6823/2047506436","heartbeat_front_addr":"172.21.15.155:6821/2047506436","state":["exists","up"]},{"osd":8,"uuid":"5d7a8ffd-a039-403e-8b9a-c80e19fd67ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6817","nonce":199970687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6819","nonce":199970687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6823","nonce":199970687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6821","nonce":199970687}]},"public_addr":"172.21.15.203:6817/199970687","cluster_addr":"172.21.15.203:6819/199970687","heartbeat_back_addr":"172.21.15.203:6823/199970687","heartbeat_front_addr":"172.21.15.203:6821/199970687","state":["exists","up"]},{"osd":9,"uuid":"cdb90242-80a1-4cef-b5e3-ddecb05664e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6827","nonce":118390483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6829","nonce":118390483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6833","nonce":118390483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6831","nonce":118390483}]},"public_addr":"172.21.15.27:6827/118390483","cluster_addr":"172.21.15.27:6829/118390483","heartbeat_back_addr":"172.21.15.27:6833/118390483","heartbeat_front_addr":"172.21.15.27:6831/118390483","state":["exists","up"]},{"osd":10,"uuid":"c7f4c9da-d913-47a5-8629-53de21efe8c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6825","nonce":1687418565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6827","nonce":1687418565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6831","nonce":1687418565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6829","nonce":1687418565}]},"public_addr":"172.21.15.155:6825/1687418565","cluster_addr":"172.21.15.155:6827/1687418565","heartbeat_back_addr":"172.21.15.155:6831/1687418565","heartbeat_front_addr":"172.21.15.155:6829/1687418565","state":["exists","up"]},{"osd":11,"uuid":"45c11a90-585e-46fa-a5a0-51a29e29eba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6825","nonce":224768827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6827","nonce":224768827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6831","nonce":224768827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6829","nonce":224768827}]},"public_addr":"172.21.15.203:6825/224768827","cluster_addr":"172.21.15.203:6827/224768827","heartbeat_back_addr":"172.21.15.203:6831/224768827","heartbeat_front_addr":"172.21.15.203:6829/224768827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:03:35.559549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:00.526006+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:25.809346+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:51.889445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:17.246017+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:43.515854+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:08.638182+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:34.653060+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:59.469837+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:26.122937+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:50.196159+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:08:16.245770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:6800/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/958829150":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1174736321":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1908865720":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/416476667":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6800/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/1717932879":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1963219497":"2024-09-20T08:01:48.686812+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:08:21.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.354+0000 7f00a7893640 1 -- 172.21.15.27:0/1804683834 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f008c0a3240 msgr2=0x7f008c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:21.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.354+0000 7f00a7893640 1 --2- 172.21.15.27:0/1804683834 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f008c0a3240 0x7f008c0a5700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f009c009930 tx=0x7f009c008040 comp rx=0 tx=0).stop 2024-09-19T08:08:21.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.354+0000 7f00a7893640 1 -- 172.21.15.27:0/1804683834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00a0101410 msgr2=0x7f00a010e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:21.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.354+0000 7f00a7893640 1 --2- 172.21.15.27:0/1804683834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00a0101410 0x7f00a010e910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f009400d770 tx=0x7f009400dc30 comp rx=0 tx=0).stop 2024-09-19T08:08:21.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.354+0000 7f00a7893640 1 -- 172.21.15.27:0/1804683834 shutdown_connections 2024-09-19T08:08:21.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.354+0000 7f00a7893640 1 --2- 172.21.15.27:0/1804683834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00a0106a70 0x7f00a010ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:21.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.354+0000 7f00a7893640 1 --2- 172.21.15.27:0/1804683834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00a0101410 0x7f00a010e910 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:21.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.354+0000 7f00a7893640 1 --2- 172.21.15.27:0/1804683834 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f008c0a3240 0x7f008c0a5700 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:21.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.354+0000 7f00a7893640 1 --2- 172.21.15.27:0/1804683834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00a0100a70 0x7f00a010e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:21.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.354+0000 7f00a7893640 1 -- 172.21.15.27:0/1804683834 >> 172.21.15.27:0/1804683834 conn(0x7f00a00fc790 msgr2=0x7f00a00fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:21.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.354+0000 7f00a7893640 1 -- 172.21.15.27:0/1804683834 shutdown_connections 2024-09-19T08:08:21.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:21.354+0000 7f00a7893640 1 -- 172.21.15.27:0/1804683834 wait complete. 2024-09-19T08:08:21.951 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:04:29.312984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T08:08:21.951 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T08:08:22.203 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:08:22.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:21 smithi155 ceph-mon[35362]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:22.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:21 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1804683834' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:08:22.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:21 smithi027 ceph-mon[31209]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:22.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:21 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1804683834' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:08:22.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:21 smithi203 ceph-mon[35198]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:22.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:21 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1804683834' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:08:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.641+0000 7f616bc40640 1 -- 172.21.15.27:0/2316836229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6164106a80 msgr2=0x7f6164106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.641+0000 7f616bc40640 1 --2- 172.21.15.27:0/2316836229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6164106a80 0x7f6164106e60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6160009930 tx=0x7f616002a420 comp rx=0 tx=0).stop 2024-09-19T08:08:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.641+0000 7f616bc40640 1 -- 172.21.15.27:0/2316836229 shutdown_connections 2024-09-19T08:08:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.641+0000 7f616bc40640 1 --2- 172.21.15.27:0/2316836229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6164101420 0x7f616410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.641+0000 7f616bc40640 1 --2- 172.21.15.27:0/2316836229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6164100a80 0x7f6164100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.641+0000 7f616bc40640 1 --2- 172.21.15.27:0/2316836229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6164106a80 0x7f6164106e60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:22.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.641+0000 7f616bc40640 1 -- 172.21.15.27:0/2316836229 >> 172.21.15.27:0/2316836229 conn(0x7f61640fc7a0 msgr2=0x7f61640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:22.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.641+0000 7f616bc40640 1 -- 172.21.15.27:0/2316836229 shutdown_connections 2024-09-19T08:08:22.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.641+0000 7f616bc40640 1 -- 172.21.15.27:0/2316836229 wait complete. 2024-09-19T08:08:22.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.642+0000 7f616bc40640 1 Processor -- start 2024-09-19T08:08:22.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.642+0000 7f616bc40640 1 -- start start 2024-09-19T08:08:22.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.642+0000 7f616bc40640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6164100a80 0x7f6164198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:22.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.642+0000 7f616bc40640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6164101420 0x7f61641989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:22.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.642+0000 7f616bc40640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6164106a80 0x7f616419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:22.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.642+0000 7f616bc40640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6164110e80 con 0x7f6164101420 2024-09-19T08:08:22.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.642+0000 7f616bc40640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6164110d00 con 0x7f6164106a80 2024-09-19T08:08:22.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.642+0000 7f616bc40640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6164111000 con 0x7f6164100a80 2024-09-19T08:08:22.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.642+0000 7f61691db640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6164101420 0x7f61641989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:22.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.642+0000 7f61691db640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6164101420 0x7f61641989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54184/0 (socket says 172.21.15.27:54184) 2024-09-19T08:08:22.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.642+0000 7f61699dc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6164100a80 0x7f6164198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:22.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.642+0000 7f61691db640 1 -- 172.21.15.27:0/1617138629 learned_addr learned my addr 172.21.15.27:0/1617138629 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:08:22.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.642+0000 7f616a1dd640 1 --2- 172.21.15.27:0/1617138629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6164106a80 0x7f616419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:22.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.642+0000 7f61691db640 1 -- 172.21.15.27:0/1617138629 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6164100a80 msgr2=0x7f6164198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:22.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.642+0000 7f61691db640 1 --2- 172.21.15.27:0/1617138629 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6164100a80 0x7f6164198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:22.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.642+0000 7f61691db640 1 -- 172.21.15.27:0/1617138629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6164106a80 msgr2=0x7f616419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:22.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.642+0000 7f61691db640 1 --2- 172.21.15.27:0/1617138629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6164106a80 0x7f616419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:22.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.642+0000 7f61691db640 1 -- 172.21.15.27:0/1617138629 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f616419d420 con 0x7f6164101420 2024-09-19T08:08:22.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.642+0000 7f616a1dd640 1 --2- 172.21.15.27:0/1617138629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6164106a80 0x7f616419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:08:22.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.642+0000 7f61691db640 1 --2- 172.21.15.27:0/1617138629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6164101420 0x7f61641989b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f615400c970 tx=0x7f615400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:22.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.643+0000 7f615affd640 1 -- 172.21.15.27:0/1617138629 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6154007bb0 con 0x7f6164101420 2024-09-19T08:08:22.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.643+0000 7f616bc40640 1 -- 172.21.15.27:0/1617138629 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f616419d710 con 0x7f6164101420 2024-09-19T08:08:22.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.643+0000 7f615affd640 1 -- 172.21.15.27:0/1617138629 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6154007d50 con 0x7f6164101420 2024-09-19T08:08:22.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.643+0000 7f615affd640 1 -- 172.21.15.27:0/1617138629 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615400f450 con 0x7f6164101420 2024-09-19T08:08:22.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.643+0000 7f616bc40640 1 -- 172.21.15.27:0/1617138629 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61641a4ff0 con 0x7f6164101420 2024-09-19T08:08:22.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.644+0000 7f616bc40640 1 -- 172.21.15.27:0/1617138629 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6164100ee0 con 0x7f6164101420 2024-09-19T08:08:22.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.645+0000 7f615affd640 1 -- 172.21.15.27:0/1617138629 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6154005020 con 0x7f6164101420 2024-09-19T08:08:22.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.646+0000 7f615affd640 1 --2- 172.21.15.27:0/1617138629 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f61500a3240 0x7f61500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:22.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.646+0000 7f61699dc640 1 --2- 172.21.15.27:0/1617138629 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f61500a3240 0x7f61500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:22.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.646+0000 7f615affd640 1 -- 172.21.15.27:0/1617138629 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f61540cf250 con 0x7f6164101420 2024-09-19T08:08:22.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.646+0000 7f61699dc640 1 --2- 172.21.15.27:0/1617138629 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f61500a3240 0x7f61500a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6160009900 tx=0x7f61600058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:22.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.650+0000 7f615affd640 1 -- 172.21.15.27:0/1617138629 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6154014030 con 0x7f6164101420 2024-09-19T08:08:22.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.824+0000 7f616bc40640 1 -- 172.21.15.27:0/1617138629 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f616402d7c0 con 0x7f6164101420 2024-09-19T08:08:22.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.825+0000 7f615affd640 1 -- 172.21.15.27:0/1617138629 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7f615409c410 con 0x7f6164101420 2024-09-19T08:08:22.825 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-09-19T08:08:22.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.827+0000 7f616bc40640 1 -- 172.21.15.27:0/1617138629 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f61500a3240 msgr2=0x7f61500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:22.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.827+0000 7f616bc40640 1 --2- 172.21.15.27:0/1617138629 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f61500a3240 0x7f61500a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6160009900 tx=0x7f61600058d0 comp rx=0 tx=0).stop 2024-09-19T08:08:22.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.827+0000 7f616bc40640 1 -- 172.21.15.27:0/1617138629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6164101420 msgr2=0x7f61641989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:22.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.827+0000 7f616bc40640 1 --2- 172.21.15.27:0/1617138629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6164101420 0x7f61641989b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f615400c970 tx=0x7f615400ce30 comp rx=0 tx=0).stop 2024-09-19T08:08:22.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.827+0000 7f616bc40640 1 -- 172.21.15.27:0/1617138629 shutdown_connections 2024-09-19T08:08:22.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.827+0000 7f616bc40640 1 --2- 172.21.15.27:0/1617138629 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f61500a3240 0x7f61500a5700 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:22.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.827+0000 7f616bc40640 1 --2- 172.21.15.27:0/1617138629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6164106a80 0x7f616419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:22.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.827+0000 7f616bc40640 1 --2- 172.21.15.27:0/1617138629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6164101420 0x7f61641989b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:22.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.827+0000 7f616bc40640 1 --2- 172.21.15.27:0/1617138629 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6164100a80 0x7f6164198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:22.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.827+0000 7f616bc40640 1 -- 172.21.15.27:0/1617138629 >> 172.21.15.27:0/1617138629 conn(0x7f61640fc7a0 msgr2=0x7f616406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:22.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.827+0000 7f616bc40640 1 -- 172.21.15.27:0/1617138629 shutdown_connections 2024-09-19T08:08:22.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:22.827+0000 7f616bc40640 1 -- 172.21.15.27:0/1617138629 wait complete. 2024-09-19T08:08:23.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:22 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1617138629' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:08:23.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:22 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1617138629' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:08:23.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:22 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1617138629' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:08:23.549 INFO:tasks.cephadm:Adding mds.a on smithi027 2024-09-19T08:08:23.549 INFO:tasks.cephadm:Adding mds.d on smithi027 2024-09-19T08:08:23.549 INFO:tasks.cephadm:Adding mds.g on smithi027 2024-09-19T08:08:23.550 INFO:tasks.cephadm:Adding mds.j on smithi027 2024-09-19T08:08:23.550 INFO:tasks.cephadm:Adding mds.b on smithi155 2024-09-19T08:08:23.550 INFO:tasks.cephadm:Adding mds.e on smithi155 2024-09-19T08:08:23.550 INFO:tasks.cephadm:Adding mds.h on smithi155 2024-09-19T08:08:23.550 INFO:tasks.cephadm:Adding mds.k on smithi155 2024-09-19T08:08:23.550 INFO:tasks.cephadm:Adding mds.c on smithi203 2024-09-19T08:08:23.550 INFO:tasks.cephadm:Adding mds.f on smithi203 2024-09-19T08:08:23.550 INFO:tasks.cephadm:Adding mds.i on smithi203 2024-09-19T08:08:23.550 INFO:tasks.cephadm:Adding mds.l on smithi203 2024-09-19T08:08:23.550 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi027=a;smithi027=d;smithi027=g;smithi027=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l' 2024-09-19T08:08:23.798 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:08:24.226 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:23 smithi203 ceph-mon[35198]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:24.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:23 smithi155 ceph-mon[35362]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:24.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:23 smithi027 ceph-mon[31209]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:24.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.311+0000 7efe21c0c640 1 -- 172.21.15.203:0/2758015037 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe1c104f90 msgr2=0x7efe1c107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:24.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.311+0000 7efe21c0c640 1 --2- 172.21.15.203:0/2758015037 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe1c104f90 0x7efe1c107380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efe04009900 tx=0x7efe0402a410 comp rx=0 tx=0).stop 2024-09-19T08:08:24.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.311+0000 7efe21c0c640 1 -- 172.21.15.203:0/2758015037 shutdown_connections 2024-09-19T08:08:24.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.311+0000 7efe21c0c640 1 --2- 172.21.15.203:0/2758015037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe1c1078c0 0x7efe1c109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:24.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.311+0000 7efe21c0c640 1 --2- 172.21.15.203:0/2758015037 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe1c104f90 0x7efe1c107380 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:24.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.311+0000 7efe21c0c640 1 --2- 172.21.15.203:0/2758015037 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe1c102660 0x7efe1c104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:24.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.311+0000 7efe21c0c640 1 -- 172.21.15.203:0/2758015037 >> 172.21.15.203:0/2758015037 conn(0x7efe1c0fc280 msgr2=0x7efe1c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:24.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.311+0000 7efe21c0c640 1 -- 172.21.15.203:0/2758015037 shutdown_connections 2024-09-19T08:08:24.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.311+0000 7efe21c0c640 1 -- 172.21.15.203:0/2758015037 wait complete. 2024-09-19T08:08:24.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.311+0000 7efe21c0c640 1 Processor -- start 2024-09-19T08:08:24.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.311+0000 7efe21c0c640 1 -- start start 2024-09-19T08:08:24.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe21c0c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe1c102660 0x7efe1c197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:24.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe21c0c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe1c104f90 0x7efe1c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:24.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe21c0c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe1c1078c0 0x7efe1c19f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:24.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe21c0c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c10d840 con 0x7efe1c1078c0 2024-09-19T08:08:24.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe21c0c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c10d6c0 con 0x7efe1c102660 2024-09-19T08:08:24.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe21c0c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c10d9c0 con 0x7efe1c104f90 2024-09-19T08:08:24.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe1affd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe1c104f90 0x7efe1c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:24.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe1affd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe1c104f90 0x7efe1c198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:59484/0 (socket says 172.21.15.203:59484) 2024-09-19T08:08:24.321 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe1affd640 1 -- 172.21.15.203:0/156029670 learned_addr learned my addr 172.21.15.203:0/156029670 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:08:24.321 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe1b7fe640 1 --2- 172.21.15.203:0/156029670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe1c102660 0x7efe1c197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:24.321 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe1affd640 1 -- 172.21.15.203:0/156029670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe1c102660 msgr2=0x7efe1c197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:24.321 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe1affd640 1 --2- 172.21.15.203:0/156029670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe1c102660 0x7efe1c197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:24.321 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe1bfff640 1 --2- 172.21.15.203:0/156029670 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe1c1078c0 0x7efe1c19f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:24.321 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe1affd640 1 -- 172.21.15.203:0/156029670 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe1c1078c0 msgr2=0x7efe1c19f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:24.321 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe1affd640 1 --2- 172.21.15.203:0/156029670 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe1c1078c0 0x7efe1c19f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:24.321 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe1affd640 1 -- 172.21.15.203:0/156029670 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1c19fb50 con 0x7efe1c104f90 2024-09-19T08:08:24.321 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe1b7fe640 1 --2- 172.21.15.203:0/156029670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe1c102660 0x7efe1c197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:08:24.321 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe1affd640 1 --2- 172.21.15.203:0/156029670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe1c104f90 0x7efe1c198460 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efe04031610 tx=0x7efe040043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:24.322 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe18ff9640 1 -- 172.21.15.203:0/156029670 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0403f030 con 0x7efe1c104f90 2024-09-19T08:08:24.322 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe18ff9640 1 -- 172.21.15.203:0/156029670 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe04003ce0 con 0x7efe1c104f90 2024-09-19T08:08:24.322 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe21c0c640 1 -- 172.21.15.203:0/156029670 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe1c19fde0 con 0x7efe1c104f90 2024-09-19T08:08:24.322 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe18ff9640 1 -- 172.21.15.203:0/156029670 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe04035070 con 0x7efe1c104f90 2024-09-19T08:08:24.322 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.312+0000 7efe21c0c640 1 -- 172.21.15.203:0/156029670 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe1c1a0260 con 0x7efe1c104f90 2024-09-19T08:08:24.322 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.313+0000 7efe21c0c640 1 -- 172.21.15.203:0/156029670 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe1c0fdd70 con 0x7efe1c104f90 2024-09-19T08:08:24.322 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.315+0000 7efe18ff9640 1 -- 172.21.15.203:0/156029670 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7efe04042030 con 0x7efe1c104f90 2024-09-19T08:08:24.322 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.315+0000 7efe18ff9640 1 --2- 172.21.15.203:0/156029670 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7efe080a3270 0x7efe080a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:24.322 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.316+0000 7efe18ff9640 1 -- 172.21.15.203:0/156029670 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7efe040efcb0 con 0x7efe1c104f90 2024-09-19T08:08:24.322 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.316+0000 7efe1b7fe640 1 --2- 172.21.15.203:0/156029670 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7efe080a3270 0x7efe080a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:24.322 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.316+0000 7efe1b7fe640 1 --2- 172.21.15.203:0/156029670 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7efe080a3270 0x7efe080a5730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efe14005c40 tx=0x7efe1400a430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:24.323 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.318+0000 7efe18ff9640 1 -- 172.21.15.203:0/156029670 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efe040bce70 con 0x7efe1c104f90 2024-09-19T08:08:24.494 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.494+0000 7efe21c0c640 1 -- 172.21.15.203:0/156029670 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi027=a;smithi027=d;smithi027=g;smithi027=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l", "target": ["mon-mgr", ""]}) -- 0x7efe1c0627f0 con 0x7efe080a3270 2024-09-19T08:08:24.502 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.502+0000 7efe18ff9640 1 -- 172.21.15.203:0/156029670 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7efe1c0627f0 con 0x7efe080a3270 2024-09-19T08:08:24.502 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled mds.all update... 2024-09-19T08:08:24.504 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.504+0000 7efe21c0c640 1 -- 172.21.15.203:0/156029670 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7efe080a3270 msgr2=0x7efe080a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:24.504 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.504+0000 7efe21c0c640 1 --2- 172.21.15.203:0/156029670 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7efe080a3270 0x7efe080a5730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efe14005c40 tx=0x7efe1400a430 comp rx=0 tx=0).stop 2024-09-19T08:08:24.504 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.504+0000 7efe21c0c640 1 -- 172.21.15.203:0/156029670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe1c104f90 msgr2=0x7efe1c198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:24.504 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.504+0000 7efe21c0c640 1 --2- 172.21.15.203:0/156029670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe1c104f90 0x7efe1c198460 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efe04031610 tx=0x7efe040043b0 comp rx=0 tx=0).stop 2024-09-19T08:08:24.504 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.504+0000 7efe21c0c640 1 -- 172.21.15.203:0/156029670 shutdown_connections 2024-09-19T08:08:24.504 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.504+0000 7efe21c0c640 1 --2- 172.21.15.203:0/156029670 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe1c1078c0 0x7efe1c19f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:24.504 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.504+0000 7efe21c0c640 1 --2- 172.21.15.203:0/156029670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe1c104f90 0x7efe1c198460 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:24.504 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.504+0000 7efe21c0c640 1 --2- 172.21.15.203:0/156029670 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7efe080a3270 0x7efe080a5730 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:24.505 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.504+0000 7efe21c0c640 1 --2- 172.21.15.203:0/156029670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe1c102660 0x7efe1c197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:24.505 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.504+0000 7efe21c0c640 1 -- 172.21.15.203:0/156029670 >> 172.21.15.203:0/156029670 conn(0x7efe1c0fc280 msgr2=0x7efe1c1030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:24.505 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.504+0000 7efe21c0c640 1 -- 172.21.15.203:0/156029670 shutdown_connections 2024-09-19T08:08:24.505 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:08:24.504+0000 7efe21c0c640 1 -- 172.21.15.203:0/156029670 wait complete. 2024-09-19T08:08:25.300 DEBUG:teuthology.orchestra.run.smithi027:mds.a> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T08:08:25.303 DEBUG:teuthology.orchestra.run.smithi027:mds.d> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T08:08:25.346 DEBUG:teuthology.orchestra.run.smithi027:mds.g> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T08:08:25.391 DEBUG:teuthology.orchestra.run.smithi027:mds.j> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T08:08:25.433 DEBUG:teuthology.orchestra.run.smithi155:mds.b> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T08:08:25.435 DEBUG:teuthology.orchestra.run.smithi155:mds.e> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T08:08:25.480 DEBUG:teuthology.orchestra.run.smithi155:mds.h> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T08:08:25.523 DEBUG:teuthology.orchestra.run.smithi155:mds.k> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T08:08:25.566 DEBUG:teuthology.orchestra.run.smithi203:mds.c> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T08:08:25.568 DEBUG:teuthology.orchestra.run.smithi203:mds.f> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T08:08:25.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:25 smithi203 ceph-mon[35198]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi027=a;smithi027=d;smithi027=g;smithi027=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:08:25.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:25 smithi203 ceph-mon[35198]: Saving service mds.all spec with placement smithi027=a;smithi027=d;smithi027=g;smithi027=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l;count:12 2024-09-19T08:08:25.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:25 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:25.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:25 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:08:25.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:25 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:25.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:25 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:08:25.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:25 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:25.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:25 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:25.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:25 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:25.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:25 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:25.590 DEBUG:teuthology.orchestra.run.smithi203:mds.i> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T08:08:25.634 DEBUG:teuthology.orchestra.run.smithi203:mds.l> sudo journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T08:08:25.677 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T08:08:25.677 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:08:25.702 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:25 smithi027 ceph-mon[31209]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi027=a;smithi027=d;smithi027=g;smithi027=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:08:25.702 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:25 smithi027 ceph-mon[31209]: Saving service mds.all spec with placement smithi027=a;smithi027=d;smithi027=g;smithi027=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l;count:12 2024-09-19T08:08:25.702 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:25 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:25.702 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:25 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:08:25.702 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:25 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:25.702 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:25 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:08:25.702 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:25 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:25.702 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:25 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:25.702 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:25 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:25.702 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:25 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:25.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:25 smithi155 ceph-mon[35362]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi027=a;smithi027=d;smithi027=g;smithi027=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:08:25.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:25 smithi155 ceph-mon[35362]: Saving service mds.all spec with placement smithi027=a;smithi027=d;smithi027=g;smithi027=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l;count:12 2024-09-19T08:08:25.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:25 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:25.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:25 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:08:25.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:25 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:25.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:25 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:08:25.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:25 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:25.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:25 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:25.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:25 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:25.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:25 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:25.934 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:08:26.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.397+0000 7f47740ba640 1 -- 172.21.15.27:0/1757840135 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f476c106f50 msgr2=0x7f476c10eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:26.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.397+0000 7f47740ba640 1 --2- 172.21.15.27:0/1757840135 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f476c106f50 0x7f476c10eaf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f475c009cd0 tx=0x7f475c02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:08:26.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.397+0000 7f47740ba640 1 -- 172.21.15.27:0/1757840135 shutdown_connections 2024-09-19T08:08:26.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.397+0000 7f47740ba640 1 --2- 172.21.15.27:0/1757840135 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f476c106f50 0x7f476c10eaf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:26.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.397+0000 7f47740ba640 1 --2- 172.21.15.27:0/1757840135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f476c100d00 0x7f476c106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:26.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.397+0000 7f47740ba640 1 --2- 172.21.15.27:0/1757840135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f476c100350 0x7f476c100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:26.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.397+0000 7f47740ba640 1 -- 172.21.15.27:0/1757840135 >> 172.21.15.27:0/1757840135 conn(0x7f476c077210 msgr2=0x7f476c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:26.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.397+0000 7f47740ba640 1 -- 172.21.15.27:0/1757840135 shutdown_connections 2024-09-19T08:08:26.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.397+0000 7f47740ba640 1 -- 172.21.15.27:0/1757840135 wait complete. 2024-09-19T08:08:26.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.398+0000 7f47740ba640 1 Processor -- start 2024-09-19T08:08:26.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.398+0000 7f47740ba640 1 -- start start 2024-09-19T08:08:26.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.398+0000 7f47740ba640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f476c100350 0x7f476c19a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:26.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.398+0000 7f47740ba640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f476c100d00 0x7f476c19ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:26.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.398+0000 7f47740ba640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f476c106f50 0x7f476c19f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:26.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.398+0000 7f47740ba640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f476c112000 con 0x7f476c100350 2024-09-19T08:08:26.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.398+0000 7f47740ba640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f476c111e80 con 0x7f476c106f50 2024-09-19T08:08:26.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.398+0000 7f47740ba640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f476c112180 con 0x7f476c100d00 2024-09-19T08:08:26.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.398+0000 7f4771e56640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f476c100350 0x7f476c19a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:26.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.398+0000 7f4771e56640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f476c100350 0x7f476c19a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54204/0 (socket says 172.21.15.27:54204) 2024-09-19T08:08:26.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.398+0000 7f4771e56640 1 -- 172.21.15.27:0/134915795 learned_addr learned my addr 172.21.15.27:0/134915795 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:08:26.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.398+0000 7f4771655640 1 --2- 172.21.15.27:0/134915795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f476c100d00 0x7f476c19ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:26.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.398+0000 7f4772657640 1 --2- 172.21.15.27:0/134915795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f476c106f50 0x7f476c19f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:26.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.399+0000 7f4771e56640 1 -- 172.21.15.27:0/134915795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f476c100d00 msgr2=0x7f476c19ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:26.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.399+0000 7f4771e56640 1 --2- 172.21.15.27:0/134915795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f476c100d00 0x7f476c19ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:26.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.399+0000 7f4771e56640 1 -- 172.21.15.27:0/134915795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f476c106f50 msgr2=0x7f476c19f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:26.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.399+0000 7f4771e56640 1 --2- 172.21.15.27:0/134915795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f476c106f50 0x7f476c19f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:26.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.399+0000 7f4771e56640 1 -- 172.21.15.27:0/134915795 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476c19f6e0 con 0x7f476c100350 2024-09-19T08:08:26.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.399+0000 7f4771e56640 1 --2- 172.21.15.27:0/134915795 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f476c100350 0x7f476c19a730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f476400d950 tx=0x7f476400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:26.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.399+0000 7f476affd640 1 -- 172.21.15.27:0/134915795 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4764017070 con 0x7f476c100350 2024-09-19T08:08:26.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.399+0000 7f476affd640 1 -- 172.21.15.27:0/134915795 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f476400de80 con 0x7f476c100350 2024-09-19T08:08:26.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.399+0000 7f47740ba640 1 -- 172.21.15.27:0/134915795 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f476c19f9d0 con 0x7f476c100350 2024-09-19T08:08:26.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.399+0000 7f476affd640 1 -- 172.21.15.27:0/134915795 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476400f620 con 0x7f476c100350 2024-09-19T08:08:26.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.399+0000 7f47740ba640 1 -- 172.21.15.27:0/134915795 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f476c1a72b0 con 0x7f476c100350 2024-09-19T08:08:26.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.400+0000 7f47740ba640 1 -- 172.21.15.27:0/134915795 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f476c100730 con 0x7f476c100350 2024-09-19T08:08:26.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.401+0000 7f476affd640 1 -- 172.21.15.27:0/134915795 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4764009c30 con 0x7f476c100350 2024-09-19T08:08:26.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.402+0000 7f476affd640 1 --2- 172.21.15.27:0/134915795 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f47540a3240 0x7f47540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:26.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.402+0000 7f4771655640 1 --2- 172.21.15.27:0/134915795 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f47540a3240 0x7f47540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:26.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.402+0000 7f476affd640 1 -- 172.21.15.27:0/134915795 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f47640cf070 con 0x7f476c100350 2024-09-19T08:08:26.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.402+0000 7f4771655640 1 --2- 172.21.15.27:0/134915795 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f47540a3240 0x7f47540a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f476c10eec0 tx=0x7f4760009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:26.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.405+0000 7f476affd640 1 -- 172.21.15.27:0/134915795 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f476409c230 con 0x7f476c100350 2024-09-19T08:08:26.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.622+0000 7f47740ba640 1 -- 172.21.15.27:0/134915795 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f476c1a7480 con 0x7f476c100350 2024-09-19T08:08:26.622 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:26 smithi027 ceph-mon[31209]: Deploying daemon mds.l on smithi203 2024-09-19T08:08:26.622 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:26 smithi027 ceph-mon[31209]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:26.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.623+0000 7f476affd640 1 -- 172.21.15.27:0/134915795 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f476409bb30 con 0x7f476c100350 2024-09-19T08:08:26.623 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:08:26.623 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":1,"btime":"2024-09-19T08:01:20:929052+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T08:08:26.623 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 1 2024-09-19T08:08:26.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.624+0000 7f47740ba640 1 -- 172.21.15.27:0/134915795 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f47540a3240 msgr2=0x7f47540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:26.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.624+0000 7f47740ba640 1 --2- 172.21.15.27:0/134915795 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f47540a3240 0x7f47540a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f476c10eec0 tx=0x7f4760009110 comp rx=0 tx=0).stop 2024-09-19T08:08:26.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.625+0000 7f47740ba640 1 -- 172.21.15.27:0/134915795 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f476c100350 msgr2=0x7f476c19a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.625+0000 7f47740ba640 1 --2- 172.21.15.27:0/134915795 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f476c100350 0x7f476c19a730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f476400d950 tx=0x7f476400dd50 comp rx=0 tx=0).stop 2024-09-19T08:08:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.625+0000 7f47740ba640 1 -- 172.21.15.27:0/134915795 shutdown_connections 2024-09-19T08:08:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.625+0000 7f47740ba640 1 --2- 172.21.15.27:0/134915795 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f47540a3240 0x7f47540a5700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.625+0000 7f47740ba640 1 --2- 172.21.15.27:0/134915795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f476c106f50 0x7f476c19f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.625+0000 7f47740ba640 1 --2- 172.21.15.27:0/134915795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f476c100d00 0x7f476c19ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.625+0000 7f47740ba640 1 --2- 172.21.15.27:0/134915795 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f476c100350 0x7f476c19a730 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.625+0000 7f47740ba640 1 -- 172.21.15.27:0/134915795 >> 172.21.15.27:0/134915795 conn(0x7f476c077210 msgr2=0x7f476c105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.625+0000 7f47740ba640 1 -- 172.21.15.27:0/134915795 shutdown_connections 2024-09-19T08:08:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:26.625+0000 7f47740ba640 1 -- 172.21.15.27:0/134915795 wait complete. 2024-09-19T08:08:26.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:26 smithi203 ceph-mon[35198]: Deploying daemon mds.l on smithi203 2024-09-19T08:08:26.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:26 smithi203 ceph-mon[35198]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:26.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:26 smithi155 ceph-mon[35362]: Deploying daemon mds.l on smithi203 2024-09-19T08:08:26.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:26 smithi155 ceph-mon[35362]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:27.203 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 08:08:26 smithi203 systemd[1]: Starting Ceph mds.l for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:08:27.469 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 08:08:27 smithi203 podman[64648]: 2024-09-19 08:08:27.106229251 +0000 UTC m=+0.016007891 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:08:27.469 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 08:08:27 smithi203 podman[64648]: 2024-09-19 08:08:27.217012348 +0000 UTC m=+0.126790983 container create effc17931e7884df01aaec7d69f55182515ef5f0fb801eb881d83454200a544b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-l, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T08:08:27.469 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 08:08:27 smithi203 podman[64648]: 2024-09-19 08:08:27.469727875 +0000 UTC m=+0.379506509 container init effc17931e7884df01aaec7d69f55182515ef5f0fb801eb881d83454200a544b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T08:08:27.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:27 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/134915795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:27.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:27 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/134915795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:27.758 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 08:08:27 smithi203 podman[64648]: 2024-09-19 08:08:27.472744134 +0000 UTC m=+0.382522776 container start effc17931e7884df01aaec7d69f55182515ef5f0fb801eb881d83454200a544b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T08:08:27.758 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 08:08:27 smithi203 ceph-mds[64667]: -- 172.21.15.203:0/382434033 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5653f8bc1860 con 0x5653f8b9f000 2024-09-19T08:08:27.758 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 08:08:27 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-l[64663]: starting mds.l at 2024-09-19T08:08:27.758 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 08:08:27 smithi203 bash[64648]: effc17931e7884df01aaec7d69f55182515ef5f0fb801eb881d83454200a544b 2024-09-19T08:08:27.758 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 08:08:27 smithi203 systemd[1]: Started Ceph mds.l for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:08:27.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:27 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/134915795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:28.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:28 smithi155 ceph-mon[35362]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:28.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:28 smithi155 ceph-mon[35362]: mds.? [v2:172.21.15.203:6832/3132962224,v1:172.21.15.203:6833/3132962224] up:boot 2024-09-19T08:08:28.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:28 smithi155 ceph-mon[35362]: fsmap 1 up:standby 2024-09-19T08:08:28.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:28 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:08:28.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:28 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:28.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:28 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:28.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:28 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:28.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:28 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:28.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:28 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:28.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:28 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:28.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:28 smithi155 ceph-mon[35362]: Deploying daemon mds.k on smithi155 2024-09-19T08:08:29.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:28 smithi027 ceph-mon[31209]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:29.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:28 smithi027 ceph-mon[31209]: mds.? [v2:172.21.15.203:6832/3132962224,v1:172.21.15.203:6833/3132962224] up:boot 2024-09-19T08:08:29.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:28 smithi027 ceph-mon[31209]: fsmap 1 up:standby 2024-09-19T08:08:29.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:28 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:08:29.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:28 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:29.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:28 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:29.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:28 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:29.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:28 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:29.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:28 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:29.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:28 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:29.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:28 smithi027 ceph-mon[31209]: Deploying daemon mds.k on smithi155 2024-09-19T08:08:29.013 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:28 smithi203 ceph-mon[35198]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:29.013 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:28 smithi203 ceph-mon[35198]: mds.? [v2:172.21.15.203:6832/3132962224,v1:172.21.15.203:6833/3132962224] up:boot 2024-09-19T08:08:29.013 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:28 smithi203 ceph-mon[35198]: fsmap 1 up:standby 2024-09-19T08:08:29.013 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:28 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:08:29.013 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:28 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:29.013 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:28 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:29.013 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:28 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:29.013 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:28 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:29.014 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:28 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:29.014 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:28 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:29.014 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:28 smithi203 ceph-mon[35198]: Deploying daemon mds.k on smithi155 2024-09-19T08:08:29.363 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:08:29.632 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:08:29.737 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:08:29 smithi155 systemd[1]: Starting Ceph mds.k for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:08:30.107 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:08:29 smithi155 podman[64829]: 2024-09-19 08:08:29.757212738 +0000 UTC m=+0.016561898 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:08:30.107 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:08:29 smithi155 podman[64829]: 2024-09-19 08:08:29.871569709 +0000 UTC m=+0.130918868 container create bb25850358b3fff7b914a9ced917440446a360fc91dc5a784ebf1141e89de467 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-k, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T08:08:30.107 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:08:30 smithi155 podman[64829]: 2024-09-19 08:08:30.107674642 +0000 UTC m=+0.367023794 container init bb25850358b3fff7b914a9ced917440446a360fc91dc5a784ebf1141e89de467 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-k, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T08:08:30.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.250+0000 7fbbad1cf640 1 -- 172.21.15.27:0/1949528534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbba8101de0 msgr2=0x7fbba81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:30.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.250+0000 7fbbad1cf640 1 --2- 172.21.15.27:0/1949528534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbba8101de0 0x7fbba81021c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009900 tx=0x7fbb9802a410 comp rx=0 tx=0).stop 2024-09-19T08:08:30.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.250+0000 7fbbad1cf640 1 -- 172.21.15.27:0/1949528534 shutdown_connections 2024-09-19T08:08:30.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.250+0000 7fbbad1cf640 1 --2- 172.21.15.27:0/1949528534 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbba8106f10 0x7fbba810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:30.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.250+0000 7fbbad1cf640 1 --2- 172.21.15.27:0/1949528534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba8102790 0x7fbba81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:30.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.250+0000 7fbbad1cf640 1 --2- 172.21.15.27:0/1949528534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbba8101de0 0x7fbba81021c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:30.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.250+0000 7fbbad1cf640 1 -- 172.21.15.27:0/1949528534 >> 172.21.15.27:0/1949528534 conn(0x7fbba80fd8c0 msgr2=0x7fbba80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:30.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.250+0000 7fbbad1cf640 1 -- 172.21.15.27:0/1949528534 shutdown_connections 2024-09-19T08:08:30.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.250+0000 7fbbad1cf640 1 -- 172.21.15.27:0/1949528534 wait complete. 2024-09-19T08:08:30.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.251+0000 7fbbad1cf640 1 Processor -- start 2024-09-19T08:08:30.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.251+0000 7fbbad1cf640 1 -- start start 2024-09-19T08:08:30.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.251+0000 7fbbad1cf640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbba8101de0 0x7fbba80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:30.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.251+0000 7fbbad1cf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbba8102790 0x7fbba8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:30.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.251+0000 7fbbad1cf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba8106f10 0x7fbba8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:30.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.251+0000 7fbbad1cf640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbba8111f90 con 0x7fbba8102790 2024-09-19T08:08:30.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.251+0000 7fbbad1cf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbba8111e10 con 0x7fbba8106f10 2024-09-19T08:08:30.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.251+0000 7fbbad1cf640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbba8112110 con 0x7fbba8101de0 2024-09-19T08:08:30.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.251+0000 7fbba659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbba8102790 0x7fbba8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:30.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.251+0000 7fbba659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbba8102790 0x7fbba8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55462/0 (socket says 172.21.15.27:55462) 2024-09-19T08:08:30.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.251+0000 7fbba659c640 1 -- 172.21.15.27:0/3184731735 learned_addr learned my addr 172.21.15.27:0/3184731735 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:08:30.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.251+0000 7fbba6d9d640 1 --2- 172.21.15.27:0/3184731735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbba8101de0 0x7fbba80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:30.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.251+0000 7fbba759e640 1 --2- 172.21.15.27:0/3184731735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba8106f10 0x7fbba8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:30.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.252+0000 7fbba659c640 1 -- 172.21.15.27:0/3184731735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbba8101de0 msgr2=0x7fbba80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:30.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.252+0000 7fbba659c640 1 --2- 172.21.15.27:0/3184731735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbba8101de0 0x7fbba80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:30.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.252+0000 7fbba659c640 1 -- 172.21.15.27:0/3184731735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba8106f10 msgr2=0x7fbba8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:30.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.252+0000 7fbba659c640 1 --2- 172.21.15.27:0/3184731735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba8106f10 0x7fbba8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:30.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.252+0000 7fbba659c640 1 -- 172.21.15.27:0/3184731735 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba81a6950 con 0x7fbba8102790 2024-09-19T08:08:30.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.252+0000 7fbba659c640 1 --2- 172.21.15.27:0/3184731735 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbba8102790 0x7fbba8074a30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00d950 tx=0x7fbb9c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:30.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.252+0000 7fbb8ffff640 1 -- 172.21.15.27:0/3184731735 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c017070 con 0x7fbba8102790 2024-09-19T08:08:30.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.252+0000 7fbbad1cf640 1 -- 172.21.15.27:0/3184731735 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbba81a6c40 con 0x7fbba8102790 2024-09-19T08:08:30.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.252+0000 7fbb8ffff640 1 -- 172.21.15.27:0/3184731735 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb9c009c30 con 0x7fbba8102790 2024-09-19T08:08:30.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.252+0000 7fbb8ffff640 1 -- 172.21.15.27:0/3184731735 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c00f6b0 con 0x7fbba8102790 2024-09-19T08:08:30.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.252+0000 7fbbad1cf640 1 -- 172.21.15.27:0/3184731735 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbba81a7180 con 0x7fbba8102790 2024-09-19T08:08:30.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.253+0000 7fbbad1cf640 1 -- 172.21.15.27:0/3184731735 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbba81021c0 con 0x7fbba8102790 2024-09-19T08:08:30.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.254+0000 7fbb8ffff640 1 -- 172.21.15.27:0/3184731735 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbb9c0109d0 con 0x7fbba8102790 2024-09-19T08:08:30.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.255+0000 7fbb8ffff640 1 --2- 172.21.15.27:0/3184731735 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fbb900a3240 0x7fbb900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:30.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.255+0000 7fbba6d9d640 1 --2- 172.21.15.27:0/3184731735 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fbb900a3240 0x7fbb900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:30.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.255+0000 7fbb8ffff640 1 -- 172.21.15.27:0/3184731735 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fbb9c0cefd0 con 0x7fbba8102790 2024-09-19T08:08:30.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.255+0000 7fbba6d9d640 1 --2- 172.21.15.27:0/3184731735 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fbb900a3240 0x7fbb900a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009230 tx=0x7fbb980058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:30.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.259+0000 7fbb8ffff640 1 -- 172.21.15.27:0/3184731735 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbb9c009de0 con 0x7fbba8102790 2024-09-19T08:08:30.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.477+0000 7fbbad1cf640 1 -- 172.21.15.27:0/3184731735 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbba802d7c0 con 0x7fbba8102790 2024-09-19T08:08:30.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.478+0000 7fbb8ffff640 1 -- 172.21.15.27:0/3184731735 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fbb9c09bb40 con 0x7fbba8102790 2024-09-19T08:08:30.479 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:08:30.479 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":2,"btime":"2024-09-19T08:08:27:500811+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T08:08:30.479 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 2 2024-09-19T08:08:30.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.480+0000 7fbbad1cf640 1 -- 172.21.15.27:0/3184731735 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fbb900a3240 msgr2=0x7fbb900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:30.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.480+0000 7fbbad1cf640 1 --2- 172.21.15.27:0/3184731735 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fbb900a3240 0x7fbb900a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009230 tx=0x7fbb980058d0 comp rx=0 tx=0).stop 2024-09-19T08:08:30.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.481+0000 7fbbad1cf640 1 -- 172.21.15.27:0/3184731735 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbba8102790 msgr2=0x7fbba8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:30.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.481+0000 7fbbad1cf640 1 --2- 172.21.15.27:0/3184731735 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbba8102790 0x7fbba8074a30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00d950 tx=0x7fbb9c00de10 comp rx=0 tx=0).stop 2024-09-19T08:08:30.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.481+0000 7fbbad1cf640 1 -- 172.21.15.27:0/3184731735 shutdown_connections 2024-09-19T08:08:30.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.481+0000 7fbbad1cf640 1 --2- 172.21.15.27:0/3184731735 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fbb900a3240 0x7fbb900a5700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:30.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.481+0000 7fbbad1cf640 1 --2- 172.21.15.27:0/3184731735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba8106f10 0x7fbba8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:30.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.481+0000 7fbbad1cf640 1 --2- 172.21.15.27:0/3184731735 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbba8102790 0x7fbba8074a30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:30.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.481+0000 7fbbad1cf640 1 --2- 172.21.15.27:0/3184731735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbba8101de0 0x7fbba80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:30.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.481+0000 7fbbad1cf640 1 -- 172.21.15.27:0/3184731735 >> 172.21.15.27:0/3184731735 conn(0x7fbba80fd8c0 msgr2=0x7fbba80fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:30.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.481+0000 7fbbad1cf640 1 -- 172.21.15.27:0/3184731735 shutdown_connections 2024-09-19T08:08:30.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:30.481+0000 7fbbad1cf640 1 -- 172.21.15.27:0/3184731735 wait complete. 2024-09-19T08:08:30.487 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:08:30 smithi155 podman[64829]: 2024-09-19 08:08:30.110782659 +0000 UTC m=+0.370131812 container start bb25850358b3fff7b914a9ced917440446a360fc91dc5a784ebf1141e89de467 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-k, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T08:08:30.487 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:08:30 smithi155 ceph-mds[64848]: -- 172.21.15.155:0/2062350454 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5557568d5860 con 0x5557568b3400 2024-09-19T08:08:30.487 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:08:30 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-k[64844]: starting mds.k at 2024-09-19T08:08:30.487 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:08:30 smithi155 bash[64829]: bb25850358b3fff7b914a9ced917440446a360fc91dc5a784ebf1141e89de467 2024-09-19T08:08:30.487 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:08:30 smithi155 systemd[1]: Started Ceph mds.k for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:08:30.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:30 smithi027 ceph-mon[31209]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:30.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:30 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:30.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:30 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:30.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:30 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:30.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:30 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:30.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:30 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:30.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:30 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:30.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:30 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3184731735' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:30.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:30 smithi155 ceph-mon[35362]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:30.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:30 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:30.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:30 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:30.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:30 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:30.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:30 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:30.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:30 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:30.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:30 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:30.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:30 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3184731735' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:31.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:30 smithi203 ceph-mon[35198]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:31.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:30 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:31.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:30 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:31.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:30 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:31.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:30 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:31.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:30 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:31.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:30 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:31.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:30 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3184731735' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:31.541 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:31 smithi155 ceph-mon[35362]: Deploying daemon mds.j on smithi027 2024-09-19T08:08:31.541 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:31 smithi155 ceph-mon[35362]: mds.? [v2:172.21.15.155:6832/1589376541,v1:172.21.15.155:6833/1589376541] up:boot 2024-09-19T08:08:31.541 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:31 smithi155 ceph-mon[35362]: fsmap 2 up:standby 2024-09-19T08:08:31.542 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:31 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:08:31.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:31 smithi027 ceph-mon[31209]: Deploying daemon mds.j on smithi027 2024-09-19T08:08:31.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:31 smithi027 ceph-mon[31209]: mds.? [v2:172.21.15.155:6832/1589376541,v1:172.21.15.155:6833/1589376541] up:boot 2024-09-19T08:08:31.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:31 smithi027 ceph-mon[31209]: fsmap 2 up:standby 2024-09-19T08:08:31.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:31 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:08:32.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:31 smithi203 ceph-mon[35198]: Deploying daemon mds.j on smithi027 2024-09-19T08:08:32.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:31 smithi203 ceph-mon[35198]: mds.? [v2:172.21.15.155:6832/1589376541,v1:172.21.15.155:6833/1589376541] up:boot 2024-09-19T08:08:32.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:31 smithi203 ceph-mon[35198]: fsmap 2 up:standby 2024-09-19T08:08:32.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:31 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:08:32.672 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:32 smithi027 ceph-mon[31209]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:32.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:32 smithi155 ceph-mon[35362]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:33.002 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 19 08:08:32 smithi027 systemd[1]: Starting Ceph mds.j for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:08:33.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:32 smithi203 ceph-mon[35198]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:33.193 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:08:33.315 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 19 08:08:33 smithi027 podman[70566]: 2024-09-19 08:08:33.071253115 +0000 UTC m=+0.113212963 container create b10afa03a215f93f9ea5262c9994402d6c2960ff530cb2db60659099154eee18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-j, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T08:08:33.315 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 19 08:08:33 smithi027 podman[70566]: 2024-09-19 08:08:32.97496172 +0000 UTC m=+0.016921566 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:08:33.315 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 19 08:08:33 smithi027 podman[70566]: 2024-09-19 08:08:33.315813903 +0000 UTC m=+0.357773749 container init b10afa03a215f93f9ea5262c9994402d6c2960ff530cb2db60659099154eee18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-j, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T08:08:33.478 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:08:33.601 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 19 08:08:33 smithi027 podman[70566]: 2024-09-19 08:08:33.319766169 +0000 UTC m=+0.361726014 container start b10afa03a215f93f9ea5262c9994402d6c2960ff530cb2db60659099154eee18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-j, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T08:08:33.601 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 19 08:08:33 smithi027 ceph-mds[70604]: -- 172.21.15.27:0/2270496675 <== mon.0 v2:172.21.15.27:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b22ed53860 con 0x55b22ed31000 2024-09-19T08:08:33.601 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 19 08:08:33 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-j[70582]: starting mds.j at 2024-09-19T08:08:33.601 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 19 08:08:33 smithi027 bash[70566]: b10afa03a215f93f9ea5262c9994402d6c2960ff530cb2db60659099154eee18 2024-09-19T08:08:33.601 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 19 08:08:33 smithi027 systemd[1]: Started Ceph mds.j for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:08:33.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.952+0000 7fad4d624640 1 -- 172.21.15.27:0/3161986297 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad4810e480 msgr2=0x7fad48110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:33.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.952+0000 7fad4d624640 1 --2- 172.21.15.27:0/3161986297 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad4810e480 0x7fad48110870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fad40009ca0 tx=0x7fad4002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:08:33.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.952+0000 7fad4d624640 1 -- 172.21.15.27:0/3161986297 shutdown_connections 2024-09-19T08:08:33.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.952+0000 7fad4d624640 1 --2- 172.21.15.27:0/3161986297 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad4810e480 0x7fad48110870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:33.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.952+0000 7fad4d624640 1 --2- 172.21.15.27:0/3161986297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad48101280 0x7fad4810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:33.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.952+0000 7fad4d624640 1 --2- 172.21.15.27:0/3161986297 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad481008d0 0x7fad48100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:33.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.952+0000 7fad4d624640 1 -- 172.21.15.27:0/3161986297 >> 172.21.15.27:0/3161986297 conn(0x7fad480fc7a0 msgr2=0x7fad480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:33.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.952+0000 7fad4d624640 1 -- 172.21.15.27:0/3161986297 shutdown_connections 2024-09-19T08:08:33.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.952+0000 7fad4d624640 1 -- 172.21.15.27:0/3161986297 wait complete. 2024-09-19T08:08:33.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.952+0000 7fad4d624640 1 Processor -- start 2024-09-19T08:08:33.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.953+0000 7fad4d624640 1 -- start start 2024-09-19T08:08:33.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.953+0000 7fad4d624640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad481008d0 0x7fad4819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:33.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.953+0000 7fad4d624640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad48101280 0x7fad4819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:33.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.953+0000 7fad4d624640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad4810e480 0x7fad4819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:33.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.953+0000 7fad4d624640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fad48114170 con 0x7fad481008d0 2024-09-19T08:08:33.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.953+0000 7fad4d624640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fad48113ff0 con 0x7fad48101280 2024-09-19T08:08:33.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.953+0000 7fad4d624640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fad481142f0 con 0x7fad4810e480 2024-09-19T08:08:33.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.953+0000 7fad46ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad481008d0 0x7fad4819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:33.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.953+0000 7fad46ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad481008d0 0x7fad4819a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55502/0 (socket says 172.21.15.27:55502) 2024-09-19T08:08:33.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.953+0000 7fad46ffd640 1 -- 172.21.15.27:0/3122761335 learned_addr learned my addr 172.21.15.27:0/3122761335 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:08:33.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.953+0000 7fad467fc640 1 --2- 172.21.15.27:0/3122761335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad48101280 0x7fad4819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:33.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.953+0000 7fad477fe640 1 --2- 172.21.15.27:0/3122761335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad4810e480 0x7fad4819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:33.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.953+0000 7fad46ffd640 1 -- 172.21.15.27:0/3122761335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad4810e480 msgr2=0x7fad4819ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:33.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.953+0000 7fad46ffd640 1 --2- 172.21.15.27:0/3122761335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad4810e480 0x7fad4819ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:33.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.953+0000 7fad46ffd640 1 -- 172.21.15.27:0/3122761335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad48101280 msgr2=0x7fad4819abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:33.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.953+0000 7fad46ffd640 1 --2- 172.21.15.27:0/3122761335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad48101280 0x7fad4819abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:33.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.953+0000 7fad46ffd640 1 -- 172.21.15.27:0/3122761335 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad4819f620 con 0x7fad481008d0 2024-09-19T08:08:33.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.953+0000 7fad467fc640 1 --2- 172.21.15.27:0/3122761335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad48101280 0x7fad4819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:08:33.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.953+0000 7fad46ffd640 1 --2- 172.21.15.27:0/3122761335 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad481008d0 0x7fad4819a670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fad3800e9f0 tx=0x7fad3800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:33.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.954+0000 7fad2ffff640 1 -- 172.21.15.27:0/3122761335 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3800cd80 con 0x7fad481008d0 2024-09-19T08:08:33.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.954+0000 7fad2ffff640 1 -- 172.21.15.27:0/3122761335 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad38005500 con 0x7fad481008d0 2024-09-19T08:08:33.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.954+0000 7fad4d624640 1 -- 172.21.15.27:0/3122761335 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad4819f910 con 0x7fad481008d0 2024-09-19T08:08:33.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.954+0000 7fad2ffff640 1 -- 172.21.15.27:0/3122761335 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad38010690 con 0x7fad481008d0 2024-09-19T08:08:33.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.954+0000 7fad4d624640 1 -- 172.21.15.27:0/3122761335 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad481a71f0 con 0x7fad481008d0 2024-09-19T08:08:33.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.955+0000 7fad4d624640 1 -- 172.21.15.27:0/3122761335 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad48100cb0 con 0x7fad481008d0 2024-09-19T08:08:33.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.956+0000 7fad2ffff640 1 -- 172.21.15.27:0/3122761335 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fad380046c0 con 0x7fad481008d0 2024-09-19T08:08:33.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.957+0000 7fad2ffff640 1 --2- 172.21.15.27:0/3122761335 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fad300a3240 0x7fad300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:33.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.957+0000 7fad467fc640 1 --2- 172.21.15.27:0/3122761335 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fad300a3240 0x7fad300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:33.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.957+0000 7fad2ffff640 1 -- 172.21.15.27:0/3122761335 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fad380cfbc0 con 0x7fad481008d0 2024-09-19T08:08:33.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.957+0000 7fad467fc640 1 --2- 172.21.15.27:0/3122761335 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fad300a3240 0x7fad300a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fad3c005fd0 tx=0x7fad3c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:33.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:33.960+0000 7fad2ffff640 1 -- 172.21.15.27:0/3122761335 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fad38054210 con 0x7fad481008d0 2024-09-19T08:08:34.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:34.177+0000 7fad4d624640 1 -- 172.21.15.27:0/3122761335 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad4819b9d0 con 0x7fad481008d0 2024-09-19T08:08:34.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:34.178+0000 7fad2ffff640 1 -- 172.21.15.27:0/3122761335 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7fad3801f340 con 0x7fad481008d0 2024-09-19T08:08:34.179 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:08:34.179 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":4,"btime":"2024-09-19T08:08:33:527988+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T08:08:34.179 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 4 2024-09-19T08:08:34.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:34.180+0000 7fad4d624640 1 -- 172.21.15.27:0/3122761335 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fad300a3240 msgr2=0x7fad300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:34.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:34.180+0000 7fad4d624640 1 --2- 172.21.15.27:0/3122761335 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fad300a3240 0x7fad300a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fad3c005fd0 tx=0x7fad3c005850 comp rx=0 tx=0).stop 2024-09-19T08:08:34.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:34.180+0000 7fad4d624640 1 -- 172.21.15.27:0/3122761335 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad481008d0 msgr2=0x7fad4819a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:34.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:34.180+0000 7fad4d624640 1 --2- 172.21.15.27:0/3122761335 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad481008d0 0x7fad4819a670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fad3800e9f0 tx=0x7fad3800edf0 comp rx=0 tx=0).stop 2024-09-19T08:08:34.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:34.181+0000 7fad4d624640 1 -- 172.21.15.27:0/3122761335 shutdown_connections 2024-09-19T08:08:34.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:34.181+0000 7fad4d624640 1 --2- 172.21.15.27:0/3122761335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad4810e480 0x7fad4819ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:34.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:34.181+0000 7fad4d624640 1 --2- 172.21.15.27:0/3122761335 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fad300a3240 0x7fad300a5700 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:34.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:34.181+0000 7fad4d624640 1 --2- 172.21.15.27:0/3122761335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad48101280 0x7fad4819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:34.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:34.181+0000 7fad4d624640 1 --2- 172.21.15.27:0/3122761335 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad481008d0 0x7fad4819a670 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:34.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:34.181+0000 7fad4d624640 1 -- 172.21.15.27:0/3122761335 >> 172.21.15.27:0/3122761335 conn(0x7fad480fc7a0 msgr2=0x7fad480feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:34.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:34.181+0000 7fad4d624640 1 -- 172.21.15.27:0/3122761335 shutdown_connections 2024-09-19T08:08:34.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:34.181+0000 7fad4d624640 1 -- 172.21.15.27:0/3122761335 wait complete. 2024-09-19T08:08:34.741 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:34 smithi155 ceph-mon[35362]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:34.741 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:34.741 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:34.741 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:34.741 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:34.741 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:34.742 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:34.742 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:34 smithi155 ceph-mon[35362]: Deploying daemon mds.d on smithi027 2024-09-19T08:08:34.742 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:34 smithi155 ceph-mon[35362]: mds.? [v2:172.21.15.27:6834/2839073918,v1:172.21.15.27:6835/2839073918] up:boot 2024-09-19T08:08:34.742 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:34 smithi155 ceph-mon[35362]: fsmap 3 up:standby 2024-09-19T08:08:34.742 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:34 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:08:34.742 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:34 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3122761335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:34.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:34 smithi027 ceph-mon[31209]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:34.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:34.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:34.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:34.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:34.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:34.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:34.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:34 smithi027 ceph-mon[31209]: Deploying daemon mds.d on smithi027 2024-09-19T08:08:34.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:34 smithi027 ceph-mon[31209]: mds.? [v2:172.21.15.27:6834/2839073918,v1:172.21.15.27:6835/2839073918] up:boot 2024-09-19T08:08:34.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:34 smithi027 ceph-mon[31209]: fsmap 3 up:standby 2024-09-19T08:08:34.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:34 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:08:34.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:34 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3122761335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:34.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:34 smithi203 ceph-mon[35198]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:34.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:34.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:34.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:34.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:34.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:34.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:34.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:34 smithi203 ceph-mon[35198]: Deploying daemon mds.d on smithi027 2024-09-19T08:08:34.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:34 smithi203 ceph-mon[35198]: mds.? [v2:172.21.15.27:6834/2839073918,v1:172.21.15.27:6835/2839073918] up:boot 2024-09-19T08:08:34.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:34 smithi203 ceph-mon[35198]: fsmap 3 up:standby 2024-09-19T08:08:34.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:34 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:08:34.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:34 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3122761335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:36.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:36 smithi027 ceph-mon[31209]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:36.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:36 smithi155 ceph-mon[35362]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:36.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:36 smithi203 ceph-mon[35198]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:37.252 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 19 08:08:37 smithi027 systemd[1]: Started Ceph mds.d for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:08:37.501 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:08:37.766 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:08:38.161 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:38 smithi027 ceph-mon[31209]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:38.161 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:38 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:38.161 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:38 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:38.161 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:38 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:38.161 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:38 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:38.161 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:38 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:38.161 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:38 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:38.161 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:38 smithi027 ceph-mon[31209]: Deploying daemon mds.e on smithi155 2024-09-19T08:08:38.161 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:38 smithi027 ceph-mon[31209]: mds.? [v2:172.21.15.27:6836/1473265593,v1:172.21.15.27:6837/1473265593] up:boot 2024-09-19T08:08:38.162 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:38 smithi027 ceph-mon[31209]: fsmap 4 up:standby 2024-09-19T08:08:38.162 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:38 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:08:38.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.245+0000 7f5ff57ea640 1 -- 172.21.15.27:0/3696435033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ff0102da0 msgr2=0x7f5ff0103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:38.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.245+0000 7f5ff57ea640 1 --2- 172.21.15.27:0/3696435033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ff0102da0 0x7f5ff0103180 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0009900 tx=0x7f5fe002a480 comp rx=0 tx=0).stop 2024-09-19T08:08:38.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.245+0000 7f5ff57ea640 1 -- 172.21.15.27:0/3696435033 shutdown_connections 2024-09-19T08:08:38.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.245+0000 7f5ff57ea640 1 --2- 172.21.15.27:0/3696435033 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ff010c180 0x7f5ff010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:38.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.245+0000 7f5ff57ea640 1 --2- 172.21.15.27:0/3696435033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ff01036c0 0x7f5ff010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:38.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.245+0000 7f5ff57ea640 1 --2- 172.21.15.27:0/3696435033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ff0102da0 0x7f5ff0103180 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:38.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.245+0000 7f5ff57ea640 1 -- 172.21.15.27:0/3696435033 >> 172.21.15.27:0/3696435033 conn(0x7f5ff00fc7a0 msgr2=0x7f5ff00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:38.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.245+0000 7f5ff57ea640 1 -- 172.21.15.27:0/3696435033 shutdown_connections 2024-09-19T08:08:38.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.245+0000 7f5ff57ea640 1 -- 172.21.15.27:0/3696435033 wait complete. 2024-09-19T08:08:38.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.245+0000 7f5ff57ea640 1 Processor -- start 2024-09-19T08:08:38.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.246+0000 7f5ff57ea640 1 -- start start 2024-09-19T08:08:38.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.246+0000 7f5ff57ea640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ff0102da0 0x7f5ff0100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:38.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.246+0000 7f5ff57ea640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ff01036c0 0x7f5ff0100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:38.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.246+0000 7f5ff57ea640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ff010c180 0x7f5ff0101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:38.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.246+0000 7f5ff57ea640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff0111f60 con 0x7f5ff010c180 2024-09-19T08:08:38.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.246+0000 7f5ff57ea640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff0111de0 con 0x7f5ff01036c0 2024-09-19T08:08:38.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.246+0000 7f5ff57ea640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff01120e0 con 0x7f5ff0102da0 2024-09-19T08:08:38.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.246+0000 7f5fef7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ff010c180 0x7f5ff0101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:38.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.246+0000 7f5fef7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ff010c180 0x7f5ff0101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55546/0 (socket says 172.21.15.27:55546) 2024-09-19T08:08:38.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.246+0000 7f5fef7fe640 1 -- 172.21.15.27:0/3327185216 learned_addr learned my addr 172.21.15.27:0/3327185216 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:08:38.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.246+0000 7f5fee7fc640 1 --2- 172.21.15.27:0/3327185216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ff01036c0 0x7f5ff0100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:38.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.246+0000 7f5feeffd640 1 --2- 172.21.15.27:0/3327185216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ff0102da0 0x7f5ff0100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:38.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.246+0000 7f5fee7fc640 1 -- 172.21.15.27:0/3327185216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ff0102da0 msgr2=0x7f5ff0100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:38.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.246+0000 7f5fee7fc640 1 --2- 172.21.15.27:0/3327185216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ff0102da0 0x7f5ff0100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:38.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.246+0000 7f5fee7fc640 1 -- 172.21.15.27:0/3327185216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ff010c180 msgr2=0x7f5ff0101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:38.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.246+0000 7f5fee7fc640 1 --2- 172.21.15.27:0/3327185216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ff010c180 0x7f5ff0101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:38.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.247+0000 7f5fee7fc640 1 -- 172.21.15.27:0/3327185216 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff01a68a0 con 0x7f5ff01036c0 2024-09-19T08:08:38.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.247+0000 7f5fef7fe640 1 --2- 172.21.15.27:0/3327185216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ff010c180 0x7f5ff0101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:08:38.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.247+0000 7f5fee7fc640 1 --2- 172.21.15.27:0/3327185216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ff01036c0 0x7f5ff0100f40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4005fd0 tx=0x7f5fe400dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:38.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.247+0000 7f5fd7fff640 1 -- 172.21.15.27:0/3327185216 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4009c30 con 0x7f5ff01036c0 2024-09-19T08:08:38.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.247+0000 7f5ff57ea640 1 -- 172.21.15.27:0/3327185216 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff01a6b90 con 0x7f5ff01036c0 2024-09-19T08:08:38.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.247+0000 7f5fd7fff640 1 -- 172.21.15.27:0/3327185216 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fe4009dd0 con 0x7f5ff01036c0 2024-09-19T08:08:38.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.247+0000 7f5fd7fff640 1 -- 172.21.15.27:0/3327185216 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4010460 con 0x7f5ff01036c0 2024-09-19T08:08:38.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.247+0000 7f5ff57ea640 1 -- 172.21.15.27:0/3327185216 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff01a7120 con 0x7f5ff01036c0 2024-09-19T08:08:38.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.248+0000 7f5ff57ea640 1 -- 172.21.15.27:0/3327185216 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff0103180 con 0x7f5ff01036c0 2024-09-19T08:08:38.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.249+0000 7f5fd7fff640 1 -- 172.21.15.27:0/3327185216 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5fe4003ef0 con 0x7f5ff01036c0 2024-09-19T08:08:38.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.250+0000 7f5fd7fff640 1 --2- 172.21.15.27:0/3327185216 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f5fd80a32c0 0x7f5fd80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:38.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.250+0000 7f5feeffd640 1 --2- 172.21.15.27:0/3327185216 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f5fd80a32c0 0x7f5fd80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:38.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.250+0000 7f5fd7fff640 1 -- 172.21.15.27:0/3327185216 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f5fe40cef20 con 0x7f5ff01036c0 2024-09-19T08:08:38.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.250+0000 7f5feeffd640 1 --2- 172.21.15.27:0/3327185216 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f5fd80a32c0 0x7f5fd80a5780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0009230 tx=0x7f5fe00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:38.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.253+0000 7f5fd7fff640 1 -- 172.21.15.27:0/3327185216 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5fe4017020 con 0x7f5ff01036c0 2024-09-19T08:08:38.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.465+0000 7f5ff57ea640 1 -- 172.21.15.27:0/3327185216 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ff0101f30 con 0x7f5ff01036c0 2024-09-19T08:08:38.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.466+0000 7f5fd7fff640 1 -- 172.21.15.27:0/3327185216 <== mon.2 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3916 (secure 0 0 0) 0x7f5ff0101f30 con 0x7f5ff01036c0 2024-09-19T08:08:38.467 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:08:38.467 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":5,"btime":"2024-09-19T08:08:37:468225+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T08:08:38.467 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 5 2024-09-19T08:08:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.468+0000 7f5ff57ea640 1 -- 172.21.15.27:0/3327185216 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f5fd80a32c0 msgr2=0x7f5fd80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.468+0000 7f5ff57ea640 1 --2- 172.21.15.27:0/3327185216 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f5fd80a32c0 0x7f5fd80a5780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0009230 tx=0x7f5fe00058d0 comp rx=0 tx=0).stop 2024-09-19T08:08:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.468+0000 7f5ff57ea640 1 -- 172.21.15.27:0/3327185216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ff01036c0 msgr2=0x7f5ff0100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.468+0000 7f5ff57ea640 1 --2- 172.21.15.27:0/3327185216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ff01036c0 0x7f5ff0100f40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4005fd0 tx=0x7f5fe400dde0 comp rx=0 tx=0).stop 2024-09-19T08:08:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.468+0000 7f5ff57ea640 1 -- 172.21.15.27:0/3327185216 shutdown_connections 2024-09-19T08:08:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.468+0000 7f5ff57ea640 1 --2- 172.21.15.27:0/3327185216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ff010c180 0x7f5ff0101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.468+0000 7f5ff57ea640 1 --2- 172.21.15.27:0/3327185216 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f5fd80a32c0 0x7f5fd80a5780 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.468+0000 7f5ff57ea640 1 --2- 172.21.15.27:0/3327185216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ff01036c0 0x7f5ff0100f40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.468+0000 7f5ff57ea640 1 --2- 172.21.15.27:0/3327185216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ff0102da0 0x7f5ff0100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.468+0000 7f5ff57ea640 1 -- 172.21.15.27:0/3327185216 >> 172.21.15.27:0/3327185216 conn(0x7f5ff00fc7a0 msgr2=0x7f5ff00fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:38.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.468+0000 7f5ff57ea640 1 -- 172.21.15.27:0/3327185216 shutdown_connections 2024-09-19T08:08:38.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:38.468+0000 7f5ff57ea640 1 -- 172.21.15.27:0/3327185216 wait complete. 2024-09-19T08:08:38.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:38 smithi155 ceph-mon[35362]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:38.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:38 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:38.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:38 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:38.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:38 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:38.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:38 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:38.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:38 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:38.488 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:38 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:38.488 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:38 smithi155 ceph-mon[35362]: Deploying daemon mds.e on smithi155 2024-09-19T08:08:38.488 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:38 smithi155 ceph-mon[35362]: mds.? [v2:172.21.15.27:6836/1473265593,v1:172.21.15.27:6837/1473265593] up:boot 2024-09-19T08:08:38.488 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:38 smithi155 ceph-mon[35362]: fsmap 4 up:standby 2024-09-19T08:08:38.488 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:38 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:08:38.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:38 smithi203 ceph-mon[35198]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:38.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:38 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:38.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:38 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:38.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:38 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:38.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:38 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:38.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:38 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:38.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:38 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:38.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:38 smithi203 ceph-mon[35198]: Deploying daemon mds.e on smithi155 2024-09-19T08:08:38.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:38 smithi203 ceph-mon[35198]: mds.? [v2:172.21.15.27:6836/1473265593,v1:172.21.15.27:6837/1473265593] up:boot 2024-09-19T08:08:38.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:38 smithi203 ceph-mon[35198]: fsmap 4 up:standby 2024-09-19T08:08:38.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:38 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:08:39.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:39 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3327185216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:39.237 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:08:39 smithi155 systemd[1]: Starting Ceph mds.e for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:08:39.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:39 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3327185216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:39.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:39 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3327185216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:39.639 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:08:39 smithi155 podman[65145]: 2024-09-19 08:08:39.267820098 +0000 UTC m=+0.016113518 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:08:39.639 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:08:39 smithi155 podman[65145]: 2024-09-19 08:08:39.385255246 +0000 UTC m=+0.133548658 container create c5f73582f5f337214a12228cf4c8113e37c562af38f5fc690a275722dd091701 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T08:08:39.639 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:08:39 smithi155 podman[65145]: 2024-09-19 08:08:39.612844484 +0000 UTC m=+0.361137904 container init c5f73582f5f337214a12228cf4c8113e37c562af38f5fc690a275722dd091701 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T08:08:39.639 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:08:39 smithi155 podman[65145]: 2024-09-19 08:08:39.615557359 +0000 UTC m=+0.363850771 container start c5f73582f5f337214a12228cf4c8113e37c562af38f5fc690a275722dd091701 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T08:08:39.987 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:08:39 smithi155 ceph-mds[65164]: -- 172.21.15.155:0/3987360084 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5556cf661c20 con 0x5556cf63f400 2024-09-19T08:08:39.987 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:08:39 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-e[65160]: starting mds.e at 2024-09-19T08:08:39.987 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:08:39 smithi155 bash[65145]: c5f73582f5f337214a12228cf4c8113e37c562af38f5fc690a275722dd091701 2024-09-19T08:08:39.987 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:08:39 smithi155 systemd[1]: Started Ceph mds.e for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:08:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:40 smithi203 ceph-mon[35198]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:40 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:40 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:40 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:40 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:41.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:40 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:41.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:40 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:41.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:40 smithi203 ceph-mon[35198]: Deploying daemon mds.f on smithi203 2024-09-19T08:08:41.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:40 smithi203 ceph-mon[35198]: mds.? [v2:172.21.15.155:6834/3102690439,v1:172.21.15.155:6835/3102690439] up:boot 2024-09-19T08:08:41.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:40 smithi203 ceph-mon[35198]: fsmap 5 up:standby 2024-09-19T08:08:41.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:40 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:08:41.086 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:08:41.116 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:40 smithi027 ceph-mon[31209]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:41.116 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:40 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:41.116 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:40 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:41.117 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:40 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:41.117 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:40 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:41.117 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:40 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:41.117 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:40 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:41.117 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:40 smithi027 ceph-mon[31209]: Deploying daemon mds.f on smithi203 2024-09-19T08:08:41.117 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:40 smithi027 ceph-mon[31209]: mds.? [v2:172.21.15.155:6834/3102690439,v1:172.21.15.155:6835/3102690439] up:boot 2024-09-19T08:08:41.117 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:40 smithi027 ceph-mon[31209]: fsmap 5 up:standby 2024-09-19T08:08:41.117 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:40 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:08:41.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:40 smithi155 ceph-mon[35362]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:41.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:40 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:41.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:40 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:41.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:40 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:41.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:40 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:41.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:40 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:41.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:40 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:41.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:40 smithi155 ceph-mon[35362]: Deploying daemon mds.f on smithi203 2024-09-19T08:08:41.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:40 smithi155 ceph-mon[35362]: mds.? [v2:172.21.15.155:6834/3102690439,v1:172.21.15.155:6835/3102690439] up:boot 2024-09-19T08:08:41.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:40 smithi155 ceph-mon[35362]: fsmap 5 up:standby 2024-09-19T08:08:41.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:40 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:08:41.357 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:08:41.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.801+0000 7f736d445640 1 -- 172.21.15.27:0/2842628898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7368102d30 msgr2=0x7f7368103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:41.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.801+0000 7f736d445640 1 --2- 172.21.15.27:0/2842628898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7368102d30 0x7f7368103110 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7360009930 tx=0x7f736002a460 comp rx=0 tx=0).stop 2024-09-19T08:08:41.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.801+0000 7f736d445640 1 -- 172.21.15.27:0/2842628898 shutdown_connections 2024-09-19T08:08:41.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.801+0000 7f736d445640 1 --2- 172.21.15.27:0/2842628898 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73681082a0 0x7f736810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:41.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.801+0000 7f736d445640 1 --2- 172.21.15.27:0/2842628898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73681036e0 0x7f7368107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:41.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.801+0000 7f736d445640 1 --2- 172.21.15.27:0/2842628898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7368102d30 0x7f7368103110 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:41.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.801+0000 7f736d445640 1 -- 172.21.15.27:0/2842628898 >> 172.21.15.27:0/2842628898 conn(0x7f73680fc7d0 msgr2=0x7f73680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:41.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.801+0000 7f736d445640 1 -- 172.21.15.27:0/2842628898 shutdown_connections 2024-09-19T08:08:41.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.801+0000 7f736d445640 1 -- 172.21.15.27:0/2842628898 wait complete. 2024-09-19T08:08:41.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.801+0000 7f736d445640 1 Processor -- start 2024-09-19T08:08:41.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.802+0000 7f736d445640 1 -- start start 2024-09-19T08:08:41.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.802+0000 7f736d445640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7368102d30 0x7f7368100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:41.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.802+0000 7f736d445640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73681036e0 0x7f7368100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:41.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.802+0000 7f736d445640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73681082a0 0x7f7368101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:41.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.802+0000 7f736d445640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7368112100 con 0x7f7368102d30 2024-09-19T08:08:41.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.802+0000 7f736d445640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7368111f80 con 0x7f73681036e0 2024-09-19T08:08:41.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.802+0000 7f736d445640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7368112280 con 0x7f73681082a0 2024-09-19T08:08:41.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.802+0000 7f7366ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7368102d30 0x7f7368100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:41.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.802+0000 7f7366ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7368102d30 0x7f7368100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55858/0 (socket says 172.21.15.27:55858) 2024-09-19T08:08:41.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.802+0000 7f7366ffd640 1 -- 172.21.15.27:0/2238845556 learned_addr learned my addr 172.21.15.27:0/2238845556 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:08:41.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.802+0000 7f73677fe640 1 --2- 172.21.15.27:0/2238845556 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73681082a0 0x7f7368101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:41.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.802+0000 7f73667fc640 1 --2- 172.21.15.27:0/2238845556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73681036e0 0x7f7368100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:41.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.802+0000 7f7366ffd640 1 -- 172.21.15.27:0/2238845556 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73681082a0 msgr2=0x7f7368101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:41.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.802+0000 7f7366ffd640 1 --2- 172.21.15.27:0/2238845556 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73681082a0 0x7f7368101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:41.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.802+0000 7f7366ffd640 1 -- 172.21.15.27:0/2238845556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73681036e0 msgr2=0x7f7368100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:41.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.802+0000 7f7366ffd640 1 --2- 172.21.15.27:0/2238845556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73681036e0 0x7f7368100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:41.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.802+0000 7f7366ffd640 1 -- 172.21.15.27:0/2238845556 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73681a6ae0 con 0x7f7368102d30 2024-09-19T08:08:41.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.802+0000 7f73667fc640 1 --2- 172.21.15.27:0/2238845556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73681036e0 0x7f7368100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:08:41.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.803+0000 7f7366ffd640 1 --2- 172.21.15.27:0/2238845556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7368102d30 0x7f7368100990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7360009230 tx=0x7f7360004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:41.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.803+0000 7f735ffff640 1 -- 172.21.15.27:0/2238845556 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736003f030 con 0x7f7368102d30 2024-09-19T08:08:41.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.803+0000 7f735ffff640 1 -- 172.21.15.27:0/2238845556 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7360003ad0 con 0x7f7368102d30 2024-09-19T08:08:41.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.803+0000 7f735ffff640 1 -- 172.21.15.27:0/2238845556 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7360035070 con 0x7f7368102d30 2024-09-19T08:08:41.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.803+0000 7f736d445640 1 -- 172.21.15.27:0/2238845556 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73681a6d70 con 0x7f7368102d30 2024-09-19T08:08:41.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.803+0000 7f736d445640 1 -- 172.21.15.27:0/2238845556 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73681a71f0 con 0x7f7368102d30 2024-09-19T08:08:41.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.804+0000 7f736d445640 1 -- 172.21.15.27:0/2238845556 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7368103110 con 0x7f7368102d30 2024-09-19T08:08:41.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.805+0000 7f735ffff640 1 -- 172.21.15.27:0/2238845556 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7360042030 con 0x7f7368102d30 2024-09-19T08:08:41.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.806+0000 7f735ffff640 1 --2- 172.21.15.27:0/2238845556 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f73540a3240 0x7f73540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:41.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.806+0000 7f73667fc640 1 --2- 172.21.15.27:0/2238845556 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f73540a3240 0x7f73540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:41.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.806+0000 7f735ffff640 1 -- 172.21.15.27:0/2238845556 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f73600ef940 con 0x7f7368102d30 2024-09-19T08:08:41.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.806+0000 7f73667fc640 1 --2- 172.21.15.27:0/2238845556 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f73540a3240 0x7f73540a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7368102420 tx=0x7f7350008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:41.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:41.810+0000 7f735ffff640 1 -- 172.21.15.27:0/2238845556 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f73600bcb00 con 0x7f7368102d30 2024-09-19T08:08:41.915 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:08:41 smithi203 systemd[1]: Starting Ceph mds.f for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:08:42.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:42.021+0000 7f736d445640 1 -- 172.21.15.27:0/2238845556 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f736810a2b0 con 0x7f7368102d30 2024-09-19T08:08:42.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:42.022+0000 7f735ffff640 1 -- 172.21.15.27:0/2238845556 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4744 (secure 0 0 0) 0x7f73600bc400 con 0x7f7368102d30 2024-09-19T08:08:42.023 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:08:42.023 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":6,"btime":"2024-09-19T08:08:40:119438+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T08:08:42.023 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 6 2024-09-19T08:08:42.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:42.024+0000 7f736d445640 1 -- 172.21.15.27:0/2238845556 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f73540a3240 msgr2=0x7f73540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:42.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:42.024+0000 7f736d445640 1 --2- 172.21.15.27:0/2238845556 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f73540a3240 0x7f73540a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7368102420 tx=0x7f7350008040 comp rx=0 tx=0).stop 2024-09-19T08:08:42.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:42.024+0000 7f736d445640 1 -- 172.21.15.27:0/2238845556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7368102d30 msgr2=0x7f7368100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:42.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:42.024+0000 7f736d445640 1 --2- 172.21.15.27:0/2238845556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7368102d30 0x7f7368100990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7360009230 tx=0x7f7360004270 comp rx=0 tx=0).stop 2024-09-19T08:08:42.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:42.024+0000 7f736d445640 1 -- 172.21.15.27:0/2238845556 shutdown_connections 2024-09-19T08:08:42.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:42.024+0000 7f736d445640 1 --2- 172.21.15.27:0/2238845556 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73681082a0 0x7f7368101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:42.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:42.024+0000 7f736d445640 1 --2- 172.21.15.27:0/2238845556 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f73540a3240 0x7f73540a5700 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:42.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:42.024+0000 7f736d445640 1 --2- 172.21.15.27:0/2238845556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73681036e0 0x7f7368100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:42.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:42.024+0000 7f736d445640 1 --2- 172.21.15.27:0/2238845556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7368102d30 0x7f7368100990 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:42.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:42.024+0000 7f736d445640 1 -- 172.21.15.27:0/2238845556 >> 172.21.15.27:0/2238845556 conn(0x7f73680fc7d0 msgr2=0x7f7368105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:42.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:42.024+0000 7f736d445640 1 -- 172.21.15.27:0/2238845556 shutdown_connections 2024-09-19T08:08:42.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:42.024+0000 7f736d445640 1 -- 172.21.15.27:0/2238845556 wait complete. 2024-09-19T08:08:42.184 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:08:41 smithi203 podman[64948]: 2024-09-19 08:08:41.817605867 +0000 UTC m=+0.015848073 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:08:42.184 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:08:41 smithi203 podman[64948]: 2024-09-19 08:08:41.92141424 +0000 UTC m=+0.119656445 container create 68d83f6463ba2a0e35abf36fe17323124e854cf954ad3e6af9a7705038dcfc90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T08:08:42.184 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:08:42 smithi203 podman[64948]: 2024-09-19 08:08:42.157391891 +0000 UTC m=+0.355634108 container init 68d83f6463ba2a0e35abf36fe17323124e854cf954ad3e6af9a7705038dcfc90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-f, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:08:42.184 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:08:42 smithi203 podman[64948]: 2024-09-19 08:08:42.16048265 +0000 UTC m=+0.358724858 container start 68d83f6463ba2a0e35abf36fe17323124e854cf954ad3e6af9a7705038dcfc90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-f, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T08:08:42.508 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:08:42 smithi203 ceph-mds[64967]: -- 172.21.15.203:0/3573474771 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557d6f25d860 con 0x557d6f23b400 2024-09-19T08:08:42.508 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:08:42 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-f[64963]: starting mds.f at 2024-09-19T08:08:42.508 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:08:42 smithi203 bash[64948]: 68d83f6463ba2a0e35abf36fe17323124e854cf954ad3e6af9a7705038dcfc90 2024-09-19T08:08:42.508 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:08:42 smithi203 systemd[1]: Started Ceph mds.f for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:08:42.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:42 smithi155 ceph-mon[35362]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:42.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:42 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2238845556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:42.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:42 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:42.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:42 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:42.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:42 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:42.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:42 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:42.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:42 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:42.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:42 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:43.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:42 smithi203 ceph-mon[35198]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:43.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:42 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2238845556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:43.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:42 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:43.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:42 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:43.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:42 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:43.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:42 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:43.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:42 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:43.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:42 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:43.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:42 smithi027 ceph-mon[31209]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:43.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:42 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2238845556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:43.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:42 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:43.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:42 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:43.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:42 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:43.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:42 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:43.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:42 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:43.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:42 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:43.866 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:43 smithi203 ceph-mon[35198]: Deploying daemon mds.c on smithi203 2024-09-19T08:08:43.866 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:43 smithi203 ceph-mon[35198]: mds.? [v2:172.21.15.203:6834/3596726506,v1:172.21.15.203:6835/3596726506] up:boot 2024-09-19T08:08:43.866 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:43 smithi203 ceph-mon[35198]: fsmap 6 up:standby 2024-09-19T08:08:43.866 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:43 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:08:44.244 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:43 smithi155 ceph-mon[35362]: Deploying daemon mds.c on smithi203 2024-09-19T08:08:44.244 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:43 smithi155 ceph-mon[35362]: mds.? [v2:172.21.15.203:6834/3596726506,v1:172.21.15.203:6835/3596726506] up:boot 2024-09-19T08:08:44.244 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:43 smithi155 ceph-mon[35362]: fsmap 6 up:standby 2024-09-19T08:08:44.244 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:43 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:08:44.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:43 smithi027 ceph-mon[31209]: Deploying daemon mds.c on smithi203 2024-09-19T08:08:44.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:43 smithi027 ceph-mon[31209]: mds.? [v2:172.21.15.203:6834/3596726506,v1:172.21.15.203:6835/3596726506] up:boot 2024-09-19T08:08:44.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:43 smithi027 ceph-mon[31209]: fsmap 6 up:standby 2024-09-19T08:08:44.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:43 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:08:44.508 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:08:44 smithi203 systemd[1]: Starting Ceph mds.c for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:08:44.720 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:08:44.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:44 smithi203 ceph-mon[35198]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:44.846 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:08:44 smithi203 podman[65253]: 2024-09-19 08:08:44.45844309 +0000 UTC m=+0.016403959 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:08:44.846 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:08:44 smithi203 podman[65253]: 2024-09-19 08:08:44.577021155 +0000 UTC m=+0.134982070 container create 710f87852e902214407801f06c15070ab65f83f2369057253881638b09825c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-c, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T08:08:44.846 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:08:44 smithi203 podman[65253]: 2024-09-19 08:08:44.847084775 +0000 UTC m=+0.405045645 container init 710f87852e902214407801f06c15070ab65f83f2369057253881638b09825c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-c, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T08:08:44.993 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:08:45.001 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:44 smithi027 ceph-mon[31209]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:45.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:44 smithi155 ceph-mon[35362]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:45.258 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:08:44 smithi203 podman[65253]: 2024-09-19 08:08:44.850050928 +0000 UTC m=+0.408011807 container start 710f87852e902214407801f06c15070ab65f83f2369057253881638b09825c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:08:45.258 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:08:44 smithi203 ceph-mds[65272]: -- 172.21.15.203:0/3326049571 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559f29c51860 con 0x559f29c2f400 2024-09-19T08:08:45.258 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:08:44 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-c[65268]: starting mds.c at 2024-09-19T08:08:45.258 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:08:44 smithi203 bash[65253]: 710f87852e902214407801f06c15070ab65f83f2369057253881638b09825c45 2024-09-19T08:08:45.258 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:08:44 smithi203 systemd[1]: Started Ceph mds.c for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:08:45.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.478+0000 7f7956c29640 1 -- 172.21.15.27:0/1358268458 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79501027c0 msgr2=0x7f7950106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:45.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.478+0000 7f7956c29640 1 --2- 172.21.15.27:0/1358268458 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79501027c0 0x7f7950106810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f793c009900 tx=0x7f793c02a410 comp rx=0 tx=0).stop 2024-09-19T08:08:45.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.478+0000 7f7956c29640 1 -- 172.21.15.27:0/1358268458 shutdown_connections 2024-09-19T08:08:45.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.478+0000 7f7956c29640 1 --2- 172.21.15.27:0/1358268458 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7950106f40 0x7f795010eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:45.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.478+0000 7f7956c29640 1 --2- 172.21.15.27:0/1358268458 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79501027c0 0x7f7950106810 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:45.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.478+0000 7f7956c29640 1 --2- 172.21.15.27:0/1358268458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7950101e10 0x7f79501021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:45.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.478+0000 7f7956c29640 1 -- 172.21.15.27:0/1358268458 >> 172.21.15.27:0/1358268458 conn(0x7f79500fd8d0 msgr2=0x7f79500ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:45.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.479+0000 7f7956c29640 1 -- 172.21.15.27:0/1358268458 shutdown_connections 2024-09-19T08:08:45.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.479+0000 7f7956c29640 1 -- 172.21.15.27:0/1358268458 wait complete. 2024-09-19T08:08:45.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.479+0000 7f7956c29640 1 Processor -- start 2024-09-19T08:08:45.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.479+0000 7f7956c29640 1 -- start start 2024-09-19T08:08:45.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f7956c29640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950101e10 0x7f79500744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:45.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f7956c29640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79501027c0 0x7f7950074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:45.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f7956c29640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7950106f40 0x7f7950074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:45.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f7956c29640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7950111f60 con 0x7f7950101e10 2024-09-19T08:08:45.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f7956c29640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7950111de0 con 0x7f7950106f40 2024-09-19T08:08:45.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f7956c29640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f79501120e0 con 0x7f79501027c0 2024-09-19T08:08:45.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f79549c5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950101e10 0x7f79500744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:45.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f79549c5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950101e10 0x7f79500744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55864/0 (socket says 172.21.15.27:55864) 2024-09-19T08:08:45.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f794ffff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79501027c0 0x7f7950074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:45.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f79549c5640 1 -- 172.21.15.27:0/592291571 learned_addr learned my addr 172.21.15.27:0/592291571 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:08:45.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f79551c6640 1 --2- 172.21.15.27:0/592291571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7950106f40 0x7f7950074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:45.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f79549c5640 1 -- 172.21.15.27:0/592291571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79501027c0 msgr2=0x7f7950074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:45.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f79549c5640 1 --2- 172.21.15.27:0/592291571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79501027c0 0x7f7950074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:45.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f79549c5640 1 -- 172.21.15.27:0/592291571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7950106f40 msgr2=0x7f7950074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:45.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f79549c5640 1 --2- 172.21.15.27:0/592291571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7950106f40 0x7f7950074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:45.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f79549c5640 1 -- 172.21.15.27:0/592291571 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79501a6890 con 0x7f7950101e10 2024-09-19T08:08:45.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f79551c6640 1 --2- 172.21.15.27:0/592291571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7950106f40 0x7f7950074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:08:45.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f79549c5640 1 --2- 172.21.15.27:0/592291571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950101e10 0x7f79500744f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f794400c920 tx=0x7f794400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:45.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f794dffb640 1 -- 172.21.15.27:0/592291571 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7944007c70 con 0x7f7950101e10 2024-09-19T08:08:45.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f794dffb640 1 -- 172.21.15.27:0/592291571 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7944007e10 con 0x7f7950101e10 2024-09-19T08:08:45.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.480+0000 7f7956c29640 1 -- 172.21.15.27:0/592291571 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79501a6b80 con 0x7f7950101e10 2024-09-19T08:08:45.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.481+0000 7f794dffb640 1 -- 172.21.15.27:0/592291571 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7944018890 con 0x7f7950101e10 2024-09-19T08:08:45.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.481+0000 7f7956c29640 1 -- 172.21.15.27:0/592291571 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79501a70e0 con 0x7f7950101e10 2024-09-19T08:08:45.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.482+0000 7f793b7fe640 1 -- 172.21.15.27:0/592291571 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79501032f0 con 0x7f7950101e10 2024-09-19T08:08:45.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.483+0000 7f794dffb640 1 -- 172.21.15.27:0/592291571 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7944018b30 con 0x7f7950101e10 2024-09-19T08:08:45.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.483+0000 7f794dffb640 1 --2- 172.21.15.27:0/592291571 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f79400a32c0 0x7f79400a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:45.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.484+0000 7f794ffff640 1 --2- 172.21.15.27:0/592291571 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f79400a32c0 0x7f79400a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:45.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.484+0000 7f794dffb640 1 -- 172.21.15.27:0/592291571 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f79440cf540 con 0x7f7950101e10 2024-09-19T08:08:45.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.484+0000 7f794ffff640 1 --2- 172.21.15.27:0/592291571 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f79400a32c0 0x7f79400a5780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f793c009230 tx=0x7f793c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:45.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.488+0000 7f794dffb640 1 -- 172.21.15.27:0/592291571 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7944014030 con 0x7f7950101e10 2024-09-19T08:08:45.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.703+0000 7f793b7fe640 1 -- 172.21.15.27:0/592291571 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79501021f0 con 0x7f7950101e10 2024-09-19T08:08:45.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.703+0000 7f794dffb640 1 -- 172.21.15.27:0/592291571 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5572 (secure 0 0 0) 0x7f7944018e20 con 0x7f7950101e10 2024-09-19T08:08:45.704 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:08:45.704 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":7,"btime":"2024-09-19T08:08:42:754759+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T08:08:45.704 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 7 2024-09-19T08:08:45.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.706+0000 7f793b7fe640 1 -- 172.21.15.27:0/592291571 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f79400a32c0 msgr2=0x7f79400a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:45.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.706+0000 7f793b7fe640 1 --2- 172.21.15.27:0/592291571 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f79400a32c0 0x7f79400a5780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f793c009230 tx=0x7f793c0058d0 comp rx=0 tx=0).stop 2024-09-19T08:08:45.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.706+0000 7f793b7fe640 1 -- 172.21.15.27:0/592291571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950101e10 msgr2=0x7f79500744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:45.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.706+0000 7f793b7fe640 1 --2- 172.21.15.27:0/592291571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950101e10 0x7f79500744f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f794400c920 tx=0x7f794400cde0 comp rx=0 tx=0).stop 2024-09-19T08:08:45.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.706+0000 7f793b7fe640 1 -- 172.21.15.27:0/592291571 shutdown_connections 2024-09-19T08:08:45.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.706+0000 7f793b7fe640 1 --2- 172.21.15.27:0/592291571 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f79400a32c0 0x7f79400a5780 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:45.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.706+0000 7f793b7fe640 1 --2- 172.21.15.27:0/592291571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7950106f40 0x7f7950074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:45.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.706+0000 7f793b7fe640 1 --2- 172.21.15.27:0/592291571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79501027c0 0x7f7950074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:45.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.706+0000 7f793b7fe640 1 --2- 172.21.15.27:0/592291571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950101e10 0x7f79500744f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:45.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.706+0000 7f793b7fe640 1 -- 172.21.15.27:0/592291571 >> 172.21.15.27:0/592291571 conn(0x7f79500fd8d0 msgr2=0x7f79500fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:45.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.707+0000 7f793b7fe640 1 -- 172.21.15.27:0/592291571 shutdown_connections 2024-09-19T08:08:45.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:45.707+0000 7f793b7fe640 1 -- 172.21.15.27:0/592291571 wait complete. 2024-09-19T08:08:46.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:45 smithi027 ceph-mon[31209]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:46.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:45 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:46.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:45 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:46.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:45 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:46.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:45 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:46.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:45 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:46.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:45 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:46.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:45 smithi027 ceph-mon[31209]: Deploying daemon mds.h on smithi155 2024-09-19T08:08:46.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:45 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/592291571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:46.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:45 smithi027 ceph-mon[31209]: mds.? [v2:172.21.15.203:6836/3575223508,v1:172.21.15.203:6837/3575223508] up:boot 2024-09-19T08:08:46.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:45 smithi027 ceph-mon[31209]: fsmap 7 up:standby 2024-09-19T08:08:46.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:45 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:08:46.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:45 smithi203 ceph-mon[35198]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:46.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:45 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:46.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:45 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:46.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:45 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:46.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:45 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:46.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:45 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:46.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:45 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:46.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:45 smithi203 ceph-mon[35198]: Deploying daemon mds.h on smithi155 2024-09-19T08:08:46.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:45 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/592291571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:46.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:45 smithi203 ceph-mon[35198]: mds.? [v2:172.21.15.203:6836/3575223508,v1:172.21.15.203:6837/3575223508] up:boot 2024-09-19T08:08:46.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:45 smithi203 ceph-mon[35198]: fsmap 7 up:standby 2024-09-19T08:08:46.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:45 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:08:46.465 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:45 smithi155 ceph-mon[35362]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:46.466 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:45 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:46.466 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:45 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:46.466 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:45 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:46.466 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:45 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:46.466 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:45 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:46.466 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:45 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:46.466 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:45 smithi155 ceph-mon[35362]: Deploying daemon mds.h on smithi155 2024-09-19T08:08:46.466 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:45 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/592291571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:46.466 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:45 smithi155 ceph-mon[35362]: mds.? [v2:172.21.15.203:6836/3575223508,v1:172.21.15.203:6837/3575223508] up:boot 2024-09-19T08:08:46.466 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:45 smithi155 ceph-mon[35362]: fsmap 7 up:standby 2024-09-19T08:08:46.466 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:45 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:08:47.237 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:08:47 smithi155 systemd[1]: Starting Ceph mds.h for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:08:47.601 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:08:47 smithi155 podman[65447]: 2024-09-19 08:08:47.217718719 +0000 UTC m=+0.016152433 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:08:47.601 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:08:47 smithi155 podman[65447]: 2024-09-19 08:08:47.349220282 +0000 UTC m=+0.147654047 container create ef634561e67b794ebe622d4100f05cb905a2613c987da9bbe0743ac7eda144df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-h, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T08:08:47.601 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:08:47 smithi155 podman[65447]: 2024-09-19 08:08:47.601999613 +0000 UTC m=+0.400433322 container init ef634561e67b794ebe622d4100f05cb905a2613c987da9bbe0743ac7eda144df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-h, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T08:08:47.987 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:08:47 smithi155 podman[65447]: 2024-09-19 08:08:47.604768159 +0000 UTC m=+0.403201865 container start ef634561e67b794ebe622d4100f05cb905a2613c987da9bbe0743ac7eda144df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-h, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-19T08:08:47.987 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:08:47 smithi155 ceph-mds[65466]: -- 172.21.15.155:0/563071169 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c540ff5860 con 0x55c540fd3400 2024-09-19T08:08:47.987 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:08:47 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-h[65462]: starting mds.h at 2024-09-19T08:08:47.987 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:08:47 smithi155 bash[65447]: ef634561e67b794ebe622d4100f05cb905a2613c987da9bbe0743ac7eda144df 2024-09-19T08:08:47.987 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:08:47 smithi155 systemd[1]: Started Ceph mds.h for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:08:48.328 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:08:48.601 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:08:49.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:48 smithi027 ceph-mon[31209]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:49.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:48 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:49.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:48 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:49.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:48 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:49.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:48 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:49.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:48 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:49.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:48 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:49.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:48 smithi027 ceph-mon[31209]: Deploying daemon mds.i on smithi203 2024-09-19T08:08:49.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:48 smithi027 ceph-mon[31209]: mds.? [v2:172.21.15.155:6836/532811783,v1:172.21.15.155:6837/532811783] up:boot 2024-09-19T08:08:49.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:48 smithi027 ceph-mon[31209]: fsmap 8 up:standby 2024-09-19T08:08:49.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:48 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:08:49.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:48 smithi203 ceph-mon[35198]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:49.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:48 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:49.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:48 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:49.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:48 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:49.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:48 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:49.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:48 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:49.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:48 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:49.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:48 smithi203 ceph-mon[35198]: Deploying daemon mds.i on smithi203 2024-09-19T08:08:49.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:48 smithi203 ceph-mon[35198]: mds.? [v2:172.21.15.155:6836/532811783,v1:172.21.15.155:6837/532811783] up:boot 2024-09-19T08:08:49.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:48 smithi203 ceph-mon[35198]: fsmap 8 up:standby 2024-09-19T08:08:49.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:48 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:08:49.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.107+0000 7f3c055c8640 1 -- 172.21.15.27:0/2359789228 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c00103660 msgr2=0x7f3c0010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:49.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.107+0000 7f3c055c8640 1 --2- 172.21.15.27:0/2359789228 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c00103660 0x7f3c0010bb50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009900 tx=0x7f3be802a480 comp rx=0 tx=0).stop 2024-09-19T08:08:49.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.107+0000 7f3c055c8640 1 -- 172.21.15.27:0/2359789228 shutdown_connections 2024-09-19T08:08:49.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.107+0000 7f3c055c8640 1 --2- 172.21.15.27:0/2359789228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c0010c170 0x7f3c0010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:49.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.107+0000 7f3c055c8640 1 --2- 172.21.15.27:0/2359789228 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c00103660 0x7f3c0010bb50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:49.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.107+0000 7f3c055c8640 1 --2- 172.21.15.27:0/2359789228 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c00102d40 0x7f3c00103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:49.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.107+0000 7f3c055c8640 1 -- 172.21.15.27:0/2359789228 >> 172.21.15.27:0/2359789228 conn(0x7f3c000fc7a0 msgr2=0x7f3c000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:49.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.107+0000 7f3c055c8640 1 -- 172.21.15.27:0/2359789228 shutdown_connections 2024-09-19T08:08:49.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.107+0000 7f3c055c8640 1 -- 172.21.15.27:0/2359789228 wait complete. 2024-09-19T08:08:49.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.108+0000 7f3c055c8640 1 Processor -- start 2024-09-19T08:08:49.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.108+0000 7f3c055c8640 1 -- start start 2024-09-19T08:08:49.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.108+0000 7f3c055c8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c00102d40 0x7f3c001983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:49.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.108+0000 7f3c055c8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c00103660 0x7f3c00198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:49.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.108+0000 7f3c055c8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c0010c170 0x7f3c0019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:49.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.108+0000 7f3c055c8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3c00111f70 con 0x7f3c00102d40 2024-09-19T08:08:49.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.108+0000 7f3c055c8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3c00111df0 con 0x7f3c00103660 2024-09-19T08:08:49.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.108+0000 7f3c055c8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3c001120f0 con 0x7f3c0010c170 2024-09-19T08:08:49.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.108+0000 7f3bfeffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c00102d40 0x7f3c001983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:49.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.108+0000 7f3bfeffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c00102d40 0x7f3c001983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55874/0 (socket says 172.21.15.27:55874) 2024-09-19T08:08:49.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.108+0000 7f3bfeffd640 1 -- 172.21.15.27:0/2182092305 learned_addr learned my addr 172.21.15.27:0/2182092305 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:08:49.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.108+0000 7f3bff7fe640 1 --2- 172.21.15.27:0/2182092305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c0010c170 0x7f3c0019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:49.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.109+0000 7f3bfe7fc640 1 --2- 172.21.15.27:0/2182092305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c00103660 0x7f3c00198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:49.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.109+0000 7f3bfeffd640 1 -- 172.21.15.27:0/2182092305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c0010c170 msgr2=0x7f3c0019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:49.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.109+0000 7f3bfeffd640 1 --2- 172.21.15.27:0/2182092305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c0010c170 0x7f3c0019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:49.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.109+0000 7f3bfeffd640 1 -- 172.21.15.27:0/2182092305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c00103660 msgr2=0x7f3c00198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:49.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.109+0000 7f3bfeffd640 1 --2- 172.21.15.27:0/2182092305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c00103660 0x7f3c00198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:49.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.109+0000 7f3bfeffd640 1 -- 172.21.15.27:0/2182092305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0019d380 con 0x7f3c00102d40 2024-09-19T08:08:49.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.109+0000 7f3bfe7fc640 1 --2- 172.21.15.27:0/2182092305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c00103660 0x7f3c00198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:08:49.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.109+0000 7f3bfeffd640 1 --2- 172.21.15.27:0/2182092305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c00102d40 0x7f3c001983d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000cce0 tx=0x7f3bf000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:49.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.109+0000 7f3bf7fff640 1 -- 172.21.15.27:0/2182092305 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf000f650 con 0x7f3c00102d40 2024-09-19T08:08:49.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.109+0000 7f3c055c8640 1 -- 172.21.15.27:0/2182092305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c0019d670 con 0x7f3c00102d40 2024-09-19T08:08:49.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.109+0000 7f3bf7fff640 1 -- 172.21.15.27:0/2182092305 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bf000fcd0 con 0x7f3c00102d40 2024-09-19T08:08:49.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.109+0000 7f3bf7fff640 1 -- 172.21.15.27:0/2182092305 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0018c70 con 0x7f3c00102d40 2024-09-19T08:08:49.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.109+0000 7f3c055c8640 1 -- 172.21.15.27:0/2182092305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c001a4f50 con 0x7f3c00102d40 2024-09-19T08:08:49.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.110+0000 7f3c055c8640 1 -- 172.21.15.27:0/2182092305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c00103120 con 0x7f3c00102d40 2024-09-19T08:08:49.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.111+0000 7f3bf7fff640 1 -- 172.21.15.27:0/2182092305 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3bf000f7f0 con 0x7f3c00102d40 2024-09-19T08:08:49.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.112+0000 7f3bf7fff640 1 --2- 172.21.15.27:0/2182092305 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f3bec0a3240 0x7f3bec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:49.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.112+0000 7f3bfe7fc640 1 --2- 172.21.15.27:0/2182092305 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f3bec0a3240 0x7f3bec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:49.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.112+0000 7f3bf7fff640 1 -- 172.21.15.27:0/2182092305 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f3bf00cf970 con 0x7f3c00102d40 2024-09-19T08:08:49.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.113+0000 7f3bfe7fc640 1 --2- 172.21.15.27:0/2182092305 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f3bec0a3240 0x7f3bec0a5700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3be8000c00 tx=0x7f3be8032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:49.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.116+0000 7f3bf7fff640 1 -- 172.21.15.27:0/2182092305 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3bf0014030 con 0x7f3c00102d40 2024-09-19T08:08:49.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:48 smithi155 ceph-mon[35362]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:49.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:48 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:49.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:48 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:49.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:48 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:49.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:48 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:49.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:48 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:49.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:48 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:49.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:48 smithi155 ceph-mon[35362]: Deploying daemon mds.i on smithi203 2024-09-19T08:08:49.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:48 smithi155 ceph-mon[35362]: mds.? [v2:172.21.15.155:6836/532811783,v1:172.21.15.155:6837/532811783] up:boot 2024-09-19T08:08:49.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:48 smithi155 ceph-mon[35362]: fsmap 8 up:standby 2024-09-19T08:08:49.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:48 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:08:49.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.329+0000 7f3c055c8640 1 -- 172.21.15.27:0/2182092305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c0002d7c0 con 0x7f3c00102d40 2024-09-19T08:08:49.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.330+0000 7f3bf7fff640 1 -- 172.21.15.27:0/2182092305 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7225 (secure 0 0 0) 0x7f3bf009cb30 con 0x7f3c00102d40 2024-09-19T08:08:49.331 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:08:49.331 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":9,"btime":"2024-09-19T08:08:48:000754+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-19T08:08:49.332 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 9 2024-09-19T08:08:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.332+0000 7f3c055c8640 1 -- 172.21.15.27:0/2182092305 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f3bec0a3240 msgr2=0x7f3bec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.332+0000 7f3c055c8640 1 --2- 172.21.15.27:0/2182092305 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f3bec0a3240 0x7f3bec0a5700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3be8000c00 tx=0x7f3be8032c70 comp rx=0 tx=0).stop 2024-09-19T08:08:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.332+0000 7f3c055c8640 1 -- 172.21.15.27:0/2182092305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c00102d40 msgr2=0x7f3c001983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.332+0000 7f3c055c8640 1 --2- 172.21.15.27:0/2182092305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c00102d40 0x7f3c001983d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000cce0 tx=0x7f3bf000a620 comp rx=0 tx=0).stop 2024-09-19T08:08:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.332+0000 7f3c055c8640 1 -- 172.21.15.27:0/2182092305 shutdown_connections 2024-09-19T08:08:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.332+0000 7f3c055c8640 1 --2- 172.21.15.27:0/2182092305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c0010c170 0x7f3c0019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.332+0000 7f3c055c8640 1 --2- 172.21.15.27:0/2182092305 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f3bec0a3240 0x7f3bec0a5700 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.332+0000 7f3c055c8640 1 --2- 172.21.15.27:0/2182092305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c00103660 0x7f3c00198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.332+0000 7f3c055c8640 1 --2- 172.21.15.27:0/2182092305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c00102d40 0x7f3c001983d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.332+0000 7f3c055c8640 1 -- 172.21.15.27:0/2182092305 >> 172.21.15.27:0/2182092305 conn(0x7f3c000fc7a0 msgr2=0x7f3c000fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.332+0000 7f3c055c8640 1 -- 172.21.15.27:0/2182092305 shutdown_connections 2024-09-19T08:08:49.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:49.332+0000 7f3c055c8640 1 -- 172.21.15.27:0/2182092305 wait complete. 2024-09-19T08:08:49.946 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:49 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2182092305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:50.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:49 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2182092305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:50.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:49 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2182092305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:50.508 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 08:08:50 smithi203 systemd[1]: Started Ceph mds.i for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:08:51.060 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:50 smithi027 ceph-mon[31209]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:51.061 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:50 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:51.061 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:50 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:51.061 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:50 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:51.061 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:50 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:51.061 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:50 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:51.061 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:50 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:51.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:50 smithi155 ceph-mon[35362]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:51.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:50 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:51.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:50 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:51.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:50 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:51.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:50 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:51.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:50 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:51.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:50 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:51.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:50 smithi203 ceph-mon[35198]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:51.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:50 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:51.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:50 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:51.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:50 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:51.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:50 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:51.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:50 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:51.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:50 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:51.954 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:08:52.067 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:51 smithi027 ceph-mon[31209]: Deploying daemon mds.g on smithi027 2024-09-19T08:08:52.067 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:51 smithi027 ceph-mon[31209]: mds.? [v2:172.21.15.203:6838/1481040099,v1:172.21.15.203:6839/1481040099] up:boot 2024-09-19T08:08:52.067 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:51 smithi027 ceph-mon[31209]: fsmap 9 up:standby 2024-09-19T08:08:52.067 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:51 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:08:52.160 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:51 smithi203 ceph-mon[35198]: Deploying daemon mds.g on smithi027 2024-09-19T08:08:52.160 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:51 smithi203 ceph-mon[35198]: mds.? [v2:172.21.15.203:6838/1481040099,v1:172.21.15.203:6839/1481040099] up:boot 2024-09-19T08:08:52.160 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:51 smithi203 ceph-mon[35198]: fsmap 9 up:standby 2024-09-19T08:08:52.160 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:51 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:08:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:08:52.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:51 smithi155 ceph-mon[35362]: Deploying daemon mds.g on smithi027 2024-09-19T08:08:52.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:51 smithi155 ceph-mon[35362]: mds.? [v2:172.21.15.203:6838/1481040099,v1:172.21.15.203:6839/1481040099] up:boot 2024-09-19T08:08:52.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:51 smithi155 ceph-mon[35362]: fsmap 9 up:standby 2024-09-19T08:08:52.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:51 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:08:52.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.727+0000 7f02dc557640 1 -- 172.21.15.27:0/1260132417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02d4102d40 msgr2=0x7f02d4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:52.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.727+0000 7f02dc557640 1 --2- 172.21.15.27:0/1260132417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02d4102d40 0x7f02d4103120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009ca0 tx=0x7f02c402a950 comp rx=0 tx=0).stop 2024-09-19T08:08:52.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.727+0000 7f02dc557640 1 -- 172.21.15.27:0/1260132417 shutdown_connections 2024-09-19T08:08:52.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.727+0000 7f02dc557640 1 --2- 172.21.15.27:0/1260132417 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02d410c170 0x7f02d410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:52.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.727+0000 7f02dc557640 1 --2- 172.21.15.27:0/1260132417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02d4103660 0x7f02d410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:52.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.727+0000 7f02dc557640 1 --2- 172.21.15.27:0/1260132417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02d4102d40 0x7f02d4103120 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:52.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.727+0000 7f02dc557640 1 -- 172.21.15.27:0/1260132417 >> 172.21.15.27:0/1260132417 conn(0x7f02d40fc7a0 msgr2=0x7f02d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:52.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.727+0000 7f02dc557640 1 -- 172.21.15.27:0/1260132417 shutdown_connections 2024-09-19T08:08:52.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.727+0000 7f02dc557640 1 -- 172.21.15.27:0/1260132417 wait complete. 2024-09-19T08:08:52.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.728+0000 7f02dc557640 1 Processor -- start 2024-09-19T08:08:52.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.728+0000 7f02dc557640 1 -- start start 2024-09-19T08:08:52.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.728+0000 7f02dc557640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02d4102d40 0x7f02d41983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:52.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.728+0000 7f02dc557640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02d4103660 0x7f02d4198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:52.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.728+0000 7f02dc557640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02d410c170 0x7f02d419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:52.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.728+0000 7f02dc557640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f02d4111f70 con 0x7f02d410c170 2024-09-19T08:08:52.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.728+0000 7f02dc557640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f02d4111df0 con 0x7f02d4102d40 2024-09-19T08:08:52.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.728+0000 7f02dc557640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f02d41120f0 con 0x7f02d4103660 2024-09-19T08:08:52.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.728+0000 7f02daaf4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02d410c170 0x7f02d419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:52.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.728+0000 7f02daaf4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02d410c170 0x7f02d419ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47278/0 (socket says 172.21.15.27:47278) 2024-09-19T08:08:52.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.728+0000 7f02daaf4640 1 -- 172.21.15.27:0/98445783 learned_addr learned my addr 172.21.15.27:0/98445783 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:08:52.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.728+0000 7f02d9af2640 1 --2- 172.21.15.27:0/98445783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02d4103660 0x7f02d4198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:52.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.728+0000 7f02da2f3640 1 --2- 172.21.15.27:0/98445783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02d4102d40 0x7f02d41983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:52.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.728+0000 7f02daaf4640 1 -- 172.21.15.27:0/98445783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02d4103660 msgr2=0x7f02d4198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:52.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.728+0000 7f02daaf4640 1 --2- 172.21.15.27:0/98445783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02d4103660 0x7f02d4198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:52.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.728+0000 7f02daaf4640 1 -- 172.21.15.27:0/98445783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02d4102d40 msgr2=0x7f02d41983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:52.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.728+0000 7f02daaf4640 1 --2- 172.21.15.27:0/98445783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02d4102d40 0x7f02d41983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:52.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.728+0000 7f02daaf4640 1 -- 172.21.15.27:0/98445783 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d419d390 con 0x7f02d410c170 2024-09-19T08:08:52.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.729+0000 7f02daaf4640 1 --2- 172.21.15.27:0/98445783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02d410c170 0x7f02d419ccb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00d750 tx=0x7f02cc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:52.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.729+0000 7f02d37fe640 1 -- 172.21.15.27:0/98445783 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc017070 con 0x7f02d410c170 2024-09-19T08:08:52.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.729+0000 7f02dc557640 1 -- 172.21.15.27:0/98445783 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d419d680 con 0x7f02d410c170 2024-09-19T08:08:52.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.729+0000 7f02d37fe640 1 -- 172.21.15.27:0/98445783 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02cc005500 con 0x7f02d410c170 2024-09-19T08:08:52.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.729+0000 7f02d37fe640 1 -- 172.21.15.27:0/98445783 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc004d90 con 0x7f02d410c170 2024-09-19T08:08:52.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.729+0000 7f02dc557640 1 -- 172.21.15.27:0/98445783 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d41a4f60 con 0x7f02d410c170 2024-09-19T08:08:52.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.730+0000 7f02dc557640 1 -- 172.21.15.27:0/98445783 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d4103120 con 0x7f02d410c170 2024-09-19T08:08:52.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.731+0000 7f02d37fe640 1 -- 172.21.15.27:0/98445783 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f02cc004f30 con 0x7f02d410c170 2024-09-19T08:08:52.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.732+0000 7f02d37fe640 1 --2- 172.21.15.27:0/98445783 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f02bc0a3240 0x7f02bc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:52.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.732+0000 7f02da2f3640 1 --2- 172.21.15.27:0/98445783 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f02bc0a3240 0x7f02bc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:52.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.732+0000 7f02d37fe640 1 -- 172.21.15.27:0/98445783 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f02cc0cf100 con 0x7f02d410c170 2024-09-19T08:08:52.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.732+0000 7f02da2f3640 1 --2- 172.21.15.27:0/98445783 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f02bc0a3240 0x7f02bc0a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f02c4004ad0 tx=0x7f02c4004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:52.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.735+0000 7f02d37fe640 1 -- 172.21.15.27:0/98445783 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f02cc09bc70 con 0x7f02d410c170 2024-09-19T08:08:52.911 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:52 smithi027 ceph-mon[31209]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:52.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.961+0000 7f02dc557640 1 -- 172.21.15.27:0/98445783 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02d402d7c0 con 0x7f02d410c170 2024-09-19T08:08:52.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.962+0000 7f02d37fe640 1 -- 172.21.15.27:0/98445783 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8055 (secure 0 0 0) 0x7f02cc09ff70 con 0x7f02d410c170 2024-09-19T08:08:52.961 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:08:52.962 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":10,"btime":"2024-09-19T08:08:50:760256+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T08:08:52.962 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 10 2024-09-19T08:08:52.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.964+0000 7f02dc557640 1 -- 172.21.15.27:0/98445783 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f02bc0a3240 msgr2=0x7f02bc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:52.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.964+0000 7f02dc557640 1 --2- 172.21.15.27:0/98445783 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f02bc0a3240 0x7f02bc0a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f02c4004ad0 tx=0x7f02c4004a60 comp rx=0 tx=0).stop 2024-09-19T08:08:52.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.964+0000 7f02dc557640 1 -- 172.21.15.27:0/98445783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02d410c170 msgr2=0x7f02d419ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:52.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.964+0000 7f02dc557640 1 --2- 172.21.15.27:0/98445783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02d410c170 0x7f02d419ccb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00d750 tx=0x7f02cc00dc10 comp rx=0 tx=0).stop 2024-09-19T08:08:52.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.964+0000 7f02dc557640 1 -- 172.21.15.27:0/98445783 shutdown_connections 2024-09-19T08:08:52.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.964+0000 7f02dc557640 1 --2- 172.21.15.27:0/98445783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02d410c170 0x7f02d419ccb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:52.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.964+0000 7f02dc557640 1 --2- 172.21.15.27:0/98445783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02d4103660 0x7f02d4198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:52.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.964+0000 7f02dc557640 1 --2- 172.21.15.27:0/98445783 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f02bc0a3240 0x7f02bc0a5700 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:52.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.964+0000 7f02dc557640 1 --2- 172.21.15.27:0/98445783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02d4102d40 0x7f02d41983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:52.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.964+0000 7f02dc557640 1 -- 172.21.15.27:0/98445783 >> 172.21.15.27:0/98445783 conn(0x7f02d40fc7a0 msgr2=0x7f02d40fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:52.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.964+0000 7f02dc557640 1 -- 172.21.15.27:0/98445783 shutdown_connections 2024-09-19T08:08:52.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:52.964+0000 7f02dc557640 1 -- 172.21.15.27:0/98445783 wait complete. 2024-09-19T08:08:53.138 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:52 smithi155 ceph-mon[35362]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:53.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:52 smithi203 ceph-mon[35198]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:53.900 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:53 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/98445783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:53.900 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 19 08:08:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-g[71879]: starting mds.g at 2024-09-19T08:08:53.900 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 19 08:08:53 smithi027 bash[71852]: 8cfeaa3e68e8cea35063c61d69ddafa5baf1fcae6d659a63cac10fecb034a154 2024-09-19T08:08:54.149 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:53 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/98445783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:54.252 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 19 08:08:53 smithi027 systemd[1]: Started Ceph mds.g for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:08:54.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:53 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/98445783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:55.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:54 smithi027 ceph-mon[31209]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:55.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:54 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:55.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:54 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:55.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:54 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:55.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:54 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:55.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:54 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:55.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:54 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:54 smithi155 ceph-mon[35362]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:54 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:54 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:54 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:54 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:54 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:54 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:55.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:54 smithi203 ceph-mon[35198]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:55.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:54 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:55.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:54 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:55.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:54 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:55.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:54 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:55.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:54 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:55.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:54 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:55.662 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:08:55.997 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:55 smithi027 ceph-mon[31209]: Deploying daemon mds.a on smithi027 2024-09-19T08:08:55.997 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:55 smithi027 ceph-mon[31209]: mds.? [v2:172.21.15.27:6838/4163950622,v1:172.21.15.27:6839/4163950622] up:boot 2024-09-19T08:08:55.997 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:55 smithi027 ceph-mon[31209]: fsmap 10 up:standby 2024-09-19T08:08:55.997 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:55 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:08:56.000 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 19 08:08:55 smithi027 systemd[1]: Starting Ceph mds.a for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:08:56.030 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:08:56.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:55 smithi155 ceph-mon[35362]: Deploying daemon mds.a on smithi027 2024-09-19T08:08:56.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:55 smithi155 ceph-mon[35362]: mds.? [v2:172.21.15.27:6838/4163950622,v1:172.21.15.27:6839/4163950622] up:boot 2024-09-19T08:08:56.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:55 smithi155 ceph-mon[35362]: fsmap 10 up:standby 2024-09-19T08:08:56.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:55 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:08:56.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:55 smithi203 ceph-mon[35198]: Deploying daemon mds.a on smithi027 2024-09-19T08:08:56.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:55 smithi203 ceph-mon[35198]: mds.? [v2:172.21.15.27:6838/4163950622,v1:172.21.15.27:6839/4163950622] up:boot 2024-09-19T08:08:56.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:55 smithi203 ceph-mon[35198]: fsmap 10 up:standby 2024-09-19T08:08:56.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:55 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:08:56.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.508+0000 7f7e00a48640 1 -- 172.21.15.27:0/3462356888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dfc102790 msgr2=0x7f7dfc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:56.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.508+0000 7f7e00a48640 1 --2- 172.21.15.27:0/3462356888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dfc102790 0x7f7dfc1067e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009900 tx=0x7f7df002a410 comp rx=0 tx=0).stop 2024-09-19T08:08:56.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.509+0000 7f7e00a48640 1 -- 172.21.15.27:0/3462356888 shutdown_connections 2024-09-19T08:08:56.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.509+0000 7f7e00a48640 1 --2- 172.21.15.27:0/3462356888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dfc106f10 0x7f7dfc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:56.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.509+0000 7f7e00a48640 1 --2- 172.21.15.27:0/3462356888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dfc102790 0x7f7dfc1067e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:56.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.509+0000 7f7e00a48640 1 --2- 172.21.15.27:0/3462356888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7dfc101de0 0x7f7dfc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:56.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.509+0000 7f7e00a48640 1 -- 172.21.15.27:0/3462356888 >> 172.21.15.27:0/3462356888 conn(0x7f7dfc0fd8c0 msgr2=0x7f7dfc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:56.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.509+0000 7f7e00a48640 1 -- 172.21.15.27:0/3462356888 shutdown_connections 2024-09-19T08:08:56.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.509+0000 7f7e00a48640 1 -- 172.21.15.27:0/3462356888 wait complete. 2024-09-19T08:08:56.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.509+0000 7f7e00a48640 1 Processor -- start 2024-09-19T08:08:56.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.509+0000 7f7e00a48640 1 -- start start 2024-09-19T08:08:56.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.510+0000 7f7e00a48640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dfc101de0 0x7f7dfc1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:56.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.510+0000 7f7e00a48640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7dfc102790 0x7f7dfc198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:56.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.510+0000 7f7e00a48640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dfc106f10 0x7f7dfc19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:56.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.510+0000 7f7e00a48640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc111f70 con 0x7f7dfc101de0 2024-09-19T08:08:56.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.510+0000 7f7e00a48640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc111df0 con 0x7f7dfc106f10 2024-09-19T08:08:56.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.510+0000 7f7e00a48640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc1120f0 con 0x7f7dfc102790 2024-09-19T08:08:56.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.510+0000 7f7dfa59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dfc101de0 0x7f7dfc1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:56.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.510+0000 7f7dfa59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dfc101de0 0x7f7dfc1983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47314/0 (socket says 172.21.15.27:47314) 2024-09-19T08:08:56.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.510+0000 7f7dfa59c640 1 -- 172.21.15.27:0/913506765 learned_addr learned my addr 172.21.15.27:0/913506765 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:08:56.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.510+0000 7f7df9d9b640 1 --2- 172.21.15.27:0/913506765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7dfc102790 0x7f7dfc198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:56.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.510+0000 7f7dfad9d640 1 --2- 172.21.15.27:0/913506765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dfc106f10 0x7f7dfc19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:56.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.510+0000 7f7dfa59c640 1 -- 172.21.15.27:0/913506765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7dfc102790 msgr2=0x7f7dfc198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:56.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.510+0000 7f7dfa59c640 1 --2- 172.21.15.27:0/913506765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7dfc102790 0x7f7dfc198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:56.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.510+0000 7f7dfa59c640 1 -- 172.21.15.27:0/913506765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dfc106f10 msgr2=0x7f7dfc19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:56.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.510+0000 7f7dfa59c640 1 --2- 172.21.15.27:0/913506765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dfc106f10 0x7f7dfc19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:56.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.510+0000 7f7dfa59c640 1 -- 172.21.15.27:0/913506765 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dfc19d380 con 0x7f7dfc101de0 2024-09-19T08:08:56.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.510+0000 7f7dfa59c640 1 --2- 172.21.15.27:0/913506765 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dfc101de0 0x7f7dfc1983d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7dec00d770 tx=0x7f7dec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:56.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.510+0000 7f7deb7fe640 1 -- 172.21.15.27:0/913506765 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec017070 con 0x7f7dfc101de0 2024-09-19T08:08:56.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.510+0000 7f7deb7fe640 1 -- 172.21.15.27:0/913506765 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dec005500 con 0x7f7dfc101de0 2024-09-19T08:08:56.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.511+0000 7f7e00a48640 1 -- 172.21.15.27:0/913506765 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dfc19d670 con 0x7f7dfc101de0 2024-09-19T08:08:56.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.511+0000 7f7deb7fe640 1 -- 172.21.15.27:0/913506765 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec004e00 con 0x7f7dfc101de0 2024-09-19T08:08:56.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.511+0000 7f7e00a48640 1 -- 172.21.15.27:0/913506765 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dfc1a4f50 con 0x7f7dfc101de0 2024-09-19T08:08:56.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.512+0000 7f7e00a48640 1 -- 172.21.15.27:0/913506765 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dfc1032c0 con 0x7f7dfc101de0 2024-09-19T08:08:56.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.513+0000 7f7deb7fe640 1 -- 172.21.15.27:0/913506765 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7dec004fa0 con 0x7f7dfc101de0 2024-09-19T08:08:56.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.513+0000 7f7deb7fe640 1 --2- 172.21.15.27:0/913506765 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7de40a3240 0x7f7de40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:08:56.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.514+0000 7f7df9d9b640 1 --2- 172.21.15.27:0/913506765 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7de40a3240 0x7f7de40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:08:56.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.514+0000 7f7deb7fe640 1 -- 172.21.15.27:0/913506765 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f7dec0ceef0 con 0x7f7dfc101de0 2024-09-19T08:08:56.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.514+0000 7f7df9d9b640 1 --2- 172.21.15.27:0/913506765 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7de40a3240 0x7f7de40a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009230 tx=0x7f7df00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:08:56.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.518+0000 7f7deb7fe640 1 -- 172.21.15.27:0/913506765 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7dec09c0b0 con 0x7f7dfc101de0 2024-09-19T08:08:56.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.733+0000 7f7e00a48640 1 -- 172.21.15.27:0/913506765 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7dfc1021c0 con 0x7f7dfc101de0 2024-09-19T08:08:56.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.734+0000 7f7deb7fe640 1 -- 172.21.15.27:0/913506765 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8881 (secure 0 0 0) 0x7f7dec09b9b0 con 0x7f7dfc101de0 2024-09-19T08:08:56.734 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:08:56.734 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":11,"btime":"2024-09-19T08:08:54:778675+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T08:08:56.734 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 11 2024-09-19T08:08:56.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.736+0000 7f7e00a48640 1 -- 172.21.15.27:0/913506765 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7de40a3240 msgr2=0x7f7de40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:56.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.736+0000 7f7e00a48640 1 --2- 172.21.15.27:0/913506765 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7de40a3240 0x7f7de40a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009230 tx=0x7f7df00058d0 comp rx=0 tx=0).stop 2024-09-19T08:08:56.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.736+0000 7f7e00a48640 1 -- 172.21.15.27:0/913506765 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dfc101de0 msgr2=0x7f7dfc1983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:08:56.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.736+0000 7f7e00a48640 1 --2- 172.21.15.27:0/913506765 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dfc101de0 0x7f7dfc1983d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7dec00d770 tx=0x7f7dec00dc30 comp rx=0 tx=0).stop 2024-09-19T08:08:56.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.736+0000 7f7e00a48640 1 -- 172.21.15.27:0/913506765 shutdown_connections 2024-09-19T08:08:56.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.736+0000 7f7e00a48640 1 --2- 172.21.15.27:0/913506765 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7de40a3240 0x7f7de40a5700 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:56.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.736+0000 7f7e00a48640 1 --2- 172.21.15.27:0/913506765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dfc106f10 0x7f7dfc19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:56.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.736+0000 7f7e00a48640 1 --2- 172.21.15.27:0/913506765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7dfc102790 0x7f7dfc198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:56.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.736+0000 7f7e00a48640 1 --2- 172.21.15.27:0/913506765 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dfc101de0 0x7f7dfc1983d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:08:56.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.736+0000 7f7e00a48640 1 -- 172.21.15.27:0/913506765 >> 172.21.15.27:0/913506765 conn(0x7f7dfc0fd8c0 msgr2=0x7f7dfc0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:08:56.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.736+0000 7f7e00a48640 1 -- 172.21.15.27:0/913506765 shutdown_connections 2024-09-19T08:08:56.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:08:56.736+0000 7f7e00a48640 1 -- 172.21.15.27:0/913506765 wait complete. 2024-09-19T08:08:56.822 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:56 smithi027 ceph-mon[31209]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:56.822 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:56 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/913506765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:56.823 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 19 08:08:56 smithi027 podman[72247]: 2024-09-19 08:08:56.58352581 +0000 UTC m=+0.146296196 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:08:56.823 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 19 08:08:56 smithi027 podman[72247]: 2024-09-19 08:08:56.707927331 +0000 UTC m=+0.270697716 container create edf337402a2a9094819b6716611f01a0d1838489653750ee823286bb9d2c4fee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:08:57.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:56 smithi155 ceph-mon[35362]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:57.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:56 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/913506765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:57.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:56 smithi203 ceph-mon[35198]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:57.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:56 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/913506765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:08:57.752 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 19 08:08:57 smithi027 podman[72247]: 2024-09-19 08:08:57.557732745 +0000 UTC m=+1.120503145 container init edf337402a2a9094819b6716611f01a0d1838489653750ee823286bb9d2c4fee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-a, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T08:08:57.752 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 19 08:08:57 smithi027 podman[72247]: 2024-09-19 08:08:57.560946944 +0000 UTC m=+1.123717330 container start edf337402a2a9094819b6716611f01a0d1838489653750ee823286bb9d2c4fee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-a, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T08:08:57.752 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 19 08:08:57 smithi027 ceph-mds[72301]: -- 172.21.15.27:0/524473897 <== mon.0 v2:172.21.15.27:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556a152a7860 con 0x556a15285000 2024-09-19T08:08:57.753 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 19 08:08:57 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-a[72294]: starting mds.a at 2024-09-19T08:08:57.753 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 19 08:08:57 smithi027 bash[72247]: edf337402a2a9094819b6716611f01a0d1838489653750ee823286bb9d2c4fee 2024-09-19T08:08:57.753 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 19 08:08:57 smithi027 systemd[1]: Started Ceph mds.a for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:08:58.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:58 smithi155 ceph-mon[35362]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:58.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:58 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:58.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:58 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:58.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:58 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:58.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:58 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:58.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:58 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:58.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:58 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:58.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:58 smithi155 ceph-mon[35362]: Deploying daemon mds.b on smithi155 2024-09-19T08:08:58.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:58 smithi155 ceph-mon[35362]: mds.? [v2:172.21.15.27:6840/2368031257,v1:172.21.15.27:6841/2368031257] up:boot 2024-09-19T08:08:58.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:58 smithi155 ceph-mon[35362]: fsmap 11 up:standby 2024-09-19T08:08:58.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:08:58 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:08:59.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:58 smithi027 ceph-mon[31209]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:59.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:58 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:59.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:58 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:59.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:58 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:59.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:58 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:59.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:58 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:59.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:58 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:59.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:58 smithi027 ceph-mon[31209]: Deploying daemon mds.b on smithi155 2024-09-19T08:08:59.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:58 smithi027 ceph-mon[31209]: mds.? [v2:172.21.15.27:6840/2368031257,v1:172.21.15.27:6841/2368031257] up:boot 2024-09-19T08:08:59.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:58 smithi027 ceph-mon[31209]: fsmap 11 up:standby 2024-09-19T08:08:59.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:08:58 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:08:59.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:58 smithi203 ceph-mon[35198]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:08:59.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:58 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:59.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:58 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:59.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:58 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:08:59.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:58 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:08:59.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:58 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:08:59.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:58 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:08:59.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:58 smithi203 ceph-mon[35198]: Deploying daemon mds.b on smithi155 2024-09-19T08:08:59.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:58 smithi203 ceph-mon[35198]: mds.? [v2:172.21.15.27:6840/2368031257,v1:172.21.15.27:6841/2368031257] up:boot 2024-09-19T08:08:59.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:58 smithi203 ceph-mon[35198]: fsmap 11 up:standby 2024-09-19T08:08:59.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:08:58 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:08:59.477 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:08:59.753 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:08:59.953 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:08:59 smithi155 systemd[1]: Starting Ceph mds.b for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:09:00.229 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:08:59 smithi155 podman[65761]: 2024-09-19 08:08:59.856057767 +0000 UTC m=+0.016370690 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:09:00.229 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:08:59 smithi155 podman[65761]: 2024-09-19 08:08:59.976794854 +0000 UTC m=+0.137107805 container create ff521ea2d6646dc100c76a0667c7b7f4c611eb7685bf532a689806ea181cc87b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T08:09:00.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.244+0000 7f4e8ebf3640 1 -- 172.21.15.27:0/2899580399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e881027c0 msgr2=0x7f4e88106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:00.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.244+0000 7f4e8ebf3640 1 --2- 172.21.15.27:0/2899580399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e881027c0 0x7f4e88106810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009900 tx=0x7f4e7002a410 comp rx=0 tx=0).stop 2024-09-19T08:09:00.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.244+0000 7f4e8ebf3640 1 -- 172.21.15.27:0/2899580399 shutdown_connections 2024-09-19T08:09:00.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.244+0000 7f4e8ebf3640 1 --2- 172.21.15.27:0/2899580399 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e88106f40 0x7f4e8810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:00.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.244+0000 7f4e8ebf3640 1 --2- 172.21.15.27:0/2899580399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e881027c0 0x7f4e88106810 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:00.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.244+0000 7f4e8ebf3640 1 --2- 172.21.15.27:0/2899580399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e88101e10 0x7f4e881021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:00.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.244+0000 7f4e8ebf3640 1 -- 172.21.15.27:0/2899580399 >> 172.21.15.27:0/2899580399 conn(0x7f4e880fd8d0 msgr2=0x7f4e880ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:00.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.244+0000 7f4e8ebf3640 1 -- 172.21.15.27:0/2899580399 shutdown_connections 2024-09-19T08:09:00.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.244+0000 7f4e8ebf3640 1 -- 172.21.15.27:0/2899580399 wait complete. 2024-09-19T08:09:00.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.245+0000 7f4e8ebf3640 1 Processor -- start 2024-09-19T08:09:00.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.245+0000 7f4e8ebf3640 1 -- start start 2024-09-19T08:09:00.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.245+0000 7f4e8ebf3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e88101e10 0x7f4e880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:00.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.245+0000 7f4e8ebf3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e881027c0 0x7f4e88074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:00.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.245+0000 7f4e8ebf3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e88106f40 0x7f4e88074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:00.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.245+0000 7f4e8ebf3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4e88111fa0 con 0x7f4e88106f40 2024-09-19T08:09:00.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.245+0000 7f4e8ebf3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4e88111e20 con 0x7f4e88101e10 2024-09-19T08:09:00.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.245+0000 7f4e8ebf3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4e88112120 con 0x7f4e881027c0 2024-09-19T08:09:00.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.245+0000 7f4e8d190640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e88106f40 0x7f4e88074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:00.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.245+0000 7f4e8c98f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e88101e10 0x7f4e880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:00.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.245+0000 7f4e8d190640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e88106f40 0x7f4e88074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36260/0 (socket says 172.21.15.27:36260) 2024-09-19T08:09:00.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.245+0000 7f4e8c98f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e88101e10 0x7f4e880744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.27:38450/0 (socket says 172.21.15.27:38450) 2024-09-19T08:09:00.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.245+0000 7f4e8d190640 1 -- 172.21.15.27:0/2899064344 learned_addr learned my addr 172.21.15.27:0/2899064344 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:00.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.245+0000 7f4e87fff640 1 --2- 172.21.15.27:0/2899064344 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e881027c0 0x7f4e88074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:00.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.245+0000 7f4e8d190640 1 -- 172.21.15.27:0/2899064344 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e881027c0 msgr2=0x7f4e88074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:00.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.245+0000 7f4e8d190640 1 --2- 172.21.15.27:0/2899064344 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e881027c0 0x7f4e88074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:00.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.245+0000 7f4e8d190640 1 -- 172.21.15.27:0/2899064344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e88101e10 msgr2=0x7f4e880744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:00.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.245+0000 7f4e8d190640 1 --2- 172.21.15.27:0/2899064344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e88101e10 0x7f4e880744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:00.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.245+0000 7f4e8d190640 1 -- 172.21.15.27:0/2899064344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e881a6900 con 0x7f4e88106f40 2024-09-19T08:09:00.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.245+0000 7f4e8c98f640 1 --2- 172.21.15.27:0/2899064344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e88101e10 0x7f4e880744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:09:00.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.246+0000 7f4e8d190640 1 --2- 172.21.15.27:0/2899064344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e88106f40 0x7f4e88074f70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800eaa0 tx=0x7f4e7800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:00.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.246+0000 7f4e85ffb640 1 -- 172.21.15.27:0/2899064344 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7800cdb0 con 0x7f4e88106f40 2024-09-19T08:09:00.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.246+0000 7f4e85ffb640 1 -- 172.21.15.27:0/2899064344 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e78005020 con 0x7f4e88106f40 2024-09-19T08:09:00.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.246+0000 7f4e85ffb640 1 -- 172.21.15.27:0/2899064344 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e780116b0 con 0x7f4e88106f40 2024-09-19T08:09:00.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.246+0000 7f4e8ebf3640 1 -- 172.21.15.27:0/2899064344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e881a6bf0 con 0x7f4e88106f40 2024-09-19T08:09:00.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.246+0000 7f4e8ebf3640 1 -- 172.21.15.27:0/2899064344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e881a70e0 con 0x7f4e88106f40 2024-09-19T08:09:00.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.247+0000 7f4e8ebf3640 1 -- 172.21.15.27:0/2899064344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e881021f0 con 0x7f4e88106f40 2024-09-19T08:09:00.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.248+0000 7f4e85ffb640 1 -- 172.21.15.27:0/2899064344 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4e78005560 con 0x7f4e88106f40 2024-09-19T08:09:00.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.249+0000 7f4e85ffb640 1 --2- 172.21.15.27:0/2899064344 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f4e740a32c0 0x7f4e740a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:00.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.249+0000 7f4e85ffb640 1 -- 172.21.15.27:0/2899064344 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f4e780cf5a0 con 0x7f4e88106f40 2024-09-19T08:09:00.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.249+0000 7f4e8c98f640 1 --2- 172.21.15.27:0/2899064344 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f4e740a32c0 0x7f4e740a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:00.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.250+0000 7f4e8c98f640 1 --2- 172.21.15.27:0/2899064344 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f4e740a32c0 0x7f4e740a5780 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4e80009fc0 tx=0x7f4e80005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:00.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.253+0000 7f4e85ffb640 1 -- 172.21.15.27:0/2899064344 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4e78016030 con 0x7f4e88106f40 2024-09-19T08:09:00.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.468+0000 7f4e8ebf3640 1 -- 172.21.15.27:0/2899064344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e88075a20 con 0x7f4e88106f40 2024-09-19T08:09:00.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.469+0000 7f4e85ffb640 1 -- 172.21.15.27:0/2899064344 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9707 (secure 0 0 0) 0x7f4e88075a20 con 0x7f4e88106f40 2024-09-19T08:09:00.469 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:09:00.469 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":12,"btime":"2024-09-19T08:08:57:790948+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T08:09:00.470 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 12 2024-09-19T08:09:00.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.471+0000 7f4e8ebf3640 1 -- 172.21.15.27:0/2899064344 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f4e740a32c0 msgr2=0x7f4e740a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:00.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.471+0000 7f4e8ebf3640 1 --2- 172.21.15.27:0/2899064344 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f4e740a32c0 0x7f4e740a5780 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4e80009fc0 tx=0x7f4e80005f90 comp rx=0 tx=0).stop 2024-09-19T08:09:00.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.471+0000 7f4e8ebf3640 1 -- 172.21.15.27:0/2899064344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e88106f40 msgr2=0x7f4e88074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:00.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.471+0000 7f4e8ebf3640 1 --2- 172.21.15.27:0/2899064344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e88106f40 0x7f4e88074f70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800eaa0 tx=0x7f4e7800ef60 comp rx=0 tx=0).stop 2024-09-19T08:09:00.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.471+0000 7f4e8ebf3640 1 -- 172.21.15.27:0/2899064344 shutdown_connections 2024-09-19T08:09:00.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.471+0000 7f4e8ebf3640 1 --2- 172.21.15.27:0/2899064344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e88106f40 0x7f4e88074f70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:00.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.471+0000 7f4e8ebf3640 1 --2- 172.21.15.27:0/2899064344 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e881027c0 0x7f4e88074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:00.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.471+0000 7f4e8ebf3640 1 --2- 172.21.15.27:0/2899064344 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f4e740a32c0 0x7f4e740a5780 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:00.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.471+0000 7f4e8ebf3640 1 --2- 172.21.15.27:0/2899064344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e88101e10 0x7f4e880744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:00.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.471+0000 7f4e8ebf3640 1 -- 172.21.15.27:0/2899064344 >> 172.21.15.27:0/2899064344 conn(0x7f4e880fd8d0 msgr2=0x7f4e880fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:00.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.472+0000 7f4e8ebf3640 1 -- 172.21.15.27:0/2899064344 shutdown_connections 2024-09-19T08:09:00.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:00.472+0000 7f4e8ebf3640 1 -- 172.21.15.27:0/2899064344 wait complete. 2024-09-19T08:09:00.487 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:09:00 smithi155 podman[65761]: 2024-09-19 08:09:00.229496443 +0000 UTC m=+0.389809352 container init ff521ea2d6646dc100c76a0667c7b7f4c611eb7685bf532a689806ea181cc87b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T08:09:00.487 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:09:00 smithi155 podman[65761]: 2024-09-19 08:09:00.232534561 +0000 UTC m=+0.392847490 container start ff521ea2d6646dc100c76a0667c7b7f4c611eb7685bf532a689806ea181cc87b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-b, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T08:09:00.487 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:09:00 smithi155 ceph-mds[65780]: -- 172.21.15.155:0/872526680 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5613ed9c1860 con 0x5613ed99f400 2024-09-19T08:09:00.487 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:09:00 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-b[65776]: starting mds.b at 2024-09-19T08:09:00.487 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:09:00 smithi155 bash[65761]: ff521ea2d6646dc100c76a0667c7b7f4c611eb7685bf532a689806ea181cc87b 2024-09-19T08:09:00.487 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:09:00 smithi155 systemd[1]: Started Ceph mds.b for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:09:00.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:00 smithi027 ceph-mon[31209]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:00.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:00.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:00.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:00.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:00.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:00.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:00 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2899064344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:09:00.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:00 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:09:00.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:00 smithi155 ceph-mon[35362]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:00.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:00 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:00.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:00 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:00.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:00 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:00.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:00 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:00.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:00 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:00.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:00 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2899064344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:09:00.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:00 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:09:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:00 smithi203 ceph-mon[35198]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:00 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2899064344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:09:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:00 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:09:01.837 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:01 smithi027 ceph-mon[31209]: mds.? [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] up:boot 2024-09-19T08:09:01.837 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:01 smithi027 ceph-mon[31209]: fsmap 12 up:standby 2024-09-19T08:09:01.837 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:01 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:09:01.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:01 smithi155 ceph-mon[35362]: mds.? [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] up:boot 2024-09-19T08:09:01.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:01 smithi155 ceph-mon[35362]: fsmap 12 up:standby 2024-09-19T08:09:01.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:01 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:09:02.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:01 smithi203 ceph-mon[35198]: mds.? [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] up:boot 2024-09-19T08:09:02.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:01 smithi203 ceph-mon[35198]: fsmap 12 up:standby 2024-09-19T08:09:02.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:01 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:09:02.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:02 smithi155 ceph-mon[35362]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:02.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:02.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:02.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:02.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:09:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:09:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:02 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:09:03.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:02 smithi027 ceph-mon[31209]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:03.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:02 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:03.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:02 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:03.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:02 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:03.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:02 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:03.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:02 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:03.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:02 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:03.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:02 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:09:03.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:02 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:09:03.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:02 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:03.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:02 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:09:03.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:02 smithi203 ceph-mon[35198]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:03.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:02 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:03.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:02 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:03.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:02 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:03.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:02 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:03.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:02 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:03.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:02 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:03.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:02 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:09:03.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:02 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:09:03.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:02 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:03.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:02 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:09:03.189 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:09:03.695 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:04.105 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:03 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:04.106 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:03 smithi027 ceph-mon[31209]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:04.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.189+0000 7ff68c84f640 1 -- 172.21.15.27:0/1467382797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff688102d90 msgr2=0x7ff688103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:04.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.189+0000 7ff68c84f640 1 --2- 172.21.15.27:0/1467382797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff688102d90 0x7ff688103170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff678009930 tx=0x7ff67802a420 comp rx=0 tx=0).stop 2024-09-19T08:09:04.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.189+0000 7ff68c84f640 1 -- 172.21.15.27:0/1467382797 shutdown_connections 2024-09-19T08:09:04.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.189+0000 7ff68c84f640 1 --2- 172.21.15.27:0/1467382797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff688108290 0x7ff68810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:04.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.189+0000 7ff68c84f640 1 --2- 172.21.15.27:0/1467382797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff688103740 0x7ff688107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:04.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.189+0000 7ff68c84f640 1 --2- 172.21.15.27:0/1467382797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff688102d90 0x7ff688103170 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:04.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.189+0000 7ff68c84f640 1 -- 172.21.15.27:0/1467382797 >> 172.21.15.27:0/1467382797 conn(0x7ff6880fc7d0 msgr2=0x7ff6880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:04.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.190+0000 7ff68c84f640 1 -- 172.21.15.27:0/1467382797 shutdown_connections 2024-09-19T08:09:04.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.190+0000 7ff68c84f640 1 -- 172.21.15.27:0/1467382797 wait complete. 2024-09-19T08:09:04.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.190+0000 7ff68c84f640 1 Processor -- start 2024-09-19T08:09:04.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.190+0000 7ff68c84f640 1 -- start start 2024-09-19T08:09:04.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.191+0000 7ff68c84f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff688102d90 0x7ff6881a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:04.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.191+0000 7ff68c84f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff688103740 0x7ff6881a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:04.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.191+0000 7ff68c84f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff688108290 0x7ff68819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:04.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.191+0000 7ff68c84f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff688112090 con 0x7ff688103740 2024-09-19T08:09:04.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.191+0000 7ff68c84f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff688111f10 con 0x7ff688102d90 2024-09-19T08:09:04.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.191+0000 7ff68c84f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff688112210 con 0x7ff688108290 2024-09-19T08:09:04.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.191+0000 7ff685d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff688103740 0x7ff6881a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:04.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.191+0000 7ff685d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff688103740 0x7ff6881a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36278/0 (socket says 172.21.15.27:36278) 2024-09-19T08:09:04.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.191+0000 7ff685d9b640 1 -- 172.21.15.27:0/3434735590 learned_addr learned my addr 172.21.15.27:0/3434735590 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:04.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.191+0000 7ff686d9d640 1 --2- 172.21.15.27:0/3434735590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff688108290 0x7ff68819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:04.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.191+0000 7ff68659c640 1 --2- 172.21.15.27:0/3434735590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff688102d90 0x7ff6881a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:04.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.191+0000 7ff685d9b640 1 -- 172.21.15.27:0/3434735590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff688108290 msgr2=0x7ff68819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:04.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.191+0000 7ff685d9b640 1 --2- 172.21.15.27:0/3434735590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff688108290 0x7ff68819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:04.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.191+0000 7ff685d9b640 1 -- 172.21.15.27:0/3434735590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff688102d90 msgr2=0x7ff6881a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:04.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.191+0000 7ff685d9b640 1 --2- 172.21.15.27:0/3434735590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff688102d90 0x7ff6881a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:04.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.191+0000 7ff685d9b640 1 -- 172.21.15.27:0/3434735590 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68819ace0 con 0x7ff688103740 2024-09-19T08:09:04.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.191+0000 7ff68659c640 1 --2- 172.21.15.27:0/3434735590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff688102d90 0x7ff6881a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:09:04.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.191+0000 7ff685d9b640 1 --2- 172.21.15.27:0/3434735590 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff688103740 0x7ff6881a0930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff67c00e9f0 tx=0x7ff67c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:04.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.192+0000 7ff6777fe640 1 -- 172.21.15.27:0/3434735590 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67c00ccc0 con 0x7ff688103740 2024-09-19T08:09:04.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.192+0000 7ff68c84f640 1 -- 172.21.15.27:0/3434735590 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff68819afd0 con 0x7ff688103740 2024-09-19T08:09:04.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.192+0000 7ff6777fe640 1 -- 172.21.15.27:0/3434735590 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff67c005500 con 0x7ff688103740 2024-09-19T08:09:04.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.192+0000 7ff6777fe640 1 -- 172.21.15.27:0/3434735590 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67c010690 con 0x7ff688103740 2024-09-19T08:09:04.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.192+0000 7ff68c84f640 1 -- 172.21.15.27:0/3434735590 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6881a72c0 con 0x7ff688103740 2024-09-19T08:09:04.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.193+0000 7ff68c84f640 1 -- 172.21.15.27:0/3434735590 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff688103170 con 0x7ff688103740 2024-09-19T08:09:04.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.194+0000 7ff6777fe640 1 -- 172.21.15.27:0/3434735590 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff67c0046c0 con 0x7ff688103740 2024-09-19T08:09:04.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.194+0000 7ff6777fe640 1 --2- 172.21.15.27:0/3434735590 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff6700a3240 0x7ff6700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:04.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.195+0000 7ff68659c640 1 --2- 172.21.15.27:0/3434735590 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff6700a3240 0x7ff6700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:04.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.195+0000 7ff6777fe640 1 -- 172.21.15.27:0/3434735590 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7ff67c0cf950 con 0x7ff688103740 2024-09-19T08:09:04.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.195+0000 7ff68659c640 1 --2- 172.21.15.27:0/3434735590 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff6700a3240 0x7ff6700a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff678000c00 tx=0x7ff678032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:04.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.199+0000 7ff6777fe640 1 -- 172.21.15.27:0/3434735590 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff67c09cb10 con 0x7ff688103740 2024-09-19T08:09:04.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:03 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:04.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:03 smithi155 ceph-mon[35362]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:04.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:03 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:04.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:03 smithi203 ceph-mon[35198]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:04.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.452+0000 7ff68c84f640 1 -- 172.21.15.27:0/3434735590 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff68810c2b0 con 0x7ff688103740 2024-09-19T08:09:04.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.452+0000 7ff6777fe640 1 -- 172.21.15.27:0/3434735590 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10536 (secure 0 0 0) 0x7ff67c09c410 con 0x7ff688103740 2024-09-19T08:09:04.452 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:09:04.452 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 13 2024-09-19T08:09:04.453 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":13,"btime":"2024-09-19T08:09:00:711545+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24482,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-19T08:09:04.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.455+0000 7ff68c84f640 1 -- 172.21.15.27:0/3434735590 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff6700a3240 msgr2=0x7ff6700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:04.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.455+0000 7ff68c84f640 1 --2- 172.21.15.27:0/3434735590 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff6700a3240 0x7ff6700a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff678000c00 tx=0x7ff678032c70 comp rx=0 tx=0).stop 2024-09-19T08:09:04.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.455+0000 7ff68c84f640 1 -- 172.21.15.27:0/3434735590 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff688103740 msgr2=0x7ff6881a0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:04.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.455+0000 7ff68c84f640 1 --2- 172.21.15.27:0/3434735590 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff688103740 0x7ff6881a0930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff67c00e9f0 tx=0x7ff67c00eeb0 comp rx=0 tx=0).stop 2024-09-19T08:09:04.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.455+0000 7ff68c84f640 1 -- 172.21.15.27:0/3434735590 shutdown_connections 2024-09-19T08:09:04.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.455+0000 7ff68c84f640 1 --2- 172.21.15.27:0/3434735590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff688108290 0x7ff68819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:04.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.455+0000 7ff68c84f640 1 --2- 172.21.15.27:0/3434735590 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff688103740 0x7ff6881a0930 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:04.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.455+0000 7ff68c84f640 1 --2- 172.21.15.27:0/3434735590 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff6700a3240 0x7ff6700a5700 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:04.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.455+0000 7ff68c84f640 1 --2- 172.21.15.27:0/3434735590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff688102d90 0x7ff6881a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:04.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.455+0000 7ff68c84f640 1 -- 172.21.15.27:0/3434735590 >> 172.21.15.27:0/3434735590 conn(0x7ff6880fc7d0 msgr2=0x7ff688100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:04.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.455+0000 7ff68c84f640 1 -- 172.21.15.27:0/3434735590 shutdown_connections 2024-09-19T08:09:04.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:04.455+0000 7ff68c84f640 1 -- 172.21.15.27:0/3434735590 wait complete. 2024-09-19T08:09:05.135 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:04 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.135 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:04 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.136 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:04 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.136 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:04 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.136 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:04 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3434735590' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:09:05.136 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:04 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.136 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:04 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.136 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:04 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:09:05.136 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:04 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:09:05.136 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:04 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.163 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T08:09:05.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:04 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:04 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:04 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:04 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:04 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3434735590' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:09:05.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:04 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:04 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:04 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:09:05.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:04 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:09:05.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:04 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.421 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:05.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:04 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:04 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:04 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:04 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:04 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3434735590' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:09:05.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:04 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:04 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.488 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:04 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:09:05.488 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:04 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:09:05.488 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:04 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:09:05.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.882+0000 7fe955897640 1 -- 172.21.15.27:0/64121987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe95010c170 msgr2=0x7fe95010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:05.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.882+0000 7fe955897640 1 --2- 172.21.15.27:0/64121987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe95010c170 0x7fe95010e610 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe948009ca0 tx=0x7fe94802a950 comp rx=0 tx=0).stop 2024-09-19T08:09:05.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.882+0000 7fe955897640 1 -- 172.21.15.27:0/64121987 shutdown_connections 2024-09-19T08:09:05.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.882+0000 7fe955897640 1 --2- 172.21.15.27:0/64121987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe95010c170 0x7fe95010e610 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:05.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.882+0000 7fe955897640 1 --2- 172.21.15.27:0/64121987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe950103660 0x7fe95010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:05.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.882+0000 7fe955897640 1 --2- 172.21.15.27:0/64121987 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe950102d40 0x7fe950103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:05.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.882+0000 7fe955897640 1 -- 172.21.15.27:0/64121987 >> 172.21.15.27:0/64121987 conn(0x7fe9500fc7a0 msgr2=0x7fe9500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:05.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.883+0000 7fe955897640 1 -- 172.21.15.27:0/64121987 shutdown_connections 2024-09-19T08:09:05.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.883+0000 7fe955897640 1 -- 172.21.15.27:0/64121987 wait complete. 2024-09-19T08:09:05.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.884+0000 7fe955897640 1 Processor -- start 2024-09-19T08:09:05.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.884+0000 7fe955897640 1 -- start start 2024-09-19T08:09:05.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.884+0000 7fe955897640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe950102d40 0x7fe950198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:05.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.884+0000 7fe955897640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe950103660 0x7fe950198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:05.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.884+0000 7fe955897640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe95010c170 0x7fe95019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:05.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.884+0000 7fe955897640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe950111f70 con 0x7fe95010c170 2024-09-19T08:09:05.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.884+0000 7fe955897640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe950111df0 con 0x7fe950102d40 2024-09-19T08:09:05.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.884+0000 7fe955897640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe9501120f0 con 0x7fe950103660 2024-09-19T08:09:05.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.884+0000 7fe94f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe95010c170 0x7fe95019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:05.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.884+0000 7fe94f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe95010c170 0x7fe95019cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36294/0 (socket says 172.21.15.27:36294) 2024-09-19T08:09:05.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.884+0000 7fe94f7fe640 1 -- 172.21.15.27:0/243285848 learned_addr learned my addr 172.21.15.27:0/243285848 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:05.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.884+0000 7fe94effd640 1 --2- 172.21.15.27:0/243285848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe950102d40 0x7fe950198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:05.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.884+0000 7fe94e7fc640 1 --2- 172.21.15.27:0/243285848 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe950103660 0x7fe950198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:05.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.885+0000 7fe94f7fe640 1 -- 172.21.15.27:0/243285848 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe950103660 msgr2=0x7fe950198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:05.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.885+0000 7fe94f7fe640 1 --2- 172.21.15.27:0/243285848 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe950103660 0x7fe950198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:05.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.885+0000 7fe94f7fe640 1 -- 172.21.15.27:0/243285848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe950102d40 msgr2=0x7fe950198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:05.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.885+0000 7fe94f7fe640 1 --2- 172.21.15.27:0/243285848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe950102d40 0x7fe950198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:05.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.885+0000 7fe94f7fe640 1 -- 172.21.15.27:0/243285848 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95019d3c0 con 0x7fe95010c170 2024-09-19T08:09:05.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.885+0000 7fe94f7fe640 1 --2- 172.21.15.27:0/243285848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe95010c170 0x7fe95019cce0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe94802ae70 tx=0x7fe94802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:05.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.885+0000 7fe954895640 1 -- 172.21.15.27:0/243285848 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe948034040 con 0x7fe95010c170 2024-09-19T08:09:05.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.885+0000 7fe955897640 1 -- 172.21.15.27:0/243285848 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95019d650 con 0x7fe95010c170 2024-09-19T08:09:05.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.885+0000 7fe954895640 1 -- 172.21.15.27:0/243285848 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe948030920 con 0x7fe95010c170 2024-09-19T08:09:05.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.885+0000 7fe954895640 1 -- 172.21.15.27:0/243285848 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe948045480 con 0x7fe95010c170 2024-09-19T08:09:05.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.885+0000 7fe955897640 1 -- 172.21.15.27:0/243285848 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9501a4f90 con 0x7fe95010c170 2024-09-19T08:09:05.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.886+0000 7fe955897640 1 -- 172.21.15.27:0/243285848 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe95006b070 con 0x7fe95010c170 2024-09-19T08:09:05.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.887+0000 7fe954895640 1 -- 172.21.15.27:0/243285848 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe948037020 con 0x7fe95010c170 2024-09-19T08:09:05.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.888+0000 7fe954895640 1 --2- 172.21.15.27:0/243285848 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe9380a3240 0x7fe9380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:05.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.888+0000 7fe94effd640 1 --2- 172.21.15.27:0/243285848 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe9380a3240 0x7fe9380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:05.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.888+0000 7fe954895640 1 -- 172.21.15.27:0/243285848 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fe9480f0370 con 0x7fe95010c170 2024-09-19T08:09:05.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.889+0000 7fe94effd640 1 --2- 172.21.15.27:0/243285848 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe9380a3240 0x7fe9380a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe940005fd0 tx=0x7fe94000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:05.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:05.893+0000 7fe954895640 1 -- 172.21.15.27:0/243285848 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe9480bd530 con 0x7fe95010c170 2024-09-19T08:09:06.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:06.072+0000 7fe955897640 1 -- 172.21.15.27:0/243285848 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe9501a5160 con 0x7fe95010c170 2024-09-19T08:09:06.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:06.073+0000 7fe954895640 1 -- 172.21.15.27:0/243285848 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) ==== 84+0+65 (secure 0 0 0) 0x7fe9480bce30 con 0x7fe95010c170 2024-09-19T08:09:06.073 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:09:06.073 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2024-09-19T08:09:06.073 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:09:06.073 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 1, 2024-09-19T08:09:06.073 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": ".mgr" 2024-09-19T08:09:06.073 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:09:06.073 INFO:teuthology.orchestra.run.smithi027.stdout:] 2024-09-19T08:09:06.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:06.075+0000 7fe955897640 1 -- 172.21.15.27:0/243285848 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe9380a3240 msgr2=0x7fe9380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:06.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:06.075+0000 7fe955897640 1 --2- 172.21.15.27:0/243285848 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe9380a3240 0x7fe9380a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe940005fd0 tx=0x7fe94000b390 comp rx=0 tx=0).stop 2024-09-19T08:09:06.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:06.075+0000 7fe955897640 1 -- 172.21.15.27:0/243285848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe95010c170 msgr2=0x7fe95019cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:06.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:06.075+0000 7fe955897640 1 --2- 172.21.15.27:0/243285848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe95010c170 0x7fe95019cce0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe94802ae70 tx=0x7fe94802f5b0 comp rx=0 tx=0).stop 2024-09-19T08:09:06.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:06.075+0000 7fe955897640 1 -- 172.21.15.27:0/243285848 shutdown_connections 2024-09-19T08:09:06.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:06.075+0000 7fe955897640 1 --2- 172.21.15.27:0/243285848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe95010c170 0x7fe95019cce0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:06.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:06.075+0000 7fe955897640 1 --2- 172.21.15.27:0/243285848 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe950103660 0x7fe950198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:06.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:06.075+0000 7fe955897640 1 --2- 172.21.15.27:0/243285848 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe9380a3240 0x7fe9380a5700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:06.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:06.075+0000 7fe955897640 1 --2- 172.21.15.27:0/243285848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe950102d40 0x7fe950198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:06.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:06.075+0000 7fe955897640 1 -- 172.21.15.27:0/243285848 >> 172.21.15.27:0/243285848 conn(0x7fe9500fc7a0 msgr2=0x7fe9500fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:06.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:06.076+0000 7fe955897640 1 -- 172.21.15.27:0/243285848 shutdown_connections 2024-09-19T08:09:06.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:06.076+0000 7fe955897640 1 -- 172.21.15.27:0/243285848 wait complete. 2024-09-19T08:09:06.699 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T08:09:06.699 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T08:09:06.959 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:07.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:06 smithi027 ceph-mon[31209]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:07.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:06 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/243285848' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T08:09:07.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:06 smithi155 ceph-mon[35362]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:07.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:06 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/243285848' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T08:09:07.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:06 smithi203 ceph-mon[35198]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:07.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:06 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/243285848' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T08:09:07.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.426+0000 7f1428f2b640 1 -- 172.21.15.27:0/1075003165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1424101de0 msgr2=0x7f14241021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:07.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.426+0000 7f1428f2b640 1 --2- 172.21.15.27:0/1075003165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1424101de0 0x7f14241021c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f140c009900 tx=0x7f140c02a410 comp rx=0 tx=0).stop 2024-09-19T08:09:07.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.426+0000 7f1428f2b640 1 -- 172.21.15.27:0/1075003165 shutdown_connections 2024-09-19T08:09:07.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.426+0000 7f1428f2b640 1 --2- 172.21.15.27:0/1075003165 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1424106f10 0x7f142410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:07.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.426+0000 7f1428f2b640 1 --2- 172.21.15.27:0/1075003165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1424102790 0x7f14241067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:07.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.426+0000 7f1428f2b640 1 --2- 172.21.15.27:0/1075003165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1424101de0 0x7f14241021c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:07.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.426+0000 7f1428f2b640 1 -- 172.21.15.27:0/1075003165 >> 172.21.15.27:0/1075003165 conn(0x7f14240fd8c0 msgr2=0x7f14240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:07.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.426+0000 7f1428f2b640 1 -- 172.21.15.27:0/1075003165 shutdown_connections 2024-09-19T08:09:07.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.426+0000 7f1428f2b640 1 -- 172.21.15.27:0/1075003165 wait complete. 2024-09-19T08:09:07.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.427+0000 7f1428f2b640 1 Processor -- start 2024-09-19T08:09:07.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.427+0000 7f1428f2b640 1 -- start start 2024-09-19T08:09:07.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.427+0000 7f1428f2b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1424101de0 0x7f1424198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:07.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.427+0000 7f1428f2b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1424102790 0x7f1424198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:07.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.427+0000 7f1428f2b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1424106f10 0x7f142419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:07.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.427+0000 7f1428f2b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1424111fb0 con 0x7f1424101de0 2024-09-19T08:09:07.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.427+0000 7f1428f2b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1424111e30 con 0x7f1424102790 2024-09-19T08:09:07.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.427+0000 7f1428f2b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1424112130 con 0x7f1424106f10 2024-09-19T08:09:07.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.427+0000 7f142259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1424101de0 0x7f1424198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:07.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.427+0000 7f142259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1424101de0 0x7f1424198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36306/0 (socket says 172.21.15.27:36306) 2024-09-19T08:09:07.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.427+0000 7f142259c640 1 -- 172.21.15.27:0/3256499261 learned_addr learned my addr 172.21.15.27:0/3256499261 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:07.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.427+0000 7f1421d9b640 1 --2- 172.21.15.27:0/3256499261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1424102790 0x7f1424198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:07.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.427+0000 7f1422d9d640 1 --2- 172.21.15.27:0/3256499261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1424106f10 0x7f142419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:07.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.428+0000 7f142259c640 1 -- 172.21.15.27:0/3256499261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1424106f10 msgr2=0x7f142419cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:07.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.428+0000 7f142259c640 1 --2- 172.21.15.27:0/3256499261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1424106f10 0x7f142419cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:07.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.428+0000 7f142259c640 1 -- 172.21.15.27:0/3256499261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1424102790 msgr2=0x7f1424198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:07.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.428+0000 7f142259c640 1 --2- 172.21.15.27:0/3256499261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1424102790 0x7f1424198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:07.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.428+0000 7f142259c640 1 -- 172.21.15.27:0/3256499261 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f142419d4c0 con 0x7f1424101de0 2024-09-19T08:09:07.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.428+0000 7f142259c640 1 --2- 172.21.15.27:0/3256499261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1424101de0 0x7f1424198510 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f140c006010 tx=0x7f140c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:07.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.428+0000 7f141b7fe640 1 -- 172.21.15.27:0/3256499261 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c03f030 con 0x7f1424101de0 2024-09-19T08:09:07.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.428+0000 7f141b7fe640 1 -- 172.21.15.27:0/3256499261 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f140c003ce0 con 0x7f1424101de0 2024-09-19T08:09:07.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.428+0000 7f1428f2b640 1 -- 172.21.15.27:0/3256499261 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f142419d750 con 0x7f1424101de0 2024-09-19T08:09:07.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.428+0000 7f141b7fe640 1 -- 172.21.15.27:0/3256499261 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c035070 con 0x7f1424101de0 2024-09-19T08:09:07.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.428+0000 7f1428f2b640 1 -- 172.21.15.27:0/3256499261 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14241a5090 con 0x7f1424101de0 2024-09-19T08:09:07.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.429+0000 7f1428f2b640 1 -- 172.21.15.27:0/3256499261 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14241032c0 con 0x7f1424101de0 2024-09-19T08:09:07.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.430+0000 7f141b7fe640 1 -- 172.21.15.27:0/3256499261 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f140c042030 con 0x7f1424101de0 2024-09-19T08:09:07.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.431+0000 7f141b7fe640 1 --2- 172.21.15.27:0/3256499261 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f14100a3240 0x7f14100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:07.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.431+0000 7f1421d9b640 1 --2- 172.21.15.27:0/3256499261 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f14100a3240 0x7f14100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:07.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.431+0000 7f141b7fe640 1 -- 172.21.15.27:0/3256499261 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f140c0ef7e0 con 0x7f1424101de0 2024-09-19T08:09:07.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.431+0000 7f1421d9b640 1 --2- 172.21.15.27:0/3256499261 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f14100a3240 0x7f14100a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f14240fdd00 tx=0x7f1414009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:07.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.435+0000 7f141b7fe640 1 -- 172.21.15.27:0/3256499261 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f140c0bc9a0 con 0x7f1424101de0 2024-09-19T08:09:07.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:07.611+0000 7f1428f2b640 1 -- 172.21.15.27:0/3256499261 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f142410a0f0 con 0x7f1424101de0 2024-09-19T08:09:08.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:08.097+0000 7f141b7fe640 1 -- 172.21.15.27:0/3256499261 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) ==== 138+0+0 (secure 0 0 0) 0x7f140c0bc2a0 con 0x7f1424101de0 2024-09-19T08:09:08.098 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' created 2024-09-19T08:09:08.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:08.099+0000 7f1428f2b640 1 -- 172.21.15.27:0/3256499261 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f14100a3240 msgr2=0x7f14100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:08.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:08.099+0000 7f1428f2b640 1 --2- 172.21.15.27:0/3256499261 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f14100a3240 0x7f14100a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f14240fdd00 tx=0x7f1414009110 comp rx=0 tx=0).stop 2024-09-19T08:09:08.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:08.099+0000 7f1428f2b640 1 -- 172.21.15.27:0/3256499261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1424101de0 msgr2=0x7f1424198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:08.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:08.099+0000 7f1428f2b640 1 --2- 172.21.15.27:0/3256499261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1424101de0 0x7f1424198510 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f140c006010 tx=0x7f140c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:09:08.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:08.100+0000 7f1428f2b640 1 -- 172.21.15.27:0/3256499261 shutdown_connections 2024-09-19T08:09:08.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:08.100+0000 7f1428f2b640 1 --2- 172.21.15.27:0/3256499261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1424106f10 0x7f142419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:08.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:08.100+0000 7f1428f2b640 1 --2- 172.21.15.27:0/3256499261 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f14100a3240 0x7f14100a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:08.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:08.100+0000 7f1428f2b640 1 --2- 172.21.15.27:0/3256499261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1424102790 0x7f1424198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:08.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:08.100+0000 7f1428f2b640 1 --2- 172.21.15.27:0/3256499261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1424101de0 0x7f1424198510 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:08.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:08.100+0000 7f1428f2b640 1 -- 172.21.15.27:0/3256499261 >> 172.21.15.27:0/3256499261 conn(0x7f14240fd8c0 msgr2=0x7f14240febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:08.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:08.100+0000 7f1428f2b640 1 -- 172.21.15.27:0/3256499261 shutdown_connections 2024-09-19T08:09:08.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:08.100+0000 7f1428f2b640 1 -- 172.21.15.27:0/3256499261 wait complete. 2024-09-19T08:09:08.469 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:08 smithi027 ceph-mon[31209]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:08.469 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:08 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3256499261' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T08:09:08.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:08 smithi155 ceph-mon[35362]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:08.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:08 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3256499261' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T08:09:08.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:08 smithi203 ceph-mon[35198]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:08.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:08 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3256499261' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T08:09:08.831 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T08:09:09.095 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:09.380 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:09 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3256499261' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T08:09:09.381 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:09 smithi027 ceph-mon[31209]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T08:09:09.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:09 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3256499261' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T08:09:09.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:09 smithi155 ceph-mon[35362]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T08:09:09.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:09 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3256499261' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T08:09:09.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:09 smithi203 ceph-mon[35198]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T08:09:09.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.603+0000 7fe44ab9a640 1 -- 172.21.15.27:0/2681733624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe444100d00 msgr2=0x7fe444106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:09.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.603+0000 7fe44ab9a640 1 --2- 172.21.15.27:0/2681733624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe444100d00 0x7fe444106840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe438009930 tx=0x7fe43802a420 comp rx=0 tx=0).stop 2024-09-19T08:09:09.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.603+0000 7fe44ab9a640 1 -- 172.21.15.27:0/2681733624 shutdown_connections 2024-09-19T08:09:09.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.603+0000 7fe44ab9a640 1 --2- 172.21.15.27:0/2681733624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe444106f50 0x7fe44410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:09.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.603+0000 7fe44ab9a640 1 --2- 172.21.15.27:0/2681733624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe444100d00 0x7fe444106840 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:09.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.603+0000 7fe44ab9a640 1 --2- 172.21.15.27:0/2681733624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe444100350 0x7fe444100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:09.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.603+0000 7fe44ab9a640 1 -- 172.21.15.27:0/2681733624 >> 172.21.15.27:0/2681733624 conn(0x7fe444077210 msgr2=0x7fe4440fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:09.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.604+0000 7fe44ab9a640 1 -- 172.21.15.27:0/2681733624 shutdown_connections 2024-09-19T08:09:09.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.604+0000 7fe44ab9a640 1 -- 172.21.15.27:0/2681733624 wait complete. 2024-09-19T08:09:09.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.604+0000 7fe44ab9a640 1 Processor -- start 2024-09-19T08:09:09.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.604+0000 7fe44ab9a640 1 -- start start 2024-09-19T08:09:09.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.605+0000 7fe44ab9a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe444100350 0x7fe4441985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:09.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.605+0000 7fe44ab9a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe444100d00 0x7fe444198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:09.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.605+0000 7fe44ab9a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe444106f50 0x7fe44419ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:09.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.605+0000 7fe44ab9a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe444111fa0 con 0x7fe444106f50 2024-09-19T08:09:09.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.605+0000 7fe44ab9a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe444111e20 con 0x7fe444100350 2024-09-19T08:09:09.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.605+0000 7fe44ab9a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe444112120 con 0x7fe444100d00 2024-09-19T08:09:09.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.605+0000 7fe449137640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe444106f50 0x7fe44419ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:09.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.605+0000 7fe449137640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe444106f50 0x7fe44419ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36326/0 (socket says 172.21.15.27:36326) 2024-09-19T08:09:09.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.605+0000 7fe449137640 1 -- 172.21.15.27:0/4206773406 learned_addr learned my addr 172.21.15.27:0/4206773406 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:09.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.605+0000 7fe448936640 1 --2- 172.21.15.27:0/4206773406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe444100350 0x7fe4441985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:09.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.605+0000 7fe443fff640 1 --2- 172.21.15.27:0/4206773406 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe444100d00 0x7fe444198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:09.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.605+0000 7fe449137640 1 -- 172.21.15.27:0/4206773406 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe444100d00 msgr2=0x7fe444198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:09.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.605+0000 7fe449137640 1 --2- 172.21.15.27:0/4206773406 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe444100d00 0x7fe444198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:09.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.605+0000 7fe449137640 1 -- 172.21.15.27:0/4206773406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe444100350 msgr2=0x7fe4441985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:09.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.605+0000 7fe449137640 1 --2- 172.21.15.27:0/4206773406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe444100350 0x7fe4441985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:09.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.605+0000 7fe449137640 1 -- 172.21.15.27:0/4206773406 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44419d590 con 0x7fe444106f50 2024-09-19T08:09:09.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.605+0000 7fe449137640 1 --2- 172.21.15.27:0/4206773406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe444106f50 0x7fe44419ceb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00cad0 tx=0x7fe43c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:09.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.606+0000 7fe441ffb640 1 -- 172.21.15.27:0/4206773406 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c00ae20 con 0x7fe444106f50 2024-09-19T08:09:09.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.606+0000 7fe44ab9a640 1 -- 172.21.15.27:0/4206773406 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe44419d880 con 0x7fe444106f50 2024-09-19T08:09:09.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.606+0000 7fe441ffb640 1 -- 172.21.15.27:0/4206773406 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe43c005020 con 0x7fe444106f50 2024-09-19T08:09:09.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.606+0000 7fe441ffb640 1 -- 172.21.15.27:0/4206773406 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c00f6b0 con 0x7fe444106f50 2024-09-19T08:09:09.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.606+0000 7fe44ab9a640 1 -- 172.21.15.27:0/4206773406 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4441a5160 con 0x7fe444106f50 2024-09-19T08:09:09.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.607+0000 7fe44ab9a640 1 -- 172.21.15.27:0/4206773406 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe444100730 con 0x7fe444106f50 2024-09-19T08:09:09.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.608+0000 7fe441ffb640 1 -- 172.21.15.27:0/4206773406 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe43c0051d0 con 0x7fe444106f50 2024-09-19T08:09:09.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.608+0000 7fe441ffb640 1 --2- 172.21.15.27:0/4206773406 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe42c0a3240 0x7fe42c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:09.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.609+0000 7fe448936640 1 --2- 172.21.15.27:0/4206773406 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe42c0a3240 0x7fe42c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:09.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.609+0000 7fe441ffb640 1 -- 172.21.15.27:0/4206773406 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7497+0+0 (secure 0 0 0) 0x7fe43c0cf970 con 0x7fe444106f50 2024-09-19T08:09:09.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.609+0000 7fe448936640 1 --2- 172.21.15.27:0/4206773406 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe42c0a3240 0x7fe42c0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe434005fd0 tx=0x7fe434005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:09.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.613+0000 7fe441ffb640 1 -- 172.21.15.27:0/4206773406 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe43c014030 con 0x7fe444106f50 2024-09-19T08:09:09.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:09.789+0000 7fe44ab9a640 1 -- 172.21.15.27:0/4206773406 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe44410a120 con 0x7fe444106f50 2024-09-19T08:09:10.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:10.224+0000 7fe441ffb640 1 -- 172.21.15.27:0/4206773406 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) ==== 170+0+0 (secure 0 0 0) 0x7fe43c09c9c0 con 0x7fe444106f50 2024-09-19T08:09:10.224 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' created 2024-09-19T08:09:10.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:10.226+0000 7fe44ab9a640 1 -- 172.21.15.27:0/4206773406 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe42c0a3240 msgr2=0x7fe42c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:10.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:10.226+0000 7fe44ab9a640 1 --2- 172.21.15.27:0/4206773406 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe42c0a3240 0x7fe42c0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe434005fd0 tx=0x7fe434005850 comp rx=0 tx=0).stop 2024-09-19T08:09:10.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:10.226+0000 7fe44ab9a640 1 -- 172.21.15.27:0/4206773406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe444106f50 msgr2=0x7fe44419ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:10.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:10.226+0000 7fe44ab9a640 1 --2- 172.21.15.27:0/4206773406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe444106f50 0x7fe44419ceb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00cad0 tx=0x7fe43c00cf90 comp rx=0 tx=0).stop 2024-09-19T08:09:10.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:10.226+0000 7fe44ab9a640 1 -- 172.21.15.27:0/4206773406 shutdown_connections 2024-09-19T08:09:10.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:10.226+0000 7fe44ab9a640 1 --2- 172.21.15.27:0/4206773406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe444106f50 0x7fe44419ceb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:10.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:10.226+0000 7fe44ab9a640 1 --2- 172.21.15.27:0/4206773406 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe444100d00 0x7fe444198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:10.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:10.226+0000 7fe44ab9a640 1 --2- 172.21.15.27:0/4206773406 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe42c0a3240 0x7fe42c0a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:10.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:10.226+0000 7fe44ab9a640 1 --2- 172.21.15.27:0/4206773406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe444100350 0x7fe4441985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:10.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:10.226+0000 7fe44ab9a640 1 -- 172.21.15.27:0/4206773406 >> 172.21.15.27:0/4206773406 conn(0x7fe444077210 msgr2=0x7fe444105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:10.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:10.226+0000 7fe44ab9a640 1 -- 172.21.15.27:0/4206773406 shutdown_connections 2024-09-19T08:09:10.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:10.226+0000 7fe44ab9a640 1 -- 172.21.15.27:0/4206773406 wait complete. 2024-09-19T08:09:10.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:10 smithi027 ceph-mon[31209]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T08:09:10.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:10 smithi027 ceph-mon[31209]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T08:09:10.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:10 smithi203 ceph-mon[35198]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T08:09:10.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:10 smithi203 ceph-mon[35198]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T08:09:10.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:10 smithi155 ceph-mon[35362]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T08:09:10.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:10 smithi155 ceph-mon[35362]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T08:09:10.925 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T08:09:11.183 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:11.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:11 smithi203 ceph-mon[35198]: pgmap v275: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:11.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:11 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/4206773406' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T08:09:11.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:11 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/4206773406' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T08:09:11.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:11 smithi203 ceph-mon[35198]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T08:09:11.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:11 smithi203 ceph-mon[35198]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T08:09:11.509 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:11 smithi027 ceph-mon[31209]: pgmap v275: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:11.509 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:11 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/4206773406' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T08:09:11.509 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:11 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/4206773406' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T08:09:11.509 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:11 smithi027 ceph-mon[31209]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T08:09:11.509 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:11 smithi027 ceph-mon[31209]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T08:09:11.641 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:11 smithi155 ceph-mon[35362]: pgmap v275: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:11.642 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:11 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/4206773406' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T08:09:11.642 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:11 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/4206773406' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T08:09:11.642 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:11 smithi155 ceph-mon[35362]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T08:09:11.642 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:11 smithi155 ceph-mon[35362]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T08:09:11.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.702+0000 7f0865887640 1 -- 172.21.15.27:0/2517615809 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0860106a80 msgr2=0x7f0860106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:11.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.702+0000 7f0865887640 1 --2- 172.21.15.27:0/2517615809 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0860106a80 0x7f0860106e60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0850009930 tx=0x7f085002a420 comp rx=0 tx=0).stop 2024-09-19T08:09:11.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.702+0000 7f0865887640 1 -- 172.21.15.27:0/2517615809 shutdown_connections 2024-09-19T08:09:11.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.702+0000 7f0865887640 1 --2- 172.21.15.27:0/2517615809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0860101420 0x7f086010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:11.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.702+0000 7f0865887640 1 --2- 172.21.15.27:0/2517615809 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0860100a80 0x7f0860100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:11.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.702+0000 7f0865887640 1 --2- 172.21.15.27:0/2517615809 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0860106a80 0x7f0860106e60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:11.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.702+0000 7f0865887640 1 -- 172.21.15.27:0/2517615809 >> 172.21.15.27:0/2517615809 conn(0x7f08600fc7a0 msgr2=0x7f08600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:11.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.702+0000 7f0865887640 1 -- 172.21.15.27:0/2517615809 shutdown_connections 2024-09-19T08:09:11.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.702+0000 7f0865887640 1 -- 172.21.15.27:0/2517615809 wait complete. 2024-09-19T08:09:11.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.703+0000 7f0865887640 1 Processor -- start 2024-09-19T08:09:11.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.703+0000 7f0865887640 1 -- start start 2024-09-19T08:09:11.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.703+0000 7f0865887640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0860100a80 0x7f0860197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:11.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.703+0000 7f0865887640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0860101420 0x7f08601975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:11.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.703+0000 7f0865887640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0860106a80 0x7f0860197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:11.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.703+0000 7f0865887640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0860110e40 con 0x7f0860106a80 2024-09-19T08:09:11.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.703+0000 7f0865887640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0860110cc0 con 0x7f0860101420 2024-09-19T08:09:11.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.703+0000 7f0865887640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0860110fc0 con 0x7f0860100a80 2024-09-19T08:09:11.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.703+0000 7f085f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0860106a80 0x7f0860197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:11.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.703+0000 7f085f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0860106a80 0x7f0860197b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58140/0 (socket says 172.21.15.27:58140) 2024-09-19T08:09:11.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.703+0000 7f085f7fe640 1 -- 172.21.15.27:0/4223458273 learned_addr learned my addr 172.21.15.27:0/4223458273 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:11.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.703+0000 7f08567fc640 1 --2- 172.21.15.27:0/4223458273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0860101420 0x7f08601975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:11.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.703+0000 7f085effd640 1 --2- 172.21.15.27:0/4223458273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0860100a80 0x7f0860197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:11.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.703+0000 7f085f7fe640 1 -- 172.21.15.27:0/4223458273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0860100a80 msgr2=0x7f0860197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:11.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.703+0000 7f085f7fe640 1 --2- 172.21.15.27:0/4223458273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0860100a80 0x7f0860197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:11.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.703+0000 7f085f7fe640 1 -- 172.21.15.27:0/4223458273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0860101420 msgr2=0x7f08601975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:11.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.703+0000 7f085f7fe640 1 --2- 172.21.15.27:0/4223458273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0860101420 0x7f08601975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:11.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.703+0000 7f085f7fe640 1 -- 172.21.15.27:0/4223458273 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08601a6900 con 0x7f0860106a80 2024-09-19T08:09:11.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.703+0000 7f085effd640 1 --2- 172.21.15.27:0/4223458273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0860100a80 0x7f0860197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:09:11.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.704+0000 7f085f7fe640 1 --2- 172.21.15.27:0/4223458273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0860106a80 0x7f0860197b10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f085800eaa0 tx=0x7f085800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:11.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.704+0000 7f0864885640 1 -- 172.21.15.27:0/4223458273 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085800cdb0 con 0x7f0860106a80 2024-09-19T08:09:11.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.704+0000 7f0864885640 1 -- 172.21.15.27:0/4223458273 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0858005020 con 0x7f0860106a80 2024-09-19T08:09:11.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.704+0000 7f0865887640 1 -- 172.21.15.27:0/4223458273 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08601a6bf0 con 0x7f0860106a80 2024-09-19T08:09:11.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.704+0000 7f0864885640 1 -- 172.21.15.27:0/4223458273 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08580116b0 con 0x7f0860106a80 2024-09-19T08:09:11.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.704+0000 7f0865887640 1 -- 172.21.15.27:0/4223458273 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08601a70e0 con 0x7f0860106a80 2024-09-19T08:09:11.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.705+0000 7f0865887640 1 -- 172.21.15.27:0/4223458273 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0860100ee0 con 0x7f0860106a80 2024-09-19T08:09:11.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.706+0000 7f0864885640 1 -- 172.21.15.27:0/4223458273 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0858005560 con 0x7f0860106a80 2024-09-19T08:09:11.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.707+0000 7f0864885640 1 --2- 172.21.15.27:0/4223458273 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f084c0a3240 0x7f084c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:11.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.707+0000 7f085effd640 1 --2- 172.21.15.27:0/4223458273 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f084c0a3240 0x7f084c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:11.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.707+0000 7f0864885640 1 -- 172.21.15.27:0/4223458273 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7879+0+0 (secure 0 0 0) 0x7f08580cfa20 con 0x7f0860106a80 2024-09-19T08:09:11.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.707+0000 7f085effd640 1 --2- 172.21.15.27:0/4223458273 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f084c0a3240 0x7f084c0a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0850000c00 tx=0x7f0850032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:11.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.711+0000 7f0864885640 1 -- 172.21.15.27:0/4223458273 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0858016030 con 0x7f0860106a80 2024-09-19T08:09:11.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:11.927+0000 7f0865887640 1 -- 172.21.15.27:0/4223458273 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f086002d7c0 con 0x7f0860106a80 2024-09-19T08:09:12.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:12.255+0000 7f0864885640 1 -- 172.21.15.27:0/4223458273 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f085809c8f0 con 0x7f0860106a80 2024-09-19T08:09:12.256 INFO:teuthology.orchestra.run.smithi027.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T08:09:12.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:12.258+0000 7f0865887640 1 -- 172.21.15.27:0/4223458273 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f084c0a3240 msgr2=0x7f084c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:12.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:12.258+0000 7f0865887640 1 --2- 172.21.15.27:0/4223458273 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f084c0a3240 0x7f084c0a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0850000c00 tx=0x7f0850032c70 comp rx=0 tx=0).stop 2024-09-19T08:09:12.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:12.258+0000 7f0865887640 1 -- 172.21.15.27:0/4223458273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0860106a80 msgr2=0x7f0860197b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:12.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:12.258+0000 7f0865887640 1 --2- 172.21.15.27:0/4223458273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0860106a80 0x7f0860197b10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f085800eaa0 tx=0x7f085800ef60 comp rx=0 tx=0).stop 2024-09-19T08:09:12.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:12.258+0000 7f0865887640 1 -- 172.21.15.27:0/4223458273 shutdown_connections 2024-09-19T08:09:12.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:12.258+0000 7f0865887640 1 --2- 172.21.15.27:0/4223458273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0860106a80 0x7f0860197b10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:12.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:12.258+0000 7f0865887640 1 --2- 172.21.15.27:0/4223458273 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f084c0a3240 0x7f084c0a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:12.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:12.258+0000 7f0865887640 1 --2- 172.21.15.27:0/4223458273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0860101420 0x7f08601975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:12.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:12.258+0000 7f0865887640 1 --2- 172.21.15.27:0/4223458273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0860100a80 0x7f0860197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:12.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:12.258+0000 7f0865887640 1 -- 172.21.15.27:0/4223458273 >> 172.21.15.27:0/4223458273 conn(0x7f08600fc7a0 msgr2=0x7f08600fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:12.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:12.258+0000 7f0865887640 1 -- 172.21.15.27:0/4223458273 shutdown_connections 2024-09-19T08:09:12.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:12.258+0000 7f0865887640 1 -- 172.21.15.27:0/4223458273 wait complete. 2024-09-19T08:09:12.580 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:12 smithi027 ceph-mon[31209]: pgmap v278: 97 pgs: 1 creating+activating, 16 creating+peering, 61 unknown, 19 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:12.580 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:12 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/4223458273' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T08:09:12.580 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:12 smithi027 ceph-mon[31209]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T08:09:12.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:12 smithi155 ceph-mon[35362]: pgmap v278: 97 pgs: 1 creating+activating, 16 creating+peering, 61 unknown, 19 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:12.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:12 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/4223458273' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T08:09:12.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:12 smithi155 ceph-mon[35362]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T08:09:12.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:12 smithi203 ceph-mon[35198]: pgmap v278: 97 pgs: 1 creating+activating, 16 creating+peering, 61 unknown, 19 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:12.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:12 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/4223458273' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T08:09:12.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:12 smithi203 ceph-mon[35198]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T08:09:12.930 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:09:13.190 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:13.585 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:13 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/4223458273' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T08:09:13.585 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:13 smithi027 ceph-mon[31209]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T08:09:13.585 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:13 smithi027 ceph-mon[31209]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T08:09:13.585 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:13 smithi027 ceph-mon[31209]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T08:09:13.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.666+0000 7fd5a426f640 1 -- 172.21.15.27:0/1002614249 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd59c100a80 msgr2=0x7fd59c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:13.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.666+0000 7fd5a426f640 1 --2- 172.21.15.27:0/1002614249 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd59c100a80 0x7fd59c100ee0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd58c009930 tx=0x7fd58c02a420 comp rx=0 tx=0).stop 2024-09-19T08:09:13.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.666+0000 7fd5a426f640 1 -- 172.21.15.27:0/1002614249 shutdown_connections 2024-09-19T08:09:13.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.666+0000 7fd5a426f640 1 --2- 172.21.15.27:0/1002614249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd59c101420 0x7fd59c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:13.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.666+0000 7fd5a426f640 1 --2- 172.21.15.27:0/1002614249 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd59c100a80 0x7fd59c100ee0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:13.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.666+0000 7fd5a426f640 1 --2- 172.21.15.27:0/1002614249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd59c106a80 0x7fd59c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:13.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.666+0000 7fd5a426f640 1 -- 172.21.15.27:0/1002614249 >> 172.21.15.27:0/1002614249 conn(0x7fd59c0fc7a0 msgr2=0x7fd59c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:13.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.666+0000 7fd5a426f640 1 -- 172.21.15.27:0/1002614249 shutdown_connections 2024-09-19T08:09:13.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.666+0000 7fd5a426f640 1 -- 172.21.15.27:0/1002614249 wait complete. 2024-09-19T08:09:13.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.667+0000 7fd5a426f640 1 Processor -- start 2024-09-19T08:09:13.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.667+0000 7fd5a426f640 1 -- start start 2024-09-19T08:09:13.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.667+0000 7fd5a426f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd59c100a80 0x7fd59c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:13.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.667+0000 7fd5a426f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd59c101420 0x7fd59c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:13.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.667+0000 7fd5a426f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd59c106a80 0x7fd59c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:13.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.667+0000 7fd5a426f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c110ea0 con 0x7fd59c100a80 2024-09-19T08:09:13.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.667+0000 7fd5a426f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c110d20 con 0x7fd59c101420 2024-09-19T08:09:13.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.667+0000 7fd5a426f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c111020 con 0x7fd59c106a80 2024-09-19T08:09:13.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.667+0000 7fd5a200b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd59c100a80 0x7fd59c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:13.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.667+0000 7fd5a200b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd59c100a80 0x7fd59c198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58164/0 (socket says 172.21.15.27:58164) 2024-09-19T08:09:13.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.667+0000 7fd5a200b640 1 -- 172.21.15.27:0/2514843852 learned_addr learned my addr 172.21.15.27:0/2514843852 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:13.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.667+0000 7fd5a180a640 1 --2- 172.21.15.27:0/2514843852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd59c101420 0x7fd59c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:13.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.668+0000 7fd5a280c640 1 --2- 172.21.15.27:0/2514843852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd59c106a80 0x7fd59c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:13.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.668+0000 7fd5a200b640 1 -- 172.21.15.27:0/2514843852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd59c106a80 msgr2=0x7fd59c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:13.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.668+0000 7fd5a200b640 1 --2- 172.21.15.27:0/2514843852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd59c106a80 0x7fd59c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:13.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.668+0000 7fd5a200b640 1 -- 172.21.15.27:0/2514843852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd59c101420 msgr2=0x7fd59c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:13.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.668+0000 7fd5a200b640 1 --2- 172.21.15.27:0/2514843852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd59c101420 0x7fd59c1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:13.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.668+0000 7fd5a200b640 1 -- 172.21.15.27:0/2514843852 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59c19d420 con 0x7fd59c100a80 2024-09-19T08:09:13.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.668+0000 7fd5a280c640 1 --2- 172.21.15.27:0/2514843852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd59c106a80 0x7fd59c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:09:13.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.668+0000 7fd5a200b640 1 --2- 172.21.15.27:0/2514843852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd59c100a80 0x7fd59c198470 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd59800c920 tx=0x7fd59800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:13.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.668+0000 7fd5937fe640 1 -- 172.21.15.27:0/2514843852 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd598007c70 con 0x7fd59c100a80 2024-09-19T08:09:13.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.668+0000 7fd5937fe640 1 -- 172.21.15.27:0/2514843852 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd598007e10 con 0x7fd59c100a80 2024-09-19T08:09:13.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.668+0000 7fd5a426f640 1 -- 172.21.15.27:0/2514843852 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59c19d710 con 0x7fd59c100a80 2024-09-19T08:09:13.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.668+0000 7fd5937fe640 1 -- 172.21.15.27:0/2514843852 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd598018890 con 0x7fd59c100a80 2024-09-19T08:09:13.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.668+0000 7fd5a426f640 1 -- 172.21.15.27:0/2514843852 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd59c1a4ff0 con 0x7fd59c100a80 2024-09-19T08:09:13.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.669+0000 7fd5a426f640 1 -- 172.21.15.27:0/2514843852 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd59c100ee0 con 0x7fd59c100a80 2024-09-19T08:09:13.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.670+0000 7fd5937fe640 1 -- 172.21.15.27:0/2514843852 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd598018a70 con 0x7fd59c100a80 2024-09-19T08:09:13.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.671+0000 7fd5937fe640 1 --2- 172.21.15.27:0/2514843852 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fd5880a32c0 0x7fd5880a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:13.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.671+0000 7fd5a180a640 1 --2- 172.21.15.27:0/2514843852 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fd5880a32c0 0x7fd5880a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:13.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.671+0000 7fd5937fe640 1 -- 172.21.15.27:0/2514843852 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fd5980cf920 con 0x7fd59c100a80 2024-09-19T08:09:13.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.671+0000 7fd5a180a640 1 --2- 172.21.15.27:0/2514843852 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fd5880a32c0 0x7fd5880a5780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd58c000c00 tx=0x7fd58c031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:13.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.675+0000 7fd5937fe640 1 -- 172.21.15.27:0/2514843852 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd598014030 con 0x7fd59c100a80 2024-09-19T08:09:13.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:13 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/4223458273' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T08:09:13.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:13 smithi155 ceph-mon[35362]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T08:09:13.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:13 smithi155 ceph-mon[35362]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T08:09:13.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:13 smithi155 ceph-mon[35362]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T08:09:13.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:13 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/4223458273' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T08:09:13.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:13 smithi203 ceph-mon[35198]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T08:09:13.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:13 smithi203 ceph-mon[35198]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T08:09:13.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:13 smithi203 ceph-mon[35198]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T08:09:13.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.870+0000 7fd5a426f640 1 -- 172.21.15.27:0/2514843852 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd59c109a90 con 0x7fd59c100a80 2024-09-19T08:09:13.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.871+0000 7fd5937fe640 1 -- 172.21.15.27:0/2514843852 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22265 (secure 0 0 0) 0x7fd59809c790 con 0x7fd59c100a80 2024-09-19T08:09:13.872 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:09:13.872 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":81,"fsid":"35b531b0-765d-11ef-bceb-c7b262605968","created":"2024-09-19T08:01:20.929241+0000","modified":"2024-09-19T08:09:11.929828+0000","last_up_change":"2024-09-19T08:08:17.919001+0000","last_in_change":"2024-09-19T08:07:54.277124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:04:29.312984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:09:08.046858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:09:10.223258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66fd6732-4cac-4eda-bf06-50638995ee80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6803","nonce":3645201250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6805","nonce":3645201250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6809","nonce":3645201250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6807","nonce":3645201250}]},"public_addr":"172.21.15.27:6803/3645201250","cluster_addr":"172.21.15.27:6805/3645201250","heartbeat_back_addr":"172.21.15.27:6809/3645201250","heartbeat_front_addr":"172.21.15.27:6807/3645201250","state":["exists","up"]},{"osd":1,"uuid":"36628767-66ac-433b-938e-10e75b51a877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6801","nonce":3977510449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6803","nonce":3977510449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6807","nonce":3977510449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6805","nonce":3977510449}]},"public_addr":"172.21.15.155:6801/3977510449","cluster_addr":"172.21.15.155:6803/3977510449","heartbeat_back_addr":"172.21.15.155:6807/3977510449","heartbeat_front_addr":"172.21.15.155:6805/3977510449","state":["exists","up"]},{"osd":2,"uuid":"3dc80404-a56b-456a-af02-f01e9c6c6dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6801","nonce":3796057016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6803","nonce":3796057016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6807","nonce":3796057016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6805","nonce":3796057016}]},"public_addr":"172.21.15.203:6801/3796057016","cluster_addr":"172.21.15.203:6803/3796057016","heartbeat_back_addr":"172.21.15.203:6807/3796057016","heartbeat_front_addr":"172.21.15.203:6805/3796057016","state":["exists","up"]},{"osd":3,"uuid":"a51077d0-5e04-49b5-bb3e-91711cc45ff1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6811","nonce":1608304347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6813","nonce":1608304347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6817","nonce":1608304347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6815","nonce":1608304347}]},"public_addr":"172.21.15.27:6811/1608304347","cluster_addr":"172.21.15.27:6813/1608304347","heartbeat_back_addr":"172.21.15.27:6817/1608304347","heartbeat_front_addr":"172.21.15.27:6815/1608304347","state":["exists","up"]},{"osd":4,"uuid":"0df35548-90b4-434d-8d7e-c037072c9ae4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6809","nonce":569913150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6811","nonce":569913150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6815","nonce":569913150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6813","nonce":569913150}]},"public_addr":"172.21.15.155:6809/569913150","cluster_addr":"172.21.15.155:6811/569913150","heartbeat_back_addr":"172.21.15.155:6815/569913150","heartbeat_front_addr":"172.21.15.155:6813/569913150","state":["exists","up"]},{"osd":5,"uuid":"de193c5f-1019-43e5-9f4f-6c2aaa4330e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6809","nonce":991491203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6811","nonce":991491203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6815","nonce":991491203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6813","nonce":991491203}]},"public_addr":"172.21.15.203:6809/991491203","cluster_addr":"172.21.15.203:6811/991491203","heartbeat_back_addr":"172.21.15.203:6815/991491203","heartbeat_front_addr":"172.21.15.203:6813/991491203","state":["exists","up"]},{"osd":6,"uuid":"28938e4f-9f22-466f-8cf7-62ee56a0c926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6819","nonce":3516868131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6821","nonce":3516868131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6825","nonce":3516868131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6823","nonce":3516868131}]},"public_addr":"172.21.15.27:6819/3516868131","cluster_addr":"172.21.15.27:6821/3516868131","heartbeat_back_addr":"172.21.15.27:6825/3516868131","heartbeat_front_addr":"172.21.15.27:6823/3516868131","state":["exists","up"]},{"osd":7,"uuid":"855f1728-be52-4445-8561-a90c08f2b2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6817","nonce":2047506436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6819","nonce":2047506436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6823","nonce":2047506436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6821","nonce":2047506436}]},"public_addr":"172.21.15.155:6817/2047506436","cluster_addr":"172.21.15.155:6819/2047506436","heartbeat_back_addr":"172.21.15.155:6823/2047506436","heartbeat_front_addr":"172.21.15.155:6821/2047506436","state":["exists","up"]},{"osd":8,"uuid":"5d7a8ffd-a039-403e-8b9a-c80e19fd67ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6817","nonce":199970687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6819","nonce":199970687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6823","nonce":199970687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6821","nonce":199970687}]},"public_addr":"172.21.15.203:6817/199970687","cluster_addr":"172.21.15.203:6819/199970687","heartbeat_back_addr":"172.21.15.203:6823/199970687","heartbeat_front_addr":"172.21.15.203:6821/199970687","state":["exists","up"]},{"osd":9,"uuid":"cdb90242-80a1-4cef-b5e3-ddecb05664e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6827","nonce":118390483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6829","nonce":118390483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6833","nonce":118390483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6831","nonce":118390483}]},"public_addr":"172.21.15.27:6827/118390483","cluster_addr":"172.21.15.27:6829/118390483","heartbeat_back_addr":"172.21.15.27:6833/118390483","heartbeat_front_addr":"172.21.15.27:6831/118390483","state":["exists","up"]},{"osd":10,"uuid":"c7f4c9da-d913-47a5-8629-53de21efe8c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6825","nonce":1687418565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6827","nonce":1687418565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6831","nonce":1687418565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6829","nonce":1687418565}]},"public_addr":"172.21.15.155:6825/1687418565","cluster_addr":"172.21.15.155:6827/1687418565","heartbeat_back_addr":"172.21.15.155:6831/1687418565","heartbeat_front_addr":"172.21.15.155:6829/1687418565","state":["exists","up"]},{"osd":11,"uuid":"45c11a90-585e-46fa-a5a0-51a29e29eba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6825","nonce":224768827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6827","nonce":224768827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6831","nonce":224768827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6829","nonce":224768827}]},"public_addr":"172.21.15.203:6825/224768827","cluster_addr":"172.21.15.203:6827/224768827","heartbeat_back_addr":"172.21.15.203:6831/224768827","heartbeat_front_addr":"172.21.15.203:6829/224768827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:03:35.559549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:00.526006+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:25.809346+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:51.889445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:17.246017+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:43.515854+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:08.638182+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:34.653060+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:59.469837+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:26.122937+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:50.196159+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:08:16.245770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:6800/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/958829150":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1174736321":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1908865720":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/416476667":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6800/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/1717932879":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1963219497":"2024-09-20T08:01:48.686812+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:09:13.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.873+0000 7fd5a426f640 1 -- 172.21.15.27:0/2514843852 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fd5880a32c0 msgr2=0x7fd5880a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:13.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.873+0000 7fd5a426f640 1 --2- 172.21.15.27:0/2514843852 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fd5880a32c0 0x7fd5880a5780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd58c000c00 tx=0x7fd58c031490 comp rx=0 tx=0).stop 2024-09-19T08:09:13.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.873+0000 7fd5a426f640 1 -- 172.21.15.27:0/2514843852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd59c100a80 msgr2=0x7fd59c198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:13.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.873+0000 7fd5a426f640 1 --2- 172.21.15.27:0/2514843852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd59c100a80 0x7fd59c198470 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd59800c920 tx=0x7fd59800cde0 comp rx=0 tx=0).stop 2024-09-19T08:09:13.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.873+0000 7fd5a426f640 1 -- 172.21.15.27:0/2514843852 shutdown_connections 2024-09-19T08:09:13.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.873+0000 7fd5a426f640 1 --2- 172.21.15.27:0/2514843852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd59c106a80 0x7fd59c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:13.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.873+0000 7fd5a426f640 1 --2- 172.21.15.27:0/2514843852 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fd5880a32c0 0x7fd5880a5780 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:13.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.873+0000 7fd5a426f640 1 --2- 172.21.15.27:0/2514843852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd59c101420 0x7fd59c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:13.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.873+0000 7fd5a426f640 1 --2- 172.21.15.27:0/2514843852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd59c100a80 0x7fd59c198470 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:13.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.874+0000 7fd5a426f640 1 -- 172.21.15.27:0/2514843852 >> 172.21.15.27:0/2514843852 conn(0x7fd59c0fc7a0 msgr2=0x7fd59c06a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:13.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.874+0000 7fd5a426f640 1 -- 172.21.15.27:0/2514843852 shutdown_connections 2024-09-19T08:09:13.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:13.874+0000 7fd5a426f640 1 -- 172.21.15.27:0/2514843852 wait complete. 2024-09-19T08:09:14.451 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:14 smithi027 ceph-mon[31209]: pgmap v281: 97 pgs: 1 creating+activating, 24 creating+peering, 36 unknown, 36 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:14.451 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:14 smithi027 ceph-mon[31209]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T08:09:14.452 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:14 smithi027 ceph-mon[31209]: Cluster is now healthy 2024-09-19T08:09:14.452 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:14 smithi027 ceph-mon[31209]: mds.? [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] up:active 2024-09-19T08:09:14.452 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:14 smithi027 ceph-mon[31209]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:09:14.452 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:14 smithi027 ceph-mon[31209]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:09:14.452 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:14 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2514843852' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:09:14.528 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:09:14.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:14 smithi155 ceph-mon[35362]: pgmap v281: 97 pgs: 1 creating+activating, 24 creating+peering, 36 unknown, 36 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:14.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:14 smithi155 ceph-mon[35362]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T08:09:14.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:14 smithi155 ceph-mon[35362]: Cluster is now healthy 2024-09-19T08:09:14.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:14 smithi155 ceph-mon[35362]: mds.? [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] up:active 2024-09-19T08:09:14.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:14 smithi155 ceph-mon[35362]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:09:14.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:14 smithi155 ceph-mon[35362]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:09:14.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:14 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2514843852' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:09:14.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:14 smithi203 ceph-mon[35198]: pgmap v281: 97 pgs: 1 creating+activating, 24 creating+peering, 36 unknown, 36 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:09:14.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:14 smithi203 ceph-mon[35198]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T08:09:14.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:14 smithi203 ceph-mon[35198]: Cluster is now healthy 2024-09-19T08:09:14.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:14 smithi203 ceph-mon[35198]: mds.? [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] up:active 2024-09-19T08:09:14.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:14 smithi203 ceph-mon[35198]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:09:14.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:14 smithi203 ceph-mon[35198]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:09:14.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:14 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2514843852' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:09:14.786 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:15.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.302+0000 7fa4791de640 1 -- 172.21.15.27:0/828694717 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa474102570 msgr2=0x7fa4741029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:15.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.302+0000 7fa4791de640 1 --2- 172.21.15.27:0/828694717 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa474102570 0x7fa4741029b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009900 tx=0x7fa45c02a480 comp rx=0 tx=0).stop 2024-09-19T08:09:15.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.303+0000 7fa4791de640 1 -- 172.21.15.27:0/828694717 shutdown_connections 2024-09-19T08:09:15.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.303+0000 7fa4791de640 1 --2- 172.21.15.27:0/828694717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa474102ef0 0x7fa47410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:15.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.303+0000 7fa4791de640 1 --2- 172.21.15.27:0/828694717 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa474102570 0x7fa4741029b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:15.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.303+0000 7fa4791de640 1 --2- 172.21.15.27:0/828694717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa474100e20 0x7fa474101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:15.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.303+0000 7fa4791de640 1 -- 172.21.15.27:0/828694717 >> 172.21.15.27:0/828694717 conn(0x7fa4740fc7d0 msgr2=0x7fa4740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:15.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.303+0000 7fa4791de640 1 -- 172.21.15.27:0/828694717 shutdown_connections 2024-09-19T08:09:15.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.303+0000 7fa4791de640 1 -- 172.21.15.27:0/828694717 wait complete. 2024-09-19T08:09:15.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.303+0000 7fa4791de640 1 Processor -- start 2024-09-19T08:09:15.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.303+0000 7fa4791de640 1 -- start start 2024-09-19T08:09:15.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.304+0000 7fa4791de640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa474100e20 0x7fa474198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:15.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.304+0000 7fa4791de640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa474102570 0x7fa474198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:15.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.304+0000 7fa4791de640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa474102ef0 0x7fa47419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:15.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.304+0000 7fa4791de640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa474110f50 con 0x7fa474102570 2024-09-19T08:09:15.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.304+0000 7fa4791de640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa474110dd0 con 0x7fa474100e20 2024-09-19T08:09:15.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.304+0000 7fa4791de640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa4741110d0 con 0x7fa474102ef0 2024-09-19T08:09:15.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.304+0000 7fa46bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa474102570 0x7fa474198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:15.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.304+0000 7fa46bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa474102570 0x7fa474198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58182/0 (socket says 172.21.15.27:58182) 2024-09-19T08:09:15.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.304+0000 7fa46bfff640 1 -- 172.21.15.27:0/1517147838 learned_addr learned my addr 172.21.15.27:0/1517147838 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:15.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.304+0000 7fa472d9d640 1 --2- 172.21.15.27:0/1517147838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa474100e20 0x7fa474198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:15.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.304+0000 7fa47359e640 1 --2- 172.21.15.27:0/1517147838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa474102ef0 0x7fa47419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:15.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.304+0000 7fa46bfff640 1 -- 172.21.15.27:0/1517147838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa474102ef0 msgr2=0x7fa47419cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:15.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.304+0000 7fa46bfff640 1 --2- 172.21.15.27:0/1517147838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa474102ef0 0x7fa47419cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:15.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.304+0000 7fa46bfff640 1 -- 172.21.15.27:0/1517147838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa474100e20 msgr2=0x7fa474198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:15.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.304+0000 7fa46bfff640 1 --2- 172.21.15.27:0/1517147838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa474100e20 0x7fa474198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:15.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.304+0000 7fa46bfff640 1 -- 172.21.15.27:0/1517147838 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa47419d4b0 con 0x7fa474102570 2024-09-19T08:09:15.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.304+0000 7fa47359e640 1 --2- 172.21.15.27:0/1517147838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa474102ef0 0x7fa47419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:09:15.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.304+0000 7fa46bfff640 1 --2- 172.21.15.27:0/1517147838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa474102570 0x7fa474198a40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa45c006010 tx=0x7fa45c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:15.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.305+0000 7fa470d99640 1 -- 172.21.15.27:0/1517147838 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c03f070 con 0x7fa474102570 2024-09-19T08:09:15.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.305+0000 7fa4791de640 1 -- 172.21.15.27:0/1517147838 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa47419d740 con 0x7fa474102570 2024-09-19T08:09:15.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.305+0000 7fa470d99640 1 -- 172.21.15.27:0/1517147838 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa45c031c30 con 0x7fa474102570 2024-09-19T08:09:15.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.305+0000 7fa470d99640 1 -- 172.21.15.27:0/1517147838 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c035030 con 0x7fa474102570 2024-09-19T08:09:15.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.305+0000 7fa4791de640 1 -- 172.21.15.27:0/1517147838 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4741a5080 con 0x7fa474102570 2024-09-19T08:09:15.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.306+0000 7fa4791de640 1 -- 172.21.15.27:0/1517147838 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa474101200 con 0x7fa474102570 2024-09-19T08:09:15.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.307+0000 7fa470d99640 1 -- 172.21.15.27:0/1517147838 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa45c042070 con 0x7fa474102570 2024-09-19T08:09:15.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.307+0000 7fa470d99640 1 --2- 172.21.15.27:0/1517147838 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fa4600a3240 0x7fa4600a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:15.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.308+0000 7fa472d9d640 1 --2- 172.21.15.27:0/1517147838 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fa4600a3240 0x7fa4600a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:15.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.308+0000 7fa470d99640 1 -- 172.21.15.27:0/1517147838 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fa45c0f0020 con 0x7fa474102570 2024-09-19T08:09:15.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.308+0000 7fa472d9d640 1 --2- 172.21.15.27:0/1517147838 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fa4600a3240 0x7fa4600a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa464005d00 tx=0x7fa46400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:15.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.316+0000 7fa470d99640 1 -- 172.21.15.27:0/1517147838 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa45c031de0 con 0x7fa474102570 2024-09-19T08:09:15.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.506+0000 7fa4791de640 1 -- 172.21.15.27:0/1517147838 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4741a5250 con 0x7fa474102570 2024-09-19T08:09:15.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.507+0000 7fa470d99640 1 -- 172.21.15.27:0/1517147838 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22265 (secure 0 0 0) 0x7fa45c0bce90 con 0x7fa474102570 2024-09-19T08:09:15.508 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:09:15.508 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":81,"fsid":"35b531b0-765d-11ef-bceb-c7b262605968","created":"2024-09-19T08:01:20.929241+0000","modified":"2024-09-19T08:09:11.929828+0000","last_up_change":"2024-09-19T08:08:17.919001+0000","last_in_change":"2024-09-19T08:07:54.277124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:04:29.312984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:09:08.046858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:09:10.223258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66fd6732-4cac-4eda-bf06-50638995ee80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6803","nonce":3645201250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6805","nonce":3645201250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6809","nonce":3645201250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6807","nonce":3645201250}]},"public_addr":"172.21.15.27:6803/3645201250","cluster_addr":"172.21.15.27:6805/3645201250","heartbeat_back_addr":"172.21.15.27:6809/3645201250","heartbeat_front_addr":"172.21.15.27:6807/3645201250","state":["exists","up"]},{"osd":1,"uuid":"36628767-66ac-433b-938e-10e75b51a877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6801","nonce":3977510449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6803","nonce":3977510449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6807","nonce":3977510449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6805","nonce":3977510449}]},"public_addr":"172.21.15.155:6801/3977510449","cluster_addr":"172.21.15.155:6803/3977510449","heartbeat_back_addr":"172.21.15.155:6807/3977510449","heartbeat_front_addr":"172.21.15.155:6805/3977510449","state":["exists","up"]},{"osd":2,"uuid":"3dc80404-a56b-456a-af02-f01e9c6c6dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6801","nonce":3796057016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6803","nonce":3796057016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6807","nonce":3796057016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6805","nonce":3796057016}]},"public_addr":"172.21.15.203:6801/3796057016","cluster_addr":"172.21.15.203:6803/3796057016","heartbeat_back_addr":"172.21.15.203:6807/3796057016","heartbeat_front_addr":"172.21.15.203:6805/3796057016","state":["exists","up"]},{"osd":3,"uuid":"a51077d0-5e04-49b5-bb3e-91711cc45ff1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6811","nonce":1608304347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6813","nonce":1608304347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6817","nonce":1608304347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6815","nonce":1608304347}]},"public_addr":"172.21.15.27:6811/1608304347","cluster_addr":"172.21.15.27:6813/1608304347","heartbeat_back_addr":"172.21.15.27:6817/1608304347","heartbeat_front_addr":"172.21.15.27:6815/1608304347","state":["exists","up"]},{"osd":4,"uuid":"0df35548-90b4-434d-8d7e-c037072c9ae4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6809","nonce":569913150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6811","nonce":569913150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6815","nonce":569913150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6813","nonce":569913150}]},"public_addr":"172.21.15.155:6809/569913150","cluster_addr":"172.21.15.155:6811/569913150","heartbeat_back_addr":"172.21.15.155:6815/569913150","heartbeat_front_addr":"172.21.15.155:6813/569913150","state":["exists","up"]},{"osd":5,"uuid":"de193c5f-1019-43e5-9f4f-6c2aaa4330e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6809","nonce":991491203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6811","nonce":991491203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6815","nonce":991491203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6813","nonce":991491203}]},"public_addr":"172.21.15.203:6809/991491203","cluster_addr":"172.21.15.203:6811/991491203","heartbeat_back_addr":"172.21.15.203:6815/991491203","heartbeat_front_addr":"172.21.15.203:6813/991491203","state":["exists","up"]},{"osd":6,"uuid":"28938e4f-9f22-466f-8cf7-62ee56a0c926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6819","nonce":3516868131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6821","nonce":3516868131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6825","nonce":3516868131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6823","nonce":3516868131}]},"public_addr":"172.21.15.27:6819/3516868131","cluster_addr":"172.21.15.27:6821/3516868131","heartbeat_back_addr":"172.21.15.27:6825/3516868131","heartbeat_front_addr":"172.21.15.27:6823/3516868131","state":["exists","up"]},{"osd":7,"uuid":"855f1728-be52-4445-8561-a90c08f2b2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6817","nonce":2047506436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6819","nonce":2047506436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6823","nonce":2047506436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6821","nonce":2047506436}]},"public_addr":"172.21.15.155:6817/2047506436","cluster_addr":"172.21.15.155:6819/2047506436","heartbeat_back_addr":"172.21.15.155:6823/2047506436","heartbeat_front_addr":"172.21.15.155:6821/2047506436","state":["exists","up"]},{"osd":8,"uuid":"5d7a8ffd-a039-403e-8b9a-c80e19fd67ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6817","nonce":199970687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6819","nonce":199970687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6823","nonce":199970687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6821","nonce":199970687}]},"public_addr":"172.21.15.203:6817/199970687","cluster_addr":"172.21.15.203:6819/199970687","heartbeat_back_addr":"172.21.15.203:6823/199970687","heartbeat_front_addr":"172.21.15.203:6821/199970687","state":["exists","up"]},{"osd":9,"uuid":"cdb90242-80a1-4cef-b5e3-ddecb05664e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6827","nonce":118390483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6829","nonce":118390483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6833","nonce":118390483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6831","nonce":118390483}]},"public_addr":"172.21.15.27:6827/118390483","cluster_addr":"172.21.15.27:6829/118390483","heartbeat_back_addr":"172.21.15.27:6833/118390483","heartbeat_front_addr":"172.21.15.27:6831/118390483","state":["exists","up"]},{"osd":10,"uuid":"c7f4c9da-d913-47a5-8629-53de21efe8c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6825","nonce":1687418565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6827","nonce":1687418565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6831","nonce":1687418565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6829","nonce":1687418565}]},"public_addr":"172.21.15.155:6825/1687418565","cluster_addr":"172.21.15.155:6827/1687418565","heartbeat_back_addr":"172.21.15.155:6831/1687418565","heartbeat_front_addr":"172.21.15.155:6829/1687418565","state":["exists","up"]},{"osd":11,"uuid":"45c11a90-585e-46fa-a5a0-51a29e29eba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6825","nonce":224768827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6827","nonce":224768827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6831","nonce":224768827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6829","nonce":224768827}]},"public_addr":"172.21.15.203:6825/224768827","cluster_addr":"172.21.15.203:6827/224768827","heartbeat_back_addr":"172.21.15.203:6831/224768827","heartbeat_front_addr":"172.21.15.203:6829/224768827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:03:35.559549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:00.526006+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:25.809346+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:51.889445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:17.246017+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:43.515854+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:08.638182+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:34.653060+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:59.469837+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:26.122937+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:50.196159+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:08:16.245770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:6800/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/958829150":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1174736321":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1908865720":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/416476667":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6800/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/1717932879":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1963219497":"2024-09-20T08:01:48.686812+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:09:15.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.509+0000 7fa4791de640 1 -- 172.21.15.27:0/1517147838 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fa4600a3240 msgr2=0x7fa4600a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:15.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.509+0000 7fa4791de640 1 --2- 172.21.15.27:0/1517147838 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fa4600a3240 0x7fa4600a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa464005d00 tx=0x7fa46400b410 comp rx=0 tx=0).stop 2024-09-19T08:09:15.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.509+0000 7fa4791de640 1 -- 172.21.15.27:0/1517147838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa474102570 msgr2=0x7fa474198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:15.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.509+0000 7fa4791de640 1 --2- 172.21.15.27:0/1517147838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa474102570 0x7fa474198a40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa45c006010 tx=0x7fa45c003c10 comp rx=0 tx=0).stop 2024-09-19T08:09:15.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.510+0000 7fa4791de640 1 -- 172.21.15.27:0/1517147838 shutdown_connections 2024-09-19T08:09:15.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.510+0000 7fa4791de640 1 --2- 172.21.15.27:0/1517147838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa474102ef0 0x7fa47419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:15.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.510+0000 7fa4791de640 1 --2- 172.21.15.27:0/1517147838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa474102570 0x7fa474198a40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:15.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.510+0000 7fa4791de640 1 --2- 172.21.15.27:0/1517147838 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fa4600a3240 0x7fa4600a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:15.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.510+0000 7fa4791de640 1 --2- 172.21.15.27:0/1517147838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa474100e20 0x7fa474198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:15.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.510+0000 7fa4791de640 1 -- 172.21.15.27:0/1517147838 >> 172.21.15.27:0/1517147838 conn(0x7fa4740fc7d0 msgr2=0x7fa474069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:15.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.510+0000 7fa4791de640 1 -- 172.21.15.27:0/1517147838 shutdown_connections 2024-09-19T08:09:15.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:15.510+0000 7fa4791de640 1 -- 172.21.15.27:0/1517147838 wait complete. 2024-09-19T08:09:15.987 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:09:15 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-b[65776]: 2024-09-19T08:09:15.722+0000 7f0b2f34e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T08:09:16.188 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T08:09:16.455 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:16.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:16 smithi027 ceph-mon[31209]: pgmap v282: 97 pgs: 18 creating+peering, 79 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 2 op/s 2024-09-19T08:09:16.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:16 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1517147838' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:09:16.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:16 smithi155 ceph-mon[35362]: pgmap v282: 97 pgs: 18 creating+peering, 79 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 2 op/s 2024-09-19T08:09:16.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:16 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1517147838' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:09:16.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:16 smithi203 ceph-mon[35198]: pgmap v282: 97 pgs: 18 creating+peering, 79 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 2 op/s 2024-09-19T08:09:16.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:16 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1517147838' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:09:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.924+0000 7f0a59af6640 1 -- 172.21.15.27:0/3614888934 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a54102d40 msgr2=0x7f0a54103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.924+0000 7f0a59af6640 1 --2- 172.21.15.27:0/3614888934 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a54102d40 0x7f0a54103120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0a44009ca0 tx=0x7f0a4402a950 comp rx=0 tx=0).stop 2024-09-19T08:09:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.924+0000 7f0a59af6640 1 -- 172.21.15.27:0/3614888934 shutdown_connections 2024-09-19T08:09:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.924+0000 7f0a59af6640 1 --2- 172.21.15.27:0/3614888934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a5410c170 0x7f0a5410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.924+0000 7f0a59af6640 1 --2- 172.21.15.27:0/3614888934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a54103660 0x7f0a5410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.924+0000 7f0a59af6640 1 --2- 172.21.15.27:0/3614888934 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a54102d40 0x7f0a54103120 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.924+0000 7f0a59af6640 1 -- 172.21.15.27:0/3614888934 >> 172.21.15.27:0/3614888934 conn(0x7f0a540fc7a0 msgr2=0x7f0a540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.924+0000 7f0a59af6640 1 -- 172.21.15.27:0/3614888934 shutdown_connections 2024-09-19T08:09:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.924+0000 7f0a59af6640 1 -- 172.21.15.27:0/3614888934 wait complete. 2024-09-19T08:09:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.924+0000 7f0a59af6640 1 Processor -- start 2024-09-19T08:09:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.924+0000 7f0a59af6640 1 -- start start 2024-09-19T08:09:16.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.925+0000 7f0a59af6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a54102d40 0x7f0a54198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:16.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.925+0000 7f0a59af6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a54103660 0x7f0a54198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:16.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.925+0000 7f0a59af6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a5410c170 0x7f0a5419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:16.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.925+0000 7f0a59af6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0a54111fb0 con 0x7f0a54103660 2024-09-19T08:09:16.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.925+0000 7f0a59af6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0a54111e30 con 0x7f0a54102d40 2024-09-19T08:09:16.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.925+0000 7f0a59af6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0a54112130 con 0x7f0a5410c170 2024-09-19T08:09:16.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.925+0000 7f0a52ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a54103660 0x7f0a54198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:16.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.925+0000 7f0a52ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a54103660 0x7f0a54198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58200/0 (socket says 172.21.15.27:58200) 2024-09-19T08:09:16.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.925+0000 7f0a52ffd640 1 -- 172.21.15.27:0/1255515694 learned_addr learned my addr 172.21.15.27:0/1255515694 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:16.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.925+0000 7f0a53fff640 1 --2- 172.21.15.27:0/1255515694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a5410c170 0x7f0a5419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:16.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.925+0000 7f0a537fe640 1 --2- 172.21.15.27:0/1255515694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a54102d40 0x7f0a54198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:16.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.925+0000 7f0a52ffd640 1 -- 172.21.15.27:0/1255515694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a5410c170 msgr2=0x7f0a5419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:16.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.925+0000 7f0a52ffd640 1 --2- 172.21.15.27:0/1255515694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a5410c170 0x7f0a5419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:16.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.925+0000 7f0a52ffd640 1 -- 172.21.15.27:0/1255515694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a54102d40 msgr2=0x7f0a54198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:16.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.925+0000 7f0a52ffd640 1 --2- 172.21.15.27:0/1255515694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a54102d40 0x7f0a54198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:16.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.925+0000 7f0a52ffd640 1 -- 172.21.15.27:0/1255515694 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a5419d400 con 0x7f0a54103660 2024-09-19T08:09:16.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.925+0000 7f0a52ffd640 1 --2- 172.21.15.27:0/1255515694 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a54103660 0x7f0a54198990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800b3f0 tx=0x7f0a4800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:16.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.925+0000 7f0a50ff9640 1 -- 172.21.15.27:0/1255515694 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a48015020 con 0x7f0a54103660 2024-09-19T08:09:16.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.926+0000 7f0a50ff9640 1 -- 172.21.15.27:0/1255515694 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a48011d10 con 0x7f0a54103660 2024-09-19T08:09:16.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.926+0000 7f0a59af6640 1 -- 172.21.15.27:0/1255515694 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a5419d6f0 con 0x7f0a54103660 2024-09-19T08:09:16.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.926+0000 7f0a50ff9640 1 -- 172.21.15.27:0/1255515694 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4800f2e0 con 0x7f0a54103660 2024-09-19T08:09:16.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.926+0000 7f0a59af6640 1 -- 172.21.15.27:0/1255515694 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a541a4fd0 con 0x7f0a54103660 2024-09-19T08:09:16.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.927+0000 7f0a59af6640 1 -- 172.21.15.27:0/1255515694 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a54103120 con 0x7f0a54103660 2024-09-19T08:09:16.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.928+0000 7f0a50ff9640 1 -- 172.21.15.27:0/1255515694 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0a48018020 con 0x7f0a54103660 2024-09-19T08:09:16.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.928+0000 7f0a50ff9640 1 --2- 172.21.15.27:0/1255515694 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f0a3c0a3240 0x7f0a3c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:16.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.929+0000 7f0a537fe640 1 --2- 172.21.15.27:0/1255515694 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f0a3c0a3240 0x7f0a3c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:16.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.929+0000 7f0a50ff9640 1 -- 172.21.15.27:0/1255515694 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f0a480cf600 con 0x7f0a54103660 2024-09-19T08:09:16.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.929+0000 7f0a537fe640 1 --2- 172.21.15.27:0/1255515694 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f0a3c0a3240 0x7f0a3c0a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0a44000f80 tx=0x7f0a4402fea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:16.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:16.932+0000 7f0a50ff9640 1 -- 172.21.15.27:0/1255515694 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0a4801f020 con 0x7f0a54103660 2024-09-19T08:09:17.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:17.146+0000 7f0a59af6640 1 -- 172.21.15.27:0/1255515694 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0a5402d7c0 con 0x7f0a54103660 2024-09-19T08:09:17.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:17.282+0000 7f0a50ff9640 1 -- 172.21.15.27:0/1255515694 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f0a4809c470 con 0x7f0a54103660 2024-09-19T08:09:17.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:17.284+0000 7f0a59af6640 1 -- 172.21.15.27:0/1255515694 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f0a3c0a3240 msgr2=0x7f0a3c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:17.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:17.284+0000 7f0a59af6640 1 --2- 172.21.15.27:0/1255515694 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f0a3c0a3240 0x7f0a3c0a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0a44000f80 tx=0x7f0a4402fea0 comp rx=0 tx=0).stop 2024-09-19T08:09:17.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:17.284+0000 7f0a59af6640 1 -- 172.21.15.27:0/1255515694 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a54103660 msgr2=0x7f0a54198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:17.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:17.284+0000 7f0a59af6640 1 --2- 172.21.15.27:0/1255515694 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a54103660 0x7f0a54198990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800b3f0 tx=0x7f0a4800b8b0 comp rx=0 tx=0).stop 2024-09-19T08:09:17.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:17.284+0000 7f0a59af6640 1 -- 172.21.15.27:0/1255515694 shutdown_connections 2024-09-19T08:09:17.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:17.284+0000 7f0a59af6640 1 --2- 172.21.15.27:0/1255515694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a5410c170 0x7f0a5419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:17.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:17.284+0000 7f0a59af6640 1 --2- 172.21.15.27:0/1255515694 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a54103660 0x7f0a54198990 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:17.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:17.284+0000 7f0a59af6640 1 --2- 172.21.15.27:0/1255515694 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f0a3c0a3240 0x7f0a3c0a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:17.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:17.284+0000 7f0a59af6640 1 --2- 172.21.15.27:0/1255515694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a54102d40 0x7f0a54198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:17.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:17.284+0000 7f0a59af6640 1 -- 172.21.15.27:0/1255515694 >> 172.21.15.27:0/1255515694 conn(0x7f0a540fc7a0 msgr2=0x7f0a540fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:17.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:17.284+0000 7f0a59af6640 1 -- 172.21.15.27:0/1255515694 shutdown_connections 2024-09-19T08:09:17.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:17.284+0000 7f0a59af6640 1 -- 172.21.15.27:0/1255515694 wait complete. 2024-09-19T08:09:17.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:17 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1255515694' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T08:09:17.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:17 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1255515694' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T08:09:17.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:17 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1255515694' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T08:09:17.968 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-19T08:09:17.969 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T08:09:18.229 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:18.641 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:18 smithi027 ceph-mon[31209]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-19T08:09:18.641 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:18 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1255515694' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T08:09:18.641 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:18 smithi027 ceph-mon[31209]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:09:18.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:18 smithi155 ceph-mon[35362]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-19T08:09:18.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:18 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1255515694' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T08:09:18.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:18 smithi155 ceph-mon[35362]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:09:18.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.726+0000 7f03516e5640 1 -- 172.21.15.27:0/2944843061 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f034c100a80 msgr2=0x7f034c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:18.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.726+0000 7f03516e5640 1 --2- 172.21.15.27:0/2944843061 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f034c100a80 0x7f034c100ee0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0334009930 tx=0x7f033402a420 comp rx=0 tx=0).stop 2024-09-19T08:09:18.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.726+0000 7f03516e5640 1 -- 172.21.15.27:0/2944843061 shutdown_connections 2024-09-19T08:09:18.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.726+0000 7f03516e5640 1 --2- 172.21.15.27:0/2944843061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f034c101420 0x7f034c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:18.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.726+0000 7f03516e5640 1 --2- 172.21.15.27:0/2944843061 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f034c100a80 0x7f034c100ee0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:18.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.726+0000 7f03516e5640 1 --2- 172.21.15.27:0/2944843061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f034c106a80 0x7f034c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:18.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.726+0000 7f03516e5640 1 -- 172.21.15.27:0/2944843061 >> 172.21.15.27:0/2944843061 conn(0x7f034c0fc7a0 msgr2=0x7f034c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:18.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.726+0000 7f03516e5640 1 -- 172.21.15.27:0/2944843061 shutdown_connections 2024-09-19T08:09:18.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.726+0000 7f03516e5640 1 -- 172.21.15.27:0/2944843061 wait complete. 2024-09-19T08:09:18.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.727+0000 7f03516e5640 1 Processor -- start 2024-09-19T08:09:18.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.727+0000 7f03516e5640 1 -- start start 2024-09-19T08:09:18.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.727+0000 7f03516e5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f034c100a80 0x7f034c197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:18.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.727+0000 7f03516e5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f034c101420 0x7f034c197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:18.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.727+0000 7f03516e5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f034c106a80 0x7f034c19bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:18.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.727+0000 7f03516e5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f034c110e80 con 0x7f034c106a80 2024-09-19T08:09:18.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.727+0000 7f03516e5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f034c110d00 con 0x7f034c101420 2024-09-19T08:09:18.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.727+0000 7f03516e5640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f034c111000 con 0x7f034c100a80 2024-09-19T08:09:18.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.727+0000 7f034b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f034c106a80 0x7f034c19bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:18.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.727+0000 7f034b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f034c106a80 0x7f034c19bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58212/0 (socket says 172.21.15.27:58212) 2024-09-19T08:09:18.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.727+0000 7f034b7fe640 1 -- 172.21.15.27:0/831250021 learned_addr learned my addr 172.21.15.27:0/831250021 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:18.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.727+0000 7f034affd640 1 --2- 172.21.15.27:0/831250021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f034c100a80 0x7f034c197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:18.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.728+0000 7f0343fff640 1 --2- 172.21.15.27:0/831250021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f034c101420 0x7f034c197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:18.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.728+0000 7f034b7fe640 1 -- 172.21.15.27:0/831250021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f034c100a80 msgr2=0x7f034c197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:18.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.728+0000 7f034b7fe640 1 --2- 172.21.15.27:0/831250021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f034c100a80 0x7f034c197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:18.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.728+0000 7f034b7fe640 1 -- 172.21.15.27:0/831250021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f034c101420 msgr2=0x7f034c197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:18.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.728+0000 7f034b7fe640 1 --2- 172.21.15.27:0/831250021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f034c101420 0x7f034c197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:18.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.728+0000 7f034b7fe640 1 -- 172.21.15.27:0/831250021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034c19c2b0 con 0x7f034c106a80 2024-09-19T08:09:18.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.728+0000 7f034b7fe640 1 --2- 172.21.15.27:0/831250021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f034c106a80 0x7f034c19bbd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f034400cce0 tx=0x7f034400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:18.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.728+0000 7f0348ff9640 1 -- 172.21.15.27:0/831250021 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034400f450 con 0x7f034c106a80 2024-09-19T08:09:18.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.728+0000 7f0348ff9640 1 -- 172.21.15.27:0/831250021 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f034400fad0 con 0x7f034c106a80 2024-09-19T08:09:18.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.728+0000 7f03516e5640 1 -- 172.21.15.27:0/831250021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f034c19c5a0 con 0x7f034c106a80 2024-09-19T08:09:18.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.728+0000 7f0348ff9640 1 -- 172.21.15.27:0/831250021 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0344018c10 con 0x7f034c106a80 2024-09-19T08:09:18.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.728+0000 7f03516e5640 1 -- 172.21.15.27:0/831250021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f034c1a3e80 con 0x7f034c106a80 2024-09-19T08:09:18.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.729+0000 7f03516e5640 1 -- 172.21.15.27:0/831250021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f034c100ee0 con 0x7f034c106a80 2024-09-19T08:09:18.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.730+0000 7f0348ff9640 1 -- 172.21.15.27:0/831250021 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f034400f5f0 con 0x7f034c106a80 2024-09-19T08:09:18.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.731+0000 7f0348ff9640 1 --2- 172.21.15.27:0/831250021 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f03380a3240 0x7f03380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:18.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.731+0000 7f034affd640 1 --2- 172.21.15.27:0/831250021 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f03380a3240 0x7f03380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:18.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.732+0000 7f0348ff9640 1 -- 172.21.15.27:0/831250021 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f03440cfeb0 con 0x7f034c106a80 2024-09-19T08:09:18.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.732+0000 7f034affd640 1 --2- 172.21.15.27:0/831250021 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f03380a3240 0x7f03380a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f033c005fd0 tx=0x7f033c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:18.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.736+0000 7f0348ff9640 1 -- 172.21.15.27:0/831250021 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0344014030 con 0x7f034c106a80 2024-09-19T08:09:18.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:18 smithi203 ceph-mon[35198]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-19T08:09:18.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:18 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1255515694' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T08:09:18.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:18 smithi203 ceph-mon[35198]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:09:18.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:18.948+0000 7f03516e5640 1 -- 172.21.15.27:0/831250021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f034c02d7c0 con 0x7f034c106a80 2024-09-19T08:09:19.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:19.289+0000 7f0348ff9640 1 -- 172.21.15.27:0/831250021 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f034409cd20 con 0x7f034c106a80 2024-09-19T08:09:19.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:19.291+0000 7f03516e5640 1 -- 172.21.15.27:0/831250021 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f03380a3240 msgr2=0x7f03380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:19.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:19.291+0000 7f03516e5640 1 --2- 172.21.15.27:0/831250021 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f03380a3240 0x7f03380a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f033c005fd0 tx=0x7f033c00b390 comp rx=0 tx=0).stop 2024-09-19T08:09:19.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:19.291+0000 7f03516e5640 1 -- 172.21.15.27:0/831250021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f034c106a80 msgr2=0x7f034c19bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:19.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:19.291+0000 7f03516e5640 1 --2- 172.21.15.27:0/831250021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f034c106a80 0x7f034c19bbd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f034400cce0 tx=0x7f034400a620 comp rx=0 tx=0).stop 2024-09-19T08:09:19.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:19.291+0000 7f03516e5640 1 -- 172.21.15.27:0/831250021 shutdown_connections 2024-09-19T08:09:19.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:19.291+0000 7f03516e5640 1 --2- 172.21.15.27:0/831250021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f034c106a80 0x7f034c19bbd0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:19.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:19.291+0000 7f03516e5640 1 --2- 172.21.15.27:0/831250021 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f03380a3240 0x7f03380a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:19.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:19.291+0000 7f03516e5640 1 --2- 172.21.15.27:0/831250021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f034c101420 0x7f034c197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:19.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:19.291+0000 7f03516e5640 1 --2- 172.21.15.27:0/831250021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f034c100a80 0x7f034c197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:19.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:19.291+0000 7f03516e5640 1 -- 172.21.15.27:0/831250021 >> 172.21.15.27:0/831250021 conn(0x7f034c0fc7a0 msgr2=0x7f034c0fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:19.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:19.291+0000 7f03516e5640 1 -- 172.21.15.27:0/831250021 shutdown_connections 2024-09-19T08:09:19.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:19.291+0000 7f03516e5640 1 -- 172.21.15.27:0/831250021 wait complete. 2024-09-19T08:09:19.621 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:19 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/831250021' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T08:09:19.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:19 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/831250021' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T08:09:19.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:19 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/831250021' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T08:09:19.942 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T08:09:20.200 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:20.583 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:20 smithi027 ceph-mon[31209]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T08:09:20.584 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:20 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/831250021' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T08:09:20.584 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:20 smithi027 ceph-mon[31209]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:09:20.584 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:20 smithi027 ceph-mon[31209]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T08:09:20.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.668+0000 7f40f4bf2640 1 -- 172.21.15.27:0/865954412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40f0100a80 msgr2=0x7f40f0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:20.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.668+0000 7f40f4bf2640 1 --2- 172.21.15.27:0/865954412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40f0100a80 0x7f40f0100ee0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009930 tx=0x7f40d802a420 comp rx=0 tx=0).stop 2024-09-19T08:09:20.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.668+0000 7f40f4bf2640 1 -- 172.21.15.27:0/865954412 shutdown_connections 2024-09-19T08:09:20.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.668+0000 7f40f4bf2640 1 --2- 172.21.15.27:0/865954412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40f0101420 0x7f40f010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:20.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.668+0000 7f40f4bf2640 1 --2- 172.21.15.27:0/865954412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40f0100a80 0x7f40f0100ee0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:20.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.668+0000 7f40f4bf2640 1 --2- 172.21.15.27:0/865954412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40f0106a80 0x7f40f0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:20.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.668+0000 7f40f4bf2640 1 -- 172.21.15.27:0/865954412 >> 172.21.15.27:0/865954412 conn(0x7f40f00fc7a0 msgr2=0x7f40f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:20.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.668+0000 7f40f4bf2640 1 -- 172.21.15.27:0/865954412 shutdown_connections 2024-09-19T08:09:20.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.668+0000 7f40f4bf2640 1 -- 172.21.15.27:0/865954412 wait complete. 2024-09-19T08:09:20.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.669+0000 7f40f4bf2640 1 Processor -- start 2024-09-19T08:09:20.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.669+0000 7f40f4bf2640 1 -- start start 2024-09-19T08:09:20.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.669+0000 7f40f4bf2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40f0100a80 0x7f40f01985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:20.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.669+0000 7f40f4bf2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40f0101420 0x7f40f0198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:20.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.669+0000 7f40f4bf2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40f0106a80 0x7f40f019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:20.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.669+0000 7f40f4bf2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f40f0110f20 con 0x7f40f0101420 2024-09-19T08:09:20.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.669+0000 7f40f4bf2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f40f0110da0 con 0x7f40f0106a80 2024-09-19T08:09:20.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.669+0000 7f40f4bf2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f40f01110a0 con 0x7f40f0100a80 2024-09-19T08:09:20.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.669+0000 7f40e7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40f0101420 0x7f40f0198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:20.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.669+0000 7f40e7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40f0101420 0x7f40f0198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51812/0 (socket says 172.21.15.27:51812) 2024-09-19T08:09:20.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.669+0000 7f40e7fff640 1 -- 172.21.15.27:0/2734502958 learned_addr learned my addr 172.21.15.27:0/2734502958 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:20.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.670+0000 7f40ee59c640 1 --2- 172.21.15.27:0/2734502958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40f0100a80 0x7f40f01985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:20.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.670+0000 7f40eed9d640 1 --2- 172.21.15.27:0/2734502958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40f0106a80 0x7f40f019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:20.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.670+0000 7f40e7fff640 1 -- 172.21.15.27:0/2734502958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40f0100a80 msgr2=0x7f40f01985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:20.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.670+0000 7f40e7fff640 1 --2- 172.21.15.27:0/2734502958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40f0100a80 0x7f40f01985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:20.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.670+0000 7f40e7fff640 1 -- 172.21.15.27:0/2734502958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40f0106a80 msgr2=0x7f40f019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:20.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.670+0000 7f40e7fff640 1 --2- 172.21.15.27:0/2734502958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40f0106a80 0x7f40f019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:20.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.670+0000 7f40e7fff640 1 -- 172.21.15.27:0/2734502958 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f019d560 con 0x7f40f0101420 2024-09-19T08:09:20.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.670+0000 7f40eed9d640 1 --2- 172.21.15.27:0/2734502958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40f0106a80 0x7f40f019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:09:20.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.670+0000 7f40e7fff640 1 --2- 172.21.15.27:0/2734502958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40f0101420 0x7f40f0198af0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009a50 tx=0x7f40d8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:20.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.670+0000 7f40e77fe640 1 -- 172.21.15.27:0/2734502958 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d803f030 con 0x7f40f0101420 2024-09-19T08:09:20.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.670+0000 7f40e77fe640 1 -- 172.21.15.27:0/2734502958 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40d8003ce0 con 0x7f40f0101420 2024-09-19T08:09:20.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.670+0000 7f40f4bf2640 1 -- 172.21.15.27:0/2734502958 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40f019d7f0 con 0x7f40f0101420 2024-09-19T08:09:20.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.670+0000 7f40e77fe640 1 -- 172.21.15.27:0/2734502958 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8035070 con 0x7f40f0101420 2024-09-19T08:09:20.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.670+0000 7f40f4bf2640 1 -- 172.21.15.27:0/2734502958 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40f01a5130 con 0x7f40f0101420 2024-09-19T08:09:20.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.671+0000 7f40f4bf2640 1 -- 172.21.15.27:0/2734502958 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40f01021c0 con 0x7f40f0101420 2024-09-19T08:09:20.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.672+0000 7f40e77fe640 1 -- 172.21.15.27:0/2734502958 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f40d8042030 con 0x7f40f0101420 2024-09-19T08:09:20.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.673+0000 7f40e77fe640 1 --2- 172.21.15.27:0/2734502958 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f40dc0a3240 0x7f40dc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:20.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.673+0000 7f40ee59c640 1 --2- 172.21.15.27:0/2734502958 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f40dc0a3240 0x7f40dc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:20.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.673+0000 7f40e77fe640 1 -- 172.21.15.27:0/2734502958 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f40d80f0260 con 0x7f40f0101420 2024-09-19T08:09:20.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.674+0000 7f40ee59c640 1 --2- 172.21.15.27:0/2734502958 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f40dc0a3240 0x7f40dc0a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f40e000a810 tx=0x7f40e0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:20.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.676+0000 7f40e77fe640 1 -- 172.21.15.27:0/2734502958 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f40d80bd0d0 con 0x7f40f0101420 2024-09-19T08:09:20.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:20 smithi155 ceph-mon[35362]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T08:09:20.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:20 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/831250021' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T08:09:20.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:20 smithi155 ceph-mon[35362]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:09:20.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:20 smithi155 ceph-mon[35362]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T08:09:20.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:20 smithi203 ceph-mon[35198]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T08:09:20.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:20 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/831250021' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T08:09:20.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:20 smithi203 ceph-mon[35198]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:09:20.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:20 smithi203 ceph-mon[35198]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T08:09:20.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:20.888+0000 7f40f4bf2640 1 -- 172.21.15.27:0/2734502958 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f40f010a020 con 0x7f40f0101420 2024-09-19T08:09:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:21.299+0000 7f40e77fe640 1 -- 172.21.15.27:0/2734502958 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v20) ==== 115+0+0 (secure 0 0 0) 0x7f40d80bc9d0 con 0x7f40f0101420 2024-09-19T08:09:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:21.301+0000 7f40f4bf2640 1 -- 172.21.15.27:0/2734502958 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f40dc0a3240 msgr2=0x7f40dc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:21.301+0000 7f40f4bf2640 1 --2- 172.21.15.27:0/2734502958 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f40dc0a3240 0x7f40dc0a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f40e000a810 tx=0x7f40e0008040 comp rx=0 tx=0).stop 2024-09-19T08:09:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:21.301+0000 7f40f4bf2640 1 -- 172.21.15.27:0/2734502958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40f0101420 msgr2=0x7f40f0198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:21.301+0000 7f40f4bf2640 1 --2- 172.21.15.27:0/2734502958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40f0101420 0x7f40f0198af0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009a50 tx=0x7f40d8004270 comp rx=0 tx=0).stop 2024-09-19T08:09:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:21.301+0000 7f40f4bf2640 1 -- 172.21.15.27:0/2734502958 shutdown_connections 2024-09-19T08:09:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:21.301+0000 7f40f4bf2640 1 --2- 172.21.15.27:0/2734502958 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f40dc0a3240 0x7f40dc0a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:21.301+0000 7f40f4bf2640 1 --2- 172.21.15.27:0/2734502958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40f0106a80 0x7f40f019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:21.301+0000 7f40f4bf2640 1 --2- 172.21.15.27:0/2734502958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40f0101420 0x7f40f0198af0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:21.301+0000 7f40f4bf2640 1 --2- 172.21.15.27:0/2734502958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40f0100a80 0x7f40f01985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:21.301+0000 7f40f4bf2640 1 -- 172.21.15.27:0/2734502958 >> 172.21.15.27:0/2734502958 conn(0x7f40f00fc7a0 msgr2=0x7f40f006aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:21.301+0000 7f40f4bf2640 1 -- 172.21.15.27:0/2734502958 shutdown_connections 2024-09-19T08:09:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:21.301+0000 7f40f4bf2640 1 -- 172.21.15.27:0/2734502958 wait complete. 2024-09-19T08:09:21.629 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:21 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2734502958' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T08:09:21.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:21 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2734502958' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T08:09:21.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:21 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2734502958' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T08:09:21.958 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-19T08:09:21.958 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T08:09:22.224 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:22.601 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:22 smithi027 ceph-mon[31209]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 423 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-19T08:09:22.602 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:22 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2734502958' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T08:09:22.602 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:22 smithi027 ceph-mon[31209]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T08:09:22.660 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:22 smithi203 ceph-mon[35198]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 423 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-19T08:09:22.660 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:22 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2734502958' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T08:09:22.660 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:22 smithi203 ceph-mon[35198]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T08:09:22.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.686+0000 7faf0ecb2640 1 -- 172.21.15.27:0/2231152224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf0810c180 msgr2=0x7faf0810e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:22.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.686+0000 7faf0ecb2640 1 --2- 172.21.15.27:0/2231152224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf0810c180 0x7faf0810e600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faef8009ca0 tx=0x7faef802a950 comp rx=0 tx=0).stop 2024-09-19T08:09:22.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.686+0000 7faf0ecb2640 1 -- 172.21.15.27:0/2231152224 shutdown_connections 2024-09-19T08:09:22.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.686+0000 7faf0ecb2640 1 --2- 172.21.15.27:0/2231152224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf0810c180 0x7faf0810e600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:22.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.686+0000 7faf0ecb2640 1 --2- 172.21.15.27:0/2231152224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf081036c0 0x7faf0810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:22.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.686+0000 7faf0ecb2640 1 --2- 172.21.15.27:0/2231152224 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf08102da0 0x7faf08103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:22.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.686+0000 7faf0ecb2640 1 -- 172.21.15.27:0/2231152224 >> 172.21.15.27:0/2231152224 conn(0x7faf080fc7a0 msgr2=0x7faf080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:22.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.686+0000 7faf0ecb2640 1 -- 172.21.15.27:0/2231152224 shutdown_connections 2024-09-19T08:09:22.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.686+0000 7faf0ecb2640 1 -- 172.21.15.27:0/2231152224 wait complete. 2024-09-19T08:09:22.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.687+0000 7faf0ecb2640 1 Processor -- start 2024-09-19T08:09:22.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.687+0000 7faf0ecb2640 1 -- start start 2024-09-19T08:09:22.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.687+0000 7faf0ecb2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf08102da0 0x7faf081983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:22.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.687+0000 7faf0ecb2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf081036c0 0x7faf08198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:22.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.687+0000 7faf0ecb2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf0810c180 0x7faf0819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:22.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.687+0000 7faf0ecb2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7faf08111fb0 con 0x7faf0810c180 2024-09-19T08:09:22.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.687+0000 7faf0ecb2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faf08111e30 con 0x7faf08102da0 2024-09-19T08:09:22.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.687+0000 7faf0ecb2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faf08112130 con 0x7faf081036c0 2024-09-19T08:09:22.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.687+0000 7faf0d24f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf0810c180 0x7faf0819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:22.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.687+0000 7faf0d24f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf0810c180 0x7faf0819cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51824/0 (socket says 172.21.15.27:51824) 2024-09-19T08:09:22.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.687+0000 7faf0d24f640 1 -- 172.21.15.27:0/3372567893 learned_addr learned my addr 172.21.15.27:0/3372567893 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:22.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.687+0000 7faf07fff640 1 --2- 172.21.15.27:0/3372567893 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf081036c0 0x7faf08198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:22.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.687+0000 7faf0ca4e640 1 --2- 172.21.15.27:0/3372567893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf08102da0 0x7faf081983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:22.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.687+0000 7faf0d24f640 1 -- 172.21.15.27:0/3372567893 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf081036c0 msgr2=0x7faf08198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:22.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.687+0000 7faf0d24f640 1 --2- 172.21.15.27:0/3372567893 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf081036c0 0x7faf08198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:22.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.687+0000 7faf0d24f640 1 -- 172.21.15.27:0/3372567893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf08102da0 msgr2=0x7faf081983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:22.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.687+0000 7faf0d24f640 1 --2- 172.21.15.27:0/3372567893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf08102da0 0x7faf081983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:22.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.687+0000 7faf0d24f640 1 -- 172.21.15.27:0/3372567893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0819d380 con 0x7faf0810c180 2024-09-19T08:09:22.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.688+0000 7faf0d24f640 1 --2- 172.21.15.27:0/3372567893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf0810c180 0x7faf0819cca0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faef8009dc0 tx=0x7faef8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:22.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.688+0000 7faf05ffb640 1 -- 172.21.15.27:0/3372567893 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef8034040 con 0x7faf0810c180 2024-09-19T08:09:22.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.688+0000 7faf05ffb640 1 -- 172.21.15.27:0/3372567893 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faef802fe20 con 0x7faf0810c180 2024-09-19T08:09:22.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.688+0000 7faf0ecb2640 1 -- 172.21.15.27:0/3372567893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0819d610 con 0x7faf0810c180 2024-09-19T08:09:22.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.688+0000 7faf05ffb640 1 -- 172.21.15.27:0/3372567893 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef80047f0 con 0x7faf0810c180 2024-09-19T08:09:22.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.688+0000 7faf0ecb2640 1 -- 172.21.15.27:0/3372567893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf081a4f50 con 0x7faf0810c180 2024-09-19T08:09:22.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.689+0000 7faf0ecb2640 1 -- 172.21.15.27:0/3372567893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf08103180 con 0x7faf0810c180 2024-09-19T08:09:22.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.690+0000 7faf05ffb640 1 -- 172.21.15.27:0/3372567893 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7faef8037020 con 0x7faf0810c180 2024-09-19T08:09:22.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.691+0000 7faf05ffb640 1 --2- 172.21.15.27:0/3372567893 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7faef40a32c0 0x7faef40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:22.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.691+0000 7faf0ca4e640 1 --2- 172.21.15.27:0/3372567893 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7faef40a32c0 0x7faef40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:22.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.691+0000 7faf05ffb640 1 -- 172.21.15.27:0/3372567893 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7faef80f07f0 con 0x7faf0810c180 2024-09-19T08:09:22.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.692+0000 7faf0ca4e640 1 --2- 172.21.15.27:0/3372567893 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7faef40a32c0 0x7faef40a5780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faf0000bbe0 tx=0x7faf0000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:22.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.694+0000 7faf05ffb640 1 -- 172.21.15.27:0/3372567893 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faef8081210 con 0x7faf0810c180 2024-09-19T08:09:22.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:22 smithi155 ceph-mon[35362]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 423 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-19T08:09:22.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:22 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2734502958' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T08:09:22.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:22 smithi155 ceph-mon[35362]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T08:09:22.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.894+0000 7faf0ecb2640 1 -- 172.21.15.27:0/3372567893 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7faf08107290 con 0x7faef40a32c0 2024-09-19T08:09:22.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.914+0000 7faf05ffb640 1 -- 172.21.15.27:0/3372567893 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7faf00010c30 con 0x7faef40a32c0 2024-09-19T08:09:22.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.916+0000 7faf0ecb2640 1 -- 172.21.15.27:0/3372567893 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7faef40a32c0 msgr2=0x7faef40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:22.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.916+0000 7faf0ecb2640 1 --2- 172.21.15.27:0/3372567893 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7faef40a32c0 0x7faef40a5780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faf0000bbe0 tx=0x7faf0000b390 comp rx=0 tx=0).stop 2024-09-19T08:09:22.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.916+0000 7faf0ecb2640 1 -- 172.21.15.27:0/3372567893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf0810c180 msgr2=0x7faf0819cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:22.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.916+0000 7faf0ecb2640 1 --2- 172.21.15.27:0/3372567893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf0810c180 0x7faf0819cca0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faef8009dc0 tx=0x7faef8003f10 comp rx=0 tx=0).stop 2024-09-19T08:09:22.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.916+0000 7faf0ecb2640 1 -- 172.21.15.27:0/3372567893 shutdown_connections 2024-09-19T08:09:22.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.916+0000 7faf0ecb2640 1 --2- 172.21.15.27:0/3372567893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf0810c180 0x7faf0819cca0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:22.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.916+0000 7faf0ecb2640 1 --2- 172.21.15.27:0/3372567893 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf081036c0 0x7faf08198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:22.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.916+0000 7faf0ecb2640 1 --2- 172.21.15.27:0/3372567893 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7faef40a32c0 0x7faef40a5780 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:22.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.916+0000 7faf0ecb2640 1 --2- 172.21.15.27:0/3372567893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf08102da0 0x7faf081983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:22.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.916+0000 7faf0ecb2640 1 -- 172.21.15.27:0/3372567893 >> 172.21.15.27:0/3372567893 conn(0x7faf080fc7a0 msgr2=0x7faf080fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:22.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.917+0000 7faf0ecb2640 1 -- 172.21.15.27:0/3372567893 shutdown_connections 2024-09-19T08:09:22.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:22.917+0000 7faf0ecb2640 1 -- 172.21.15.27:0/3372567893 wait complete. 2024-09-19T08:09:23.252 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:09:22 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:09:22.899+0000 7fd2d4feb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:09:23.252 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:09:22 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:09:22.899+0000 7fd2d4feb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:09:23.252 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:09:22 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:09:22.899+0000 7fd2d4feb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:09:23.252 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:09:22 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:09:22.899+0000 7fd2d4feb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:09:23.252 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:09:22 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:09:22.899+0000 7fd2d4feb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:09:23.652 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T08:09:23.908 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:24.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.410+0000 7fed8de6c640 1 -- 172.21.15.27:0/2038619622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed88102790 msgr2=0x7fed881067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:24.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.410+0000 7fed8de6c640 1 --2- 172.21.15.27:0/2038619622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed88102790 0x7fed881067e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009900 tx=0x7fed7c02a410 comp rx=0 tx=0).stop 2024-09-19T08:09:24.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.410+0000 7fed8de6c640 1 -- 172.21.15.27:0/2038619622 shutdown_connections 2024-09-19T08:09:24.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.410+0000 7fed8de6c640 1 --2- 172.21.15.27:0/2038619622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed88106f10 0x7fed8810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:24.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.410+0000 7fed8de6c640 1 --2- 172.21.15.27:0/2038619622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed88102790 0x7fed881067e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:24.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.410+0000 7fed8de6c640 1 --2- 172.21.15.27:0/2038619622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed88101de0 0x7fed881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:24.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.410+0000 7fed8de6c640 1 -- 172.21.15.27:0/2038619622 >> 172.21.15.27:0/2038619622 conn(0x7fed880fd8c0 msgr2=0x7fed880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:24.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.410+0000 7fed8de6c640 1 -- 172.21.15.27:0/2038619622 shutdown_connections 2024-09-19T08:09:24.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.410+0000 7fed8de6c640 1 -- 172.21.15.27:0/2038619622 wait complete. 2024-09-19T08:09:24.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.411+0000 7fed8de6c640 1 Processor -- start 2024-09-19T08:09:24.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.411+0000 7fed8de6c640 1 -- start start 2024-09-19T08:09:24.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.411+0000 7fed8de6c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed88101de0 0x7fed881984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:24.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.411+0000 7fed8de6c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed88102790 0x7fed88198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:24.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.411+0000 7fed8de6c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed88106f10 0x7fed8819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:24.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.411+0000 7fed8de6c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fed88111f70 con 0x7fed88101de0 2024-09-19T08:09:24.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.412+0000 7fed8de6c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fed88111df0 con 0x7fed88102790 2024-09-19T08:09:24.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.412+0000 7fed8de6c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fed881120f0 con 0x7fed88106f10 2024-09-19T08:09:24.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.412+0000 7fed877fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed88101de0 0x7fed881984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:24.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.412+0000 7fed877fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed88101de0 0x7fed881984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51848/0 (socket says 172.21.15.27:51848) 2024-09-19T08:09:24.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.412+0000 7fed877fe640 1 -- 172.21.15.27:0/3326192246 learned_addr learned my addr 172.21.15.27:0/3326192246 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:24.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.412+0000 7fed87fff640 1 --2- 172.21.15.27:0/3326192246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed88106f10 0x7fed8819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:24.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.412+0000 7fed86ffd640 1 --2- 172.21.15.27:0/3326192246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed88102790 0x7fed88198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:24.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.412+0000 7fed877fe640 1 -- 172.21.15.27:0/3326192246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed88106f10 msgr2=0x7fed8819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:24.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.412+0000 7fed877fe640 1 --2- 172.21.15.27:0/3326192246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed88106f10 0x7fed8819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:24.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.412+0000 7fed877fe640 1 -- 172.21.15.27:0/3326192246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed88102790 msgr2=0x7fed88198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:24.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.412+0000 7fed877fe640 1 --2- 172.21.15.27:0/3326192246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed88102790 0x7fed88198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:24.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.412+0000 7fed877fe640 1 -- 172.21.15.27:0/3326192246 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed8819d480 con 0x7fed88101de0 2024-09-19T08:09:24.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.412+0000 7fed877fe640 1 --2- 172.21.15.27:0/3326192246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed88101de0 0x7fed881984d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fed7800d950 tx=0x7fed7800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:24.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.412+0000 7fed84ff9640 1 -- 172.21.15.27:0/3326192246 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed78017070 con 0x7fed88101de0 2024-09-19T08:09:24.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.412+0000 7fed84ff9640 1 -- 172.21.15.27:0/3326192246 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed78009c30 con 0x7fed88101de0 2024-09-19T08:09:24.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.412+0000 7fed8de6c640 1 -- 172.21.15.27:0/3326192246 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed8819d770 con 0x7fed88101de0 2024-09-19T08:09:24.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.412+0000 7fed84ff9640 1 -- 172.21.15.27:0/3326192246 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7800f6b0 con 0x7fed88101de0 2024-09-19T08:09:24.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.412+0000 7fed8de6c640 1 -- 172.21.15.27:0/3326192246 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed881a5050 con 0x7fed88101de0 2024-09-19T08:09:24.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.413+0000 7fed8de6c640 1 -- 172.21.15.27:0/3326192246 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed881021c0 con 0x7fed88101de0 2024-09-19T08:09:24.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.414+0000 7fed84ff9640 1 -- 172.21.15.27:0/3326192246 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fed780109d0 con 0x7fed88101de0 2024-09-19T08:09:24.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.415+0000 7fed84ff9640 1 --2- 172.21.15.27:0/3326192246 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fed700a3350 0x7fed700a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:24.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.415+0000 7fed86ffd640 1 --2- 172.21.15.27:0/3326192246 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fed700a3350 0x7fed700a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:24.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.415+0000 7fed84ff9640 1 -- 172.21.15.27:0/3326192246 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fed780cf4e0 con 0x7fed88101de0 2024-09-19T08:09:24.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.416+0000 7fed86ffd640 1 --2- 172.21.15.27:0/3326192246 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fed700a3350 0x7fed700a5810 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fed880fdd70 tx=0x7fed7c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:24.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.420+0000 7fed84ff9640 1 -- 172.21.15.27:0/3326192246 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fed78009de0 con 0x7fed88101de0 2024-09-19T08:09:24.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.620+0000 7fed8de6c640 1 -- 172.21.15.27:0/3326192246 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fed8810a1b0 con 0x7fed700a3350 2024-09-19T08:09:24.621 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:24 smithi027 ceph-mon[31209]: from='client.14685 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:09:24.621 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:24 smithi027 ceph-mon[31209]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 865 B/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-19T08:09:24.621 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:24 smithi027 ceph-mon[31209]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T08:09:24.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.641+0000 7fed84ff9640 1 -- 172.21.15.27:0/3326192246 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fed8810a1b0 con 0x7fed700a3350 2024-09-19T08:09:24.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.643+0000 7fed8de6c640 1 -- 172.21.15.27:0/3326192246 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fed700a3350 msgr2=0x7fed700a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:24.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.643+0000 7fed8de6c640 1 --2- 172.21.15.27:0/3326192246 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fed700a3350 0x7fed700a5810 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fed880fdd70 tx=0x7fed7c005a20 comp rx=0 tx=0).stop 2024-09-19T08:09:24.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.643+0000 7fed8de6c640 1 -- 172.21.15.27:0/3326192246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed88101de0 msgr2=0x7fed881984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:24.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.643+0000 7fed8de6c640 1 --2- 172.21.15.27:0/3326192246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed88101de0 0x7fed881984d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fed7800d950 tx=0x7fed7800de10 comp rx=0 tx=0).stop 2024-09-19T08:09:24.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.643+0000 7fed8de6c640 1 -- 172.21.15.27:0/3326192246 shutdown_connections 2024-09-19T08:09:24.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.643+0000 7fed8de6c640 1 --2- 172.21.15.27:0/3326192246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed88106f10 0x7fed8819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:24.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.643+0000 7fed8de6c640 1 --2- 172.21.15.27:0/3326192246 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fed700a3350 0x7fed700a5810 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:24.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.643+0000 7fed8de6c640 1 --2- 172.21.15.27:0/3326192246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed88102790 0x7fed88198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:24.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.643+0000 7fed8de6c640 1 --2- 172.21.15.27:0/3326192246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed88101de0 0x7fed881984d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:24.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.643+0000 7fed8de6c640 1 -- 172.21.15.27:0/3326192246 >> 172.21.15.27:0/3326192246 conn(0x7fed880fd8c0 msgr2=0x7fed880fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:24.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.643+0000 7fed8de6c640 1 -- 172.21.15.27:0/3326192246 shutdown_connections 2024-09-19T08:09:24.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:24.643+0000 7fed8de6c640 1 -- 172.21.15.27:0/3326192246 wait complete. 2024-09-19T08:09:24.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:24 smithi155 ceph-mon[35362]: from='client.14685 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:09:24.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:24 smithi155 ceph-mon[35362]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 865 B/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-19T08:09:24.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:24 smithi155 ceph-mon[35362]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T08:09:24.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:24 smithi203 ceph-mon[35198]: from='client.14685 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:09:24.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:24 smithi203 ceph-mon[35198]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 865 B/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-19T08:09:24.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:24 smithi203 ceph-mon[35198]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T08:09:25.405 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T08:09:25.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:25 smithi027 ceph-mon[31209]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:09:25.664 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:25.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:25 smithi155 ceph-mon[35362]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:09:25.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:25 smithi203 ceph-mon[35198]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:09:26.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.141+0000 7f1ad56e9640 1 -- 172.21.15.27:0/2513726230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ad0100a80 msgr2=0x7f1ad0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:26.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.141+0000 7f1ad56e9640 1 --2- 172.21.15.27:0/2513726230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ad0100a80 0x7f1ad0100ee0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8009930 tx=0x7f1ab802a420 comp rx=0 tx=0).stop 2024-09-19T08:09:26.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.141+0000 7f1ad56e9640 1 -- 172.21.15.27:0/2513726230 shutdown_connections 2024-09-19T08:09:26.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.141+0000 7f1ad56e9640 1 --2- 172.21.15.27:0/2513726230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ad0101420 0x7f1ad010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:26.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.141+0000 7f1ad56e9640 1 --2- 172.21.15.27:0/2513726230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ad0100a80 0x7f1ad0100ee0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:26.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.141+0000 7f1ad56e9640 1 --2- 172.21.15.27:0/2513726230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ad0106a80 0x7f1ad0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:26.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.141+0000 7f1ad56e9640 1 -- 172.21.15.27:0/2513726230 >> 172.21.15.27:0/2513726230 conn(0x7f1ad00fc7a0 msgr2=0x7f1ad00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:26.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.141+0000 7f1ad56e9640 1 -- 172.21.15.27:0/2513726230 shutdown_connections 2024-09-19T08:09:26.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.141+0000 7f1ad56e9640 1 -- 172.21.15.27:0/2513726230 wait complete. 2024-09-19T08:09:26.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.141+0000 7f1ad56e9640 1 Processor -- start 2024-09-19T08:09:26.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.142+0000 7f1ad56e9640 1 -- start start 2024-09-19T08:09:26.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.142+0000 7f1ad56e9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ad0100a80 0x7f1ad0198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:26.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.142+0000 7f1ad56e9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ad0101420 0x7f1ad0198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:26.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.142+0000 7f1ad56e9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ad0106a80 0x7f1ad019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:26.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.142+0000 7f1ad56e9640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad0111fa0 con 0x7f1ad0101420 2024-09-19T08:09:26.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.142+0000 7f1ad56e9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad0111e20 con 0x7f1ad0106a80 2024-09-19T08:09:26.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.142+0000 7f1ad56e9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad0112120 con 0x7f1ad0100a80 2024-09-19T08:09:26.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.142+0000 7f1ace7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ad0101420 0x7f1ad0198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:26.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.142+0000 7f1ace7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ad0101420 0x7f1ad0198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51862/0 (socket says 172.21.15.27:51862) 2024-09-19T08:09:26.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.142+0000 7f1ace7fc640 1 -- 172.21.15.27:0/1278131527 learned_addr learned my addr 172.21.15.27:0/1278131527 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:26.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.142+0000 7f1aceffd640 1 --2- 172.21.15.27:0/1278131527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ad0100a80 0x7f1ad0198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:26.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.142+0000 7f1acf7fe640 1 --2- 172.21.15.27:0/1278131527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ad0106a80 0x7f1ad019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:26.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.142+0000 7f1ace7fc640 1 -- 172.21.15.27:0/1278131527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ad0100a80 msgr2=0x7f1ad0198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:26.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.142+0000 7f1ace7fc640 1 --2- 172.21.15.27:0/1278131527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ad0100a80 0x7f1ad0198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:26.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.142+0000 7f1ace7fc640 1 -- 172.21.15.27:0/1278131527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ad0106a80 msgr2=0x7f1ad019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:26.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.142+0000 7f1ace7fc640 1 --2- 172.21.15.27:0/1278131527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ad0106a80 0x7f1ad019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:26.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.142+0000 7f1ace7fc640 1 -- 172.21.15.27:0/1278131527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad019d400 con 0x7f1ad0101420 2024-09-19T08:09:26.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.142+0000 7f1acf7fe640 1 --2- 172.21.15.27:0/1278131527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ad0106a80 0x7f1ad019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:09:26.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.143+0000 7f1ace7fc640 1 --2- 172.21.15.27:0/1278131527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ad0101420 0x7f1ad0198990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8009230 tx=0x7f1ab8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:26.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.143+0000 7f1ac7fff640 1 -- 172.21.15.27:0/1278131527 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab803f030 con 0x7f1ad0101420 2024-09-19T08:09:26.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.143+0000 7f1ac7fff640 1 -- 172.21.15.27:0/1278131527 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ab8003ad0 con 0x7f1ad0101420 2024-09-19T08:09:26.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.143+0000 7f1ad56e9640 1 -- 172.21.15.27:0/1278131527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ad019d690 con 0x7f1ad0101420 2024-09-19T08:09:26.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.143+0000 7f1ac7fff640 1 -- 172.21.15.27:0/1278131527 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8035070 con 0x7f1ad0101420 2024-09-19T08:09:26.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.143+0000 7f1ad56e9640 1 -- 172.21.15.27:0/1278131527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ad01a4fd0 con 0x7f1ad0101420 2024-09-19T08:09:26.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.144+0000 7f1ad56e9640 1 -- 172.21.15.27:0/1278131527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ad0100ee0 con 0x7f1ad0101420 2024-09-19T08:09:26.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.145+0000 7f1ac7fff640 1 -- 172.21.15.27:0/1278131527 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1ab8042030 con 0x7f1ad0101420 2024-09-19T08:09:26.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.146+0000 7f1ac7fff640 1 --2- 172.21.15.27:0/1278131527 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f1abc0a3350 0x7f1abc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:26.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.146+0000 7f1aceffd640 1 --2- 172.21.15.27:0/1278131527 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f1abc0a3350 0x7f1abc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:26.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.146+0000 7f1ac7fff640 1 -- 172.21.15.27:0/1278131527 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f1ab80f0160 con 0x7f1ad0101420 2024-09-19T08:09:26.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.146+0000 7f1aceffd640 1 --2- 172.21.15.27:0/1278131527 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f1abc0a3350 0x7f1abc0a5810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8005fd0 tx=0x7f1ac8009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:26.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.149+0000 7f1ac7fff640 1 -- 172.21.15.27:0/1278131527 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1ab80bced0 con 0x7f1ad0101420 2024-09-19T08:09:26.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.355+0000 7f1ad56e9640 1 -- 172.21.15.27:0/1278131527 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f1ad0109040 con 0x7f1abc0a3350 2024-09-19T08:09:26.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.361+0000 7f1ac7fff640 1 -- 172.21.15.27:0/1278131527 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f1ad0109040 con 0x7f1abc0a3350 2024-09-19T08:09:26.361 INFO:teuthology.orchestra.run.smithi027.stdout:/volumes/qa/sv_0/180d67f7-131d-4662-9c68-5c257de62a72 2024-09-19T08:09:26.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.363+0000 7f1ad56e9640 1 -- 172.21.15.27:0/1278131527 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f1abc0a3350 msgr2=0x7f1abc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:26.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.363+0000 7f1ad56e9640 1 --2- 172.21.15.27:0/1278131527 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f1abc0a3350 0x7f1abc0a5810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8005fd0 tx=0x7f1ac8009680 comp rx=0 tx=0).stop 2024-09-19T08:09:26.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.363+0000 7f1ad56e9640 1 -- 172.21.15.27:0/1278131527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ad0101420 msgr2=0x7f1ad0198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:26.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.363+0000 7f1ad56e9640 1 --2- 172.21.15.27:0/1278131527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ad0101420 0x7f1ad0198990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8009230 tx=0x7f1ab8004270 comp rx=0 tx=0).stop 2024-09-19T08:09:26.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.363+0000 7f1ad56e9640 1 -- 172.21.15.27:0/1278131527 shutdown_connections 2024-09-19T08:09:26.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.363+0000 7f1ad56e9640 1 --2- 172.21.15.27:0/1278131527 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f1abc0a3350 0x7f1abc0a5810 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:26.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.363+0000 7f1ad56e9640 1 --2- 172.21.15.27:0/1278131527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ad0106a80 0x7f1ad019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:26.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.363+0000 7f1ad56e9640 1 --2- 172.21.15.27:0/1278131527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ad0101420 0x7f1ad0198990 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:26.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.363+0000 7f1ad56e9640 1 --2- 172.21.15.27:0/1278131527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ad0100a80 0x7f1ad0198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:26.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.363+0000 7f1ad56e9640 1 -- 172.21.15.27:0/1278131527 >> 172.21.15.27:0/1278131527 conn(0x7f1ad00fc7a0 msgr2=0x7f1ad00fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:26.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.363+0000 7f1ad56e9640 1 -- 172.21.15.27:0/1278131527 shutdown_connections 2024-09-19T08:09:26.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:26.363+0000 7f1ad56e9640 1 -- 172.21.15.27:0/1278131527 wait complete. 2024-09-19T08:09:26.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:26 smithi155 ceph-mon[35362]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-19T08:09:27.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:26 smithi027 ceph-mon[31209]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-19T08:09:27.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:26 smithi203 ceph-mon[35198]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-19T08:09:27.055 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T08:09:27.314 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:27.715 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:27 smithi027 ceph-mon[31209]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:09:27.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.802+0000 7f2eaa3a0640 1 -- 172.21.15.27:0/230696705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea4100e20 msgr2=0x7f2ea4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:27.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.802+0000 7f2eaa3a0640 1 --2- 172.21.15.27:0/230696705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea4100e20 0x7f2ea4101200 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2e94009900 tx=0x7f2e9402a480 comp rx=0 tx=0).stop 2024-09-19T08:09:27.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.802+0000 7f2eaa3a0640 1 -- 172.21.15.27:0/230696705 shutdown_connections 2024-09-19T08:09:27.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.802+0000 7f2eaa3a0640 1 --2- 172.21.15.27:0/230696705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ea4102ef0 0x7f2ea410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:27.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.802+0000 7f2eaa3a0640 1 --2- 172.21.15.27:0/230696705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ea4102570 0x7f2ea41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:27.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.802+0000 7f2eaa3a0640 1 --2- 172.21.15.27:0/230696705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea4100e20 0x7f2ea4101200 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:27.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.802+0000 7f2eaa3a0640 1 -- 172.21.15.27:0/230696705 >> 172.21.15.27:0/230696705 conn(0x7f2ea40fc7d0 msgr2=0x7f2ea40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:27.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.802+0000 7f2eaa3a0640 1 -- 172.21.15.27:0/230696705 shutdown_connections 2024-09-19T08:09:27.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.802+0000 7f2eaa3a0640 1 -- 172.21.15.27:0/230696705 wait complete. 2024-09-19T08:09:27.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.803+0000 7f2eaa3a0640 1 Processor -- start 2024-09-19T08:09:27.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.803+0000 7f2eaa3a0640 1 -- start start 2024-09-19T08:09:27.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.803+0000 7f2eaa3a0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ea4100e20 0x7f2ea4199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:27.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.803+0000 7f2eaa3a0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea4102570 0x7f2ea4199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:27.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.803+0000 7f2eaa3a0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ea4102ef0 0x7f2ea41a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:27.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.803+0000 7f2eaa3a0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea4110f80 con 0x7f2ea4102570 2024-09-19T08:09:27.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.803+0000 7f2eaa3a0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea4110e00 con 0x7f2ea4102ef0 2024-09-19T08:09:27.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.803+0000 7f2eaa3a0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea4111100 con 0x7f2ea4100e20 2024-09-19T08:09:27.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.803+0000 7f2ea37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea4102570 0x7f2ea4199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:27.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.803+0000 7f2ea37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea4102570 0x7f2ea4199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51882/0 (socket says 172.21.15.27:51882) 2024-09-19T08:09:27.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.803+0000 7f2ea37fe640 1 -- 172.21.15.27:0/2161091699 learned_addr learned my addr 172.21.15.27:0/2161091699 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:27.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.803+0000 7f2ea3fff640 1 --2- 172.21.15.27:0/2161091699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ea4100e20 0x7f2ea4199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:27.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.803+0000 7f2ea893d640 1 --2- 172.21.15.27:0/2161091699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ea4102ef0 0x7f2ea41a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:27.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.803+0000 7f2ea37fe640 1 -- 172.21.15.27:0/2161091699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ea4100e20 msgr2=0x7f2ea4199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:27.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.803+0000 7f2ea37fe640 1 --2- 172.21.15.27:0/2161091699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ea4100e20 0x7f2ea4199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:27.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.803+0000 7f2ea37fe640 1 -- 172.21.15.27:0/2161091699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ea4102ef0 msgr2=0x7f2ea41a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:27.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.803+0000 7f2ea37fe640 1 --2- 172.21.15.27:0/2161091699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ea4102ef0 0x7f2ea41a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:27.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.803+0000 7f2ea37fe640 1 -- 172.21.15.27:0/2161091699 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea41a48d0 con 0x7f2ea4102570 2024-09-19T08:09:27.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.803+0000 7f2ea3fff640 1 --2- 172.21.15.27:0/2161091699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ea4100e20 0x7f2ea4199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:09:27.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.804+0000 7f2ea37fe640 1 --2- 172.21.15.27:0/2161091699 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea4102570 0x7f2ea4199850 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800e9f0 tx=0x7f2e9800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:27.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.804+0000 7f2ea17fa640 1 -- 172.21.15.27:0/2161091699 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9800cd80 con 0x7f2ea4102570 2024-09-19T08:09:27.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.804+0000 7f2eaa3a0640 1 -- 172.21.15.27:0/2161091699 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea41a4aa0 con 0x7f2ea4102570 2024-09-19T08:09:27.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.804+0000 7f2ea17fa640 1 -- 172.21.15.27:0/2161091699 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e98005500 con 0x7f2ea4102570 2024-09-19T08:09:27.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.804+0000 7f2ea17fa640 1 -- 172.21.15.27:0/2161091699 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98010690 con 0x7f2ea4102570 2024-09-19T08:09:27.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.804+0000 7f2eaa3a0640 1 -- 172.21.15.27:0/2161091699 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea41a4f90 con 0x7f2ea4102570 2024-09-19T08:09:27.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.805+0000 7f2eaa3a0640 1 -- 172.21.15.27:0/2161091699 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ea4101200 con 0x7f2ea4102570 2024-09-19T08:09:27.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.806+0000 7f2ea17fa640 1 -- 172.21.15.27:0/2161091699 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2e980046c0 con 0x7f2ea4102570 2024-09-19T08:09:27.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.807+0000 7f2ea17fa640 1 --2- 172.21.15.27:0/2161091699 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2e8c0a32d0 0x7f2e8c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:27.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.807+0000 7f2ea3fff640 1 --2- 172.21.15.27:0/2161091699 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2e8c0a32d0 0x7f2e8c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:27.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.807+0000 7f2ea17fa640 1 -- 172.21.15.27:0/2161091699 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f2e980cfe50 con 0x7f2ea4102570 2024-09-19T08:09:27.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.807+0000 7f2ea3fff640 1 --2- 172.21.15.27:0/2161091699 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2e8c0a32d0 0x7f2e8c0a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2e94005ab0 tx=0x7f2e94005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:27.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:27.811+0000 7f2ea17fa640 1 -- 172.21.15.27:0/2161091699 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2e9809cbc0 con 0x7f2ea4102570 2024-09-19T08:09:27.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:27 smithi155 ceph-mon[35362]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:09:28.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:27 smithi203 ceph-mon[35198]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:09:28.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:28.013+0000 7f2eaa3a0640 1 -- 172.21.15.27:0/2161091699 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f2ea4062630 con 0x7f2e8c0a32d0 2024-09-19T08:09:28.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:28.038+0000 7f2ea17fa640 1 -- 172.21.15.27:0/2161091699 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2ea4062630 con 0x7f2e8c0a32d0 2024-09-19T08:09:28.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:28.040+0000 7f2eaa3a0640 1 -- 172.21.15.27:0/2161091699 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2e8c0a32d0 msgr2=0x7f2e8c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:28.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:28.040+0000 7f2eaa3a0640 1 --2- 172.21.15.27:0/2161091699 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2e8c0a32d0 0x7f2e8c0a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2e94005ab0 tx=0x7f2e94005a20 comp rx=0 tx=0).stop 2024-09-19T08:09:28.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:28.040+0000 7f2eaa3a0640 1 -- 172.21.15.27:0/2161091699 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea4102570 msgr2=0x7f2ea4199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:28.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:28.040+0000 7f2eaa3a0640 1 --2- 172.21.15.27:0/2161091699 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea4102570 0x7f2ea4199850 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800e9f0 tx=0x7f2e9800edf0 comp rx=0 tx=0).stop 2024-09-19T08:09:28.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:28.040+0000 7f2eaa3a0640 1 -- 172.21.15.27:0/2161091699 shutdown_connections 2024-09-19T08:09:28.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:28.040+0000 7f2eaa3a0640 1 --2- 172.21.15.27:0/2161091699 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f2e8c0a32d0 0x7f2e8c0a5790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:28.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:28.040+0000 7f2eaa3a0640 1 --2- 172.21.15.27:0/2161091699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ea4102ef0 0x7f2ea41a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:28.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:28.040+0000 7f2eaa3a0640 1 --2- 172.21.15.27:0/2161091699 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea4102570 0x7f2ea4199850 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:28.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:28.040+0000 7f2eaa3a0640 1 --2- 172.21.15.27:0/2161091699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ea4100e20 0x7f2ea4199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:28.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:28.040+0000 7f2eaa3a0640 1 -- 172.21.15.27:0/2161091699 >> 172.21.15.27:0/2161091699 conn(0x7f2ea40fc7d0 msgr2=0x7f2ea40fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:28.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:28.040+0000 7f2eaa3a0640 1 -- 172.21.15.27:0/2161091699 shutdown_connections 2024-09-19T08:09:28.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:28.040+0000 7f2eaa3a0640 1 -- 172.21.15.27:0/2161091699 wait complete. 2024-09-19T08:09:28.821 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T08:09:28.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:28 smithi155 ceph-mon[35362]: pgmap v288: 97 pgs: 97 active+clean; 604 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.7 KiB/s wr, 5 op/s 2024-09-19T08:09:29.001 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:28 smithi027 ceph-mon[31209]: pgmap v288: 97 pgs: 97 active+clean; 604 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.7 KiB/s wr, 5 op/s 2024-09-19T08:09:29.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:28 smithi203 ceph-mon[35198]: pgmap v288: 97 pgs: 97 active+clean; 604 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.7 KiB/s wr, 5 op/s 2024-09-19T08:09:29.088 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:29.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.569+0000 7f6edaf47640 1 -- 172.21.15.27:0/3466217910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed4102790 msgr2=0x7f6ed41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:29.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.569+0000 7f6edaf47640 1 --2- 172.21.15.27:0/3466217910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed4102790 0x7f6ed41067e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc009ca0 tx=0x7f6ebc02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:09:29.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.569+0000 7f6edaf47640 1 -- 172.21.15.27:0/3466217910 shutdown_connections 2024-09-19T08:09:29.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.569+0000 7f6edaf47640 1 --2- 172.21.15.27:0/3466217910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed4106f10 0x7f6ed410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:29.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.569+0000 7f6edaf47640 1 --2- 172.21.15.27:0/3466217910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed4102790 0x7f6ed41067e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:29.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.569+0000 7f6edaf47640 1 --2- 172.21.15.27:0/3466217910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ed4101de0 0x7f6ed41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:29.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.569+0000 7f6edaf47640 1 -- 172.21.15.27:0/3466217910 >> 172.21.15.27:0/3466217910 conn(0x7f6ed40fd8c0 msgr2=0x7f6ed40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:29.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.569+0000 7f6edaf47640 1 -- 172.21.15.27:0/3466217910 shutdown_connections 2024-09-19T08:09:29.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.569+0000 7f6edaf47640 1 -- 172.21.15.27:0/3466217910 wait complete. 2024-09-19T08:09:29.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.570+0000 7f6edaf47640 1 Processor -- start 2024-09-19T08:09:29.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.570+0000 7f6edaf47640 1 -- start start 2024-09-19T08:09:29.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.570+0000 7f6edaf47640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed4101de0 0x7f6ed40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:29.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.570+0000 7f6edaf47640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed4102790 0x7f6ed4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:29.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.570+0000 7f6edaf47640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ed4106f10 0x7f6ed4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:29.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.570+0000 7f6edaf47640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed4111fc0 con 0x7f6ed4102790 2024-09-19T08:09:29.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.570+0000 7f6edaf47640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed4111e40 con 0x7f6ed4101de0 2024-09-19T08:09:29.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.570+0000 7f6edaf47640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed4112140 con 0x7f6ed4106f10 2024-09-19T08:09:29.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.570+0000 7f6ed3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed4102790 0x7f6ed4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:29.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.570+0000 7f6ed3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed4102790 0x7f6ed4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51900/0 (socket says 172.21.15.27:51900) 2024-09-19T08:09:29.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.570+0000 7f6ed3fff640 1 -- 172.21.15.27:0/1323882483 learned_addr learned my addr 172.21.15.27:0/1323882483 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:29.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.570+0000 7f6ed8ce3640 1 --2- 172.21.15.27:0/1323882483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed4101de0 0x7f6ed40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:29.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.570+0000 7f6ed94e4640 1 --2- 172.21.15.27:0/1323882483 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ed4106f10 0x7f6ed4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:29.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.570+0000 7f6ed3fff640 1 -- 172.21.15.27:0/1323882483 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ed4106f10 msgr2=0x7f6ed4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:29.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.570+0000 7f6ed3fff640 1 --2- 172.21.15.27:0/1323882483 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ed4106f10 0x7f6ed4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:29.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.570+0000 7f6ed3fff640 1 -- 172.21.15.27:0/1323882483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed4101de0 msgr2=0x7f6ed40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:29.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.570+0000 7f6ed3fff640 1 --2- 172.21.15.27:0/1323882483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed4101de0 0x7f6ed40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:29.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.570+0000 7f6ed3fff640 1 -- 172.21.15.27:0/1323882483 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed41a68e0 con 0x7f6ed4102790 2024-09-19T08:09:29.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.570+0000 7f6ed94e4640 1 --2- 172.21.15.27:0/1323882483 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ed4106f10 0x7f6ed4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:09:29.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.571+0000 7f6ed3fff640 1 --2- 172.21.15.27:0/1323882483 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed4102790 0x7f6ed4074a30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc005e30 tx=0x7f6ebc003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:29.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.571+0000 7f6ed1ffb640 1 -- 172.21.15.27:0/1323882483 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc0316d0 con 0x7f6ed4102790 2024-09-19T08:09:29.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.571+0000 7f6ed1ffb640 1 -- 172.21.15.27:0/1323882483 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ebc031870 con 0x7f6ed4102790 2024-09-19T08:09:29.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.571+0000 7f6edaf47640 1 -- 172.21.15.27:0/1323882483 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ed41a6b70 con 0x7f6ed4102790 2024-09-19T08:09:29.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.571+0000 7f6ed1ffb640 1 -- 172.21.15.27:0/1323882483 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc02fb90 con 0x7f6ed4102790 2024-09-19T08:09:29.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.571+0000 7f6edaf47640 1 -- 172.21.15.27:0/1323882483 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ed41a7100 con 0x7f6ed4102790 2024-09-19T08:09:29.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.572+0000 7f6edaf47640 1 -- 172.21.15.27:0/1323882483 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ed41021c0 con 0x7f6ed4102790 2024-09-19T08:09:29.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.573+0000 7f6ed1ffb640 1 -- 172.21.15.27:0/1323882483 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6ebc004040 con 0x7f6ed4102790 2024-09-19T08:09:29.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.574+0000 7f6ed1ffb640 1 --2- 172.21.15.27:0/1323882483 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6ec00a3350 0x7f6ec00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:29.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.574+0000 7f6ed8ce3640 1 --2- 172.21.15.27:0/1323882483 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6ec00a3350 0x7f6ec00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:29.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.575+0000 7f6ed1ffb640 1 -- 172.21.15.27:0/1323882483 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f6ebc0f0d10 con 0x7f6ed4102790 2024-09-19T08:09:29.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.575+0000 7f6ed8ce3640 1 --2- 172.21.15.27:0/1323882483 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6ec00a3350 0x7f6ec00a5810 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400bbe0 tx=0x7f6ec400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:29.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.579+0000 7f6ed1ffb640 1 -- 172.21.15.27:0/1323882483 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6ebc0bdb90 con 0x7f6ed4102790 2024-09-19T08:09:29.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:29 smithi027 ceph-mon[31209]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:09:29.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.785+0000 7f6edaf47640 1 -- 172.21.15.27:0/1323882483 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f6ed4062630 con 0x7f6ec00a3350 2024-09-19T08:09:29.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.790+0000 7f6ed1ffb640 1 -- 172.21.15.27:0/1323882483 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f6ed4062630 con 0x7f6ec00a3350 2024-09-19T08:09:29.790 INFO:teuthology.orchestra.run.smithi027.stdout:/volumes/qa/sv_1/fd5652cb-0319-42ec-8770-4c09e6ed2340 2024-09-19T08:09:29.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.792+0000 7f6edaf47640 1 -- 172.21.15.27:0/1323882483 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6ec00a3350 msgr2=0x7f6ec00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:29.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.792+0000 7f6edaf47640 1 --2- 172.21.15.27:0/1323882483 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6ec00a3350 0x7f6ec00a5810 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400bbe0 tx=0x7f6ec400b390 comp rx=0 tx=0).stop 2024-09-19T08:09:29.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.792+0000 7f6edaf47640 1 -- 172.21.15.27:0/1323882483 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed4102790 msgr2=0x7f6ed4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:29.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.792+0000 7f6edaf47640 1 --2- 172.21.15.27:0/1323882483 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed4102790 0x7f6ed4074a30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc005e30 tx=0x7f6ebc003f90 comp rx=0 tx=0).stop 2024-09-19T08:09:29.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.792+0000 7f6edaf47640 1 -- 172.21.15.27:0/1323882483 shutdown_connections 2024-09-19T08:09:29.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.792+0000 7f6edaf47640 1 --2- 172.21.15.27:0/1323882483 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ed4106f10 0x7f6ed4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:29.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.792+0000 7f6edaf47640 1 --2- 172.21.15.27:0/1323882483 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed4102790 0x7f6ed4074a30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:29.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.792+0000 7f6edaf47640 1 --2- 172.21.15.27:0/1323882483 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6ec00a3350 0x7f6ec00a5810 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:29.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.792+0000 7f6edaf47640 1 --2- 172.21.15.27:0/1323882483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed4101de0 0x7f6ed40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:29.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.792+0000 7f6edaf47640 1 -- 172.21.15.27:0/1323882483 >> 172.21.15.27:0/1323882483 conn(0x7f6ed40fd8c0 msgr2=0x7f6ed40fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:29.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.792+0000 7f6edaf47640 1 -- 172.21.15.27:0/1323882483 shutdown_connections 2024-09-19T08:09:29.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:29.792+0000 7f6edaf47640 1 -- 172.21.15.27:0/1323882483 wait complete. 2024-09-19T08:09:29.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:29 smithi155 ceph-mon[35362]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:09:30.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:29 smithi203 ceph-mon[35198]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:09:30.426 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:09:30.685 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:30.948 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:30 smithi027 ceph-mon[31209]: pgmap v289: 97 pgs: 97 active+clean; 604 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-19T08:09:30.949 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:30 smithi027 ceph-mon[31209]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:09:30.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:30 smithi155 ceph-mon[35362]: pgmap v289: 97 pgs: 97 active+clean; 604 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-19T08:09:30.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:30 smithi155 ceph-mon[35362]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:09:31.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:30 smithi203 ceph-mon[35198]: pgmap v289: 97 pgs: 97 active+clean; 604 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-19T08:09:31.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:30 smithi203 ceph-mon[35198]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:09:31.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.172+0000 7fa424dcf640 1 -- 172.21.15.27:0/1630145941 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa420100a80 msgr2=0x7fa420100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:31.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.172+0000 7fa424dcf640 1 --2- 172.21.15.27:0/1630145941 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa420100a80 0x7fa420100ee0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa414009930 tx=0x7fa41402a420 comp rx=0 tx=0).stop 2024-09-19T08:09:31.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.172+0000 7fa424dcf640 1 -- 172.21.15.27:0/1630145941 shutdown_connections 2024-09-19T08:09:31.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.172+0000 7fa424dcf640 1 --2- 172.21.15.27:0/1630145941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa420101420 0x7fa42010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:31.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.172+0000 7fa424dcf640 1 --2- 172.21.15.27:0/1630145941 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa420100a80 0x7fa420100ee0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:31.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.172+0000 7fa424dcf640 1 --2- 172.21.15.27:0/1630145941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa420106a80 0x7fa420106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:31.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.172+0000 7fa424dcf640 1 -- 172.21.15.27:0/1630145941 >> 172.21.15.27:0/1630145941 conn(0x7fa4200fc7a0 msgr2=0x7fa4200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:31.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.172+0000 7fa424dcf640 1 -- 172.21.15.27:0/1630145941 shutdown_connections 2024-09-19T08:09:31.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.172+0000 7fa424dcf640 1 -- 172.21.15.27:0/1630145941 wait complete. 2024-09-19T08:09:31.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.173+0000 7fa424dcf640 1 Processor -- start 2024-09-19T08:09:31.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.173+0000 7fa424dcf640 1 -- start start 2024-09-19T08:09:31.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.173+0000 7fa424dcf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa420100a80 0x7fa420198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:31.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.173+0000 7fa424dcf640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa420101420 0x7fa420198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:31.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.173+0000 7fa424dcf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa420106a80 0x7fa42019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:31.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.173+0000 7fa424dcf640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa420110e80 con 0x7fa420100a80 2024-09-19T08:09:31.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.173+0000 7fa424dcf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa420110d00 con 0x7fa420106a80 2024-09-19T08:09:31.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.173+0000 7fa424dcf640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa420111000 con 0x7fa420101420 2024-09-19T08:09:31.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.173+0000 7fa41e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa420100a80 0x7fa420198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:31.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.173+0000 7fa41e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa420100a80 0x7fa420198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33396/0 (socket says 172.21.15.27:33396) 2024-09-19T08:09:31.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.173+0000 7fa41e59c640 1 -- 172.21.15.27:0/3220573776 learned_addr learned my addr 172.21.15.27:0/3220573776 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:31.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.174+0000 7fa41ed9d640 1 --2- 172.21.15.27:0/3220573776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa420106a80 0x7fa42019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:31.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.174+0000 7fa41dd9b640 1 --2- 172.21.15.27:0/3220573776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa420101420 0x7fa420198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:31.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.174+0000 7fa41e59c640 1 -- 172.21.15.27:0/3220573776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa420101420 msgr2=0x7fa420198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:31.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.174+0000 7fa41e59c640 1 --2- 172.21.15.27:0/3220573776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa420101420 0x7fa420198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:31.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.174+0000 7fa41e59c640 1 -- 172.21.15.27:0/3220573776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa420106a80 msgr2=0x7fa42019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:31.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.174+0000 7fa41e59c640 1 --2- 172.21.15.27:0/3220573776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa420106a80 0x7fa42019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:31.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.174+0000 7fa41e59c640 1 -- 172.21.15.27:0/3220573776 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42019d3e0 con 0x7fa420100a80 2024-09-19T08:09:31.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.174+0000 7fa41ed9d640 1 --2- 172.21.15.27:0/3220573776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa420106a80 0x7fa42019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:09:31.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.174+0000 7fa41e59c640 1 --2- 172.21.15.27:0/3220573776 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa420100a80 0x7fa420198430 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa41000d950 tx=0x7fa41000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:31.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.174+0000 7fa40f7fe640 1 -- 172.21.15.27:0/3220573776 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa410017070 con 0x7fa420100a80 2024-09-19T08:09:31.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.174+0000 7fa40f7fe640 1 -- 172.21.15.27:0/3220573776 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa410009c30 con 0x7fa420100a80 2024-09-19T08:09:31.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.174+0000 7fa424dcf640 1 -- 172.21.15.27:0/3220573776 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa42019d6d0 con 0x7fa420100a80 2024-09-19T08:09:31.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.174+0000 7fa40f7fe640 1 -- 172.21.15.27:0/3220573776 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41000f6b0 con 0x7fa420100a80 2024-09-19T08:09:31.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.174+0000 7fa424dcf640 1 -- 172.21.15.27:0/3220573776 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4201a4fb0 con 0x7fa420100a80 2024-09-19T08:09:31.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.175+0000 7fa424dcf640 1 -- 172.21.15.27:0/3220573776 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa420100ee0 con 0x7fa420100a80 2024-09-19T08:09:31.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.176+0000 7fa40f7fe640 1 -- 172.21.15.27:0/3220573776 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa4100109d0 con 0x7fa420100a80 2024-09-19T08:09:31.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.177+0000 7fa40f7fe640 1 --2- 172.21.15.27:0/3220573776 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fa4080a32d0 0x7fa4080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:31.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.177+0000 7fa41dd9b640 1 --2- 172.21.15.27:0/3220573776 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fa4080a32d0 0x7fa4080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:31.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.177+0000 7fa40f7fe640 1 -- 172.21.15.27:0/3220573776 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fa4100cf540 con 0x7fa420100a80 2024-09-19T08:09:31.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.177+0000 7fa41dd9b640 1 --2- 172.21.15.27:0/3220573776 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fa4080a32d0 0x7fa4080a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa414000c00 tx=0x7fa414005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:31.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.181+0000 7fa40f7fe640 1 -- 172.21.15.27:0/3220573776 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa410009de0 con 0x7fa420100a80 2024-09-19T08:09:31.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.392+0000 7fa424dcf640 1 -- 172.21.15.27:0/3220573776 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4201a5180 con 0x7fa420100a80 2024-09-19T08:09:31.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.392+0000 7fa40f7fe640 1 -- 172.21.15.27:0/3220573776 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7fa41009c2b0 con 0x7fa420100a80 2024-09-19T08:09:31.393 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:09:31.393 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:09:31.393 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:09:31.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.394+0000 7fa424dcf640 1 -- 172.21.15.27:0/3220573776 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fa4080a32d0 msgr2=0x7fa4080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:31.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.394+0000 7fa424dcf640 1 --2- 172.21.15.27:0/3220573776 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fa4080a32d0 0x7fa4080a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa414000c00 tx=0x7fa414005a20 comp rx=0 tx=0).stop 2024-09-19T08:09:31.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.394+0000 7fa424dcf640 1 -- 172.21.15.27:0/3220573776 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa420100a80 msgr2=0x7fa420198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:31.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.394+0000 7fa424dcf640 1 --2- 172.21.15.27:0/3220573776 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa420100a80 0x7fa420198430 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa41000d950 tx=0x7fa41000de10 comp rx=0 tx=0).stop 2024-09-19T08:09:31.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.394+0000 7fa424dcf640 1 -- 172.21.15.27:0/3220573776 shutdown_connections 2024-09-19T08:09:31.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.394+0000 7fa424dcf640 1 --2- 172.21.15.27:0/3220573776 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fa4080a32d0 0x7fa4080a5790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:31.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.394+0000 7fa424dcf640 1 --2- 172.21.15.27:0/3220573776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa420106a80 0x7fa42019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:31.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.394+0000 7fa424dcf640 1 --2- 172.21.15.27:0/3220573776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa420101420 0x7fa420198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:31.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.394+0000 7fa424dcf640 1 --2- 172.21.15.27:0/3220573776 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa420100a80 0x7fa420198430 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:31.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.394+0000 7fa424dcf640 1 -- 172.21.15.27:0/3220573776 >> 172.21.15.27:0/3220573776 conn(0x7fa4200fc7a0 msgr2=0x7fa420104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:31.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.395+0000 7fa424dcf640 1 -- 172.21.15.27:0/3220573776 shutdown_connections 2024-09-19T08:09:31.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:31.395+0000 7fa424dcf640 1 -- 172.21.15.27:0/3220573776 wait complete. 2024-09-19T08:09:31.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:31 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3220573776' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:09:32.001 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:31 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3220573776' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:09:32.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:31 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3220573776' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:09:32.125 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:09:32.382 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:32.795 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:32 smithi027 ceph-mon[31209]: pgmap v290: 97 pgs: 97 active+clean; 604 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-19T08:09:32.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.876+0000 7fc0cca39640 1 -- 172.21.15.27:0/3334948613 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0c8103660 msgr2=0x7fc0c810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:32.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.876+0000 7fc0cca39640 1 --2- 172.21.15.27:0/3334948613 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0c8103660 0x7fc0c810bb50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009900 tx=0x7fc0bc02a480 comp rx=0 tx=0).stop 2024-09-19T08:09:32.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.877+0000 7fc0cca39640 1 -- 172.21.15.27:0/3334948613 shutdown_connections 2024-09-19T08:09:32.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.877+0000 7fc0cca39640 1 --2- 172.21.15.27:0/3334948613 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc0c810c170 0x7fc0c810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:32.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.877+0000 7fc0cca39640 1 --2- 172.21.15.27:0/3334948613 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0c8103660 0x7fc0c810bb50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:32.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.877+0000 7fc0cca39640 1 --2- 172.21.15.27:0/3334948613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0c8102d40 0x7fc0c8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:32.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.877+0000 7fc0cca39640 1 -- 172.21.15.27:0/3334948613 >> 172.21.15.27:0/3334948613 conn(0x7fc0c80fc7a0 msgr2=0x7fc0c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:32.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.877+0000 7fc0cca39640 1 -- 172.21.15.27:0/3334948613 shutdown_connections 2024-09-19T08:09:32.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.877+0000 7fc0cca39640 1 -- 172.21.15.27:0/3334948613 wait complete. 2024-09-19T08:09:32.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.877+0000 7fc0cca39640 1 Processor -- start 2024-09-19T08:09:32.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.877+0000 7fc0cca39640 1 -- start start 2024-09-19T08:09:32.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.878+0000 7fc0cca39640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0c8102d40 0x7fc0c8198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:32.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.878+0000 7fc0cca39640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0c8103660 0x7fc0c81989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:32.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.878+0000 7fc0cca39640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc0c810c170 0x7fc0c819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:32.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.878+0000 7fc0cca39640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c8112000 con 0x7fc0c8102d40 2024-09-19T08:09:32.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.878+0000 7fc0cca39640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c8111e80 con 0x7fc0c8103660 2024-09-19T08:09:32.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.878+0000 7fc0cca39640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c8112180 con 0x7fc0c810c170 2024-09-19T08:09:32.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.878+0000 7fc0c659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0c8102d40 0x7fc0c8198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:32.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.878+0000 7fc0c659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0c8102d40 0x7fc0c8198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33402/0 (socket says 172.21.15.27:33402) 2024-09-19T08:09:32.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.878+0000 7fc0c659c640 1 -- 172.21.15.27:0/1446740314 learned_addr learned my addr 172.21.15.27:0/1446740314 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:32.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.878+0000 7fc0c5d9b640 1 --2- 172.21.15.27:0/1446740314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0c8103660 0x7fc0c81989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:32.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.878+0000 7fc0c6d9d640 1 --2- 172.21.15.27:0/1446740314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc0c810c170 0x7fc0c819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:32.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.878+0000 7fc0c659c640 1 -- 172.21.15.27:0/1446740314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc0c810c170 msgr2=0x7fc0c819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:32.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.878+0000 7fc0c659c640 1 --2- 172.21.15.27:0/1446740314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc0c810c170 0x7fc0c819cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:32.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.878+0000 7fc0c659c640 1 -- 172.21.15.27:0/1446740314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0c8103660 msgr2=0x7fc0c81989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:32.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.878+0000 7fc0c659c640 1 --2- 172.21.15.27:0/1446740314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0c8103660 0x7fc0c81989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:32.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.878+0000 7fc0c659c640 1 -- 172.21.15.27:0/1446740314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c819d430 con 0x7fc0c8102d40 2024-09-19T08:09:32.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.878+0000 7fc0c659c640 1 --2- 172.21.15.27:0/1446740314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0c8102d40 0x7fc0c8198480 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800b4a0 tx=0x7fc0b800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:32.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.878+0000 7fc0b77fe640 1 -- 172.21.15.27:0/1446740314 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8014070 con 0x7fc0c8102d40 2024-09-19T08:09:32.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.879+0000 7fc0b77fe640 1 -- 172.21.15.27:0/1446740314 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0b8010af0 con 0x7fc0c8102d40 2024-09-19T08:09:32.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.879+0000 7fc0cca39640 1 -- 172.21.15.27:0/1446740314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c819d720 con 0x7fc0c8102d40 2024-09-19T08:09:32.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.879+0000 7fc0b77fe640 1 -- 172.21.15.27:0/1446740314 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8017d10 con 0x7fc0c8102d40 2024-09-19T08:09:32.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.879+0000 7fc0cca39640 1 -- 172.21.15.27:0/1446740314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c81a5000 con 0x7fc0c8102d40 2024-09-19T08:09:32.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.880+0000 7fc0cca39640 1 -- 172.21.15.27:0/1446740314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0c8103120 con 0x7fc0c8102d40 2024-09-19T08:09:32.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.881+0000 7fc0b77fe640 1 -- 172.21.15.27:0/1446740314 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc0b8017070 con 0x7fc0c8102d40 2024-09-19T08:09:32.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.881+0000 7fc0b77fe640 1 --2- 172.21.15.27:0/1446740314 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc0b00a32d0 0x7fc0b00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:32.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.881+0000 7fc0c5d9b640 1 --2- 172.21.15.27:0/1446740314 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc0b00a32d0 0x7fc0b00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:32.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.882+0000 7fc0b77fe640 1 -- 172.21.15.27:0/1446740314 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fc0b80cebb0 con 0x7fc0c8102d40 2024-09-19T08:09:32.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.882+0000 7fc0c5d9b640 1 --2- 172.21.15.27:0/1446740314 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc0b00a32d0 0x7fc0b00a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc000c00 tx=0x7fc0bc005df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:32.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:32.886+0000 7fc0b77fe640 1 -- 172.21.15.27:0/1446740314 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc0b80d5080 con 0x7fc0c8102d40 2024-09-19T08:09:32.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:32 smithi155 ceph-mon[35362]: pgmap v290: 97 pgs: 97 active+clean; 604 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-19T08:09:33.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:32 smithi203 ceph-mon[35198]: pgmap v290: 97 pgs: 97 active+clean; 604 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-19T08:09:33.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:33.076+0000 7fc0cca39640 1 -- 172.21.15.27:0/1446740314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc0c81997e0 con 0x7fc0c8102d40 2024-09-19T08:09:33.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:33.078+0000 7fc0b77fe640 1 -- 172.21.15.27:0/1446740314 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22265 (secure 0 0 0) 0x7fc0b809ba30 con 0x7fc0c8102d40 2024-09-19T08:09:33.078 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:09:33.078 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":81,"fsid":"35b531b0-765d-11ef-bceb-c7b262605968","created":"2024-09-19T08:01:20.929241+0000","modified":"2024-09-19T08:09:11.929828+0000","last_up_change":"2024-09-19T08:08:17.919001+0000","last_in_change":"2024-09-19T08:07:54.277124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:04:29.312984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:09:08.046858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:09:10.223258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66fd6732-4cac-4eda-bf06-50638995ee80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6803","nonce":3645201250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6805","nonce":3645201250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6809","nonce":3645201250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6807","nonce":3645201250}]},"public_addr":"172.21.15.27:6803/3645201250","cluster_addr":"172.21.15.27:6805/3645201250","heartbeat_back_addr":"172.21.15.27:6809/3645201250","heartbeat_front_addr":"172.21.15.27:6807/3645201250","state":["exists","up"]},{"osd":1,"uuid":"36628767-66ac-433b-938e-10e75b51a877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6801","nonce":3977510449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6803","nonce":3977510449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6807","nonce":3977510449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6805","nonce":3977510449}]},"public_addr":"172.21.15.155:6801/3977510449","cluster_addr":"172.21.15.155:6803/3977510449","heartbeat_back_addr":"172.21.15.155:6807/3977510449","heartbeat_front_addr":"172.21.15.155:6805/3977510449","state":["exists","up"]},{"osd":2,"uuid":"3dc80404-a56b-456a-af02-f01e9c6c6dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6801","nonce":3796057016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6803","nonce":3796057016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6807","nonce":3796057016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6805","nonce":3796057016}]},"public_addr":"172.21.15.203:6801/3796057016","cluster_addr":"172.21.15.203:6803/3796057016","heartbeat_back_addr":"172.21.15.203:6807/3796057016","heartbeat_front_addr":"172.21.15.203:6805/3796057016","state":["exists","up"]},{"osd":3,"uuid":"a51077d0-5e04-49b5-bb3e-91711cc45ff1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6811","nonce":1608304347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6813","nonce":1608304347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6817","nonce":1608304347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6815","nonce":1608304347}]},"public_addr":"172.21.15.27:6811/1608304347","cluster_addr":"172.21.15.27:6813/1608304347","heartbeat_back_addr":"172.21.15.27:6817/1608304347","heartbeat_front_addr":"172.21.15.27:6815/1608304347","state":["exists","up"]},{"osd":4,"uuid":"0df35548-90b4-434d-8d7e-c037072c9ae4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6809","nonce":569913150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6811","nonce":569913150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6815","nonce":569913150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6813","nonce":569913150}]},"public_addr":"172.21.15.155:6809/569913150","cluster_addr":"172.21.15.155:6811/569913150","heartbeat_back_addr":"172.21.15.155:6815/569913150","heartbeat_front_addr":"172.21.15.155:6813/569913150","state":["exists","up"]},{"osd":5,"uuid":"de193c5f-1019-43e5-9f4f-6c2aaa4330e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6809","nonce":991491203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6811","nonce":991491203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6815","nonce":991491203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6813","nonce":991491203}]},"public_addr":"172.21.15.203:6809/991491203","cluster_addr":"172.21.15.203:6811/991491203","heartbeat_back_addr":"172.21.15.203:6815/991491203","heartbeat_front_addr":"172.21.15.203:6813/991491203","state":["exists","up"]},{"osd":6,"uuid":"28938e4f-9f22-466f-8cf7-62ee56a0c926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6819","nonce":3516868131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6821","nonce":3516868131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6825","nonce":3516868131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6823","nonce":3516868131}]},"public_addr":"172.21.15.27:6819/3516868131","cluster_addr":"172.21.15.27:6821/3516868131","heartbeat_back_addr":"172.21.15.27:6825/3516868131","heartbeat_front_addr":"172.21.15.27:6823/3516868131","state":["exists","up"]},{"osd":7,"uuid":"855f1728-be52-4445-8561-a90c08f2b2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6817","nonce":2047506436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6819","nonce":2047506436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6823","nonce":2047506436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6821","nonce":2047506436}]},"public_addr":"172.21.15.155:6817/2047506436","cluster_addr":"172.21.15.155:6819/2047506436","heartbeat_back_addr":"172.21.15.155:6823/2047506436","heartbeat_front_addr":"172.21.15.155:6821/2047506436","state":["exists","up"]},{"osd":8,"uuid":"5d7a8ffd-a039-403e-8b9a-c80e19fd67ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6817","nonce":199970687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6819","nonce":199970687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6823","nonce":199970687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6821","nonce":199970687}]},"public_addr":"172.21.15.203:6817/199970687","cluster_addr":"172.21.15.203:6819/199970687","heartbeat_back_addr":"172.21.15.203:6823/199970687","heartbeat_front_addr":"172.21.15.203:6821/199970687","state":["exists","up"]},{"osd":9,"uuid":"cdb90242-80a1-4cef-b5e3-ddecb05664e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6827","nonce":118390483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6829","nonce":118390483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6833","nonce":118390483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6831","nonce":118390483}]},"public_addr":"172.21.15.27:6827/118390483","cluster_addr":"172.21.15.27:6829/118390483","heartbeat_back_addr":"172.21.15.27:6833/118390483","heartbeat_front_addr":"172.21.15.27:6831/118390483","state":["exists","up"]},{"osd":10,"uuid":"c7f4c9da-d913-47a5-8629-53de21efe8c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6825","nonce":1687418565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6827","nonce":1687418565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6831","nonce":1687418565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6829","nonce":1687418565}]},"public_addr":"172.21.15.155:6825/1687418565","cluster_addr":"172.21.15.155:6827/1687418565","heartbeat_back_addr":"172.21.15.155:6831/1687418565","heartbeat_front_addr":"172.21.15.155:6829/1687418565","state":["exists","up"]},{"osd":11,"uuid":"45c11a90-585e-46fa-a5a0-51a29e29eba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6825","nonce":224768827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6827","nonce":224768827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6831","nonce":224768827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6829","nonce":224768827}]},"public_addr":"172.21.15.203:6825/224768827","cluster_addr":"172.21.15.203:6827/224768827","heartbeat_back_addr":"172.21.15.203:6831/224768827","heartbeat_front_addr":"172.21.15.203:6829/224768827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:03:35.559549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:00.526006+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:25.809346+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:51.889445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:17.246017+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:43.515854+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:08.638182+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:34.653060+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:59.469837+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:26.122937+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:50.196159+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:08:16.245770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:6800/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/958829150":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1174736321":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1908865720":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/416476667":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6800/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/1717932879":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1963219497":"2024-09-20T08:01:48.686812+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:09:33.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:33.080+0000 7fc0cca39640 1 -- 172.21.15.27:0/1446740314 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc0b00a32d0 msgr2=0x7fc0b00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:33.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:33.080+0000 7fc0cca39640 1 --2- 172.21.15.27:0/1446740314 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc0b00a32d0 0x7fc0b00a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc000c00 tx=0x7fc0bc005df0 comp rx=0 tx=0).stop 2024-09-19T08:09:33.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:33.080+0000 7fc0cca39640 1 -- 172.21.15.27:0/1446740314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0c8102d40 msgr2=0x7fc0c8198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:33.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:33.080+0000 7fc0cca39640 1 --2- 172.21.15.27:0/1446740314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0c8102d40 0x7fc0c8198480 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800b4a0 tx=0x7fc0b800b960 comp rx=0 tx=0).stop 2024-09-19T08:09:33.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:33.081+0000 7fc0cca39640 1 -- 172.21.15.27:0/1446740314 shutdown_connections 2024-09-19T08:09:33.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:33.081+0000 7fc0cca39640 1 --2- 172.21.15.27:0/1446740314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc0c810c170 0x7fc0c819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:33.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:33.081+0000 7fc0cca39640 1 --2- 172.21.15.27:0/1446740314 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc0b00a32d0 0x7fc0b00a5790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:33.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:33.081+0000 7fc0cca39640 1 --2- 172.21.15.27:0/1446740314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0c8103660 0x7fc0c81989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:33.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:33.081+0000 7fc0cca39640 1 --2- 172.21.15.27:0/1446740314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0c8102d40 0x7fc0c8198480 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:33.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:33.081+0000 7fc0cca39640 1 -- 172.21.15.27:0/1446740314 >> 172.21.15.27:0/1446740314 conn(0x7fc0c80fc7a0 msgr2=0x7fc0c80fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:33.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:33.081+0000 7fc0cca39640 1 -- 172.21.15.27:0/1446740314 shutdown_connections 2024-09-19T08:09:33.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:33.081+0000 7fc0cca39640 1 -- 172.21.15.27:0/1446740314 wait complete. 2024-09-19T08:09:33.748 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T08:09:33.748 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:09:33.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:33 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1446740314' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:09:34.005 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:33 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1446740314' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:09:34.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:33 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1446740314' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:09:34.009 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:34.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.476+0000 7f6ee054e640 1 -- 172.21.15.27:0/2751541085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed8101420 msgr2=0x7f6ed810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:34.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.476+0000 7f6ee054e640 1 --2- 172.21.15.27:0/2751541085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed8101420 0x7f6ed810d950 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009cd0 tx=0x7f6ed002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:09:34.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.476+0000 7f6ee054e640 1 -- 172.21.15.27:0/2751541085 shutdown_connections 2024-09-19T08:09:34.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.476+0000 7f6ee054e640 1 --2- 172.21.15.27:0/2751541085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed8101420 0x7f6ed810d950 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:34.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.476+0000 7f6ee054e640 1 --2- 172.21.15.27:0/2751541085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ed8100a80 0x7f6ed8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:34.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.476+0000 7f6ee054e640 1 --2- 172.21.15.27:0/2751541085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed8106a80 0x7f6ed8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:34.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.476+0000 7f6ee054e640 1 -- 172.21.15.27:0/2751541085 >> 172.21.15.27:0/2751541085 conn(0x7f6ed80fc7a0 msgr2=0x7f6ed80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:34.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.477+0000 7f6ee054e640 1 -- 172.21.15.27:0/2751541085 shutdown_connections 2024-09-19T08:09:34.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.477+0000 7f6ee054e640 1 -- 172.21.15.27:0/2751541085 wait complete. 2024-09-19T08:09:34.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.477+0000 7f6ee054e640 1 Processor -- start 2024-09-19T08:09:34.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.477+0000 7f6ee054e640 1 -- start start 2024-09-19T08:09:34.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.478+0000 7f6ee054e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed8100a80 0x7f6ed810e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:34.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.478+0000 7f6ee054e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed8101420 0x7f6ed810e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:34.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.478+0000 7f6ee054e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ed8106a80 0x7f6ed810ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:34.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.478+0000 7f6ee054e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed8111f90 con 0x7f6ed8101420 2024-09-19T08:09:34.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.478+0000 7f6ee054e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed8111e10 con 0x7f6ed8100a80 2024-09-19T08:09:34.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.478+0000 7f6ee054e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed8112110 con 0x7f6ed8106a80 2024-09-19T08:09:34.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.478+0000 7f6eddae9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed8101420 0x7f6ed810e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:34.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.478+0000 7f6eddae9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed8101420 0x7f6ed810e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33424/0 (socket says 172.21.15.27:33424) 2024-09-19T08:09:34.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.478+0000 7f6eddae9640 1 -- 172.21.15.27:0/1043294374 learned_addr learned my addr 172.21.15.27:0/1043294374 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:34.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.478+0000 7f6edeaeb640 1 --2- 172.21.15.27:0/1043294374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ed8106a80 0x7f6ed810ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:34.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.478+0000 7f6ede2ea640 1 --2- 172.21.15.27:0/1043294374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed8100a80 0x7f6ed810e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:34.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.478+0000 7f6eddae9640 1 -- 172.21.15.27:0/1043294374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ed8106a80 msgr2=0x7f6ed810ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:34.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.478+0000 7f6eddae9640 1 --2- 172.21.15.27:0/1043294374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ed8106a80 0x7f6ed810ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:34.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.478+0000 7f6eddae9640 1 -- 172.21.15.27:0/1043294374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed8100a80 msgr2=0x7f6ed810e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:34.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.478+0000 7f6eddae9640 1 --2- 172.21.15.27:0/1043294374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed8100a80 0x7f6ed810e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:34.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.478+0000 7f6eddae9640 1 -- 172.21.15.27:0/1043294374 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed8072cd0 con 0x7f6ed8101420 2024-09-19T08:09:34.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.478+0000 7f6eddae9640 1 --2- 172.21.15.27:0/1043294374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed8101420 0x7f6ed810e6d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800d950 tx=0x7f6ec800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:34.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.479+0000 7f6ecf7fe640 1 -- 172.21.15.27:0/1043294374 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8017030 con 0x7f6ed8101420 2024-09-19T08:09:34.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.479+0000 7f6ee054e640 1 -- 172.21.15.27:0/1043294374 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ed8072fc0 con 0x7f6ed8101420 2024-09-19T08:09:34.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.479+0000 7f6ecf7fe640 1 -- 172.21.15.27:0/1043294374 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ec8004020 con 0x7f6ed8101420 2024-09-19T08:09:34.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.479+0000 7f6ecf7fe640 1 -- 172.21.15.27:0/1043294374 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec80047a0 con 0x7f6ed8101420 2024-09-19T08:09:34.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.479+0000 7f6ee054e640 1 -- 172.21.15.27:0/1043294374 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ed8073550 con 0x7f6ed8101420 2024-09-19T08:09:34.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.480+0000 7f6ee054e640 1 -- 172.21.15.27:0/1043294374 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ed8100ee0 con 0x7f6ed8101420 2024-09-19T08:09:34.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.482+0000 7f6ecf7fe640 1 -- 172.21.15.27:0/1043294374 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6ec80041d0 con 0x7f6ed8101420 2024-09-19T08:09:34.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.482+0000 7f6ecf7fe640 1 --2- 172.21.15.27:0/1043294374 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6ec40a32d0 0x7f6ec40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:34.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.483+0000 7f6ede2ea640 1 --2- 172.21.15.27:0/1043294374 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6ec40a32d0 0x7f6ec40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:34.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.483+0000 7f6ecf7fe640 1 -- 172.21.15.27:0/1043294374 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f6ec80cf8c0 con 0x7f6ed8101420 2024-09-19T08:09:34.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.483+0000 7f6ede2ea640 1 --2- 172.21.15.27:0/1043294374 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6ec40a32d0 0x7f6ec40a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400bb60 tx=0x7f6ed400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:34.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.486+0000 7f6ecf7fe640 1 -- 172.21.15.27:0/1043294374 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6ec809c630 con 0x7f6ed8101420 2024-09-19T08:09:34.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.657+0000 7f6ee054e640 1 -- 172.21.15.27:0/1043294374 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ed8074040 con 0x7f6ec40a32d0 2024-09-19T08:09:34.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.665+0000 7f6ecf7fe640 1 -- 172.21.15.27:0/1043294374 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258790 (secure 0 0 0) 0x7f6ed8074040 con 0x7f6ec40a32d0 2024-09-19T08:09:34.668 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:09:34.669 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-09-19T08:09:34.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.667+0000 7f6ee054e640 1 -- 172.21.15.27:0/1043294374 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6ec40a32d0 msgr2=0x7f6ec40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:34.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.667+0000 7f6ee054e640 1 --2- 172.21.15.27:0/1043294374 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6ec40a32d0 0x7f6ec40a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400bb60 tx=0x7f6ed400b390 comp rx=0 tx=0).stop 2024-09-19T08:09:34.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.667+0000 7f6ee054e640 1 -- 172.21.15.27:0/1043294374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed8101420 msgr2=0x7f6ed810e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:34.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.667+0000 7f6ee054e640 1 --2- 172.21.15.27:0/1043294374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed8101420 0x7f6ed810e6d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800d950 tx=0x7f6ec800de10 comp rx=0 tx=0).stop 2024-09-19T08:09:34.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.667+0000 7f6ee054e640 1 -- 172.21.15.27:0/1043294374 shutdown_connections 2024-09-19T08:09:34.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.668+0000 7f6ee054e640 1 --2- 172.21.15.27:0/1043294374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ed8106a80 0x7f6ed810ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:34.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.668+0000 7f6ee054e640 1 --2- 172.21.15.27:0/1043294374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed8101420 0x7f6ed810e6d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:34.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.668+0000 7f6ee054e640 1 --2- 172.21.15.27:0/1043294374 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6ec40a32d0 0x7f6ec40a5790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:34.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.668+0000 7f6ee054e640 1 --2- 172.21.15.27:0/1043294374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed8100a80 0x7f6ed810e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:34.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.668+0000 7f6ee054e640 1 -- 172.21.15.27:0/1043294374 >> 172.21.15.27:0/1043294374 conn(0x7f6ed80fc7a0 msgr2=0x7f6ed80fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:34.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.668+0000 7f6ee054e640 1 -- 172.21.15.27:0/1043294374 shutdown_connections 2024-09-19T08:09:34.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:34.668+0000 7f6ee054e640 1 -- 172.21.15.27:0/1043294374 wait complete. 2024-09-19T08:09:34.967 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:34 smithi203 ceph-mon[35198]: pgmap v291: 97 pgs: 97 active+clean; 629 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-09-19T08:09:34.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:34 smithi155 ceph-mon[35362]: pgmap v291: 97 pgs: 97 active+clean; 629 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-09-19T08:09:34.989 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:34 smithi027 ceph-mon[31209]: pgmap v291: 97 pgs: 97 active+clean; 629 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-09-19T08:09:35.442 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2024-09-19T08:09:32.912986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644567,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":174,"num_read_kb":192,"num_write":253,"num_write_kb":3014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355668,"kb_used_data":10560,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124586156,"statfs":{"total":1151940427776,"available":1151576223744,"internally_reserved":0,"allocated":10813440,"data_stored":6935745,"data_compressed":107475,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51789,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":69,"num_write":27,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002847"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260466+0000","last_change":"2024-09-19T08:09:11.246436+0000","last_active":"2024-09-19T08:09:12.260466+0000","last_peered":"2024-09-19T08:09:12.260466+0000","last_clean":"2024-09-19T08:09:12.260466+0000","last_became_active":"2024-09-19T08:09:11.245674+0000","last_became_peered":"2024-09-19T08:09:11.245674+0000","last_unstale":"2024-09-19T08:09:12.260466+0000","last_undegraded":"2024-09-19T08:09:12.260466+0000","last_fullsized":"2024-09-19T08:09:12.260466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:46.716474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273550+0000","last_change":"2024-09-19T08:09:11.243334+0000","last_active":"2024-09-19T08:09:12.273550+0000","last_peered":"2024-09-19T08:09:12.273550+0000","last_clean":"2024-09-19T08:09:12.273550+0000","last_became_active":"2024-09-19T08:09:11.243024+0000","last_became_peered":"2024-09-19T08:09:11.243024+0000","last_unstale":"2024-09-19T08:09:12.273550+0000","last_undegraded":"2024-09-19T08:09:12.273550+0000","last_fullsized":"2024-09-19T08:09:12.273550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.060068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273553+0000","last_change":"2024-09-19T08:09:11.254655+0000","last_active":"2024-09-19T08:09:12.273553+0000","last_peered":"2024-09-19T08:09:12.273553+0000","last_clean":"2024-09-19T08:09:12.273553+0000","last_became_active":"2024-09-19T08:09:11.254292+0000","last_became_peered":"2024-09-19T08:09:11.254292+0000","last_unstale":"2024-09-19T08:09:12.273553+0000","last_undegraded":"2024-09-19T08:09:12.273553+0000","last_fullsized":"2024-09-19T08:09:12.273553+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:01.977743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273130+0000","last_change":"2024-09-19T08:09:11.257029+0000","last_active":"2024-09-19T08:09:12.273130+0000","last_peered":"2024-09-19T08:09:12.273130+0000","last_clean":"2024-09-19T08:09:12.273130+0000","last_became_active":"2024-09-19T08:09:11.256669+0000","last_became_peered":"2024-09-19T08:09:11.256669+0000","last_unstale":"2024-09-19T08:09:12.273130+0000","last_undegraded":"2024-09-19T08:09:12.273130+0000","last_fullsized":"2024-09-19T08:09:12.273130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:32.831036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270384+0000","last_change":"2024-09-19T08:09:11.240341+0000","last_active":"2024-09-19T08:09:12.270384+0000","last_peered":"2024-09-19T08:09:12.270384+0000","last_clean":"2024-09-19T08:09:12.270384+0000","last_became_active":"2024-09-19T08:09:11.239996+0000","last_became_peered":"2024-09-19T08:09:11.239996+0000","last_unstale":"2024-09-19T08:09:12.270384+0000","last_undegraded":"2024-09-19T08:09:12.270384+0000","last_fullsized":"2024-09-19T08:09:12.270384+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:20.331791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264127+0000","last_change":"2024-09-19T08:09:11.248089+0000","last_active":"2024-09-19T08:09:12.264127+0000","last_peered":"2024-09-19T08:09:12.264127+0000","last_clean":"2024-09-19T08:09:12.264127+0000","last_became_active":"2024-09-19T08:09:11.247802+0000","last_became_peered":"2024-09-19T08:09:11.247802+0000","last_unstale":"2024-09-19T08:09:12.264127+0000","last_undegraded":"2024-09-19T08:09:12.264127+0000","last_fullsized":"2024-09-19T08:09:12.264127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.249119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274640+0000","last_change":"2024-09-19T08:09:11.246853+0000","last_active":"2024-09-19T08:09:12.274640+0000","last_peered":"2024-09-19T08:09:12.274640+0000","last_clean":"2024-09-19T08:09:12.274640+0000","last_became_active":"2024-09-19T08:09:11.246523+0000","last_became_peered":"2024-09-19T08:09:11.246523+0000","last_unstale":"2024-09-19T08:09:12.274640+0000","last_undegraded":"2024-09-19T08:09:12.274640+0000","last_fullsized":"2024-09-19T08:09:12.274640+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:54.879087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269828+0000","last_change":"2024-09-19T08:09:11.232588+0000","last_active":"2024-09-19T08:09:12.269828+0000","last_peered":"2024-09-19T08:09:12.269828+0000","last_clean":"2024-09-19T08:09:12.269828+0000","last_became_active":"2024-09-19T08:09:11.232251+0000","last_became_peered":"2024-09-19T08:09:11.232251+0000","last_unstale":"2024-09-19T08:09:12.269828+0000","last_undegraded":"2024-09-19T08:09:12.269828+0000","last_fullsized":"2024-09-19T08:09:12.269828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:57.622086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270505+0000","last_change":"2024-09-19T08:09:11.248854+0000","last_active":"2024-09-19T08:09:12.270505+0000","last_peered":"2024-09-19T08:09:12.270505+0000","last_clean":"2024-09-19T08:09:12.270505+0000","last_became_active":"2024-09-19T08:09:11.248524+0000","last_became_peered":"2024-09-19T08:09:11.248524+0000","last_unstale":"2024-09-19T08:09:12.270505+0000","last_undegraded":"2024-09-19T08:09:12.270505+0000","last_fullsized":"2024-09-19T08:09:12.270505+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:57.978974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264615+0000","last_change":"2024-09-19T08:09:11.247407+0000","last_active":"2024-09-19T08:09:12.264615+0000","last_peered":"2024-09-19T08:09:12.264615+0000","last_clean":"2024-09-19T08:09:12.264615+0000","last_became_active":"2024-09-19T08:09:11.247093+0000","last_became_peered":"2024-09-19T08:09:11.247093+0000","last_unstale":"2024-09-19T08:09:12.264615+0000","last_undegraded":"2024-09-19T08:09:12.264615+0000","last_fullsized":"2024-09-19T08:09:12.264615+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:25.959852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275097+0000","last_change":"2024-09-19T08:09:11.247604+0000","last_active":"2024-09-19T08:09:12.275097+0000","last_peered":"2024-09-19T08:09:12.275097+0000","last_clean":"2024-09-19T08:09:12.275097+0000","last_became_active":"2024-09-19T08:09:11.247264+0000","last_became_peered":"2024-09-19T08:09:11.247264+0000","last_unstale":"2024-09-19T08:09:12.275097+0000","last_undegraded":"2024-09-19T08:09:12.275097+0000","last_fullsized":"2024-09-19T08:09:12.275097+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:15.315022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273289+0000","last_change":"2024-09-19T08:09:11.253948+0000","last_active":"2024-09-19T08:09:12.273289+0000","last_peered":"2024-09-19T08:09:12.273289+0000","last_clean":"2024-09-19T08:09:12.273289+0000","last_became_active":"2024-09-19T08:09:11.253402+0000","last_became_peered":"2024-09-19T08:09:11.253402+0000","last_unstale":"2024-09-19T08:09:12.273289+0000","last_undegraded":"2024-09-19T08:09:12.273289+0000","last_fullsized":"2024-09-19T08:09:12.273289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:04.884541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259928+0000","last_change":"2024-09-19T08:09:11.241770+0000","last_active":"2024-09-19T08:09:12.259928+0000","last_peered":"2024-09-19T08:09:12.259928+0000","last_clean":"2024-09-19T08:09:12.259928+0000","last_became_active":"2024-09-19T08:09:11.241356+0000","last_became_peered":"2024-09-19T08:09:11.241356+0000","last_unstale":"2024-09-19T08:09:12.259928+0000","last_undegraded":"2024-09-19T08:09:12.259928+0000","last_fullsized":"2024-09-19T08:09:12.259928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:02.722445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272890+0000","last_change":"2024-09-19T08:09:11.242874+0000","last_active":"2024-09-19T08:09:12.272890+0000","last_peered":"2024-09-19T08:09:12.272890+0000","last_clean":"2024-09-19T08:09:12.272890+0000","last_became_active":"2024-09-19T08:09:11.242383+0000","last_became_peered":"2024-09-19T08:09:11.242383+0000","last_unstale":"2024-09-19T08:09:12.272890+0000","last_undegraded":"2024-09-19T08:09:12.272890+0000","last_fullsized":"2024-09-19T08:09:12.272890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:51.900211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272762+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:09:12.272762+0000","last_peered":"2024-09-19T08:09:12.272762+0000","last_clean":"2024-09-19T08:09:12.272762+0000","last_became_active":"2024-09-19T08:09:11.250797+0000","last_became_peered":"2024-09-19T08:09:11.250797+0000","last_unstale":"2024-09-19T08:09:12.272762+0000","last_undegraded":"2024-09-19T08:09:12.272762+0000","last_fullsized":"2024-09-19T08:09:12.272762+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:46.183857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269901+0000","last_change":"2024-09-19T08:09:11.250884+0000","last_active":"2024-09-19T08:09:12.269901+0000","last_peered":"2024-09-19T08:09:12.269901+0000","last_clean":"2024-09-19T08:09:12.269901+0000","last_became_active":"2024-09-19T08:09:11.250543+0000","last_became_peered":"2024-09-19T08:09:11.250543+0000","last_unstale":"2024-09-19T08:09:12.269901+0000","last_undegraded":"2024-09-19T08:09:12.269901+0000","last_fullsized":"2024-09-19T08:09:12.269901+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.259466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260519+0000","last_change":"2024-09-19T08:09:11.246705+0000","last_active":"2024-09-19T08:09:12.260519+0000","last_peered":"2024-09-19T08:09:12.260519+0000","last_clean":"2024-09-19T08:09:12.260519+0000","last_became_active":"2024-09-19T08:09:11.246117+0000","last_became_peered":"2024-09-19T08:09:11.246117+0000","last_unstale":"2024-09-19T08:09:12.260519+0000","last_undegraded":"2024-09-19T08:09:12.260519+0000","last_fullsized":"2024-09-19T08:09:12.260519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:07.421222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272544+0000","last_change":"2024-09-19T08:09:11.242181+0000","last_active":"2024-09-19T08:09:12.272544+0000","last_peered":"2024-09-19T08:09:12.272544+0000","last_clean":"2024-09-19T08:09:12.272544+0000","last_became_active":"2024-09-19T08:09:11.241882+0000","last_became_peered":"2024-09-19T08:09:11.241882+0000","last_unstale":"2024-09-19T08:09:12.272544+0000","last_undegraded":"2024-09-19T08:09:12.272544+0000","last_fullsized":"2024-09-19T08:09:12.272544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:35.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270253+0000","last_change":"2024-09-19T08:09:11.246038+0000","last_active":"2024-09-19T08:09:12.270253+0000","last_peered":"2024-09-19T08:09:12.270253+0000","last_clean":"2024-09-19T08:09:12.270253+0000","last_became_active":"2024-09-19T08:09:11.245554+0000","last_became_peered":"2024-09-19T08:09:11.245554+0000","last_unstale":"2024-09-19T08:09:12.270253+0000","last_undegraded":"2024-09-19T08:09:12.270253+0000","last_fullsized":"2024-09-19T08:09:12.270253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:14.512425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260222+0000","last_change":"2024-09-19T08:09:11.249246+0000","last_active":"2024-09-19T08:09:12.260222+0000","last_peered":"2024-09-19T08:09:12.260222+0000","last_clean":"2024-09-19T08:09:12.260222+0000","last_became_active":"2024-09-19T08:09:11.248896+0000","last_became_peered":"2024-09-19T08:09:11.248896+0000","last_unstale":"2024-09-19T08:09:12.260222+0000","last_undegraded":"2024-09-19T08:09:12.260222+0000","last_fullsized":"2024-09-19T08:09:12.260222+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:40.406924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259965+0000","last_change":"2024-09-19T08:09:11.245421+0000","last_active":"2024-09-19T08:09:12.259965+0000","last_peered":"2024-09-19T08:09:12.259965+0000","last_clean":"2024-09-19T08:09:12.259965+0000","last_became_active":"2024-09-19T08:09:11.245071+0000","last_became_peered":"2024-09-19T08:09:11.245071+0000","last_unstale":"2024-09-19T08:09:12.259965+0000","last_undegraded":"2024-09-19T08:09:12.259965+0000","last_fullsized":"2024-09-19T08:09:12.259965+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:58.594399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270143+0000","last_change":"2024-09-19T08:09:11.246097+0000","last_active":"2024-09-19T08:09:12.270143+0000","last_peered":"2024-09-19T08:09:12.270143+0000","last_clean":"2024-09-19T08:09:12.270143+0000","last_became_active":"2024-09-19T08:09:11.245741+0000","last_became_peered":"2024-09-19T08:09:11.245741+0000","last_unstale":"2024-09-19T08:09:12.270143+0000","last_undegraded":"2024-09-19T08:09:12.270143+0000","last_fullsized":"2024-09-19T08:09:12.270143+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:05.731148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269658+0000","last_change":"2024-09-19T08:09:11.251485+0000","last_active":"2024-09-19T08:09:12.269658+0000","last_peered":"2024-09-19T08:09:12.269658+0000","last_clean":"2024-09-19T08:09:12.269658+0000","last_became_active":"2024-09-19T08:09:11.251151+0000","last_became_peered":"2024-09-19T08:09:11.251151+0000","last_unstale":"2024-09-19T08:09:12.269658+0000","last_undegraded":"2024-09-19T08:09:12.269658+0000","last_fullsized":"2024-09-19T08:09:12.269658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:47.231056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275099+0000","last_change":"2024-09-19T08:09:11.234490+0000","last_active":"2024-09-19T08:09:12.275099+0000","last_peered":"2024-09-19T08:09:12.275099+0000","last_clean":"2024-09-19T08:09:12.275099+0000","last_became_active":"2024-09-19T08:09:11.234163+0000","last_became_peered":"2024-09-19T08:09:11.234163+0000","last_unstale":"2024-09-19T08:09:12.275099+0000","last_undegraded":"2024-09-19T08:09:12.275099+0000","last_fullsized":"2024-09-19T08:09:12.275099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.610165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270016+0000","last_change":"2024-09-19T08:09:11.247189+0000","last_active":"2024-09-19T08:09:12.270016+0000","last_peered":"2024-09-19T08:09:12.270016+0000","last_clean":"2024-09-19T08:09:12.270016+0000","last_became_active":"2024-09-19T08:09:11.246844+0000","last_became_peered":"2024-09-19T08:09:11.246844+0000","last_unstale":"2024-09-19T08:09:12.270016+0000","last_undegraded":"2024-09-19T08:09:12.270016+0000","last_fullsized":"2024-09-19T08:09:12.270016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:50.764694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273859+0000","last_change":"2024-09-19T08:09:11.251655+0000","last_active":"2024-09-19T08:09:12.273859+0000","last_peered":"2024-09-19T08:09:12.273859+0000","last_clean":"2024-09-19T08:09:12.273859+0000","last_became_active":"2024-09-19T08:09:11.250930+0000","last_became_peered":"2024-09-19T08:09:11.250930+0000","last_unstale":"2024-09-19T08:09:12.273859+0000","last_undegraded":"2024-09-19T08:09:12.273859+0000","last_fullsized":"2024-09-19T08:09:12.273859+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:17.658277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260441+0000","last_change":"2024-09-19T08:09:11.248095+0000","last_active":"2024-09-19T08:09:12.260441+0000","last_peered":"2024-09-19T08:09:12.260441+0000","last_clean":"2024-09-19T08:09:12.260441+0000","last_became_active":"2024-09-19T08:09:11.247719+0000","last_became_peered":"2024-09-19T08:09:11.247719+0000","last_unstale":"2024-09-19T08:09:12.260441+0000","last_undegraded":"2024-09-19T08:09:12.260441+0000","last_fullsized":"2024-09-19T08:09:12.260441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:26.701140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259653+0000","last_change":"2024-09-19T08:09:11.243232+0000","last_active":"2024-09-19T08:09:12.259653+0000","last_peered":"2024-09-19T08:09:12.259653+0000","last_clean":"2024-09-19T08:09:12.259653+0000","last_became_active":"2024-09-19T08:09:11.242927+0000","last_became_peered":"2024-09-19T08:09:11.242927+0000","last_unstale":"2024-09-19T08:09:12.259653+0000","last_undegraded":"2024-09-19T08:09:12.259653+0000","last_fullsized":"2024-09-19T08:09:12.259653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:19.877520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273190+0000","last_change":"2024-09-19T08:09:11.249588+0000","last_active":"2024-09-19T08:09:12.273190+0000","last_peered":"2024-09-19T08:09:12.273190+0000","last_clean":"2024-09-19T08:09:12.273190+0000","last_became_active":"2024-09-19T08:09:11.249266+0000","last_became_peered":"2024-09-19T08:09:11.249266+0000","last_unstale":"2024-09-19T08:09:12.273190+0000","last_undegraded":"2024-09-19T08:09:12.273190+0000","last_fullsized":"2024-09-19T08:09:12.273190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:43.332454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272135+0000","last_change":"2024-09-19T08:09:11.245866+0000","last_active":"2024-09-19T08:09:12.272135+0000","last_peered":"2024-09-19T08:09:12.272135+0000","last_clean":"2024-09-19T08:09:12.272135+0000","last_became_active":"2024-09-19T08:09:11.245505+0000","last_became_peered":"2024-09-19T08:09:11.245505+0000","last_unstale":"2024-09-19T08:09:12.272135+0000","last_undegraded":"2024-09-19T08:09:12.272135+0000","last_fullsized":"2024-09-19T08:09:12.272135+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:38.203790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270471+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:09:12.270471+0000","last_peered":"2024-09-19T08:09:12.270471+0000","last_clean":"2024-09-19T08:09:12.270471+0000","last_became_active":"2024-09-19T08:09:11.250745+0000","last_became_peered":"2024-09-19T08:09:11.250745+0000","last_unstale":"2024-09-19T08:09:12.270471+0000","last_undegraded":"2024-09-19T08:09:12.270471+0000","last_fullsized":"2024-09-19T08:09:12.270471+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:16.851230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260162+0000","last_change":"2024-09-19T08:09:11.255211+0000","last_active":"2024-09-19T08:09:12.260162+0000","last_peered":"2024-09-19T08:09:12.260162+0000","last_clean":"2024-09-19T08:09:12.260162+0000","last_became_active":"2024-09-19T08:09:11.254853+0000","last_became_peered":"2024-09-19T08:09:11.254853+0000","last_unstale":"2024-09-19T08:09:12.260162+0000","last_undegraded":"2024-09-19T08:09:12.260162+0000","last_fullsized":"2024-09-19T08:09:12.260162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.497502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.271028+0000","last_change":"2024-09-19T08:09:11.247201+0000","last_active":"2024-09-19T08:09:12.271028+0000","last_peered":"2024-09-19T08:09:12.271028+0000","last_clean":"2024-09-19T08:09:12.271028+0000","last_became_active":"2024-09-19T08:09:11.246854+0000","last_became_peered":"2024-09-19T08:09:11.246854+0000","last_unstale":"2024-09-19T08:09:12.271028+0000","last_undegraded":"2024-09-19T08:09:12.271028+0000","last_fullsized":"2024-09-19T08:09:12.271028+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:19.262849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275258+0000","last_change":"2024-09-19T08:09:09.113754+0000","last_active":"2024-09-19T08:09:12.275258+0000","last_peered":"2024-09-19T08:09:12.275258+0000","last_clean":"2024-09-19T08:09:12.275258+0000","last_became_active":"2024-09-19T08:09:09.113389+0000","last_became_peered":"2024-09-19T08:09:09.113389+0000","last_unstale":"2024-09-19T08:09:12.275258+0000","last_undegraded":"2024-09-19T08:09:12.275258+0000","last_fullsized":"2024-09-19T08:09:12.275258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:45.325895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275007+0000","last_change":"2024-09-19T08:09:11.244625+0000","last_active":"2024-09-19T08:09:12.275007+0000","last_peered":"2024-09-19T08:09:12.275007+0000","last_clean":"2024-09-19T08:09:12.275007+0000","last_became_active":"2024-09-19T08:09:11.244277+0000","last_became_peered":"2024-09-19T08:09:11.244277+0000","last_unstale":"2024-09-19T08:09:12.275007+0000","last_undegraded":"2024-09-19T08:09:12.275007+0000","last_fullsized":"2024-09-19T08:09:12.275007+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:33:34.050343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264206+0000","last_change":"2024-09-19T08:09:09.116735+0000","last_active":"2024-09-19T08:09:12.264206+0000","last_peered":"2024-09-19T08:09:12.264206+0000","last_clean":"2024-09-19T08:09:12.264206+0000","last_became_active":"2024-09-19T08:09:09.116356+0000","last_became_peered":"2024-09-19T08:09:09.116356+0000","last_unstale":"2024-09-19T08:09:12.264206+0000","last_undegraded":"2024-09-19T08:09:12.264206+0000","last_fullsized":"2024-09-19T08:09:12.264206+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:50.952567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259425+0000","last_change":"2024-09-19T08:09:09.113182+0000","last_active":"2024-09-19T08:09:12.259425+0000","last_peered":"2024-09-19T08:09:12.259425+0000","last_clean":"2024-09-19T08:09:12.259425+0000","last_became_active":"2024-09-19T08:09:09.112528+0000","last_became_peered":"2024-09-19T08:09:09.112528+0000","last_unstale":"2024-09-19T08:09:12.259425+0000","last_undegraded":"2024-09-19T08:09:12.259425+0000","last_fullsized":"2024-09-19T08:09:12.259425+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:07.647351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270502+0000","last_change":"2024-09-19T08:09:11.241639+0000","last_active":"2024-09-19T08:09:12.270502+0000","last_peered":"2024-09-19T08:09:12.270502+0000","last_clean":"2024-09-19T08:09:12.270502+0000","last_became_active":"2024-09-19T08:09:11.241308+0000","last_became_peered":"2024-09-19T08:09:11.241308+0000","last_unstale":"2024-09-19T08:09:12.270502+0000","last_undegraded":"2024-09-19T08:09:12.270502+0000","last_fullsized":"2024-09-19T08:09:12.270502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:57.826870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.276709+0000","last_change":"2024-09-19T08:09:09.118334+0000","last_active":"2024-09-19T08:09:12.276709+0000","last_peered":"2024-09-19T08:09:12.276709+0000","last_clean":"2024-09-19T08:09:12.276709+0000","last_became_active":"2024-09-19T08:09:09.118010+0000","last_became_peered":"2024-09-19T08:09:09.118010+0000","last_unstale":"2024-09-19T08:09:12.276709+0000","last_undegraded":"2024-09-19T08:09:12.276709+0000","last_fullsized":"2024-09-19T08:09:12.276709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:51.046598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272762+0000","last_change":"2024-09-19T08:09:11.239990+0000","last_active":"2024-09-19T08:09:12.272762+0000","last_peered":"2024-09-19T08:09:12.272762+0000","last_clean":"2024-09-19T08:09:12.272762+0000","last_became_active":"2024-09-19T08:09:11.239643+0000","last_became_peered":"2024-09-19T08:09:11.239643+0000","last_unstale":"2024-09-19T08:09:12.272762+0000","last_undegraded":"2024-09-19T08:09:12.272762+0000","last_fullsized":"2024-09-19T08:09:12.272762+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:07.078244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264539+0000","last_change":"2024-09-19T08:09:09.114397+0000","last_active":"2024-09-19T08:09:12.264539+0000","last_peered":"2024-09-19T08:09:12.264539+0000","last_clean":"2024-09-19T08:09:12.264539+0000","last_became_active":"2024-09-19T08:09:09.114051+0000","last_became_peered":"2024-09-19T08:09:09.114051+0000","last_unstale":"2024-09-19T08:09:12.264539+0000","last_undegraded":"2024-09-19T08:09:12.264539+0000","last_fullsized":"2024-09-19T08:09:12.264539+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:41.799442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270435+0000","last_change":"2024-09-19T08:09:11.254802+0000","last_active":"2024-09-19T08:09:12.270435+0000","last_peered":"2024-09-19T08:09:12.270435+0000","last_clean":"2024-09-19T08:09:12.270435+0000","last_became_active":"2024-09-19T08:09:11.253869+0000","last_became_peered":"2024-09-19T08:09:11.253869+0000","last_unstale":"2024-09-19T08:09:12.270435+0000","last_undegraded":"2024-09-19T08:09:12.270435+0000","last_fullsized":"2024-09-19T08:09:12.270435+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:00.164834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275404+0000","last_change":"2024-09-19T08:09:09.118585+0000","last_active":"2024-09-19T08:09:12.275404+0000","last_peered":"2024-09-19T08:09:12.275404+0000","last_clean":"2024-09-19T08:09:12.275404+0000","last_became_active":"2024-09-19T08:09:09.118216+0000","last_became_peered":"2024-09-19T08:09:09.118216+0000","last_unstale":"2024-09-19T08:09:12.275404+0000","last_undegraded":"2024-09-19T08:09:12.275404+0000","last_fullsized":"2024-09-19T08:09:12.275404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:41.905746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274037+0000","last_change":"2024-09-19T08:09:11.249835+0000","last_active":"2024-09-19T08:09:12.274037+0000","last_peered":"2024-09-19T08:09:12.274037+0000","last_clean":"2024-09-19T08:09:12.274037+0000","last_became_active":"2024-09-19T08:09:11.249443+0000","last_became_peered":"2024-09-19T08:09:11.249443+0000","last_unstale":"2024-09-19T08:09:12.274037+0000","last_undegraded":"2024-09-19T08:09:12.274037+0000","last_fullsized":"2024-09-19T08:09:12.274037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:06.373126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.279297+0000","last_change":"2024-09-19T08:09:09.242565+0000","last_active":"2024-09-19T08:09:12.279297+0000","last_peered":"2024-09-19T08:09:12.279297+0000","last_clean":"2024-09-19T08:09:12.279297+0000","last_became_active":"2024-09-19T08:09:09.242199+0000","last_became_peered":"2024-09-19T08:09:09.242199+0000","last_unstale":"2024-09-19T08:09:12.279297+0000","last_undegraded":"2024-09-19T08:09:12.279297+0000","last_fullsized":"2024-09-19T08:09:12.279297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:33.195385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270121+0000","last_change":"2024-09-19T08:09:11.251682+0000","last_active":"2024-09-19T08:09:12.270121+0000","last_peered":"2024-09-19T08:09:12.270121+0000","last_clean":"2024-09-19T08:09:12.270121+0000","last_became_active":"2024-09-19T08:09:11.251037+0000","last_became_peered":"2024-09-19T08:09:11.251037+0000","last_unstale":"2024-09-19T08:09:12.270121+0000","last_undegraded":"2024-09-19T08:09:12.270121+0000","last_fullsized":"2024-09-19T08:09:12.270121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:29.518828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'25","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:31.329113+0000","last_change":"2024-09-19T08:09:09.119090+0000","last_active":"2024-09-19T08:09:31.329113+0000","last_peered":"2024-09-19T08:09:31.329113+0000","last_clean":"2024-09-19T08:09:31.329113+0000","last_became_active":"2024-09-19T08:09:09.118685+0000","last_became_peered":"2024-09-19T08:09:09.118685+0000","last_unstale":"2024-09-19T08:09:31.329113+0000","last_undegraded":"2024-09-19T08:09:31.329113+0000","last_fullsized":"2024-09-19T08:09:31.329113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:21.540404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53167,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":67,"num_write":25,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270801+0000","last_change":"2024-09-19T08:09:11.243200+0000","last_active":"2024-09-19T08:09:12.270801+0000","last_peered":"2024-09-19T08:09:12.270801+0000","last_clean":"2024-09-19T08:09:12.270801+0000","last_became_active":"2024-09-19T08:09:11.242873+0000","last_became_peered":"2024-09-19T08:09:11.242873+0000","last_unstale":"2024-09-19T08:09:12.270801+0000","last_undegraded":"2024-09-19T08:09:12.270801+0000","last_fullsized":"2024-09-19T08:09:12.270801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:35.817609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.278392+0000","last_change":"2024-09-19T08:09:09.117117+0000","last_active":"2024-09-19T08:09:12.278392+0000","last_peered":"2024-09-19T08:09:12.278392+0000","last_clean":"2024-09-19T08:09:12.278392+0000","last_became_active":"2024-09-19T08:09:09.116512+0000","last_became_peered":"2024-09-19T08:09:09.116512+0000","last_unstale":"2024-09-19T08:09:12.278392+0000","last_undegraded":"2024-09-19T08:09:12.278392+0000","last_fullsized":"2024-09-19T08:09:12.278392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:15.010570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259483+0000","last_change":"2024-09-19T08:09:11.246648+0000","last_active":"2024-09-19T08:09:12.259483+0000","last_peered":"2024-09-19T08:09:12.259483+0000","last_clean":"2024-09-19T08:09:12.259483+0000","last_became_active":"2024-09-19T08:09:11.246317+0000","last_became_peered":"2024-09-19T08:09:11.246317+0000","last_unstale":"2024-09-19T08:09:12.259483+0000","last_undegraded":"2024-09-19T08:09:12.259483+0000","last_fullsized":"2024-09-19T08:09:12.259483+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:43.285257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274579+0000","last_change":"2024-09-19T08:09:09.112599+0000","last_active":"2024-09-19T08:09:12.274579+0000","last_peered":"2024-09-19T08:09:12.274579+0000","last_clean":"2024-09-19T08:09:12.274579+0000","last_became_active":"2024-09-19T08:09:09.112281+0000","last_became_peered":"2024-09-19T08:09:09.112281+0000","last_unstale":"2024-09-19T08:09:12.274579+0000","last_undegraded":"2024-09-19T08:09:12.274579+0000","last_fullsized":"2024-09-19T08:09:12.274579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:47.710235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274905+0000","last_change":"2024-09-19T08:09:11.253814+0000","last_active":"2024-09-19T08:09:12.274905+0000","last_peered":"2024-09-19T08:09:12.274905+0000","last_clean":"2024-09-19T08:09:12.274905+0000","last_became_active":"2024-09-19T08:09:11.253490+0000","last_became_peered":"2024-09-19T08:09:11.253490+0000","last_unstale":"2024-09-19T08:09:12.274905+0000","last_undegraded":"2024-09-19T08:09:12.274905+0000","last_fullsized":"2024-09-19T08:09:12.274905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:09.287110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272943+0000","last_change":"2024-09-19T08:09:09.114820+0000","last_active":"2024-09-19T08:09:12.272943+0000","last_peered":"2024-09-19T08:09:12.272943+0000","last_clean":"2024-09-19T08:09:12.272943+0000","last_became_active":"2024-09-19T08:09:09.114478+0000","last_became_peered":"2024-09-19T08:09:09.114478+0000","last_unstale":"2024-09-19T08:09:12.272943+0000","last_undegraded":"2024-09-19T08:09:12.272943+0000","last_fullsized":"2024-09-19T08:09:12.272943+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:24.243629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274533+0000","last_change":"2024-09-19T08:09:11.249622+0000","last_active":"2024-09-19T08:09:12.274533+0000","last_peered":"2024-09-19T08:09:12.274533+0000","last_clean":"2024-09-19T08:09:12.274533+0000","last_became_active":"2024-09-19T08:09:11.249325+0000","last_became_peered":"2024-09-19T08:09:11.249325+0000","last_unstale":"2024-09-19T08:09:12.274533+0000","last_undegraded":"2024-09-19T08:09:12.274533+0000","last_fullsized":"2024-09-19T08:09:12.274533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:59.342715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.279583+0000","last_change":"2024-09-19T08:09:09.244136+0000","last_active":"2024-09-19T08:09:12.279583+0000","last_peered":"2024-09-19T08:09:12.279583+0000","last_clean":"2024-09-19T08:09:12.279583+0000","last_became_active":"2024-09-19T08:09:09.243776+0000","last_became_peered":"2024-09-19T08:09:09.243776+0000","last_unstale":"2024-09-19T08:09:12.279583+0000","last_undegraded":"2024-09-19T08:09:12.279583+0000","last_fullsized":"2024-09-19T08:09:12.279583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:01.711310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274220+0000","last_change":"2024-09-19T08:09:11.245399+0000","last_active":"2024-09-19T08:09:12.274220+0000","last_peered":"2024-09-19T08:09:12.274220+0000","last_clean":"2024-09-19T08:09:12.274220+0000","last_became_active":"2024-09-19T08:09:11.245055+0000","last_became_peered":"2024-09-19T08:09:11.245055+0000","last_unstale":"2024-09-19T08:09:12.274220+0000","last_undegraded":"2024-09-19T08:09:12.274220+0000","last_fullsized":"2024-09-19T08:09:12.274220+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:57.639205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275274+0000","last_change":"2024-09-19T08:09:09.115252+0000","last_active":"2024-09-19T08:09:12.275274+0000","last_peered":"2024-09-19T08:09:12.275274+0000","last_clean":"2024-09-19T08:09:12.275274+0000","last_became_active":"2024-09-19T08:09:09.114908+0000","last_became_peered":"2024-09-19T08:09:09.114908+0000","last_unstale":"2024-09-19T08:09:12.275274+0000","last_undegraded":"2024-09-19T08:09:12.275274+0000","last_fullsized":"2024-09-19T08:09:12.275274+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:48.326221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260384+0000","last_change":"2024-09-19T08:09:11.249189+0000","last_active":"2024-09-19T08:09:12.260384+0000","last_peered":"2024-09-19T08:09:12.260384+0000","last_clean":"2024-09-19T08:09:12.260384+0000","last_became_active":"2024-09-19T08:09:11.248797+0000","last_became_peered":"2024-09-19T08:09:11.248797+0000","last_unstale":"2024-09-19T08:09:12.260384+0000","last_undegraded":"2024-09-19T08:09:12.260384+0000","last_fullsized":"2024-09-19T08:09:12.260384+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:20.915638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270335+0000","last_change":"2024-09-19T08:09:09.112973+0000","last_active":"2024-09-19T08:09:12.270335+0000","last_peered":"2024-09-19T08:09:12.270335+0000","last_clean":"2024-09-19T08:09:12.270335+0000","last_became_active":"2024-09-19T08:09:09.112616+0000","last_became_peered":"2024-09-19T08:09:09.112616+0000","last_unstale":"2024-09-19T08:09:12.270335+0000","last_undegraded":"2024-09-19T08:09:12.270335+0000","last_fullsized":"2024-09-19T08:09:12.270335+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:13.791926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275124+0000","last_change":"2024-09-19T08:09:11.240739+0000","last_active":"2024-09-19T08:09:12.275124+0000","last_peered":"2024-09-19T08:09:12.275124+0000","last_clean":"2024-09-19T08:09:12.275124+0000","last_became_active":"2024-09-19T08:09:11.240340+0000","last_became_peered":"2024-09-19T08:09:11.240340+0000","last_unstale":"2024-09-19T08:09:12.275124+0000","last_undegraded":"2024-09-19T08:09:12.275124+0000","last_fullsized":"2024-09-19T08:09:12.275124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:35.450279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.279199+0000","last_change":"2024-09-19T08:09:09.112516+0000","last_active":"2024-09-19T08:09:12.279199+0000","last_peered":"2024-09-19T08:09:12.279199+0000","last_clean":"2024-09-19T08:09:12.279199+0000","last_became_active":"2024-09-19T08:09:09.112140+0000","last_became_peered":"2024-09-19T08:09:09.112140+0000","last_unstale":"2024-09-19T08:09:12.279199+0000","last_undegraded":"2024-09-19T08:09:12.279199+0000","last_fullsized":"2024-09-19T08:09:12.279199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:05.434331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274943+0000","last_change":"2024-09-19T08:09:11.252163+0000","last_active":"2024-09-19T08:09:12.274943+0000","last_peered":"2024-09-19T08:09:12.274943+0000","last_clean":"2024-09-19T08:09:12.274943+0000","last_became_active":"2024-09-19T08:09:11.251762+0000","last_became_peered":"2024-09-19T08:09:11.251762+0000","last_unstale":"2024-09-19T08:09:12.274943+0000","last_undegraded":"2024-09-19T08:09:12.274943+0000","last_fullsized":"2024-09-19T08:09:12.274943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:33.941910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270594+0000","last_change":"2024-09-19T08:09:09.243479+0000","last_active":"2024-09-19T08:09:12.270594+0000","last_peered":"2024-09-19T08:09:12.270594+0000","last_clean":"2024-09-19T08:09:12.270594+0000","last_became_active":"2024-09-19T08:09:09.243064+0000","last_became_peered":"2024-09-19T08:09:09.243064+0000","last_unstale":"2024-09-19T08:09:12.270594+0000","last_undegraded":"2024-09-19T08:09:12.270594+0000","last_fullsized":"2024-09-19T08:09:12.270594+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:58.965426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275301+0000","last_change":"2024-09-19T08:09:11.242438+0000","last_active":"2024-09-19T08:09:12.275301+0000","last_peered":"2024-09-19T08:09:12.275301+0000","last_clean":"2024-09-19T08:09:12.275301+0000","last_became_active":"2024-09-19T08:09:11.242114+0000","last_became_peered":"2024-09-19T08:09:11.242114+0000","last_unstale":"2024-09-19T08:09:12.275301+0000","last_undegraded":"2024-09-19T08:09:12.275301+0000","last_fullsized":"2024-09-19T08:09:12.275301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:54.183012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":341,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274753+0000","last_change":"2024-09-19T08:07:55.287566+0000","last_active":"2024-09-19T08:09:12.274753+0000","last_peered":"2024-09-19T08:09:12.274753+0000","last_clean":"2024-09-19T08:09:12.274753+0000","last_became_active":"2024-09-19T08:07:55.287037+0000","last_became_peered":"2024-09-19T08:07:55.287037+0000","last_unstale":"2024-09-19T08:09:12.274753+0000","last_undegraded":"2024-09-19T08:09:12.274753+0000","last_fullsized":"2024-09-19T08:09:12.274753+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_clean_scrub_stamp":"2024-09-19T08:04:29.468857+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:49.553882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273322+0000","last_change":"2024-09-19T08:09:09.113497+0000","last_active":"2024-09-19T08:09:12.273322+0000","last_peered":"2024-09-19T08:09:12.273322+0000","last_clean":"2024-09-19T08:09:12.273322+0000","last_became_active":"2024-09-19T08:09:09.112546+0000","last_became_peered":"2024-09-19T08:09:09.112546+0000","last_unstale":"2024-09-19T08:09:12.273322+0000","last_undegraded":"2024-09-19T08:09:12.273322+0000","last_fullsized":"2024-09-19T08:09:12.273322+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:09.906476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269847+0000","last_change":"2024-09-19T08:09:11.241478+0000","last_active":"2024-09-19T08:09:12.269847+0000","last_peered":"2024-09-19T08:09:12.269847+0000","last_clean":"2024-09-19T08:09:12.269847+0000","last_became_active":"2024-09-19T08:09:11.241138+0000","last_became_peered":"2024-09-19T08:09:11.241138+0000","last_unstale":"2024-09-19T08:09:12.269847+0000","last_undegraded":"2024-09-19T08:09:12.269847+0000","last_fullsized":"2024-09-19T08:09:12.269847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:32.884491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274978+0000","last_change":"2024-09-19T08:09:09.116571+0000","last_active":"2024-09-19T08:09:12.274978+0000","last_peered":"2024-09-19T08:09:12.274978+0000","last_clean":"2024-09-19T08:09:12.274978+0000","last_became_active":"2024-09-19T08:09:09.116180+0000","last_became_peered":"2024-09-19T08:09:09.116180+0000","last_unstale":"2024-09-19T08:09:12.274978+0000","last_undegraded":"2024-09-19T08:09:12.274978+0000","last_fullsized":"2024-09-19T08:09:12.274978+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:58.577320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259671+0000","last_change":"2024-09-19T08:09:11.254088+0000","last_active":"2024-09-19T08:09:12.259671+0000","last_peered":"2024-09-19T08:09:12.259671+0000","last_clean":"2024-09-19T08:09:12.259671+0000","last_became_active":"2024-09-19T08:09:11.253795+0000","last_became_peered":"2024-09-19T08:09:11.253795+0000","last_unstale":"2024-09-19T08:09:12.259671+0000","last_undegraded":"2024-09-19T08:09:12.259671+0000","last_fullsized":"2024-09-19T08:09:12.259671+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:30.528506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259700+0000","last_change":"2024-09-19T08:09:09.242166+0000","last_active":"2024-09-19T08:09:12.259700+0000","last_peered":"2024-09-19T08:09:12.259700+0000","last_clean":"2024-09-19T08:09:12.259700+0000","last_became_active":"2024-09-19T08:09:09.241270+0000","last_became_peered":"2024-09-19T08:09:09.241270+0000","last_unstale":"2024-09-19T08:09:12.259700+0000","last_undegraded":"2024-09-19T08:09:12.259700+0000","last_fullsized":"2024-09-19T08:09:12.259700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:51.899069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.276508+0000","last_change":"2024-09-19T08:09:11.253778+0000","last_active":"2024-09-19T08:09:12.276508+0000","last_peered":"2024-09-19T08:09:12.276508+0000","last_clean":"2024-09-19T08:09:12.276508+0000","last_became_active":"2024-09-19T08:09:11.252219+0000","last_became_peered":"2024-09-19T08:09:11.252219+0000","last_unstale":"2024-09-19T08:09:12.276508+0000","last_undegraded":"2024-09-19T08:09:12.276508+0000","last_fullsized":"2024-09-19T08:09:12.276508+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:07.205504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275248+0000","last_change":"2024-09-19T08:09:09.118790+0000","last_active":"2024-09-19T08:09:12.275248+0000","last_peered":"2024-09-19T08:09:12.275248+0000","last_clean":"2024-09-19T08:09:12.275248+0000","last_became_active":"2024-09-19T08:09:09.117695+0000","last_became_peered":"2024-09-19T08:09:09.117695+0000","last_unstale":"2024-09-19T08:09:12.275248+0000","last_undegraded":"2024-09-19T08:09:12.275248+0000","last_fullsized":"2024-09-19T08:09:12.275248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:40.674039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264264+0000","last_change":"2024-09-19T08:09:11.249386+0000","last_active":"2024-09-19T08:09:12.264264+0000","last_peered":"2024-09-19T08:09:12.264264+0000","last_clean":"2024-09-19T08:09:12.264264+0000","last_became_active":"2024-09-19T08:09:11.249004+0000","last_became_peered":"2024-09-19T08:09:11.249004+0000","last_unstale":"2024-09-19T08:09:12.264264+0000","last_undegraded":"2024-09-19T08:09:12.264264+0000","last_fullsized":"2024-09-19T08:09:12.264264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:50.170799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272215+0000","last_change":"2024-09-19T08:09:09.241599+0000","last_active":"2024-09-19T08:09:12.272215+0000","last_peered":"2024-09-19T08:09:12.272215+0000","last_clean":"2024-09-19T08:09:12.272215+0000","last_became_active":"2024-09-19T08:09:09.241226+0000","last_became_peered":"2024-09-19T08:09:09.241226+0000","last_unstale":"2024-09-19T08:09:12.272215+0000","last_undegraded":"2024-09-19T08:09:12.272215+0000","last_fullsized":"2024-09-19T08:09:12.272215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:19.590966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264496+0000","last_change":"2024-09-19T08:09:11.238098+0000","last_active":"2024-09-19T08:09:12.264496+0000","last_peered":"2024-09-19T08:09:12.264496+0000","last_clean":"2024-09-19T08:09:12.264496+0000","last_became_active":"2024-09-19T08:09:11.237737+0000","last_became_peered":"2024-09-19T08:09:11.237737+0000","last_unstale":"2024-09-19T08:09:12.264496+0000","last_undegraded":"2024-09-19T08:09:12.264496+0000","last_fullsized":"2024-09-19T08:09:12.264496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:00.134664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272482+0000","last_change":"2024-09-19T08:09:09.241775+0000","last_active":"2024-09-19T08:09:12.272482+0000","last_peered":"2024-09-19T08:09:12.272482+0000","last_clean":"2024-09-19T08:09:12.272482+0000","last_became_active":"2024-09-19T08:09:09.241367+0000","last_became_peered":"2024-09-19T08:09:09.241367+0000","last_unstale":"2024-09-19T08:09:12.272482+0000","last_undegraded":"2024-09-19T08:09:12.272482+0000","last_fullsized":"2024-09-19T08:09:12.272482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:11.862171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259714+0000","last_change":"2024-09-19T08:09:11.251980+0000","last_active":"2024-09-19T08:09:12.259714+0000","last_peered":"2024-09-19T08:09:12.259714+0000","last_clean":"2024-09-19T08:09:12.259714+0000","last_became_active":"2024-09-19T08:09:11.251638+0000","last_became_peered":"2024-09-19T08:09:11.251638+0000","last_unstale":"2024-09-19T08:09:12.259714+0000","last_undegraded":"2024-09-19T08:09:12.259714+0000","last_fullsized":"2024-09-19T08:09:12.259714+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:35.905643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'4","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:25.266650+0000","last_change":"2024-09-19T08:09:09.117150+0000","last_active":"2024-09-19T08:09:25.266650+0000","last_peered":"2024-09-19T08:09:25.266650+0000","last_clean":"2024-09-19T08:09:25.266650+0000","last_became_active":"2024-09-19T08:09:09.116763+0000","last_became_peered":"2024-09-19T08:09:09.116763+0000","last_unstale":"2024-09-19T08:09:25.266650+0000","last_undegraded":"2024-09-19T08:09:25.266650+0000","last_fullsized":"2024-09-19T08:09:25.266650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:18.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270016+0000","last_change":"2024-09-19T08:09:11.244366+0000","last_active":"2024-09-19T08:09:12.270016+0000","last_peered":"2024-09-19T08:09:12.270016+0000","last_clean":"2024-09-19T08:09:12.270016+0000","last_became_active":"2024-09-19T08:09:11.244023+0000","last_became_peered":"2024-09-19T08:09:11.244023+0000","last_unstale":"2024-09-19T08:09:12.270016+0000","last_undegraded":"2024-09-19T08:09:12.270016+0000","last_fullsized":"2024-09-19T08:09:12.270016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:18.572377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275535+0000","last_change":"2024-09-19T08:09:09.139557+0000","last_active":"2024-09-19T08:09:12.275535+0000","last_peered":"2024-09-19T08:09:12.275535+0000","last_clean":"2024-09-19T08:09:12.275535+0000","last_became_active":"2024-09-19T08:09:09.139190+0000","last_became_peered":"2024-09-19T08:09:09.139190+0000","last_unstale":"2024-09-19T08:09:12.275535+0000","last_undegraded":"2024-09-19T08:09:12.275535+0000","last_fullsized":"2024-09-19T08:09:12.275535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:39.270432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273816+0000","last_change":"2024-09-19T08:09:11.249637+0000","last_active":"2024-09-19T08:09:12.273816+0000","last_peered":"2024-09-19T08:09:12.273816+0000","last_clean":"2024-09-19T08:09:12.273816+0000","last_became_active":"2024-09-19T08:09:11.249323+0000","last_became_peered":"2024-09-19T08:09:11.249323+0000","last_unstale":"2024-09-19T08:09:12.273816+0000","last_undegraded":"2024-09-19T08:09:12.273816+0000","last_fullsized":"2024-09-19T08:09:12.273816+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:28.270910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270693+0000","last_change":"2024-09-19T08:09:09.242444+0000","last_active":"2024-09-19T08:09:12.270693+0000","last_peered":"2024-09-19T08:09:12.270693+0000","last_clean":"2024-09-19T08:09:12.270693+0000","last_became_active":"2024-09-19T08:09:09.242095+0000","last_became_peered":"2024-09-19T08:09:09.242095+0000","last_unstale":"2024-09-19T08:09:12.270693+0000","last_undegraded":"2024-09-19T08:09:12.270693+0000","last_fullsized":"2024-09-19T08:09:12.270693+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:42.941930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269950+0000","last_change":"2024-09-19T08:09:11.241588+0000","last_active":"2024-09-19T08:09:12.269950+0000","last_peered":"2024-09-19T08:09:12.269950+0000","last_clean":"2024-09-19T08:09:12.269950+0000","last_became_active":"2024-09-19T08:09:11.241076+0000","last_became_peered":"2024-09-19T08:09:11.241076+0000","last_unstale":"2024-09-19T08:09:12.269950+0000","last_undegraded":"2024-09-19T08:09:12.269950+0000","last_fullsized":"2024-09-19T08:09:12.269950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:01.676410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269706+0000","last_change":"2024-09-19T08:09:09.112494+0000","last_active":"2024-09-19T08:09:12.269706+0000","last_peered":"2024-09-19T08:09:12.269706+0000","last_clean":"2024-09-19T08:09:12.269706+0000","last_became_active":"2024-09-19T08:09:09.112019+0000","last_became_peered":"2024-09-19T08:09:09.112019+0000","last_unstale":"2024-09-19T08:09:12.269706+0000","last_undegraded":"2024-09-19T08:09:12.269706+0000","last_fullsized":"2024-09-19T08:09:12.269706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:17.674092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260305+0000","last_change":"2024-09-19T08:09:11.251420+0000","last_active":"2024-09-19T08:09:12.260305+0000","last_peered":"2024-09-19T08:09:12.260305+0000","last_clean":"2024-09-19T08:09:12.260305+0000","last_became_active":"2024-09-19T08:09:11.251083+0000","last_became_peered":"2024-09-19T08:09:11.251083+0000","last_unstale":"2024-09-19T08:09:12.260305+0000","last_undegraded":"2024-09-19T08:09:12.260305+0000","last_fullsized":"2024-09-19T08:09:12.260305+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:38.810616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272113+0000","last_change":"2024-09-19T08:09:09.117705+0000","last_active":"2024-09-19T08:09:12.272113+0000","last_peered":"2024-09-19T08:09:12.272113+0000","last_clean":"2024-09-19T08:09:12.272113+0000","last_became_active":"2024-09-19T08:09:09.117367+0000","last_became_peered":"2024-09-19T08:09:09.117367+0000","last_unstale":"2024-09-19T08:09:12.272113+0000","last_undegraded":"2024-09-19T08:09:12.272113+0000","last_fullsized":"2024-09-19T08:09:12.272113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:21.256227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269858+0000","last_change":"2024-09-19T08:09:11.239096+0000","last_active":"2024-09-19T08:09:12.269858+0000","last_peered":"2024-09-19T08:09:12.269858+0000","last_clean":"2024-09-19T08:09:12.269858+0000","last_became_active":"2024-09-19T08:09:11.238739+0000","last_became_peered":"2024-09-19T08:09:11.238739+0000","last_unstale":"2024-09-19T08:09:12.269858+0000","last_undegraded":"2024-09-19T08:09:12.269858+0000","last_fullsized":"2024-09-19T08:09:12.269858+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:27.161174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.279086+0000","last_change":"2024-09-19T08:09:09.115198+0000","last_active":"2024-09-19T08:09:12.279086+0000","last_peered":"2024-09-19T08:09:12.279086+0000","last_clean":"2024-09-19T08:09:12.279086+0000","last_became_active":"2024-09-19T08:09:09.114783+0000","last_became_peered":"2024-09-19T08:09:09.114783+0000","last_unstale":"2024-09-19T08:09:12.279086+0000","last_undegraded":"2024-09-19T08:09:12.279086+0000","last_fullsized":"2024-09-19T08:09:12.279086+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:45.674774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274921+0000","last_change":"2024-09-19T08:09:11.252450+0000","last_active":"2024-09-19T08:09:12.274921+0000","last_peered":"2024-09-19T08:09:12.274921+0000","last_clean":"2024-09-19T08:09:12.274921+0000","last_became_active":"2024-09-19T08:09:11.251696+0000","last_became_peered":"2024-09-19T08:09:11.251696+0000","last_unstale":"2024-09-19T08:09:12.274921+0000","last_undegraded":"2024-09-19T08:09:12.274921+0000","last_fullsized":"2024-09-19T08:09:12.274921+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:48.179795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.276254+0000","last_change":"2024-09-19T08:09:11.244571+0000","last_active":"2024-09-19T08:09:12.276254+0000","last_peered":"2024-09-19T08:09:12.276254+0000","last_clean":"2024-09-19T08:09:12.276254+0000","last_became_active":"2024-09-19T08:09:11.244217+0000","last_became_peered":"2024-09-19T08:09:11.244217+0000","last_unstale":"2024-09-19T08:09:12.276254+0000","last_undegraded":"2024-09-19T08:09:12.276254+0000","last_fullsized":"2024-09-19T08:09:12.276254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:52.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275687+0000","last_change":"2024-09-19T08:09:09.117355+0000","last_active":"2024-09-19T08:09:12.275687+0000","last_peered":"2024-09-19T08:09:12.275687+0000","last_clean":"2024-09-19T08:09:12.275687+0000","last_became_active":"2024-09-19T08:09:09.116806+0000","last_became_peered":"2024-09-19T08:09:09.116806+0000","last_unstale":"2024-09-19T08:09:12.275687+0000","last_undegraded":"2024-09-19T08:09:12.275687+0000","last_fullsized":"2024-09-19T08:09:12.275687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:42.113015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269943+0000","last_change":"2024-09-19T08:09:11.245745+0000","last_active":"2024-09-19T08:09:12.269943+0000","last_peered":"2024-09-19T08:09:12.269943+0000","last_clean":"2024-09-19T08:09:12.269943+0000","last_became_active":"2024-09-19T08:09:11.245373+0000","last_became_peered":"2024-09-19T08:09:11.245373+0000","last_unstale":"2024-09-19T08:09:12.269943+0000","last_undegraded":"2024-09-19T08:09:12.269943+0000","last_fullsized":"2024-09-19T08:09:12.269943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:56.500738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.278897+0000","last_change":"2024-09-19T08:09:09.119550+0000","last_active":"2024-09-19T08:09:12.278897+0000","last_peered":"2024-09-19T08:09:12.278897+0000","last_clean":"2024-09-19T08:09:12.278897+0000","last_became_active":"2024-09-19T08:09:09.119187+0000","last_became_peered":"2024-09-19T08:09:09.119187+0000","last_unstale":"2024-09-19T08:09:12.278897+0000","last_undegraded":"2024-09-19T08:09:12.278897+0000","last_fullsized":"2024-09-19T08:09:12.278897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:14.629824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274031+0000","last_change":"2024-09-19T08:09:11.245318+0000","last_active":"2024-09-19T08:09:12.274031+0000","last_peered":"2024-09-19T08:09:12.274031+0000","last_clean":"2024-09-19T08:09:12.274031+0000","last_became_active":"2024-09-19T08:09:11.245000+0000","last_became_peered":"2024-09-19T08:09:11.245000+0000","last_unstale":"2024-09-19T08:09:12.274031+0000","last_undegraded":"2024-09-19T08:09:12.274031+0000","last_fullsized":"2024-09-19T08:09:12.274031+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:53.590453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270460+0000","last_change":"2024-09-19T08:09:09.241552+0000","last_active":"2024-09-19T08:09:12.270460+0000","last_peered":"2024-09-19T08:09:12.270460+0000","last_clean":"2024-09-19T08:09:12.270460+0000","last_became_active":"2024-09-19T08:09:09.241201+0000","last_became_peered":"2024-09-19T08:09:09.241201+0000","last_unstale":"2024-09-19T08:09:12.270460+0000","last_undegraded":"2024-09-19T08:09:12.270460+0000","last_fullsized":"2024-09-19T08:09:12.270460+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:09.374532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270213+0000","last_change":"2024-09-19T08:09:11.246697+0000","last_active":"2024-09-19T08:09:12.270213+0000","last_peered":"2024-09-19T08:09:12.270213+0000","last_clean":"2024-09-19T08:09:12.270213+0000","last_became_active":"2024-09-19T08:09:11.246404+0000","last_became_peered":"2024-09-19T08:09:11.246404+0000","last_unstale":"2024-09-19T08:09:12.270213+0000","last_undegraded":"2024-09-19T08:09:12.270213+0000","last_fullsized":"2024-09-19T08:09:12.270213+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.008875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.278644+0000","last_change":"2024-09-19T08:09:09.113401+0000","last_active":"2024-09-19T08:09:12.278644+0000","last_peered":"2024-09-19T08:09:12.278644+0000","last_clean":"2024-09-19T08:09:12.278644+0000","last_became_active":"2024-09-19T08:09:09.113026+0000","last_became_peered":"2024-09-19T08:09:09.113026+0000","last_unstale":"2024-09-19T08:09:12.278644+0000","last_undegraded":"2024-09-19T08:09:12.278644+0000","last_fullsized":"2024-09-19T08:09:12.278644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:54.740955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53965,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":38,"num_read_kb":73,"num_write":70,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":149793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281686,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547217,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":868352,"data_stored":419022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":1062868,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939675,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":419604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168608,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":876544,"data_stored":419626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397541,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":1010089,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561066,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":419139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789999,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":1009689,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953525,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":872448,"data_stored":419044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":419360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":446003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":472189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":872448,"data_stored":419112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":53167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":41099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":53361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:09:35.447 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:09:35.705 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:35.952 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:35 smithi027 ceph-mon[31209]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:09:35.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:35 smithi155 ceph-mon[35362]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:09:36.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:35 smithi203 ceph-mon[35198]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:09:36.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.176+0000 7f65c7ff1640 1 -- 172.21.15.27:0/1420035316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65c0102d40 msgr2=0x7f65c0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:36.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.176+0000 7f65c7ff1640 1 --2- 172.21.15.27:0/1420035316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65c0102d40 0x7f65c0103120 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009900 tx=0x7f65bc02a480 comp rx=0 tx=0).stop 2024-09-19T08:09:36.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.176+0000 7f65c7ff1640 1 -- 172.21.15.27:0/1420035316 shutdown_connections 2024-09-19T08:09:36.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.176+0000 7f65c7ff1640 1 --2- 172.21.15.27:0/1420035316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65c010c170 0x7f65c010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:36.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.176+0000 7f65c7ff1640 1 --2- 172.21.15.27:0/1420035316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65c0103660 0x7f65c010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:36.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.176+0000 7f65c7ff1640 1 --2- 172.21.15.27:0/1420035316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65c0102d40 0x7f65c0103120 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:36.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.176+0000 7f65c7ff1640 1 -- 172.21.15.27:0/1420035316 >> 172.21.15.27:0/1420035316 conn(0x7f65c00fc7a0 msgr2=0x7f65c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:36.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.176+0000 7f65c7ff1640 1 -- 172.21.15.27:0/1420035316 shutdown_connections 2024-09-19T08:09:36.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.176+0000 7f65c7ff1640 1 -- 172.21.15.27:0/1420035316 wait complete. 2024-09-19T08:09:36.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.177+0000 7f65c7ff1640 1 Processor -- start 2024-09-19T08:09:36.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.177+0000 7f65c7ff1640 1 -- start start 2024-09-19T08:09:36.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.177+0000 7f65c7ff1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65c0102d40 0x7f65c01984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:36.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.177+0000 7f65c7ff1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65c0103660 0x7f65c01989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:36.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.177+0000 7f65c7ff1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65c010c170 0x7f65c019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:36.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.177+0000 7f65c7ff1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f65c0112000 con 0x7f65c010c170 2024-09-19T08:09:36.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.177+0000 7f65c7ff1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f65c0111e80 con 0x7f65c0102d40 2024-09-19T08:09:36.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.177+0000 7f65c7ff1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f65c0112180 con 0x7f65c0103660 2024-09-19T08:09:36.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.177+0000 7f65c658e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65c010c170 0x7f65c019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:36.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.177+0000 7f65c658e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65c010c170 0x7f65c019cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33454/0 (socket says 172.21.15.27:33454) 2024-09-19T08:09:36.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.177+0000 7f65c658e640 1 -- 172.21.15.27:0/2721940405 learned_addr learned my addr 172.21.15.27:0/2721940405 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:36.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.177+0000 7f65c5d8d640 1 --2- 172.21.15.27:0/2721940405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65c0102d40 0x7f65c01984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:36.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.177+0000 7f65c558c640 1 --2- 172.21.15.27:0/2721940405 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65c0103660 0x7f65c01989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:36.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.178+0000 7f65c658e640 1 -- 172.21.15.27:0/2721940405 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65c0103660 msgr2=0x7f65c01989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:36.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.178+0000 7f65c658e640 1 --2- 172.21.15.27:0/2721940405 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65c0103660 0x7f65c01989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:36.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.178+0000 7f65c658e640 1 -- 172.21.15.27:0/2721940405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65c0102d40 msgr2=0x7f65c01984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:36.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.178+0000 7f65c658e640 1 --2- 172.21.15.27:0/2721940405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65c0102d40 0x7f65c01984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:36.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.178+0000 7f65c658e640 1 -- 172.21.15.27:0/2721940405 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c019d450 con 0x7f65c010c170 2024-09-19T08:09:36.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.178+0000 7f65c558c640 1 --2- 172.21.15.27:0/2721940405 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65c0103660 0x7f65c01989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:09:36.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.178+0000 7f65c658e640 1 --2- 172.21.15.27:0/2721940405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65c010c170 0x7f65c019cd70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f65b800eaa0 tx=0x7f65b800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:36.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.178+0000 7f65b6ffd640 1 -- 172.21.15.27:0/2721940405 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b800cdb0 con 0x7f65c010c170 2024-09-19T08:09:36.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.178+0000 7f65b6ffd640 1 -- 172.21.15.27:0/2721940405 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65b8005020 con 0x7f65c010c170 2024-09-19T08:09:36.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.178+0000 7f65c7ff1640 1 -- 172.21.15.27:0/2721940405 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65c019d740 con 0x7f65c010c170 2024-09-19T08:09:36.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.178+0000 7f65b6ffd640 1 -- 172.21.15.27:0/2721940405 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b80116b0 con 0x7f65c010c170 2024-09-19T08:09:36.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.178+0000 7f65c7ff1640 1 -- 172.21.15.27:0/2721940405 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65c01a5020 con 0x7f65c010c170 2024-09-19T08:09:36.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.179+0000 7f65c7ff1640 1 -- 172.21.15.27:0/2721940405 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65c0103120 con 0x7f65c010c170 2024-09-19T08:09:36.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.180+0000 7f65b6ffd640 1 -- 172.21.15.27:0/2721940405 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f65b8005560 con 0x7f65c010c170 2024-09-19T08:09:36.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.181+0000 7f65b6ffd640 1 --2- 172.21.15.27:0/2721940405 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f65ac0a3350 0x7f65ac0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:36.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.181+0000 7f65c5d8d640 1 --2- 172.21.15.27:0/2721940405 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f65ac0a3350 0x7f65ac0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:36.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.181+0000 7f65b6ffd640 1 -- 172.21.15.27:0/2721940405 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f65b80cfb10 con 0x7f65c010c170 2024-09-19T08:09:36.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.181+0000 7f65c5d8d640 1 --2- 172.21.15.27:0/2721940405 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f65ac0a3350 0x7f65ac0a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f65bc000c00 tx=0x7f65bc005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:36.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.185+0000 7f65b6ffd640 1 -- 172.21.15.27:0/2721940405 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f65b8016030 con 0x7f65c010c170 2024-09-19T08:09:36.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.357+0000 7f65c7ff1640 1 -- 172.21.15.27:0/2721940405 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f65c0062630 con 0x7f65ac0a3350 2024-09-19T08:09:36.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.364+0000 7f65b6ffd640 1 -- 172.21.15.27:0/2721940405 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258791 (secure 0 0 0) 0x7f65c0062630 con 0x7f65ac0a3350 2024-09-19T08:09:36.366 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:09:36.367 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-09-19T08:09:36.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.367+0000 7f65c7ff1640 1 -- 172.21.15.27:0/2721940405 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f65ac0a3350 msgr2=0x7f65ac0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:36.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.367+0000 7f65c7ff1640 1 --2- 172.21.15.27:0/2721940405 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f65ac0a3350 0x7f65ac0a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f65bc000c00 tx=0x7f65bc005b50 comp rx=0 tx=0).stop 2024-09-19T08:09:36.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.367+0000 7f65c7ff1640 1 -- 172.21.15.27:0/2721940405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65c010c170 msgr2=0x7f65c019cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:36.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.367+0000 7f65c7ff1640 1 --2- 172.21.15.27:0/2721940405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65c010c170 0x7f65c019cd70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f65b800eaa0 tx=0x7f65b800ef60 comp rx=0 tx=0).stop 2024-09-19T08:09:36.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.367+0000 7f65c7ff1640 1 -- 172.21.15.27:0/2721940405 shutdown_connections 2024-09-19T08:09:36.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.367+0000 7f65c7ff1640 1 --2- 172.21.15.27:0/2721940405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65c010c170 0x7f65c019cd70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:36.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.367+0000 7f65c7ff1640 1 --2- 172.21.15.27:0/2721940405 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65c0103660 0x7f65c01989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:36.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.367+0000 7f65c7ff1640 1 --2- 172.21.15.27:0/2721940405 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f65ac0a3350 0x7f65ac0a5810 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:36.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.367+0000 7f65c7ff1640 1 --2- 172.21.15.27:0/2721940405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65c0102d40 0x7f65c01984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:36.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.367+0000 7f65c7ff1640 1 -- 172.21.15.27:0/2721940405 >> 172.21.15.27:0/2721940405 conn(0x7f65c00fc7a0 msgr2=0x7f65c00fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:36.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.367+0000 7f65c7ff1640 1 -- 172.21.15.27:0/2721940405 shutdown_connections 2024-09-19T08:09:36.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:36.367+0000 7f65c7ff1640 1 -- 172.21.15.27:0/2721940405 wait complete. 2024-09-19T08:09:36.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:36 smithi155 ceph-mon[35362]: pgmap v292: 97 pgs: 97 active+clean; 629 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 5.2 KiB/s wr, 4 op/s 2024-09-19T08:09:37.001 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:36 smithi027 ceph-mon[31209]: pgmap v292: 97 pgs: 97 active+clean; 629 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 5.2 KiB/s wr, 4 op/s 2024-09-19T08:09:37.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:36 smithi203 ceph-mon[35198]: pgmap v292: 97 pgs: 97 active+clean; 629 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 5.2 KiB/s wr, 4 op/s 2024-09-19T08:09:37.100 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-19T08:09:34.913434+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644567,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":174,"num_read_kb":192,"num_write":258,"num_write_kb":3015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355692,"kb_used_data":10584,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124586132,"statfs":{"total":1151940427776,"available":1151576199168,"internally_reserved":0,"allocated":10838016,"data_stored":6961965,"data_compressed":107475,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51789,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":64,"num_write":32,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002861"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260466+0000","last_change":"2024-09-19T08:09:11.246436+0000","last_active":"2024-09-19T08:09:12.260466+0000","last_peered":"2024-09-19T08:09:12.260466+0000","last_clean":"2024-09-19T08:09:12.260466+0000","last_became_active":"2024-09-19T08:09:11.245674+0000","last_became_peered":"2024-09-19T08:09:11.245674+0000","last_unstale":"2024-09-19T08:09:12.260466+0000","last_undegraded":"2024-09-19T08:09:12.260466+0000","last_fullsized":"2024-09-19T08:09:12.260466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:46.716474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273550+0000","last_change":"2024-09-19T08:09:11.243334+0000","last_active":"2024-09-19T08:09:12.273550+0000","last_peered":"2024-09-19T08:09:12.273550+0000","last_clean":"2024-09-19T08:09:12.273550+0000","last_became_active":"2024-09-19T08:09:11.243024+0000","last_became_peered":"2024-09-19T08:09:11.243024+0000","last_unstale":"2024-09-19T08:09:12.273550+0000","last_undegraded":"2024-09-19T08:09:12.273550+0000","last_fullsized":"2024-09-19T08:09:12.273550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.060068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273553+0000","last_change":"2024-09-19T08:09:11.254655+0000","last_active":"2024-09-19T08:09:12.273553+0000","last_peered":"2024-09-19T08:09:12.273553+0000","last_clean":"2024-09-19T08:09:12.273553+0000","last_became_active":"2024-09-19T08:09:11.254292+0000","last_became_peered":"2024-09-19T08:09:11.254292+0000","last_unstale":"2024-09-19T08:09:12.273553+0000","last_undegraded":"2024-09-19T08:09:12.273553+0000","last_fullsized":"2024-09-19T08:09:12.273553+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:01.977743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273130+0000","last_change":"2024-09-19T08:09:11.257029+0000","last_active":"2024-09-19T08:09:12.273130+0000","last_peered":"2024-09-19T08:09:12.273130+0000","last_clean":"2024-09-19T08:09:12.273130+0000","last_became_active":"2024-09-19T08:09:11.256669+0000","last_became_peered":"2024-09-19T08:09:11.256669+0000","last_unstale":"2024-09-19T08:09:12.273130+0000","last_undegraded":"2024-09-19T08:09:12.273130+0000","last_fullsized":"2024-09-19T08:09:12.273130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:32.831036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270384+0000","last_change":"2024-09-19T08:09:11.240341+0000","last_active":"2024-09-19T08:09:12.270384+0000","last_peered":"2024-09-19T08:09:12.270384+0000","last_clean":"2024-09-19T08:09:12.270384+0000","last_became_active":"2024-09-19T08:09:11.239996+0000","last_became_peered":"2024-09-19T08:09:11.239996+0000","last_unstale":"2024-09-19T08:09:12.270384+0000","last_undegraded":"2024-09-19T08:09:12.270384+0000","last_fullsized":"2024-09-19T08:09:12.270384+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:20.331791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264127+0000","last_change":"2024-09-19T08:09:11.248089+0000","last_active":"2024-09-19T08:09:12.264127+0000","last_peered":"2024-09-19T08:09:12.264127+0000","last_clean":"2024-09-19T08:09:12.264127+0000","last_became_active":"2024-09-19T08:09:11.247802+0000","last_became_peered":"2024-09-19T08:09:11.247802+0000","last_unstale":"2024-09-19T08:09:12.264127+0000","last_undegraded":"2024-09-19T08:09:12.264127+0000","last_fullsized":"2024-09-19T08:09:12.264127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.249119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274640+0000","last_change":"2024-09-19T08:09:11.246853+0000","last_active":"2024-09-19T08:09:12.274640+0000","last_peered":"2024-09-19T08:09:12.274640+0000","last_clean":"2024-09-19T08:09:12.274640+0000","last_became_active":"2024-09-19T08:09:11.246523+0000","last_became_peered":"2024-09-19T08:09:11.246523+0000","last_unstale":"2024-09-19T08:09:12.274640+0000","last_undegraded":"2024-09-19T08:09:12.274640+0000","last_fullsized":"2024-09-19T08:09:12.274640+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:54.879087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269828+0000","last_change":"2024-09-19T08:09:11.232588+0000","last_active":"2024-09-19T08:09:12.269828+0000","last_peered":"2024-09-19T08:09:12.269828+0000","last_clean":"2024-09-19T08:09:12.269828+0000","last_became_active":"2024-09-19T08:09:11.232251+0000","last_became_peered":"2024-09-19T08:09:11.232251+0000","last_unstale":"2024-09-19T08:09:12.269828+0000","last_undegraded":"2024-09-19T08:09:12.269828+0000","last_fullsized":"2024-09-19T08:09:12.269828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:57.622086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270505+0000","last_change":"2024-09-19T08:09:11.248854+0000","last_active":"2024-09-19T08:09:12.270505+0000","last_peered":"2024-09-19T08:09:12.270505+0000","last_clean":"2024-09-19T08:09:12.270505+0000","last_became_active":"2024-09-19T08:09:11.248524+0000","last_became_peered":"2024-09-19T08:09:11.248524+0000","last_unstale":"2024-09-19T08:09:12.270505+0000","last_undegraded":"2024-09-19T08:09:12.270505+0000","last_fullsized":"2024-09-19T08:09:12.270505+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:57.978974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264615+0000","last_change":"2024-09-19T08:09:11.247407+0000","last_active":"2024-09-19T08:09:12.264615+0000","last_peered":"2024-09-19T08:09:12.264615+0000","last_clean":"2024-09-19T08:09:12.264615+0000","last_became_active":"2024-09-19T08:09:11.247093+0000","last_became_peered":"2024-09-19T08:09:11.247093+0000","last_unstale":"2024-09-19T08:09:12.264615+0000","last_undegraded":"2024-09-19T08:09:12.264615+0000","last_fullsized":"2024-09-19T08:09:12.264615+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:25.959852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275097+0000","last_change":"2024-09-19T08:09:11.247604+0000","last_active":"2024-09-19T08:09:12.275097+0000","last_peered":"2024-09-19T08:09:12.275097+0000","last_clean":"2024-09-19T08:09:12.275097+0000","last_became_active":"2024-09-19T08:09:11.247264+0000","last_became_peered":"2024-09-19T08:09:11.247264+0000","last_unstale":"2024-09-19T08:09:12.275097+0000","last_undegraded":"2024-09-19T08:09:12.275097+0000","last_fullsized":"2024-09-19T08:09:12.275097+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:15.315022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273289+0000","last_change":"2024-09-19T08:09:11.253948+0000","last_active":"2024-09-19T08:09:12.273289+0000","last_peered":"2024-09-19T08:09:12.273289+0000","last_clean":"2024-09-19T08:09:12.273289+0000","last_became_active":"2024-09-19T08:09:11.253402+0000","last_became_peered":"2024-09-19T08:09:11.253402+0000","last_unstale":"2024-09-19T08:09:12.273289+0000","last_undegraded":"2024-09-19T08:09:12.273289+0000","last_fullsized":"2024-09-19T08:09:12.273289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:04.884541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259928+0000","last_change":"2024-09-19T08:09:11.241770+0000","last_active":"2024-09-19T08:09:12.259928+0000","last_peered":"2024-09-19T08:09:12.259928+0000","last_clean":"2024-09-19T08:09:12.259928+0000","last_became_active":"2024-09-19T08:09:11.241356+0000","last_became_peered":"2024-09-19T08:09:11.241356+0000","last_unstale":"2024-09-19T08:09:12.259928+0000","last_undegraded":"2024-09-19T08:09:12.259928+0000","last_fullsized":"2024-09-19T08:09:12.259928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:02.722445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272890+0000","last_change":"2024-09-19T08:09:11.242874+0000","last_active":"2024-09-19T08:09:12.272890+0000","last_peered":"2024-09-19T08:09:12.272890+0000","last_clean":"2024-09-19T08:09:12.272890+0000","last_became_active":"2024-09-19T08:09:11.242383+0000","last_became_peered":"2024-09-19T08:09:11.242383+0000","last_unstale":"2024-09-19T08:09:12.272890+0000","last_undegraded":"2024-09-19T08:09:12.272890+0000","last_fullsized":"2024-09-19T08:09:12.272890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:51.900211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272762+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:09:12.272762+0000","last_peered":"2024-09-19T08:09:12.272762+0000","last_clean":"2024-09-19T08:09:12.272762+0000","last_became_active":"2024-09-19T08:09:11.250797+0000","last_became_peered":"2024-09-19T08:09:11.250797+0000","last_unstale":"2024-09-19T08:09:12.272762+0000","last_undegraded":"2024-09-19T08:09:12.272762+0000","last_fullsized":"2024-09-19T08:09:12.272762+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:46.183857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269901+0000","last_change":"2024-09-19T08:09:11.250884+0000","last_active":"2024-09-19T08:09:12.269901+0000","last_peered":"2024-09-19T08:09:12.269901+0000","last_clean":"2024-09-19T08:09:12.269901+0000","last_became_active":"2024-09-19T08:09:11.250543+0000","last_became_peered":"2024-09-19T08:09:11.250543+0000","last_unstale":"2024-09-19T08:09:12.269901+0000","last_undegraded":"2024-09-19T08:09:12.269901+0000","last_fullsized":"2024-09-19T08:09:12.269901+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.259466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260519+0000","last_change":"2024-09-19T08:09:11.246705+0000","last_active":"2024-09-19T08:09:12.260519+0000","last_peered":"2024-09-19T08:09:12.260519+0000","last_clean":"2024-09-19T08:09:12.260519+0000","last_became_active":"2024-09-19T08:09:11.246117+0000","last_became_peered":"2024-09-19T08:09:11.246117+0000","last_unstale":"2024-09-19T08:09:12.260519+0000","last_undegraded":"2024-09-19T08:09:12.260519+0000","last_fullsized":"2024-09-19T08:09:12.260519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:07.421222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272544+0000","last_change":"2024-09-19T08:09:11.242181+0000","last_active":"2024-09-19T08:09:12.272544+0000","last_peered":"2024-09-19T08:09:12.272544+0000","last_clean":"2024-09-19T08:09:12.272544+0000","last_became_active":"2024-09-19T08:09:11.241882+0000","last_became_peered":"2024-09-19T08:09:11.241882+0000","last_unstale":"2024-09-19T08:09:12.272544+0000","last_undegraded":"2024-09-19T08:09:12.272544+0000","last_fullsized":"2024-09-19T08:09:12.272544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:35.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270253+0000","last_change":"2024-09-19T08:09:11.246038+0000","last_active":"2024-09-19T08:09:12.270253+0000","last_peered":"2024-09-19T08:09:12.270253+0000","last_clean":"2024-09-19T08:09:12.270253+0000","last_became_active":"2024-09-19T08:09:11.245554+0000","last_became_peered":"2024-09-19T08:09:11.245554+0000","last_unstale":"2024-09-19T08:09:12.270253+0000","last_undegraded":"2024-09-19T08:09:12.270253+0000","last_fullsized":"2024-09-19T08:09:12.270253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:14.512425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260222+0000","last_change":"2024-09-19T08:09:11.249246+0000","last_active":"2024-09-19T08:09:12.260222+0000","last_peered":"2024-09-19T08:09:12.260222+0000","last_clean":"2024-09-19T08:09:12.260222+0000","last_became_active":"2024-09-19T08:09:11.248896+0000","last_became_peered":"2024-09-19T08:09:11.248896+0000","last_unstale":"2024-09-19T08:09:12.260222+0000","last_undegraded":"2024-09-19T08:09:12.260222+0000","last_fullsized":"2024-09-19T08:09:12.260222+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:40.406924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259965+0000","last_change":"2024-09-19T08:09:11.245421+0000","last_active":"2024-09-19T08:09:12.259965+0000","last_peered":"2024-09-19T08:09:12.259965+0000","last_clean":"2024-09-19T08:09:12.259965+0000","last_became_active":"2024-09-19T08:09:11.245071+0000","last_became_peered":"2024-09-19T08:09:11.245071+0000","last_unstale":"2024-09-19T08:09:12.259965+0000","last_undegraded":"2024-09-19T08:09:12.259965+0000","last_fullsized":"2024-09-19T08:09:12.259965+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:58.594399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270143+0000","last_change":"2024-09-19T08:09:11.246097+0000","last_active":"2024-09-19T08:09:12.270143+0000","last_peered":"2024-09-19T08:09:12.270143+0000","last_clean":"2024-09-19T08:09:12.270143+0000","last_became_active":"2024-09-19T08:09:11.245741+0000","last_became_peered":"2024-09-19T08:09:11.245741+0000","last_unstale":"2024-09-19T08:09:12.270143+0000","last_undegraded":"2024-09-19T08:09:12.270143+0000","last_fullsized":"2024-09-19T08:09:12.270143+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:05.731148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269658+0000","last_change":"2024-09-19T08:09:11.251485+0000","last_active":"2024-09-19T08:09:12.269658+0000","last_peered":"2024-09-19T08:09:12.269658+0000","last_clean":"2024-09-19T08:09:12.269658+0000","last_became_active":"2024-09-19T08:09:11.251151+0000","last_became_peered":"2024-09-19T08:09:11.251151+0000","last_unstale":"2024-09-19T08:09:12.269658+0000","last_undegraded":"2024-09-19T08:09:12.269658+0000","last_fullsized":"2024-09-19T08:09:12.269658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:47.231056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275099+0000","last_change":"2024-09-19T08:09:11.234490+0000","last_active":"2024-09-19T08:09:12.275099+0000","last_peered":"2024-09-19T08:09:12.275099+0000","last_clean":"2024-09-19T08:09:12.275099+0000","last_became_active":"2024-09-19T08:09:11.234163+0000","last_became_peered":"2024-09-19T08:09:11.234163+0000","last_unstale":"2024-09-19T08:09:12.275099+0000","last_undegraded":"2024-09-19T08:09:12.275099+0000","last_fullsized":"2024-09-19T08:09:12.275099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.610165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270016+0000","last_change":"2024-09-19T08:09:11.247189+0000","last_active":"2024-09-19T08:09:12.270016+0000","last_peered":"2024-09-19T08:09:12.270016+0000","last_clean":"2024-09-19T08:09:12.270016+0000","last_became_active":"2024-09-19T08:09:11.246844+0000","last_became_peered":"2024-09-19T08:09:11.246844+0000","last_unstale":"2024-09-19T08:09:12.270016+0000","last_undegraded":"2024-09-19T08:09:12.270016+0000","last_fullsized":"2024-09-19T08:09:12.270016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:50.764694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273859+0000","last_change":"2024-09-19T08:09:11.251655+0000","last_active":"2024-09-19T08:09:12.273859+0000","last_peered":"2024-09-19T08:09:12.273859+0000","last_clean":"2024-09-19T08:09:12.273859+0000","last_became_active":"2024-09-19T08:09:11.250930+0000","last_became_peered":"2024-09-19T08:09:11.250930+0000","last_unstale":"2024-09-19T08:09:12.273859+0000","last_undegraded":"2024-09-19T08:09:12.273859+0000","last_fullsized":"2024-09-19T08:09:12.273859+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:17.658277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260441+0000","last_change":"2024-09-19T08:09:11.248095+0000","last_active":"2024-09-19T08:09:12.260441+0000","last_peered":"2024-09-19T08:09:12.260441+0000","last_clean":"2024-09-19T08:09:12.260441+0000","last_became_active":"2024-09-19T08:09:11.247719+0000","last_became_peered":"2024-09-19T08:09:11.247719+0000","last_unstale":"2024-09-19T08:09:12.260441+0000","last_undegraded":"2024-09-19T08:09:12.260441+0000","last_fullsized":"2024-09-19T08:09:12.260441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:26.701140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259653+0000","last_change":"2024-09-19T08:09:11.243232+0000","last_active":"2024-09-19T08:09:12.259653+0000","last_peered":"2024-09-19T08:09:12.259653+0000","last_clean":"2024-09-19T08:09:12.259653+0000","last_became_active":"2024-09-19T08:09:11.242927+0000","last_became_peered":"2024-09-19T08:09:11.242927+0000","last_unstale":"2024-09-19T08:09:12.259653+0000","last_undegraded":"2024-09-19T08:09:12.259653+0000","last_fullsized":"2024-09-19T08:09:12.259653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:19.877520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273190+0000","last_change":"2024-09-19T08:09:11.249588+0000","last_active":"2024-09-19T08:09:12.273190+0000","last_peered":"2024-09-19T08:09:12.273190+0000","last_clean":"2024-09-19T08:09:12.273190+0000","last_became_active":"2024-09-19T08:09:11.249266+0000","last_became_peered":"2024-09-19T08:09:11.249266+0000","last_unstale":"2024-09-19T08:09:12.273190+0000","last_undegraded":"2024-09-19T08:09:12.273190+0000","last_fullsized":"2024-09-19T08:09:12.273190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:43.332454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272135+0000","last_change":"2024-09-19T08:09:11.245866+0000","last_active":"2024-09-19T08:09:12.272135+0000","last_peered":"2024-09-19T08:09:12.272135+0000","last_clean":"2024-09-19T08:09:12.272135+0000","last_became_active":"2024-09-19T08:09:11.245505+0000","last_became_peered":"2024-09-19T08:09:11.245505+0000","last_unstale":"2024-09-19T08:09:12.272135+0000","last_undegraded":"2024-09-19T08:09:12.272135+0000","last_fullsized":"2024-09-19T08:09:12.272135+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:38.203790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270471+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:09:12.270471+0000","last_peered":"2024-09-19T08:09:12.270471+0000","last_clean":"2024-09-19T08:09:12.270471+0000","last_became_active":"2024-09-19T08:09:11.250745+0000","last_became_peered":"2024-09-19T08:09:11.250745+0000","last_unstale":"2024-09-19T08:09:12.270471+0000","last_undegraded":"2024-09-19T08:09:12.270471+0000","last_fullsized":"2024-09-19T08:09:12.270471+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:16.851230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260162+0000","last_change":"2024-09-19T08:09:11.255211+0000","last_active":"2024-09-19T08:09:12.260162+0000","last_peered":"2024-09-19T08:09:12.260162+0000","last_clean":"2024-09-19T08:09:12.260162+0000","last_became_active":"2024-09-19T08:09:11.254853+0000","last_became_peered":"2024-09-19T08:09:11.254853+0000","last_unstale":"2024-09-19T08:09:12.260162+0000","last_undegraded":"2024-09-19T08:09:12.260162+0000","last_fullsized":"2024-09-19T08:09:12.260162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.497502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.271028+0000","last_change":"2024-09-19T08:09:11.247201+0000","last_active":"2024-09-19T08:09:12.271028+0000","last_peered":"2024-09-19T08:09:12.271028+0000","last_clean":"2024-09-19T08:09:12.271028+0000","last_became_active":"2024-09-19T08:09:11.246854+0000","last_became_peered":"2024-09-19T08:09:11.246854+0000","last_unstale":"2024-09-19T08:09:12.271028+0000","last_undegraded":"2024-09-19T08:09:12.271028+0000","last_fullsized":"2024-09-19T08:09:12.271028+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:19.262849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275258+0000","last_change":"2024-09-19T08:09:09.113754+0000","last_active":"2024-09-19T08:09:12.275258+0000","last_peered":"2024-09-19T08:09:12.275258+0000","last_clean":"2024-09-19T08:09:12.275258+0000","last_became_active":"2024-09-19T08:09:09.113389+0000","last_became_peered":"2024-09-19T08:09:09.113389+0000","last_unstale":"2024-09-19T08:09:12.275258+0000","last_undegraded":"2024-09-19T08:09:12.275258+0000","last_fullsized":"2024-09-19T08:09:12.275258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:45.325895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275007+0000","last_change":"2024-09-19T08:09:11.244625+0000","last_active":"2024-09-19T08:09:12.275007+0000","last_peered":"2024-09-19T08:09:12.275007+0000","last_clean":"2024-09-19T08:09:12.275007+0000","last_became_active":"2024-09-19T08:09:11.244277+0000","last_became_peered":"2024-09-19T08:09:11.244277+0000","last_unstale":"2024-09-19T08:09:12.275007+0000","last_undegraded":"2024-09-19T08:09:12.275007+0000","last_fullsized":"2024-09-19T08:09:12.275007+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:33:34.050343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264206+0000","last_change":"2024-09-19T08:09:09.116735+0000","last_active":"2024-09-19T08:09:12.264206+0000","last_peered":"2024-09-19T08:09:12.264206+0000","last_clean":"2024-09-19T08:09:12.264206+0000","last_became_active":"2024-09-19T08:09:09.116356+0000","last_became_peered":"2024-09-19T08:09:09.116356+0000","last_unstale":"2024-09-19T08:09:12.264206+0000","last_undegraded":"2024-09-19T08:09:12.264206+0000","last_fullsized":"2024-09-19T08:09:12.264206+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:50.952567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259425+0000","last_change":"2024-09-19T08:09:09.113182+0000","last_active":"2024-09-19T08:09:12.259425+0000","last_peered":"2024-09-19T08:09:12.259425+0000","last_clean":"2024-09-19T08:09:12.259425+0000","last_became_active":"2024-09-19T08:09:09.112528+0000","last_became_peered":"2024-09-19T08:09:09.112528+0000","last_unstale":"2024-09-19T08:09:12.259425+0000","last_undegraded":"2024-09-19T08:09:12.259425+0000","last_fullsized":"2024-09-19T08:09:12.259425+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:07.647351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270502+0000","last_change":"2024-09-19T08:09:11.241639+0000","last_active":"2024-09-19T08:09:12.270502+0000","last_peered":"2024-09-19T08:09:12.270502+0000","last_clean":"2024-09-19T08:09:12.270502+0000","last_became_active":"2024-09-19T08:09:11.241308+0000","last_became_peered":"2024-09-19T08:09:11.241308+0000","last_unstale":"2024-09-19T08:09:12.270502+0000","last_undegraded":"2024-09-19T08:09:12.270502+0000","last_fullsized":"2024-09-19T08:09:12.270502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:57.826870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.276709+0000","last_change":"2024-09-19T08:09:09.118334+0000","last_active":"2024-09-19T08:09:12.276709+0000","last_peered":"2024-09-19T08:09:12.276709+0000","last_clean":"2024-09-19T08:09:12.276709+0000","last_became_active":"2024-09-19T08:09:09.118010+0000","last_became_peered":"2024-09-19T08:09:09.118010+0000","last_unstale":"2024-09-19T08:09:12.276709+0000","last_undegraded":"2024-09-19T08:09:12.276709+0000","last_fullsized":"2024-09-19T08:09:12.276709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:51.046598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272762+0000","last_change":"2024-09-19T08:09:11.239990+0000","last_active":"2024-09-19T08:09:12.272762+0000","last_peered":"2024-09-19T08:09:12.272762+0000","last_clean":"2024-09-19T08:09:12.272762+0000","last_became_active":"2024-09-19T08:09:11.239643+0000","last_became_peered":"2024-09-19T08:09:11.239643+0000","last_unstale":"2024-09-19T08:09:12.272762+0000","last_undegraded":"2024-09-19T08:09:12.272762+0000","last_fullsized":"2024-09-19T08:09:12.272762+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:07.078244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264539+0000","last_change":"2024-09-19T08:09:09.114397+0000","last_active":"2024-09-19T08:09:12.264539+0000","last_peered":"2024-09-19T08:09:12.264539+0000","last_clean":"2024-09-19T08:09:12.264539+0000","last_became_active":"2024-09-19T08:09:09.114051+0000","last_became_peered":"2024-09-19T08:09:09.114051+0000","last_unstale":"2024-09-19T08:09:12.264539+0000","last_undegraded":"2024-09-19T08:09:12.264539+0000","last_fullsized":"2024-09-19T08:09:12.264539+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:41.799442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270435+0000","last_change":"2024-09-19T08:09:11.254802+0000","last_active":"2024-09-19T08:09:12.270435+0000","last_peered":"2024-09-19T08:09:12.270435+0000","last_clean":"2024-09-19T08:09:12.270435+0000","last_became_active":"2024-09-19T08:09:11.253869+0000","last_became_peered":"2024-09-19T08:09:11.253869+0000","last_unstale":"2024-09-19T08:09:12.270435+0000","last_undegraded":"2024-09-19T08:09:12.270435+0000","last_fullsized":"2024-09-19T08:09:12.270435+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:00.164834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275404+0000","last_change":"2024-09-19T08:09:09.118585+0000","last_active":"2024-09-19T08:09:12.275404+0000","last_peered":"2024-09-19T08:09:12.275404+0000","last_clean":"2024-09-19T08:09:12.275404+0000","last_became_active":"2024-09-19T08:09:09.118216+0000","last_became_peered":"2024-09-19T08:09:09.118216+0000","last_unstale":"2024-09-19T08:09:12.275404+0000","last_undegraded":"2024-09-19T08:09:12.275404+0000","last_fullsized":"2024-09-19T08:09:12.275404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:41.905746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274037+0000","last_change":"2024-09-19T08:09:11.249835+0000","last_active":"2024-09-19T08:09:12.274037+0000","last_peered":"2024-09-19T08:09:12.274037+0000","last_clean":"2024-09-19T08:09:12.274037+0000","last_became_active":"2024-09-19T08:09:11.249443+0000","last_became_peered":"2024-09-19T08:09:11.249443+0000","last_unstale":"2024-09-19T08:09:12.274037+0000","last_undegraded":"2024-09-19T08:09:12.274037+0000","last_fullsized":"2024-09-19T08:09:12.274037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:06.373126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.279297+0000","last_change":"2024-09-19T08:09:09.242565+0000","last_active":"2024-09-19T08:09:12.279297+0000","last_peered":"2024-09-19T08:09:12.279297+0000","last_clean":"2024-09-19T08:09:12.279297+0000","last_became_active":"2024-09-19T08:09:09.242199+0000","last_became_peered":"2024-09-19T08:09:09.242199+0000","last_unstale":"2024-09-19T08:09:12.279297+0000","last_undegraded":"2024-09-19T08:09:12.279297+0000","last_fullsized":"2024-09-19T08:09:12.279297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:33.195385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270121+0000","last_change":"2024-09-19T08:09:11.251682+0000","last_active":"2024-09-19T08:09:12.270121+0000","last_peered":"2024-09-19T08:09:12.270121+0000","last_clean":"2024-09-19T08:09:12.270121+0000","last_became_active":"2024-09-19T08:09:11.251037+0000","last_became_peered":"2024-09-19T08:09:11.251037+0000","last_unstale":"2024-09-19T08:09:12.270121+0000","last_undegraded":"2024-09-19T08:09:12.270121+0000","last_fullsized":"2024-09-19T08:09:12.270121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:29.518828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'25","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:31.329113+0000","last_change":"2024-09-19T08:09:09.119090+0000","last_active":"2024-09-19T08:09:31.329113+0000","last_peered":"2024-09-19T08:09:31.329113+0000","last_clean":"2024-09-19T08:09:31.329113+0000","last_became_active":"2024-09-19T08:09:09.118685+0000","last_became_peered":"2024-09-19T08:09:09.118685+0000","last_unstale":"2024-09-19T08:09:31.329113+0000","last_undegraded":"2024-09-19T08:09:31.329113+0000","last_fullsized":"2024-09-19T08:09:31.329113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:21.540404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53167,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":67,"num_write":25,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270801+0000","last_change":"2024-09-19T08:09:11.243200+0000","last_active":"2024-09-19T08:09:12.270801+0000","last_peered":"2024-09-19T08:09:12.270801+0000","last_clean":"2024-09-19T08:09:12.270801+0000","last_became_active":"2024-09-19T08:09:11.242873+0000","last_became_peered":"2024-09-19T08:09:11.242873+0000","last_unstale":"2024-09-19T08:09:12.270801+0000","last_undegraded":"2024-09-19T08:09:12.270801+0000","last_fullsized":"2024-09-19T08:09:12.270801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:35.817609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.278392+0000","last_change":"2024-09-19T08:09:09.117117+0000","last_active":"2024-09-19T08:09:12.278392+0000","last_peered":"2024-09-19T08:09:12.278392+0000","last_clean":"2024-09-19T08:09:12.278392+0000","last_became_active":"2024-09-19T08:09:09.116512+0000","last_became_peered":"2024-09-19T08:09:09.116512+0000","last_unstale":"2024-09-19T08:09:12.278392+0000","last_undegraded":"2024-09-19T08:09:12.278392+0000","last_fullsized":"2024-09-19T08:09:12.278392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:15.010570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259483+0000","last_change":"2024-09-19T08:09:11.246648+0000","last_active":"2024-09-19T08:09:12.259483+0000","last_peered":"2024-09-19T08:09:12.259483+0000","last_clean":"2024-09-19T08:09:12.259483+0000","last_became_active":"2024-09-19T08:09:11.246317+0000","last_became_peered":"2024-09-19T08:09:11.246317+0000","last_unstale":"2024-09-19T08:09:12.259483+0000","last_undegraded":"2024-09-19T08:09:12.259483+0000","last_fullsized":"2024-09-19T08:09:12.259483+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:43.285257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274579+0000","last_change":"2024-09-19T08:09:09.112599+0000","last_active":"2024-09-19T08:09:12.274579+0000","last_peered":"2024-09-19T08:09:12.274579+0000","last_clean":"2024-09-19T08:09:12.274579+0000","last_became_active":"2024-09-19T08:09:09.112281+0000","last_became_peered":"2024-09-19T08:09:09.112281+0000","last_unstale":"2024-09-19T08:09:12.274579+0000","last_undegraded":"2024-09-19T08:09:12.274579+0000","last_fullsized":"2024-09-19T08:09:12.274579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:47.710235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274905+0000","last_change":"2024-09-19T08:09:11.253814+0000","last_active":"2024-09-19T08:09:12.274905+0000","last_peered":"2024-09-19T08:09:12.274905+0000","last_clean":"2024-09-19T08:09:12.274905+0000","last_became_active":"2024-09-19T08:09:11.253490+0000","last_became_peered":"2024-09-19T08:09:11.253490+0000","last_unstale":"2024-09-19T08:09:12.274905+0000","last_undegraded":"2024-09-19T08:09:12.274905+0000","last_fullsized":"2024-09-19T08:09:12.274905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:09.287110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272943+0000","last_change":"2024-09-19T08:09:09.114820+0000","last_active":"2024-09-19T08:09:12.272943+0000","last_peered":"2024-09-19T08:09:12.272943+0000","last_clean":"2024-09-19T08:09:12.272943+0000","last_became_active":"2024-09-19T08:09:09.114478+0000","last_became_peered":"2024-09-19T08:09:09.114478+0000","last_unstale":"2024-09-19T08:09:12.272943+0000","last_undegraded":"2024-09-19T08:09:12.272943+0000","last_fullsized":"2024-09-19T08:09:12.272943+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:24.243629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274533+0000","last_change":"2024-09-19T08:09:11.249622+0000","last_active":"2024-09-19T08:09:12.274533+0000","last_peered":"2024-09-19T08:09:12.274533+0000","last_clean":"2024-09-19T08:09:12.274533+0000","last_became_active":"2024-09-19T08:09:11.249325+0000","last_became_peered":"2024-09-19T08:09:11.249325+0000","last_unstale":"2024-09-19T08:09:12.274533+0000","last_undegraded":"2024-09-19T08:09:12.274533+0000","last_fullsized":"2024-09-19T08:09:12.274533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:59.342715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.279583+0000","last_change":"2024-09-19T08:09:09.244136+0000","last_active":"2024-09-19T08:09:12.279583+0000","last_peered":"2024-09-19T08:09:12.279583+0000","last_clean":"2024-09-19T08:09:12.279583+0000","last_became_active":"2024-09-19T08:09:09.243776+0000","last_became_peered":"2024-09-19T08:09:09.243776+0000","last_unstale":"2024-09-19T08:09:12.279583+0000","last_undegraded":"2024-09-19T08:09:12.279583+0000","last_fullsized":"2024-09-19T08:09:12.279583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:01.711310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274220+0000","last_change":"2024-09-19T08:09:11.245399+0000","last_active":"2024-09-19T08:09:12.274220+0000","last_peered":"2024-09-19T08:09:12.274220+0000","last_clean":"2024-09-19T08:09:12.274220+0000","last_became_active":"2024-09-19T08:09:11.245055+0000","last_became_peered":"2024-09-19T08:09:11.245055+0000","last_unstale":"2024-09-19T08:09:12.274220+0000","last_undegraded":"2024-09-19T08:09:12.274220+0000","last_fullsized":"2024-09-19T08:09:12.274220+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:57.639205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275274+0000","last_change":"2024-09-19T08:09:09.115252+0000","last_active":"2024-09-19T08:09:12.275274+0000","last_peered":"2024-09-19T08:09:12.275274+0000","last_clean":"2024-09-19T08:09:12.275274+0000","last_became_active":"2024-09-19T08:09:09.114908+0000","last_became_peered":"2024-09-19T08:09:09.114908+0000","last_unstale":"2024-09-19T08:09:12.275274+0000","last_undegraded":"2024-09-19T08:09:12.275274+0000","last_fullsized":"2024-09-19T08:09:12.275274+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:48.326221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260384+0000","last_change":"2024-09-19T08:09:11.249189+0000","last_active":"2024-09-19T08:09:12.260384+0000","last_peered":"2024-09-19T08:09:12.260384+0000","last_clean":"2024-09-19T08:09:12.260384+0000","last_became_active":"2024-09-19T08:09:11.248797+0000","last_became_peered":"2024-09-19T08:09:11.248797+0000","last_unstale":"2024-09-19T08:09:12.260384+0000","last_undegraded":"2024-09-19T08:09:12.260384+0000","last_fullsized":"2024-09-19T08:09:12.260384+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:20.915638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270335+0000","last_change":"2024-09-19T08:09:09.112973+0000","last_active":"2024-09-19T08:09:12.270335+0000","last_peered":"2024-09-19T08:09:12.270335+0000","last_clean":"2024-09-19T08:09:12.270335+0000","last_became_active":"2024-09-19T08:09:09.112616+0000","last_became_peered":"2024-09-19T08:09:09.112616+0000","last_unstale":"2024-09-19T08:09:12.270335+0000","last_undegraded":"2024-09-19T08:09:12.270335+0000","last_fullsized":"2024-09-19T08:09:12.270335+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:13.791926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275124+0000","last_change":"2024-09-19T08:09:11.240739+0000","last_active":"2024-09-19T08:09:12.275124+0000","last_peered":"2024-09-19T08:09:12.275124+0000","last_clean":"2024-09-19T08:09:12.275124+0000","last_became_active":"2024-09-19T08:09:11.240340+0000","last_became_peered":"2024-09-19T08:09:11.240340+0000","last_unstale":"2024-09-19T08:09:12.275124+0000","last_undegraded":"2024-09-19T08:09:12.275124+0000","last_fullsized":"2024-09-19T08:09:12.275124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:35.450279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.279199+0000","last_change":"2024-09-19T08:09:09.112516+0000","last_active":"2024-09-19T08:09:12.279199+0000","last_peered":"2024-09-19T08:09:12.279199+0000","last_clean":"2024-09-19T08:09:12.279199+0000","last_became_active":"2024-09-19T08:09:09.112140+0000","last_became_peered":"2024-09-19T08:09:09.112140+0000","last_unstale":"2024-09-19T08:09:12.279199+0000","last_undegraded":"2024-09-19T08:09:12.279199+0000","last_fullsized":"2024-09-19T08:09:12.279199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:05.434331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274943+0000","last_change":"2024-09-19T08:09:11.252163+0000","last_active":"2024-09-19T08:09:12.274943+0000","last_peered":"2024-09-19T08:09:12.274943+0000","last_clean":"2024-09-19T08:09:12.274943+0000","last_became_active":"2024-09-19T08:09:11.251762+0000","last_became_peered":"2024-09-19T08:09:11.251762+0000","last_unstale":"2024-09-19T08:09:12.274943+0000","last_undegraded":"2024-09-19T08:09:12.274943+0000","last_fullsized":"2024-09-19T08:09:12.274943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:33.941910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270594+0000","last_change":"2024-09-19T08:09:09.243479+0000","last_active":"2024-09-19T08:09:12.270594+0000","last_peered":"2024-09-19T08:09:12.270594+0000","last_clean":"2024-09-19T08:09:12.270594+0000","last_became_active":"2024-09-19T08:09:09.243064+0000","last_became_peered":"2024-09-19T08:09:09.243064+0000","last_unstale":"2024-09-19T08:09:12.270594+0000","last_undegraded":"2024-09-19T08:09:12.270594+0000","last_fullsized":"2024-09-19T08:09:12.270594+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:58.965426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275301+0000","last_change":"2024-09-19T08:09:11.242438+0000","last_active":"2024-09-19T08:09:12.275301+0000","last_peered":"2024-09-19T08:09:12.275301+0000","last_clean":"2024-09-19T08:09:12.275301+0000","last_became_active":"2024-09-19T08:09:11.242114+0000","last_became_peered":"2024-09-19T08:09:11.242114+0000","last_unstale":"2024-09-19T08:09:12.275301+0000","last_undegraded":"2024-09-19T08:09:12.275301+0000","last_fullsized":"2024-09-19T08:09:12.275301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:54.183012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":341,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274753+0000","last_change":"2024-09-19T08:07:55.287566+0000","last_active":"2024-09-19T08:09:12.274753+0000","last_peered":"2024-09-19T08:09:12.274753+0000","last_clean":"2024-09-19T08:09:12.274753+0000","last_became_active":"2024-09-19T08:07:55.287037+0000","last_became_peered":"2024-09-19T08:07:55.287037+0000","last_unstale":"2024-09-19T08:09:12.274753+0000","last_undegraded":"2024-09-19T08:09:12.274753+0000","last_fullsized":"2024-09-19T08:09:12.274753+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_clean_scrub_stamp":"2024-09-19T08:04:29.468857+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:49.553882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273322+0000","last_change":"2024-09-19T08:09:09.113497+0000","last_active":"2024-09-19T08:09:12.273322+0000","last_peered":"2024-09-19T08:09:12.273322+0000","last_clean":"2024-09-19T08:09:12.273322+0000","last_became_active":"2024-09-19T08:09:09.112546+0000","last_became_peered":"2024-09-19T08:09:09.112546+0000","last_unstale":"2024-09-19T08:09:12.273322+0000","last_undegraded":"2024-09-19T08:09:12.273322+0000","last_fullsized":"2024-09-19T08:09:12.273322+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:09.906476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269847+0000","last_change":"2024-09-19T08:09:11.241478+0000","last_active":"2024-09-19T08:09:12.269847+0000","last_peered":"2024-09-19T08:09:12.269847+0000","last_clean":"2024-09-19T08:09:12.269847+0000","last_became_active":"2024-09-19T08:09:11.241138+0000","last_became_peered":"2024-09-19T08:09:11.241138+0000","last_unstale":"2024-09-19T08:09:12.269847+0000","last_undegraded":"2024-09-19T08:09:12.269847+0000","last_fullsized":"2024-09-19T08:09:12.269847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:32.884491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274978+0000","last_change":"2024-09-19T08:09:09.116571+0000","last_active":"2024-09-19T08:09:12.274978+0000","last_peered":"2024-09-19T08:09:12.274978+0000","last_clean":"2024-09-19T08:09:12.274978+0000","last_became_active":"2024-09-19T08:09:09.116180+0000","last_became_peered":"2024-09-19T08:09:09.116180+0000","last_unstale":"2024-09-19T08:09:12.274978+0000","last_undegraded":"2024-09-19T08:09:12.274978+0000","last_fullsized":"2024-09-19T08:09:12.274978+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:58.577320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259671+0000","last_change":"2024-09-19T08:09:11.254088+0000","last_active":"2024-09-19T08:09:12.259671+0000","last_peered":"2024-09-19T08:09:12.259671+0000","last_clean":"2024-09-19T08:09:12.259671+0000","last_became_active":"2024-09-19T08:09:11.253795+0000","last_became_peered":"2024-09-19T08:09:11.253795+0000","last_unstale":"2024-09-19T08:09:12.259671+0000","last_undegraded":"2024-09-19T08:09:12.259671+0000","last_fullsized":"2024-09-19T08:09:12.259671+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:30.528506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259700+0000","last_change":"2024-09-19T08:09:09.242166+0000","last_active":"2024-09-19T08:09:12.259700+0000","last_peered":"2024-09-19T08:09:12.259700+0000","last_clean":"2024-09-19T08:09:12.259700+0000","last_became_active":"2024-09-19T08:09:09.241270+0000","last_became_peered":"2024-09-19T08:09:09.241270+0000","last_unstale":"2024-09-19T08:09:12.259700+0000","last_undegraded":"2024-09-19T08:09:12.259700+0000","last_fullsized":"2024-09-19T08:09:12.259700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:51.899069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.276508+0000","last_change":"2024-09-19T08:09:11.253778+0000","last_active":"2024-09-19T08:09:12.276508+0000","last_peered":"2024-09-19T08:09:12.276508+0000","last_clean":"2024-09-19T08:09:12.276508+0000","last_became_active":"2024-09-19T08:09:11.252219+0000","last_became_peered":"2024-09-19T08:09:11.252219+0000","last_unstale":"2024-09-19T08:09:12.276508+0000","last_undegraded":"2024-09-19T08:09:12.276508+0000","last_fullsized":"2024-09-19T08:09:12.276508+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:07.205504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275248+0000","last_change":"2024-09-19T08:09:09.118790+0000","last_active":"2024-09-19T08:09:12.275248+0000","last_peered":"2024-09-19T08:09:12.275248+0000","last_clean":"2024-09-19T08:09:12.275248+0000","last_became_active":"2024-09-19T08:09:09.117695+0000","last_became_peered":"2024-09-19T08:09:09.117695+0000","last_unstale":"2024-09-19T08:09:12.275248+0000","last_undegraded":"2024-09-19T08:09:12.275248+0000","last_fullsized":"2024-09-19T08:09:12.275248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:40.674039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264264+0000","last_change":"2024-09-19T08:09:11.249386+0000","last_active":"2024-09-19T08:09:12.264264+0000","last_peered":"2024-09-19T08:09:12.264264+0000","last_clean":"2024-09-19T08:09:12.264264+0000","last_became_active":"2024-09-19T08:09:11.249004+0000","last_became_peered":"2024-09-19T08:09:11.249004+0000","last_unstale":"2024-09-19T08:09:12.264264+0000","last_undegraded":"2024-09-19T08:09:12.264264+0000","last_fullsized":"2024-09-19T08:09:12.264264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:50.170799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272215+0000","last_change":"2024-09-19T08:09:09.241599+0000","last_active":"2024-09-19T08:09:12.272215+0000","last_peered":"2024-09-19T08:09:12.272215+0000","last_clean":"2024-09-19T08:09:12.272215+0000","last_became_active":"2024-09-19T08:09:09.241226+0000","last_became_peered":"2024-09-19T08:09:09.241226+0000","last_unstale":"2024-09-19T08:09:12.272215+0000","last_undegraded":"2024-09-19T08:09:12.272215+0000","last_fullsized":"2024-09-19T08:09:12.272215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:19.590966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264496+0000","last_change":"2024-09-19T08:09:11.238098+0000","last_active":"2024-09-19T08:09:12.264496+0000","last_peered":"2024-09-19T08:09:12.264496+0000","last_clean":"2024-09-19T08:09:12.264496+0000","last_became_active":"2024-09-19T08:09:11.237737+0000","last_became_peered":"2024-09-19T08:09:11.237737+0000","last_unstale":"2024-09-19T08:09:12.264496+0000","last_undegraded":"2024-09-19T08:09:12.264496+0000","last_fullsized":"2024-09-19T08:09:12.264496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:00.134664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272482+0000","last_change":"2024-09-19T08:09:09.241775+0000","last_active":"2024-09-19T08:09:12.272482+0000","last_peered":"2024-09-19T08:09:12.272482+0000","last_clean":"2024-09-19T08:09:12.272482+0000","last_became_active":"2024-09-19T08:09:09.241367+0000","last_became_peered":"2024-09-19T08:09:09.241367+0000","last_unstale":"2024-09-19T08:09:12.272482+0000","last_undegraded":"2024-09-19T08:09:12.272482+0000","last_fullsized":"2024-09-19T08:09:12.272482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:11.862171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259714+0000","last_change":"2024-09-19T08:09:11.251980+0000","last_active":"2024-09-19T08:09:12.259714+0000","last_peered":"2024-09-19T08:09:12.259714+0000","last_clean":"2024-09-19T08:09:12.259714+0000","last_became_active":"2024-09-19T08:09:11.251638+0000","last_became_peered":"2024-09-19T08:09:11.251638+0000","last_unstale":"2024-09-19T08:09:12.259714+0000","last_undegraded":"2024-09-19T08:09:12.259714+0000","last_fullsized":"2024-09-19T08:09:12.259714+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:35.905643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'6","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:30.267860+0000","last_change":"2024-09-19T08:09:09.117150+0000","last_active":"2024-09-19T08:09:30.267860+0000","last_peered":"2024-09-19T08:09:30.267860+0000","last_clean":"2024-09-19T08:09:30.267860+0000","last_became_active":"2024-09-19T08:09:09.116763+0000","last_became_peered":"2024-09-19T08:09:09.116763+0000","last_unstale":"2024-09-19T08:09:30.267860+0000","last_undegraded":"2024-09-19T08:09:30.267860+0000","last_fullsized":"2024-09-19T08:09:30.267860+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:18.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270016+0000","last_change":"2024-09-19T08:09:11.244366+0000","last_active":"2024-09-19T08:09:12.270016+0000","last_peered":"2024-09-19T08:09:12.270016+0000","last_clean":"2024-09-19T08:09:12.270016+0000","last_became_active":"2024-09-19T08:09:11.244023+0000","last_became_peered":"2024-09-19T08:09:11.244023+0000","last_unstale":"2024-09-19T08:09:12.270016+0000","last_undegraded":"2024-09-19T08:09:12.270016+0000","last_fullsized":"2024-09-19T08:09:12.270016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:18.572377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275535+0000","last_change":"2024-09-19T08:09:09.139557+0000","last_active":"2024-09-19T08:09:12.275535+0000","last_peered":"2024-09-19T08:09:12.275535+0000","last_clean":"2024-09-19T08:09:12.275535+0000","last_became_active":"2024-09-19T08:09:09.139190+0000","last_became_peered":"2024-09-19T08:09:09.139190+0000","last_unstale":"2024-09-19T08:09:12.275535+0000","last_undegraded":"2024-09-19T08:09:12.275535+0000","last_fullsized":"2024-09-19T08:09:12.275535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:39.270432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273816+0000","last_change":"2024-09-19T08:09:11.249637+0000","last_active":"2024-09-19T08:09:12.273816+0000","last_peered":"2024-09-19T08:09:12.273816+0000","last_clean":"2024-09-19T08:09:12.273816+0000","last_became_active":"2024-09-19T08:09:11.249323+0000","last_became_peered":"2024-09-19T08:09:11.249323+0000","last_unstale":"2024-09-19T08:09:12.273816+0000","last_undegraded":"2024-09-19T08:09:12.273816+0000","last_fullsized":"2024-09-19T08:09:12.273816+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:28.270910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270693+0000","last_change":"2024-09-19T08:09:09.242444+0000","last_active":"2024-09-19T08:09:12.270693+0000","last_peered":"2024-09-19T08:09:12.270693+0000","last_clean":"2024-09-19T08:09:12.270693+0000","last_became_active":"2024-09-19T08:09:09.242095+0000","last_became_peered":"2024-09-19T08:09:09.242095+0000","last_unstale":"2024-09-19T08:09:12.270693+0000","last_undegraded":"2024-09-19T08:09:12.270693+0000","last_fullsized":"2024-09-19T08:09:12.270693+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:42.941930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269950+0000","last_change":"2024-09-19T08:09:11.241588+0000","last_active":"2024-09-19T08:09:12.269950+0000","last_peered":"2024-09-19T08:09:12.269950+0000","last_clean":"2024-09-19T08:09:12.269950+0000","last_became_active":"2024-09-19T08:09:11.241076+0000","last_became_peered":"2024-09-19T08:09:11.241076+0000","last_unstale":"2024-09-19T08:09:12.269950+0000","last_undegraded":"2024-09-19T08:09:12.269950+0000","last_fullsized":"2024-09-19T08:09:12.269950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:01.676410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269706+0000","last_change":"2024-09-19T08:09:09.112494+0000","last_active":"2024-09-19T08:09:12.269706+0000","last_peered":"2024-09-19T08:09:12.269706+0000","last_clean":"2024-09-19T08:09:12.269706+0000","last_became_active":"2024-09-19T08:09:09.112019+0000","last_became_peered":"2024-09-19T08:09:09.112019+0000","last_unstale":"2024-09-19T08:09:12.269706+0000","last_undegraded":"2024-09-19T08:09:12.269706+0000","last_fullsized":"2024-09-19T08:09:12.269706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:17.674092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260305+0000","last_change":"2024-09-19T08:09:11.251420+0000","last_active":"2024-09-19T08:09:12.260305+0000","last_peered":"2024-09-19T08:09:12.260305+0000","last_clean":"2024-09-19T08:09:12.260305+0000","last_became_active":"2024-09-19T08:09:11.251083+0000","last_became_peered":"2024-09-19T08:09:11.251083+0000","last_unstale":"2024-09-19T08:09:12.260305+0000","last_undegraded":"2024-09-19T08:09:12.260305+0000","last_fullsized":"2024-09-19T08:09:12.260305+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:38.810616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272113+0000","last_change":"2024-09-19T08:09:09.117705+0000","last_active":"2024-09-19T08:09:12.272113+0000","last_peered":"2024-09-19T08:09:12.272113+0000","last_clean":"2024-09-19T08:09:12.272113+0000","last_became_active":"2024-09-19T08:09:09.117367+0000","last_became_peered":"2024-09-19T08:09:09.117367+0000","last_unstale":"2024-09-19T08:09:12.272113+0000","last_undegraded":"2024-09-19T08:09:12.272113+0000","last_fullsized":"2024-09-19T08:09:12.272113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:21.256227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269858+0000","last_change":"2024-09-19T08:09:11.239096+0000","last_active":"2024-09-19T08:09:12.269858+0000","last_peered":"2024-09-19T08:09:12.269858+0000","last_clean":"2024-09-19T08:09:12.269858+0000","last_became_active":"2024-09-19T08:09:11.238739+0000","last_became_peered":"2024-09-19T08:09:11.238739+0000","last_unstale":"2024-09-19T08:09:12.269858+0000","last_undegraded":"2024-09-19T08:09:12.269858+0000","last_fullsized":"2024-09-19T08:09:12.269858+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:27.161174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.279086+0000","last_change":"2024-09-19T08:09:09.115198+0000","last_active":"2024-09-19T08:09:12.279086+0000","last_peered":"2024-09-19T08:09:12.279086+0000","last_clean":"2024-09-19T08:09:12.279086+0000","last_became_active":"2024-09-19T08:09:09.114783+0000","last_became_peered":"2024-09-19T08:09:09.114783+0000","last_unstale":"2024-09-19T08:09:12.279086+0000","last_undegraded":"2024-09-19T08:09:12.279086+0000","last_fullsized":"2024-09-19T08:09:12.279086+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:45.674774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274921+0000","last_change":"2024-09-19T08:09:11.252450+0000","last_active":"2024-09-19T08:09:12.274921+0000","last_peered":"2024-09-19T08:09:12.274921+0000","last_clean":"2024-09-19T08:09:12.274921+0000","last_became_active":"2024-09-19T08:09:11.251696+0000","last_became_peered":"2024-09-19T08:09:11.251696+0000","last_unstale":"2024-09-19T08:09:12.274921+0000","last_undegraded":"2024-09-19T08:09:12.274921+0000","last_fullsized":"2024-09-19T08:09:12.274921+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:48.179795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.276254+0000","last_change":"2024-09-19T08:09:11.244571+0000","last_active":"2024-09-19T08:09:12.276254+0000","last_peered":"2024-09-19T08:09:12.276254+0000","last_clean":"2024-09-19T08:09:12.276254+0000","last_became_active":"2024-09-19T08:09:11.244217+0000","last_became_peered":"2024-09-19T08:09:11.244217+0000","last_unstale":"2024-09-19T08:09:12.276254+0000","last_undegraded":"2024-09-19T08:09:12.276254+0000","last_fullsized":"2024-09-19T08:09:12.276254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:52.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275687+0000","last_change":"2024-09-19T08:09:09.117355+0000","last_active":"2024-09-19T08:09:12.275687+0000","last_peered":"2024-09-19T08:09:12.275687+0000","last_clean":"2024-09-19T08:09:12.275687+0000","last_became_active":"2024-09-19T08:09:09.116806+0000","last_became_peered":"2024-09-19T08:09:09.116806+0000","last_unstale":"2024-09-19T08:09:12.275687+0000","last_undegraded":"2024-09-19T08:09:12.275687+0000","last_fullsized":"2024-09-19T08:09:12.275687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:42.113015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269943+0000","last_change":"2024-09-19T08:09:11.245745+0000","last_active":"2024-09-19T08:09:12.269943+0000","last_peered":"2024-09-19T08:09:12.269943+0000","last_clean":"2024-09-19T08:09:12.269943+0000","last_became_active":"2024-09-19T08:09:11.245373+0000","last_became_peered":"2024-09-19T08:09:11.245373+0000","last_unstale":"2024-09-19T08:09:12.269943+0000","last_undegraded":"2024-09-19T08:09:12.269943+0000","last_fullsized":"2024-09-19T08:09:12.269943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:56.500738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.278897+0000","last_change":"2024-09-19T08:09:09.119550+0000","last_active":"2024-09-19T08:09:12.278897+0000","last_peered":"2024-09-19T08:09:12.278897+0000","last_clean":"2024-09-19T08:09:12.278897+0000","last_became_active":"2024-09-19T08:09:09.119187+0000","last_became_peered":"2024-09-19T08:09:09.119187+0000","last_unstale":"2024-09-19T08:09:12.278897+0000","last_undegraded":"2024-09-19T08:09:12.278897+0000","last_fullsized":"2024-09-19T08:09:12.278897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:14.629824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274031+0000","last_change":"2024-09-19T08:09:11.245318+0000","last_active":"2024-09-19T08:09:12.274031+0000","last_peered":"2024-09-19T08:09:12.274031+0000","last_clean":"2024-09-19T08:09:12.274031+0000","last_became_active":"2024-09-19T08:09:11.245000+0000","last_became_peered":"2024-09-19T08:09:11.245000+0000","last_unstale":"2024-09-19T08:09:12.274031+0000","last_undegraded":"2024-09-19T08:09:12.274031+0000","last_fullsized":"2024-09-19T08:09:12.274031+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:53.590453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270460+0000","last_change":"2024-09-19T08:09:09.241552+0000","last_active":"2024-09-19T08:09:12.270460+0000","last_peered":"2024-09-19T08:09:12.270460+0000","last_clean":"2024-09-19T08:09:12.270460+0000","last_became_active":"2024-09-19T08:09:09.241201+0000","last_became_peered":"2024-09-19T08:09:09.241201+0000","last_unstale":"2024-09-19T08:09:12.270460+0000","last_undegraded":"2024-09-19T08:09:12.270460+0000","last_fullsized":"2024-09-19T08:09:12.270460+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:09.374532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270213+0000","last_change":"2024-09-19T08:09:11.246697+0000","last_active":"2024-09-19T08:09:12.270213+0000","last_peered":"2024-09-19T08:09:12.270213+0000","last_clean":"2024-09-19T08:09:12.270213+0000","last_became_active":"2024-09-19T08:09:11.246404+0000","last_became_peered":"2024-09-19T08:09:11.246404+0000","last_unstale":"2024-09-19T08:09:12.270213+0000","last_undegraded":"2024-09-19T08:09:12.270213+0000","last_fullsized":"2024-09-19T08:09:12.270213+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.008875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.278644+0000","last_change":"2024-09-19T08:09:09.113401+0000","last_active":"2024-09-19T08:09:12.278644+0000","last_peered":"2024-09-19T08:09:12.278644+0000","last_clean":"2024-09-19T08:09:12.278644+0000","last_became_active":"2024-09-19T08:09:09.113026+0000","last_became_peered":"2024-09-19T08:09:09.113026+0000","last_unstale":"2024-09-19T08:09:12.278644+0000","last_undegraded":"2024-09-19T08:09:12.278644+0000","last_fullsized":"2024-09-19T08:09:12.278644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:54.740955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53965,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":38,"num_read_kb":73,"num_write":75,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":161895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63,"ondisk_log_size":63,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281686,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547218,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":868352,"data_stored":419022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":1062868,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939676,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":419604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168608,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":876544,"data_stored":419626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397541,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":1010089,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561066,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":419139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790000,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":1009689,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953526,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":872448,"data_stored":419044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":419360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":472223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":472189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":872448,"data_stored":419112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":53167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":53201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":53361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:09:37.104 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T08:09:37.105 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T08:09:37.105 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T08:09:37.365 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:37.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:37 smithi027 ceph-mon[31209]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:09:37.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.847+0000 7f992517d640 1 -- 172.21.15.27:0/3582862615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99201037d0 msgr2=0x7f992010a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:37.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.847+0000 7f992517d640 1 --2- 172.21.15.27:0/3582862615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99201037d0 0x7f992010a060 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9918009900 tx=0x7f991802a410 comp rx=0 tx=0).stop 2024-09-19T08:09:37.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.847+0000 7f992517d640 1 -- 172.21.15.27:0/3582862615 shutdown_connections 2024-09-19T08:09:37.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.847+0000 7f992517d640 1 --2- 172.21.15.27:0/3582862615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99201037d0 0x7f992010a060 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:37.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.847+0000 7f992517d640 1 --2- 172.21.15.27:0/3582862615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9920102e10 0x7f9920103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:37.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.847+0000 7f992517d640 1 --2- 172.21.15.27:0/3582862615 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9920101c10 0x7f9920102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:37.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.847+0000 7f992517d640 1 -- 172.21.15.27:0/3582862615 >> 172.21.15.27:0/3582862615 conn(0x7f99200fd3c0 msgr2=0x7f99200ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:37.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.847+0000 7f992517d640 1 -- 172.21.15.27:0/3582862615 shutdown_connections 2024-09-19T08:09:37.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.847+0000 7f992517d640 1 -- 172.21.15.27:0/3582862615 wait complete. 2024-09-19T08:09:37.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.847+0000 7f992517d640 1 Processor -- start 2024-09-19T08:09:37.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.848+0000 7f992517d640 1 -- start start 2024-09-19T08:09:37.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.848+0000 7f992517d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9920101c10 0x7f9920197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:37.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.848+0000 7f992517d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9920102e10 0x7f9920198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:37.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.848+0000 7f992517d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99201037d0 0x7f992019f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:37.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.848+0000 7f992517d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f992010d960 con 0x7f9920102e10 2024-09-19T08:09:37.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.848+0000 7f992517d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f992010d7e0 con 0x7f9920101c10 2024-09-19T08:09:37.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.848+0000 7f992517d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f992010dae0 con 0x7f99201037d0 2024-09-19T08:09:37.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.848+0000 7f991e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9920102e10 0x7f9920198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:37.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.848+0000 7f991e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9920102e10 0x7f9920198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33462/0 (socket says 172.21.15.27:33462) 2024-09-19T08:09:37.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.848+0000 7f991e59c640 1 -- 172.21.15.27:0/1069294673 learned_addr learned my addr 172.21.15.27:0/1069294673 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:37.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.848+0000 7f991f59e640 1 --2- 172.21.15.27:0/1069294673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99201037d0 0x7f992019f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:37.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.848+0000 7f991ed9d640 1 --2- 172.21.15.27:0/1069294673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9920101c10 0x7f9920197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:37.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.848+0000 7f991e59c640 1 -- 172.21.15.27:0/1069294673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99201037d0 msgr2=0x7f992019f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:37.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.848+0000 7f991e59c640 1 --2- 172.21.15.27:0/1069294673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99201037d0 0x7f992019f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:37.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.848+0000 7f991e59c640 1 -- 172.21.15.27:0/1069294673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9920101c10 msgr2=0x7f9920197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:37.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.848+0000 7f991e59c640 1 --2- 172.21.15.27:0/1069294673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9920101c10 0x7f9920197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:37.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.848+0000 7f991e59c640 1 -- 172.21.15.27:0/1069294673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992019fb50 con 0x7f9920102e10 2024-09-19T08:09:37.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.848+0000 7f991ed9d640 1 --2- 172.21.15.27:0/1069294673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9920101c10 0x7f9920197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:09:37.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.848+0000 7f991f59e640 1 --2- 172.21.15.27:0/1069294673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99201037d0 0x7f992019f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:09:37.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.849+0000 7f991e59c640 1 --2- 172.21.15.27:0/1069294673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9920102e10 0x7f9920198460 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f990800c890 tx=0x7f990800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:37.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.849+0000 7f9917fff640 1 -- 172.21.15.27:0/1069294673 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9908004220 con 0x7f9920102e10 2024-09-19T08:09:37.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.849+0000 7f9917fff640 1 -- 172.21.15.27:0/1069294673 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99080043c0 con 0x7f9920102e10 2024-09-19T08:09:37.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.849+0000 7f992517d640 1 -- 172.21.15.27:0/1069294673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f992019fe40 con 0x7f9920102e10 2024-09-19T08:09:37.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.849+0000 7f9917fff640 1 -- 172.21.15.27:0/1069294673 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99080049e0 con 0x7f9920102e10 2024-09-19T08:09:37.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.849+0000 7f992517d640 1 -- 172.21.15.27:0/1069294673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99201a0370 con 0x7f9920102e10 2024-09-19T08:09:37.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.850+0000 7f992517d640 1 -- 172.21.15.27:0/1069294673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9920108f40 con 0x7f9920102e10 2024-09-19T08:09:37.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.851+0000 7f9917fff640 1 -- 172.21.15.27:0/1069294673 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9908004b80 con 0x7f9920102e10 2024-09-19T08:09:37.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.852+0000 7f9917fff640 1 --2- 172.21.15.27:0/1069294673 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f990c0a3300 0x7f990c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:37.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.853+0000 7f991ed9d640 1 --2- 172.21.15.27:0/1069294673 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f990c0a3300 0x7f990c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:37.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.853+0000 7f9917fff640 1 -- 172.21.15.27:0/1069294673 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f99080cfa00 con 0x7f9920102e10 2024-09-19T08:09:37.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.853+0000 7f991ed9d640 1 --2- 172.21.15.27:0/1069294673 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f990c0a3300 0x7f990c0a57c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9920102c70 tx=0x7f9910009570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:37.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:37.857+0000 7f9917fff640 1 -- 172.21.15.27:0/1069294673 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9908014030 con 0x7f9920102e10 2024-09-19T08:09:37.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:37 smithi155 ceph-mon[35362]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:09:38.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:37 smithi203 ceph-mon[35198]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:09:38.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:38.102+0000 7f992517d640 1 -- 172.21.15.27:0/1069294673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f992002d7c0 con 0x7f9920102e10 2024-09-19T08:09:38.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:38.104+0000 7f9917fff640 1 -- 172.21.15.27:0/1069294673 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f990809c770 con 0x7f9920102e10 2024-09-19T08:09:38.104 INFO:teuthology.orchestra.run.smithi027.stdout:[client.0] 2024-09-19T08:09:38.104 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBC3OtmAH8kBhAAgILqFIvh/JkeMUfmxscV8A== 2024-09-19T08:09:38.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:38.106+0000 7f992517d640 1 -- 172.21.15.27:0/1069294673 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f990c0a3300 msgr2=0x7f990c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:38.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:38.106+0000 7f992517d640 1 --2- 172.21.15.27:0/1069294673 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f990c0a3300 0x7f990c0a57c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9920102c70 tx=0x7f9910009570 comp rx=0 tx=0).stop 2024-09-19T08:09:38.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:38.106+0000 7f992517d640 1 -- 172.21.15.27:0/1069294673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9920102e10 msgr2=0x7f9920198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:38.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:38.106+0000 7f992517d640 1 --2- 172.21.15.27:0/1069294673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9920102e10 0x7f9920198460 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f990800c890 tx=0x7f990800cd50 comp rx=0 tx=0).stop 2024-09-19T08:09:38.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:38.106+0000 7f992517d640 1 -- 172.21.15.27:0/1069294673 shutdown_connections 2024-09-19T08:09:38.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:38.106+0000 7f992517d640 1 --2- 172.21.15.27:0/1069294673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99201037d0 0x7f992019f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:38.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:38.106+0000 7f992517d640 1 --2- 172.21.15.27:0/1069294673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9920102e10 0x7f9920198460 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:38.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:38.106+0000 7f992517d640 1 --2- 172.21.15.27:0/1069294673 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f990c0a3300 0x7f990c0a57c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:38.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:38.106+0000 7f992517d640 1 --2- 172.21.15.27:0/1069294673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9920101c10 0x7f9920197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:38.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:38.106+0000 7f992517d640 1 -- 172.21.15.27:0/1069294673 >> 172.21.15.27:0/1069294673 conn(0x7f99200fd3c0 msgr2=0x7f9920106110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:38.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:38.107+0000 7f992517d640 1 -- 172.21.15.27:0/1069294673 shutdown_connections 2024-09-19T08:09:38.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:38.107+0000 7f992517d640 1 -- 172.21.15.27:0/1069294673 wait complete. 2024-09-19T08:09:38.938 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-19T08:09:38.938 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T08:09:38.938 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T08:09:38.963 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:38 smithi027 ceph-mon[31209]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2024-09-19T08:09:38.963 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:38 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1069294673' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:09:38.963 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:38 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1069294673' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T08:09:38.979 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T08:09:38.979 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T08:09:38.979 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T08:09:38.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:38 smithi155 ceph-mon[35362]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2024-09-19T08:09:38.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:38 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1069294673' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:09:38.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:38 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1069294673' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T08:09:39.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:38 smithi203 ceph-mon[35198]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2024-09-19T08:09:39.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:38 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1069294673' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:09:39.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:38 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1069294673' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T08:09:39.277 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:39.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.773+0000 7fca28adf640 1 -- 172.21.15.27:0/3549728876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca24106f50 msgr2=0x7fca2410eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:39.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.773+0000 7fca28adf640 1 --2- 172.21.15.27:0/3549728876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca24106f50 0x7fca2410eaf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fca14009cd0 tx=0x7fca1402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:09:39.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.774+0000 7fca28adf640 1 -- 172.21.15.27:0/3549728876 shutdown_connections 2024-09-19T08:09:39.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.774+0000 7fca28adf640 1 --2- 172.21.15.27:0/3549728876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca24106f50 0x7fca2410eaf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:39.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.774+0000 7fca28adf640 1 --2- 172.21.15.27:0/3549728876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca24100ca0 0x7fca24106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:39.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.774+0000 7fca28adf640 1 --2- 172.21.15.27:0/3549728876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca241002f0 0x7fca241006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.774+0000 7fca28adf640 1 -- 172.21.15.27:0/3549728876 >> 172.21.15.27:0/3549728876 conn(0x7fca24077210 msgr2=0x7fca240fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.774+0000 7fca28adf640 1 -- 172.21.15.27:0/3549728876 shutdown_connections 2024-09-19T08:09:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.774+0000 7fca28adf640 1 -- 172.21.15.27:0/3549728876 wait complete. 2024-09-19T08:09:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.774+0000 7fca28adf640 1 Processor -- start 2024-09-19T08:09:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.774+0000 7fca28adf640 1 -- start start 2024-09-19T08:09:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.775+0000 7fca28adf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca241002f0 0x7fca24101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.775+0000 7fca28adf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca24100ca0 0x7fca241017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.775+0000 7fca28adf640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca24106f50 0x7fca24101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.775+0000 7fca28adf640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fca24112000 con 0x7fca241002f0 2024-09-19T08:09:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.775+0000 7fca28adf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fca24111e80 con 0x7fca24100ca0 2024-09-19T08:09:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.775+0000 7fca28adf640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fca24112180 con 0x7fca24106f50 2024-09-19T08:09:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.775+0000 7fca2259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca241002f0 0x7fca24101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:39.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.775+0000 7fca2259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca241002f0 0x7fca24101270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33482/0 (socket says 172.21.15.27:33482) 2024-09-19T08:09:39.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.775+0000 7fca2259c640 1 -- 172.21.15.27:0/2642313034 learned_addr learned my addr 172.21.15.27:0/2642313034 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:39.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.775+0000 7fca21d9b640 1 --2- 172.21.15.27:0/2642313034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca24100ca0 0x7fca241017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:39.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.775+0000 7fca22d9d640 1 --2- 172.21.15.27:0/2642313034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca24106f50 0x7fca24101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:39.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.775+0000 7fca2259c640 1 -- 172.21.15.27:0/2642313034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca24106f50 msgr2=0x7fca24101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:39.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.775+0000 7fca2259c640 1 --2- 172.21.15.27:0/2642313034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca24106f50 0x7fca24101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:39.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.775+0000 7fca2259c640 1 -- 172.21.15.27:0/2642313034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca24100ca0 msgr2=0x7fca241017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:39.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.775+0000 7fca2259c640 1 --2- 172.21.15.27:0/2642313034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca24100ca0 0x7fca241017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:39.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.775+0000 7fca2259c640 1 -- 172.21.15.27:0/2642313034 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca241a69a0 con 0x7fca241002f0 2024-09-19T08:09:39.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.776+0000 7fca2259c640 1 --2- 172.21.15.27:0/2642313034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca241002f0 0x7fca24101270 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00c890 tx=0x7fca1c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:39.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.776+0000 7fca1b7fe640 1 -- 172.21.15.27:0/2642313034 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c004220 con 0x7fca241002f0 2024-09-19T08:09:39.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.776+0000 7fca1b7fe640 1 -- 172.21.15.27:0/2642313034 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca1c0043c0 con 0x7fca241002f0 2024-09-19T08:09:39.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.776+0000 7fca28adf640 1 -- 172.21.15.27:0/2642313034 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca241a6c90 con 0x7fca241002f0 2024-09-19T08:09:39.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.776+0000 7fca1b7fe640 1 -- 172.21.15.27:0/2642313034 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c004a00 con 0x7fca241002f0 2024-09-19T08:09:39.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.776+0000 7fca28adf640 1 -- 172.21.15.27:0/2642313034 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca241a7180 con 0x7fca241002f0 2024-09-19T08:09:39.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.777+0000 7fca28adf640 1 -- 172.21.15.27:0/2642313034 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca241006d0 con 0x7fca241002f0 2024-09-19T08:09:39.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.779+0000 7fca1b7fe640 1 -- 172.21.15.27:0/2642313034 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fca1c0079b0 con 0x7fca241002f0 2024-09-19T08:09:39.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.780+0000 7fca1b7fe640 1 --2- 172.21.15.27:0/2642313034 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fca100a3420 0x7fca100a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:39.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.780+0000 7fca21d9b640 1 --2- 172.21.15.27:0/2642313034 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fca100a3420 0x7fca100a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:39.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.780+0000 7fca1b7fe640 1 -- 172.21.15.27:0/2642313034 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fca1c0cf830 con 0x7fca241002f0 2024-09-19T08:09:39.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.780+0000 7fca21d9b640 1 --2- 172.21.15.27:0/2642313034 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fca100a3420 0x7fca100a58e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fca24102d00 tx=0x7fca0c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:39.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:39.783+0000 7fca1b7fe640 1 -- 172.21.15.27:0/2642313034 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fca1c014030 con 0x7fca241002f0 2024-09-19T08:09:40.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:40.009+0000 7fca28adf640 1 -- 172.21.15.27:0/2642313034 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fca241027a0 con 0x7fca241002f0 2024-09-19T08:09:40.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:40.014+0000 7fca1b7fe640 1 -- 172.21.15.27:0/2642313034 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264049 (secure 0 0 0) 0x7fca1c09c6a0 con 0x7fca241002f0 2024-09-19T08:09:40.022 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:09:40.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:40.017+0000 7fca28adf640 1 -- 172.21.15.27:0/2642313034 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fca100a3420 msgr2=0x7fca100a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:40.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:40.017+0000 7fca28adf640 1 --2- 172.21.15.27:0/2642313034 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fca100a3420 0x7fca100a58e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fca24102d00 tx=0x7fca0c009110 comp rx=0 tx=0).stop 2024-09-19T08:09:40.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:40.017+0000 7fca28adf640 1 -- 172.21.15.27:0/2642313034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca241002f0 msgr2=0x7fca24101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:40.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:40.017+0000 7fca28adf640 1 --2- 172.21.15.27:0/2642313034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca241002f0 0x7fca24101270 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00c890 tx=0x7fca1c00cc90 comp rx=0 tx=0).stop 2024-09-19T08:09:40.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:40.017+0000 7fca28adf640 1 -- 172.21.15.27:0/2642313034 shutdown_connections 2024-09-19T08:09:40.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:40.017+0000 7fca28adf640 1 --2- 172.21.15.27:0/2642313034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca24106f50 0x7fca24101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:40.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:40.017+0000 7fca28adf640 1 --2- 172.21.15.27:0/2642313034 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fca100a3420 0x7fca100a58e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:40.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:40.017+0000 7fca28adf640 1 --2- 172.21.15.27:0/2642313034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca24100ca0 0x7fca241017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:40.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:40.017+0000 7fca28adf640 1 --2- 172.21.15.27:0/2642313034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca241002f0 0x7fca24101270 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:40.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:40.017+0000 7fca28adf640 1 -- 172.21.15.27:0/2642313034 >> 172.21.15.27:0/2642313034 conn(0x7fca24077210 msgr2=0x7fca24105850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:40.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:40.017+0000 7fca28adf640 1 -- 172.21.15.27:0/2642313034 shutdown_connections 2024-09-19T08:09:40.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:40.017+0000 7fca28adf640 1 -- 172.21.15.27:0/2642313034 wait complete. 2024-09-19T08:09:40.779 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":4220278108},{"type":"v1","addr":"172.21.15.27:6801","nonce":4220278108}]},"active_addr":"172.21.15.27:6801/4220278108","active_change":"2024-09-19T08:02:12.808194+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.27:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":1827043850}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":913696111}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":4099657868}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":3419400802}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":4167851181}]}]} 2024-09-19T08:09:40.785 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T08:09:40.785 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T08:09:40.785 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:09:40.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:40 smithi155 ceph-mon[35362]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 KiB/s wr, 4 op/s 2024-09-19T08:09:40.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:40 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2642313034' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T08:09:41.001 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:40 smithi027 ceph-mon[31209]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 KiB/s wr, 4 op/s 2024-09-19T08:09:41.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:40 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2642313034' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T08:09:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:40 smithi203 ceph-mon[35198]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 KiB/s wr, 4 op/s 2024-09-19T08:09:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:40 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2642313034' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T08:09:41.045 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:41.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.534+0000 7fc685fdd640 1 -- 172.21.15.27:0/1675494071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc680100eb0 msgr2=0x7fc680106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:41.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.534+0000 7fc685fdd640 1 --2- 172.21.15.27:0/1675494071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc680100eb0 0x7fc680106840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc668009900 tx=0x7fc66802a410 comp rx=0 tx=0).stop 2024-09-19T08:09:41.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.534+0000 7fc685fdd640 1 -- 172.21.15.27:0/1675494071 shutdown_connections 2024-09-19T08:09:41.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.534+0000 7fc685fdd640 1 --2- 172.21.15.27:0/1675494071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc680106f70 0x7fc68010eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:41.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.534+0000 7fc685fdd640 1 --2- 172.21.15.27:0/1675494071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc680100eb0 0x7fc680106840 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:41.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.534+0000 7fc685fdd640 1 --2- 172.21.15.27:0/1675494071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc680100500 0x7fc6801008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:41.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.534+0000 7fc685fdd640 1 -- 172.21.15.27:0/1675494071 >> 172.21.15.27:0/1675494071 conn(0x7fc6800fc5c0 msgr2=0x7fc6800fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:41.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.534+0000 7fc685fdd640 1 -- 172.21.15.27:0/1675494071 shutdown_connections 2024-09-19T08:09:41.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.534+0000 7fc685fdd640 1 -- 172.21.15.27:0/1675494071 wait complete. 2024-09-19T08:09:41.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.535+0000 7fc685fdd640 1 Processor -- start 2024-09-19T08:09:41.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.535+0000 7fc685fdd640 1 -- start start 2024-09-19T08:09:41.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.535+0000 7fc685fdd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc680100500 0x7fc6801984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:41.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.535+0000 7fc685fdd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc680100eb0 0x7fc680198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:41.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.535+0000 7fc685fdd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc680106f70 0x7fc68019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:41.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.535+0000 7fc685fdd640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc680111f90 con 0x7fc680106f70 2024-09-19T08:09:41.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.535+0000 7fc685fdd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc680111e10 con 0x7fc680100eb0 2024-09-19T08:09:41.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.535+0000 7fc685fdd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc680112110 con 0x7fc680100500 2024-09-19T08:09:41.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.535+0000 7fc67ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc680106f70 0x7fc68019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:41.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.535+0000 7fc67ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc680106f70 0x7fc68019cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53606/0 (socket says 172.21.15.27:53606) 2024-09-19T08:09:41.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.535+0000 7fc67ffff640 1 -- 172.21.15.27:0/90547219 learned_addr learned my addr 172.21.15.27:0/90547219 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:41.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.536+0000 7fc67f7fe640 1 --2- 172.21.15.27:0/90547219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc680100500 0x7fc6801984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:41.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.536+0000 7fc67effd640 1 --2- 172.21.15.27:0/90547219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc680100eb0 0x7fc680198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:41.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.536+0000 7fc67ffff640 1 -- 172.21.15.27:0/90547219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc680100500 msgr2=0x7fc6801984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:41.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.536+0000 7fc67ffff640 1 --2- 172.21.15.27:0/90547219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc680100500 0x7fc6801984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:41.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.536+0000 7fc67ffff640 1 -- 172.21.15.27:0/90547219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc680100eb0 msgr2=0x7fc680198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:41.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.536+0000 7fc67ffff640 1 --2- 172.21.15.27:0/90547219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc680100eb0 0x7fc680198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:41.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.536+0000 7fc67ffff640 1 -- 172.21.15.27:0/90547219 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc68019d480 con 0x7fc680106f70 2024-09-19T08:09:41.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.536+0000 7fc67f7fe640 1 --2- 172.21.15.27:0/90547219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc680100500 0x7fc6801984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:09:41.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.536+0000 7fc67ffff640 1 --2- 172.21.15.27:0/90547219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc680106f70 0x7fc68019cda0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc678009fd0 tx=0x7fc67800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:41.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.536+0000 7fc67cff9640 1 -- 172.21.15.27:0/90547219 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc678017070 con 0x7fc680106f70 2024-09-19T08:09:41.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.536+0000 7fc67cff9640 1 -- 172.21.15.27:0/90547219 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc678003e50 con 0x7fc680106f70 2024-09-19T08:09:41.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.536+0000 7fc685fdd640 1 -- 172.21.15.27:0/90547219 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc68019d770 con 0x7fc680106f70 2024-09-19T08:09:41.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.536+0000 7fc67cff9640 1 -- 172.21.15.27:0/90547219 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6780106c0 con 0x7fc680106f70 2024-09-19T08:09:41.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.536+0000 7fc685fdd640 1 -- 172.21.15.27:0/90547219 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6801a5050 con 0x7fc680106f70 2024-09-19T08:09:41.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.537+0000 7fc685fdd640 1 -- 172.21.15.27:0/90547219 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6801008e0 con 0x7fc680106f70 2024-09-19T08:09:41.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.538+0000 7fc67cff9640 1 -- 172.21.15.27:0/90547219 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc678003970 con 0x7fc680106f70 2024-09-19T08:09:41.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.539+0000 7fc67cff9640 1 --2- 172.21.15.27:0/90547219 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc66c0a32d0 0x7fc66c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:41.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.539+0000 7fc67f7fe640 1 --2- 172.21.15.27:0/90547219 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc66c0a32d0 0x7fc66c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:41.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.539+0000 7fc67cff9640 1 -- 172.21.15.27:0/90547219 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fc6780cf710 con 0x7fc680106f70 2024-09-19T08:09:41.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.540+0000 7fc67f7fe640 1 --2- 172.21.15.27:0/90547219 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc66c0a32d0 0x7fc66c0a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc6700058c0 tx=0x7fc670005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:41.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.543+0000 7fc67cff9640 1 -- 172.21.15.27:0/90547219 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc67809c480 con 0x7fc680106f70 2024-09-19T08:09:41.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.721+0000 7fc685fdd640 1 -- 172.21.15.27:0/90547219 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc68010a0e0 con 0x7fc680106f70 2024-09-19T08:09:41.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.723+0000 7fc67cff9640 1 -- 172.21.15.27:0/90547219 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22265 (secure 0 0 0) 0x7fc67809bd80 con 0x7fc680106f70 2024-09-19T08:09:41.723 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:09:41.723 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":81,"fsid":"35b531b0-765d-11ef-bceb-c7b262605968","created":"2024-09-19T08:01:20.929241+0000","modified":"2024-09-19T08:09:11.929828+0000","last_up_change":"2024-09-19T08:08:17.919001+0000","last_in_change":"2024-09-19T08:07:54.277124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:04:29.312984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:09:08.046858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:09:10.223258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66fd6732-4cac-4eda-bf06-50638995ee80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6803","nonce":3645201250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6805","nonce":3645201250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6809","nonce":3645201250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6807","nonce":3645201250}]},"public_addr":"172.21.15.27:6803/3645201250","cluster_addr":"172.21.15.27:6805/3645201250","heartbeat_back_addr":"172.21.15.27:6809/3645201250","heartbeat_front_addr":"172.21.15.27:6807/3645201250","state":["exists","up"]},{"osd":1,"uuid":"36628767-66ac-433b-938e-10e75b51a877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6801","nonce":3977510449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6803","nonce":3977510449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6807","nonce":3977510449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6805","nonce":3977510449}]},"public_addr":"172.21.15.155:6801/3977510449","cluster_addr":"172.21.15.155:6803/3977510449","heartbeat_back_addr":"172.21.15.155:6807/3977510449","heartbeat_front_addr":"172.21.15.155:6805/3977510449","state":["exists","up"]},{"osd":2,"uuid":"3dc80404-a56b-456a-af02-f01e9c6c6dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6801","nonce":3796057016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6803","nonce":3796057016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6807","nonce":3796057016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6805","nonce":3796057016}]},"public_addr":"172.21.15.203:6801/3796057016","cluster_addr":"172.21.15.203:6803/3796057016","heartbeat_back_addr":"172.21.15.203:6807/3796057016","heartbeat_front_addr":"172.21.15.203:6805/3796057016","state":["exists","up"]},{"osd":3,"uuid":"a51077d0-5e04-49b5-bb3e-91711cc45ff1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6811","nonce":1608304347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6813","nonce":1608304347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6817","nonce":1608304347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6815","nonce":1608304347}]},"public_addr":"172.21.15.27:6811/1608304347","cluster_addr":"172.21.15.27:6813/1608304347","heartbeat_back_addr":"172.21.15.27:6817/1608304347","heartbeat_front_addr":"172.21.15.27:6815/1608304347","state":["exists","up"]},{"osd":4,"uuid":"0df35548-90b4-434d-8d7e-c037072c9ae4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6809","nonce":569913150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6811","nonce":569913150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6815","nonce":569913150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6813","nonce":569913150}]},"public_addr":"172.21.15.155:6809/569913150","cluster_addr":"172.21.15.155:6811/569913150","heartbeat_back_addr":"172.21.15.155:6815/569913150","heartbeat_front_addr":"172.21.15.155:6813/569913150","state":["exists","up"]},{"osd":5,"uuid":"de193c5f-1019-43e5-9f4f-6c2aaa4330e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6809","nonce":991491203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6811","nonce":991491203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6815","nonce":991491203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6813","nonce":991491203}]},"public_addr":"172.21.15.203:6809/991491203","cluster_addr":"172.21.15.203:6811/991491203","heartbeat_back_addr":"172.21.15.203:6815/991491203","heartbeat_front_addr":"172.21.15.203:6813/991491203","state":["exists","up"]},{"osd":6,"uuid":"28938e4f-9f22-466f-8cf7-62ee56a0c926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6819","nonce":3516868131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6821","nonce":3516868131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6825","nonce":3516868131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6823","nonce":3516868131}]},"public_addr":"172.21.15.27:6819/3516868131","cluster_addr":"172.21.15.27:6821/3516868131","heartbeat_back_addr":"172.21.15.27:6825/3516868131","heartbeat_front_addr":"172.21.15.27:6823/3516868131","state":["exists","up"]},{"osd":7,"uuid":"855f1728-be52-4445-8561-a90c08f2b2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6817","nonce":2047506436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6819","nonce":2047506436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6823","nonce":2047506436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6821","nonce":2047506436}]},"public_addr":"172.21.15.155:6817/2047506436","cluster_addr":"172.21.15.155:6819/2047506436","heartbeat_back_addr":"172.21.15.155:6823/2047506436","heartbeat_front_addr":"172.21.15.155:6821/2047506436","state":["exists","up"]},{"osd":8,"uuid":"5d7a8ffd-a039-403e-8b9a-c80e19fd67ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6817","nonce":199970687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6819","nonce":199970687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6823","nonce":199970687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6821","nonce":199970687}]},"public_addr":"172.21.15.203:6817/199970687","cluster_addr":"172.21.15.203:6819/199970687","heartbeat_back_addr":"172.21.15.203:6823/199970687","heartbeat_front_addr":"172.21.15.203:6821/199970687","state":["exists","up"]},{"osd":9,"uuid":"cdb90242-80a1-4cef-b5e3-ddecb05664e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6827","nonce":118390483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6829","nonce":118390483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6833","nonce":118390483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6831","nonce":118390483}]},"public_addr":"172.21.15.27:6827/118390483","cluster_addr":"172.21.15.27:6829/118390483","heartbeat_back_addr":"172.21.15.27:6833/118390483","heartbeat_front_addr":"172.21.15.27:6831/118390483","state":["exists","up"]},{"osd":10,"uuid":"c7f4c9da-d913-47a5-8629-53de21efe8c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6825","nonce":1687418565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6827","nonce":1687418565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6831","nonce":1687418565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6829","nonce":1687418565}]},"public_addr":"172.21.15.155:6825/1687418565","cluster_addr":"172.21.15.155:6827/1687418565","heartbeat_back_addr":"172.21.15.155:6831/1687418565","heartbeat_front_addr":"172.21.15.155:6829/1687418565","state":["exists","up"]},{"osd":11,"uuid":"45c11a90-585e-46fa-a5a0-51a29e29eba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6825","nonce":224768827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6827","nonce":224768827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6831","nonce":224768827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6829","nonce":224768827}]},"public_addr":"172.21.15.203:6825/224768827","cluster_addr":"172.21.15.203:6827/224768827","heartbeat_back_addr":"172.21.15.203:6831/224768827","heartbeat_front_addr":"172.21.15.203:6829/224768827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:03:35.559549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:00.526006+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:25.809346+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:51.889445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:17.246017+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:43.515854+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:08.638182+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:34.653060+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:59.469837+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:26.122937+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:50.196159+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:08:16.245770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:6800/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/958829150":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1174736321":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1908865720":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/416476667":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6800/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/1717932879":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1963219497":"2024-09-20T08:01:48.686812+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:09:41.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.725+0000 7fc685fdd640 1 -- 172.21.15.27:0/90547219 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc66c0a32d0 msgr2=0x7fc66c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:41.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.725+0000 7fc685fdd640 1 --2- 172.21.15.27:0/90547219 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc66c0a32d0 0x7fc66c0a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc6700058c0 tx=0x7fc670005850 comp rx=0 tx=0).stop 2024-09-19T08:09:41.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.725+0000 7fc685fdd640 1 -- 172.21.15.27:0/90547219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc680106f70 msgr2=0x7fc68019cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:41.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.725+0000 7fc685fdd640 1 --2- 172.21.15.27:0/90547219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc680106f70 0x7fc68019cda0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc678009fd0 tx=0x7fc67800b260 comp rx=0 tx=0).stop 2024-09-19T08:09:41.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.725+0000 7fc685fdd640 1 -- 172.21.15.27:0/90547219 shutdown_connections 2024-09-19T08:09:41.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.725+0000 7fc685fdd640 1 --2- 172.21.15.27:0/90547219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc680106f70 0x7fc68019cda0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:41.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.725+0000 7fc685fdd640 1 --2- 172.21.15.27:0/90547219 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc66c0a32d0 0x7fc66c0a5790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:41.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.725+0000 7fc685fdd640 1 --2- 172.21.15.27:0/90547219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc680100eb0 0x7fc680198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:41.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.725+0000 7fc685fdd640 1 --2- 172.21.15.27:0/90547219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc680100500 0x7fc6801984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:41.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.725+0000 7fc685fdd640 1 -- 172.21.15.27:0/90547219 >> 172.21.15.27:0/90547219 conn(0x7fc6800fc5c0 msgr2=0x7fc6801053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:41.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.726+0000 7fc685fdd640 1 -- 172.21.15.27:0/90547219 shutdown_connections 2024-09-19T08:09:41.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:41.726+0000 7fc685fdd640 1 -- 172.21.15.27:0/90547219 wait complete. 2024-09-19T08:09:42.356 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T08:09:42.357 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:09:42.613 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:42.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:42 smithi155 ceph-mon[35362]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.4 KiB/s wr, 3 op/s 2024-09-19T08:09:42.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:42 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/90547219' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:09:43.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:42 smithi027 ceph-mon[31209]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.4 KiB/s wr, 3 op/s 2024-09-19T08:09:43.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:42 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/90547219' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:09:43.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:42 smithi203 ceph-mon[35198]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.4 KiB/s wr, 3 op/s 2024-09-19T08:09:43.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:42 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/90547219' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:09:43.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.103+0000 7f5f9f73b640 1 -- 172.21.15.27:0/621987982 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f98100b20 msgr2=0x7f5f98100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:43.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.103+0000 7f5f9f73b640 1 --2- 172.21.15.27:0/621987982 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f98100b20 0x7f5f98100f00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009900 tx=0x7f5f9002a410 comp rx=0 tx=0).stop 2024-09-19T08:09:43.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.104+0000 7f5f9f73b640 1 -- 172.21.15.27:0/621987982 shutdown_connections 2024-09-19T08:09:43.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.104+0000 7f5f9f73b640 1 --2- 172.21.15.27:0/621987982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f9810e500 0x7f5f98110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:43.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.104+0000 7f5f9f73b640 1 --2- 172.21.15.27:0/621987982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f98101440 0x7f5f9810df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:43.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.104+0000 7f5f9f73b640 1 --2- 172.21.15.27:0/621987982 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f98100b20 0x7f5f98100f00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:43.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.104+0000 7f5f9f73b640 1 -- 172.21.15.27:0/621987982 >> 172.21.15.27:0/621987982 conn(0x7f5f980fc7d0 msgr2=0x7f5f980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:43.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.104+0000 7f5f9f73b640 1 -- 172.21.15.27:0/621987982 shutdown_connections 2024-09-19T08:09:43.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.104+0000 7f5f9f73b640 1 -- 172.21.15.27:0/621987982 wait complete. 2024-09-19T08:09:43.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.104+0000 7f5f9f73b640 1 Processor -- start 2024-09-19T08:09:43.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.104+0000 7f5f9f73b640 1 -- start start 2024-09-19T08:09:43.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.105+0000 7f5f9f73b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f98100b20 0x7f5f981a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:43.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.105+0000 7f5f9f73b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f98101440 0x7f5f981a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:43.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.105+0000 7f5f9f73b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f9810e500 0x7f5f9819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:43.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.105+0000 7f5f9f73b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5f981142f0 con 0x7f5f98101440 2024-09-19T08:09:43.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.105+0000 7f5f9f73b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5f98114170 con 0x7f5f9810e500 2024-09-19T08:09:43.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.105+0000 7f5f9f73b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5f98114470 con 0x7f5f98100b20 2024-09-19T08:09:43.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.105+0000 7f5f9ccd6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f98101440 0x7f5f981a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:43.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.105+0000 7f5f9ccd6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f98101440 0x7f5f981a0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53620/0 (socket says 172.21.15.27:53620) 2024-09-19T08:09:43.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.105+0000 7f5f9ccd6640 1 -- 172.21.15.27:0/2735319847 learned_addr learned my addr 172.21.15.27:0/2735319847 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:43.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.105+0000 7f5f9d4d7640 1 --2- 172.21.15.27:0/2735319847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f98100b20 0x7f5f981a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:43.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.105+0000 7f5f9dcd8640 1 --2- 172.21.15.27:0/2735319847 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f9810e500 0x7f5f9819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:43.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.105+0000 7f5f9ccd6640 1 -- 172.21.15.27:0/2735319847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f98100b20 msgr2=0x7f5f981a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:43.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.105+0000 7f5f9ccd6640 1 --2- 172.21.15.27:0/2735319847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f98100b20 0x7f5f981a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:43.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.105+0000 7f5f9ccd6640 1 -- 172.21.15.27:0/2735319847 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f9810e500 msgr2=0x7f5f9819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:43.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.105+0000 7f5f9ccd6640 1 --2- 172.21.15.27:0/2735319847 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f9810e500 0x7f5f9819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:43.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.105+0000 7f5f9ccd6640 1 -- 172.21.15.27:0/2735319847 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9819acd0 con 0x7f5f98101440 2024-09-19T08:09:43.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.105+0000 7f5f9ccd6640 1 --2- 172.21.15.27:0/2735319847 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f98101440 0x7f5f981a0920 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00b450 tx=0x7f5f8c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:43.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.105+0000 7f5f967fc640 1 -- 172.21.15.27:0/2735319847 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c015020 con 0x7f5f98101440 2024-09-19T08:09:43.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.105+0000 7f5f9f73b640 1 -- 172.21.15.27:0/2735319847 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f9819afc0 con 0x7f5f98101440 2024-09-19T08:09:43.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.105+0000 7f5f967fc640 1 -- 172.21.15.27:0/2735319847 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f8c011d70 con 0x7f5f98101440 2024-09-19T08:09:43.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.106+0000 7f5f967fc640 1 -- 172.21.15.27:0/2735319847 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c00f340 con 0x7f5f98101440 2024-09-19T08:09:43.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.106+0000 7f5f9f73b640 1 -- 172.21.15.27:0/2735319847 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f981a72b0 con 0x7f5f98101440 2024-09-19T08:09:43.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.106+0000 7f5f9f73b640 1 -- 172.21.15.27:0/2735319847 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f9806a850 con 0x7f5f98101440 2024-09-19T08:09:43.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.108+0000 7f5f967fc640 1 -- 172.21.15.27:0/2735319847 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5f8c018020 con 0x7f5f98101440 2024-09-19T08:09:43.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.109+0000 7f5f967fc640 1 --2- 172.21.15.27:0/2735319847 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f5f800a32d0 0x7f5f800a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:43.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.109+0000 7f5f9d4d7640 1 --2- 172.21.15.27:0/2735319847 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f5f800a32d0 0x7f5f800a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:43.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.109+0000 7f5f967fc640 1 -- 172.21.15.27:0/2735319847 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f5f8c0cf340 con 0x7f5f98101440 2024-09-19T08:09:43.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.109+0000 7f5f9d4d7640 1 --2- 172.21.15.27:0/2735319847 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f5f800a32d0 0x7f5f800a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5f900096c0 tx=0x7f5f90031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:43.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.113+0000 7f5f967fc640 1 -- 172.21.15.27:0/2735319847 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5f8c01f020 con 0x7f5f98101440 2024-09-19T08:09:43.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.294+0000 7f5f9f73b640 1 -- 172.21.15.27:0/2735319847 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5f98109600 con 0x7f5f98101440 2024-09-19T08:09:43.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.295+0000 7f5f967fc640 1 -- 172.21.15.27:0/2735319847 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22265 (secure 0 0 0) 0x7f5f8c00d040 con 0x7f5f98101440 2024-09-19T08:09:43.295 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:09:43.295 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":81,"fsid":"35b531b0-765d-11ef-bceb-c7b262605968","created":"2024-09-19T08:01:20.929241+0000","modified":"2024-09-19T08:09:11.929828+0000","last_up_change":"2024-09-19T08:08:17.919001+0000","last_in_change":"2024-09-19T08:07:54.277124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:04:29.312984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:09:08.046858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:09:10.223258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66fd6732-4cac-4eda-bf06-50638995ee80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6803","nonce":3645201250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6805","nonce":3645201250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6809","nonce":3645201250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6807","nonce":3645201250}]},"public_addr":"172.21.15.27:6803/3645201250","cluster_addr":"172.21.15.27:6805/3645201250","heartbeat_back_addr":"172.21.15.27:6809/3645201250","heartbeat_front_addr":"172.21.15.27:6807/3645201250","state":["exists","up"]},{"osd":1,"uuid":"36628767-66ac-433b-938e-10e75b51a877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6801","nonce":3977510449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6803","nonce":3977510449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6807","nonce":3977510449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6805","nonce":3977510449}]},"public_addr":"172.21.15.155:6801/3977510449","cluster_addr":"172.21.15.155:6803/3977510449","heartbeat_back_addr":"172.21.15.155:6807/3977510449","heartbeat_front_addr":"172.21.15.155:6805/3977510449","state":["exists","up"]},{"osd":2,"uuid":"3dc80404-a56b-456a-af02-f01e9c6c6dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6801","nonce":3796057016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6803","nonce":3796057016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6807","nonce":3796057016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6805","nonce":3796057016}]},"public_addr":"172.21.15.203:6801/3796057016","cluster_addr":"172.21.15.203:6803/3796057016","heartbeat_back_addr":"172.21.15.203:6807/3796057016","heartbeat_front_addr":"172.21.15.203:6805/3796057016","state":["exists","up"]},{"osd":3,"uuid":"a51077d0-5e04-49b5-bb3e-91711cc45ff1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6811","nonce":1608304347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6813","nonce":1608304347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6817","nonce":1608304347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6815","nonce":1608304347}]},"public_addr":"172.21.15.27:6811/1608304347","cluster_addr":"172.21.15.27:6813/1608304347","heartbeat_back_addr":"172.21.15.27:6817/1608304347","heartbeat_front_addr":"172.21.15.27:6815/1608304347","state":["exists","up"]},{"osd":4,"uuid":"0df35548-90b4-434d-8d7e-c037072c9ae4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6809","nonce":569913150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6811","nonce":569913150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6815","nonce":569913150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6813","nonce":569913150}]},"public_addr":"172.21.15.155:6809/569913150","cluster_addr":"172.21.15.155:6811/569913150","heartbeat_back_addr":"172.21.15.155:6815/569913150","heartbeat_front_addr":"172.21.15.155:6813/569913150","state":["exists","up"]},{"osd":5,"uuid":"de193c5f-1019-43e5-9f4f-6c2aaa4330e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6809","nonce":991491203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6811","nonce":991491203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6815","nonce":991491203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6813","nonce":991491203}]},"public_addr":"172.21.15.203:6809/991491203","cluster_addr":"172.21.15.203:6811/991491203","heartbeat_back_addr":"172.21.15.203:6815/991491203","heartbeat_front_addr":"172.21.15.203:6813/991491203","state":["exists","up"]},{"osd":6,"uuid":"28938e4f-9f22-466f-8cf7-62ee56a0c926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6819","nonce":3516868131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6821","nonce":3516868131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6825","nonce":3516868131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6823","nonce":3516868131}]},"public_addr":"172.21.15.27:6819/3516868131","cluster_addr":"172.21.15.27:6821/3516868131","heartbeat_back_addr":"172.21.15.27:6825/3516868131","heartbeat_front_addr":"172.21.15.27:6823/3516868131","state":["exists","up"]},{"osd":7,"uuid":"855f1728-be52-4445-8561-a90c08f2b2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6817","nonce":2047506436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6819","nonce":2047506436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6823","nonce":2047506436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6821","nonce":2047506436}]},"public_addr":"172.21.15.155:6817/2047506436","cluster_addr":"172.21.15.155:6819/2047506436","heartbeat_back_addr":"172.21.15.155:6823/2047506436","heartbeat_front_addr":"172.21.15.155:6821/2047506436","state":["exists","up"]},{"osd":8,"uuid":"5d7a8ffd-a039-403e-8b9a-c80e19fd67ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6817","nonce":199970687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6819","nonce":199970687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6823","nonce":199970687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6821","nonce":199970687}]},"public_addr":"172.21.15.203:6817/199970687","cluster_addr":"172.21.15.203:6819/199970687","heartbeat_back_addr":"172.21.15.203:6823/199970687","heartbeat_front_addr":"172.21.15.203:6821/199970687","state":["exists","up"]},{"osd":9,"uuid":"cdb90242-80a1-4cef-b5e3-ddecb05664e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6827","nonce":118390483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6829","nonce":118390483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6833","nonce":118390483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6831","nonce":118390483}]},"public_addr":"172.21.15.27:6827/118390483","cluster_addr":"172.21.15.27:6829/118390483","heartbeat_back_addr":"172.21.15.27:6833/118390483","heartbeat_front_addr":"172.21.15.27:6831/118390483","state":["exists","up"]},{"osd":10,"uuid":"c7f4c9da-d913-47a5-8629-53de21efe8c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6825","nonce":1687418565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6827","nonce":1687418565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6831","nonce":1687418565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6829","nonce":1687418565}]},"public_addr":"172.21.15.155:6825/1687418565","cluster_addr":"172.21.15.155:6827/1687418565","heartbeat_back_addr":"172.21.15.155:6831/1687418565","heartbeat_front_addr":"172.21.15.155:6829/1687418565","state":["exists","up"]},{"osd":11,"uuid":"45c11a90-585e-46fa-a5a0-51a29e29eba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6825","nonce":224768827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6827","nonce":224768827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6831","nonce":224768827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6829","nonce":224768827}]},"public_addr":"172.21.15.203:6825/224768827","cluster_addr":"172.21.15.203:6827/224768827","heartbeat_back_addr":"172.21.15.203:6831/224768827","heartbeat_front_addr":"172.21.15.203:6829/224768827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:03:35.559549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:00.526006+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:25.809346+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:51.889445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:17.246017+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:43.515854+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:08.638182+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:34.653060+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:59.469837+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:26.122937+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:50.196159+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:08:16.245770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:6800/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/958829150":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1174736321":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1908865720":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/416476667":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6800/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/1717932879":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1963219497":"2024-09-20T08:01:48.686812+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:09:43.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.297+0000 7f5f9f73b640 1 -- 172.21.15.27:0/2735319847 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f5f800a32d0 msgr2=0x7f5f800a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:43.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.297+0000 7f5f9f73b640 1 --2- 172.21.15.27:0/2735319847 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f5f800a32d0 0x7f5f800a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5f900096c0 tx=0x7f5f90031490 comp rx=0 tx=0).stop 2024-09-19T08:09:43.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.297+0000 7f5f9f73b640 1 -- 172.21.15.27:0/2735319847 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f98101440 msgr2=0x7f5f981a0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:43.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.297+0000 7f5f9f73b640 1 --2- 172.21.15.27:0/2735319847 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f98101440 0x7f5f981a0920 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00b450 tx=0x7f5f8c00b910 comp rx=0 tx=0).stop 2024-09-19T08:09:43.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.297+0000 7f5f9f73b640 1 -- 172.21.15.27:0/2735319847 shutdown_connections 2024-09-19T08:09:43.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.297+0000 7f5f9f73b640 1 --2- 172.21.15.27:0/2735319847 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f5f800a32d0 0x7f5f800a5790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:43.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.297+0000 7f5f9f73b640 1 --2- 172.21.15.27:0/2735319847 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f9810e500 0x7f5f9819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:43.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.297+0000 7f5f9f73b640 1 --2- 172.21.15.27:0/2735319847 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f98101440 0x7f5f981a0920 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:43.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.297+0000 7f5f9f73b640 1 --2- 172.21.15.27:0/2735319847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f98100b20 0x7f5f981a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:43.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.297+0000 7f5f9f73b640 1 -- 172.21.15.27:0/2735319847 >> 172.21.15.27:0/2735319847 conn(0x7f5f980fc7d0 msgr2=0x7f5f980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:43.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.297+0000 7f5f9f73b640 1 -- 172.21.15.27:0/2735319847 shutdown_connections 2024-09-19T08:09:43.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:43.297+0000 7f5f9f73b640 1 -- 172.21.15.27:0/2735319847 wait complete. 2024-09-19T08:09:43.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:43 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2735319847' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:09:44.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:43 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2735319847' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:09:44.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:43 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2735319847' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:09:44.032 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T08:09:44.033 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T08:09:44.033 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T08:09:44.033 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T08:09:44.034 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T08:09:44.034 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T08:09:44.035 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T08:09:44.035 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T08:09:44.036 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T08:09:44.037 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T08:09:44.037 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T08:09:44.038 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T08:09:44.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:44 smithi027 ceph-mon[31209]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 3.6 KiB/s wr, 4 op/s 2024-09-19T08:09:44.770 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:44.770 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:44.777 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:44.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:44 smithi155 ceph-mon[35362]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 3.6 KiB/s wr, 4 op/s 2024-09-19T08:09:45.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:44 smithi203 ceph-mon[35198]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 3.6 KiB/s wr, 4 op/s 2024-09-19T08:09:45.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.539+0000 7ff00c4b3640 1 -- 172.21.15.27:0/1352947158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff004102dd0 msgr2=0x7ff0041031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:45.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.539+0000 7ff00c4b3640 1 --2- 172.21.15.27:0/1352947158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff004102dd0 0x7ff0041031b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7feff8009cd0 tx=0x7feff802a8f0 comp rx=0 tx=0).stop 2024-09-19T08:09:45.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.539+0000 7ff00c4b3640 1 -- 172.21.15.27:0/1352947158 shutdown_connections 2024-09-19T08:09:45.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.539+0000 7ff00c4b3640 1 --2- 172.21.15.27:0/1352947158 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff004108300 0x7ff00410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:45.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.539+0000 7ff00c4b3640 1 --2- 172.21.15.27:0/1352947158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff004103780 0x7ff004107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:45.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.539+0000 7ff00c4b3640 1 --2- 172.21.15.27:0/1352947158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff004102dd0 0x7ff0041031b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:45.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.539+0000 7ff00c4b3640 1 -- 172.21.15.27:0/1352947158 >> 172.21.15.27:0/1352947158 conn(0x7ff0040fc7d0 msgr2=0x7ff0040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:45.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.539+0000 7ff00c4b3640 1 -- 172.21.15.27:0/1352947158 shutdown_connections 2024-09-19T08:09:45.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.539+0000 7ff00c4b3640 1 -- 172.21.15.27:0/1352947158 wait complete. 2024-09-19T08:09:45.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.540+0000 7ff00c4b3640 1 Processor -- start 2024-09-19T08:09:45.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.540+0000 7ff00c4b3640 1 -- start start 2024-09-19T08:09:45.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.540+0000 7ff00c4b3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff004102dd0 0x7ff0041a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:45.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.540+0000 7ff00c4b3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff004103780 0x7ff0041a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:45.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.540+0000 7ff00c4b3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff004108300 0x7ff00419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:45.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.540+0000 7ff00c4b3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff004112170 con 0x7ff004108300 2024-09-19T08:09:45.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.540+0000 7ff00c4b3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff004111ff0 con 0x7ff004103780 2024-09-19T08:09:45.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.540+0000 7ff00c4b3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff0041122f0 con 0x7ff004102dd0 2024-09-19T08:09:45.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.540+0000 7ff00aa50640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff004108300 0x7ff00419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:45.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.540+0000 7ff00aa50640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff004108300 0x7ff00419a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53640/0 (socket says 172.21.15.27:53640) 2024-09-19T08:09:45.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.540+0000 7ff00aa50640 1 -- 172.21.15.27:0/978002537 learned_addr learned my addr 172.21.15.27:0/978002537 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:45.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.540+0000 7ff009a4e640 1 --2- 172.21.15.27:0/978002537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff004103780 0x7ff0041a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:45.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.540+0000 7ff00a24f640 1 --2- 172.21.15.27:0/978002537 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff004102dd0 0x7ff0041a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:45.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.541+0000 7ff00aa50640 1 -- 172.21.15.27:0/978002537 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff004102dd0 msgr2=0x7ff0041a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:45.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.541+0000 7ff00aa50640 1 --2- 172.21.15.27:0/978002537 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff004102dd0 0x7ff0041a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:45.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.541+0000 7ff00aa50640 1 -- 172.21.15.27:0/978002537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff004103780 msgr2=0x7ff0041a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:45.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.541+0000 7ff00aa50640 1 --2- 172.21.15.27:0/978002537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff004103780 0x7ff0041a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:45.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.541+0000 7ff00aa50640 1 -- 172.21.15.27:0/978002537 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff00419af90 con 0x7ff004108300 2024-09-19T08:09:45.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.541+0000 7ff00aa50640 1 --2- 172.21.15.27:0/978002537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff004108300 0x7ff00419a720 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7feffc009fd0 tx=0x7feffc00b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:45.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.541+0000 7feff77fe640 1 -- 172.21.15.27:0/978002537 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc015020 con 0x7ff004108300 2024-09-19T08:09:45.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.541+0000 7feff77fe640 1 -- 172.21.15.27:0/978002537 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feffc011d10 con 0x7ff004108300 2024-09-19T08:09:45.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.541+0000 7ff00c4b3640 1 -- 172.21.15.27:0/978002537 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff00419b280 con 0x7ff004108300 2024-09-19T08:09:45.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.541+0000 7feff77fe640 1 -- 172.21.15.27:0/978002537 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc00f2e0 con 0x7ff004108300 2024-09-19T08:09:45.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.541+0000 7ff00c4b3640 1 -- 172.21.15.27:0/978002537 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0041a75d0 con 0x7ff004108300 2024-09-19T08:09:45.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.542+0000 7ff00c4b3640 1 -- 172.21.15.27:0/978002537 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff004062940 con 0x7ff004108300 2024-09-19T08:09:45.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.544+0000 7feff77fe640 1 -- 172.21.15.27:0/978002537 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7feffc018020 con 0x7ff004108300 2024-09-19T08:09:45.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.545+0000 7feff77fe640 1 --2- 172.21.15.27:0/978002537 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7feff00a3350 0x7feff00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:45.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.545+0000 7ff00a24f640 1 --2- 172.21.15.27:0/978002537 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7feff00a3350 0x7feff00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:45.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.545+0000 7feff77fe640 1 -- 172.21.15.27:0/978002537 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7feffc0cf5d0 con 0x7ff004108300 2024-09-19T08:09:45.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.545+0000 7feff77fe640 1 --2- 172.21.15.27:0/978002537 >> [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250] conn(0x7feff00acba0 0x7feff00aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:45.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.545+0000 7feff77fe640 1 -- 172.21.15.27:0/978002537 --> [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feffc012e80 con 0x7feff00acba0 2024-09-19T08:09:45.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.545+0000 7feff77fe640 1 -- 172.21.15.27:0/978002537 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7feffc0cfab0 con 0x7ff004108300 2024-09-19T08:09:45.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.545+0000 7ff009a4e640 1 --2- 172.21.15.27:0/978002537 >> [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250] conn(0x7feff00acba0 0x7feff00aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:45.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.545+0000 7ff00a24f640 1 --2- 172.21.15.27:0/978002537 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7feff00a3350 0x7feff00a5810 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feff8009430 tx=0x7feff8009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:45.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.546+0000 7ff009a4e640 1 --2- 172.21.15.27:0/978002537 >> [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250] conn(0x7feff00acba0 0x7feff00aefc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:45.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.546+0000 7feff77fe640 1 -- 172.21.15.27:0/978002537 <== osd.0 v2:172.21.15.27:6802/3645201250 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feffc012e80 con 0x7feff00acba0 2024-09-19T08:09:45.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.560+0000 7ff00c4b3640 1 -- 172.21.15.27:0/978002537 --> [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff004062dc0 con 0x7feff00acba0 2024-09-19T08:09:45.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.560+0000 7feff77fe640 1 -- 172.21.15.27:0/978002537 <== osd.0 v2:172.21.15.27:6802/3645201250 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff004062dc0 con 0x7feff00acba0 2024-09-19T08:09:45.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.561+0000 7ff00c4b3640 1 -- 172.21.15.27:0/978002537 >> [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250] conn(0x7feff00acba0 msgr2=0x7feff00aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:45.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.561+0000 7ff00c4b3640 1 --2- 172.21.15.27:0/978002537 >> [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250] conn(0x7feff00acba0 0x7feff00aefc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:45.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.561+0000 7ff00c4b3640 1 -- 172.21.15.27:0/978002537 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7feff00a3350 msgr2=0x7feff00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:45.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.561+0000 7ff00c4b3640 1 --2- 172.21.15.27:0/978002537 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7feff00a3350 0x7feff00a5810 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feff8009430 tx=0x7feff8009360 comp rx=0 tx=0).stop 2024-09-19T08:09:45.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.561+0000 7ff00c4b3640 1 -- 172.21.15.27:0/978002537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff004108300 msgr2=0x7ff00419a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:45.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.561+0000 7ff00c4b3640 1 --2- 172.21.15.27:0/978002537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff004108300 0x7ff00419a720 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7feffc009fd0 tx=0x7feffc00b820 comp rx=0 tx=0).stop 2024-09-19T08:09:45.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.561+0000 7ff00aa50640 1 -- 172.21.15.27:0/978002537 reap_dead start 2024-09-19T08:09:45.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.561+0000 7ff00c4b3640 1 -- 172.21.15.27:0/978002537 shutdown_connections 2024-09-19T08:09:45.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.561+0000 7ff00c4b3640 1 -- 172.21.15.27:0/978002537 >> 172.21.15.27:0/978002537 conn(0x7ff0040fc7d0 msgr2=0x7ff004100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:45.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.561+0000 7ff00c4b3640 1 -- 172.21.15.27:0/978002537 shutdown_connections 2024-09-19T08:09:45.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.561+0000 7ff00c4b3640 1 -- 172.21.15.27:0/978002537 wait complete. 2024-09-19T08:09:45.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.756+0000 7fd2d642e640 1 -- 172.21.15.27:0/2247913061 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2d0102570 msgr2=0x7fd2d01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:45.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.756+0000 7fd2d642e640 1 --2- 172.21.15.27:0/2247913061 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2d0102570 0x7fd2d01029b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4009900 tx=0x7fd2c402a480 comp rx=0 tx=0).stop 2024-09-19T08:09:45.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.757+0000 7fd2d642e640 1 -- 172.21.15.27:0/2247913061 shutdown_connections 2024-09-19T08:09:45.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.757+0000 7fd2d642e640 1 --2- 172.21.15.27:0/2247913061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2d0102ef0 0x7fd2d010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:45.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.757+0000 7fd2d642e640 1 --2- 172.21.15.27:0/2247913061 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2d0102570 0x7fd2d01029b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:45.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.757+0000 7fd2d642e640 1 --2- 172.21.15.27:0/2247913061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d0100e20 0x7fd2d0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:45.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.757+0000 7fd2d642e640 1 -- 172.21.15.27:0/2247913061 >> 172.21.15.27:0/2247913061 conn(0x7fd2d00fc7d0 msgr2=0x7fd2d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:45.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.757+0000 7fd2d642e640 1 -- 172.21.15.27:0/2247913061 shutdown_connections 2024-09-19T08:09:45.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.757+0000 7fd2d642e640 1 -- 172.21.15.27:0/2247913061 wait complete. 2024-09-19T08:09:45.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.757+0000 7fd2d642e640 1 Processor -- start 2024-09-19T08:09:45.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.757+0000 7fd2d642e640 1 -- start start 2024-09-19T08:09:45.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.758+0000 7fd2d642e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2d0100e20 0x7fd2d0199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:45.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.758+0000 7fd2d642e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d0102570 0x7fd2d0199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:45.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.758+0000 7fd2d642e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2d0102ef0 0x7fd2d01a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:45.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.758+0000 7fd2d642e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d0110f80 con 0x7fd2d0102ef0 2024-09-19T08:09:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.758+0000 7fd2d642e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d0110e00 con 0x7fd2d0102570 2024-09-19T08:09:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.758+0000 7fd2d642e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d0111100 con 0x7fd2d0100e20 2024-09-19T08:09:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.758+0000 7fd2d49cb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2d0102ef0 0x7fd2d01a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.758+0000 7fd2d49cb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2d0102ef0 0x7fd2d01a43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53654/0 (socket says 172.21.15.27:53654) 2024-09-19T08:09:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.758+0000 7fd2d49cb640 1 -- 172.21.15.27:0/932203594 learned_addr learned my addr 172.21.15.27:0/932203594 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.758+0000 7fd2cffff640 1 --2- 172.21.15.27:0/932203594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2d0100e20 0x7fd2d0199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.758+0000 7fd2cf7fe640 1 --2- 172.21.15.27:0/932203594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d0102570 0x7fd2d0199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.758+0000 7fd2d49cb640 1 -- 172.21.15.27:0/932203594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2d0100e20 msgr2=0x7fd2d0199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.758+0000 7fd2d49cb640 1 --2- 172.21.15.27:0/932203594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2d0100e20 0x7fd2d0199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.758+0000 7fd2d49cb640 1 -- 172.21.15.27:0/932203594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d0102570 msgr2=0x7fd2d0199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:45.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.758+0000 7fd2d49cb640 1 --2- 172.21.15.27:0/932203594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d0102570 0x7fd2d0199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:45.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.759+0000 7fd2d49cb640 1 -- 172.21.15.27:0/932203594 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d01a4910 con 0x7fd2d0102ef0 2024-09-19T08:09:45.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.759+0000 7fd2d49cb640 1 --2- 172.21.15.27:0/932203594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2d0102ef0 0x7fd2d01a43d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800eaa0 tx=0x7fd2c800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:45.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.759+0000 7fd2cd7fa640 1 -- 172.21.15.27:0/932203594 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c800cdb0 con 0x7fd2d0102ef0 2024-09-19T08:09:45.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.759+0000 7fd2d642e640 1 -- 172.21.15.27:0/932203594 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d01a4ae0 con 0x7fd2d0102ef0 2024-09-19T08:09:45.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.759+0000 7fd2d642e640 1 -- 172.21.15.27:0/932203594 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d01a4ff0 con 0x7fd2d0102ef0 2024-09-19T08:09:45.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.759+0000 7fd2cd7fa640 1 -- 172.21.15.27:0/932203594 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2c8005020 con 0x7fd2d0102ef0 2024-09-19T08:09:45.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.759+0000 7fd2cd7fa640 1 -- 172.21.15.27:0/932203594 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c80116b0 con 0x7fd2d0102ef0 2024-09-19T08:09:45.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.760+0000 7fd2d642e640 1 -- 172.21.15.27:0/932203594 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd2bc001030 con 0x7fd2d0102ef0 2024-09-19T08:09:45.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.761+0000 7fd2cd7fa640 1 -- 172.21.15.27:0/932203594 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd2c8004a40 con 0x7fd2d0102ef0 2024-09-19T08:09:45.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.762+0000 7fd2cd7fa640 1 --2- 172.21.15.27:0/932203594 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fd2b80a3350 0x7fd2b80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:45.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.762+0000 7fd2cffff640 1 --2- 172.21.15.27:0/932203594 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fd2b80a3350 0x7fd2b80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:45.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.763+0000 7fd2cd7fa640 1 -- 172.21.15.27:0/932203594 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fd2c80cfd30 con 0x7fd2d0102ef0 2024-09-19T08:09:45.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.763+0000 7fd2cd7fa640 1 --2- 172.21.15.27:0/932203594 >> [v2:172.21.15.203:6800/3796057016,v1:172.21.15.203:6801/3796057016] conn(0x7fd2b80acba0 0x7fd2b80aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:45.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.763+0000 7fd2cd7fa640 1 -- 172.21.15.27:0/932203594 --> [v2:172.21.15.203:6800/3796057016,v1:172.21.15.203:6801/3796057016] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2c8014ec0 con 0x7fd2b80acba0 2024-09-19T08:09:45.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.763+0000 7fd2cd7fa640 1 -- 172.21.15.27:0/932203594 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fd2c80d00e0 con 0x7fd2d0102ef0 2024-09-19T08:09:45.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.763+0000 7fd2cffff640 1 --2- 172.21.15.27:0/932203594 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fd2b80a3350 0x7fd2b80a5810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0005d00 tx=0x7fd2c000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:45.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.763+0000 7fd2cf7fe640 1 --2- 172.21.15.27:0/932203594 >> [v2:172.21.15.203:6800/3796057016,v1:172.21.15.203:6801/3796057016] conn(0x7fd2b80acba0 0x7fd2b80aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:45.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.764+0000 7fd2cf7fe640 1 --2- 172.21.15.27:0/932203594 >> [v2:172.21.15.203:6800/3796057016,v1:172.21.15.203:6801/3796057016] conn(0x7fd2b80acba0 0x7fd2b80aefc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:45.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.765+0000 7fd2cd7fa640 1 -- 172.21.15.27:0/932203594 <== osd.2 v2:172.21.15.203:6800/3796057016 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd2c8014ec0 con 0x7fd2b80acba0 2024-09-19T08:09:45.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.778+0000 7fd2d642e640 1 -- 172.21.15.27:0/932203594 --> [v2:172.21.15.203:6800/3796057016,v1:172.21.15.203:6801/3796057016] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd2bc002dd0 con 0x7fd2b80acba0 2024-09-19T08:09:45.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.779+0000 7fd2cd7fa640 1 -- 172.21.15.27:0/932203594 <== osd.2 v2:172.21.15.203:6800/3796057016 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd2bc002dd0 con 0x7fd2b80acba0 2024-09-19T08:09:45.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.779+0000 7fd2d642e640 1 -- 172.21.15.27:0/932203594 >> [v2:172.21.15.203:6800/3796057016,v1:172.21.15.203:6801/3796057016] conn(0x7fd2b80acba0 msgr2=0x7fd2b80aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:45.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.779+0000 7fd2d642e640 1 --2- 172.21.15.27:0/932203594 >> [v2:172.21.15.203:6800/3796057016,v1:172.21.15.203:6801/3796057016] conn(0x7fd2b80acba0 0x7fd2b80aefc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:45.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.779+0000 7fd2d642e640 1 -- 172.21.15.27:0/932203594 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fd2b80a3350 msgr2=0x7fd2b80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:45.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.779+0000 7fd2d642e640 1 --2- 172.21.15.27:0/932203594 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fd2b80a3350 0x7fd2b80a5810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0005d00 tx=0x7fd2c000b410 comp rx=0 tx=0).stop 2024-09-19T08:09:45.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.779+0000 7fd2d642e640 1 -- 172.21.15.27:0/932203594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2d0102ef0 msgr2=0x7fd2d01a43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:45.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.779+0000 7fd2d642e640 1 --2- 172.21.15.27:0/932203594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2d0102ef0 0x7fd2d01a43d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800eaa0 tx=0x7fd2c800ef60 comp rx=0 tx=0).stop 2024-09-19T08:09:45.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.779+0000 7fd2d49cb640 1 -- 172.21.15.27:0/932203594 reap_dead start 2024-09-19T08:09:45.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.780+0000 7fd2d642e640 1 -- 172.21.15.27:0/932203594 shutdown_connections 2024-09-19T08:09:45.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.780+0000 7fd2d642e640 1 -- 172.21.15.27:0/932203594 >> 172.21.15.27:0/932203594 conn(0x7fd2d00fc7d0 msgr2=0x7fd2d01068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:45.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.780+0000 7fd2d642e640 1 -- 172.21.15.27:0/932203594 shutdown_connections 2024-09-19T08:09:45.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:45.780+0000 7fd2d642e640 1 -- 172.21.15.27:0/932203594 wait complete. 2024-09-19T08:09:46.787 INFO:teuthology.orchestra.run.smithi027.stdout:34359738445 2024-09-19T08:09:46.787 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T08:09:46.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:46 smithi155 ceph-mon[35362]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1022 B/s wr, 2 op/s 2024-09-19T08:09:47.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:46 smithi027 ceph-mon[31209]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1022 B/s wr, 2 op/s 2024-09-19T08:09:47.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:46 smithi203 ceph-mon[35198]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1022 B/s wr, 2 op/s 2024-09-19T08:09:47.066 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:47.066 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:47.067 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:47.067 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:47.067 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:47.073 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:47.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.262+0000 7fdff16d0640 1 -- 172.21.15.27:0/2392283685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfec102ef0 msgr2=0x7fdfec10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:47.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.262+0000 7fdff16d0640 1 --2- 172.21.15.27:0/2392283685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfec102ef0 0x7fdfec10da40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009900 tx=0x7fdfe402a480 comp rx=0 tx=0).stop 2024-09-19T08:09:47.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.263+0000 7fdff16d0640 1 -- 172.21.15.27:0/2392283685 shutdown_connections 2024-09-19T08:09:47.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.263+0000 7fdff16d0640 1 --2- 172.21.15.27:0/2392283685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfec102ef0 0x7fdfec10da40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:47.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.263+0000 7fdff16d0640 1 --2- 172.21.15.27:0/2392283685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfec102570 0x7fdfec1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:47.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.263+0000 7fdff16d0640 1 --2- 172.21.15.27:0/2392283685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfec100e20 0x7fdfec101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:47.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.263+0000 7fdff16d0640 1 -- 172.21.15.27:0/2392283685 >> 172.21.15.27:0/2392283685 conn(0x7fdfec0fc7d0 msgr2=0x7fdfec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:47.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.263+0000 7fdff16d0640 1 -- 172.21.15.27:0/2392283685 shutdown_connections 2024-09-19T08:09:47.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.263+0000 7fdff16d0640 1 -- 172.21.15.27:0/2392283685 wait complete. 2024-09-19T08:09:47.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.263+0000 7fdff16d0640 1 Processor -- start 2024-09-19T08:09:47.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.263+0000 7fdff16d0640 1 -- start start 2024-09-19T08:09:47.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdff16d0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfec100e20 0x7fdfec198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:47.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdff16d0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfec102570 0x7fdfec198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:47.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdff16d0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfec102ef0 0x7fdfec19ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:47.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdff16d0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec111020 con 0x7fdfec100e20 2024-09-19T08:09:47.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdff16d0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec110ea0 con 0x7fdfec102ef0 2024-09-19T08:09:47.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdff16d0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec1111a0 con 0x7fdfec102570 2024-09-19T08:09:47.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdfeaffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfec100e20 0x7fdfec198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:47.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdfeaffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfec100e20 0x7fdfec198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53684/0 (socket says 172.21.15.27:53684) 2024-09-19T08:09:47.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdfeaffd640 1 -- 172.21.15.27:0/541738284 learned_addr learned my addr 172.21.15.27:0/541738284 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:47.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdfea7fc640 1 --2- 172.21.15.27:0/541738284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfec102570 0x7fdfec198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:47.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdfeb7fe640 1 --2- 172.21.15.27:0/541738284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfec102ef0 0x7fdfec19ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:47.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdfeaffd640 1 -- 172.21.15.27:0/541738284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfec102570 msgr2=0x7fdfec198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:47.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdfeaffd640 1 --2- 172.21.15.27:0/541738284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfec102570 0x7fdfec198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:47.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdfeaffd640 1 -- 172.21.15.27:0/541738284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfec102ef0 msgr2=0x7fdfec19ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:47.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdfeaffd640 1 --2- 172.21.15.27:0/541738284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfec102ef0 0x7fdfec19ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:47.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdfeaffd640 1 -- 172.21.15.27:0/541738284 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfec19d5b0 con 0x7fdfec100e20 2024-09-19T08:09:47.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdfeb7fe640 1 --2- 172.21.15.27:0/541738284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfec102ef0 0x7fdfec19ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:09:47.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdfeaffd640 1 --2- 172.21.15.27:0/541738284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfec100e20 0x7fdfec198600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc00ba50 tx=0x7fdfdc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:47.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdfe3fff640 1 -- 172.21.15.27:0/541738284 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc019070 con 0x7fdfec100e20 2024-09-19T08:09:47.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdff16d0640 1 -- 172.21.15.27:0/541738284 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfec19d8a0 con 0x7fdfec100e20 2024-09-19T08:09:47.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdfe3fff640 1 -- 172.21.15.27:0/541738284 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfdc00cbe0 con 0x7fdfec100e20 2024-09-19T08:09:47.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdfe3fff640 1 -- 172.21.15.27:0/541738284 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc0076e0 con 0x7fdfec100e20 2024-09-19T08:09:47.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.264+0000 7fdff16d0640 1 -- 172.21.15.27:0/541738284 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfec1a5180 con 0x7fdfec100e20 2024-09-19T08:09:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.265+0000 7fdff16d0640 1 -- 172.21.15.27:0/541738284 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdfec107260 con 0x7fdfec100e20 2024-09-19T08:09:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.266+0000 7fdfe3fff640 1 -- 172.21.15.27:0/541738284 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdfdc01c070 con 0x7fdfec100e20 2024-09-19T08:09:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.267+0000 7fdfe3fff640 1 --2- 172.21.15.27:0/541738284 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fdfd80a3350 0x7fdfd80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.267+0000 7fdfea7fc640 1 --2- 172.21.15.27:0/541738284 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fdfd80a3350 0x7fdfd80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.267+0000 7fdfe3fff640 1 -- 172.21.15.27:0/541738284 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fdfdc0cee20 con 0x7fdfec100e20 2024-09-19T08:09:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.268+0000 7fdfe3fff640 1 --2- 172.21.15.27:0/541738284 >> [v2:172.21.15.203:6808/991491203,v1:172.21.15.203:6809/991491203] conn(0x7fdfd80acba0 0x7fdfd80aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.268+0000 7fdfe3fff640 1 -- 172.21.15.27:0/541738284 --> [v2:172.21.15.203:6808/991491203,v1:172.21.15.203:6809/991491203] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdfd80af670 con 0x7fdfd80acba0 2024-09-19T08:09:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.268+0000 7fdfe3fff640 1 -- 172.21.15.27:0/541738284 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fdfdc0d1570 con 0x7fdfec100e20 2024-09-19T08:09:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.268+0000 7fdfea7fc640 1 --2- 172.21.15.27:0/541738284 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fdfd80a3350 0x7fdfd80a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0fee90 tx=0x7fdfd4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.268+0000 7fdfeb7fe640 1 --2- 172.21.15.27:0/541738284 >> [v2:172.21.15.203:6808/991491203,v1:172.21.15.203:6809/991491203] conn(0x7fdfd80acba0 0x7fdfd80aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.268+0000 7fdfeb7fe640 1 --2- 172.21.15.27:0/541738284 >> [v2:172.21.15.203:6808/991491203,v1:172.21.15.203:6809/991491203] conn(0x7fdfd80acba0 0x7fdfd80aefc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.269+0000 7fdfe3fff640 1 -- 172.21.15.27:0/541738284 <== osd.5 v2:172.21.15.203:6808/991491203 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdfd80af670 con 0x7fdfd80acba0 2024-09-19T08:09:47.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.284+0000 7fdff16d0640 1 -- 172.21.15.27:0/541738284 --> [v2:172.21.15.203:6808/991491203,v1:172.21.15.203:6809/991491203] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdfec1021b0 con 0x7fdfd80acba0 2024-09-19T08:09:47.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.285+0000 7fdfe3fff640 1 -- 172.21.15.27:0/541738284 <== osd.5 v2:172.21.15.203:6808/991491203 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdfec1021b0 con 0x7fdfd80acba0 2024-09-19T08:09:47.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.285+0000 7fdff16d0640 1 -- 172.21.15.27:0/541738284 >> [v2:172.21.15.203:6808/991491203,v1:172.21.15.203:6809/991491203] conn(0x7fdfd80acba0 msgr2=0x7fdfd80aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:47.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.285+0000 7fdff16d0640 1 --2- 172.21.15.27:0/541738284 >> [v2:172.21.15.203:6808/991491203,v1:172.21.15.203:6809/991491203] conn(0x7fdfd80acba0 0x7fdfd80aefc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:47.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.285+0000 7fdff16d0640 1 -- 172.21.15.27:0/541738284 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fdfd80a3350 msgr2=0x7fdfd80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:47.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.285+0000 7fdff16d0640 1 --2- 172.21.15.27:0/541738284 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fdfd80a3350 0x7fdfd80a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0fee90 tx=0x7fdfd4008040 comp rx=0 tx=0).stop 2024-09-19T08:09:47.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.285+0000 7fdff16d0640 1 -- 172.21.15.27:0/541738284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfec100e20 msgr2=0x7fdfec198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:47.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.285+0000 7fdff16d0640 1 --2- 172.21.15.27:0/541738284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfec100e20 0x7fdfec198600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc00ba50 tx=0x7fdfdc00bf10 comp rx=0 tx=0).stop 2024-09-19T08:09:47.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.286+0000 7fdfeb7fe640 1 -- 172.21.15.27:0/541738284 reap_dead start 2024-09-19T08:09:47.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.286+0000 7fdff16d0640 1 -- 172.21.15.27:0/541738284 shutdown_connections 2024-09-19T08:09:47.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.286+0000 7fdff16d0640 1 -- 172.21.15.27:0/541738284 >> 172.21.15.27:0/541738284 conn(0x7fdfec0fc7d0 msgr2=0x7fdfec069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:47.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.286+0000 7fdff16d0640 1 -- 172.21.15.27:0/541738284 shutdown_connections 2024-09-19T08:09:47.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:47.286+0000 7fdff16d0640 1 -- 172.21.15.27:0/541738284 wait complete. 2024-09-19T08:09:47.361 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:47.361 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:48.233 INFO:teuthology.orchestra.run.smithi027.stdout:77309411395 2024-09-19T08:09:48.233 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T08:09:48.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:48 smithi155 ceph-mon[35362]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 937 B/s wr, 3 op/s 2024-09-19T08:09:49.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:48 smithi027 ceph-mon[31209]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 937 B/s wr, 3 op/s 2024-09-19T08:09:49.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:48 smithi203 ceph-mon[35198]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 937 B/s wr, 3 op/s 2024-09-19T08:09:49.446 INFO:teuthology.orchestra.run.smithi027.stdout:158913790003 2024-09-19T08:09:49.446 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T08:09:49.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.935+0000 7f6cbb221640 1 -- 172.21.15.27:0/2339135025 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cb4101de0 msgr2=0x7f6cb41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:49.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.935+0000 7f6cbb221640 1 --2- 172.21.15.27:0/2339135025 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cb4101de0 0x7f6cb41021c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009900 tx=0x7f6ca802a410 comp rx=0 tx=0).stop 2024-09-19T08:09:49.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.935+0000 7f6cbb221640 1 -- 172.21.15.27:0/2339135025 shutdown_connections 2024-09-19T08:09:49.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.935+0000 7f6cbb221640 1 --2- 172.21.15.27:0/2339135025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cb4106f10 0x7f6cb410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:49.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.935+0000 7f6cbb221640 1 --2- 172.21.15.27:0/2339135025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cb4102790 0x7f6cb41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:49.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.935+0000 7f6cbb221640 1 --2- 172.21.15.27:0/2339135025 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cb4101de0 0x7f6cb41021c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:49.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.935+0000 7f6cbb221640 1 -- 172.21.15.27:0/2339135025 >> 172.21.15.27:0/2339135025 conn(0x7f6cb40fd8c0 msgr2=0x7f6cb40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:49.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.935+0000 7f6cbb221640 1 -- 172.21.15.27:0/2339135025 shutdown_connections 2024-09-19T08:09:49.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.935+0000 7f6cbb221640 1 -- 172.21.15.27:0/2339135025 wait complete. 2024-09-19T08:09:49.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.936+0000 7f6cbb221640 1 Processor -- start 2024-09-19T08:09:49.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.936+0000 7f6cbb221640 1 -- start start 2024-09-19T08:09:49.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.936+0000 7f6cbb221640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cb4101de0 0x7f6cb40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:49.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.936+0000 7f6cbb221640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cb4102790 0x7f6cb4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:49.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.936+0000 7f6cbb221640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cb4106f10 0x7f6cb4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:49.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.936+0000 7f6cbb221640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb4111fb0 con 0x7f6cb4102790 2024-09-19T08:09:49.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.936+0000 7f6cbb221640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb4111e30 con 0x7f6cb4101de0 2024-09-19T08:09:49.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.936+0000 7f6cbb221640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb4112130 con 0x7f6cb4106f10 2024-09-19T08:09:49.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.936+0000 7f6cb3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cb4102790 0x7f6cb4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:49.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.936+0000 7f6cb3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cb4102790 0x7f6cb4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53706/0 (socket says 172.21.15.27:53706) 2024-09-19T08:09:49.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.936+0000 7f6cb3fff640 1 -- 172.21.15.27:0/1480003147 learned_addr learned my addr 172.21.15.27:0/1480003147 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:49.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.936+0000 7f6cb97be640 1 --2- 172.21.15.27:0/1480003147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cb4106f10 0x7f6cb4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:49.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.936+0000 7f6cb8fbd640 1 --2- 172.21.15.27:0/1480003147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cb4101de0 0x7f6cb40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:49.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.937+0000 7f6cb3fff640 1 -- 172.21.15.27:0/1480003147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cb4106f10 msgr2=0x7f6cb4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:49.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.937+0000 7f6cb3fff640 1 --2- 172.21.15.27:0/1480003147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cb4106f10 0x7f6cb4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:49.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.937+0000 7f6cb3fff640 1 -- 172.21.15.27:0/1480003147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cb4101de0 msgr2=0x7f6cb40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:49.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.937+0000 7f6cb3fff640 1 --2- 172.21.15.27:0/1480003147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cb4101de0 0x7f6cb40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:49.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.937+0000 7f6cb3fff640 1 -- 172.21.15.27:0/1480003147 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb41a69d0 con 0x7f6cb4102790 2024-09-19T08:09:49.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.937+0000 7f6cb97be640 1 --2- 172.21.15.27:0/1480003147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cb4106f10 0x7f6cb4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:09:49.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.937+0000 7f6cb3fff640 1 --2- 172.21.15.27:0/1480003147 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cb4102790 0x7f6cb4074a30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000b4a0 tx=0x7f6ca000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:49.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.937+0000 7f6cb1ffb640 1 -- 172.21.15.27:0/1480003147 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0014070 con 0x7f6cb4102790 2024-09-19T08:09:49.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.937+0000 7f6cbb221640 1 -- 172.21.15.27:0/1480003147 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb41a6cc0 con 0x7f6cb4102790 2024-09-19T08:09:49.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.937+0000 7f6cb1ffb640 1 -- 172.21.15.27:0/1480003147 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ca0010af0 con 0x7f6cb4102790 2024-09-19T08:09:49.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.937+0000 7f6cb1ffb640 1 -- 172.21.15.27:0/1480003147 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0017d10 con 0x7f6cb4102790 2024-09-19T08:09:49.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.938+0000 7f6cbb221640 1 -- 172.21.15.27:0/1480003147 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb41a71f0 con 0x7f6cb4102790 2024-09-19T08:09:49.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.939+0000 7f6cbb221640 1 -- 172.21.15.27:0/1480003147 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6cb4062880 con 0x7f6cb4102790 2024-09-19T08:09:49.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.941+0000 7f6cb1ffb640 1 -- 172.21.15.27:0/1480003147 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6ca0017070 con 0x7f6cb4102790 2024-09-19T08:09:49.944 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:49.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.942+0000 7f6cb1ffb640 1 --2- 172.21.15.27:0/1480003147 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6ca40a3350 0x7f6ca40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:49.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.942+0000 7f6cb8fbd640 1 --2- 172.21.15.27:0/1480003147 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6ca40a3350 0x7f6ca40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:49.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.942+0000 7f6cb1ffb640 1 -- 172.21.15.27:0/1480003147 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f6ca00cee30 con 0x7f6cb4102790 2024-09-19T08:09:49.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.942+0000 7f6cb1ffb640 1 --2- 172.21.15.27:0/1480003147 >> [v2:172.21.15.155:6800/3977510449,v1:172.21.15.155:6801/3977510449] conn(0x7f6ca40acba0 0x7f6ca40aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:49.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.942+0000 7f6cb1ffb640 1 -- 172.21.15.27:0/1480003147 --> [v2:172.21.15.155:6800/3977510449,v1:172.21.15.155:6801/3977510449] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ca000dec0 con 0x7f6ca40acba0 2024-09-19T08:09:49.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.942+0000 7f6cb1ffb640 1 -- 172.21.15.27:0/1480003147 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f6ca00cf310 con 0x7f6cb4102790 2024-09-19T08:09:49.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.943+0000 7f6cb8fbd640 1 --2- 172.21.15.27:0/1480003147 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6ca40a3350 0x7f6ca40a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009230 tx=0x7f6ca80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:49.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.943+0000 7f6cb97be640 1 --2- 172.21.15.27:0/1480003147 >> [v2:172.21.15.155:6800/3977510449,v1:172.21.15.155:6801/3977510449] conn(0x7f6ca40acba0 0x7f6ca40aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:49.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.943+0000 7f6cb97be640 1 --2- 172.21.15.27:0/1480003147 >> [v2:172.21.15.155:6800/3977510449,v1:172.21.15.155:6801/3977510449] conn(0x7f6ca40acba0 0x7f6ca40aefc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:49.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.944+0000 7f6cb1ffb640 1 -- 172.21.15.27:0/1480003147 <== osd.1 v2:172.21.15.155:6800/3977510449 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ca000dec0 con 0x7f6ca40acba0 2024-09-19T08:09:49.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.966+0000 7f6cbb221640 1 -- 172.21.15.27:0/1480003147 --> [v2:172.21.15.155:6800/3977510449,v1:172.21.15.155:6801/3977510449] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6cb4062c80 con 0x7f6ca40acba0 2024-09-19T08:09:49.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.967+0000 7f6cb1ffb640 1 -- 172.21.15.27:0/1480003147 <== osd.1 v2:172.21.15.155:6800/3977510449 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6cb4062c80 con 0x7f6ca40acba0 2024-09-19T08:09:49.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.968+0000 7f6cbb221640 1 -- 172.21.15.27:0/1480003147 >> [v2:172.21.15.155:6800/3977510449,v1:172.21.15.155:6801/3977510449] conn(0x7f6ca40acba0 msgr2=0x7f6ca40aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:49.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.968+0000 7f6cbb221640 1 --2- 172.21.15.27:0/1480003147 >> [v2:172.21.15.155:6800/3977510449,v1:172.21.15.155:6801/3977510449] conn(0x7f6ca40acba0 0x7f6ca40aefc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:49.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.968+0000 7f6cbb221640 1 -- 172.21.15.27:0/1480003147 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6ca40a3350 msgr2=0x7f6ca40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:49.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.968+0000 7f6cbb221640 1 --2- 172.21.15.27:0/1480003147 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6ca40a3350 0x7f6ca40a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009230 tx=0x7f6ca80058d0 comp rx=0 tx=0).stop 2024-09-19T08:09:49.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.968+0000 7f6cbb221640 1 -- 172.21.15.27:0/1480003147 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cb4102790 msgr2=0x7f6cb4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:49.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.968+0000 7f6cbb221640 1 --2- 172.21.15.27:0/1480003147 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cb4102790 0x7f6cb4074a30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000b4a0 tx=0x7f6ca000b960 comp rx=0 tx=0).stop 2024-09-19T08:09:49.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.968+0000 7f6cb97be640 1 -- 172.21.15.27:0/1480003147 reap_dead start 2024-09-19T08:09:49.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.968+0000 7f6cbb221640 1 -- 172.21.15.27:0/1480003147 shutdown_connections 2024-09-19T08:09:49.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.968+0000 7f6cbb221640 1 -- 172.21.15.27:0/1480003147 >> 172.21.15.27:0/1480003147 conn(0x7f6cb40fd8c0 msgr2=0x7f6cb40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:49.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.968+0000 7f6cbb221640 1 -- 172.21.15.27:0/1480003147 shutdown_connections 2024-09-19T08:09:49.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:49.968+0000 7f6cbb221640 1 -- 172.21.15.27:0/1480003147 wait complete. 2024-09-19T08:09:50.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.700+0000 7f6b4c810640 1 -- 172.21.15.27:0/3398290414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b48102da0 msgr2=0x7f6b48103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:50.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.700+0000 7f6b4c810640 1 --2- 172.21.15.27:0/3398290414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b48102da0 0x7f6b48103180 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6b38009900 tx=0x7f6b3802a480 comp rx=0 tx=0).stop 2024-09-19T08:09:50.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.700+0000 7f6b4c810640 1 -- 172.21.15.27:0/3398290414 shutdown_connections 2024-09-19T08:09:50.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.700+0000 7f6b4c810640 1 --2- 172.21.15.27:0/3398290414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b4810c180 0x7f6b4810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:50.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.700+0000 7f6b4c810640 1 --2- 172.21.15.27:0/3398290414 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b481036c0 0x7f6b4810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:50.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.700+0000 7f6b4c810640 1 --2- 172.21.15.27:0/3398290414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b48102da0 0x7f6b48103180 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.700+0000 7f6b4c810640 1 -- 172.21.15.27:0/3398290414 >> 172.21.15.27:0/3398290414 conn(0x7f6b480fc7a0 msgr2=0x7f6b480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.700+0000 7f6b4c810640 1 -- 172.21.15.27:0/3398290414 shutdown_connections 2024-09-19T08:09:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.700+0000 7f6b4c810640 1 -- 172.21.15.27:0/3398290414 wait complete. 2024-09-19T08:09:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.701+0000 7f6b4c810640 1 Processor -- start 2024-09-19T08:09:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.701+0000 7f6b4c810640 1 -- start start 2024-09-19T08:09:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.701+0000 7f6b4c810640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b48102da0 0x7f6b48198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.701+0000 7f6b4c810640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b481036c0 0x7f6b481989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.701+0000 7f6b4c810640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b4810c180 0x7f6b4819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.701+0000 7f6b4c810640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6b48111fa0 con 0x7f6b4810c180 2024-09-19T08:09:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.701+0000 7f6b4c810640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6b48111e20 con 0x7f6b48102da0 2024-09-19T08:09:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.701+0000 7f6b4c810640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6b48112120 con 0x7f6b481036c0 2024-09-19T08:09:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.701+0000 7f6b46d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b4810c180 0x7f6b4819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.701+0000 7f6b46d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b4810c180 0x7f6b4819cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44794/0 (socket says 172.21.15.27:44794) 2024-09-19T08:09:50.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.701+0000 7f6b46d9d640 1 -- 172.21.15.27:0/1870682276 learned_addr learned my addr 172.21.15.27:0/1870682276 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:50.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.701+0000 7f6b45d9b640 1 --2- 172.21.15.27:0/1870682276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b481036c0 0x7f6b481989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:50.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.701+0000 7f6b4659c640 1 --2- 172.21.15.27:0/1870682276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b48102da0 0x7f6b48198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:50.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.702+0000 7f6b46d9d640 1 -- 172.21.15.27:0/1870682276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b481036c0 msgr2=0x7f6b481989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:50.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.702+0000 7f6b46d9d640 1 --2- 172.21.15.27:0/1870682276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b481036c0 0x7f6b481989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:50.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.702+0000 7f6b46d9d640 1 -- 172.21.15.27:0/1870682276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b48102da0 msgr2=0x7f6b48198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:50.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.702+0000 7f6b46d9d640 1 --2- 172.21.15.27:0/1870682276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b48102da0 0x7f6b48198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:50.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.702+0000 7f6b46d9d640 1 -- 172.21.15.27:0/1870682276 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4819d430 con 0x7f6b4810c180 2024-09-19T08:09:50.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.702+0000 7f6b46d9d640 1 --2- 172.21.15.27:0/1870682276 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b4810c180 0x7f6b4819cd50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000b970 tx=0x7f6b4000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:50.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.702+0000 7f6b377fe640 1 -- 172.21.15.27:0/1870682276 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40019070 con 0x7f6b4810c180 2024-09-19T08:09:50.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.702+0000 7f6b377fe640 1 -- 172.21.15.27:0/1870682276 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b40014440 con 0x7f6b4810c180 2024-09-19T08:09:50.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.702+0000 7f6b4c810640 1 -- 172.21.15.27:0/1870682276 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4819d720 con 0x7f6b4810c180 2024-09-19T08:09:50.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.702+0000 7f6b377fe640 1 -- 172.21.15.27:0/1870682276 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b400075d0 con 0x7f6b4810c180 2024-09-19T08:09:50.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.702+0000 7f6b4c810640 1 -- 172.21.15.27:0/1870682276 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b481a5000 con 0x7f6b4810c180 2024-09-19T08:09:50.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.703+0000 7f6b4c810640 1 -- 172.21.15.27:0/1870682276 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6b48062900 con 0x7f6b4810c180 2024-09-19T08:09:50.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.704+0000 7f6b377fe640 1 -- 172.21.15.27:0/1870682276 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6b4001c070 con 0x7f6b4810c180 2024-09-19T08:09:50.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.705+0000 7f6b377fe640 1 --2- 172.21.15.27:0/1870682276 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6b300a3350 0x7f6b300a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:50.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.705+0000 7f6b4659c640 1 --2- 172.21.15.27:0/1870682276 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6b300a3350 0x7f6b300a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:50.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.705+0000 7f6b377fe640 1 -- 172.21.15.27:0/1870682276 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f6b400cf4d0 con 0x7f6b4810c180 2024-09-19T08:09:50.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.705+0000 7f6b377fe640 1 --2- 172.21.15.27:0/1870682276 >> [v2:172.21.15.203:6816/199970687,v1:172.21.15.203:6817/199970687] conn(0x7f6b300acba0 0x7f6b300aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:50.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.705+0000 7f6b377fe640 1 -- 172.21.15.27:0/1870682276 --> [v2:172.21.15.203:6816/199970687,v1:172.21.15.203:6817/199970687] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b300af670 con 0x7f6b300acba0 2024-09-19T08:09:50.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.705+0000 7f6b377fe640 1 -- 172.21.15.27:0/1870682276 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f6b400cf9b0 con 0x7f6b4810c180 2024-09-19T08:09:50.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.705+0000 7f6b4659c640 1 --2- 172.21.15.27:0/1870682276 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6b300a3350 0x7f6b300a5810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6b38000c00 tx=0x7f6b380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:50.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.705+0000 7f6b45d9b640 1 --2- 172.21.15.27:0/1870682276 >> [v2:172.21.15.203:6816/199970687,v1:172.21.15.203:6817/199970687] conn(0x7f6b300acba0 0x7f6b300aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:50.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.706+0000 7f6b45d9b640 1 --2- 172.21.15.27:0/1870682276 >> [v2:172.21.15.203:6816/199970687,v1:172.21.15.203:6817/199970687] conn(0x7f6b300acba0 0x7f6b300aefc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:50.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.707+0000 7f6b377fe640 1 -- 172.21.15.27:0/1870682276 <== osd.8 v2:172.21.15.203:6816/199970687 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b300af670 con 0x7f6b300acba0 2024-09-19T08:09:50.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.722+0000 7f6b4c810640 1 -- 172.21.15.27:0/1870682276 --> [v2:172.21.15.203:6816/199970687,v1:172.21.15.203:6817/199970687] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6b48062d80 con 0x7f6b300acba0 2024-09-19T08:09:50.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.723+0000 7f6b377fe640 1 -- 172.21.15.27:0/1870682276 <== osd.8 v2:172.21.15.203:6816/199970687 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6b48062d80 con 0x7f6b300acba0 2024-09-19T08:09:50.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.723+0000 7f6b4c810640 1 -- 172.21.15.27:0/1870682276 >> [v2:172.21.15.203:6816/199970687,v1:172.21.15.203:6817/199970687] conn(0x7f6b300acba0 msgr2=0x7f6b300aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:50.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.723+0000 7f6b4c810640 1 --2- 172.21.15.27:0/1870682276 >> [v2:172.21.15.203:6816/199970687,v1:172.21.15.203:6817/199970687] conn(0x7f6b300acba0 0x7f6b300aefc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:50.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.723+0000 7f6b4c810640 1 -- 172.21.15.27:0/1870682276 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6b300a3350 msgr2=0x7f6b300a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:50.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.723+0000 7f6b4c810640 1 --2- 172.21.15.27:0/1870682276 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6b300a3350 0x7f6b300a5810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6b38000c00 tx=0x7f6b380058d0 comp rx=0 tx=0).stop 2024-09-19T08:09:50.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.723+0000 7f6b4c810640 1 -- 172.21.15.27:0/1870682276 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b4810c180 msgr2=0x7f6b4819cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:50.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.723+0000 7f6b4c810640 1 --2- 172.21.15.27:0/1870682276 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b4810c180 0x7f6b4819cd50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000b970 tx=0x7f6b4000bd70 comp rx=0 tx=0).stop 2024-09-19T08:09:50.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.724+0000 7f6b46d9d640 1 -- 172.21.15.27:0/1870682276 reap_dead start 2024-09-19T08:09:50.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.724+0000 7f6b4c810640 1 -- 172.21.15.27:0/1870682276 shutdown_connections 2024-09-19T08:09:50.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.724+0000 7f6b4c810640 1 -- 172.21.15.27:0/1870682276 >> 172.21.15.27:0/1870682276 conn(0x7f6b480fc7a0 msgr2=0x7f6b480fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:50.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.724+0000 7f6b4c810640 1 -- 172.21.15.27:0/1870682276 shutdown_connections 2024-09-19T08:09:50.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:50.724+0000 7f6b4c810640 1 -- 172.21.15.27:0/1870682276 wait complete. 2024-09-19T08:09:50.963 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:50 smithi027 ceph-mon[31209]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1022 B/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:09:50.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:50 smithi155 ceph-mon[35362]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1022 B/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:09:51.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:50 smithi203 ceph-mon[35198]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1022 B/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:09:51.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.161+0000 7f427b071640 1 -- 172.21.15.27:0/3102072753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4274101420 msgr2=0x7f427410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:51.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.161+0000 7f427b071640 1 --2- 172.21.15.27:0/3102072753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4274101420 0x7f427410d950 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f426c009cd0 tx=0x7f426c02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:09:51.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.162+0000 7f427b071640 1 -- 172.21.15.27:0/3102072753 shutdown_connections 2024-09-19T08:09:51.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.162+0000 7f427b071640 1 --2- 172.21.15.27:0/3102072753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4274101420 0x7f427410d950 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:51.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.162+0000 7f427b071640 1 --2- 172.21.15.27:0/3102072753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4274100a80 0x7f4274100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:51.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.162+0000 7f427b071640 1 --2- 172.21.15.27:0/3102072753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4274106a80 0x7f4274106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:51.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.162+0000 7f427b071640 1 -- 172.21.15.27:0/3102072753 >> 172.21.15.27:0/3102072753 conn(0x7f42740fc7a0 msgr2=0x7f42740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:51.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.162+0000 7f427b071640 1 -- 172.21.15.27:0/3102072753 shutdown_connections 2024-09-19T08:09:51.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.162+0000 7f427b071640 1 -- 172.21.15.27:0/3102072753 wait complete. 2024-09-19T08:09:51.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.162+0000 7f427b071640 1 Processor -- start 2024-09-19T08:09:51.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.162+0000 7f427b071640 1 -- start start 2024-09-19T08:09:51.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.162+0000 7f427b071640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4274100a80 0x7f42740fcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:51.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.162+0000 7f427b071640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4274101420 0x7f42740fd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:51.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.162+0000 7f427b071640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4274106a80 0x7f42740fd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:51.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.162+0000 7f427b071640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4274110f70 con 0x7f4274100a80 2024-09-19T08:09:51.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.162+0000 7f427b071640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4274110df0 con 0x7f4274106a80 2024-09-19T08:09:51.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.162+0000 7f427b071640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f42741110f0 con 0x7f4274101420 2024-09-19T08:09:51.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.163+0000 7f4278e0d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4274100a80 0x7f42740fcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:51.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.163+0000 7f4278e0d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4274100a80 0x7f42740fcdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44812/0 (socket says 172.21.15.27:44812) 2024-09-19T08:09:51.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.163+0000 7f4278e0d640 1 -- 172.21.15.27:0/3025012150 learned_addr learned my addr 172.21.15.27:0/3025012150 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:51.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.163+0000 7f427960e640 1 --2- 172.21.15.27:0/3025012150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4274106a80 0x7f42740fd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:51.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.163+0000 7f4273fff640 1 --2- 172.21.15.27:0/3025012150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4274101420 0x7f42740fd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:51.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.163+0000 7f4278e0d640 1 -- 172.21.15.27:0/3025012150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4274101420 msgr2=0x7f42740fd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:51.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.163+0000 7f4278e0d640 1 --2- 172.21.15.27:0/3025012150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4274101420 0x7f42740fd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:51.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.163+0000 7f4278e0d640 1 -- 172.21.15.27:0/3025012150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4274106a80 msgr2=0x7f42740fd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:51.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.163+0000 7f4278e0d640 1 --2- 172.21.15.27:0/3025012150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4274106a80 0x7f42740fd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:51.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.163+0000 7f4278e0d640 1 -- 172.21.15.27:0/3025012150 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42741a6a20 con 0x7f4274100a80 2024-09-19T08:09:51.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.163+0000 7f4273fff640 1 --2- 172.21.15.27:0/3025012150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4274101420 0x7f42740fd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:09:51.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.163+0000 7f427960e640 1 --2- 172.21.15.27:0/3025012150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4274106a80 0x7f42740fd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:09:51.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.163+0000 7f4278e0d640 1 --2- 172.21.15.27:0/3025012150 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4274100a80 0x7f42740fcdc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f426800b4a0 tx=0x7f426800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:51.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.163+0000 7f4271ffb640 1 -- 172.21.15.27:0/3025012150 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4268014070 con 0x7f4274100a80 2024-09-19T08:09:51.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.163+0000 7f4271ffb640 1 -- 172.21.15.27:0/3025012150 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4268010af0 con 0x7f4274100a80 2024-09-19T08:09:51.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.163+0000 7f427b071640 1 -- 172.21.15.27:0/3025012150 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42741a6d10 con 0x7f4274100a80 2024-09-19T08:09:51.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.163+0000 7f4271ffb640 1 -- 172.21.15.27:0/3025012150 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4268017d10 con 0x7f4274100a80 2024-09-19T08:09:51.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.163+0000 7f427b071640 1 -- 172.21.15.27:0/3025012150 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42741a7240 con 0x7f4274100a80 2024-09-19T08:09:51.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.164+0000 7f427b071640 1 -- 172.21.15.27:0/3025012150 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f42740628c0 con 0x7f4274100a80 2024-09-19T08:09:51.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.165+0000 7f4271ffb640 1 -- 172.21.15.27:0/3025012150 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4268017070 con 0x7f4274100a80 2024-09-19T08:09:51.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.166+0000 7f4271ffb640 1 --2- 172.21.15.27:0/3025012150 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f42640a3350 0x7f42640a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:51.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.166+0000 7f4273fff640 1 --2- 172.21.15.27:0/3025012150 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f42640a3350 0x7f42640a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:51.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.166+0000 7f4271ffb640 1 -- 172.21.15.27:0/3025012150 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f42680ceb80 con 0x7f4274100a80 2024-09-19T08:09:51.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.166+0000 7f4271ffb640 1 --2- 172.21.15.27:0/3025012150 >> [v2:172.21.15.203:6824/224768827,v1:172.21.15.203:6825/224768827] conn(0x7f42640acba0 0x7f42640aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:51.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.166+0000 7f4271ffb640 1 -- 172.21.15.27:0/3025012150 --> [v2:172.21.15.203:6824/224768827,v1:172.21.15.203:6825/224768827] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42640af670 con 0x7f42640acba0 2024-09-19T08:09:51.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.166+0000 7f4271ffb640 1 -- 172.21.15.27:0/3025012150 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f42680d42a0 con 0x7f4274100a80 2024-09-19T08:09:51.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.166+0000 7f4273fff640 1 --2- 172.21.15.27:0/3025012150 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f42640a3350 0x7f42640a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4260006fd0 tx=0x7f4260008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:51.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.166+0000 7f427960e640 1 --2- 172.21.15.27:0/3025012150 >> [v2:172.21.15.203:6824/224768827,v1:172.21.15.203:6825/224768827] conn(0x7f42640acba0 0x7f42640aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:51.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.167+0000 7f427960e640 1 --2- 172.21.15.27:0/3025012150 >> [v2:172.21.15.203:6824/224768827,v1:172.21.15.203:6825/224768827] conn(0x7f42640acba0 0x7f42640aefc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:51.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.168+0000 7f4271ffb640 1 -- 172.21.15.27:0/3025012150 <== osd.11 v2:172.21.15.203:6824/224768827 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f42640af670 con 0x7f42640acba0 2024-09-19T08:09:51.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.182+0000 7f427b071640 1 -- 172.21.15.27:0/3025012150 --> [v2:172.21.15.203:6824/224768827,v1:172.21.15.203:6825/224768827] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4274062cf0 con 0x7f42640acba0 2024-09-19T08:09:51.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.182+0000 7f4271ffb640 1 -- 172.21.15.27:0/3025012150 <== osd.11 v2:172.21.15.203:6824/224768827 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4274062cf0 con 0x7f42640acba0 2024-09-19T08:09:51.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.182+0000 7f427b071640 1 -- 172.21.15.27:0/3025012150 >> [v2:172.21.15.203:6824/224768827,v1:172.21.15.203:6825/224768827] conn(0x7f42640acba0 msgr2=0x7f42640aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:51.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.182+0000 7f427b071640 1 --2- 172.21.15.27:0/3025012150 >> [v2:172.21.15.203:6824/224768827,v1:172.21.15.203:6825/224768827] conn(0x7f42640acba0 0x7f42640aefc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:51.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.183+0000 7f427b071640 1 -- 172.21.15.27:0/3025012150 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f42640a3350 msgr2=0x7f42640a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:51.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.183+0000 7f427b071640 1 --2- 172.21.15.27:0/3025012150 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f42640a3350 0x7f42640a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4260006fd0 tx=0x7f4260008040 comp rx=0 tx=0).stop 2024-09-19T08:09:51.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.183+0000 7f427b071640 1 -- 172.21.15.27:0/3025012150 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4274100a80 msgr2=0x7f42740fcdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:51.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.183+0000 7f427b071640 1 --2- 172.21.15.27:0/3025012150 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4274100a80 0x7f42740fcdc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f426800b4a0 tx=0x7f426800b960 comp rx=0 tx=0).stop 2024-09-19T08:09:51.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.183+0000 7f427960e640 1 -- 172.21.15.27:0/3025012150 reap_dead start 2024-09-19T08:09:51.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.183+0000 7f427b071640 1 -- 172.21.15.27:0/3025012150 shutdown_connections 2024-09-19T08:09:51.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.183+0000 7f427b071640 1 -- 172.21.15.27:0/3025012150 >> 172.21.15.27:0/3025012150 conn(0x7f42740fc7a0 msgr2=0x7f427406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:51.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.183+0000 7f427b071640 1 -- 172.21.15.27:0/3025012150 shutdown_connections 2024-09-19T08:09:51.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.183+0000 7f427b071640 1 -- 172.21.15.27:0/3025012150 wait complete. 2024-09-19T08:09:51.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.591+0000 7f8c5f121640 1 -- 172.21.15.27:0/3892010561 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c58103660 msgr2=0x7f8c5810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:51.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.591+0000 7f8c5f121640 1 --2- 172.21.15.27:0/3892010561 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c58103660 0x7f8c5810bb50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009ca0 tx=0x7f8c4802a950 comp rx=0 tx=0).stop 2024-09-19T08:09:51.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.591+0000 7f8c5f121640 1 -- 172.21.15.27:0/3892010561 shutdown_connections 2024-09-19T08:09:51.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.591+0000 7f8c5f121640 1 --2- 172.21.15.27:0/3892010561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c5810c170 0x7f8c5810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:51.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.591+0000 7f8c5f121640 1 --2- 172.21.15.27:0/3892010561 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c58103660 0x7f8c5810bb50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:51.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.591+0000 7f8c5f121640 1 --2- 172.21.15.27:0/3892010561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c58102d40 0x7f8c58103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:51.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.591+0000 7f8c5f121640 1 -- 172.21.15.27:0/3892010561 >> 172.21.15.27:0/3892010561 conn(0x7f8c580fc7a0 msgr2=0x7f8c580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:51.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.591+0000 7f8c5f121640 1 -- 172.21.15.27:0/3892010561 shutdown_connections 2024-09-19T08:09:51.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.591+0000 7f8c5f121640 1 -- 172.21.15.27:0/3892010561 wait complete. 2024-09-19T08:09:51.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.592+0000 7f8c5f121640 1 Processor -- start 2024-09-19T08:09:51.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.592+0000 7f8c5f121640 1 -- start start 2024-09-19T08:09:51.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.592+0000 7f8c5f121640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c58102d40 0x7f8c581009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:51.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.592+0000 7f8c5f121640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c58103660 0x7f8c58100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:51.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.592+0000 7f8c5f121640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c5810c170 0x7f8c58101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.592+0000 7f8c5f121640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8c58112030 con 0x7f8c58102d40 2024-09-19T08:09:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.592+0000 7f8c5f121640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8c58111eb0 con 0x7f8c5810c170 2024-09-19T08:09:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.592+0000 7f8c5f121640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8c581121b0 con 0x7f8c58103660 2024-09-19T08:09:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.592+0000 7f8c5cebd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c58102d40 0x7f8c581009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.592+0000 7f8c5cebd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c58102d40 0x7f8c581009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44824/0 (socket says 172.21.15.27:44824) 2024-09-19T08:09:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.592+0000 7f8c5cebd640 1 -- 172.21.15.27:0/3477245205 learned_addr learned my addr 172.21.15.27:0/3477245205 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.592+0000 7f8c5d6be640 1 --2- 172.21.15.27:0/3477245205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c5810c170 0x7f8c58101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.592+0000 7f8c57fff640 1 --2- 172.21.15.27:0/3477245205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c58103660 0x7f8c58100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.592+0000 7f8c5cebd640 1 -- 172.21.15.27:0/3477245205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c58103660 msgr2=0x7f8c58100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.592+0000 7f8c5cebd640 1 --2- 172.21.15.27:0/3477245205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c58103660 0x7f8c58100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.592+0000 7f8c5cebd640 1 -- 172.21.15.27:0/3477245205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c5810c170 msgr2=0x7f8c58101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.592+0000 7f8c5cebd640 1 --2- 172.21.15.27:0/3477245205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c5810c170 0x7f8c58101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:51.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.592+0000 7f8c5cebd640 1 -- 172.21.15.27:0/3477245205 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c581a6a90 con 0x7f8c58102d40 2024-09-19T08:09:51.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.592+0000 7f8c57fff640 1 --2- 172.21.15.27:0/3477245205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c58103660 0x7f8c58100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:09:51.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.592+0000 7f8c5d6be640 1 --2- 172.21.15.27:0/3477245205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c5810c170 0x7f8c58101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:09:51.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.593+0000 7f8c5cebd640 1 --2- 172.21.15.27:0/3477245205 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c58102d40 0x7f8c581009a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8c4000b4a0 tx=0x7f8c4000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:51.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.593+0000 7f8c55ffb640 1 -- 172.21.15.27:0/3477245205 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c40014070 con 0x7f8c58102d40 2024-09-19T08:09:51.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.593+0000 7f8c55ffb640 1 -- 172.21.15.27:0/3477245205 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c40010af0 con 0x7f8c58102d40 2024-09-19T08:09:51.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.593+0000 7f8c5f121640 1 -- 172.21.15.27:0/3477245205 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c581a6d80 con 0x7f8c58102d40 2024-09-19T08:09:51.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.593+0000 7f8c55ffb640 1 -- 172.21.15.27:0/3477245205 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c40017d10 con 0x7f8c58102d40 2024-09-19T08:09:51.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.593+0000 7f8c5f121640 1 -- 172.21.15.27:0/3477245205 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c581a7240 con 0x7f8c58102d40 2024-09-19T08:09:51.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.594+0000 7f8c5f121640 1 -- 172.21.15.27:0/3477245205 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8c58062900 con 0x7f8c58102d40 2024-09-19T08:09:51.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.595+0000 7f8c55ffb640 1 -- 172.21.15.27:0/3477245205 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8c40017070 con 0x7f8c58102d40 2024-09-19T08:09:51.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.596+0000 7f8c55ffb640 1 --2- 172.21.15.27:0/3477245205 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8c440a3350 0x7f8c440a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:51.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.596+0000 7f8c57fff640 1 --2- 172.21.15.27:0/3477245205 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8c440a3350 0x7f8c440a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:51.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.596+0000 7f8c55ffb640 1 -- 172.21.15.27:0/3477245205 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f8c400cef90 con 0x7f8c58102d40 2024-09-19T08:09:51.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.596+0000 7f8c55ffb640 1 --2- 172.21.15.27:0/3477245205 >> [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131] conn(0x7f8c440acba0 0x7f8c440aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:51.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.596+0000 7f8c55ffb640 1 -- 172.21.15.27:0/3477245205 --> [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c4000dec0 con 0x7f8c440acba0 2024-09-19T08:09:51.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.596+0000 7f8c55ffb640 1 -- 172.21.15.27:0/3477245205 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f8c400cf470 con 0x7f8c58102d40 2024-09-19T08:09:51.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.596+0000 7f8c5d6be640 1 --2- 172.21.15.27:0/3477245205 >> [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131] conn(0x7f8c440acba0 0x7f8c440aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:51.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.596+0000 7f8c57fff640 1 --2- 172.21.15.27:0/3477245205 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8c440a3350 0x7f8c440a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8c48006010 tx=0x7f8c48005f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:51.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.597+0000 7f8c5d6be640 1 --2- 172.21.15.27:0/3477245205 >> [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131] conn(0x7f8c440acba0 0x7f8c440aefc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:51.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.597+0000 7f8c55ffb640 1 -- 172.21.15.27:0/3477245205 <== osd.6 v2:172.21.15.27:6818/3516868131 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8c4000dec0 con 0x7f8c440acba0 2024-09-19T08:09:51.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.611+0000 7f8c5f121640 1 -- 172.21.15.27:0/3477245205 --> [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8c58062d80 con 0x7f8c440acba0 2024-09-19T08:09:51.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.612+0000 7f8c55ffb640 1 -- 172.21.15.27:0/3477245205 <== osd.6 v2:172.21.15.27:6818/3516868131 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8c58062d80 con 0x7f8c440acba0 2024-09-19T08:09:51.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.612+0000 7f8c5f121640 1 -- 172.21.15.27:0/3477245205 >> [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131] conn(0x7f8c440acba0 msgr2=0x7f8c440aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:51.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.612+0000 7f8c5f121640 1 --2- 172.21.15.27:0/3477245205 >> [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131] conn(0x7f8c440acba0 0x7f8c440aefc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:51.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.612+0000 7f8c5f121640 1 -- 172.21.15.27:0/3477245205 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8c440a3350 msgr2=0x7f8c440a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:51.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.612+0000 7f8c5f121640 1 --2- 172.21.15.27:0/3477245205 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f8c440a3350 0x7f8c440a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8c48006010 tx=0x7f8c48005f80 comp rx=0 tx=0).stop 2024-09-19T08:09:51.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.612+0000 7f8c5f121640 1 -- 172.21.15.27:0/3477245205 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c58102d40 msgr2=0x7f8c581009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:51.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.612+0000 7f8c5f121640 1 --2- 172.21.15.27:0/3477245205 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c58102d40 0x7f8c581009a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8c4000b4a0 tx=0x7f8c4000b960 comp rx=0 tx=0).stop 2024-09-19T08:09:51.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.612+0000 7f8c5d6be640 1 -- 172.21.15.27:0/3477245205 reap_dead start 2024-09-19T08:09:51.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.612+0000 7f8c5f121640 1 -- 172.21.15.27:0/3477245205 shutdown_connections 2024-09-19T08:09:51.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.612+0000 7f8c5f121640 1 -- 172.21.15.27:0/3477245205 >> 172.21.15.27:0/3477245205 conn(0x7f8c580fc7a0 msgr2=0x7f8c580fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:51.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.612+0000 7f8c5f121640 1 -- 172.21.15.27:0/3477245205 shutdown_connections 2024-09-19T08:09:51.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.613+0000 7f8c5f121640 1 -- 172.21.15.27:0/3477245205 wait complete. 2024-09-19T08:09:51.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.801+0000 7fccd401b640 1 -- 172.21.15.27:0/1616824786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcccc106f10 msgr2=0x7fcccc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:51.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.801+0000 7fccd401b640 1 --2- 172.21.15.27:0/1616824786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcccc106f10 0x7fcccc10ea90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fccc4009900 tx=0x7fccc402a410 comp rx=0 tx=0).stop 2024-09-19T08:09:51.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.801+0000 7fccd401b640 1 -- 172.21.15.27:0/1616824786 shutdown_connections 2024-09-19T08:09:51.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.801+0000 7fccd401b640 1 --2- 172.21.15.27:0/1616824786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcccc106f10 0x7fcccc10ea90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:51.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.801+0000 7fccd401b640 1 --2- 172.21.15.27:0/1616824786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcccc102790 0x7fcccc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:51.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.801+0000 7fccd401b640 1 --2- 172.21.15.27:0/1616824786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcccc101de0 0x7fcccc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:51.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.801+0000 7fccd401b640 1 -- 172.21.15.27:0/1616824786 >> 172.21.15.27:0/1616824786 conn(0x7fcccc0fd8c0 msgr2=0x7fcccc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:51.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.801+0000 7fccd401b640 1 -- 172.21.15.27:0/1616824786 shutdown_connections 2024-09-19T08:09:51.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.801+0000 7fccd401b640 1 -- 172.21.15.27:0/1616824786 wait complete. 2024-09-19T08:09:51.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.802+0000 7fccd401b640 1 Processor -- start 2024-09-19T08:09:51.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.802+0000 7fccd401b640 1 -- start start 2024-09-19T08:09:51.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.802+0000 7fccd401b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcccc101de0 0x7fcccc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:51.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.802+0000 7fccd401b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcccc102790 0x7fcccc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:51.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.802+0000 7fccd401b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcccc106f10 0x7fcccc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:51.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.802+0000 7fccd401b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc111f70 con 0x7fcccc102790 2024-09-19T08:09:51.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.802+0000 7fccd401b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc111df0 con 0x7fcccc106f10 2024-09-19T08:09:51.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.802+0000 7fccd401b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc1120f0 con 0x7fcccc101de0 2024-09-19T08:09:51.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.802+0000 7fccd15b6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcccc102790 0x7fcccc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:51.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.802+0000 7fccd15b6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcccc102790 0x7fcccc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44840/0 (socket says 172.21.15.27:44840) 2024-09-19T08:09:51.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.802+0000 7fccd15b6640 1 -- 172.21.15.27:0/39599569 learned_addr learned my addr 172.21.15.27:0/39599569 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:51.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.803+0000 7fccd1db7640 1 --2- 172.21.15.27:0/39599569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcccc101de0 0x7fcccc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:51.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.803+0000 7fccd25b8640 1 --2- 172.21.15.27:0/39599569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcccc106f10 0x7fcccc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:51.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.803+0000 7fccd15b6640 1 -- 172.21.15.27:0/39599569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcccc101de0 msgr2=0x7fcccc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:51.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.803+0000 7fccd15b6640 1 --2- 172.21.15.27:0/39599569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcccc101de0 0x7fcccc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:51.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.803+0000 7fccd15b6640 1 -- 172.21.15.27:0/39599569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcccc106f10 msgr2=0x7fcccc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:51.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.803+0000 7fccd15b6640 1 --2- 172.21.15.27:0/39599569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcccc106f10 0x7fcccc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:51.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.803+0000 7fccd15b6640 1 -- 172.21.15.27:0/39599569 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcccc1a68b0 con 0x7fcccc102790 2024-09-19T08:09:51.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.803+0000 7fccd1db7640 1 --2- 172.21.15.27:0/39599569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcccc101de0 0x7fcccc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:09:51.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.803+0000 7fccd25b8640 1 --2- 172.21.15.27:0/39599569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcccc106f10 0x7fcccc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:09:51.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.803+0000 7fccd15b6640 1 --2- 172.21.15.27:0/39599569 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcccc102790 0x7fcccc074a30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fccc000c970 tx=0x7fccc000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:51.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.803+0000 7fcccaffd640 1 -- 172.21.15.27:0/39599569 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc0007bb0 con 0x7fcccc102790 2024-09-19T08:09:51.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.803+0000 7fcccaffd640 1 -- 172.21.15.27:0/39599569 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccc0007d50 con 0x7fcccc102790 2024-09-19T08:09:51.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.803+0000 7fccd401b640 1 -- 172.21.15.27:0/39599569 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcccc1a6ba0 con 0x7fcccc102790 2024-09-19T08:09:51.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.803+0000 7fcccaffd640 1 -- 172.21.15.27:0/39599569 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc000f450 con 0x7fcccc102790 2024-09-19T08:09:51.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.803+0000 7fccd401b640 1 -- 172.21.15.27:0/39599569 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcccc1a70e0 con 0x7fcccc102790 2024-09-19T08:09:51.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.804+0000 7fccd401b640 1 -- 172.21.15.27:0/39599569 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcccc062880 con 0x7fcccc102790 2024-09-19T08:09:51.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.805+0000 7fcccaffd640 1 -- 172.21.15.27:0/39599569 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fccc0005020 con 0x7fcccc102790 2024-09-19T08:09:51.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.806+0000 7fcccaffd640 1 --2- 172.21.15.27:0/39599569 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fccb40a3350 0x7fccb40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:51.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.806+0000 7fccd1db7640 1 --2- 172.21.15.27:0/39599569 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fccb40a3350 0x7fccb40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:51.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.806+0000 7fcccaffd640 1 -- 172.21.15.27:0/39599569 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fccc00cf6c0 con 0x7fcccc102790 2024-09-19T08:09:51.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.806+0000 7fcccaffd640 1 --2- 172.21.15.27:0/39599569 >> [v2:172.21.15.155:6824/1687418565,v1:172.21.15.155:6825/1687418565] conn(0x7fccb40acba0 0x7fccb40aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:51.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.806+0000 7fcccaffd640 1 -- 172.21.15.27:0/39599569 --> [v2:172.21.15.155:6824/1687418565,v1:172.21.15.155:6825/1687418565] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fccc0004490 con 0x7fccb40acba0 2024-09-19T08:09:51.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.806+0000 7fcccaffd640 1 -- 172.21.15.27:0/39599569 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fccc00d6050 con 0x7fcccc102790 2024-09-19T08:09:51.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.807+0000 7fccd1db7640 1 --2- 172.21.15.27:0/39599569 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fccb40a3350 0x7fccb40a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fccbc005c40 tx=0x7fccbc00a430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:51.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.807+0000 7fccd25b8640 1 --2- 172.21.15.27:0/39599569 >> [v2:172.21.15.155:6824/1687418565,v1:172.21.15.155:6825/1687418565] conn(0x7fccb40acba0 0x7fccb40aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:51.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.807+0000 7fccd25b8640 1 --2- 172.21.15.27:0/39599569 >> [v2:172.21.15.155:6824/1687418565,v1:172.21.15.155:6825/1687418565] conn(0x7fccb40acba0 0x7fccb40aefc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:51.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.808+0000 7fcccaffd640 1 -- 172.21.15.27:0/39599569 <== osd.10 v2:172.21.15.155:6824/1687418565 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fccc0004490 con 0x7fccb40acba0 2024-09-19T08:09:51.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.822+0000 7fccd401b640 1 -- 172.21.15.27:0/39599569 --> [v2:172.21.15.155:6824/1687418565,v1:172.21.15.155:6825/1687418565] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcccc062d30 con 0x7fccb40acba0 2024-09-19T08:09:51.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.822+0000 7fcccaffd640 1 -- 172.21.15.27:0/39599569 <== osd.10 v2:172.21.15.155:6824/1687418565 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcccc062d30 con 0x7fccb40acba0 2024-09-19T08:09:51.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.823+0000 7fccd401b640 1 -- 172.21.15.27:0/39599569 >> [v2:172.21.15.155:6824/1687418565,v1:172.21.15.155:6825/1687418565] conn(0x7fccb40acba0 msgr2=0x7fccb40aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:51.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.823+0000 7fccd401b640 1 --2- 172.21.15.27:0/39599569 >> [v2:172.21.15.155:6824/1687418565,v1:172.21.15.155:6825/1687418565] conn(0x7fccb40acba0 0x7fccb40aefc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:51.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.823+0000 7fccd401b640 1 -- 172.21.15.27:0/39599569 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fccb40a3350 msgr2=0x7fccb40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:51.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.823+0000 7fccd401b640 1 --2- 172.21.15.27:0/39599569 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fccb40a3350 0x7fccb40a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fccbc005c40 tx=0x7fccbc00a430 comp rx=0 tx=0).stop 2024-09-19T08:09:51.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.823+0000 7fccd401b640 1 -- 172.21.15.27:0/39599569 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcccc102790 msgr2=0x7fcccc074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:51.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.823+0000 7fccd401b640 1 --2- 172.21.15.27:0/39599569 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcccc102790 0x7fcccc074a30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fccc000c970 tx=0x7fccc000ce30 comp rx=0 tx=0).stop 2024-09-19T08:09:51.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.823+0000 7fccd25b8640 1 -- 172.21.15.27:0/39599569 reap_dead start 2024-09-19T08:09:51.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.823+0000 7fccd401b640 1 -- 172.21.15.27:0/39599569 shutdown_connections 2024-09-19T08:09:51.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.823+0000 7fccd401b640 1 -- 172.21.15.27:0/39599569 >> 172.21.15.27:0/39599569 conn(0x7fcccc0fd8c0 msgr2=0x7fcccc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:51.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.823+0000 7fccd401b640 1 -- 172.21.15.27:0/39599569 shutdown_connections 2024-09-19T08:09:51.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:51.823+0000 7fccd401b640 1 -- 172.21.15.27:0/39599569 wait complete. 2024-09-19T08:09:52.598 INFO:teuthology.orchestra.run.smithi027.stdout:292057776155 2024-09-19T08:09:52.598 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T08:09:52.953 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:52 smithi027 ceph-mon[31209]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1022 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T08:09:52.979 INFO:teuthology.orchestra.run.smithi027.stdout:55834574919 2024-09-19T08:09:52.980 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T08:09:52.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:52 smithi155 ceph-mon[35362]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1022 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T08:09:53.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:52 smithi203 ceph-mon[35198]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1022 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T08:09:53.644 INFO:teuthology.orchestra.run.smithi027.stdout:240518168612 2024-09-19T08:09:53.645 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T08:09:53.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.816+0000 7f7fdd69f640 1 -- 172.21.15.27:0/2985432065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fd8100e20 msgr2=0x7f7fd8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:53.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.816+0000 7f7fdd69f640 1 --2- 172.21.15.27:0/2985432065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fd8100e20 0x7f7fd8101200 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8009900 tx=0x7f7fc802a480 comp rx=0 tx=0).stop 2024-09-19T08:09:53.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.817+0000 7f7fdd69f640 1 -- 172.21.15.27:0/2985432065 shutdown_connections 2024-09-19T08:09:53.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.817+0000 7f7fdd69f640 1 --2- 172.21.15.27:0/2985432065 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7fd8102ef0 0x7f7fd810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:53.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.817+0000 7f7fdd69f640 1 --2- 172.21.15.27:0/2985432065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fd8102570 0x7f7fd81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:53.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.817+0000 7f7fdd69f640 1 --2- 172.21.15.27:0/2985432065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fd8100e20 0x7f7fd8101200 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:53.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.817+0000 7f7fdd69f640 1 -- 172.21.15.27:0/2985432065 >> 172.21.15.27:0/2985432065 conn(0x7f7fd80fc7d0 msgr2=0x7f7fd80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:53.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.817+0000 7f7fdd69f640 1 -- 172.21.15.27:0/2985432065 shutdown_connections 2024-09-19T08:09:53.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.817+0000 7f7fdd69f640 1 -- 172.21.15.27:0/2985432065 wait complete. 2024-09-19T08:09:53.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.817+0000 7f7fdd69f640 1 Processor -- start 2024-09-19T08:09:53.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.818+0000 7f7fdd69f640 1 -- start start 2024-09-19T08:09:53.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.818+0000 7f7fdd69f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fd8100e20 0x7f7fd8197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:53.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.818+0000 7f7fdd69f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7fd8102570 0x7f7fd8197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:53.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.818+0000 7f7fdd69f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fd8102ef0 0x7f7fd819be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:53.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.818+0000 7f7fdd69f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd8111020 con 0x7f7fd8100e20 2024-09-19T08:09:53.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.818+0000 7f7fdd69f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd8110ea0 con 0x7f7fd8102ef0 2024-09-19T08:09:53.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.818+0000 7f7fdd69f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd81111a0 con 0x7f7fd8102570 2024-09-19T08:09:53.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.818+0000 7f7fd6ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fd8100e20 0x7f7fd8197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:53.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.818+0000 7f7fd6ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fd8100e20 0x7f7fd8197580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44850/0 (socket says 172.21.15.27:44850) 2024-09-19T08:09:53.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.818+0000 7f7fd6ffd640 1 -- 172.21.15.27:0/212369850 learned_addr learned my addr 172.21.15.27:0/212369850 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:53.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.818+0000 7f7fd77fe640 1 --2- 172.21.15.27:0/212369850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fd8102ef0 0x7f7fd819be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:53.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.818+0000 7f7fd67fc640 1 --2- 172.21.15.27:0/212369850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7fd8102570 0x7f7fd8197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:53.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.818+0000 7f7fd6ffd640 1 -- 172.21.15.27:0/212369850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7fd8102570 msgr2=0x7f7fd8197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:53.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.818+0000 7f7fd6ffd640 1 --2- 172.21.15.27:0/212369850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7fd8102570 0x7f7fd8197ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:53.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.818+0000 7f7fd6ffd640 1 -- 172.21.15.27:0/212369850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fd8102ef0 msgr2=0x7f7fd819be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:53.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.818+0000 7f7fd6ffd640 1 --2- 172.21.15.27:0/212369850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fd8102ef0 0x7f7fd819be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:53.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.818+0000 7f7fd6ffd640 1 -- 172.21.15.27:0/212369850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd819c530 con 0x7f7fd8100e20 2024-09-19T08:09:53.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.818+0000 7f7fd77fe640 1 --2- 172.21.15.27:0/212369850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fd8102ef0 0x7f7fd819be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:09:53.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.818+0000 7f7fd67fc640 1 --2- 172.21.15.27:0/212369850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7fd8102570 0x7f7fd8197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:09:53.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.819+0000 7f7fd6ffd640 1 --2- 172.21.15.27:0/212369850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fd8100e20 0x7f7fd8197580 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8006010 tx=0x7f7fc8003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:53.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.819+0000 7f7fbffff640 1 -- 172.21.15.27:0/212369850 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc803f070 con 0x7f7fd8100e20 2024-09-19T08:09:53.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.819+0000 7f7fdd69f640 1 -- 172.21.15.27:0/212369850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd819c7c0 con 0x7f7fd8100e20 2024-09-19T08:09:53.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.819+0000 7f7fbffff640 1 -- 172.21.15.27:0/212369850 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fc8031e30 con 0x7f7fd8100e20 2024-09-19T08:09:53.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.819+0000 7f7fbffff640 1 -- 172.21.15.27:0/212369850 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8035030 con 0x7f7fd8100e20 2024-09-19T08:09:53.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.819+0000 7f7fdd69f640 1 -- 172.21.15.27:0/212369850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd8069f70 con 0x7f7fd8100e20 2024-09-19T08:09:53.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.820+0000 7f7fdd69f640 1 -- 172.21.15.27:0/212369850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7fd806a5a0 con 0x7f7fd8100e20 2024-09-19T08:09:53.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.821+0000 7f7fbffff640 1 -- 172.21.15.27:0/212369850 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7fc8042070 con 0x7f7fd8100e20 2024-09-19T08:09:53.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.822+0000 7f7fbffff640 1 --2- 172.21.15.27:0/212369850 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7fc00a32d0 0x7f7fc00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:53.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.822+0000 7f7fd67fc640 1 --2- 172.21.15.27:0/212369850 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7fc00a32d0 0x7f7fc00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:53.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.822+0000 7f7fbffff640 1 -- 172.21.15.27:0/212369850 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f7fc80f0990 con 0x7f7fd8100e20 2024-09-19T08:09:53.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.822+0000 7f7fbffff640 1 --2- 172.21.15.27:0/212369850 >> [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347] conn(0x7f7fc00acb20 0x7f7fc00aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:53.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.822+0000 7f7fbffff640 1 -- 172.21.15.27:0/212369850 --> [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7fc804ee50 con 0x7f7fc00acb20 2024-09-19T08:09:53.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.822+0000 7f7fbffff640 1 -- 172.21.15.27:0/212369850 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f7fc80f0d40 con 0x7f7fd8100e20 2024-09-19T08:09:53.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.823+0000 7f7fd77fe640 1 --2- 172.21.15.27:0/212369850 >> [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347] conn(0x7f7fc00acb20 0x7f7fc00aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:53.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.823+0000 7f7fd67fc640 1 --2- 172.21.15.27:0/212369850 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7fc00a32d0 0x7f7fc00a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80ffea0 tx=0x7f7fcc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:53.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.823+0000 7f7fd77fe640 1 --2- 172.21.15.27:0/212369850 >> [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347] conn(0x7f7fc00acb20 0x7f7fc00aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:53.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.824+0000 7f7fbffff640 1 -- 172.21.15.27:0/212369850 <== osd.3 v2:172.21.15.27:6810/1608304347 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7fc804ee50 con 0x7f7fc00acb20 2024-09-19T08:09:53.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.847+0000 7f7fdd69f640 1 -- 172.21.15.27:0/212369850 --> [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7fd806a9a0 con 0x7f7fc00acb20 2024-09-19T08:09:53.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.848+0000 7f7fbffff640 1 -- 172.21.15.27:0/212369850 <== osd.3 v2:172.21.15.27:6810/1608304347 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7fd806a9a0 con 0x7f7fc00acb20 2024-09-19T08:09:53.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.848+0000 7f7fdd69f640 1 -- 172.21.15.27:0/212369850 >> [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347] conn(0x7f7fc00acb20 msgr2=0x7f7fc00aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:53.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.848+0000 7f7fdd69f640 1 --2- 172.21.15.27:0/212369850 >> [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347] conn(0x7f7fc00acb20 0x7f7fc00aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:53.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.848+0000 7f7fdd69f640 1 -- 172.21.15.27:0/212369850 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7fc00a32d0 msgr2=0x7f7fc00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:53.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.848+0000 7f7fdd69f640 1 --2- 172.21.15.27:0/212369850 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7fc00a32d0 0x7f7fc00a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80ffea0 tx=0x7f7fcc008040 comp rx=0 tx=0).stop 2024-09-19T08:09:53.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.848+0000 7f7fdd69f640 1 -- 172.21.15.27:0/212369850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fd8100e20 msgr2=0x7f7fd8197580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:53.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.848+0000 7f7fdd69f640 1 --2- 172.21.15.27:0/212369850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fd8100e20 0x7f7fd8197580 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8006010 tx=0x7f7fc8003c80 comp rx=0 tx=0).stop 2024-09-19T08:09:53.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.848+0000 7f7fd77fe640 1 -- 172.21.15.27:0/212369850 reap_dead start 2024-09-19T08:09:53.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.848+0000 7f7fdd69f640 1 -- 172.21.15.27:0/212369850 shutdown_connections 2024-09-19T08:09:53.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.848+0000 7f7fdd69f640 1 -- 172.21.15.27:0/212369850 >> 172.21.15.27:0/212369850 conn(0x7f7fd80fc7d0 msgr2=0x7f7fd80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:53.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.849+0000 7f7fdd69f640 1 -- 172.21.15.27:0/212369850 shutdown_connections 2024-09-19T08:09:53.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:53.849+0000 7f7fdd69f640 1 -- 172.21.15.27:0/212369850 wait complete. 2024-09-19T08:09:54.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.616+0000 7f1ddca1b640 1 -- 172.21.15.27:0/1181807139 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1dd8102d30 msgr2=0x7f1dd8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:54.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.616+0000 7f1ddca1b640 1 --2- 172.21.15.27:0/1181807139 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1dd8102d30 0x7f1dd8103110 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009930 tx=0x7f1dc002a440 comp rx=0 tx=0).stop 2024-09-19T08:09:54.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.616+0000 7f1ddca1b640 1 -- 172.21.15.27:0/1181807139 shutdown_connections 2024-09-19T08:09:54.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.616+0000 7f1ddca1b640 1 --2- 172.21.15.27:0/1181807139 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1dd81082a0 0x7f1dd810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:54.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.616+0000 7f1ddca1b640 1 --2- 172.21.15.27:0/1181807139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dd81036e0 0x7f1dd8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:54.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.616+0000 7f1ddca1b640 1 --2- 172.21.15.27:0/1181807139 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1dd8102d30 0x7f1dd8103110 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:54.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.616+0000 7f1ddca1b640 1 -- 172.21.15.27:0/1181807139 >> 172.21.15.27:0/1181807139 conn(0x7f1dd80fc7d0 msgr2=0x7f1dd80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:54.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.616+0000 7f1ddca1b640 1 -- 172.21.15.27:0/1181807139 shutdown_connections 2024-09-19T08:09:54.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.616+0000 7f1ddca1b640 1 -- 172.21.15.27:0/1181807139 wait complete. 2024-09-19T08:09:54.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.616+0000 7f1ddca1b640 1 Processor -- start 2024-09-19T08:09:54.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.616+0000 7f1ddca1b640 1 -- start start 2024-09-19T08:09:54.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.617+0000 7f1ddca1b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1dd8102d30 0x7f1dd8198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:54.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.617+0000 7f1ddca1b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dd81036e0 0x7f1dd8198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:54.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.617+0000 7f1ddca1b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1dd81082a0 0x7f1dd819d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:54.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.617+0000 7f1ddca1b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd81121b0 con 0x7f1dd8102d30 2024-09-19T08:09:54.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.617+0000 7f1ddca1b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd8112030 con 0x7f1dd81082a0 2024-09-19T08:09:54.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.617+0000 7f1ddca1b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd8112330 con 0x7f1dd81036e0 2024-09-19T08:09:54.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.617+0000 7f1dd659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1dd8102d30 0x7f1dd8198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:54.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.617+0000 7f1dd659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1dd8102d30 0x7f1dd8198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44892/0 (socket says 172.21.15.27:44892) 2024-09-19T08:09:54.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.617+0000 7f1dd659c640 1 -- 172.21.15.27:0/3131054583 learned_addr learned my addr 172.21.15.27:0/3131054583 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:54.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.617+0000 7f1dd5d9b640 1 --2- 172.21.15.27:0/3131054583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dd81036e0 0x7f1dd8198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:54.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.617+0000 7f1dd659c640 1 -- 172.21.15.27:0/3131054583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dd81036e0 msgr2=0x7f1dd8198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:54.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.617+0000 7f1dd659c640 1 --2- 172.21.15.27:0/3131054583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dd81036e0 0x7f1dd8198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:54.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.617+0000 7f1dd659c640 1 -- 172.21.15.27:0/3131054583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1dd81082a0 msgr2=0x7f1dd819d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:54.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.617+0000 7f1dd659c640 1 --2- 172.21.15.27:0/3131054583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1dd81082a0 0x7f1dd819d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:54.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.617+0000 7f1dd659c640 1 -- 172.21.15.27:0/3131054583 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd819d700 con 0x7f1dd8102d30 2024-09-19T08:09:54.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.617+0000 7f1dd659c640 1 --2- 172.21.15.27:0/3131054583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1dd8102d30 0x7f1dd8198750 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1dc002a960 tx=0x7f1dc0003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:54.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.617+0000 7f1dcf7fe640 1 -- 172.21.15.27:0/3131054583 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc003f070 con 0x7f1dd8102d30 2024-09-19T08:09:54.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.617+0000 7f1dcf7fe640 1 -- 172.21.15.27:0/3131054583 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dc003b460 con 0x7f1dd8102d30 2024-09-19T08:09:54.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.617+0000 7f1ddca1b640 1 -- 172.21.15.27:0/3131054583 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dd819d990 con 0x7f1dd8102d30 2024-09-19T08:09:54.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.617+0000 7f1dcf7fe640 1 -- 172.21.15.27:0/3131054583 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0035030 con 0x7f1dd8102d30 2024-09-19T08:09:54.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.618+0000 7f1ddca1b640 1 -- 172.21.15.27:0/3131054583 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dd81a52d0 con 0x7f1dd8102d30 2024-09-19T08:09:54.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.618+0000 7f1ddca1b640 1 -- 172.21.15.27:0/3131054583 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1dd8062980 con 0x7f1dd8102d30 2024-09-19T08:09:54.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.620+0000 7f1dcf7fe640 1 -- 172.21.15.27:0/3131054583 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1dc0042070 con 0x7f1dd8102d30 2024-09-19T08:09:54.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.620+0000 7f1dcf7fe640 1 --2- 172.21.15.27:0/3131054583 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f1dc40a32d0 0x7f1dc40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:54.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.621+0000 7f1dd5d9b640 1 --2- 172.21.15.27:0/3131054583 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f1dc40a32d0 0x7f1dc40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:54.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.621+0000 7f1dcf7fe640 1 -- 172.21.15.27:0/3131054583 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f1dc00f05c0 con 0x7f1dd8102d30 2024-09-19T08:09:54.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.621+0000 7f1dcf7fe640 1 --2- 172.21.15.27:0/3131054583 >> [v2:172.21.15.155:6808/569913150,v1:172.21.15.155:6809/569913150] conn(0x7f1dc40acb20 0x7f1dc40aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:54.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.621+0000 7f1dcf7fe640 1 -- 172.21.15.27:0/3131054583 --> [v2:172.21.15.155:6808/569913150,v1:172.21.15.155:6809/569913150] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1dc0038e90 con 0x7f1dc40acb20 2024-09-19T08:09:54.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.621+0000 7f1dcf7fe640 1 -- 172.21.15.27:0/3131054583 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f1dc00f0aa0 con 0x7f1dd8102d30 2024-09-19T08:09:54.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.621+0000 7f1dd5d9b640 1 --2- 172.21.15.27:0/3131054583 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f1dc40a32d0 0x7f1dc40a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80fee30 tx=0x7f1dc8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:54.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.621+0000 7f1dd6d9d640 1 --2- 172.21.15.27:0/3131054583 >> [v2:172.21.15.155:6808/569913150,v1:172.21.15.155:6809/569913150] conn(0x7f1dc40acb20 0x7f1dc40aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:54.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.622+0000 7f1dd6d9d640 1 --2- 172.21.15.27:0/3131054583 >> [v2:172.21.15.155:6808/569913150,v1:172.21.15.155:6809/569913150] conn(0x7f1dc40acb20 0x7f1dc40aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:54.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.622+0000 7f1dcf7fe640 1 -- 172.21.15.27:0/3131054583 <== osd.4 v2:172.21.15.155:6808/569913150 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1dc0038e90 con 0x7f1dc40acb20 2024-09-19T08:09:54.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.636+0000 7f1ddca1b640 1 -- 172.21.15.27:0/3131054583 --> [v2:172.21.15.155:6808/569913150,v1:172.21.15.155:6809/569913150] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1dd8062e00 con 0x7f1dc40acb20 2024-09-19T08:09:54.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.637+0000 7f1dcf7fe640 1 -- 172.21.15.27:0/3131054583 <== osd.4 v2:172.21.15.155:6808/569913150 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1dd8062e00 con 0x7f1dc40acb20 2024-09-19T08:09:54.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.637+0000 7f1ddca1b640 1 -- 172.21.15.27:0/3131054583 >> [v2:172.21.15.155:6808/569913150,v1:172.21.15.155:6809/569913150] conn(0x7f1dc40acb20 msgr2=0x7f1dc40aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:54.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.637+0000 7f1ddca1b640 1 --2- 172.21.15.27:0/3131054583 >> [v2:172.21.15.155:6808/569913150,v1:172.21.15.155:6809/569913150] conn(0x7f1dc40acb20 0x7f1dc40aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:54.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.637+0000 7f1ddca1b640 1 -- 172.21.15.27:0/3131054583 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f1dc40a32d0 msgr2=0x7f1dc40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:54.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.637+0000 7f1ddca1b640 1 --2- 172.21.15.27:0/3131054583 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f1dc40a32d0 0x7f1dc40a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80fee30 tx=0x7f1dc8008040 comp rx=0 tx=0).stop 2024-09-19T08:09:54.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.637+0000 7f1ddca1b640 1 -- 172.21.15.27:0/3131054583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1dd8102d30 msgr2=0x7f1dd8198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:54.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.637+0000 7f1ddca1b640 1 --2- 172.21.15.27:0/3131054583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1dd8102d30 0x7f1dd8198750 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1dc002a960 tx=0x7f1dc0003c00 comp rx=0 tx=0).stop 2024-09-19T08:09:54.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.637+0000 7f1dd6d9d640 1 -- 172.21.15.27:0/3131054583 reap_dead start 2024-09-19T08:09:54.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.637+0000 7f1ddca1b640 1 -- 172.21.15.27:0/3131054583 shutdown_connections 2024-09-19T08:09:54.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.637+0000 7f1ddca1b640 1 -- 172.21.15.27:0/3131054583 >> 172.21.15.27:0/3131054583 conn(0x7f1dd80fc7d0 msgr2=0x7f1dd8105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:54.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.637+0000 7f1ddca1b640 1 -- 172.21.15.27:0/3131054583 shutdown_connections 2024-09-19T08:09:54.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.637+0000 7f1ddca1b640 1 -- 172.21.15.27:0/3131054583 wait complete. 2024-09-19T08:09:54.825 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:54 smithi027 ceph-mon[31209]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:09:54.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:54 smithi155 ceph-mon[35362]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:09:55.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:54 smithi203 ceph-mon[35198]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:09:55.521 INFO:teuthology.orchestra.run.smithi027.stdout:322122547222 2024-09-19T08:09:55.522 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T08:09:55.814 INFO:teuthology.orchestra.run.smithi027.stdout:188978561071 2024-09-19T08:09:55.815 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T08:09:55.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.825+0000 7f21097b3640 1 -- 172.21.15.27:0/3123177679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2104101400 msgr2=0x7f210410d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:55.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.825+0000 7f21097b3640 1 --2- 172.21.15.27:0/3123177679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2104101400 0x7f210410d930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f20fc009cd0 tx=0x7f20fc02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:09:55.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.825+0000 7f21097b3640 1 -- 172.21.15.27:0/3123177679 shutdown_connections 2024-09-19T08:09:55.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.825+0000 7f21097b3640 1 --2- 172.21.15.27:0/3123177679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2104101400 0x7f210410d930 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:55.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.825+0000 7f21097b3640 1 --2- 172.21.15.27:0/3123177679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2104100a60 0x7f2104100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:55.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.825+0000 7f21097b3640 1 --2- 172.21.15.27:0/3123177679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2104106a60 0x7f2104106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:55.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.825+0000 7f21097b3640 1 -- 172.21.15.27:0/3123177679 >> 172.21.15.27:0/3123177679 conn(0x7f21040fc780 msgr2=0x7f21040feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:55.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.825+0000 7f21097b3640 1 -- 172.21.15.27:0/3123177679 shutdown_connections 2024-09-19T08:09:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.826+0000 7f21097b3640 1 -- 172.21.15.27:0/3123177679 wait complete. 2024-09-19T08:09:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.826+0000 7f21097b3640 1 Processor -- start 2024-09-19T08:09:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.826+0000 7f21097b3640 1 -- start start 2024-09-19T08:09:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.827+0000 7f21097b3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2104100a60 0x7f2104198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.827+0000 7f21097b3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2104101400 0x7f2104198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.827+0000 7f21097b3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2104106a60 0x7f210419ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.827+0000 7f21097b3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2104110f00 con 0x7f2104106a60 2024-09-19T08:09:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.827+0000 7f21097b3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2104110d80 con 0x7f2104101400 2024-09-19T08:09:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.827+0000 7f21097b3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2104111080 con 0x7f2104100a60 2024-09-19T08:09:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.827+0000 7f21037fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2104106a60 0x7f210419ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.827+0000 7f21037fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2104106a60 0x7f210419ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44904/0 (socket says 172.21.15.27:44904) 2024-09-19T08:09:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.827+0000 7f21037fe640 1 -- 172.21.15.27:0/1418430690 learned_addr learned my addr 172.21.15.27:0/1418430690 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:55.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.827+0000 7f2102ffd640 1 --2- 172.21.15.27:0/1418430690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2104100a60 0x7f2104198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:55.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.827+0000 7f21027fc640 1 --2- 172.21.15.27:0/1418430690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2104101400 0x7f2104198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:55.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.827+0000 7f21037fe640 1 -- 172.21.15.27:0/1418430690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2104100a60 msgr2=0x7f2104198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:55.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.827+0000 7f21037fe640 1 --2- 172.21.15.27:0/1418430690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2104100a60 0x7f2104198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:55.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.827+0000 7f21037fe640 1 -- 172.21.15.27:0/1418430690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2104101400 msgr2=0x7f2104198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:55.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.827+0000 7f21037fe640 1 --2- 172.21.15.27:0/1418430690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2104101400 0x7f2104198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:55.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.827+0000 7f21037fe640 1 -- 172.21.15.27:0/1418430690 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210419d510 con 0x7f2104106a60 2024-09-19T08:09:55.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.827+0000 7f21027fc640 1 --2- 172.21.15.27:0/1418430690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2104101400 0x7f2104198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:09:55.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.827+0000 7f21037fe640 1 --2- 172.21.15.27:0/1418430690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2104106a60 0x7f210419ce30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f20fc006010 tx=0x7f20fc003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:55.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.827+0000 7f20ebfff640 1 -- 172.21.15.27:0/1418430690 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc004450 con 0x7f2104106a60 2024-09-19T08:09:55.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.828+0000 7f21097b3640 1 -- 172.21.15.27:0/1418430690 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f210419d7a0 con 0x7f2104106a60 2024-09-19T08:09:55.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.828+0000 7f20ebfff640 1 -- 172.21.15.27:0/1418430690 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20fc003e10 con 0x7f2104106a60 2024-09-19T08:09:55.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.828+0000 7f20ebfff640 1 -- 172.21.15.27:0/1418430690 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc0466e0 con 0x7f2104106a60 2024-09-19T08:09:55.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.828+0000 7f21097b3640 1 -- 172.21.15.27:0/1418430690 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21041a50e0 con 0x7f2104106a60 2024-09-19T08:09:55.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.828+0000 7f21097b3640 1 -- 172.21.15.27:0/1418430690 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2104062980 con 0x7f2104106a60 2024-09-19T08:09:55.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.830+0000 7f20ebfff640 1 -- 172.21.15.27:0/1418430690 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f20fc0305a0 con 0x7f2104106a60 2024-09-19T08:09:55.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.830+0000 7f20ebfff640 1 --2- 172.21.15.27:0/1418430690 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f20ec0a32d0 0x7f20ec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:55.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.830+0000 7f2102ffd640 1 --2- 172.21.15.27:0/1418430690 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f20ec0a32d0 0x7f20ec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:55.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.830+0000 7f20ebfff640 1 -- 172.21.15.27:0/1418430690 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f20fc02e030 con 0x7f2104106a60 2024-09-19T08:09:55.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.831+0000 7f20ebfff640 1 --2- 172.21.15.27:0/1418430690 >> [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483] conn(0x7f20ec0acb20 0x7f20ec0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:55.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.831+0000 7f20ebfff640 1 -- 172.21.15.27:0/1418430690 --> [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20fc0020b0 con 0x7f20ec0acb20 2024-09-19T08:09:55.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.831+0000 7f20ebfff640 1 -- 172.21.15.27:0/1418430690 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f20fc0f1880 con 0x7f2104106a60 2024-09-19T08:09:55.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.831+0000 7f21027fc640 1 --2- 172.21.15.27:0/1418430690 >> [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483] conn(0x7f20ec0acb20 0x7f20ec0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:55.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.831+0000 7f2102ffd640 1 --2- 172.21.15.27:0/1418430690 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f20ec0a32d0 0x7f20ec0a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f20f4009890 tx=0x7f20f4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:55.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.831+0000 7f21027fc640 1 --2- 172.21.15.27:0/1418430690 >> [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483] conn(0x7f20ec0acb20 0x7f20ec0aef40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:55.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.832+0000 7f20ebfff640 1 -- 172.21.15.27:0/1418430690 <== osd.9 v2:172.21.15.27:6826/118390483 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f20fc0020b0 con 0x7f20ec0acb20 2024-09-19T08:09:55.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.845+0000 7f21097b3640 1 -- 172.21.15.27:0/1418430690 --> [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2104062e00 con 0x7f20ec0acb20 2024-09-19T08:09:55.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.846+0000 7f20ebfff640 1 -- 172.21.15.27:0/1418430690 <== osd.9 v2:172.21.15.27:6826/118390483 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2104062e00 con 0x7f20ec0acb20 2024-09-19T08:09:55.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.846+0000 7f21097b3640 1 -- 172.21.15.27:0/1418430690 >> [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483] conn(0x7f20ec0acb20 msgr2=0x7f20ec0aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:55.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.846+0000 7f21097b3640 1 --2- 172.21.15.27:0/1418430690 >> [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483] conn(0x7f20ec0acb20 0x7f20ec0aef40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:55.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.846+0000 7f21097b3640 1 -- 172.21.15.27:0/1418430690 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f20ec0a32d0 msgr2=0x7f20ec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:55.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.846+0000 7f21097b3640 1 --2- 172.21.15.27:0/1418430690 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f20ec0a32d0 0x7f20ec0a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f20f4009890 tx=0x7f20f4008040 comp rx=0 tx=0).stop 2024-09-19T08:09:55.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.846+0000 7f21097b3640 1 -- 172.21.15.27:0/1418430690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2104106a60 msgr2=0x7f210419ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:55.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.846+0000 7f21097b3640 1 --2- 172.21.15.27:0/1418430690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2104106a60 0x7f210419ce30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f20fc006010 tx=0x7f20fc003c20 comp rx=0 tx=0).stop 2024-09-19T08:09:55.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.846+0000 7f21037fe640 1 -- 172.21.15.27:0/1418430690 reap_dead start 2024-09-19T08:09:55.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.846+0000 7f21097b3640 1 -- 172.21.15.27:0/1418430690 shutdown_connections 2024-09-19T08:09:55.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.846+0000 7f21097b3640 1 -- 172.21.15.27:0/1418430690 >> 172.21.15.27:0/1418430690 conn(0x7f21040fc780 msgr2=0x7f210406aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:55.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.846+0000 7f21097b3640 1 -- 172.21.15.27:0/1418430690 shutdown_connections 2024-09-19T08:09:55.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.846+0000 7f21097b3640 1 -- 172.21.15.27:0/1418430690 wait complete. 2024-09-19T08:09:56.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.026+0000 7ff7ea7b6640 1 -- 172.21.15.27:0/3332451636 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7e4102ef0 msgr2=0x7ff7e410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:56.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.026+0000 7ff7ea7b6640 1 --2- 172.21.15.27:0/3332451636 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7e4102ef0 0x7ff7e410da40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009ca0 tx=0x7ff7dc02a950 comp rx=0 tx=0).stop 2024-09-19T08:09:56.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.026+0000 7ff7ea7b6640 1 -- 172.21.15.27:0/3332451636 shutdown_connections 2024-09-19T08:09:56.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.026+0000 7ff7ea7b6640 1 --2- 172.21.15.27:0/3332451636 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7e4102ef0 0x7ff7e410da40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:56.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.026+0000 7ff7ea7b6640 1 --2- 172.21.15.27:0/3332451636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7e4102570 0x7ff7e41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:56.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.026+0000 7ff7ea7b6640 1 --2- 172.21.15.27:0/3332451636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7e4100e20 0x7ff7e4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:56.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.026+0000 7ff7ea7b6640 1 -- 172.21.15.27:0/3332451636 >> 172.21.15.27:0/3332451636 conn(0x7ff7e40fc7d0 msgr2=0x7ff7e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:56.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.026+0000 7ff7ea7b6640 1 -- 172.21.15.27:0/3332451636 shutdown_connections 2024-09-19T08:09:56.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.026+0000 7ff7ea7b6640 1 -- 172.21.15.27:0/3332451636 wait complete. 2024-09-19T08:09:56.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.027+0000 7ff7ea7b6640 1 Processor -- start 2024-09-19T08:09:56.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.027+0000 7ff7ea7b6640 1 -- start start 2024-09-19T08:09:56.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.027+0000 7ff7ea7b6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7e4100e20 0x7ff7e41983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:56.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.027+0000 7ff7ea7b6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7e4102570 0x7ff7e4198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:56.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.027+0000 7ff7ea7b6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7e4102ef0 0x7ff7e419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:56.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.027+0000 7ff7ea7b6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e4110f80 con 0x7ff7e4100e20 2024-09-19T08:09:56.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.027+0000 7ff7ea7b6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e4110e00 con 0x7ff7e4102ef0 2024-09-19T08:09:56.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.027+0000 7ff7ea7b6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e4111100 con 0x7ff7e4102570 2024-09-19T08:09:56.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.027+0000 7ff7e3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7e4100e20 0x7ff7e41983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:56.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.027+0000 7ff7e3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7e4100e20 0x7ff7e41983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44862/0 (socket says 172.21.15.27:44862) 2024-09-19T08:09:56.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.027+0000 7ff7e3fff640 1 -- 172.21.15.27:0/3929698238 learned_addr learned my addr 172.21.15.27:0/3929698238 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:56.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.028+0000 7ff7e37fe640 1 --2- 172.21.15.27:0/3929698238 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7e4102570 0x7ff7e4198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:56.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.028+0000 7ff7e3fff640 1 -- 172.21.15.27:0/3929698238 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7e4102570 msgr2=0x7ff7e4198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:56.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.028+0000 7ff7e8d53640 1 --2- 172.21.15.27:0/3929698238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7e4102ef0 0x7ff7e419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:56.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.028+0000 7ff7e3fff640 1 --2- 172.21.15.27:0/3929698238 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7e4102570 0x7ff7e4198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:56.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.028+0000 7ff7e3fff640 1 -- 172.21.15.27:0/3929698238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7e4102ef0 msgr2=0x7ff7e419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:56.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.028+0000 7ff7e3fff640 1 --2- 172.21.15.27:0/3929698238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7e4102ef0 0x7ff7e419cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:56.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.028+0000 7ff7e3fff640 1 -- 172.21.15.27:0/3929698238 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e419d380 con 0x7ff7e4100e20 2024-09-19T08:09:56.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.028+0000 7ff7e37fe640 1 --2- 172.21.15.27:0/3929698238 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7e4102570 0x7ff7e4198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:09:56.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.028+0000 7ff7e3fff640 1 --2- 172.21.15.27:0/3929698238 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7e4100e20 0x7ff7e41983d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400d950 tx=0x7ff7d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:56.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.028+0000 7ff7e17fa640 1 -- 172.21.15.27:0/3929698238 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4017070 con 0x7ff7e4100e20 2024-09-19T08:09:56.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.028+0000 7ff7e17fa640 1 -- 172.21.15.27:0/3929698238 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7d4009c30 con 0x7ff7e4100e20 2024-09-19T08:09:56.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.028+0000 7ff7ea7b6640 1 -- 172.21.15.27:0/3929698238 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7e419d670 con 0x7ff7e4100e20 2024-09-19T08:09:56.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.028+0000 7ff7e17fa640 1 -- 172.21.15.27:0/3929698238 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d400f6b0 con 0x7ff7e4100e20 2024-09-19T08:09:56.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.028+0000 7ff7ea7b6640 1 -- 172.21.15.27:0/3929698238 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7e41a4f50 con 0x7ff7e4100e20 2024-09-19T08:09:56.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.029+0000 7ff7ea7b6640 1 -- 172.21.15.27:0/3929698238 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff7e4062980 con 0x7ff7e4100e20 2024-09-19T08:09:56.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.030+0000 7ff7e17fa640 1 -- 172.21.15.27:0/3929698238 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff7d40109d0 con 0x7ff7e4100e20 2024-09-19T08:09:56.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.031+0000 7ff7e17fa640 1 --2- 172.21.15.27:0/3929698238 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff7d00a32d0 0x7ff7d00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:56.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.031+0000 7ff7e37fe640 1 --2- 172.21.15.27:0/3929698238 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff7d00a32d0 0x7ff7d00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:56.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.031+0000 7ff7e17fa640 1 -- 172.21.15.27:0/3929698238 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7ff7d40cf630 con 0x7ff7e4100e20 2024-09-19T08:09:56.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.031+0000 7ff7e17fa640 1 --2- 172.21.15.27:0/3929698238 >> [v2:172.21.15.155:6816/2047506436,v1:172.21.15.155:6817/2047506436] conn(0x7ff7d00acb20 0x7ff7d00aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:56.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.031+0000 7ff7e17fa640 1 -- 172.21.15.27:0/3929698238 --> [v2:172.21.15.155:6816/2047506436,v1:172.21.15.155:6817/2047506436] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff7d4004470 con 0x7ff7d00acb20 2024-09-19T08:09:56.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.031+0000 7ff7e17fa640 1 -- 172.21.15.27:0/3929698238 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7ff7d40d6050 con 0x7ff7e4100e20 2024-09-19T08:09:56.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.031+0000 7ff7e37fe640 1 --2- 172.21.15.27:0/3929698238 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff7d00a32d0 0x7ff7d00a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff7e41051c0 tx=0x7ff7cc005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:56.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.032+0000 7ff7e8d53640 1 --2- 172.21.15.27:0/3929698238 >> [v2:172.21.15.155:6816/2047506436,v1:172.21.15.155:6817/2047506436] conn(0x7ff7d00acb20 0x7ff7d00aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:56.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.032+0000 7ff7e8d53640 1 --2- 172.21.15.27:0/3929698238 >> [v2:172.21.15.155:6816/2047506436,v1:172.21.15.155:6817/2047506436] conn(0x7ff7d00acb20 0x7ff7d00aef40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:56.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.033+0000 7ff7e17fa640 1 -- 172.21.15.27:0/3929698238 <== osd.7 v2:172.21.15.155:6816/2047506436 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff7d4004470 con 0x7ff7d00acb20 2024-09-19T08:09:56.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.046+0000 7ff7ea7b6640 1 -- 172.21.15.27:0/3929698238 --> [v2:172.21.15.155:6816/2047506436,v1:172.21.15.155:6817/2047506436] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff7e4062e00 con 0x7ff7d00acb20 2024-09-19T08:09:56.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.047+0000 7ff7e17fa640 1 -- 172.21.15.27:0/3929698238 <== osd.7 v2:172.21.15.155:6816/2047506436 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff7e4062e00 con 0x7ff7d00acb20 2024-09-19T08:09:56.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.047+0000 7ff7ea7b6640 1 -- 172.21.15.27:0/3929698238 >> [v2:172.21.15.155:6816/2047506436,v1:172.21.15.155:6817/2047506436] conn(0x7ff7d00acb20 msgr2=0x7ff7d00aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:56.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.047+0000 7ff7ea7b6640 1 --2- 172.21.15.27:0/3929698238 >> [v2:172.21.15.155:6816/2047506436,v1:172.21.15.155:6817/2047506436] conn(0x7ff7d00acb20 0x7ff7d00aef40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:56.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.047+0000 7ff7ea7b6640 1 -- 172.21.15.27:0/3929698238 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff7d00a32d0 msgr2=0x7ff7d00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:56.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.047+0000 7ff7ea7b6640 1 --2- 172.21.15.27:0/3929698238 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff7d00a32d0 0x7ff7d00a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff7e41051c0 tx=0x7ff7cc005d90 comp rx=0 tx=0).stop 2024-09-19T08:09:56.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.047+0000 7ff7ea7b6640 1 -- 172.21.15.27:0/3929698238 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7e4100e20 msgr2=0x7ff7e41983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:56.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.047+0000 7ff7ea7b6640 1 --2- 172.21.15.27:0/3929698238 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7e4100e20 0x7ff7e41983d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400d950 tx=0x7ff7d400de10 comp rx=0 tx=0).stop 2024-09-19T08:09:56.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.047+0000 7ff7e8d53640 1 -- 172.21.15.27:0/3929698238 reap_dead start 2024-09-19T08:09:56.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.048+0000 7ff7ea7b6640 1 -- 172.21.15.27:0/3929698238 shutdown_connections 2024-09-19T08:09:56.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.048+0000 7ff7ea7b6640 1 -- 172.21.15.27:0/3929698238 >> 172.21.15.27:0/3929698238 conn(0x7ff7e40fc7d0 msgr2=0x7ff7e406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:56.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.048+0000 7ff7ea7b6640 1 -- 172.21.15.27:0/3929698238 shutdown_connections 2024-09-19T08:09:56.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:54.048+0000 7ff7ea7b6640 1 -- 172.21.15.27:0/3929698238 wait complete. 2024-09-19T08:09:56.933 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:56 smithi027 ceph-mon[31209]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:09:56.967 INFO:teuthology.orchestra.run.smithi027.stdout:210453397546 2024-09-19T08:09:56.967 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T08:09:56.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:56 smithi155 ceph-mon[35362]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:09:57.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:56 smithi203 ceph-mon[35198]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:09:57.665 INFO:teuthology.orchestra.run.smithi027.stdout:137438953530 2024-09-19T08:09:57.666 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T08:09:58.064 INFO:teuthology.orchestra.run.smithi027.stdout:107374182463 2024-09-19T08:09:58.064 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T08:09:58.563 INFO:teuthology.orchestra.run.smithi027.stdout:270582939681 2024-09-19T08:09:58.564 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T08:09:58.643 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:58.712 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:58.751 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:58.759 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:58.759 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:58.840 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:09:58 smithi027 ceph-mon[31209]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:09:58.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:09:58 smithi155 ceph-mon[35362]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:09:59.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:09:58 smithi203 ceph-mon[35198]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:09:59.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.754+0000 7f5483e9d640 1 -- 172.21.15.27:0/1745673622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f547c074eb0 msgr2=0x7f547c112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:59.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.754+0000 7f5483e9d640 1 --2- 172.21.15.27:0/1745673622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f547c074eb0 0x7f547c112650 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5470009900 tx=0x7f547002a480 comp rx=0 tx=0).stop 2024-09-19T08:09:59.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.754+0000 7f5483e9d640 1 -- 172.21.15.27:0/1745673622 shutdown_connections 2024-09-19T08:09:59.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.754+0000 7f5483e9d640 1 --2- 172.21.15.27:0/1745673622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f547c112b90 0x7f547c114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:59.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.754+0000 7f5483e9d640 1 --2- 172.21.15.27:0/1745673622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f547c074eb0 0x7f547c112650 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:59.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.754+0000 7f5483e9d640 1 --2- 172.21.15.27:0/1745673622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f547c074590 0x7f547c074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:59.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.754+0000 7f5483e9d640 1 -- 172.21.15.27:0/1745673622 >> 172.21.15.27:0/1745673622 conn(0x7f547c0fd8c0 msgr2=0x7f547c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:59.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.755+0000 7f5483e9d640 1 -- 172.21.15.27:0/1745673622 shutdown_connections 2024-09-19T08:09:59.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.755+0000 7f5483e9d640 1 -- 172.21.15.27:0/1745673622 wait complete. 2024-09-19T08:09:59.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.755+0000 7f5483e9d640 1 Processor -- start 2024-09-19T08:09:59.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.755+0000 7f5483e9d640 1 -- start start 2024-09-19T08:09:59.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.756+0000 7f5483e9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f547c074590 0x7f547c1a4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:59.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.756+0000 7f5483e9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f547c074eb0 0x7f547c1a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:59.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.756+0000 7f5483e9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f547c112b90 0x7f547c19ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:59.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.756+0000 7f5483e9d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f547c118650 con 0x7f547c112b90 2024-09-19T08:09:59.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.756+0000 7f5483e9d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f547c1184d0 con 0x7f547c074eb0 2024-09-19T08:09:59.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.756+0000 7f5483e9d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f547c1187d0 con 0x7f547c074590 2024-09-19T08:09:59.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.756+0000 7f548243a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f547c112b90 0x7f547c19ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:59.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.756+0000 7f548243a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f547c112b90 0x7f547c19ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44920/0 (socket says 172.21.15.27:44920) 2024-09-19T08:09:59.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.756+0000 7f548243a640 1 -- 172.21.15.27:0/3907629812 learned_addr learned my addr 172.21.15.27:0/3907629812 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:09:59.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.756+0000 7f5481438640 1 --2- 172.21.15.27:0/3907629812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f547c074eb0 0x7f547c1a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:59.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.756+0000 7f5481c39640 1 --2- 172.21.15.27:0/3907629812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f547c074590 0x7f547c1a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:59.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.756+0000 7f548243a640 1 -- 172.21.15.27:0/3907629812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f547c074590 msgr2=0x7f547c1a4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:59.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.756+0000 7f548243a640 1 --2- 172.21.15.27:0/3907629812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f547c074590 0x7f547c1a4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:59.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.756+0000 7f548243a640 1 -- 172.21.15.27:0/3907629812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f547c074eb0 msgr2=0x7f547c1a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:59.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.756+0000 7f548243a640 1 --2- 172.21.15.27:0/3907629812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f547c074eb0 0x7f547c1a4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:59.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.756+0000 7f548243a640 1 -- 172.21.15.27:0/3907629812 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547c19f150 con 0x7f547c112b90 2024-09-19T08:09:59.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.756+0000 7f5481c39640 1 --2- 172.21.15.27:0/3907629812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f547c074590 0x7f547c1a4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:09:59.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.756+0000 7f548243a640 1 --2- 172.21.15.27:0/3907629812 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f547c112b90 0x7f547c19ea20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f547400b3f0 tx=0x7f547400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:59.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.756+0000 7f547affd640 1 -- 172.21.15.27:0/3907629812 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474015020 con 0x7f547c112b90 2024-09-19T08:09:59.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.757+0000 7f547affd640 1 -- 172.21.15.27:0/3907629812 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5474011d10 con 0x7f547c112b90 2024-09-19T08:09:59.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.757+0000 7f5483e9d640 1 -- 172.21.15.27:0/3907629812 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f547c19f440 con 0x7f547c112b90 2024-09-19T08:09:59.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.757+0000 7f547affd640 1 -- 172.21.15.27:0/3907629812 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547400f2e0 con 0x7f547c112b90 2024-09-19T08:09:59.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.757+0000 7f5483e9d640 1 -- 172.21.15.27:0/3907629812 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f547c1ab730 con 0x7f547c112b90 2024-09-19T08:09:59.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.758+0000 7f5483e9d640 1 -- 172.21.15.27:0/3907629812 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f547c0749f0 con 0x7f547c112b90 2024-09-19T08:09:59.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.759+0000 7f547affd640 1 -- 172.21.15.27:0/3907629812 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5474018020 con 0x7f547c112b90 2024-09-19T08:09:59.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.760+0000 7f547affd640 1 --2- 172.21.15.27:0/3907629812 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f54640a32d0 0x7f54640a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:09:59.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.760+0000 7f5481c39640 1 --2- 172.21.15.27:0/3907629812 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f54640a32d0 0x7f54640a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:09:59.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.760+0000 7f547affd640 1 -- 172.21.15.27:0/3907629812 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f54740cf120 con 0x7f547c112b90 2024-09-19T08:09:59.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.760+0000 7f5481c39640 1 --2- 172.21.15.27:0/3907629812 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f54640a32d0 0x7f54640a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f547c19fb60 tx=0x7f546c0073e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:09:59.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.764+0000 7f547affd640 1 -- 172.21.15.27:0/3907629812 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f547401f020 con 0x7f547c112b90 2024-09-19T08:09:59.798 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:59.801 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:59.801 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:59.803 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:59.807 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:59.807 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:09:59.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.989+0000 7f5483e9d640 1 -- 172.21.15.27:0/3907629812 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f547c105030 con 0x7f547c112b90 2024-09-19T08:09:59.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.989+0000 7f547affd640 1 -- 172.21.15.27:0/3907629812 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f547409bfa0 con 0x7f547c112b90 2024-09-19T08:09:59.990 INFO:teuthology.orchestra.run.smithi027.stdout:322122547224 2024-09-19T08:09:59.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.991+0000 7f5483e9d640 1 -- 172.21.15.27:0/3907629812 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f54640a32d0 msgr2=0x7f54640a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:59.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.991+0000 7f5483e9d640 1 --2- 172.21.15.27:0/3907629812 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f54640a32d0 0x7f54640a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f547c19fb60 tx=0x7f546c0073e0 comp rx=0 tx=0).stop 2024-09-19T08:09:59.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.991+0000 7f5483e9d640 1 -- 172.21.15.27:0/3907629812 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f547c112b90 msgr2=0x7f547c19ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:09:59.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.991+0000 7f5483e9d640 1 --2- 172.21.15.27:0/3907629812 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f547c112b90 0x7f547c19ea20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f547400b3f0 tx=0x7f547400b8b0 comp rx=0 tx=0).stop 2024-09-19T08:09:59.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.991+0000 7f5483e9d640 1 -- 172.21.15.27:0/3907629812 shutdown_connections 2024-09-19T08:09:59.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.991+0000 7f5483e9d640 1 --2- 172.21.15.27:0/3907629812 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f547c112b90 0x7f547c19ea20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:59.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.991+0000 7f5483e9d640 1 --2- 172.21.15.27:0/3907629812 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f54640a32d0 0x7f54640a5790 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:59.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.991+0000 7f5483e9d640 1 --2- 172.21.15.27:0/3907629812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f547c074eb0 0x7f547c1a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:59.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.991+0000 7f5483e9d640 1 --2- 172.21.15.27:0/3907629812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f547c074590 0x7f547c1a4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:09:59.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.991+0000 7f5483e9d640 1 -- 172.21.15.27:0/3907629812 >> 172.21.15.27:0/3907629812 conn(0x7f547c0fd8c0 msgr2=0x7f547c0ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:09:59.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.991+0000 7f5483e9d640 1 -- 172.21.15.27:0/3907629812 shutdown_connections 2024-09-19T08:09:59.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:09:59.991+0000 7f5483e9d640 1 -- 172.21.15.27:0/3907629812 wait complete. 2024-09-19T08:10:00.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.012+0000 7f6c1fcd1640 1 -- 172.21.15.27:0/2662213840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c18106a90 msgr2=0x7f6c18106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:00.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.012+0000 7f6c1fcd1640 1 --2- 172.21.15.27:0/2662213840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c18106a90 0x7f6c18106e70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009930 tx=0x7f6c1402a420 comp rx=0 tx=0).stop 2024-09-19T08:10:00.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.012+0000 7f6c1fcd1640 1 -- 172.21.15.27:0/2662213840 shutdown_connections 2024-09-19T08:10:00.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.012+0000 7f6c1fcd1640 1 --2- 172.21.15.27:0/2662213840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c18101430 0x7f6c1810d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:00.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.012+0000 7f6c1fcd1640 1 --2- 172.21.15.27:0/2662213840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c18100a90 0x7f6c18100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:00.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.012+0000 7f6c1fcd1640 1 --2- 172.21.15.27:0/2662213840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c18106a90 0x7f6c18106e70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:00.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.013+0000 7f6c1fcd1640 1 -- 172.21.15.27:0/2662213840 >> 172.21.15.27:0/2662213840 conn(0x7f6c180fc7d0 msgr2=0x7f6c180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:00.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.013+0000 7f6c1fcd1640 1 -- 172.21.15.27:0/2662213840 shutdown_connections 2024-09-19T08:10:00.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.013+0000 7f6c1fcd1640 1 -- 172.21.15.27:0/2662213840 wait complete. 2024-09-19T08:10:00.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.013+0000 7f6c1fcd1640 1 Processor -- start 2024-09-19T08:10:00.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.013+0000 7f6c1fcd1640 1 -- start start 2024-09-19T08:10:00.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.013+0000 7f6c1fcd1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c18100a90 0x7f6c18198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:00.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.014+0000 7f6c1fcd1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c18101430 0x7f6c181989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:00.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.014+0000 7f6c1fcd1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c18106a90 0x7f6c1819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:00.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.014+0000 7f6c1fcd1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6c18110e90 con 0x7f6c18101430 2024-09-19T08:10:00.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.014+0000 7f6c1fcd1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c18110d10 con 0x7f6c18106a90 2024-09-19T08:10:00.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.014+0000 7f6c1fcd1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c18111010 con 0x7f6c18100a90 2024-09-19T08:10:00.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.014+0000 7f6c1da6d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c18100a90 0x7f6c18198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:00.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.014+0000 7f6c1d26c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c18101430 0x7f6c181989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:00.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.014+0000 7f6c1d26c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c18101430 0x7f6c181989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44938/0 (socket says 172.21.15.27:44938) 2024-09-19T08:10:00.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.014+0000 7f6c1da6d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c18100a90 0x7f6c18198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.27:37746/0 (socket says 172.21.15.27:37746) 2024-09-19T08:10:00.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.014+0000 7f6c1d26c640 1 -- 172.21.15.27:0/2749711213 learned_addr learned my addr 172.21.15.27:0/2749711213 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:00.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.014+0000 7f6c1e26e640 1 --2- 172.21.15.27:0/2749711213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c18106a90 0x7f6c1819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:00.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.014+0000 7f6c1d26c640 1 -- 172.21.15.27:0/2749711213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c18100a90 msgr2=0x7f6c18198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:00.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.014+0000 7f6c1d26c640 1 --2- 172.21.15.27:0/2749711213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c18100a90 0x7f6c18198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:00.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.014+0000 7f6c1d26c640 1 -- 172.21.15.27:0/2749711213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c18106a90 msgr2=0x7f6c1819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:00.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.014+0000 7f6c1d26c640 1 --2- 172.21.15.27:0/2749711213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c18106a90 0x7f6c1819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:00.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.014+0000 7f6c1d26c640 1 -- 172.21.15.27:0/2749711213 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1819d420 con 0x7f6c18101430 2024-09-19T08:10:00.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.014+0000 7f6c1da6d640 1 --2- 172.21.15.27:0/2749711213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c18100a90 0x7f6c18198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:10:00.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.014+0000 7f6c1d26c640 1 --2- 172.21.15.27:0/2749711213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c18101430 0x7f6c181989b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800d950 tx=0x7f6c0800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:00.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.015+0000 7f6c0effd640 1 -- 172.21.15.27:0/2749711213 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08017030 con 0x7f6c18101430 2024-09-19T08:10:00.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.015+0000 7f6c1fcd1640 1 -- 172.21.15.27:0/2749711213 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1819d710 con 0x7f6c18101430 2024-09-19T08:10:00.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.015+0000 7f6c1fcd1640 1 -- 172.21.15.27:0/2749711213 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c180fccf0 con 0x7f6c18101430 2024-09-19T08:10:00.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.015+0000 7f6c0effd640 1 -- 172.21.15.27:0/2749711213 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c08004020 con 0x7f6c18101430 2024-09-19T08:10:00.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.015+0000 7f6c0effd640 1 -- 172.21.15.27:0/2749711213 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c080047a0 con 0x7f6c18101430 2024-09-19T08:10:00.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.016+0000 7f6c1fcd1640 1 -- 172.21.15.27:0/2749711213 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c18100ef0 con 0x7f6c18101430 2024-09-19T08:10:00.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.018+0000 7f6c0effd640 1 -- 172.21.15.27:0/2749711213 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6c080041d0 con 0x7f6c18101430 2024-09-19T08:10:00.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.019+0000 7f6c0effd640 1 --2- 172.21.15.27:0/2749711213 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6c040a32d0 0x7f6c040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:00.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.019+0000 7f6c0effd640 1 -- 172.21.15.27:0/2749711213 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f6c080cf8c0 con 0x7f6c18101430 2024-09-19T08:10:00.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.019+0000 7f6c1da6d640 1 --2- 172.21.15.27:0/2749711213 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6c040a32d0 0x7f6c040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:00.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.020+0000 7f6c1da6d640 1 --2- 172.21.15.27:0/2749711213 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6c040a32d0 0x7f6c040a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009900 tx=0x7f6c140058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:00.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.022+0000 7f6c0effd640 1 -- 172.21.15.27:0/2749711213 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6c0809c630 con 0x7f6c18101430 2024-09-19T08:10:00.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.200+0000 7f6c1fcd1640 1 -- 172.21.15.27:0/2749711213 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6c1810a010 con 0x7f6c18101430 2024-09-19T08:10:00.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.200+0000 7f6c0effd640 1 -- 172.21.15.27:0/2749711213 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6c0809bf30 con 0x7f6c18101430 2024-09-19T08:10:00.201 INFO:teuthology.orchestra.run.smithi027.stdout:188978561072 2024-09-19T08:10:00.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.203+0000 7f6c1fcd1640 1 -- 172.21.15.27:0/2749711213 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6c040a32d0 msgr2=0x7f6c040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:00.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.203+0000 7f6c1fcd1640 1 --2- 172.21.15.27:0/2749711213 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6c040a32d0 0x7f6c040a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009900 tx=0x7f6c140058d0 comp rx=0 tx=0).stop 2024-09-19T08:10:00.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.203+0000 7f6c1fcd1640 1 -- 172.21.15.27:0/2749711213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c18101430 msgr2=0x7f6c181989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:00.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.203+0000 7f6c1fcd1640 1 --2- 172.21.15.27:0/2749711213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c18101430 0x7f6c181989b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800d950 tx=0x7f6c0800de10 comp rx=0 tx=0).stop 2024-09-19T08:10:00.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.203+0000 7f6c1fcd1640 1 -- 172.21.15.27:0/2749711213 shutdown_connections 2024-09-19T08:10:00.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.203+0000 7f6c1fcd1640 1 --2- 172.21.15.27:0/2749711213 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6c040a32d0 0x7f6c040a5790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:00.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.203+0000 7f6c1fcd1640 1 --2- 172.21.15.27:0/2749711213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c18106a90 0x7f6c1819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:00.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.203+0000 7f6c1fcd1640 1 --2- 172.21.15.27:0/2749711213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c18101430 0x7f6c181989b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:00.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.203+0000 7f6c1fcd1640 1 --2- 172.21.15.27:0/2749711213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c18100a90 0x7f6c18198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:00.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.203+0000 7f6c1fcd1640 1 -- 172.21.15.27:0/2749711213 >> 172.21.15.27:0/2749711213 conn(0x7f6c180fc7d0 msgr2=0x7f6c1806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:00.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.203+0000 7f6c1fcd1640 1 -- 172.21.15.27:0/2749711213 shutdown_connections 2024-09-19T08:10:00.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:00.203+0000 7f6c1fcd1640 1 -- 172.21.15.27:0/2749711213 wait complete. 2024-09-19T08:10:00.863 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:00 smithi027 ceph-mon[31209]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:00.863 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:00 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3907629812' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T08:10:00.863 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:00 smithi027 ceph-mon[31209]: overall HEALTH_OK 2024-09-19T08:10:00.863 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:00 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2749711213' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T08:10:00.897 INFO:tasks.cephadm.ceph_manager.ceph:need seq 322122547222 got 322122547224 for osd.11 2024-09-19T08:10:00.897 DEBUG:teuthology.parallel:result is None 2024-09-19T08:10:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:00 smithi203 ceph-mon[35198]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:00 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3907629812' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T08:10:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:00 smithi203 ceph-mon[35198]: overall HEALTH_OK 2024-09-19T08:10:01.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:00 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2749711213' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T08:10:01.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:00 smithi155 ceph-mon[35362]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:01.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:00 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3907629812' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T08:10:01.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:00 smithi155 ceph-mon[35362]: overall HEALTH_OK 2024-09-19T08:10:01.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:00 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2749711213' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T08:10:01.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.493+0000 7f3321616640 1 -- 172.21.15.27:0/667110693 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f331c1082a0 msgr2=0x7f331c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:01.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.493+0000 7f3321616640 1 --2- 172.21.15.27:0/667110693 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f331c1082a0 0x7f331c10ec40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f330c009cd0 tx=0x7f330c02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:10:01.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.494+0000 7f3321616640 1 -- 172.21.15.27:0/667110693 shutdown_connections 2024-09-19T08:10:01.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.494+0000 7f3321616640 1 --2- 172.21.15.27:0/667110693 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f331c1082a0 0x7f331c10ec40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:01.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.494+0000 7f3321616640 1 --2- 172.21.15.27:0/667110693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f331c1036e0 0x7f331c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:01.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.494+0000 7f3321616640 1 --2- 172.21.15.27:0/667110693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f331c102d30 0x7f331c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:01.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.494+0000 7f3321616640 1 -- 172.21.15.27:0/667110693 >> 172.21.15.27:0/667110693 conn(0x7f331c0fc7d0 msgr2=0x7f331c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:01.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.494+0000 7f3321616640 1 -- 172.21.15.27:0/667110693 shutdown_connections 2024-09-19T08:10:01.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.494+0000 7f3321616640 1 -- 172.21.15.27:0/667110693 wait complete. 2024-09-19T08:10:01.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.494+0000 7f3321616640 1 Processor -- start 2024-09-19T08:10:01.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.494+0000 7f3321616640 1 -- start start 2024-09-19T08:10:01.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.495+0000 7f3321616640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f331c102d30 0x7f331c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:01.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.495+0000 7f3321616640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f331c1036e0 0x7f331c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:01.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.495+0000 7f3321616640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f331c1082a0 0x7f331c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:01.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.495+0000 7f3321616640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f331c1120a0 con 0x7f331c1082a0 2024-09-19T08:10:01.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.495+0000 7f3321616640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f331c111f20 con 0x7f331c1036e0 2024-09-19T08:10:01.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.495+0000 7f3321616640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f331c112220 con 0x7f331c102d30 2024-09-19T08:10:01.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.495+0000 7f331b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f331c1082a0 0x7f331c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:01.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.495+0000 7f331b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f331c1082a0 0x7f331c101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38250/0 (socket says 172.21.15.27:38250) 2024-09-19T08:10:01.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.495+0000 7f331b7fe640 1 -- 172.21.15.27:0/743008491 learned_addr learned my addr 172.21.15.27:0/743008491 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:01.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.495+0000 7f331affd640 1 --2- 172.21.15.27:0/743008491 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f331c102d30 0x7f331c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:01.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.495+0000 7f331b7fe640 1 -- 172.21.15.27:0/743008491 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f331c102d30 msgr2=0x7f331c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:01.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.495+0000 7f331b7fe640 1 --2- 172.21.15.27:0/743008491 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f331c102d30 0x7f331c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:01.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.495+0000 7f331a7fc640 1 --2- 172.21.15.27:0/743008491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f331c1036e0 0x7f331c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:01.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.495+0000 7f331b7fe640 1 -- 172.21.15.27:0/743008491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f331c1036e0 msgr2=0x7f331c100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:01.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.495+0000 7f331b7fe640 1 --2- 172.21.15.27:0/743008491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f331c1036e0 0x7f331c100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:01.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.495+0000 7f331b7fe640 1 -- 172.21.15.27:0/743008491 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331c1a6990 con 0x7f331c1082a0 2024-09-19T08:10:01.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.495+0000 7f331affd640 1 --2- 172.21.15.27:0/743008491 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f331c102d30 0x7f331c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:10:01.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.495+0000 7f331b7fe640 1 --2- 172.21.15.27:0/743008491 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f331c1082a0 0x7f331c101410 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f330c005cc0 tx=0x7f330c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:01.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.496+0000 7f3313fff640 1 -- 172.21.15.27:0/743008491 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c004040 con 0x7f331c1082a0 2024-09-19T08:10:01.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.496+0000 7f3313fff640 1 -- 172.21.15.27:0/743008491 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f330c0046c0 con 0x7f331c1082a0 2024-09-19T08:10:01.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.496+0000 7f3321616640 1 -- 172.21.15.27:0/743008491 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f331c1a6c20 con 0x7f331c1082a0 2024-09-19T08:10:01.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.496+0000 7f3313fff640 1 -- 172.21.15.27:0/743008491 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c046480 con 0x7f331c1082a0 2024-09-19T08:10:01.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.496+0000 7f3321616640 1 -- 172.21.15.27:0/743008491 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f331c1a7160 con 0x7f331c1082a0 2024-09-19T08:10:01.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.497+0000 7f3321616640 1 -- 172.21.15.27:0/743008491 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f331c103110 con 0x7f331c1082a0 2024-09-19T08:10:01.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.498+0000 7f3313fff640 1 -- 172.21.15.27:0/743008491 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f330c0305a0 con 0x7f331c1082a0 2024-09-19T08:10:01.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.498+0000 7f3313fff640 1 --2- 172.21.15.27:0/743008491 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f33080a32d0 0x7f33080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:01.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.499+0000 7f331affd640 1 --2- 172.21.15.27:0/743008491 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f33080a32d0 0x7f33080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:01.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.499+0000 7f3313fff640 1 -- 172.21.15.27:0/743008491 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f330c02e030 con 0x7f331c1082a0 2024-09-19T08:10:01.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.499+0000 7f331affd640 1 --2- 172.21.15.27:0/743008491 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f33080a32d0 0x7f33080a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f331400baa0 tx=0x7f3314005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:01.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.502+0000 7f3313fff640 1 -- 172.21.15.27:0/743008491 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f330c04b060 con 0x7f331c1082a0 2024-09-19T08:10:01.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.679+0000 7f3321616640 1 -- 172.21.15.27:0/743008491 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f331c10a2b0 con 0x7f331c1082a0 2024-09-19T08:10:01.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.679+0000 7f3313fff640 1 -- 172.21.15.27:0/743008491 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f330c0be0e0 con 0x7f331c1082a0 2024-09-19T08:10:01.680 INFO:teuthology.orchestra.run.smithi027.stdout:55834574921 2024-09-19T08:10:01.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.681+0000 7f3321616640 1 -- 172.21.15.27:0/743008491 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f33080a32d0 msgr2=0x7f33080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:01.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.681+0000 7f3321616640 1 --2- 172.21.15.27:0/743008491 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f33080a32d0 0x7f33080a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f331400baa0 tx=0x7f3314005d90 comp rx=0 tx=0).stop 2024-09-19T08:10:01.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.682+0000 7f3321616640 1 -- 172.21.15.27:0/743008491 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f331c1082a0 msgr2=0x7f331c101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:01.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.682+0000 7f3321616640 1 --2- 172.21.15.27:0/743008491 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f331c1082a0 0x7f331c101410 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f330c005cc0 tx=0x7f330c003970 comp rx=0 tx=0).stop 2024-09-19T08:10:01.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.682+0000 7f3321616640 1 -- 172.21.15.27:0/743008491 shutdown_connections 2024-09-19T08:10:01.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.682+0000 7f3321616640 1 --2- 172.21.15.27:0/743008491 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f331c1082a0 0x7f331c101410 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:01.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.682+0000 7f3321616640 1 --2- 172.21.15.27:0/743008491 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f33080a32d0 0x7f33080a5790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:01.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.682+0000 7f3321616640 1 --2- 172.21.15.27:0/743008491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f331c1036e0 0x7f331c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:01.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.682+0000 7f3321616640 1 --2- 172.21.15.27:0/743008491 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f331c102d30 0x7f331c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:01.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.682+0000 7f3321616640 1 -- 172.21.15.27:0/743008491 >> 172.21.15.27:0/743008491 conn(0x7f331c0fc7d0 msgr2=0x7f331c106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:01.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.682+0000 7f3321616640 1 -- 172.21.15.27:0/743008491 shutdown_connections 2024-09-19T08:10:01.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:01.682+0000 7f3321616640 1 -- 172.21.15.27:0/743008491 wait complete. 2024-09-19T08:10:02.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:01 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/743008491' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T08:10:02.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:01 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/743008491' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T08:10:02.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:01 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/743008491' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T08:10:02.385 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574919 got 55834574921 for osd.1 2024-09-19T08:10:02.385 DEBUG:teuthology.parallel:result is None 2024-09-19T08:10:02.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.906+0000 7ff34ee61640 1 -- 172.21.15.27:0/5952906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff348100e20 msgr2=0x7ff348101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:02.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.906+0000 7ff34ee61640 1 --2- 172.21.15.27:0/5952906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff348100e20 0x7ff348101200 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff338009900 tx=0x7ff33802a480 comp rx=0 tx=0).stop 2024-09-19T08:10:02.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.906+0000 7ff34ee61640 1 -- 172.21.15.27:0/5952906 shutdown_connections 2024-09-19T08:10:02.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.906+0000 7ff34ee61640 1 --2- 172.21.15.27:0/5952906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff348102ef0 0x7ff34810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:02.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.906+0000 7ff34ee61640 1 --2- 172.21.15.27:0/5952906 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff348102570 0x7ff3481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:02.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.906+0000 7ff34ee61640 1 --2- 172.21.15.27:0/5952906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff348100e20 0x7ff348101200 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:02.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.906+0000 7ff34ee61640 1 -- 172.21.15.27:0/5952906 >> 172.21.15.27:0/5952906 conn(0x7ff3480fc7d0 msgr2=0x7ff3480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:02.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.906+0000 7ff34ee61640 1 -- 172.21.15.27:0/5952906 shutdown_connections 2024-09-19T08:10:02.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.906+0000 7ff34ee61640 1 -- 172.21.15.27:0/5952906 wait complete. 2024-09-19T08:10:02.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.906+0000 7ff34ee61640 1 Processor -- start 2024-09-19T08:10:02.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.906+0000 7ff34ee61640 1 -- start start 2024-09-19T08:10:02.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.906+0000 7ff34ee61640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff348100e20 0x7ff348198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:02.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff34ee61640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff348102570 0x7ff348198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:02.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff34ee61640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff348102ef0 0x7ff34819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:02.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff34ee61640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff348110fa0 con 0x7ff348102ef0 2024-09-19T08:10:02.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff34ee61640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff348110e20 con 0x7ff348102570 2024-09-19T08:10:02.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff34ee61640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff348111120 con 0x7ff348100e20 2024-09-19T08:10:02.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff34d3fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff348102ef0 0x7ff34819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:02.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff34d3fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff348102ef0 0x7ff34819cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38258/0 (socket says 172.21.15.27:38258) 2024-09-19T08:10:02.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff34d3fe640 1 -- 172.21.15.27:0/3651841953 learned_addr learned my addr 172.21.15.27:0/3651841953 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:02.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff34d3fe640 1 -- 172.21.15.27:0/3651841953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff348100e20 msgr2=0x7ff348198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:02.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff34cbfd640 1 --2- 172.21.15.27:0/3651841953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff348100e20 0x7ff348198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:02.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff34d3fe640 1 --2- 172.21.15.27:0/3651841953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff348100e20 0x7ff348198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:02.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff347fff640 1 --2- 172.21.15.27:0/3651841953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff348102570 0x7ff348198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:02.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff34d3fe640 1 -- 172.21.15.27:0/3651841953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff348102570 msgr2=0x7ff348198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:02.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff34d3fe640 1 --2- 172.21.15.27:0/3651841953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff348102570 0x7ff348198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:02.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff34d3fe640 1 -- 172.21.15.27:0/3651841953 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff34819d5a0 con 0x7ff348102ef0 2024-09-19T08:10:02.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff34cbfd640 1 --2- 172.21.15.27:0/3651841953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff348100e20 0x7ff348198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:10:02.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff34d3fe640 1 --2- 172.21.15.27:0/3651841953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff348102ef0 0x7ff34819cec0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff34000b970 tx=0x7ff34000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:02.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff345ffb640 1 -- 172.21.15.27:0/3651841953 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff340019070 con 0x7ff348102ef0 2024-09-19T08:10:02.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff34ee61640 1 -- 172.21.15.27:0/3651841953 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff34819d890 con 0x7ff348102ef0 2024-09-19T08:10:02.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff345ffb640 1 -- 172.21.15.27:0/3651841953 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff34000cb40 con 0x7ff348102ef0 2024-09-19T08:10:02.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.907+0000 7ff345ffb640 1 -- 172.21.15.27:0/3651841953 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff340007650 con 0x7ff348102ef0 2024-09-19T08:10:02.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.908+0000 7ff34ee61640 1 -- 172.21.15.27:0/3651841953 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3481a5170 con 0x7ff348102ef0 2024-09-19T08:10:02.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.908+0000 7ff34ee61640 1 -- 172.21.15.27:0/3651841953 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff348101200 con 0x7ff348102ef0 2024-09-19T08:10:02.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.910+0000 7ff345ffb640 1 -- 172.21.15.27:0/3651841953 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff34001c070 con 0x7ff348102ef0 2024-09-19T08:10:02.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.910+0000 7ff345ffb640 1 --2- 172.21.15.27:0/3651841953 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff3300a32d0 0x7ff3300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:02.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.910+0000 7ff34cbfd640 1 --2- 172.21.15.27:0/3651841953 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff3300a32d0 0x7ff3300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:02.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.910+0000 7ff345ffb640 1 -- 172.21.15.27:0/3651841953 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7ff3400cf340 con 0x7ff348102ef0 2024-09-19T08:10:02.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.911+0000 7ff34cbfd640 1 --2- 172.21.15.27:0/3651841953 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff3300a32d0 0x7ff3300a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff338000c00 tx=0x7ff3380041e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:02.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:02.913+0000 7ff345ffb640 1 -- 172.21.15.27:0/3651841953 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff34009c1c0 con 0x7ff348102ef0 2024-09-19T08:10:03.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:02 smithi027 ceph-mon[31209]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:03.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:02 smithi203 ceph-mon[35198]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:03.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.094+0000 7ff34ee61640 1 -- 172.21.15.27:0/3651841953 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff3481a5370 con 0x7ff348102ef0 2024-09-19T08:10:03.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.094+0000 7ff345ffb640 1 -- 172.21.15.27:0/3651841953 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff34009bac0 con 0x7ff348102ef0 2024-09-19T08:10:03.095 INFO:teuthology.orchestra.run.smithi027.stdout:107374182465 2024-09-19T08:10:03.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.097+0000 7ff34ee61640 1 -- 172.21.15.27:0/3651841953 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff3300a32d0 msgr2=0x7ff3300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:03.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.097+0000 7ff34ee61640 1 --2- 172.21.15.27:0/3651841953 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff3300a32d0 0x7ff3300a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff338000c00 tx=0x7ff3380041e0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.097+0000 7ff34ee61640 1 -- 172.21.15.27:0/3651841953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff348102ef0 msgr2=0x7ff34819cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:03.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.097+0000 7ff34ee61640 1 --2- 172.21.15.27:0/3651841953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff348102ef0 0x7ff34819cec0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff34000b970 tx=0x7ff34000be30 comp rx=0 tx=0).stop 2024-09-19T08:10:03.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.097+0000 7ff34ee61640 1 -- 172.21.15.27:0/3651841953 shutdown_connections 2024-09-19T08:10:03.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.097+0000 7ff34ee61640 1 --2- 172.21.15.27:0/3651841953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff348102ef0 0x7ff34819cec0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.097+0000 7ff34ee61640 1 --2- 172.21.15.27:0/3651841953 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff3300a32d0 0x7ff3300a5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.097+0000 7ff34ee61640 1 --2- 172.21.15.27:0/3651841953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff348102570 0x7ff348198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.097+0000 7ff34ee61640 1 --2- 172.21.15.27:0/3651841953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff348100e20 0x7ff348198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.097+0000 7ff34ee61640 1 -- 172.21.15.27:0/3651841953 >> 172.21.15.27:0/3651841953 conn(0x7ff3480fc7d0 msgr2=0x7ff348069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:03.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.097+0000 7ff34ee61640 1 -- 172.21.15.27:0/3651841953 shutdown_connections 2024-09-19T08:10:03.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.097+0000 7ff34ee61640 1 -- 172.21.15.27:0/3651841953 wait complete. 2024-09-19T08:10:03.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.186+0000 7f6aa12b2640 1 -- 172.21.15.27:0/2818899126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a9c108300 msgr2=0x7f6a9c10ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:03.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.186+0000 7f6aa12b2640 1 --2- 172.21.15.27:0/2818899126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a9c108300 0x7f6a9c10ec70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009cd0 tx=0x7f6a9402a8d0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.186+0000 7f6aa12b2640 1 -- 172.21.15.27:0/2818899126 shutdown_connections 2024-09-19T08:10:03.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.186+0000 7f6aa12b2640 1 --2- 172.21.15.27:0/2818899126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a9c108300 0x7f6a9c10ec70 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.186+0000 7f6aa12b2640 1 --2- 172.21.15.27:0/2818899126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a9c103780 0x7f6a9c107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.186+0000 7f6aa12b2640 1 --2- 172.21.15.27:0/2818899126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a9c102dd0 0x7f6a9c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.186+0000 7f6aa12b2640 1 -- 172.21.15.27:0/2818899126 >> 172.21.15.27:0/2818899126 conn(0x7f6a9c0fc7d0 msgr2=0x7f6a9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:03.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.186+0000 7f6aa12b2640 1 -- 172.21.15.27:0/2818899126 shutdown_connections 2024-09-19T08:10:03.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.186+0000 7f6aa12b2640 1 -- 172.21.15.27:0/2818899126 wait complete. 2024-09-19T08:10:03.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.187+0000 7f6aa12b2640 1 Processor -- start 2024-09-19T08:10:03.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.187+0000 7f6aa12b2640 1 -- start start 2024-09-19T08:10:03.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.187+0000 7f6aa12b2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a9c102dd0 0x7f6a9c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:03.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.187+0000 7f6aa12b2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a9c103780 0x7f6a9c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:03.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.187+0000 7f6aa12b2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a9c108300 0x7f6a9c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:03.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.187+0000 7f6aa12b2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c112110 con 0x7f6a9c108300 2024-09-19T08:10:03.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.187+0000 7f6aa12b2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c111f90 con 0x7f6a9c102dd0 2024-09-19T08:10:03.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.187+0000 7f6aa12b2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c112290 con 0x7f6a9c103780 2024-09-19T08:10:03.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.187+0000 7f6a9b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a9c108300 0x7f6a9c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:03.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.188+0000 7f6a9b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a9c108300 0x7f6a9c19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38268/0 (socket says 172.21.15.27:38268) 2024-09-19T08:10:03.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.188+0000 7f6a9b7fe640 1 -- 172.21.15.27:0/953175642 learned_addr learned my addr 172.21.15.27:0/953175642 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:03.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.188+0000 7f6a9a7fc640 1 --2- 172.21.15.27:0/953175642 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a9c103780 0x7f6a9c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:03.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.188+0000 7f6a9affd640 1 --2- 172.21.15.27:0/953175642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a9c102dd0 0x7f6a9c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:03.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.188+0000 7f6a9b7fe640 1 -- 172.21.15.27:0/953175642 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a9c103780 msgr2=0x7f6a9c198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:03.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.188+0000 7f6a9b7fe640 1 --2- 172.21.15.27:0/953175642 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a9c103780 0x7f6a9c198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.188+0000 7f6a9b7fe640 1 -- 172.21.15.27:0/953175642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a9c102dd0 msgr2=0x7f6a9c198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:03.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.188+0000 7f6a9b7fe640 1 --2- 172.21.15.27:0/953175642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a9c102dd0 0x7f6a9c198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.188+0000 7f6a9b7fe640 1 -- 172.21.15.27:0/953175642 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9c19d4f0 con 0x7f6a9c108300 2024-09-19T08:10:03.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.188+0000 7f6a9affd640 1 --2- 172.21.15.27:0/953175642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a9c102dd0 0x7f6a9c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:10:03.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.188+0000 7f6a9b7fe640 1 --2- 172.21.15.27:0/953175642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a9c108300 0x7f6a9c19ce10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009ca0 tx=0x7f6a9402f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:03.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.188+0000 7f6a93fff640 1 -- 172.21.15.27:0/953175642 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a94031860 con 0x7f6a9c108300 2024-09-19T08:10:03.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.188+0000 7f6a93fff640 1 -- 172.21.15.27:0/953175642 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a94003e50 con 0x7f6a9c108300 2024-09-19T08:10:03.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.188+0000 7f6aa12b2640 1 -- 172.21.15.27:0/953175642 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a9c19d780 con 0x7f6a9c108300 2024-09-19T08:10:03.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.188+0000 7f6a93fff640 1 -- 172.21.15.27:0/953175642 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a940307f0 con 0x7f6a9c108300 2024-09-19T08:10:03.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.188+0000 7f6aa12b2640 1 -- 172.21.15.27:0/953175642 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a9c1a50c0 con 0x7f6a9c108300 2024-09-19T08:10:03.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.189+0000 7f6aa12b2640 1 -- 172.21.15.27:0/953175642 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a9c1031b0 con 0x7f6a9c108300 2024-09-19T08:10:03.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.191+0000 7f6a93fff640 1 -- 172.21.15.27:0/953175642 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6a940041d0 con 0x7f6a9c108300 2024-09-19T08:10:03.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.192+0000 7f6a93fff640 1 --2- 172.21.15.27:0/953175642 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6a880a3350 0x7f6a880a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:03.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.192+0000 7f6a9affd640 1 --2- 172.21.15.27:0/953175642 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6a880a3350 0x7f6a880a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:03.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.192+0000 7f6a93fff640 1 -- 172.21.15.27:0/953175642 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f6a940f0ac0 con 0x7f6a9c108300 2024-09-19T08:10:03.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.192+0000 7f6a9affd640 1 --2- 172.21.15.27:0/953175642 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6a880a3350 0x7f6a880a5810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c009930 tx=0x7f6a8c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:03.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.195+0000 7f6a93fff640 1 -- 172.21.15.27:0/953175642 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6a940bd840 con 0x7f6a9c108300 2024-09-19T08:10:03.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:02 smithi155 ceph-mon[35362]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:03.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.376+0000 7f6aa12b2640 1 -- 172.21.15.27:0/953175642 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6a9c10a290 con 0x7f6a9c108300 2024-09-19T08:10:03.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.377+0000 7f6a93fff640 1 -- 172.21.15.27:0/953175642 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6a940bd140 con 0x7f6a9c108300 2024-09-19T08:10:03.378 INFO:teuthology.orchestra.run.smithi027.stdout:137438953532 2024-09-19T08:10:03.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.379+0000 7f6aa12b2640 1 -- 172.21.15.27:0/953175642 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6a880a3350 msgr2=0x7f6a880a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:03.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.379+0000 7f6aa12b2640 1 --2- 172.21.15.27:0/953175642 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6a880a3350 0x7f6a880a5810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c009930 tx=0x7f6a8c008040 comp rx=0 tx=0).stop 2024-09-19T08:10:03.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.379+0000 7f6aa12b2640 1 -- 172.21.15.27:0/953175642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a9c108300 msgr2=0x7f6a9c19ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:03.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.379+0000 7f6aa12b2640 1 --2- 172.21.15.27:0/953175642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a9c108300 0x7f6a9c19ce10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009ca0 tx=0x7f6a9402f420 comp rx=0 tx=0).stop 2024-09-19T08:10:03.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.379+0000 7f6aa12b2640 1 -- 172.21.15.27:0/953175642 shutdown_connections 2024-09-19T08:10:03.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.379+0000 7f6aa12b2640 1 --2- 172.21.15.27:0/953175642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a9c108300 0x7f6a9c19ce10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.379+0000 7f6aa12b2640 1 --2- 172.21.15.27:0/953175642 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a9c103780 0x7f6a9c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.379+0000 7f6aa12b2640 1 --2- 172.21.15.27:0/953175642 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f6a880a3350 0x7f6a880a5810 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.379+0000 7f6aa12b2640 1 --2- 172.21.15.27:0/953175642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a9c102dd0 0x7f6a9c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.379+0000 7f6aa12b2640 1 -- 172.21.15.27:0/953175642 >> 172.21.15.27:0/953175642 conn(0x7f6a9c0fc7d0 msgr2=0x7f6a9c1063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:03.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.379+0000 7f6aa12b2640 1 -- 172.21.15.27:0/953175642 shutdown_connections 2024-09-19T08:10:03.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.379+0000 7f6aa12b2640 1 -- 172.21.15.27:0/953175642 wait complete. 2024-09-19T08:10:03.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.396+0000 7fac0fd2e640 1 -- 172.21.15.27:0/524022898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac081082a0 msgr2=0x7fac0810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:03.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.396+0000 7fac0fd2e640 1 --2- 172.21.15.27:0/524022898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac081082a0 0x7fac0810ec40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fac00009cd0 tx=0x7fac0002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.396+0000 7fac0fd2e640 1 -- 172.21.15.27:0/524022898 shutdown_connections 2024-09-19T08:10:03.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.396+0000 7fac0fd2e640 1 --2- 172.21.15.27:0/524022898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac081082a0 0x7fac0810ec40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.396+0000 7fac0fd2e640 1 --2- 172.21.15.27:0/524022898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac081036e0 0x7fac08107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.396+0000 7fac0fd2e640 1 --2- 172.21.15.27:0/524022898 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac08102d30 0x7fac08103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.396+0000 7fac0fd2e640 1 -- 172.21.15.27:0/524022898 >> 172.21.15.27:0/524022898 conn(0x7fac080fc7d0 msgr2=0x7fac080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:03.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.396+0000 7fac0fd2e640 1 -- 172.21.15.27:0/524022898 shutdown_connections 2024-09-19T08:10:03.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.397+0000 7fac0fd2e640 1 -- 172.21.15.27:0/524022898 wait complete. 2024-09-19T08:10:03.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.398+0000 7fac0fd2e640 1 Processor -- start 2024-09-19T08:10:03.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.398+0000 7fac0fd2e640 1 -- start start 2024-09-19T08:10:03.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.398+0000 7fac0fd2e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac08102d30 0x7fac0819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:03.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.398+0000 7fac0fd2e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac081036e0 0x7fac0819ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:03.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.398+0000 7fac0fd2e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac081082a0 0x7fac0819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:03.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.398+0000 7fac0fd2e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fac081120a0 con 0x7fac08102d30 2024-09-19T08:10:03.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.398+0000 7fac0fd2e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fac08111f20 con 0x7fac081082a0 2024-09-19T08:10:03.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.398+0000 7fac0fd2e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fac08112220 con 0x7fac081036e0 2024-09-19T08:10:03.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.398+0000 7fac0daca640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac08102d30 0x7fac0819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:03.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.398+0000 7fac0daca640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac08102d30 0x7fac0819a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38300/0 (socket says 172.21.15.27:38300) 2024-09-19T08:10:03.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.398+0000 7fac0daca640 1 -- 172.21.15.27:0/744715552 learned_addr learned my addr 172.21.15.27:0/744715552 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:03.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.398+0000 7fac0e2cb640 1 --2- 172.21.15.27:0/744715552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac081082a0 0x7fac0819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:03.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.398+0000 7fac0d2c9640 1 --2- 172.21.15.27:0/744715552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac081036e0 0x7fac0819ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:03.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.398+0000 7fac0daca640 1 -- 172.21.15.27:0/744715552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac081036e0 msgr2=0x7fac0819ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:03.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.399+0000 7fac0daca640 1 --2- 172.21.15.27:0/744715552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac081036e0 0x7fac0819ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.399+0000 7fac0daca640 1 -- 172.21.15.27:0/744715552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac081082a0 msgr2=0x7fac0819f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:03.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.399+0000 7fac0daca640 1 --2- 172.21.15.27:0/744715552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac081082a0 0x7fac0819f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.399+0000 7fac0daca640 1 -- 172.21.15.27:0/744715552 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0819f6e0 con 0x7fac08102d30 2024-09-19T08:10:03.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.399+0000 7fac0d2c9640 1 --2- 172.21.15.27:0/744715552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac081036e0 0x7fac0819ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:10:03.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.399+0000 7fac0daca640 1 --2- 172.21.15.27:0/744715552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac08102d30 0x7fac0819a730 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fac0400d770 tx=0x7fac0400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:03.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.399+0000 7fabfeffd640 1 -- 172.21.15.27:0/744715552 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac04017070 con 0x7fac08102d30 2024-09-19T08:10:03.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.399+0000 7fabfeffd640 1 -- 172.21.15.27:0/744715552 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac04005500 con 0x7fac08102d30 2024-09-19T08:10:03.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.399+0000 7fac0fd2e640 1 -- 172.21.15.27:0/744715552 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac0819f9d0 con 0x7fac08102d30 2024-09-19T08:10:03.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.399+0000 7fabfeffd640 1 -- 172.21.15.27:0/744715552 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac04004e00 con 0x7fac08102d30 2024-09-19T08:10:03.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.399+0000 7fac0fd2e640 1 -- 172.21.15.27:0/744715552 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac081a72b0 con 0x7fac08102d30 2024-09-19T08:10:03.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.401+0000 7fac0fd2e640 1 -- 172.21.15.27:0/744715552 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac08103110 con 0x7fac08102d30 2024-09-19T08:10:03.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.402+0000 7fabfeffd640 1 -- 172.21.15.27:0/744715552 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fac04004fa0 con 0x7fac08102d30 2024-09-19T08:10:03.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.403+0000 7fabfeffd640 1 --2- 172.21.15.27:0/744715552 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fabf40a3350 0x7fabf40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:03.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.403+0000 7fabfeffd640 1 -- 172.21.15.27:0/744715552 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fac040cf2d0 con 0x7fac08102d30 2024-09-19T08:10:03.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.403+0000 7fac0d2c9640 1 --2- 172.21.15.27:0/744715552 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fabf40a3350 0x7fabf40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:03.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.404+0000 7fac0d2c9640 1 --2- 172.21.15.27:0/744715552 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fabf40a3350 0x7fabf40a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fabf8005fd0 tx=0x7fabf8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:03.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.411+0000 7fabfeffd640 1 -- 172.21.15.27:0/744715552 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fac0409c040 con 0x7fac08102d30 2024-09-19T08:10:03.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.591+0000 7fac0fd2e640 1 -- 172.21.15.27:0/744715552 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fac0810c2c0 con 0x7fac08102d30 2024-09-19T08:10:03.592 INFO:teuthology.orchestra.run.smithi027.stdout:210453397547 2024-09-19T08:10:03.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.591+0000 7fabfeffd640 1 -- 172.21.15.27:0/744715552 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fac0409b940 con 0x7fac08102d30 2024-09-19T08:10:03.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.594+0000 7fac0fd2e640 1 -- 172.21.15.27:0/744715552 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fabf40a3350 msgr2=0x7fabf40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:03.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.594+0000 7fac0fd2e640 1 --2- 172.21.15.27:0/744715552 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fabf40a3350 0x7fabf40a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fabf8005fd0 tx=0x7fabf8005850 comp rx=0 tx=0).stop 2024-09-19T08:10:03.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.594+0000 7fac0fd2e640 1 -- 172.21.15.27:0/744715552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac08102d30 msgr2=0x7fac0819a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:03.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.594+0000 7fac0fd2e640 1 --2- 172.21.15.27:0/744715552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac08102d30 0x7fac0819a730 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fac0400d770 tx=0x7fac0400dc30 comp rx=0 tx=0).stop 2024-09-19T08:10:03.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.594+0000 7fac0fd2e640 1 -- 172.21.15.27:0/744715552 shutdown_connections 2024-09-19T08:10:03.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.594+0000 7fac0fd2e640 1 --2- 172.21.15.27:0/744715552 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fabf40a3350 0x7fabf40a5810 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.594+0000 7fac0fd2e640 1 --2- 172.21.15.27:0/744715552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac081082a0 0x7fac0819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.594+0000 7fac0fd2e640 1 --2- 172.21.15.27:0/744715552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac081036e0 0x7fac0819ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.594+0000 7fac0fd2e640 1 --2- 172.21.15.27:0/744715552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac08102d30 0x7fac0819a730 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:03.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.594+0000 7fac0fd2e640 1 -- 172.21.15.27:0/744715552 >> 172.21.15.27:0/744715552 conn(0x7fac080fc7d0 msgr2=0x7fac08101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:03.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.595+0000 7fac0fd2e640 1 -- 172.21.15.27:0/744715552 shutdown_connections 2024-09-19T08:10:03.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:03.595+0000 7fac0fd2e640 1 -- 172.21.15.27:0/744715552 wait complete. 2024-09-19T08:10:03.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:03 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3651841953' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T08:10:03.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:03 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/953175642' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T08:10:03.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:03 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/744715552' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T08:10:04.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:03 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3651841953' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T08:10:04.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:03 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/953175642' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T08:10:04.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:03 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/744715552' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T08:10:04.060 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182463 got 107374182465 for osd.3 2024-09-19T08:10:04.060 DEBUG:teuthology.parallel:result is None 2024-09-19T08:10:04.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:03 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3651841953' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T08:10:04.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:03 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/953175642' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T08:10:04.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:03 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/744715552' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T08:10:04.863 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:04 smithi027 ceph-mon[31209]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:04.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.862+0000 7f7698380640 1 -- 172.21.15.27:0/1783961655 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7690106f10 msgr2=0x7f769010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:04.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.862+0000 7f7698380640 1 --2- 172.21.15.27:0/1783961655 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7690106f10 0x7f769010ea90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7688009ca0 tx=0x7f768802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:10:04.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.862+0000 7f7698380640 1 -- 172.21.15.27:0/1783961655 shutdown_connections 2024-09-19T08:10:04.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.862+0000 7f7698380640 1 --2- 172.21.15.27:0/1783961655 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7690106f10 0x7f769010ea90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:04.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.862+0000 7f7698380640 1 --2- 172.21.15.27:0/1783961655 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7690102790 0x7f76901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:04.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.862+0000 7f7698380640 1 --2- 172.21.15.27:0/1783961655 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7690101de0 0x7f76901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:04.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.862+0000 7f7698380640 1 -- 172.21.15.27:0/1783961655 >> 172.21.15.27:0/1783961655 conn(0x7f76900fd8c0 msgr2=0x7f76900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:04.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.862+0000 7f7698380640 1 -- 172.21.15.27:0/1783961655 shutdown_connections 2024-09-19T08:10:04.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.862+0000 7f7698380640 1 -- 172.21.15.27:0/1783961655 wait complete. 2024-09-19T08:10:04.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.863+0000 7f7698380640 1 Processor -- start 2024-09-19T08:10:04.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.863+0000 7f7698380640 1 -- start start 2024-09-19T08:10:04.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.863+0000 7f7698380640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7690101de0 0x7f7690198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:04.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.863+0000 7f7698380640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7690102790 0x7f7690198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:04.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.863+0000 7f7698380640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7690106f10 0x7f769019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:04.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.863+0000 7f7698380640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7690111f70 con 0x7f7690102790 2024-09-19T08:10:04.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.863+0000 7f7698380640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7690111df0 con 0x7f7690101de0 2024-09-19T08:10:04.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.863+0000 7f7698380640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f76901120f0 con 0x7f7690106f10 2024-09-19T08:10:04.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.863+0000 7f769591b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7690102790 0x7f7690198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:04.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.863+0000 7f769591b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7690102790 0x7f7690198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38320/0 (socket says 172.21.15.27:38320) 2024-09-19T08:10:04.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.863+0000 7f769591b640 1 -- 172.21.15.27:0/831050187 learned_addr learned my addr 172.21.15.27:0/831050187 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:04.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.863+0000 7f769611c640 1 --2- 172.21.15.27:0/831050187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7690101de0 0x7f7690198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:04.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.863+0000 7f769691d640 1 --2- 172.21.15.27:0/831050187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7690106f10 0x7f769019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:04.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.863+0000 7f769591b640 1 -- 172.21.15.27:0/831050187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7690106f10 msgr2=0x7f769019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:04.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.863+0000 7f769591b640 1 --2- 172.21.15.27:0/831050187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7690106f10 0x7f769019cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:04.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.863+0000 7f769591b640 1 -- 172.21.15.27:0/831050187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7690101de0 msgr2=0x7f7690198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:04.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.863+0000 7f769591b640 1 --2- 172.21.15.27:0/831050187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7690101de0 0x7f7690198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:04.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.863+0000 7f769591b640 1 -- 172.21.15.27:0/831050187 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769019d3c0 con 0x7f7690102790 2024-09-19T08:10:04.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.863+0000 7f769611c640 1 --2- 172.21.15.27:0/831050187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7690101de0 0x7f7690198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:10:04.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.863+0000 7f769691d640 1 --2- 172.21.15.27:0/831050187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7690106f10 0x7f769019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:10:04.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.864+0000 7f769591b640 1 --2- 172.21.15.27:0/831050187 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7690102790 0x7f7690198950 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f768000c920 tx=0x7f768000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:04.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.864+0000 7f76877fe640 1 -- 172.21.15.27:0/831050187 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7680007c70 con 0x7f7690102790 2024-09-19T08:10:04.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.864+0000 7f7698380640 1 -- 172.21.15.27:0/831050187 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f769019d6b0 con 0x7f7690102790 2024-09-19T08:10:04.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.864+0000 7f76877fe640 1 -- 172.21.15.27:0/831050187 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7680007e10 con 0x7f7690102790 2024-09-19T08:10:04.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.864+0000 7f76877fe640 1 -- 172.21.15.27:0/831050187 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7680018890 con 0x7f7690102790 2024-09-19T08:10:04.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.864+0000 7f7698380640 1 -- 172.21.15.27:0/831050187 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76901a4f90 con 0x7f7690102790 2024-09-19T08:10:04.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.865+0000 7f7698380640 1 -- 172.21.15.27:0/831050187 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76901021c0 con 0x7f7690102790 2024-09-19T08:10:04.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.866+0000 7f76877fe640 1 -- 172.21.15.27:0/831050187 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7680018a70 con 0x7f7690102790 2024-09-19T08:10:04.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.866+0000 7f76877fe640 1 --2- 172.21.15.27:0/831050187 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f767c0a32d0 0x7f767c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:04.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.867+0000 7f769611c640 1 --2- 172.21.15.27:0/831050187 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f767c0a32d0 0x7f767c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:04.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.867+0000 7f76877fe640 1 -- 172.21.15.27:0/831050187 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f76800cfa70 con 0x7f7690102790 2024-09-19T08:10:04.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.867+0000 7f769611c640 1 --2- 172.21.15.27:0/831050187 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f767c0a32d0 0x7f767c0a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f768c0058c0 tx=0x7f768c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:04.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:04.871+0000 7f76877fe640 1 -- 172.21.15.27:0/831050187 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7680014030 con 0x7f7690102790 2024-09-19T08:10:05.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:04 smithi203 ceph-mon[35198]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:05.063 INFO:teuthology.orchestra.run.smithi027.stdout:34359738448 2024-09-19T08:10:05.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.061+0000 7f7698380640 1 -- 172.21.15.27:0/831050187 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f769010a150 con 0x7f7690102790 2024-09-19T08:10:05.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.062+0000 7f76877fe640 1 -- 172.21.15.27:0/831050187 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f768009c7e0 con 0x7f7690102790 2024-09-19T08:10:05.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.064+0000 7f7698380640 1 -- 172.21.15.27:0/831050187 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f767c0a32d0 msgr2=0x7f767c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:05.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.064+0000 7f7698380640 1 --2- 172.21.15.27:0/831050187 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f767c0a32d0 0x7f767c0a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f768c0058c0 tx=0x7f768c005850 comp rx=0 tx=0).stop 2024-09-19T08:10:05.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.064+0000 7f7698380640 1 -- 172.21.15.27:0/831050187 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7690102790 msgr2=0x7f7690198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:05.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.064+0000 7f7698380640 1 --2- 172.21.15.27:0/831050187 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7690102790 0x7f7690198950 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f768000c920 tx=0x7f768000cde0 comp rx=0 tx=0).stop 2024-09-19T08:10:05.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.064+0000 7f7698380640 1 -- 172.21.15.27:0/831050187 shutdown_connections 2024-09-19T08:10:05.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.064+0000 7f7698380640 1 --2- 172.21.15.27:0/831050187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7690106f10 0x7f769019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:05.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.064+0000 7f7698380640 1 --2- 172.21.15.27:0/831050187 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7690102790 0x7f7690198950 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:05.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.064+0000 7f7698380640 1 --2- 172.21.15.27:0/831050187 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f767c0a32d0 0x7f767c0a5790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:05.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.064+0000 7f7698380640 1 --2- 172.21.15.27:0/831050187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7690101de0 0x7f7690198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:05.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.064+0000 7f7698380640 1 -- 172.21.15.27:0/831050187 >> 172.21.15.27:0/831050187 conn(0x7f76900fd8c0 msgr2=0x7f76900febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:05.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.064+0000 7f7698380640 1 -- 172.21.15.27:0/831050187 shutdown_connections 2024-09-19T08:10:05.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.064+0000 7f7698380640 1 -- 172.21.15.27:0/831050187 wait complete. 2024-09-19T08:10:05.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:04 smithi155 ceph-mon[35362]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:05.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.451+0000 7fe4cc827640 1 -- 172.21.15.27:0/374763277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c8102d40 msgr2=0x7fe4c8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:05.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.451+0000 7fe4cc827640 1 --2- 172.21.15.27:0/374763277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c8102d40 0x7fe4c8103120 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009900 tx=0x7fe4b802a480 comp rx=0 tx=0).stop 2024-09-19T08:10:05.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.451+0000 7fe4cc827640 1 -- 172.21.15.27:0/374763277 shutdown_connections 2024-09-19T08:10:05.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.451+0000 7fe4cc827640 1 --2- 172.21.15.27:0/374763277 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4c810c170 0x7fe4c810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:05.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.451+0000 7fe4cc827640 1 --2- 172.21.15.27:0/374763277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4c8103660 0x7fe4c810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:05.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.451+0000 7fe4cc827640 1 --2- 172.21.15.27:0/374763277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c8102d40 0x7fe4c8103120 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:05.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.451+0000 7fe4cc827640 1 -- 172.21.15.27:0/374763277 >> 172.21.15.27:0/374763277 conn(0x7fe4c80fc7a0 msgr2=0x7fe4c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:05.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.451+0000 7fe4cc827640 1 -- 172.21.15.27:0/374763277 shutdown_connections 2024-09-19T08:10:05.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.451+0000 7fe4cc827640 1 -- 172.21.15.27:0/374763277 wait complete. 2024-09-19T08:10:05.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.452+0000 7fe4cc827640 1 Processor -- start 2024-09-19T08:10:05.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.452+0000 7fe4cc827640 1 -- start start 2024-09-19T08:10:05.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.452+0000 7fe4cc827640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4c8102d40 0x7fe4c81984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:05.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.452+0000 7fe4cc827640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c8103660 0x7fe4c81989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:05.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.452+0000 7fe4cc827640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4c810c170 0x7fe4c819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:05.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.452+0000 7fe4cc827640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c8111fd0 con 0x7fe4c8103660 2024-09-19T08:10:05.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.452+0000 7fe4cc827640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c8111e50 con 0x7fe4c8102d40 2024-09-19T08:10:05.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.452+0000 7fe4cc827640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c8112150 con 0x7fe4c810c170 2024-09-19T08:10:05.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.452+0000 7fe4c5d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c8103660 0x7fe4c81989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:05.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.452+0000 7fe4c659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4c8102d40 0x7fe4c81984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:05.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.452+0000 7fe4c5d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c8103660 0x7fe4c81989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38338/0 (socket says 172.21.15.27:38338) 2024-09-19T08:10:05.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.452+0000 7fe4c5d9b640 1 -- 172.21.15.27:0/4035387051 learned_addr learned my addr 172.21.15.27:0/4035387051 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:05.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.452+0000 7fe4c6d9d640 1 --2- 172.21.15.27:0/4035387051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4c810c170 0x7fe4c819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:05.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.453+0000 7fe4c5d9b640 1 -- 172.21.15.27:0/4035387051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4c810c170 msgr2=0x7fe4c819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:05.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.453+0000 7fe4c5d9b640 1 --2- 172.21.15.27:0/4035387051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4c810c170 0x7fe4c819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:05.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.453+0000 7fe4c5d9b640 1 -- 172.21.15.27:0/4035387051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4c8102d40 msgr2=0x7fe4c81984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:05.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.453+0000 7fe4c5d9b640 1 --2- 172.21.15.27:0/4035387051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4c8102d40 0x7fe4c81984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:05.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.453+0000 7fe4c5d9b640 1 -- 172.21.15.27:0/4035387051 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c819d460 con 0x7fe4c8103660 2024-09-19T08:10:05.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.453+0000 7fe4c5d9b640 1 --2- 172.21.15.27:0/4035387051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c8103660 0x7fe4c81989f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00b3f0 tx=0x7fe4bc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:05.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.453+0000 7fe4b77fe640 1 -- 172.21.15.27:0/4035387051 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc015020 con 0x7fe4c8103660 2024-09-19T08:10:05.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.453+0000 7fe4cc827640 1 -- 172.21.15.27:0/4035387051 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c819d750 con 0x7fe4c8103660 2024-09-19T08:10:05.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.453+0000 7fe4b77fe640 1 -- 172.21.15.27:0/4035387051 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4bc011d10 con 0x7fe4c8103660 2024-09-19T08:10:05.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.453+0000 7fe4b77fe640 1 -- 172.21.15.27:0/4035387051 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc00f2e0 con 0x7fe4c8103660 2024-09-19T08:10:05.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.453+0000 7fe4cc827640 1 -- 172.21.15.27:0/4035387051 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c81a5030 con 0x7fe4c8103660 2024-09-19T08:10:05.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.454+0000 7fe4cc827640 1 -- 172.21.15.27:0/4035387051 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c8103120 con 0x7fe4c8103660 2024-09-19T08:10:05.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.456+0000 7fe4b77fe640 1 -- 172.21.15.27:0/4035387051 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe4bc018020 con 0x7fe4c8103660 2024-09-19T08:10:05.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.456+0000 7fe4b77fe640 1 --2- 172.21.15.27:0/4035387051 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe4b00a32d0 0x7fe4b00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:05.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.456+0000 7fe4c659c640 1 --2- 172.21.15.27:0/4035387051 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe4b00a32d0 0x7fe4b00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:05.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.456+0000 7fe4b77fe640 1 -- 172.21.15.27:0/4035387051 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fe4bc0cf4e0 con 0x7fe4c8103660 2024-09-19T08:10:05.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.457+0000 7fe4c659c640 1 --2- 172.21.15.27:0/4035387051 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe4b00a32d0 0x7fe4b00a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8000c00 tx=0x7fe4b80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:05.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.459+0000 7fe4b77fe640 1 -- 172.21.15.27:0/4035387051 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe4bc01f020 con 0x7fe4c8103660 2024-09-19T08:10:05.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.637+0000 7fe4cc827640 1 -- 172.21.15.27:0/4035387051 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fe4c8106c80 con 0x7fe4c8103660 2024-09-19T08:10:05.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.638+0000 7fe4b77fe640 1 -- 172.21.15.27:0/4035387051 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fe4bc09c360 con 0x7fe4c8103660 2024-09-19T08:10:05.639 INFO:teuthology.orchestra.run.smithi027.stdout:292057776157 2024-09-19T08:10:05.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.640+0000 7fe4cc827640 1 -- 172.21.15.27:0/4035387051 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe4b00a32d0 msgr2=0x7fe4b00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:05.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.640+0000 7fe4cc827640 1 --2- 172.21.15.27:0/4035387051 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe4b00a32d0 0x7fe4b00a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8000c00 tx=0x7fe4b80058d0 comp rx=0 tx=0).stop 2024-09-19T08:10:05.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.640+0000 7fe4cc827640 1 -- 172.21.15.27:0/4035387051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c8103660 msgr2=0x7fe4c81989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:05.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.640+0000 7fe4cc827640 1 --2- 172.21.15.27:0/4035387051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c8103660 0x7fe4c81989f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00b3f0 tx=0x7fe4bc00b8b0 comp rx=0 tx=0).stop 2024-09-19T08:10:05.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.640+0000 7fe4cc827640 1 -- 172.21.15.27:0/4035387051 shutdown_connections 2024-09-19T08:10:05.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.640+0000 7fe4cc827640 1 --2- 172.21.15.27:0/4035387051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4c810c170 0x7fe4c819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:05.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.640+0000 7fe4cc827640 1 --2- 172.21.15.27:0/4035387051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c8103660 0x7fe4c81989f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:05.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.640+0000 7fe4cc827640 1 --2- 172.21.15.27:0/4035387051 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe4b00a32d0 0x7fe4b00a5790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:05.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.640+0000 7fe4cc827640 1 --2- 172.21.15.27:0/4035387051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4c8102d40 0x7fe4c81984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:05.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.640+0000 7fe4cc827640 1 -- 172.21.15.27:0/4035387051 >> 172.21.15.27:0/4035387051 conn(0x7fe4c80fc7a0 msgr2=0x7fe4c80fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:05.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.640+0000 7fe4cc827640 1 -- 172.21.15.27:0/4035387051 shutdown_connections 2024-09-19T08:10:05.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:05.640+0000 7fe4cc827640 1 -- 172.21.15.27:0/4035387051 wait complete. 2024-09-19T08:10:05.900 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:05 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:10:05.900 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:05 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/831050187' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T08:10:05.900 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:05 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/4035387051' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T08:10:05.928 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953530 got 137438953532 for osd.4 2024-09-19T08:10:05.928 DEBUG:teuthology.parallel:result is None 2024-09-19T08:10:06.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:05 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:10:06.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:05 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/831050187' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T08:10:06.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:05 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/4035387051' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T08:10:06.063 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:05 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:10:06.063 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:05 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/831050187' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T08:10:06.063 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:05 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/4035387051' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T08:10:06.438 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397546 got 210453397547 for osd.7 2024-09-19T08:10:06.439 DEBUG:teuthology.parallel:result is None 2024-09-19T08:10:06.800 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:06 smithi027 ceph-mon[31209]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:06.800 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:06 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:06.800 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:06 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:06.800 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:06 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:06.800 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:06 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:07.190 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561071 got 188978561072 for osd.6 2024-09-19T08:10:07.190 DEBUG:teuthology.parallel:result is None 2024-09-19T08:10:07.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:06 smithi155 ceph-mon[35362]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:07.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:06 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:07.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:06 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:07.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:06 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:07.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:06 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:07.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:06 smithi203 ceph-mon[35198]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:07.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:06 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:07.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:06 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:07.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:06 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:07.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:06 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:07.792 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776155 got 292057776157 for osd.10 2024-09-19T08:10:07.792 DEBUG:teuthology.parallel:result is None 2024-09-19T08:10:07.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.975+0000 7f79c4e2a640 1 -- 172.21.15.27:0/3503716538 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79c0100a80 msgr2=0x7f79c0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:07.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.975+0000 7f79c4e2a640 1 --2- 172.21.15.27:0/3503716538 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79c0100a80 0x7f79c0100ee0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009930 tx=0x7f79b402a420 comp rx=0 tx=0).stop 2024-09-19T08:10:07.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.975+0000 7f79c4e2a640 1 -- 172.21.15.27:0/3503716538 shutdown_connections 2024-09-19T08:10:07.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.975+0000 7f79c4e2a640 1 --2- 172.21.15.27:0/3503716538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79c0101420 0x7f79c010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:07.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.975+0000 7f79c4e2a640 1 --2- 172.21.15.27:0/3503716538 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79c0100a80 0x7f79c0100ee0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:07.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.975+0000 7f79c4e2a640 1 --2- 172.21.15.27:0/3503716538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79c0106a80 0x7f79c0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:07.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.975+0000 7f79c4e2a640 1 -- 172.21.15.27:0/3503716538 >> 172.21.15.27:0/3503716538 conn(0x7f79c00fc7a0 msgr2=0x7f79c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:07.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.975+0000 7f79c4e2a640 1 -- 172.21.15.27:0/3503716538 shutdown_connections 2024-09-19T08:10:07.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.975+0000 7f79c4e2a640 1 -- 172.21.15.27:0/3503716538 wait complete. 2024-09-19T08:10:07.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.976+0000 7f79c4e2a640 1 Processor -- start 2024-09-19T08:10:07.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.976+0000 7f79c4e2a640 1 -- start start 2024-09-19T08:10:07.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.977+0000 7f79c4e2a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79c0100a80 0x7f79c0199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:07.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.977+0000 7f79c4e2a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79c0101420 0x7f79c01997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:07.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.977+0000 7f79c4e2a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79c0106a80 0x7f79c01a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:07.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.977+0000 7f79c4e2a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f79c0110ed0 con 0x7f79c0100a80 2024-09-19T08:10:07.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.977+0000 7f79c4e2a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f79c0110d50 con 0x7f79c0101420 2024-09-19T08:10:07.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.977+0000 7f79c4e2a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f79c0111050 con 0x7f79c0106a80 2024-09-19T08:10:07.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.977+0000 7f79be59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79c0100a80 0x7f79c0199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:07.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.977+0000 7f79be59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79c0100a80 0x7f79c0199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38354/0 (socket says 172.21.15.27:38354) 2024-09-19T08:10:07.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.977+0000 7f79be59c640 1 -- 172.21.15.27:0/2666050589 learned_addr learned my addr 172.21.15.27:0/2666050589 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:07.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.977+0000 7f79bdd9b640 1 --2- 172.21.15.27:0/2666050589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79c0101420 0x7f79c01997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:07.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.977+0000 7f79bed9d640 1 --2- 172.21.15.27:0/2666050589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79c0106a80 0x7f79c01a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:07.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.977+0000 7f79be59c640 1 -- 172.21.15.27:0/2666050589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79c0106a80 msgr2=0x7f79c01a42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:07.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.977+0000 7f79be59c640 1 --2- 172.21.15.27:0/2666050589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79c0106a80 0x7f79c01a42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:07.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.977+0000 7f79be59c640 1 -- 172.21.15.27:0/2666050589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79c0101420 msgr2=0x7f79c01997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:07.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.977+0000 7f79be59c640 1 --2- 172.21.15.27:0/2666050589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79c0101420 0x7f79c01997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:07.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.977+0000 7f79be59c640 1 -- 172.21.15.27:0/2666050589 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c01a4820 con 0x7f79c0100a80 2024-09-19T08:10:07.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.977+0000 7f79bdd9b640 1 --2- 172.21.15.27:0/2666050589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79c0101420 0x7f79c01997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:10:07.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.977+0000 7f79bed9d640 1 --2- 172.21.15.27:0/2666050589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79c0106a80 0x7f79c01a42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:10:07.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.977+0000 7f79be59c640 1 --2- 172.21.15.27:0/2666050589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79c0100a80 0x7f79c0199260 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f79b000d950 tx=0x7f79b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:07.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.978+0000 7f79af7fe640 1 -- 172.21.15.27:0/2666050589 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0017070 con 0x7f79c0100a80 2024-09-19T08:10:07.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.978+0000 7f79af7fe640 1 -- 172.21.15.27:0/2666050589 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79b0009c30 con 0x7f79c0100a80 2024-09-19T08:10:07.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.978+0000 7f79c4e2a640 1 -- 172.21.15.27:0/2666050589 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c01a49f0 con 0x7f79c0100a80 2024-09-19T08:10:07.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.978+0000 7f79af7fe640 1 -- 172.21.15.27:0/2666050589 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b000f6b0 con 0x7f79c0100a80 2024-09-19T08:10:07.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.978+0000 7f79c4e2a640 1 -- 172.21.15.27:0/2666050589 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c01a4f00 con 0x7f79c0100a80 2024-09-19T08:10:07.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.979+0000 7f79c4e2a640 1 -- 172.21.15.27:0/2666050589 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c0100ee0 con 0x7f79c0100a80 2024-09-19T08:10:07.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.980+0000 7f79af7fe640 1 -- 172.21.15.27:0/2666050589 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f79b00109d0 con 0x7f79c0100a80 2024-09-19T08:10:07.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.981+0000 7f79af7fe640 1 --2- 172.21.15.27:0/2666050589 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f79a80a32d0 0x7f79a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:07.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.981+0000 7f79bdd9b640 1 --2- 172.21.15.27:0/2666050589 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f79a80a32d0 0x7f79a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:07.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.981+0000 7f79af7fe640 1 -- 172.21.15.27:0/2666050589 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f79b00cf530 con 0x7f79c0100a80 2024-09-19T08:10:07.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.981+0000 7f79bdd9b640 1 --2- 172.21.15.27:0/2666050589 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f79a80a32d0 0x7f79a80a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f79b4006010 tx=0x7f79b4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:07.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:07.985+0000 7f79af7fe640 1 -- 172.21.15.27:0/2666050589 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f79b0009de0 con 0x7f79c0100a80 2024-09-19T08:10:08.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:08.161+0000 7f79c4e2a640 1 -- 172.21.15.27:0/2666050589 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f79c002d7c0 con 0x7f79c0100a80 2024-09-19T08:10:08.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:08.162+0000 7f79af7fe640 1 -- 172.21.15.27:0/2666050589 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f79b009c2a0 con 0x7f79c0100a80 2024-09-19T08:10:08.162 INFO:teuthology.orchestra.run.smithi027.stdout:158913790007 2024-09-19T08:10:08.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:08.164+0000 7f79c4e2a640 1 -- 172.21.15.27:0/2666050589 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f79a80a32d0 msgr2=0x7f79a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:08.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:08.164+0000 7f79c4e2a640 1 --2- 172.21.15.27:0/2666050589 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f79a80a32d0 0x7f79a80a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f79b4006010 tx=0x7f79b4005a20 comp rx=0 tx=0).stop 2024-09-19T08:10:08.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:08.164+0000 7f79c4e2a640 1 -- 172.21.15.27:0/2666050589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79c0100a80 msgr2=0x7f79c0199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:08.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:08.164+0000 7f79c4e2a640 1 --2- 172.21.15.27:0/2666050589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79c0100a80 0x7f79c0199260 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f79b000d950 tx=0x7f79b000de10 comp rx=0 tx=0).stop 2024-09-19T08:10:08.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:08.164+0000 7f79c4e2a640 1 -- 172.21.15.27:0/2666050589 shutdown_connections 2024-09-19T08:10:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:08.164+0000 7f79c4e2a640 1 --2- 172.21.15.27:0/2666050589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79c0106a80 0x7f79c01a42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:08.164+0000 7f79c4e2a640 1 --2- 172.21.15.27:0/2666050589 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f79a80a32d0 0x7f79a80a5790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:08.164+0000 7f79c4e2a640 1 --2- 172.21.15.27:0/2666050589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79c0101420 0x7f79c01997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:08.164+0000 7f79c4e2a640 1 --2- 172.21.15.27:0/2666050589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79c0100a80 0x7f79c0199260 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:08.164+0000 7f79c4e2a640 1 -- 172.21.15.27:0/2666050589 >> 172.21.15.27:0/2666050589 conn(0x7f79c00fc7a0 msgr2=0x7f79c00fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:08.164+0000 7f79c4e2a640 1 -- 172.21.15.27:0/2666050589 shutdown_connections 2024-09-19T08:10:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:08.164+0000 7f79c4e2a640 1 -- 172.21.15.27:0/2666050589 wait complete. 2024-09-19T08:10:08.668 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738445 got 34359738448 for osd.0 2024-09-19T08:10:08.668 DEBUG:teuthology.parallel:result is None 2024-09-19T08:10:09.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:08 smithi027 ceph-mon[31209]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:09.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:08 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2666050589' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T08:10:09.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.116+0000 7fc7c4a0b640 1 -- 172.21.15.27:0/1090847956 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7c0100e20 msgr2=0x7fc7c0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:09.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.116+0000 7fc7c4a0b640 1 --2- 172.21.15.27:0/1090847956 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7c0100e20 0x7fc7c0101200 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009ca0 tx=0x7fc7b802a950 comp rx=0 tx=0).stop 2024-09-19T08:10:09.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.116+0000 7fc7c4a0b640 1 -- 172.21.15.27:0/1090847956 shutdown_connections 2024-09-19T08:10:09.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.116+0000 7fc7c4a0b640 1 --2- 172.21.15.27:0/1090847956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7c0102ef0 0x7fc7c010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:09.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.116+0000 7fc7c4a0b640 1 --2- 172.21.15.27:0/1090847956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7c0102570 0x7fc7c01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:09.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.116+0000 7fc7c4a0b640 1 --2- 172.21.15.27:0/1090847956 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7c0100e20 0x7fc7c0101200 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:09.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.116+0000 7fc7c4a0b640 1 -- 172.21.15.27:0/1090847956 >> 172.21.15.27:0/1090847956 conn(0x7fc7c00fc7d0 msgr2=0x7fc7c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:09.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.116+0000 7fc7c4a0b640 1 -- 172.21.15.27:0/1090847956 shutdown_connections 2024-09-19T08:10:09.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.116+0000 7fc7c4a0b640 1 -- 172.21.15.27:0/1090847956 wait complete. 2024-09-19T08:10:09.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.117+0000 7fc7c4a0b640 1 Processor -- start 2024-09-19T08:10:09.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.117+0000 7fc7c4a0b640 1 -- start start 2024-09-19T08:10:09.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.117+0000 7fc7c4a0b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7c0100e20 0x7fc7c019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:09.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.117+0000 7fc7c4a0b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7c0102570 0x7fc7c019ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:09.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.117+0000 7fc7c4a0b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7c0102ef0 0x7fc7c019efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:09.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.117+0000 7fc7c4a0b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c0110f50 con 0x7fc7c0102ef0 2024-09-19T08:10:09.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.117+0000 7fc7c4a0b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c0110dd0 con 0x7fc7c0100e20 2024-09-19T08:10:09.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.117+0000 7fc7c4a0b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c01110d0 con 0x7fc7c0102570 2024-09-19T08:10:09.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.118+0000 7fc7bed9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7c0102ef0 0x7fc7c019efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:09.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.118+0000 7fc7bed9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7c0102ef0 0x7fc7c019efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38372/0 (socket says 172.21.15.27:38372) 2024-09-19T08:10:09.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.118+0000 7fc7bed9d640 1 -- 172.21.15.27:0/4057234525 learned_addr learned my addr 172.21.15.27:0/4057234525 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:09.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.118+0000 7fc7be59c640 1 --2- 172.21.15.27:0/4057234525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7c0100e20 0x7fc7c019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:09.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.118+0000 7fc7bdd9b640 1 --2- 172.21.15.27:0/4057234525 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7c0102570 0x7fc7c019ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:09.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.118+0000 7fc7bed9d640 1 -- 172.21.15.27:0/4057234525 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7c0102570 msgr2=0x7fc7c019ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:09.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.118+0000 7fc7bed9d640 1 --2- 172.21.15.27:0/4057234525 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7c0102570 0x7fc7c019ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:09.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.118+0000 7fc7bed9d640 1 -- 172.21.15.27:0/4057234525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7c0100e20 msgr2=0x7fc7c019a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:09.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.118+0000 7fc7bed9d640 1 --2- 172.21.15.27:0/4057234525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7c0100e20 0x7fc7c019a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:09.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.118+0000 7fc7bed9d640 1 -- 172.21.15.27:0/4057234525 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c019f6b0 con 0x7fc7c0102ef0 2024-09-19T08:10:09.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.118+0000 7fc7bed9d640 1 --2- 172.21.15.27:0/4057234525 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7c0102ef0 0x7fc7c019efd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc7b000c970 tx=0x7fc7b000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:09.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.118+0000 7fc7b77fe640 1 -- 172.21.15.27:0/4057234525 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0007bb0 con 0x7fc7c0102ef0 2024-09-19T08:10:09.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.118+0000 7fc7b77fe640 1 -- 172.21.15.27:0/4057234525 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7b0007d50 con 0x7fc7c0102ef0 2024-09-19T08:10:09.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.118+0000 7fc7c4a0b640 1 -- 172.21.15.27:0/4057234525 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c019f9a0 con 0x7fc7c0102ef0 2024-09-19T08:10:09.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.118+0000 7fc7b77fe640 1 -- 172.21.15.27:0/4057234525 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b000f450 con 0x7fc7c0102ef0 2024-09-19T08:10:09.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.119+0000 7fc7c4a0b640 1 -- 172.21.15.27:0/4057234525 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c01a7280 con 0x7fc7c0102ef0 2024-09-19T08:10:09.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.120+0000 7fc7c4a0b640 1 -- 172.21.15.27:0/4057234525 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7c0101200 con 0x7fc7c0102ef0 2024-09-19T08:10:09.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.121+0000 7fc7b77fe640 1 -- 172.21.15.27:0/4057234525 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc7b0004f00 con 0x7fc7c0102ef0 2024-09-19T08:10:09.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.122+0000 7fc7b77fe640 1 --2- 172.21.15.27:0/4057234525 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc7ac0a3350 0x7fc7ac0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:09.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.122+0000 7fc7be59c640 1 --2- 172.21.15.27:0/4057234525 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc7ac0a3350 0x7fc7ac0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:09.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.122+0000 7fc7b77fe640 1 -- 172.21.15.27:0/4057234525 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fc7b00cf960 con 0x7fc7c0102ef0 2024-09-19T08:10:09.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.122+0000 7fc7be59c640 1 --2- 172.21.15.27:0/4057234525 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc7ac0a3350 0x7fc7ac0a5810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8004ad0 tx=0x7fc7b8004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:09.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.125+0000 7fc7b77fe640 1 -- 172.21.15.27:0/4057234525 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc7b0014030 con 0x7fc7c0102ef0 2024-09-19T08:10:09.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:08 smithi155 ceph-mon[35362]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:09.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:08 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2666050589' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T08:10:09.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:08 smithi203 ceph-mon[35198]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:09.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:08 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2666050589' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T08:10:09.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.304+0000 7fc7c4a0b640 1 -- 172.21.15.27:0/4057234525 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc7c019ba60 con 0x7fc7c0102ef0 2024-09-19T08:10:09.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.305+0000 7fc7b77fe640 1 -- 172.21.15.27:0/4057234525 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc7c019ba60 con 0x7fc7c0102ef0 2024-09-19T08:10:09.306 INFO:teuthology.orchestra.run.smithi027.stdout:77309411399 2024-09-19T08:10:09.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.307+0000 7fc7c4a0b640 1 -- 172.21.15.27:0/4057234525 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc7ac0a3350 msgr2=0x7fc7ac0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:09.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.307+0000 7fc7c4a0b640 1 --2- 172.21.15.27:0/4057234525 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc7ac0a3350 0x7fc7ac0a5810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8004ad0 tx=0x7fc7b8004a60 comp rx=0 tx=0).stop 2024-09-19T08:10:09.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.307+0000 7fc7c4a0b640 1 -- 172.21.15.27:0/4057234525 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7c0102ef0 msgr2=0x7fc7c019efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:09.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.307+0000 7fc7c4a0b640 1 --2- 172.21.15.27:0/4057234525 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7c0102ef0 0x7fc7c019efd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc7b000c970 tx=0x7fc7b000ce30 comp rx=0 tx=0).stop 2024-09-19T08:10:09.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.307+0000 7fc7c4a0b640 1 -- 172.21.15.27:0/4057234525 shutdown_connections 2024-09-19T08:10:09.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.307+0000 7fc7c4a0b640 1 --2- 172.21.15.27:0/4057234525 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7c0102ef0 0x7fc7c019efd0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:09.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.307+0000 7fc7c4a0b640 1 --2- 172.21.15.27:0/4057234525 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7c0102570 0x7fc7c019ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:09.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.307+0000 7fc7c4a0b640 1 --2- 172.21.15.27:0/4057234525 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc7ac0a3350 0x7fc7ac0a5810 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:09.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.307+0000 7fc7c4a0b640 1 --2- 172.21.15.27:0/4057234525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7c0100e20 0x7fc7c019a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:09.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.307+0000 7fc7c4a0b640 1 -- 172.21.15.27:0/4057234525 >> 172.21.15.27:0/4057234525 conn(0x7fc7c00fc7d0 msgr2=0x7fc7c006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:09.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.307+0000 7fc7c4a0b640 1 -- 172.21.15.27:0/4057234525 shutdown_connections 2024-09-19T08:10:09.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.307+0000 7fc7c4a0b640 1 -- 172.21.15.27:0/4057234525 wait complete. 2024-09-19T08:10:09.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.355+0000 7f58da5e0640 1 -- 172.21.15.27:0/2523147715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58d4102ef0 msgr2=0x7f58d410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:09.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.355+0000 7f58da5e0640 1 --2- 172.21.15.27:0/2523147715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58d4102ef0 0x7f58d410da40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009ca0 tx=0x7f58cc02a950 comp rx=0 tx=0).stop 2024-09-19T08:10:09.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.355+0000 7f58da5e0640 1 -- 172.21.15.27:0/2523147715 shutdown_connections 2024-09-19T08:10:09.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.355+0000 7f58da5e0640 1 --2- 172.21.15.27:0/2523147715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58d4102ef0 0x7f58d410da40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:09.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.355+0000 7f58da5e0640 1 --2- 172.21.15.27:0/2523147715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d4102570 0x7f58d41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:09.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.355+0000 7f58da5e0640 1 --2- 172.21.15.27:0/2523147715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58d4100e20 0x7f58d4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:09.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.355+0000 7f58da5e0640 1 -- 172.21.15.27:0/2523147715 >> 172.21.15.27:0/2523147715 conn(0x7f58d40fc7d0 msgr2=0x7f58d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:09.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.355+0000 7f58da5e0640 1 -- 172.21.15.27:0/2523147715 shutdown_connections 2024-09-19T08:10:09.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.355+0000 7f58da5e0640 1 -- 172.21.15.27:0/2523147715 wait complete. 2024-09-19T08:10:09.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.355+0000 7f58da5e0640 1 Processor -- start 2024-09-19T08:10:09.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.355+0000 7f58da5e0640 1 -- start start 2024-09-19T08:10:09.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.356+0000 7f58da5e0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d4100e20 0x7f58d40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:09.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.356+0000 7f58da5e0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58d4102570 0x7f58d40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:09.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.356+0000 7f58da5e0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58d4102ef0 0x7f58d40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:09.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.356+0000 7f58da5e0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f58d4110f80 con 0x7f58d4102570 2024-09-19T08:10:09.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.356+0000 7f58da5e0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f58d4110e00 con 0x7f58d4100e20 2024-09-19T08:10:09.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.356+0000 7f58da5e0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f58d4111100 con 0x7f58d4102ef0 2024-09-19T08:10:09.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.356+0000 7f58d37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58d4102570 0x7f58d40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:09.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.356+0000 7f58d37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58d4102570 0x7f58d40fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38386/0 (socket says 172.21.15.27:38386) 2024-09-19T08:10:09.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.356+0000 7f58d37fe640 1 -- 172.21.15.27:0/3397713517 learned_addr learned my addr 172.21.15.27:0/3397713517 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:09.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.356+0000 7f58d3fff640 1 --2- 172.21.15.27:0/3397713517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d4100e20 0x7f58d40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:09.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.356+0000 7f58d8b7d640 1 --2- 172.21.15.27:0/3397713517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58d4102ef0 0x7f58d40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:09.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.356+0000 7f58d37fe640 1 -- 172.21.15.27:0/3397713517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58d4102ef0 msgr2=0x7f58d40fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:09.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.356+0000 7f58d37fe640 1 --2- 172.21.15.27:0/3397713517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58d4102ef0 0x7f58d40fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:09.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.356+0000 7f58d37fe640 1 -- 172.21.15.27:0/3397713517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d4100e20 msgr2=0x7f58d40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:09.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.356+0000 7f58d37fe640 1 --2- 172.21.15.27:0/3397713517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d4100e20 0x7f58d40fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:09.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.356+0000 7f58d37fe640 1 -- 172.21.15.27:0/3397713517 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d41a6920 con 0x7f58d4102570 2024-09-19T08:10:09.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.356+0000 7f58d37fe640 1 --2- 172.21.15.27:0/3397713517 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58d4102570 0x7f58d40fd1c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f58c800e9f0 tx=0x7f58c800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:09.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.357+0000 7f58d17fa640 1 -- 172.21.15.27:0/3397713517 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c800cd80 con 0x7f58d4102570 2024-09-19T08:10:09.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.357+0000 7f58d17fa640 1 -- 172.21.15.27:0/3397713517 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58c8010910 con 0x7f58d4102570 2024-09-19T08:10:09.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.357+0000 7f58da5e0640 1 -- 172.21.15.27:0/3397713517 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d41a6c10 con 0x7f58d4102570 2024-09-19T08:10:09.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.357+0000 7f58d17fa640 1 -- 172.21.15.27:0/3397713517 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8018990 con 0x7f58d4102570 2024-09-19T08:10:09.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.357+0000 7f58da5e0640 1 -- 172.21.15.27:0/3397713517 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d41a71a0 con 0x7f58d4102570 2024-09-19T08:10:09.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.358+0000 7f58da5e0640 1 -- 172.21.15.27:0/3397713517 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d4101200 con 0x7f58d4102570 2024-09-19T08:10:09.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.359+0000 7f58d17fa640 1 -- 172.21.15.27:0/3397713517 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f58c8010ac0 con 0x7f58d4102570 2024-09-19T08:10:09.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.360+0000 7f58d17fa640 1 --2- 172.21.15.27:0/3397713517 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f58bc0a3350 0x7f58bc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:09.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.360+0000 7f58d17fa640 1 -- 172.21.15.27:0/3397713517 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f58c80cfb70 con 0x7f58d4102570 2024-09-19T08:10:09.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.360+0000 7f58d3fff640 1 --2- 172.21.15.27:0/3397713517 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f58bc0a3350 0x7f58bc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:09.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.360+0000 7f58d3fff640 1 --2- 172.21.15.27:0/3397713517 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f58bc0a3350 0x7f58bc0a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f58c40058c0 tx=0x7f58c400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:09.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.364+0000 7f58d17fa640 1 -- 172.21.15.27:0/3397713517 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f58c809c8e0 con 0x7f58d4102570 2024-09-19T08:10:09.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.542+0000 7f58da5e0640 1 -- 172.21.15.27:0/3397713517 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f58d402d7c0 con 0x7f58d4102570 2024-09-19T08:10:09.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.542+0000 7f58d17fa640 1 -- 172.21.15.27:0/3397713517 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f58c80bae20 con 0x7f58d4102570 2024-09-19T08:10:09.543 INFO:teuthology.orchestra.run.smithi027.stdout:240518168616 2024-09-19T08:10:09.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.544+0000 7f58da5e0640 1 -- 172.21.15.27:0/3397713517 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f58bc0a3350 msgr2=0x7f58bc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:09.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.544+0000 7f58da5e0640 1 --2- 172.21.15.27:0/3397713517 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f58bc0a3350 0x7f58bc0a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f58c40058c0 tx=0x7f58c400a2d0 comp rx=0 tx=0).stop 2024-09-19T08:10:09.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.544+0000 7f58da5e0640 1 -- 172.21.15.27:0/3397713517 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58d4102570 msgr2=0x7f58d40fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:09.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.544+0000 7f58da5e0640 1 --2- 172.21.15.27:0/3397713517 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58d4102570 0x7f58d40fd1c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f58c800e9f0 tx=0x7f58c800eeb0 comp rx=0 tx=0).stop 2024-09-19T08:10:09.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.545+0000 7f58da5e0640 1 -- 172.21.15.27:0/3397713517 shutdown_connections 2024-09-19T08:10:09.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.545+0000 7f58da5e0640 1 --2- 172.21.15.27:0/3397713517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58d4102ef0 0x7f58d40fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:09.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.545+0000 7f58da5e0640 1 --2- 172.21.15.27:0/3397713517 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58d4102570 0x7f58d40fd1c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:09.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.545+0000 7f58da5e0640 1 --2- 172.21.15.27:0/3397713517 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f58bc0a3350 0x7f58bc0a5810 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:09.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.545+0000 7f58da5e0640 1 --2- 172.21.15.27:0/3397713517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d4100e20 0x7f58d40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:09.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.545+0000 7f58da5e0640 1 -- 172.21.15.27:0/3397713517 >> 172.21.15.27:0/3397713517 conn(0x7f58d40fc7d0 msgr2=0x7f58d406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:09.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.545+0000 7f58da5e0640 1 -- 172.21.15.27:0/3397713517 shutdown_connections 2024-09-19T08:10:09.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:09.545+0000 7f58da5e0640 1 -- 172.21.15.27:0/3397713517 wait complete. 2024-09-19T08:10:10.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:09 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/4057234525' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T08:10:10.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:09 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3397713517' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T08:10:10.074 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411395 got 77309411399 for osd.2 2024-09-19T08:10:10.074 DEBUG:teuthology.parallel:result is None 2024-09-19T08:10:10.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:09 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/4057234525' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T08:10:10.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:09 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3397713517' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T08:10:10.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:09 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/4057234525' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T08:10:10.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:09 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3397713517' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T08:10:10.548 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790003 got 158913790007 for osd.5 2024-09-19T08:10:10.548 DEBUG:teuthology.parallel:result is None 2024-09-19T08:10:10.784 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:10.881 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:10 smithi027 ceph-mon[31209]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:11.203 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168612 got 240518168616 for osd.8 2024-09-19T08:10:11.203 DEBUG:teuthology.parallel:result is None 2024-09-19T08:10:11.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:10 smithi155 ceph-mon[35362]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:11.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:10 smithi203 ceph-mon[35198]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:11.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.706+0000 7f883c264640 1 -- 172.21.15.27:0/3579056959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8834102d30 msgr2=0x7f8834103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:11.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.706+0000 7f883c264640 1 --2- 172.21.15.27:0/3579056959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8834102d30 0x7f8834103110 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8830009930 tx=0x7f883002a420 comp rx=0 tx=0).stop 2024-09-19T08:10:11.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.706+0000 7f883c264640 1 -- 172.21.15.27:0/3579056959 shutdown_connections 2024-09-19T08:10:11.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.706+0000 7f883c264640 1 --2- 172.21.15.27:0/3579056959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88341082a0 0x7f883410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:11.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.706+0000 7f883c264640 1 --2- 172.21.15.27:0/3579056959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88341036e0 0x7f8834107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:11.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.706+0000 7f883c264640 1 --2- 172.21.15.27:0/3579056959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8834102d30 0x7f8834103110 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:11.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.706+0000 7f883c264640 1 -- 172.21.15.27:0/3579056959 >> 172.21.15.27:0/3579056959 conn(0x7f88340fc7d0 msgr2=0x7f88340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:11.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.706+0000 7f883c264640 1 -- 172.21.15.27:0/3579056959 shutdown_connections 2024-09-19T08:10:11.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.706+0000 7f883c264640 1 -- 172.21.15.27:0/3579056959 wait complete. 2024-09-19T08:10:11.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.707+0000 7f883c264640 1 Processor -- start 2024-09-19T08:10:11.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.707+0000 7f883c264640 1 -- start start 2024-09-19T08:10:11.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.707+0000 7f883c264640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8834102d30 0x7f8834100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:11.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.707+0000 7f883c264640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88341036e0 0x7f8834100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:11.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.707+0000 7f883c264640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88341082a0 0x7f8834101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:11.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.707+0000 7f883c264640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f88341120a0 con 0x7f88341036e0 2024-09-19T08:10:11.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.707+0000 7f883c264640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8834111f20 con 0x7f8834102d30 2024-09-19T08:10:11.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.707+0000 7f883c264640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8834112220 con 0x7f88341082a0 2024-09-19T08:10:11.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.707+0000 7f88397ff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88341036e0 0x7f8834100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:11.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.707+0000 7f88397ff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88341036e0 0x7f8834100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35512/0 (socket says 172.21.15.27:35512) 2024-09-19T08:10:11.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.707+0000 7f88397ff640 1 -- 172.21.15.27:0/222302377 learned_addr learned my addr 172.21.15.27:0/222302377 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:11.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.707+0000 7f883a000640 1 --2- 172.21.15.27:0/222302377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8834102d30 0x7f8834100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:11.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.707+0000 7f883a801640 1 --2- 172.21.15.27:0/222302377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88341082a0 0x7f8834101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:11.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.707+0000 7f88397ff640 1 -- 172.21.15.27:0/222302377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88341082a0 msgr2=0x7f8834101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:11.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.707+0000 7f88397ff640 1 --2- 172.21.15.27:0/222302377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88341082a0 0x7f8834101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:11.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.707+0000 7f88397ff640 1 -- 172.21.15.27:0/222302377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8834102d30 msgr2=0x7f8834100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:11.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.707+0000 7f88397ff640 1 --2- 172.21.15.27:0/222302377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8834102d30 0x7f8834100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:11.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.707+0000 7f88397ff640 1 -- 172.21.15.27:0/222302377 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88341a6ae0 con 0x7f88341036e0 2024-09-19T08:10:11.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.707+0000 7f88397ff640 1 --2- 172.21.15.27:0/222302377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88341036e0 0x7f8834100ed0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f882400d750 tx=0x7f882400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:11.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.708+0000 7f882affd640 1 -- 172.21.15.27:0/222302377 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8824017070 con 0x7f88341036e0 2024-09-19T08:10:11.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.708+0000 7f883c264640 1 -- 172.21.15.27:0/222302377 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88341a6dd0 con 0x7f88341036e0 2024-09-19T08:10:11.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.708+0000 7f882affd640 1 -- 172.21.15.27:0/222302377 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8824005500 con 0x7f88341036e0 2024-09-19T08:10:11.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.708+0000 7f882affd640 1 -- 172.21.15.27:0/222302377 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8824004e00 con 0x7f88341036e0 2024-09-19T08:10:11.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.708+0000 7f883c264640 1 -- 172.21.15.27:0/222302377 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88341a7280 con 0x7f88341036e0 2024-09-19T08:10:11.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.709+0000 7f883c264640 1 -- 172.21.15.27:0/222302377 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f883406a850 con 0x7f88341036e0 2024-09-19T08:10:11.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.710+0000 7f882affd640 1 -- 172.21.15.27:0/222302377 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8824004fa0 con 0x7f88341036e0 2024-09-19T08:10:11.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.711+0000 7f882affd640 1 --2- 172.21.15.27:0/222302377 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f88200a32d0 0x7f88200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:11.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.711+0000 7f883a000640 1 --2- 172.21.15.27:0/222302377 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f88200a32d0 0x7f88200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:11.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.711+0000 7f882affd640 1 -- 172.21.15.27:0/222302377 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f88240cf440 con 0x7f88341036e0 2024-09-19T08:10:11.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.711+0000 7f883a000640 1 --2- 172.21.15.27:0/222302377 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f88200a32d0 0x7f88200a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8830000c00 tx=0x7f8830005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:11.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.715+0000 7f882affd640 1 -- 172.21.15.27:0/222302377 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f882409c0b0 con 0x7f88341036e0 2024-09-19T08:10:11.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.895+0000 7f883c264640 1 -- 172.21.15.27:0/222302377 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f883410a2b0 con 0x7f88341036e0 2024-09-19T08:10:11.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.895+0000 7f882affd640 1 -- 172.21.15.27:0/222302377 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f882409b9b0 con 0x7f88341036e0 2024-09-19T08:10:11.896 INFO:teuthology.orchestra.run.smithi027.stdout:270582939684 2024-09-19T08:10:11.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.897+0000 7f883c264640 1 -- 172.21.15.27:0/222302377 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f88200a32d0 msgr2=0x7f88200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:11.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.897+0000 7f883c264640 1 --2- 172.21.15.27:0/222302377 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f88200a32d0 0x7f88200a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8830000c00 tx=0x7f8830005a20 comp rx=0 tx=0).stop 2024-09-19T08:10:11.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.897+0000 7f883c264640 1 -- 172.21.15.27:0/222302377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88341036e0 msgr2=0x7f8834100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:11.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.897+0000 7f883c264640 1 --2- 172.21.15.27:0/222302377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88341036e0 0x7f8834100ed0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f882400d750 tx=0x7f882400dc10 comp rx=0 tx=0).stop 2024-09-19T08:10:11.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.897+0000 7f883c264640 1 -- 172.21.15.27:0/222302377 shutdown_connections 2024-09-19T08:10:11.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.897+0000 7f883c264640 1 --2- 172.21.15.27:0/222302377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88341082a0 0x7f8834101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:11.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.897+0000 7f883c264640 1 --2- 172.21.15.27:0/222302377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88341036e0 0x7f8834100ed0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:11.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.897+0000 7f883c264640 1 --2- 172.21.15.27:0/222302377 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f88200a32d0 0x7f88200a5790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:11.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.897+0000 7f883c264640 1 --2- 172.21.15.27:0/222302377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8834102d30 0x7f8834100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:11.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.897+0000 7f883c264640 1 -- 172.21.15.27:0/222302377 >> 172.21.15.27:0/222302377 conn(0x7f88340fc7d0 msgr2=0x7f8834105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:11.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.897+0000 7f883c264640 1 -- 172.21.15.27:0/222302377 shutdown_connections 2024-09-19T08:10:11.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:11.897+0000 7f883c264640 1 -- 172.21.15.27:0/222302377 wait complete. 2024-09-19T08:10:13.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:12 smithi027 ceph-mon[31209]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:13.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:12 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/222302377' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T08:10:13.063 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939681 got 270582939684 for osd.9 2024-09-19T08:10:13.063 DEBUG:teuthology.parallel:result is None 2024-09-19T08:10:13.064 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T08:10:13.064 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:10:13.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:12 smithi155 ceph-mon[35362]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:13.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:12 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/222302377' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T08:10:13.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:12 smithi203 ceph-mon[35198]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:13.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:12 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/222302377' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T08:10:13.347 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:13.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.860+0000 7fe17cf8c640 1 -- 172.21.15.27:0/2597879406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe178101ba0 msgr2=0x7fe17810d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:13.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.860+0000 7fe17cf8c640 1 --2- 172.21.15.27:0/2597879406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe178101ba0 0x7fe17810d970 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe168009900 tx=0x7fe16802a410 comp rx=0 tx=0).stop 2024-09-19T08:10:13.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.860+0000 7fe17cf8c640 1 -- 172.21.15.27:0/2597879406 shutdown_connections 2024-09-19T08:10:13.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.860+0000 7fe17cf8c640 1 --2- 172.21.15.27:0/2597879406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe178101ba0 0x7fe17810d970 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:13.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.860+0000 7fe17cf8c640 1 --2- 172.21.15.27:0/2597879406 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe178101200 0x7fe178101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:13.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.860+0000 7fe17cf8c640 1 --2- 172.21.15.27:0/2597879406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe178105ad0 0x7fe178105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:13.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.860+0000 7fe17cf8c640 1 -- 172.21.15.27:0/2597879406 >> 172.21.15.27:0/2597879406 conn(0x7fe178077210 msgr2=0x7fe1780fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:13.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.860+0000 7fe17cf8c640 1 -- 172.21.15.27:0/2597879406 shutdown_connections 2024-09-19T08:10:13.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.860+0000 7fe17cf8c640 1 -- 172.21.15.27:0/2597879406 wait complete. 2024-09-19T08:10:13.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.861+0000 7fe17cf8c640 1 Processor -- start 2024-09-19T08:10:13.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.861+0000 7fe17cf8c640 1 -- start start 2024-09-19T08:10:13.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.861+0000 7fe17cf8c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe178101200 0x7fe178198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:13.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.861+0000 7fe17cf8c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe178101ba0 0x7fe1781988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:13.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.861+0000 7fe17cf8c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe178105ad0 0x7fe17819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:13.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.861+0000 7fe17cf8c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe178110ef0 con 0x7fe178101ba0 2024-09-19T08:10:13.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.861+0000 7fe17cf8c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe178110d70 con 0x7fe178101200 2024-09-19T08:10:13.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.861+0000 7fe17cf8c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe178111070 con 0x7fe178105ad0 2024-09-19T08:10:13.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.861+0000 7fe175d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe178101ba0 0x7fe1781988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:13.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.861+0000 7fe175d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe178101ba0 0x7fe1781988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35530/0 (socket says 172.21.15.27:35530) 2024-09-19T08:10:13.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.861+0000 7fe175d9b640 1 -- 172.21.15.27:0/2706670587 learned_addr learned my addr 172.21.15.27:0/2706670587 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:13.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.862+0000 7fe176d9d640 1 --2- 172.21.15.27:0/2706670587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe178105ad0 0x7fe17819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:13.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.862+0000 7fe17659c640 1 --2- 172.21.15.27:0/2706670587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe178101200 0x7fe178198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:13.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.862+0000 7fe175d9b640 1 -- 172.21.15.27:0/2706670587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe178105ad0 msgr2=0x7fe17819cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:13.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.862+0000 7fe175d9b640 1 --2- 172.21.15.27:0/2706670587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe178105ad0 0x7fe17819cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:13.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.862+0000 7fe175d9b640 1 -- 172.21.15.27:0/2706670587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe178101200 msgr2=0x7fe178198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:13.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.862+0000 7fe175d9b640 1 --2- 172.21.15.27:0/2706670587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe178101200 0x7fe178198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:13.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.862+0000 7fe175d9b640 1 -- 172.21.15.27:0/2706670587 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17819d270 con 0x7fe178101ba0 2024-09-19T08:10:13.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.862+0000 7fe17659c640 1 --2- 172.21.15.27:0/2706670587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe178101200 0x7fe178198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:10:13.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.862+0000 7fe175d9b640 1 --2- 172.21.15.27:0/2706670587 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe178101ba0 0x7fe1781988a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe16000d770 tx=0x7fe16000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:13.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.862+0000 7fe16f7fe640 1 -- 172.21.15.27:0/2706670587 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160017070 con 0x7fe178101ba0 2024-09-19T08:10:13.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.862+0000 7fe16f7fe640 1 -- 172.21.15.27:0/2706670587 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe160005500 con 0x7fe178101ba0 2024-09-19T08:10:13.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.862+0000 7fe17cf8c640 1 -- 172.21.15.27:0/2706670587 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe17819d560 con 0x7fe178101ba0 2024-09-19T08:10:13.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.862+0000 7fe16f7fe640 1 -- 172.21.15.27:0/2706670587 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160004e00 con 0x7fe178101ba0 2024-09-19T08:10:13.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.862+0000 7fe17cf8c640 1 -- 172.21.15.27:0/2706670587 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1781a4e40 con 0x7fe178101ba0 2024-09-19T08:10:13.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.863+0000 7fe17cf8c640 1 -- 172.21.15.27:0/2706670587 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe178101660 con 0x7fe178101ba0 2024-09-19T08:10:13.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.864+0000 7fe16f7fe640 1 -- 172.21.15.27:0/2706670587 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe160004fa0 con 0x7fe178101ba0 2024-09-19T08:10:13.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.865+0000 7fe16f7fe640 1 --2- 172.21.15.27:0/2706670587 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe1640a32d0 0x7fe1640a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:13.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.865+0000 7fe17659c640 1 --2- 172.21.15.27:0/2706670587 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe1640a32d0 0x7fe1640a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:13.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.865+0000 7fe16f7fe640 1 -- 172.21.15.27:0/2706670587 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fe1600cf920 con 0x7fe178101ba0 2024-09-19T08:10:13.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.866+0000 7fe17659c640 1 --2- 172.21.15.27:0/2706670587 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe1640a32d0 0x7fe1640a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe170007e70 tx=0x7fe170007850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:13.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:13.868+0000 7fe16f7fe640 1 -- 172.21.15.27:0/2706670587 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe16009c510 con 0x7fe178101ba0 2024-09-19T08:10:14.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:14.046+0000 7fe17cf8c640 1 -- 172.21.15.27:0/2706670587 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe1781008a0 con 0x7fe1640a32d0 2024-09-19T08:10:14.046 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:13 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T08:10:14.047 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:13 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-19T08:10:14.047 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:13 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-19T08:10:14.047 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:13 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-19T08:10:14.047 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:13 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-19T08:10:14.047 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:13 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-19T08:10:14.047 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:13 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-19T08:10:14.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:14.053+0000 7fe16f7fe640 1 -- 172.21.15.27:0/2706670587 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258791 (secure 0 0 0) 0x7fe1781008a0 con 0x7fe1640a32d0 2024-09-19T08:10:14.055 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:10:14.056 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-09-19T08:10:14.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:14.057+0000 7fe17cf8c640 1 -- 172.21.15.27:0/2706670587 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe1640a32d0 msgr2=0x7fe1640a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:14.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:14.057+0000 7fe17cf8c640 1 --2- 172.21.15.27:0/2706670587 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe1640a32d0 0x7fe1640a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe170007e70 tx=0x7fe170007850 comp rx=0 tx=0).stop 2024-09-19T08:10:14.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:14.057+0000 7fe17cf8c640 1 -- 172.21.15.27:0/2706670587 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe178101ba0 msgr2=0x7fe1781988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:14.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:14.057+0000 7fe17cf8c640 1 --2- 172.21.15.27:0/2706670587 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe178101ba0 0x7fe1781988a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe16000d770 tx=0x7fe16000dc30 comp rx=0 tx=0).stop 2024-09-19T08:10:14.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:14.057+0000 7fe17cf8c640 1 -- 172.21.15.27:0/2706670587 shutdown_connections 2024-09-19T08:10:14.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:14.057+0000 7fe17cf8c640 1 --2- 172.21.15.27:0/2706670587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe178105ad0 0x7fe17819cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:14.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:14.057+0000 7fe17cf8c640 1 --2- 172.21.15.27:0/2706670587 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe178101ba0 0x7fe1781988a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:14.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:14.057+0000 7fe17cf8c640 1 --2- 172.21.15.27:0/2706670587 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe1640a32d0 0x7fe1640a5790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:14.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:14.057+0000 7fe17cf8c640 1 --2- 172.21.15.27:0/2706670587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe178101200 0x7fe178198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:14.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:14.057+0000 7fe17cf8c640 1 -- 172.21.15.27:0/2706670587 >> 172.21.15.27:0/2706670587 conn(0x7fe178077210 msgr2=0x7fe178100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:14.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:14.058+0000 7fe17cf8c640 1 -- 172.21.15.27:0/2706670587 shutdown_connections 2024-09-19T08:10:14.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:14.058+0000 7fe17cf8c640 1 -- 172.21.15.27:0/2706670587 wait complete. 2024-09-19T08:10:14.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:13 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T08:10:14.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:13 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-19T08:10:14.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:13 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-19T08:10:14.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:13 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-19T08:10:14.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:13 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-19T08:10:14.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:13 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-19T08:10:14.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:13 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-19T08:10:14.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:13 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T08:10:14.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:13 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-19T08:10:14.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:13 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-19T08:10:14.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:13 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-19T08:10:14.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:13 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-19T08:10:14.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:13 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-19T08:10:14.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:13 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-19T08:10:14.795 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-09-19T08:10:13.780118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654219,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":256,"num_read_kb":243,"num_write":264,"num_write_kb":3026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355728,"kb_used_data":10620,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124586096,"statfs":{"total":1151940427776,"available":1151576162304,"internally_reserved":0,"allocated":10874880,"data_stored":6990921,"data_compressed":107475,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.850732"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260466+0000","last_change":"2024-09-19T08:09:11.246436+0000","last_active":"2024-09-19T08:09:12.260466+0000","last_peered":"2024-09-19T08:09:12.260466+0000","last_clean":"2024-09-19T08:09:12.260466+0000","last_became_active":"2024-09-19T08:09:11.245674+0000","last_became_peered":"2024-09-19T08:09:11.245674+0000","last_unstale":"2024-09-19T08:09:12.260466+0000","last_undegraded":"2024-09-19T08:09:12.260466+0000","last_fullsized":"2024-09-19T08:09:12.260466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:46.716474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273550+0000","last_change":"2024-09-19T08:09:11.243334+0000","last_active":"2024-09-19T08:09:12.273550+0000","last_peered":"2024-09-19T08:09:12.273550+0000","last_clean":"2024-09-19T08:09:12.273550+0000","last_became_active":"2024-09-19T08:09:11.243024+0000","last_became_peered":"2024-09-19T08:09:11.243024+0000","last_unstale":"2024-09-19T08:09:12.273550+0000","last_undegraded":"2024-09-19T08:09:12.273550+0000","last_fullsized":"2024-09-19T08:09:12.273550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.060068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273553+0000","last_change":"2024-09-19T08:09:11.254655+0000","last_active":"2024-09-19T08:09:12.273553+0000","last_peered":"2024-09-19T08:09:12.273553+0000","last_clean":"2024-09-19T08:09:12.273553+0000","last_became_active":"2024-09-19T08:09:11.254292+0000","last_became_peered":"2024-09-19T08:09:11.254292+0000","last_unstale":"2024-09-19T08:09:12.273553+0000","last_undegraded":"2024-09-19T08:09:12.273553+0000","last_fullsized":"2024-09-19T08:09:12.273553+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:01.977743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273130+0000","last_change":"2024-09-19T08:09:11.257029+0000","last_active":"2024-09-19T08:09:12.273130+0000","last_peered":"2024-09-19T08:09:12.273130+0000","last_clean":"2024-09-19T08:09:12.273130+0000","last_became_active":"2024-09-19T08:09:11.256669+0000","last_became_peered":"2024-09-19T08:09:11.256669+0000","last_unstale":"2024-09-19T08:09:12.273130+0000","last_undegraded":"2024-09-19T08:09:12.273130+0000","last_fullsized":"2024-09-19T08:09:12.273130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:32.831036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270384+0000","last_change":"2024-09-19T08:09:11.240341+0000","last_active":"2024-09-19T08:09:12.270384+0000","last_peered":"2024-09-19T08:09:12.270384+0000","last_clean":"2024-09-19T08:09:12.270384+0000","last_became_active":"2024-09-19T08:09:11.239996+0000","last_became_peered":"2024-09-19T08:09:11.239996+0000","last_unstale":"2024-09-19T08:09:12.270384+0000","last_undegraded":"2024-09-19T08:09:12.270384+0000","last_fullsized":"2024-09-19T08:09:12.270384+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:20.331791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264127+0000","last_change":"2024-09-19T08:09:11.248089+0000","last_active":"2024-09-19T08:09:12.264127+0000","last_peered":"2024-09-19T08:09:12.264127+0000","last_clean":"2024-09-19T08:09:12.264127+0000","last_became_active":"2024-09-19T08:09:11.247802+0000","last_became_peered":"2024-09-19T08:09:11.247802+0000","last_unstale":"2024-09-19T08:09:12.264127+0000","last_undegraded":"2024-09-19T08:09:12.264127+0000","last_fullsized":"2024-09-19T08:09:12.264127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.249119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274640+0000","last_change":"2024-09-19T08:09:11.246853+0000","last_active":"2024-09-19T08:09:12.274640+0000","last_peered":"2024-09-19T08:09:12.274640+0000","last_clean":"2024-09-19T08:09:12.274640+0000","last_became_active":"2024-09-19T08:09:11.246523+0000","last_became_peered":"2024-09-19T08:09:11.246523+0000","last_unstale":"2024-09-19T08:09:12.274640+0000","last_undegraded":"2024-09-19T08:09:12.274640+0000","last_fullsized":"2024-09-19T08:09:12.274640+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:54.879087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269828+0000","last_change":"2024-09-19T08:09:11.232588+0000","last_active":"2024-09-19T08:09:12.269828+0000","last_peered":"2024-09-19T08:09:12.269828+0000","last_clean":"2024-09-19T08:09:12.269828+0000","last_became_active":"2024-09-19T08:09:11.232251+0000","last_became_peered":"2024-09-19T08:09:11.232251+0000","last_unstale":"2024-09-19T08:09:12.269828+0000","last_undegraded":"2024-09-19T08:09:12.269828+0000","last_fullsized":"2024-09-19T08:09:12.269828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:57.622086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270505+0000","last_change":"2024-09-19T08:09:11.248854+0000","last_active":"2024-09-19T08:09:12.270505+0000","last_peered":"2024-09-19T08:09:12.270505+0000","last_clean":"2024-09-19T08:09:12.270505+0000","last_became_active":"2024-09-19T08:09:11.248524+0000","last_became_peered":"2024-09-19T08:09:11.248524+0000","last_unstale":"2024-09-19T08:09:12.270505+0000","last_undegraded":"2024-09-19T08:09:12.270505+0000","last_fullsized":"2024-09-19T08:09:12.270505+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:57.978974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264615+0000","last_change":"2024-09-19T08:09:11.247407+0000","last_active":"2024-09-19T08:09:12.264615+0000","last_peered":"2024-09-19T08:09:12.264615+0000","last_clean":"2024-09-19T08:09:12.264615+0000","last_became_active":"2024-09-19T08:09:11.247093+0000","last_became_peered":"2024-09-19T08:09:11.247093+0000","last_unstale":"2024-09-19T08:09:12.264615+0000","last_undegraded":"2024-09-19T08:09:12.264615+0000","last_fullsized":"2024-09-19T08:09:12.264615+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:25.959852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275097+0000","last_change":"2024-09-19T08:09:11.247604+0000","last_active":"2024-09-19T08:09:12.275097+0000","last_peered":"2024-09-19T08:09:12.275097+0000","last_clean":"2024-09-19T08:09:12.275097+0000","last_became_active":"2024-09-19T08:09:11.247264+0000","last_became_peered":"2024-09-19T08:09:11.247264+0000","last_unstale":"2024-09-19T08:09:12.275097+0000","last_undegraded":"2024-09-19T08:09:12.275097+0000","last_fullsized":"2024-09-19T08:09:12.275097+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:15.315022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273289+0000","last_change":"2024-09-19T08:09:11.253948+0000","last_active":"2024-09-19T08:09:12.273289+0000","last_peered":"2024-09-19T08:09:12.273289+0000","last_clean":"2024-09-19T08:09:12.273289+0000","last_became_active":"2024-09-19T08:09:11.253402+0000","last_became_peered":"2024-09-19T08:09:11.253402+0000","last_unstale":"2024-09-19T08:09:12.273289+0000","last_undegraded":"2024-09-19T08:09:12.273289+0000","last_fullsized":"2024-09-19T08:09:12.273289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:04.884541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259928+0000","last_change":"2024-09-19T08:09:11.241770+0000","last_active":"2024-09-19T08:09:12.259928+0000","last_peered":"2024-09-19T08:09:12.259928+0000","last_clean":"2024-09-19T08:09:12.259928+0000","last_became_active":"2024-09-19T08:09:11.241356+0000","last_became_peered":"2024-09-19T08:09:11.241356+0000","last_unstale":"2024-09-19T08:09:12.259928+0000","last_undegraded":"2024-09-19T08:09:12.259928+0000","last_fullsized":"2024-09-19T08:09:12.259928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:02.722445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272890+0000","last_change":"2024-09-19T08:09:11.242874+0000","last_active":"2024-09-19T08:09:12.272890+0000","last_peered":"2024-09-19T08:09:12.272890+0000","last_clean":"2024-09-19T08:09:12.272890+0000","last_became_active":"2024-09-19T08:09:11.242383+0000","last_became_peered":"2024-09-19T08:09:11.242383+0000","last_unstale":"2024-09-19T08:09:12.272890+0000","last_undegraded":"2024-09-19T08:09:12.272890+0000","last_fullsized":"2024-09-19T08:09:12.272890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:51.900211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272762+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:09:12.272762+0000","last_peered":"2024-09-19T08:09:12.272762+0000","last_clean":"2024-09-19T08:09:12.272762+0000","last_became_active":"2024-09-19T08:09:11.250797+0000","last_became_peered":"2024-09-19T08:09:11.250797+0000","last_unstale":"2024-09-19T08:09:12.272762+0000","last_undegraded":"2024-09-19T08:09:12.272762+0000","last_fullsized":"2024-09-19T08:09:12.272762+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:46.183857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269901+0000","last_change":"2024-09-19T08:09:11.250884+0000","last_active":"2024-09-19T08:09:12.269901+0000","last_peered":"2024-09-19T08:09:12.269901+0000","last_clean":"2024-09-19T08:09:12.269901+0000","last_became_active":"2024-09-19T08:09:11.250543+0000","last_became_peered":"2024-09-19T08:09:11.250543+0000","last_unstale":"2024-09-19T08:09:12.269901+0000","last_undegraded":"2024-09-19T08:09:12.269901+0000","last_fullsized":"2024-09-19T08:09:12.269901+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.259466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260519+0000","last_change":"2024-09-19T08:09:11.246705+0000","last_active":"2024-09-19T08:09:12.260519+0000","last_peered":"2024-09-19T08:09:12.260519+0000","last_clean":"2024-09-19T08:09:12.260519+0000","last_became_active":"2024-09-19T08:09:11.246117+0000","last_became_peered":"2024-09-19T08:09:11.246117+0000","last_unstale":"2024-09-19T08:09:12.260519+0000","last_undegraded":"2024-09-19T08:09:12.260519+0000","last_fullsized":"2024-09-19T08:09:12.260519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:07.421222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272544+0000","last_change":"2024-09-19T08:09:11.242181+0000","last_active":"2024-09-19T08:09:12.272544+0000","last_peered":"2024-09-19T08:09:12.272544+0000","last_clean":"2024-09-19T08:09:12.272544+0000","last_became_active":"2024-09-19T08:09:11.241882+0000","last_became_peered":"2024-09-19T08:09:11.241882+0000","last_unstale":"2024-09-19T08:09:12.272544+0000","last_undegraded":"2024-09-19T08:09:12.272544+0000","last_fullsized":"2024-09-19T08:09:12.272544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:35.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270253+0000","last_change":"2024-09-19T08:09:11.246038+0000","last_active":"2024-09-19T08:09:12.270253+0000","last_peered":"2024-09-19T08:09:12.270253+0000","last_clean":"2024-09-19T08:09:12.270253+0000","last_became_active":"2024-09-19T08:09:11.245554+0000","last_became_peered":"2024-09-19T08:09:11.245554+0000","last_unstale":"2024-09-19T08:09:12.270253+0000","last_undegraded":"2024-09-19T08:09:12.270253+0000","last_fullsized":"2024-09-19T08:09:12.270253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:14.512425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260222+0000","last_change":"2024-09-19T08:09:11.249246+0000","last_active":"2024-09-19T08:09:12.260222+0000","last_peered":"2024-09-19T08:09:12.260222+0000","last_clean":"2024-09-19T08:09:12.260222+0000","last_became_active":"2024-09-19T08:09:11.248896+0000","last_became_peered":"2024-09-19T08:09:11.248896+0000","last_unstale":"2024-09-19T08:09:12.260222+0000","last_undegraded":"2024-09-19T08:09:12.260222+0000","last_fullsized":"2024-09-19T08:09:12.260222+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:40.406924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259965+0000","last_change":"2024-09-19T08:09:11.245421+0000","last_active":"2024-09-19T08:09:12.259965+0000","last_peered":"2024-09-19T08:09:12.259965+0000","last_clean":"2024-09-19T08:09:12.259965+0000","last_became_active":"2024-09-19T08:09:11.245071+0000","last_became_peered":"2024-09-19T08:09:11.245071+0000","last_unstale":"2024-09-19T08:09:12.259965+0000","last_undegraded":"2024-09-19T08:09:12.259965+0000","last_fullsized":"2024-09-19T08:09:12.259965+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:58.594399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270143+0000","last_change":"2024-09-19T08:09:11.246097+0000","last_active":"2024-09-19T08:09:12.270143+0000","last_peered":"2024-09-19T08:09:12.270143+0000","last_clean":"2024-09-19T08:09:12.270143+0000","last_became_active":"2024-09-19T08:09:11.245741+0000","last_became_peered":"2024-09-19T08:09:11.245741+0000","last_unstale":"2024-09-19T08:09:12.270143+0000","last_undegraded":"2024-09-19T08:09:12.270143+0000","last_fullsized":"2024-09-19T08:09:12.270143+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:05.731148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269658+0000","last_change":"2024-09-19T08:09:11.251485+0000","last_active":"2024-09-19T08:09:12.269658+0000","last_peered":"2024-09-19T08:09:12.269658+0000","last_clean":"2024-09-19T08:09:12.269658+0000","last_became_active":"2024-09-19T08:09:11.251151+0000","last_became_peered":"2024-09-19T08:09:11.251151+0000","last_unstale":"2024-09-19T08:09:12.269658+0000","last_undegraded":"2024-09-19T08:09:12.269658+0000","last_fullsized":"2024-09-19T08:09:12.269658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:47.231056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275099+0000","last_change":"2024-09-19T08:09:11.234490+0000","last_active":"2024-09-19T08:09:12.275099+0000","last_peered":"2024-09-19T08:09:12.275099+0000","last_clean":"2024-09-19T08:09:12.275099+0000","last_became_active":"2024-09-19T08:09:11.234163+0000","last_became_peered":"2024-09-19T08:09:11.234163+0000","last_unstale":"2024-09-19T08:09:12.275099+0000","last_undegraded":"2024-09-19T08:09:12.275099+0000","last_fullsized":"2024-09-19T08:09:12.275099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.610165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270016+0000","last_change":"2024-09-19T08:09:11.247189+0000","last_active":"2024-09-19T08:09:12.270016+0000","last_peered":"2024-09-19T08:09:12.270016+0000","last_clean":"2024-09-19T08:09:12.270016+0000","last_became_active":"2024-09-19T08:09:11.246844+0000","last_became_peered":"2024-09-19T08:09:11.246844+0000","last_unstale":"2024-09-19T08:09:12.270016+0000","last_undegraded":"2024-09-19T08:09:12.270016+0000","last_fullsized":"2024-09-19T08:09:12.270016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:50.764694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273859+0000","last_change":"2024-09-19T08:09:11.251655+0000","last_active":"2024-09-19T08:09:12.273859+0000","last_peered":"2024-09-19T08:09:12.273859+0000","last_clean":"2024-09-19T08:09:12.273859+0000","last_became_active":"2024-09-19T08:09:11.250930+0000","last_became_peered":"2024-09-19T08:09:11.250930+0000","last_unstale":"2024-09-19T08:09:12.273859+0000","last_undegraded":"2024-09-19T08:09:12.273859+0000","last_fullsized":"2024-09-19T08:09:12.273859+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:17.658277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260441+0000","last_change":"2024-09-19T08:09:11.248095+0000","last_active":"2024-09-19T08:09:12.260441+0000","last_peered":"2024-09-19T08:09:12.260441+0000","last_clean":"2024-09-19T08:09:12.260441+0000","last_became_active":"2024-09-19T08:09:11.247719+0000","last_became_peered":"2024-09-19T08:09:11.247719+0000","last_unstale":"2024-09-19T08:09:12.260441+0000","last_undegraded":"2024-09-19T08:09:12.260441+0000","last_fullsized":"2024-09-19T08:09:12.260441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:26.701140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259653+0000","last_change":"2024-09-19T08:09:11.243232+0000","last_active":"2024-09-19T08:09:12.259653+0000","last_peered":"2024-09-19T08:09:12.259653+0000","last_clean":"2024-09-19T08:09:12.259653+0000","last_became_active":"2024-09-19T08:09:11.242927+0000","last_became_peered":"2024-09-19T08:09:11.242927+0000","last_unstale":"2024-09-19T08:09:12.259653+0000","last_undegraded":"2024-09-19T08:09:12.259653+0000","last_fullsized":"2024-09-19T08:09:12.259653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:19.877520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273190+0000","last_change":"2024-09-19T08:09:11.249588+0000","last_active":"2024-09-19T08:09:12.273190+0000","last_peered":"2024-09-19T08:09:12.273190+0000","last_clean":"2024-09-19T08:09:12.273190+0000","last_became_active":"2024-09-19T08:09:11.249266+0000","last_became_peered":"2024-09-19T08:09:11.249266+0000","last_unstale":"2024-09-19T08:09:12.273190+0000","last_undegraded":"2024-09-19T08:09:12.273190+0000","last_fullsized":"2024-09-19T08:09:12.273190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:43.332454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272135+0000","last_change":"2024-09-19T08:09:11.245866+0000","last_active":"2024-09-19T08:09:12.272135+0000","last_peered":"2024-09-19T08:09:12.272135+0000","last_clean":"2024-09-19T08:09:12.272135+0000","last_became_active":"2024-09-19T08:09:11.245505+0000","last_became_peered":"2024-09-19T08:09:11.245505+0000","last_unstale":"2024-09-19T08:09:12.272135+0000","last_undegraded":"2024-09-19T08:09:12.272135+0000","last_fullsized":"2024-09-19T08:09:12.272135+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:38.203790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270471+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:09:12.270471+0000","last_peered":"2024-09-19T08:09:12.270471+0000","last_clean":"2024-09-19T08:09:12.270471+0000","last_became_active":"2024-09-19T08:09:11.250745+0000","last_became_peered":"2024-09-19T08:09:11.250745+0000","last_unstale":"2024-09-19T08:09:12.270471+0000","last_undegraded":"2024-09-19T08:09:12.270471+0000","last_fullsized":"2024-09-19T08:09:12.270471+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:16.851230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260162+0000","last_change":"2024-09-19T08:09:11.255211+0000","last_active":"2024-09-19T08:09:12.260162+0000","last_peered":"2024-09-19T08:09:12.260162+0000","last_clean":"2024-09-19T08:09:12.260162+0000","last_became_active":"2024-09-19T08:09:11.254853+0000","last_became_peered":"2024-09-19T08:09:11.254853+0000","last_unstale":"2024-09-19T08:09:12.260162+0000","last_undegraded":"2024-09-19T08:09:12.260162+0000","last_fullsized":"2024-09-19T08:09:12.260162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.497502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.271028+0000","last_change":"2024-09-19T08:09:11.247201+0000","last_active":"2024-09-19T08:09:12.271028+0000","last_peered":"2024-09-19T08:09:12.271028+0000","last_clean":"2024-09-19T08:09:12.271028+0000","last_became_active":"2024-09-19T08:09:11.246854+0000","last_became_peered":"2024-09-19T08:09:11.246854+0000","last_unstale":"2024-09-19T08:09:12.271028+0000","last_undegraded":"2024-09-19T08:09:12.271028+0000","last_fullsized":"2024-09-19T08:09:12.271028+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:19.262849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275258+0000","last_change":"2024-09-19T08:09:09.113754+0000","last_active":"2024-09-19T08:09:12.275258+0000","last_peered":"2024-09-19T08:09:12.275258+0000","last_clean":"2024-09-19T08:09:12.275258+0000","last_became_active":"2024-09-19T08:09:09.113389+0000","last_became_peered":"2024-09-19T08:09:09.113389+0000","last_unstale":"2024-09-19T08:09:12.275258+0000","last_undegraded":"2024-09-19T08:09:12.275258+0000","last_fullsized":"2024-09-19T08:09:12.275258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:45.325895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275007+0000","last_change":"2024-09-19T08:09:11.244625+0000","last_active":"2024-09-19T08:09:12.275007+0000","last_peered":"2024-09-19T08:09:12.275007+0000","last_clean":"2024-09-19T08:09:12.275007+0000","last_became_active":"2024-09-19T08:09:11.244277+0000","last_became_peered":"2024-09-19T08:09:11.244277+0000","last_unstale":"2024-09-19T08:09:12.275007+0000","last_undegraded":"2024-09-19T08:09:12.275007+0000","last_fullsized":"2024-09-19T08:09:12.275007+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:33:34.050343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264206+0000","last_change":"2024-09-19T08:09:09.116735+0000","last_active":"2024-09-19T08:09:12.264206+0000","last_peered":"2024-09-19T08:09:12.264206+0000","last_clean":"2024-09-19T08:09:12.264206+0000","last_became_active":"2024-09-19T08:09:09.116356+0000","last_became_peered":"2024-09-19T08:09:09.116356+0000","last_unstale":"2024-09-19T08:09:12.264206+0000","last_undegraded":"2024-09-19T08:09:12.264206+0000","last_fullsized":"2024-09-19T08:09:12.264206+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:50.952567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259425+0000","last_change":"2024-09-19T08:09:09.113182+0000","last_active":"2024-09-19T08:09:12.259425+0000","last_peered":"2024-09-19T08:09:12.259425+0000","last_clean":"2024-09-19T08:09:12.259425+0000","last_became_active":"2024-09-19T08:09:09.112528+0000","last_became_peered":"2024-09-19T08:09:09.112528+0000","last_unstale":"2024-09-19T08:09:12.259425+0000","last_undegraded":"2024-09-19T08:09:12.259425+0000","last_fullsized":"2024-09-19T08:09:12.259425+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:07.647351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270502+0000","last_change":"2024-09-19T08:09:11.241639+0000","last_active":"2024-09-19T08:09:12.270502+0000","last_peered":"2024-09-19T08:09:12.270502+0000","last_clean":"2024-09-19T08:09:12.270502+0000","last_became_active":"2024-09-19T08:09:11.241308+0000","last_became_peered":"2024-09-19T08:09:11.241308+0000","last_unstale":"2024-09-19T08:09:12.270502+0000","last_undegraded":"2024-09-19T08:09:12.270502+0000","last_fullsized":"2024-09-19T08:09:12.270502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:57.826870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.276709+0000","last_change":"2024-09-19T08:09:09.118334+0000","last_active":"2024-09-19T08:09:12.276709+0000","last_peered":"2024-09-19T08:09:12.276709+0000","last_clean":"2024-09-19T08:09:12.276709+0000","last_became_active":"2024-09-19T08:09:09.118010+0000","last_became_peered":"2024-09-19T08:09:09.118010+0000","last_unstale":"2024-09-19T08:09:12.276709+0000","last_undegraded":"2024-09-19T08:09:12.276709+0000","last_fullsized":"2024-09-19T08:09:12.276709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:51.046598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272762+0000","last_change":"2024-09-19T08:09:11.239990+0000","last_active":"2024-09-19T08:09:12.272762+0000","last_peered":"2024-09-19T08:09:12.272762+0000","last_clean":"2024-09-19T08:09:12.272762+0000","last_became_active":"2024-09-19T08:09:11.239643+0000","last_became_peered":"2024-09-19T08:09:11.239643+0000","last_unstale":"2024-09-19T08:09:12.272762+0000","last_undegraded":"2024-09-19T08:09:12.272762+0000","last_fullsized":"2024-09-19T08:09:12.272762+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:07.078244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264539+0000","last_change":"2024-09-19T08:09:09.114397+0000","last_active":"2024-09-19T08:09:12.264539+0000","last_peered":"2024-09-19T08:09:12.264539+0000","last_clean":"2024-09-19T08:09:12.264539+0000","last_became_active":"2024-09-19T08:09:09.114051+0000","last_became_peered":"2024-09-19T08:09:09.114051+0000","last_unstale":"2024-09-19T08:09:12.264539+0000","last_undegraded":"2024-09-19T08:09:12.264539+0000","last_fullsized":"2024-09-19T08:09:12.264539+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:41.799442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270435+0000","last_change":"2024-09-19T08:09:11.254802+0000","last_active":"2024-09-19T08:09:12.270435+0000","last_peered":"2024-09-19T08:09:12.270435+0000","last_clean":"2024-09-19T08:09:12.270435+0000","last_became_active":"2024-09-19T08:09:11.253869+0000","last_became_peered":"2024-09-19T08:09:11.253869+0000","last_unstale":"2024-09-19T08:09:12.270435+0000","last_undegraded":"2024-09-19T08:09:12.270435+0000","last_fullsized":"2024-09-19T08:09:12.270435+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:00.164834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275404+0000","last_change":"2024-09-19T08:09:09.118585+0000","last_active":"2024-09-19T08:09:12.275404+0000","last_peered":"2024-09-19T08:09:12.275404+0000","last_clean":"2024-09-19T08:09:12.275404+0000","last_became_active":"2024-09-19T08:09:09.118216+0000","last_became_peered":"2024-09-19T08:09:09.118216+0000","last_unstale":"2024-09-19T08:09:12.275404+0000","last_undegraded":"2024-09-19T08:09:12.275404+0000","last_fullsized":"2024-09-19T08:09:12.275404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:41.905746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274037+0000","last_change":"2024-09-19T08:09:11.249835+0000","last_active":"2024-09-19T08:09:12.274037+0000","last_peered":"2024-09-19T08:09:12.274037+0000","last_clean":"2024-09-19T08:09:12.274037+0000","last_became_active":"2024-09-19T08:09:11.249443+0000","last_became_peered":"2024-09-19T08:09:11.249443+0000","last_unstale":"2024-09-19T08:09:12.274037+0000","last_undegraded":"2024-09-19T08:09:12.274037+0000","last_fullsized":"2024-09-19T08:09:12.274037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:06.373126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.279297+0000","last_change":"2024-09-19T08:09:09.242565+0000","last_active":"2024-09-19T08:09:12.279297+0000","last_peered":"2024-09-19T08:09:12.279297+0000","last_clean":"2024-09-19T08:09:12.279297+0000","last_became_active":"2024-09-19T08:09:09.242199+0000","last_became_peered":"2024-09-19T08:09:09.242199+0000","last_unstale":"2024-09-19T08:09:12.279297+0000","last_undegraded":"2024-09-19T08:09:12.279297+0000","last_fullsized":"2024-09-19T08:09:12.279297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:33.195385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270121+0000","last_change":"2024-09-19T08:09:11.251682+0000","last_active":"2024-09-19T08:09:12.270121+0000","last_peered":"2024-09-19T08:09:12.270121+0000","last_clean":"2024-09-19T08:09:12.270121+0000","last_became_active":"2024-09-19T08:09:11.251037+0000","last_became_peered":"2024-09-19T08:09:11.251037+0000","last_unstale":"2024-09-19T08:09:12.270121+0000","last_undegraded":"2024-09-19T08:09:12.270121+0000","last_fullsized":"2024-09-19T08:09:12.270121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:29.518828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:10:11.395079+0000","last_change":"2024-09-19T08:09:09.119090+0000","last_active":"2024-09-19T08:10:11.395079+0000","last_peered":"2024-09-19T08:10:11.395079+0000","last_clean":"2024-09-19T08:10:11.395079+0000","last_became_active":"2024-09-19T08:09:09.118685+0000","last_became_peered":"2024-09-19T08:09:09.118685+0000","last_unstale":"2024-09-19T08:10:11.395079+0000","last_undegraded":"2024-09-19T08:10:11.395079+0000","last_fullsized":"2024-09-19T08:10:11.395079+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:21.540404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62819,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":118,"num_write":27,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270801+0000","last_change":"2024-09-19T08:09:11.243200+0000","last_active":"2024-09-19T08:09:12.270801+0000","last_peered":"2024-09-19T08:09:12.270801+0000","last_clean":"2024-09-19T08:09:12.270801+0000","last_became_active":"2024-09-19T08:09:11.242873+0000","last_became_peered":"2024-09-19T08:09:11.242873+0000","last_unstale":"2024-09-19T08:09:12.270801+0000","last_undegraded":"2024-09-19T08:09:12.270801+0000","last_fullsized":"2024-09-19T08:09:12.270801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:35.817609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.278392+0000","last_change":"2024-09-19T08:09:09.117117+0000","last_active":"2024-09-19T08:09:12.278392+0000","last_peered":"2024-09-19T08:09:12.278392+0000","last_clean":"2024-09-19T08:09:12.278392+0000","last_became_active":"2024-09-19T08:09:09.116512+0000","last_became_peered":"2024-09-19T08:09:09.116512+0000","last_unstale":"2024-09-19T08:09:12.278392+0000","last_undegraded":"2024-09-19T08:09:12.278392+0000","last_fullsized":"2024-09-19T08:09:12.278392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:15.010570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259483+0000","last_change":"2024-09-19T08:09:11.246648+0000","last_active":"2024-09-19T08:09:12.259483+0000","last_peered":"2024-09-19T08:09:12.259483+0000","last_clean":"2024-09-19T08:09:12.259483+0000","last_became_active":"2024-09-19T08:09:11.246317+0000","last_became_peered":"2024-09-19T08:09:11.246317+0000","last_unstale":"2024-09-19T08:09:12.259483+0000","last_undegraded":"2024-09-19T08:09:12.259483+0000","last_fullsized":"2024-09-19T08:09:12.259483+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:43.285257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274579+0000","last_change":"2024-09-19T08:09:09.112599+0000","last_active":"2024-09-19T08:09:12.274579+0000","last_peered":"2024-09-19T08:09:12.274579+0000","last_clean":"2024-09-19T08:09:12.274579+0000","last_became_active":"2024-09-19T08:09:09.112281+0000","last_became_peered":"2024-09-19T08:09:09.112281+0000","last_unstale":"2024-09-19T08:09:12.274579+0000","last_undegraded":"2024-09-19T08:09:12.274579+0000","last_fullsized":"2024-09-19T08:09:12.274579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:47.710235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274905+0000","last_change":"2024-09-19T08:09:11.253814+0000","last_active":"2024-09-19T08:09:12.274905+0000","last_peered":"2024-09-19T08:09:12.274905+0000","last_clean":"2024-09-19T08:09:12.274905+0000","last_became_active":"2024-09-19T08:09:11.253490+0000","last_became_peered":"2024-09-19T08:09:11.253490+0000","last_unstale":"2024-09-19T08:09:12.274905+0000","last_undegraded":"2024-09-19T08:09:12.274905+0000","last_fullsized":"2024-09-19T08:09:12.274905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:09.287110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272943+0000","last_change":"2024-09-19T08:09:09.114820+0000","last_active":"2024-09-19T08:09:12.272943+0000","last_peered":"2024-09-19T08:09:12.272943+0000","last_clean":"2024-09-19T08:09:12.272943+0000","last_became_active":"2024-09-19T08:09:09.114478+0000","last_became_peered":"2024-09-19T08:09:09.114478+0000","last_unstale":"2024-09-19T08:09:12.272943+0000","last_undegraded":"2024-09-19T08:09:12.272943+0000","last_fullsized":"2024-09-19T08:09:12.272943+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:24.243629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274533+0000","last_change":"2024-09-19T08:09:11.249622+0000","last_active":"2024-09-19T08:09:12.274533+0000","last_peered":"2024-09-19T08:09:12.274533+0000","last_clean":"2024-09-19T08:09:12.274533+0000","last_became_active":"2024-09-19T08:09:11.249325+0000","last_became_peered":"2024-09-19T08:09:11.249325+0000","last_unstale":"2024-09-19T08:09:12.274533+0000","last_undegraded":"2024-09-19T08:09:12.274533+0000","last_fullsized":"2024-09-19T08:09:12.274533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:59.342715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.279583+0000","last_change":"2024-09-19T08:09:09.244136+0000","last_active":"2024-09-19T08:09:12.279583+0000","last_peered":"2024-09-19T08:09:12.279583+0000","last_clean":"2024-09-19T08:09:12.279583+0000","last_became_active":"2024-09-19T08:09:09.243776+0000","last_became_peered":"2024-09-19T08:09:09.243776+0000","last_unstale":"2024-09-19T08:09:12.279583+0000","last_undegraded":"2024-09-19T08:09:12.279583+0000","last_fullsized":"2024-09-19T08:09:12.279583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:01.711310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274220+0000","last_change":"2024-09-19T08:09:11.245399+0000","last_active":"2024-09-19T08:09:12.274220+0000","last_peered":"2024-09-19T08:09:12.274220+0000","last_clean":"2024-09-19T08:09:12.274220+0000","last_became_active":"2024-09-19T08:09:11.245055+0000","last_became_peered":"2024-09-19T08:09:11.245055+0000","last_unstale":"2024-09-19T08:09:12.274220+0000","last_undegraded":"2024-09-19T08:09:12.274220+0000","last_fullsized":"2024-09-19T08:09:12.274220+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:57.639205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275274+0000","last_change":"2024-09-19T08:09:09.115252+0000","last_active":"2024-09-19T08:09:12.275274+0000","last_peered":"2024-09-19T08:09:12.275274+0000","last_clean":"2024-09-19T08:09:12.275274+0000","last_became_active":"2024-09-19T08:09:09.114908+0000","last_became_peered":"2024-09-19T08:09:09.114908+0000","last_unstale":"2024-09-19T08:09:12.275274+0000","last_undegraded":"2024-09-19T08:09:12.275274+0000","last_fullsized":"2024-09-19T08:09:12.275274+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:48.326221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260384+0000","last_change":"2024-09-19T08:09:11.249189+0000","last_active":"2024-09-19T08:09:12.260384+0000","last_peered":"2024-09-19T08:09:12.260384+0000","last_clean":"2024-09-19T08:09:12.260384+0000","last_became_active":"2024-09-19T08:09:11.248797+0000","last_became_peered":"2024-09-19T08:09:11.248797+0000","last_unstale":"2024-09-19T08:09:12.260384+0000","last_undegraded":"2024-09-19T08:09:12.260384+0000","last_fullsized":"2024-09-19T08:09:12.260384+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:20.915638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270335+0000","last_change":"2024-09-19T08:09:09.112973+0000","last_active":"2024-09-19T08:09:12.270335+0000","last_peered":"2024-09-19T08:09:12.270335+0000","last_clean":"2024-09-19T08:09:12.270335+0000","last_became_active":"2024-09-19T08:09:09.112616+0000","last_became_peered":"2024-09-19T08:09:09.112616+0000","last_unstale":"2024-09-19T08:09:12.270335+0000","last_undegraded":"2024-09-19T08:09:12.270335+0000","last_fullsized":"2024-09-19T08:09:12.270335+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:13.791926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275124+0000","last_change":"2024-09-19T08:09:11.240739+0000","last_active":"2024-09-19T08:09:12.275124+0000","last_peered":"2024-09-19T08:09:12.275124+0000","last_clean":"2024-09-19T08:09:12.275124+0000","last_became_active":"2024-09-19T08:09:11.240340+0000","last_became_peered":"2024-09-19T08:09:11.240340+0000","last_unstale":"2024-09-19T08:09:12.275124+0000","last_undegraded":"2024-09-19T08:09:12.275124+0000","last_fullsized":"2024-09-19T08:09:12.275124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:35.450279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.279199+0000","last_change":"2024-09-19T08:09:09.112516+0000","last_active":"2024-09-19T08:09:12.279199+0000","last_peered":"2024-09-19T08:09:12.279199+0000","last_clean":"2024-09-19T08:09:12.279199+0000","last_became_active":"2024-09-19T08:09:09.112140+0000","last_became_peered":"2024-09-19T08:09:09.112140+0000","last_unstale":"2024-09-19T08:09:12.279199+0000","last_undegraded":"2024-09-19T08:09:12.279199+0000","last_fullsized":"2024-09-19T08:09:12.279199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:05.434331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274943+0000","last_change":"2024-09-19T08:09:11.252163+0000","last_active":"2024-09-19T08:09:12.274943+0000","last_peered":"2024-09-19T08:09:12.274943+0000","last_clean":"2024-09-19T08:09:12.274943+0000","last_became_active":"2024-09-19T08:09:11.251762+0000","last_became_peered":"2024-09-19T08:09:11.251762+0000","last_unstale":"2024-09-19T08:09:12.274943+0000","last_undegraded":"2024-09-19T08:09:12.274943+0000","last_fullsized":"2024-09-19T08:09:12.274943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:33.941910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270594+0000","last_change":"2024-09-19T08:09:09.243479+0000","last_active":"2024-09-19T08:09:12.270594+0000","last_peered":"2024-09-19T08:09:12.270594+0000","last_clean":"2024-09-19T08:09:12.270594+0000","last_became_active":"2024-09-19T08:09:09.243064+0000","last_became_peered":"2024-09-19T08:09:09.243064+0000","last_unstale":"2024-09-19T08:09:12.270594+0000","last_undegraded":"2024-09-19T08:09:12.270594+0000","last_fullsized":"2024-09-19T08:09:12.270594+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:58.965426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275301+0000","last_change":"2024-09-19T08:09:11.242438+0000","last_active":"2024-09-19T08:09:12.275301+0000","last_peered":"2024-09-19T08:09:12.275301+0000","last_clean":"2024-09-19T08:09:12.275301+0000","last_became_active":"2024-09-19T08:09:11.242114+0000","last_became_peered":"2024-09-19T08:09:11.242114+0000","last_unstale":"2024-09-19T08:09:12.275301+0000","last_undegraded":"2024-09-19T08:09:12.275301+0000","last_fullsized":"2024-09-19T08:09:12.275301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:54.183012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":341,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274753+0000","last_change":"2024-09-19T08:07:55.287566+0000","last_active":"2024-09-19T08:09:12.274753+0000","last_peered":"2024-09-19T08:09:12.274753+0000","last_clean":"2024-09-19T08:09:12.274753+0000","last_became_active":"2024-09-19T08:07:55.287037+0000","last_became_peered":"2024-09-19T08:07:55.287037+0000","last_unstale":"2024-09-19T08:09:12.274753+0000","last_undegraded":"2024-09-19T08:09:12.274753+0000","last_fullsized":"2024-09-19T08:09:12.274753+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_clean_scrub_stamp":"2024-09-19T08:04:29.468857+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:49.553882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273322+0000","last_change":"2024-09-19T08:09:09.113497+0000","last_active":"2024-09-19T08:09:12.273322+0000","last_peered":"2024-09-19T08:09:12.273322+0000","last_clean":"2024-09-19T08:09:12.273322+0000","last_became_active":"2024-09-19T08:09:09.112546+0000","last_became_peered":"2024-09-19T08:09:09.112546+0000","last_unstale":"2024-09-19T08:09:12.273322+0000","last_undegraded":"2024-09-19T08:09:12.273322+0000","last_fullsized":"2024-09-19T08:09:12.273322+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:09.906476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269847+0000","last_change":"2024-09-19T08:09:11.241478+0000","last_active":"2024-09-19T08:09:12.269847+0000","last_peered":"2024-09-19T08:09:12.269847+0000","last_clean":"2024-09-19T08:09:12.269847+0000","last_became_active":"2024-09-19T08:09:11.241138+0000","last_became_peered":"2024-09-19T08:09:11.241138+0000","last_unstale":"2024-09-19T08:09:12.269847+0000","last_undegraded":"2024-09-19T08:09:12.269847+0000","last_fullsized":"2024-09-19T08:09:12.269847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:32.884491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274978+0000","last_change":"2024-09-19T08:09:09.116571+0000","last_active":"2024-09-19T08:09:12.274978+0000","last_peered":"2024-09-19T08:09:12.274978+0000","last_clean":"2024-09-19T08:09:12.274978+0000","last_became_active":"2024-09-19T08:09:09.116180+0000","last_became_peered":"2024-09-19T08:09:09.116180+0000","last_unstale":"2024-09-19T08:09:12.274978+0000","last_undegraded":"2024-09-19T08:09:12.274978+0000","last_fullsized":"2024-09-19T08:09:12.274978+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:58.577320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259671+0000","last_change":"2024-09-19T08:09:11.254088+0000","last_active":"2024-09-19T08:09:12.259671+0000","last_peered":"2024-09-19T08:09:12.259671+0000","last_clean":"2024-09-19T08:09:12.259671+0000","last_became_active":"2024-09-19T08:09:11.253795+0000","last_became_peered":"2024-09-19T08:09:11.253795+0000","last_unstale":"2024-09-19T08:09:12.259671+0000","last_undegraded":"2024-09-19T08:09:12.259671+0000","last_fullsized":"2024-09-19T08:09:12.259671+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:30.528506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259700+0000","last_change":"2024-09-19T08:09:09.242166+0000","last_active":"2024-09-19T08:09:12.259700+0000","last_peered":"2024-09-19T08:09:12.259700+0000","last_clean":"2024-09-19T08:09:12.259700+0000","last_became_active":"2024-09-19T08:09:09.241270+0000","last_became_peered":"2024-09-19T08:09:09.241270+0000","last_unstale":"2024-09-19T08:09:12.259700+0000","last_undegraded":"2024-09-19T08:09:12.259700+0000","last_fullsized":"2024-09-19T08:09:12.259700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:51.899069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.276508+0000","last_change":"2024-09-19T08:09:11.253778+0000","last_active":"2024-09-19T08:09:12.276508+0000","last_peered":"2024-09-19T08:09:12.276508+0000","last_clean":"2024-09-19T08:09:12.276508+0000","last_became_active":"2024-09-19T08:09:11.252219+0000","last_became_peered":"2024-09-19T08:09:11.252219+0000","last_unstale":"2024-09-19T08:09:12.276508+0000","last_undegraded":"2024-09-19T08:09:12.276508+0000","last_fullsized":"2024-09-19T08:09:12.276508+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:07.205504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275248+0000","last_change":"2024-09-19T08:09:09.118790+0000","last_active":"2024-09-19T08:09:12.275248+0000","last_peered":"2024-09-19T08:09:12.275248+0000","last_clean":"2024-09-19T08:09:12.275248+0000","last_became_active":"2024-09-19T08:09:09.117695+0000","last_became_peered":"2024-09-19T08:09:09.117695+0000","last_unstale":"2024-09-19T08:09:12.275248+0000","last_undegraded":"2024-09-19T08:09:12.275248+0000","last_fullsized":"2024-09-19T08:09:12.275248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:40.674039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264264+0000","last_change":"2024-09-19T08:09:11.249386+0000","last_active":"2024-09-19T08:09:12.264264+0000","last_peered":"2024-09-19T08:09:12.264264+0000","last_clean":"2024-09-19T08:09:12.264264+0000","last_became_active":"2024-09-19T08:09:11.249004+0000","last_became_peered":"2024-09-19T08:09:11.249004+0000","last_unstale":"2024-09-19T08:09:12.264264+0000","last_undegraded":"2024-09-19T08:09:12.264264+0000","last_fullsized":"2024-09-19T08:09:12.264264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:50.170799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272215+0000","last_change":"2024-09-19T08:09:09.241599+0000","last_active":"2024-09-19T08:09:12.272215+0000","last_peered":"2024-09-19T08:09:12.272215+0000","last_clean":"2024-09-19T08:09:12.272215+0000","last_became_active":"2024-09-19T08:09:09.241226+0000","last_became_peered":"2024-09-19T08:09:09.241226+0000","last_unstale":"2024-09-19T08:09:12.272215+0000","last_undegraded":"2024-09-19T08:09:12.272215+0000","last_fullsized":"2024-09-19T08:09:12.272215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:19.590966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264496+0000","last_change":"2024-09-19T08:09:11.238098+0000","last_active":"2024-09-19T08:09:12.264496+0000","last_peered":"2024-09-19T08:09:12.264496+0000","last_clean":"2024-09-19T08:09:12.264496+0000","last_became_active":"2024-09-19T08:09:11.237737+0000","last_became_peered":"2024-09-19T08:09:11.237737+0000","last_unstale":"2024-09-19T08:09:12.264496+0000","last_undegraded":"2024-09-19T08:09:12.264496+0000","last_fullsized":"2024-09-19T08:09:12.264496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:00.134664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272482+0000","last_change":"2024-09-19T08:09:09.241775+0000","last_active":"2024-09-19T08:09:12.272482+0000","last_peered":"2024-09-19T08:09:12.272482+0000","last_clean":"2024-09-19T08:09:12.272482+0000","last_became_active":"2024-09-19T08:09:09.241367+0000","last_became_peered":"2024-09-19T08:09:09.241367+0000","last_unstale":"2024-09-19T08:09:12.272482+0000","last_undegraded":"2024-09-19T08:09:12.272482+0000","last_fullsized":"2024-09-19T08:09:12.272482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:11.862171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259714+0000","last_change":"2024-09-19T08:09:11.251980+0000","last_active":"2024-09-19T08:09:12.259714+0000","last_peered":"2024-09-19T08:09:12.259714+0000","last_clean":"2024-09-19T08:09:12.259714+0000","last_became_active":"2024-09-19T08:09:11.251638+0000","last_became_peered":"2024-09-19T08:09:11.251638+0000","last_unstale":"2024-09-19T08:09:12.259714+0000","last_undegraded":"2024-09-19T08:09:12.259714+0000","last_fullsized":"2024-09-19T08:09:12.259714+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:35.905643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'8","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:34.279466+0000","last_change":"2024-09-19T08:09:09.117150+0000","last_active":"2024-09-19T08:09:34.279466+0000","last_peered":"2024-09-19T08:09:34.279466+0000","last_clean":"2024-09-19T08:09:34.279466+0000","last_became_active":"2024-09-19T08:09:09.116763+0000","last_became_peered":"2024-09-19T08:09:09.116763+0000","last_unstale":"2024-09-19T08:09:34.279466+0000","last_undegraded":"2024-09-19T08:09:34.279466+0000","last_fullsized":"2024-09-19T08:09:34.279466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:18.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270016+0000","last_change":"2024-09-19T08:09:11.244366+0000","last_active":"2024-09-19T08:09:12.270016+0000","last_peered":"2024-09-19T08:09:12.270016+0000","last_clean":"2024-09-19T08:09:12.270016+0000","last_became_active":"2024-09-19T08:09:11.244023+0000","last_became_peered":"2024-09-19T08:09:11.244023+0000","last_unstale":"2024-09-19T08:09:12.270016+0000","last_undegraded":"2024-09-19T08:09:12.270016+0000","last_fullsized":"2024-09-19T08:09:12.270016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:18.572377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275535+0000","last_change":"2024-09-19T08:09:09.139557+0000","last_active":"2024-09-19T08:09:12.275535+0000","last_peered":"2024-09-19T08:09:12.275535+0000","last_clean":"2024-09-19T08:09:12.275535+0000","last_became_active":"2024-09-19T08:09:09.139190+0000","last_became_peered":"2024-09-19T08:09:09.139190+0000","last_unstale":"2024-09-19T08:09:12.275535+0000","last_undegraded":"2024-09-19T08:09:12.275535+0000","last_fullsized":"2024-09-19T08:09:12.275535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:39.270432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273816+0000","last_change":"2024-09-19T08:09:11.249637+0000","last_active":"2024-09-19T08:09:12.273816+0000","last_peered":"2024-09-19T08:09:12.273816+0000","last_clean":"2024-09-19T08:09:12.273816+0000","last_became_active":"2024-09-19T08:09:11.249323+0000","last_became_peered":"2024-09-19T08:09:11.249323+0000","last_unstale":"2024-09-19T08:09:12.273816+0000","last_undegraded":"2024-09-19T08:09:12.273816+0000","last_fullsized":"2024-09-19T08:09:12.273816+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:28.270910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270693+0000","last_change":"2024-09-19T08:09:09.242444+0000","last_active":"2024-09-19T08:09:12.270693+0000","last_peered":"2024-09-19T08:09:12.270693+0000","last_clean":"2024-09-19T08:09:12.270693+0000","last_became_active":"2024-09-19T08:09:09.242095+0000","last_became_peered":"2024-09-19T08:09:09.242095+0000","last_unstale":"2024-09-19T08:09:12.270693+0000","last_undegraded":"2024-09-19T08:09:12.270693+0000","last_fullsized":"2024-09-19T08:09:12.270693+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:42.941930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269950+0000","last_change":"2024-09-19T08:09:11.241588+0000","last_active":"2024-09-19T08:09:12.269950+0000","last_peered":"2024-09-19T08:09:12.269950+0000","last_clean":"2024-09-19T08:09:12.269950+0000","last_became_active":"2024-09-19T08:09:11.241076+0000","last_became_peered":"2024-09-19T08:09:11.241076+0000","last_unstale":"2024-09-19T08:09:12.269950+0000","last_undegraded":"2024-09-19T08:09:12.269950+0000","last_fullsized":"2024-09-19T08:09:12.269950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:01.676410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269706+0000","last_change":"2024-09-19T08:09:09.112494+0000","last_active":"2024-09-19T08:09:12.269706+0000","last_peered":"2024-09-19T08:09:12.269706+0000","last_clean":"2024-09-19T08:09:12.269706+0000","last_became_active":"2024-09-19T08:09:09.112019+0000","last_became_peered":"2024-09-19T08:09:09.112019+0000","last_unstale":"2024-09-19T08:09:12.269706+0000","last_undegraded":"2024-09-19T08:09:12.269706+0000","last_fullsized":"2024-09-19T08:09:12.269706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:17.674092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260305+0000","last_change":"2024-09-19T08:09:11.251420+0000","last_active":"2024-09-19T08:09:12.260305+0000","last_peered":"2024-09-19T08:09:12.260305+0000","last_clean":"2024-09-19T08:09:12.260305+0000","last_became_active":"2024-09-19T08:09:11.251083+0000","last_became_peered":"2024-09-19T08:09:11.251083+0000","last_unstale":"2024-09-19T08:09:12.260305+0000","last_undegraded":"2024-09-19T08:09:12.260305+0000","last_fullsized":"2024-09-19T08:09:12.260305+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:38.810616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272113+0000","last_change":"2024-09-19T08:09:09.117705+0000","last_active":"2024-09-19T08:09:12.272113+0000","last_peered":"2024-09-19T08:09:12.272113+0000","last_clean":"2024-09-19T08:09:12.272113+0000","last_became_active":"2024-09-19T08:09:09.117367+0000","last_became_peered":"2024-09-19T08:09:09.117367+0000","last_unstale":"2024-09-19T08:09:12.272113+0000","last_undegraded":"2024-09-19T08:09:12.272113+0000","last_fullsized":"2024-09-19T08:09:12.272113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:21.256227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269858+0000","last_change":"2024-09-19T08:09:11.239096+0000","last_active":"2024-09-19T08:09:12.269858+0000","last_peered":"2024-09-19T08:09:12.269858+0000","last_clean":"2024-09-19T08:09:12.269858+0000","last_became_active":"2024-09-19T08:09:11.238739+0000","last_became_peered":"2024-09-19T08:09:11.238739+0000","last_unstale":"2024-09-19T08:09:12.269858+0000","last_undegraded":"2024-09-19T08:09:12.269858+0000","last_fullsized":"2024-09-19T08:09:12.269858+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:27.161174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.279086+0000","last_change":"2024-09-19T08:09:09.115198+0000","last_active":"2024-09-19T08:09:12.279086+0000","last_peered":"2024-09-19T08:09:12.279086+0000","last_clean":"2024-09-19T08:09:12.279086+0000","last_became_active":"2024-09-19T08:09:09.114783+0000","last_became_peered":"2024-09-19T08:09:09.114783+0000","last_unstale":"2024-09-19T08:09:12.279086+0000","last_undegraded":"2024-09-19T08:09:12.279086+0000","last_fullsized":"2024-09-19T08:09:12.279086+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:45.674774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274921+0000","last_change":"2024-09-19T08:09:11.252450+0000","last_active":"2024-09-19T08:09:12.274921+0000","last_peered":"2024-09-19T08:09:12.274921+0000","last_clean":"2024-09-19T08:09:12.274921+0000","last_became_active":"2024-09-19T08:09:11.251696+0000","last_became_peered":"2024-09-19T08:09:11.251696+0000","last_unstale":"2024-09-19T08:09:12.274921+0000","last_undegraded":"2024-09-19T08:09:12.274921+0000","last_fullsized":"2024-09-19T08:09:12.274921+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:48.179795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.276254+0000","last_change":"2024-09-19T08:09:11.244571+0000","last_active":"2024-09-19T08:09:12.276254+0000","last_peered":"2024-09-19T08:09:12.276254+0000","last_clean":"2024-09-19T08:09:12.276254+0000","last_became_active":"2024-09-19T08:09:11.244217+0000","last_became_peered":"2024-09-19T08:09:11.244217+0000","last_unstale":"2024-09-19T08:09:12.276254+0000","last_undegraded":"2024-09-19T08:09:12.276254+0000","last_fullsized":"2024-09-19T08:09:12.276254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:52.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275687+0000","last_change":"2024-09-19T08:09:09.117355+0000","last_active":"2024-09-19T08:09:12.275687+0000","last_peered":"2024-09-19T08:09:12.275687+0000","last_clean":"2024-09-19T08:09:12.275687+0000","last_became_active":"2024-09-19T08:09:09.116806+0000","last_became_peered":"2024-09-19T08:09:09.116806+0000","last_unstale":"2024-09-19T08:09:12.275687+0000","last_undegraded":"2024-09-19T08:09:12.275687+0000","last_fullsized":"2024-09-19T08:09:12.275687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:42.113015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269943+0000","last_change":"2024-09-19T08:09:11.245745+0000","last_active":"2024-09-19T08:09:12.269943+0000","last_peered":"2024-09-19T08:09:12.269943+0000","last_clean":"2024-09-19T08:09:12.269943+0000","last_became_active":"2024-09-19T08:09:11.245373+0000","last_became_peered":"2024-09-19T08:09:11.245373+0000","last_unstale":"2024-09-19T08:09:12.269943+0000","last_undegraded":"2024-09-19T08:09:12.269943+0000","last_fullsized":"2024-09-19T08:09:12.269943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:56.500738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.278897+0000","last_change":"2024-09-19T08:09:09.119550+0000","last_active":"2024-09-19T08:09:12.278897+0000","last_peered":"2024-09-19T08:09:12.278897+0000","last_clean":"2024-09-19T08:09:12.278897+0000","last_became_active":"2024-09-19T08:09:09.119187+0000","last_became_peered":"2024-09-19T08:09:09.119187+0000","last_unstale":"2024-09-19T08:09:12.278897+0000","last_undegraded":"2024-09-19T08:09:12.278897+0000","last_fullsized":"2024-09-19T08:09:12.278897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:14.629824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274031+0000","last_change":"2024-09-19T08:09:11.245318+0000","last_active":"2024-09-19T08:09:12.274031+0000","last_peered":"2024-09-19T08:09:12.274031+0000","last_clean":"2024-09-19T08:09:12.274031+0000","last_became_active":"2024-09-19T08:09:11.245000+0000","last_became_peered":"2024-09-19T08:09:11.245000+0000","last_unstale":"2024-09-19T08:09:12.274031+0000","last_undegraded":"2024-09-19T08:09:12.274031+0000","last_fullsized":"2024-09-19T08:09:12.274031+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:53.590453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270460+0000","last_change":"2024-09-19T08:09:09.241552+0000","last_active":"2024-09-19T08:09:12.270460+0000","last_peered":"2024-09-19T08:09:12.270460+0000","last_clean":"2024-09-19T08:09:12.270460+0000","last_became_active":"2024-09-19T08:09:09.241201+0000","last_became_peered":"2024-09-19T08:09:09.241201+0000","last_unstale":"2024-09-19T08:09:12.270460+0000","last_undegraded":"2024-09-19T08:09:12.270460+0000","last_fullsized":"2024-09-19T08:09:12.270460+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:09.374532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270213+0000","last_change":"2024-09-19T08:09:11.246697+0000","last_active":"2024-09-19T08:09:12.270213+0000","last_peered":"2024-09-19T08:09:12.270213+0000","last_clean":"2024-09-19T08:09:12.270213+0000","last_became_active":"2024-09-19T08:09:11.246404+0000","last_became_peered":"2024-09-19T08:09:11.246404+0000","last_unstale":"2024-09-19T08:09:12.270213+0000","last_undegraded":"2024-09-19T08:09:12.270213+0000","last_fullsized":"2024-09-19T08:09:12.270213+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.008875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.278644+0000","last_change":"2024-09-19T08:09:09.113401+0000","last_active":"2024-09-19T08:09:12.278644+0000","last_peered":"2024-09-19T08:09:12.278644+0000","last_clean":"2024-09-19T08:09:12.278644+0000","last_became_active":"2024-09-19T08:09:09.113026+0000","last_became_peered":"2024-09-19T08:09:09.113026+0000","last_unstale":"2024-09-19T08:09:12.278644+0000","last_undegraded":"2024-09-19T08:09:12.278644+0000","last_fullsized":"2024-09-19T08:09:12.278644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:54.740955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63617,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":120,"num_read_kb":124,"num_write":81,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":67,"ondisk_log_size":67,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281686,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547227,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":868352,"data_stored":419022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776159,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":1072520,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939685,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":419604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168617,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":876544,"data_stored":419626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397550,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":1010089,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561075,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":419139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790008,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":1009689,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953534,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":872448,"data_stored":419044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182467,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":419360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":481875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":481841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":872448,"data_stored":419112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:10:14.799 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:10:15.058 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:15.179 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:14 smithi027 ceph-mon[31209]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:15.180 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T08:10:15.180 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-19T08:10:15.180 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-19T08:10:15.180 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-19T08:10:15.180 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-19T08:10:15.180 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-19T08:10:15.180 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-19T08:10:15.180 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:14 smithi027 ceph-mon[31209]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T08:10:15.180 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:15.180 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:15.180 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:10:15.180 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:10:15.181 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:14 smithi027 ceph-mon[31209]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:15.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:14 smithi155 ceph-mon[35362]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:15.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T08:10:15.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-19T08:10:15.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-19T08:10:15.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-19T08:10:15.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-19T08:10:15.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-19T08:10:15.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-19T08:10:15.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:14 smithi155 ceph-mon[35362]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T08:10:15.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:15.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:15.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:10:15.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:10:15.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:14 smithi155 ceph-mon[35362]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:15.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:14 smithi203 ceph-mon[35198]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:15.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T08:10:15.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-19T08:10:15.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-19T08:10:15.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-19T08:10:15.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-19T08:10:15.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-19T08:10:15.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-19T08:10:15.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:14 smithi203 ceph-mon[35198]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T08:10:15.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:15.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:15.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:10:15.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:10:15.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:14 smithi203 ceph-mon[35198]: from='mgr.14150 172.21.15.27:0/2097266783' entity='mgr.x' 2024-09-19T08:10:15.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.583+0000 7f3d9b015640 1 -- 172.21.15.27:0/1482992527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d94101430 msgr2=0x7f3d9410d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:15.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.583+0000 7f3d9b015640 1 --2- 172.21.15.27:0/1482992527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d94101430 0x7f3d9410d960 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c009cd0 tx=0x7f3d8c02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:10:15.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.583+0000 7f3d9b015640 1 -- 172.21.15.27:0/1482992527 shutdown_connections 2024-09-19T08:10:15.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.583+0000 7f3d9b015640 1 --2- 172.21.15.27:0/1482992527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d94101430 0x7f3d9410d960 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:15.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.583+0000 7f3d9b015640 1 --2- 172.21.15.27:0/1482992527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d94100a90 0x7f3d94100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:15.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.583+0000 7f3d9b015640 1 --2- 172.21.15.27:0/1482992527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d94106a90 0x7f3d94106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:15.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.583+0000 7f3d9b015640 1 -- 172.21.15.27:0/1482992527 >> 172.21.15.27:0/1482992527 conn(0x7f3d940fc7d0 msgr2=0x7f3d940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:15.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.583+0000 7f3d9b015640 1 -- 172.21.15.27:0/1482992527 shutdown_connections 2024-09-19T08:10:15.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.583+0000 7f3d9b015640 1 -- 172.21.15.27:0/1482992527 wait complete. 2024-09-19T08:10:15.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.584+0000 7f3d9b015640 1 Processor -- start 2024-09-19T08:10:15.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.584+0000 7f3d9b015640 1 -- start start 2024-09-19T08:10:15.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.584+0000 7f3d9b015640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d94100a90 0x7f3d94197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:15.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.584+0000 7f3d9b015640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d94101430 0x7f3d941977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:15.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.584+0000 7f3d9b015640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d94106a90 0x7f3d9419bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:15.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.584+0000 7f3d9b015640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3d94110e90 con 0x7f3d94101430 2024-09-19T08:10:15.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.584+0000 7f3d9b015640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3d94110d10 con 0x7f3d94106a90 2024-09-19T08:10:15.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.584+0000 7f3d9b015640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3d94111010 con 0x7f3d94100a90 2024-09-19T08:10:15.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.584+0000 7f3d93fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d94101430 0x7f3d941977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:15.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.584+0000 7f3d93fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d94101430 0x7f3d941977d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35548/0 (socket says 172.21.15.27:35548) 2024-09-19T08:10:15.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.584+0000 7f3d93fff640 1 -- 172.21.15.27:0/2955396234 learned_addr learned my addr 172.21.15.27:0/2955396234 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:15.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.584+0000 7f3d98db1640 1 --2- 172.21.15.27:0/2955396234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d94100a90 0x7f3d94197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:15.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.585+0000 7f3d995b2640 1 --2- 172.21.15.27:0/2955396234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d94106a90 0x7f3d9419bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:15.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.585+0000 7f3d93fff640 1 -- 172.21.15.27:0/2955396234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d94100a90 msgr2=0x7f3d94197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:15.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.585+0000 7f3d93fff640 1 --2- 172.21.15.27:0/2955396234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d94100a90 0x7f3d94197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:15.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.585+0000 7f3d93fff640 1 -- 172.21.15.27:0/2955396234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d94106a90 msgr2=0x7f3d9419bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:15.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.585+0000 7f3d93fff640 1 --2- 172.21.15.27:0/2955396234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d94106a90 0x7f3d9419bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:15.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.585+0000 7f3d93fff640 1 -- 172.21.15.27:0/2955396234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d9419c240 con 0x7f3d94101430 2024-09-19T08:10:15.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.585+0000 7f3d995b2640 1 --2- 172.21.15.27:0/2955396234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d94106a90 0x7f3d9419bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:10:15.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.585+0000 7f3d93fff640 1 --2- 172.21.15.27:0/2955396234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d94101430 0x7f3d941977d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3d8000c970 tx=0x7f3d8000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:15.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.585+0000 7f3d91ffb640 1 -- 172.21.15.27:0/2955396234 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d80007bb0 con 0x7f3d94101430 2024-09-19T08:10:15.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.585+0000 7f3d91ffb640 1 -- 172.21.15.27:0/2955396234 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d80007d50 con 0x7f3d94101430 2024-09-19T08:10:15.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.585+0000 7f3d9b015640 1 -- 172.21.15.27:0/2955396234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d9419c530 con 0x7f3d94101430 2024-09-19T08:10:15.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.585+0000 7f3d91ffb640 1 -- 172.21.15.27:0/2955396234 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8000f450 con 0x7f3d94101430 2024-09-19T08:10:15.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.585+0000 7f3d9b015640 1 -- 172.21.15.27:0/2955396234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d941a3e10 con 0x7f3d94101430 2024-09-19T08:10:15.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.586+0000 7f3d9b015640 1 -- 172.21.15.27:0/2955396234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d94100ef0 con 0x7f3d94101430 2024-09-19T08:10:15.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.587+0000 7f3d91ffb640 1 -- 172.21.15.27:0/2955396234 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3d80004f40 con 0x7f3d94101430 2024-09-19T08:10:15.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.588+0000 7f3d91ffb640 1 --2- 172.21.15.27:0/2955396234 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f3d840a3350 0x7f3d840a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:15.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.588+0000 7f3d98db1640 1 --2- 172.21.15.27:0/2955396234 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f3d840a3350 0x7f3d840a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:15.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.588+0000 7f3d91ffb640 1 -- 172.21.15.27:0/2955396234 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f3d800cf770 con 0x7f3d94101430 2024-09-19T08:10:15.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.588+0000 7f3d98db1640 1 --2- 172.21.15.27:0/2955396234 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f3d840a3350 0x7f3d840a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800ab60 tx=0x7f3d8800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:15.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.592+0000 7f3d91ffb640 1 -- 172.21.15.27:0/2955396234 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3d80014030 con 0x7f3d94101430 2024-09-19T08:10:15.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.767+0000 7f3d9b015640 1 -- 172.21.15.27:0/2955396234 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3d940fd4c0 con 0x7f3d840a3350 2024-09-19T08:10:15.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.773+0000 7f3d91ffb640 1 -- 172.21.15.27:0/2955396234 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258776 (secure 0 0 0) 0x7f3d940fd4c0 con 0x7f3d840a3350 2024-09-19T08:10:15.775 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:10:15.776 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-09-19T08:10:15.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.776+0000 7f3d9b015640 1 -- 172.21.15.27:0/2955396234 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f3d840a3350 msgr2=0x7f3d840a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:15.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.776+0000 7f3d9b015640 1 --2- 172.21.15.27:0/2955396234 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f3d840a3350 0x7f3d840a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800ab60 tx=0x7f3d8800a2d0 comp rx=0 tx=0).stop 2024-09-19T08:10:15.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.776+0000 7f3d9b015640 1 -- 172.21.15.27:0/2955396234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d94101430 msgr2=0x7f3d941977d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:15.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.776+0000 7f3d9b015640 1 --2- 172.21.15.27:0/2955396234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d94101430 0x7f3d941977d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3d8000c970 tx=0x7f3d8000cd70 comp rx=0 tx=0).stop 2024-09-19T08:10:15.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.776+0000 7f3d9b015640 1 -- 172.21.15.27:0/2955396234 shutdown_connections 2024-09-19T08:10:15.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.776+0000 7f3d9b015640 1 --2- 172.21.15.27:0/2955396234 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f3d840a3350 0x7f3d840a5810 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:15.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.776+0000 7f3d9b015640 1 --2- 172.21.15.27:0/2955396234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d94106a90 0x7f3d9419bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:15.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.776+0000 7f3d9b015640 1 --2- 172.21.15.27:0/2955396234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d94101430 0x7f3d941977d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:15.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.776+0000 7f3d9b015640 1 --2- 172.21.15.27:0/2955396234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d94100a90 0x7f3d94197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:15.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.776+0000 7f3d9b015640 1 -- 172.21.15.27:0/2955396234 >> 172.21.15.27:0/2955396234 conn(0x7f3d940fc7d0 msgr2=0x7f3d940fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:15.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.776+0000 7f3d9b015640 1 -- 172.21.15.27:0/2955396234 shutdown_connections 2024-09-19T08:10:15.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:15.776+0000 7f3d9b015640 1 -- 172.21.15.27:0/2955396234 wait complete. 2024-09-19T08:10:16.147 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:15 smithi027 ceph-mon[31209]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:10:16.147 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:15 smithi027 ceph-mon[31209]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T08:10:16.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:15 smithi155 ceph-mon[35362]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:10:16.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:15 smithi155 ceph-mon[35362]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T08:10:16.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:15 smithi203 ceph-mon[35198]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:10:16.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:15 smithi203 ceph-mon[35198]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T08:10:16.485 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2024-09-19T08:10:14.932027+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654219,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":256,"num_read_kb":243,"num_write":264,"num_write_kb":3026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355748,"kb_used_data":10644,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124586076,"statfs":{"total":1151940427776,"available":1151576141824,"internally_reserved":0,"allocated":10899456,"data_stored":7008091,"data_compressed":107475,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001705"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260466+0000","last_change":"2024-09-19T08:09:11.246436+0000","last_active":"2024-09-19T08:09:12.260466+0000","last_peered":"2024-09-19T08:09:12.260466+0000","last_clean":"2024-09-19T08:09:12.260466+0000","last_became_active":"2024-09-19T08:09:11.245674+0000","last_became_peered":"2024-09-19T08:09:11.245674+0000","last_unstale":"2024-09-19T08:09:12.260466+0000","last_undegraded":"2024-09-19T08:09:12.260466+0000","last_fullsized":"2024-09-19T08:09:12.260466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:46.716474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273550+0000","last_change":"2024-09-19T08:09:11.243334+0000","last_active":"2024-09-19T08:09:12.273550+0000","last_peered":"2024-09-19T08:09:12.273550+0000","last_clean":"2024-09-19T08:09:12.273550+0000","last_became_active":"2024-09-19T08:09:11.243024+0000","last_became_peered":"2024-09-19T08:09:11.243024+0000","last_unstale":"2024-09-19T08:09:12.273550+0000","last_undegraded":"2024-09-19T08:09:12.273550+0000","last_fullsized":"2024-09-19T08:09:12.273550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.060068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273553+0000","last_change":"2024-09-19T08:09:11.254655+0000","last_active":"2024-09-19T08:09:12.273553+0000","last_peered":"2024-09-19T08:09:12.273553+0000","last_clean":"2024-09-19T08:09:12.273553+0000","last_became_active":"2024-09-19T08:09:11.254292+0000","last_became_peered":"2024-09-19T08:09:11.254292+0000","last_unstale":"2024-09-19T08:09:12.273553+0000","last_undegraded":"2024-09-19T08:09:12.273553+0000","last_fullsized":"2024-09-19T08:09:12.273553+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:01.977743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.785712+0000","last_change":"2024-09-19T08:09:11.257029+0000","last_active":"2024-09-19T08:10:14.785712+0000","last_peered":"2024-09-19T08:10:14.785712+0000","last_clean":"2024-09-19T08:10:14.785712+0000","last_became_active":"2024-09-19T08:09:11.256669+0000","last_became_peered":"2024-09-19T08:09:11.256669+0000","last_unstale":"2024-09-19T08:10:14.785712+0000","last_undegraded":"2024-09-19T08:10:14.785712+0000","last_fullsized":"2024-09-19T08:10:14.785712+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:32.831036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270384+0000","last_change":"2024-09-19T08:09:11.240341+0000","last_active":"2024-09-19T08:09:12.270384+0000","last_peered":"2024-09-19T08:09:12.270384+0000","last_clean":"2024-09-19T08:09:12.270384+0000","last_became_active":"2024-09-19T08:09:11.239996+0000","last_became_peered":"2024-09-19T08:09:11.239996+0000","last_unstale":"2024-09-19T08:09:12.270384+0000","last_undegraded":"2024-09-19T08:09:12.270384+0000","last_fullsized":"2024-09-19T08:09:12.270384+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:20.331791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264127+0000","last_change":"2024-09-19T08:09:11.248089+0000","last_active":"2024-09-19T08:09:12.264127+0000","last_peered":"2024-09-19T08:09:12.264127+0000","last_clean":"2024-09-19T08:09:12.264127+0000","last_became_active":"2024-09-19T08:09:11.247802+0000","last_became_peered":"2024-09-19T08:09:11.247802+0000","last_unstale":"2024-09-19T08:09:12.264127+0000","last_undegraded":"2024-09-19T08:09:12.264127+0000","last_fullsized":"2024-09-19T08:09:12.264127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.249119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274640+0000","last_change":"2024-09-19T08:09:11.246853+0000","last_active":"2024-09-19T08:09:12.274640+0000","last_peered":"2024-09-19T08:09:12.274640+0000","last_clean":"2024-09-19T08:09:12.274640+0000","last_became_active":"2024-09-19T08:09:11.246523+0000","last_became_peered":"2024-09-19T08:09:11.246523+0000","last_unstale":"2024-09-19T08:09:12.274640+0000","last_undegraded":"2024-09-19T08:09:12.274640+0000","last_fullsized":"2024-09-19T08:09:12.274640+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:54.879087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787158+0000","last_change":"2024-09-19T08:09:11.232588+0000","last_active":"2024-09-19T08:10:13.787158+0000","last_peered":"2024-09-19T08:10:13.787158+0000","last_clean":"2024-09-19T08:10:13.787158+0000","last_became_active":"2024-09-19T08:09:11.232251+0000","last_became_peered":"2024-09-19T08:09:11.232251+0000","last_unstale":"2024-09-19T08:10:13.787158+0000","last_undegraded":"2024-09-19T08:10:13.787158+0000","last_fullsized":"2024-09-19T08:10:13.787158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:57.622086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270505+0000","last_change":"2024-09-19T08:09:11.248854+0000","last_active":"2024-09-19T08:09:12.270505+0000","last_peered":"2024-09-19T08:09:12.270505+0000","last_clean":"2024-09-19T08:09:12.270505+0000","last_became_active":"2024-09-19T08:09:11.248524+0000","last_became_peered":"2024-09-19T08:09:11.248524+0000","last_unstale":"2024-09-19T08:09:12.270505+0000","last_undegraded":"2024-09-19T08:09:12.270505+0000","last_fullsized":"2024-09-19T08:09:12.270505+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:57.978974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264615+0000","last_change":"2024-09-19T08:09:11.247407+0000","last_active":"2024-09-19T08:09:12.264615+0000","last_peered":"2024-09-19T08:09:12.264615+0000","last_clean":"2024-09-19T08:09:12.264615+0000","last_became_active":"2024-09-19T08:09:11.247093+0000","last_became_peered":"2024-09-19T08:09:11.247093+0000","last_unstale":"2024-09-19T08:09:12.264615+0000","last_undegraded":"2024-09-19T08:09:12.264615+0000","last_fullsized":"2024-09-19T08:09:12.264615+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:25.959852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275097+0000","last_change":"2024-09-19T08:09:11.247604+0000","last_active":"2024-09-19T08:09:12.275097+0000","last_peered":"2024-09-19T08:09:12.275097+0000","last_clean":"2024-09-19T08:09:12.275097+0000","last_became_active":"2024-09-19T08:09:11.247264+0000","last_became_peered":"2024-09-19T08:09:11.247264+0000","last_unstale":"2024-09-19T08:09:12.275097+0000","last_undegraded":"2024-09-19T08:09:12.275097+0000","last_fullsized":"2024-09-19T08:09:12.275097+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:15.315022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.785754+0000","last_change":"2024-09-19T08:09:11.253948+0000","last_active":"2024-09-19T08:10:14.785754+0000","last_peered":"2024-09-19T08:10:14.785754+0000","last_clean":"2024-09-19T08:10:14.785754+0000","last_became_active":"2024-09-19T08:09:11.253402+0000","last_became_peered":"2024-09-19T08:09:11.253402+0000","last_unstale":"2024-09-19T08:10:14.785754+0000","last_undegraded":"2024-09-19T08:10:14.785754+0000","last_fullsized":"2024-09-19T08:10:14.785754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:04.884541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259928+0000","last_change":"2024-09-19T08:09:11.241770+0000","last_active":"2024-09-19T08:09:12.259928+0000","last_peered":"2024-09-19T08:09:12.259928+0000","last_clean":"2024-09-19T08:09:12.259928+0000","last_became_active":"2024-09-19T08:09:11.241356+0000","last_became_peered":"2024-09-19T08:09:11.241356+0000","last_unstale":"2024-09-19T08:09:12.259928+0000","last_undegraded":"2024-09-19T08:09:12.259928+0000","last_fullsized":"2024-09-19T08:09:12.259928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:02.722445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272890+0000","last_change":"2024-09-19T08:09:11.242874+0000","last_active":"2024-09-19T08:09:12.272890+0000","last_peered":"2024-09-19T08:09:12.272890+0000","last_clean":"2024-09-19T08:09:12.272890+0000","last_became_active":"2024-09-19T08:09:11.242383+0000","last_became_peered":"2024-09-19T08:09:11.242383+0000","last_unstale":"2024-09-19T08:09:12.272890+0000","last_undegraded":"2024-09-19T08:09:12.272890+0000","last_fullsized":"2024-09-19T08:09:12.272890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:51.900211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272762+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:09:12.272762+0000","last_peered":"2024-09-19T08:09:12.272762+0000","last_clean":"2024-09-19T08:09:12.272762+0000","last_became_active":"2024-09-19T08:09:11.250797+0000","last_became_peered":"2024-09-19T08:09:11.250797+0000","last_unstale":"2024-09-19T08:09:12.272762+0000","last_undegraded":"2024-09-19T08:09:12.272762+0000","last_fullsized":"2024-09-19T08:09:12.272762+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:46.183857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269901+0000","last_change":"2024-09-19T08:09:11.250884+0000","last_active":"2024-09-19T08:09:12.269901+0000","last_peered":"2024-09-19T08:09:12.269901+0000","last_clean":"2024-09-19T08:09:12.269901+0000","last_became_active":"2024-09-19T08:09:11.250543+0000","last_became_peered":"2024-09-19T08:09:11.250543+0000","last_unstale":"2024-09-19T08:09:12.269901+0000","last_undegraded":"2024-09-19T08:09:12.269901+0000","last_fullsized":"2024-09-19T08:09:12.269901+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.259466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260519+0000","last_change":"2024-09-19T08:09:11.246705+0000","last_active":"2024-09-19T08:09:12.260519+0000","last_peered":"2024-09-19T08:09:12.260519+0000","last_clean":"2024-09-19T08:09:12.260519+0000","last_became_active":"2024-09-19T08:09:11.246117+0000","last_became_peered":"2024-09-19T08:09:11.246117+0000","last_unstale":"2024-09-19T08:09:12.260519+0000","last_undegraded":"2024-09-19T08:09:12.260519+0000","last_fullsized":"2024-09-19T08:09:12.260519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:07.421222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272544+0000","last_change":"2024-09-19T08:09:11.242181+0000","last_active":"2024-09-19T08:09:12.272544+0000","last_peered":"2024-09-19T08:09:12.272544+0000","last_clean":"2024-09-19T08:09:12.272544+0000","last_became_active":"2024-09-19T08:09:11.241882+0000","last_became_peered":"2024-09-19T08:09:11.241882+0000","last_unstale":"2024-09-19T08:09:12.272544+0000","last_undegraded":"2024-09-19T08:09:12.272544+0000","last_fullsized":"2024-09-19T08:09:12.272544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:35.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270253+0000","last_change":"2024-09-19T08:09:11.246038+0000","last_active":"2024-09-19T08:09:12.270253+0000","last_peered":"2024-09-19T08:09:12.270253+0000","last_clean":"2024-09-19T08:09:12.270253+0000","last_became_active":"2024-09-19T08:09:11.245554+0000","last_became_peered":"2024-09-19T08:09:11.245554+0000","last_unstale":"2024-09-19T08:09:12.270253+0000","last_undegraded":"2024-09-19T08:09:12.270253+0000","last_fullsized":"2024-09-19T08:09:12.270253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:14.512425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260222+0000","last_change":"2024-09-19T08:09:11.249246+0000","last_active":"2024-09-19T08:09:12.260222+0000","last_peered":"2024-09-19T08:09:12.260222+0000","last_clean":"2024-09-19T08:09:12.260222+0000","last_became_active":"2024-09-19T08:09:11.248896+0000","last_became_peered":"2024-09-19T08:09:11.248896+0000","last_unstale":"2024-09-19T08:09:12.260222+0000","last_undegraded":"2024-09-19T08:09:12.260222+0000","last_fullsized":"2024-09-19T08:09:12.260222+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:40.406924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259965+0000","last_change":"2024-09-19T08:09:11.245421+0000","last_active":"2024-09-19T08:09:12.259965+0000","last_peered":"2024-09-19T08:09:12.259965+0000","last_clean":"2024-09-19T08:09:12.259965+0000","last_became_active":"2024-09-19T08:09:11.245071+0000","last_became_peered":"2024-09-19T08:09:11.245071+0000","last_unstale":"2024-09-19T08:09:12.259965+0000","last_undegraded":"2024-09-19T08:09:12.259965+0000","last_fullsized":"2024-09-19T08:09:12.259965+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:58.594399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270143+0000","last_change":"2024-09-19T08:09:11.246097+0000","last_active":"2024-09-19T08:09:12.270143+0000","last_peered":"2024-09-19T08:09:12.270143+0000","last_clean":"2024-09-19T08:09:12.270143+0000","last_became_active":"2024-09-19T08:09:11.245741+0000","last_became_peered":"2024-09-19T08:09:11.245741+0000","last_unstale":"2024-09-19T08:09:12.270143+0000","last_undegraded":"2024-09-19T08:09:12.270143+0000","last_fullsized":"2024-09-19T08:09:12.270143+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:05.731148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787472+0000","last_change":"2024-09-19T08:09:11.251485+0000","last_active":"2024-09-19T08:10:13.787472+0000","last_peered":"2024-09-19T08:10:13.787472+0000","last_clean":"2024-09-19T08:10:13.787472+0000","last_became_active":"2024-09-19T08:09:11.251151+0000","last_became_peered":"2024-09-19T08:09:11.251151+0000","last_unstale":"2024-09-19T08:10:13.787472+0000","last_undegraded":"2024-09-19T08:10:13.787472+0000","last_fullsized":"2024-09-19T08:10:13.787472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:47.231056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787056+0000","last_change":"2024-09-19T08:09:11.234490+0000","last_active":"2024-09-19T08:10:13.787056+0000","last_peered":"2024-09-19T08:10:13.787056+0000","last_clean":"2024-09-19T08:10:13.787056+0000","last_became_active":"2024-09-19T08:09:11.234163+0000","last_became_peered":"2024-09-19T08:09:11.234163+0000","last_unstale":"2024-09-19T08:10:13.787056+0000","last_undegraded":"2024-09-19T08:10:13.787056+0000","last_fullsized":"2024-09-19T08:10:13.787056+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.610165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.788266+0000","last_change":"2024-09-19T08:09:11.247189+0000","last_active":"2024-09-19T08:10:13.788266+0000","last_peered":"2024-09-19T08:10:13.788266+0000","last_clean":"2024-09-19T08:10:13.788266+0000","last_became_active":"2024-09-19T08:09:11.246844+0000","last_became_peered":"2024-09-19T08:09:11.246844+0000","last_unstale":"2024-09-19T08:10:13.788266+0000","last_undegraded":"2024-09-19T08:10:13.788266+0000","last_fullsized":"2024-09-19T08:10:13.788266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:50.764694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273859+0000","last_change":"2024-09-19T08:09:11.251655+0000","last_active":"2024-09-19T08:09:12.273859+0000","last_peered":"2024-09-19T08:09:12.273859+0000","last_clean":"2024-09-19T08:09:12.273859+0000","last_became_active":"2024-09-19T08:09:11.250930+0000","last_became_peered":"2024-09-19T08:09:11.250930+0000","last_unstale":"2024-09-19T08:09:12.273859+0000","last_undegraded":"2024-09-19T08:09:12.273859+0000","last_fullsized":"2024-09-19T08:09:12.273859+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:17.658277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260441+0000","last_change":"2024-09-19T08:09:11.248095+0000","last_active":"2024-09-19T08:09:12.260441+0000","last_peered":"2024-09-19T08:09:12.260441+0000","last_clean":"2024-09-19T08:09:12.260441+0000","last_became_active":"2024-09-19T08:09:11.247719+0000","last_became_peered":"2024-09-19T08:09:11.247719+0000","last_unstale":"2024-09-19T08:09:12.260441+0000","last_undegraded":"2024-09-19T08:09:12.260441+0000","last_fullsized":"2024-09-19T08:09:12.260441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:26.701140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259653+0000","last_change":"2024-09-19T08:09:11.243232+0000","last_active":"2024-09-19T08:09:12.259653+0000","last_peered":"2024-09-19T08:09:12.259653+0000","last_clean":"2024-09-19T08:09:12.259653+0000","last_became_active":"2024-09-19T08:09:11.242927+0000","last_became_peered":"2024-09-19T08:09:11.242927+0000","last_unstale":"2024-09-19T08:09:12.259653+0000","last_undegraded":"2024-09-19T08:09:12.259653+0000","last_fullsized":"2024-09-19T08:09:12.259653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:19.877520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273190+0000","last_change":"2024-09-19T08:09:11.249588+0000","last_active":"2024-09-19T08:09:12.273190+0000","last_peered":"2024-09-19T08:09:12.273190+0000","last_clean":"2024-09-19T08:09:12.273190+0000","last_became_active":"2024-09-19T08:09:11.249266+0000","last_became_peered":"2024-09-19T08:09:11.249266+0000","last_unstale":"2024-09-19T08:09:12.273190+0000","last_undegraded":"2024-09-19T08:09:12.273190+0000","last_fullsized":"2024-09-19T08:09:12.273190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:43.332454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272135+0000","last_change":"2024-09-19T08:09:11.245866+0000","last_active":"2024-09-19T08:09:12.272135+0000","last_peered":"2024-09-19T08:09:12.272135+0000","last_clean":"2024-09-19T08:09:12.272135+0000","last_became_active":"2024-09-19T08:09:11.245505+0000","last_became_peered":"2024-09-19T08:09:11.245505+0000","last_unstale":"2024-09-19T08:09:12.272135+0000","last_undegraded":"2024-09-19T08:09:12.272135+0000","last_fullsized":"2024-09-19T08:09:12.272135+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:38.203790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270471+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:09:12.270471+0000","last_peered":"2024-09-19T08:09:12.270471+0000","last_clean":"2024-09-19T08:09:12.270471+0000","last_became_active":"2024-09-19T08:09:11.250745+0000","last_became_peered":"2024-09-19T08:09:11.250745+0000","last_unstale":"2024-09-19T08:09:12.270471+0000","last_undegraded":"2024-09-19T08:09:12.270471+0000","last_fullsized":"2024-09-19T08:09:12.270471+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:16.851230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260162+0000","last_change":"2024-09-19T08:09:11.255211+0000","last_active":"2024-09-19T08:09:12.260162+0000","last_peered":"2024-09-19T08:09:12.260162+0000","last_clean":"2024-09-19T08:09:12.260162+0000","last_became_active":"2024-09-19T08:09:11.254853+0000","last_became_peered":"2024-09-19T08:09:11.254853+0000","last_unstale":"2024-09-19T08:09:12.260162+0000","last_undegraded":"2024-09-19T08:09:12.260162+0000","last_fullsized":"2024-09-19T08:09:12.260162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.497502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.271028+0000","last_change":"2024-09-19T08:09:11.247201+0000","last_active":"2024-09-19T08:09:12.271028+0000","last_peered":"2024-09-19T08:09:12.271028+0000","last_clean":"2024-09-19T08:09:12.271028+0000","last_became_active":"2024-09-19T08:09:11.246854+0000","last_became_peered":"2024-09-19T08:09:11.246854+0000","last_unstale":"2024-09-19T08:09:12.271028+0000","last_undegraded":"2024-09-19T08:09:12.271028+0000","last_fullsized":"2024-09-19T08:09:12.271028+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:19.262849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786157+0000","last_change":"2024-09-19T08:09:09.113754+0000","last_active":"2024-09-19T08:10:13.786157+0000","last_peered":"2024-09-19T08:10:13.786157+0000","last_clean":"2024-09-19T08:10:13.786157+0000","last_became_active":"2024-09-19T08:09:09.113389+0000","last_became_peered":"2024-09-19T08:09:09.113389+0000","last_unstale":"2024-09-19T08:10:13.786157+0000","last_undegraded":"2024-09-19T08:10:13.786157+0000","last_fullsized":"2024-09-19T08:10:13.786157+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:45.325895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786050+0000","last_change":"2024-09-19T08:09:11.244625+0000","last_active":"2024-09-19T08:10:13.786050+0000","last_peered":"2024-09-19T08:10:13.786050+0000","last_clean":"2024-09-19T08:10:13.786050+0000","last_became_active":"2024-09-19T08:09:11.244277+0000","last_became_peered":"2024-09-19T08:09:11.244277+0000","last_unstale":"2024-09-19T08:10:13.786050+0000","last_undegraded":"2024-09-19T08:10:13.786050+0000","last_fullsized":"2024-09-19T08:10:13.786050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:33:34.050343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264206+0000","last_change":"2024-09-19T08:09:09.116735+0000","last_active":"2024-09-19T08:09:12.264206+0000","last_peered":"2024-09-19T08:09:12.264206+0000","last_clean":"2024-09-19T08:09:12.264206+0000","last_became_active":"2024-09-19T08:09:09.116356+0000","last_became_peered":"2024-09-19T08:09:09.116356+0000","last_unstale":"2024-09-19T08:09:12.264206+0000","last_undegraded":"2024-09-19T08:09:12.264206+0000","last_fullsized":"2024-09-19T08:09:12.264206+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:50.952567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259425+0000","last_change":"2024-09-19T08:09:09.113182+0000","last_active":"2024-09-19T08:09:12.259425+0000","last_peered":"2024-09-19T08:09:12.259425+0000","last_clean":"2024-09-19T08:09:12.259425+0000","last_became_active":"2024-09-19T08:09:09.112528+0000","last_became_peered":"2024-09-19T08:09:09.112528+0000","last_unstale":"2024-09-19T08:09:12.259425+0000","last_undegraded":"2024-09-19T08:09:12.259425+0000","last_fullsized":"2024-09-19T08:09:12.259425+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:07.647351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787258+0000","last_change":"2024-09-19T08:09:11.241639+0000","last_active":"2024-09-19T08:10:13.787258+0000","last_peered":"2024-09-19T08:10:13.787258+0000","last_clean":"2024-09-19T08:10:13.787258+0000","last_became_active":"2024-09-19T08:09:11.241308+0000","last_became_peered":"2024-09-19T08:09:11.241308+0000","last_unstale":"2024-09-19T08:10:13.787258+0000","last_undegraded":"2024-09-19T08:10:13.787258+0000","last_fullsized":"2024-09-19T08:10:13.787258+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:57.826870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787237+0000","last_change":"2024-09-19T08:09:09.118334+0000","last_active":"2024-09-19T08:10:13.787237+0000","last_peered":"2024-09-19T08:10:13.787237+0000","last_clean":"2024-09-19T08:10:13.787237+0000","last_became_active":"2024-09-19T08:09:09.118010+0000","last_became_peered":"2024-09-19T08:09:09.118010+0000","last_unstale":"2024-09-19T08:10:13.787237+0000","last_undegraded":"2024-09-19T08:10:13.787237+0000","last_fullsized":"2024-09-19T08:10:13.787237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:51.046598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272762+0000","last_change":"2024-09-19T08:09:11.239990+0000","last_active":"2024-09-19T08:09:12.272762+0000","last_peered":"2024-09-19T08:09:12.272762+0000","last_clean":"2024-09-19T08:09:12.272762+0000","last_became_active":"2024-09-19T08:09:11.239643+0000","last_became_peered":"2024-09-19T08:09:11.239643+0000","last_unstale":"2024-09-19T08:09:12.272762+0000","last_undegraded":"2024-09-19T08:09:12.272762+0000","last_fullsized":"2024-09-19T08:09:12.272762+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:07.078244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264539+0000","last_change":"2024-09-19T08:09:09.114397+0000","last_active":"2024-09-19T08:09:12.264539+0000","last_peered":"2024-09-19T08:09:12.264539+0000","last_clean":"2024-09-19T08:09:12.264539+0000","last_became_active":"2024-09-19T08:09:09.114051+0000","last_became_peered":"2024-09-19T08:09:09.114051+0000","last_unstale":"2024-09-19T08:09:12.264539+0000","last_undegraded":"2024-09-19T08:09:12.264539+0000","last_fullsized":"2024-09-19T08:09:12.264539+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:41.799442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270435+0000","last_change":"2024-09-19T08:09:11.254802+0000","last_active":"2024-09-19T08:09:12.270435+0000","last_peered":"2024-09-19T08:09:12.270435+0000","last_clean":"2024-09-19T08:09:12.270435+0000","last_became_active":"2024-09-19T08:09:11.253869+0000","last_became_peered":"2024-09-19T08:09:11.253869+0000","last_unstale":"2024-09-19T08:09:12.270435+0000","last_undegraded":"2024-09-19T08:09:12.270435+0000","last_fullsized":"2024-09-19T08:09:12.270435+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:00.164834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275404+0000","last_change":"2024-09-19T08:09:09.118585+0000","last_active":"2024-09-19T08:09:12.275404+0000","last_peered":"2024-09-19T08:09:12.275404+0000","last_clean":"2024-09-19T08:09:12.275404+0000","last_became_active":"2024-09-19T08:09:09.118216+0000","last_became_peered":"2024-09-19T08:09:09.118216+0000","last_unstale":"2024-09-19T08:09:12.275404+0000","last_undegraded":"2024-09-19T08:09:12.275404+0000","last_fullsized":"2024-09-19T08:09:12.275404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:41.905746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274037+0000","last_change":"2024-09-19T08:09:11.249835+0000","last_active":"2024-09-19T08:09:12.274037+0000","last_peered":"2024-09-19T08:09:12.274037+0000","last_clean":"2024-09-19T08:09:12.274037+0000","last_became_active":"2024-09-19T08:09:11.249443+0000","last_became_peered":"2024-09-19T08:09:11.249443+0000","last_unstale":"2024-09-19T08:09:12.274037+0000","last_undegraded":"2024-09-19T08:09:12.274037+0000","last_fullsized":"2024-09-19T08:09:12.274037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:06.373126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786711+0000","last_change":"2024-09-19T08:09:09.242565+0000","last_active":"2024-09-19T08:10:13.786711+0000","last_peered":"2024-09-19T08:10:13.786711+0000","last_clean":"2024-09-19T08:10:13.786711+0000","last_became_active":"2024-09-19T08:09:09.242199+0000","last_became_peered":"2024-09-19T08:09:09.242199+0000","last_unstale":"2024-09-19T08:10:13.786711+0000","last_undegraded":"2024-09-19T08:10:13.786711+0000","last_fullsized":"2024-09-19T08:10:13.786711+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:33.195385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270121+0000","last_change":"2024-09-19T08:09:11.251682+0000","last_active":"2024-09-19T08:09:12.270121+0000","last_peered":"2024-09-19T08:09:12.270121+0000","last_clean":"2024-09-19T08:09:12.270121+0000","last_became_active":"2024-09-19T08:09:11.251037+0000","last_became_peered":"2024-09-19T08:09:11.251037+0000","last_unstale":"2024-09-19T08:09:12.270121+0000","last_undegraded":"2024-09-19T08:09:12.270121+0000","last_fullsized":"2024-09-19T08:09:12.270121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:29.518828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:10:11.395079+0000","last_change":"2024-09-19T08:09:09.119090+0000","last_active":"2024-09-19T08:10:11.395079+0000","last_peered":"2024-09-19T08:10:11.395079+0000","last_clean":"2024-09-19T08:10:11.395079+0000","last_became_active":"2024-09-19T08:09:09.118685+0000","last_became_peered":"2024-09-19T08:09:09.118685+0000","last_unstale":"2024-09-19T08:10:11.395079+0000","last_undegraded":"2024-09-19T08:10:11.395079+0000","last_fullsized":"2024-09-19T08:10:11.395079+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:21.540404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62819,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":118,"num_write":27,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270801+0000","last_change":"2024-09-19T08:09:11.243200+0000","last_active":"2024-09-19T08:09:12.270801+0000","last_peered":"2024-09-19T08:09:12.270801+0000","last_clean":"2024-09-19T08:09:12.270801+0000","last_became_active":"2024-09-19T08:09:11.242873+0000","last_became_peered":"2024-09-19T08:09:11.242873+0000","last_unstale":"2024-09-19T08:09:12.270801+0000","last_undegraded":"2024-09-19T08:09:12.270801+0000","last_fullsized":"2024-09-19T08:09:12.270801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:35.817609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.278392+0000","last_change":"2024-09-19T08:09:09.117117+0000","last_active":"2024-09-19T08:09:12.278392+0000","last_peered":"2024-09-19T08:09:12.278392+0000","last_clean":"2024-09-19T08:09:12.278392+0000","last_became_active":"2024-09-19T08:09:09.116512+0000","last_became_peered":"2024-09-19T08:09:09.116512+0000","last_unstale":"2024-09-19T08:09:12.278392+0000","last_undegraded":"2024-09-19T08:09:12.278392+0000","last_fullsized":"2024-09-19T08:09:12.278392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:15.010570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259483+0000","last_change":"2024-09-19T08:09:11.246648+0000","last_active":"2024-09-19T08:09:12.259483+0000","last_peered":"2024-09-19T08:09:12.259483+0000","last_clean":"2024-09-19T08:09:12.259483+0000","last_became_active":"2024-09-19T08:09:11.246317+0000","last_became_peered":"2024-09-19T08:09:11.246317+0000","last_unstale":"2024-09-19T08:09:12.259483+0000","last_undegraded":"2024-09-19T08:09:12.259483+0000","last_fullsized":"2024-09-19T08:09:12.259483+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:43.285257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786532+0000","last_change":"2024-09-19T08:09:09.112599+0000","last_active":"2024-09-19T08:10:13.786532+0000","last_peered":"2024-09-19T08:10:13.786532+0000","last_clean":"2024-09-19T08:10:13.786532+0000","last_became_active":"2024-09-19T08:09:09.112281+0000","last_became_peered":"2024-09-19T08:09:09.112281+0000","last_unstale":"2024-09-19T08:10:13.786532+0000","last_undegraded":"2024-09-19T08:10:13.786532+0000","last_fullsized":"2024-09-19T08:10:13.786532+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:47.710235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274905+0000","last_change":"2024-09-19T08:09:11.253814+0000","last_active":"2024-09-19T08:09:12.274905+0000","last_peered":"2024-09-19T08:09:12.274905+0000","last_clean":"2024-09-19T08:09:12.274905+0000","last_became_active":"2024-09-19T08:09:11.253490+0000","last_became_peered":"2024-09-19T08:09:11.253490+0000","last_unstale":"2024-09-19T08:09:12.274905+0000","last_undegraded":"2024-09-19T08:09:12.274905+0000","last_fullsized":"2024-09-19T08:09:12.274905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:09.287110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.785412+0000","last_change":"2024-09-19T08:09:09.114820+0000","last_active":"2024-09-19T08:10:14.785412+0000","last_peered":"2024-09-19T08:10:14.785412+0000","last_clean":"2024-09-19T08:10:14.785412+0000","last_became_active":"2024-09-19T08:09:09.114478+0000","last_became_peered":"2024-09-19T08:09:09.114478+0000","last_unstale":"2024-09-19T08:10:14.785412+0000","last_undegraded":"2024-09-19T08:10:14.785412+0000","last_fullsized":"2024-09-19T08:10:14.785412+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:24.243629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274533+0000","last_change":"2024-09-19T08:09:11.249622+0000","last_active":"2024-09-19T08:09:12.274533+0000","last_peered":"2024-09-19T08:09:12.274533+0000","last_clean":"2024-09-19T08:09:12.274533+0000","last_became_active":"2024-09-19T08:09:11.249325+0000","last_became_peered":"2024-09-19T08:09:11.249325+0000","last_unstale":"2024-09-19T08:09:12.274533+0000","last_undegraded":"2024-09-19T08:09:12.274533+0000","last_fullsized":"2024-09-19T08:09:12.274533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:59.342715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.279583+0000","last_change":"2024-09-19T08:09:09.244136+0000","last_active":"2024-09-19T08:09:12.279583+0000","last_peered":"2024-09-19T08:09:12.279583+0000","last_clean":"2024-09-19T08:09:12.279583+0000","last_became_active":"2024-09-19T08:09:09.243776+0000","last_became_peered":"2024-09-19T08:09:09.243776+0000","last_unstale":"2024-09-19T08:09:12.279583+0000","last_undegraded":"2024-09-19T08:09:12.279583+0000","last_fullsized":"2024-09-19T08:09:12.279583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:01.711310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786314+0000","last_change":"2024-09-19T08:09:11.245399+0000","last_active":"2024-09-19T08:10:13.786314+0000","last_peered":"2024-09-19T08:10:13.786314+0000","last_clean":"2024-09-19T08:10:13.786314+0000","last_became_active":"2024-09-19T08:09:11.245055+0000","last_became_peered":"2024-09-19T08:09:11.245055+0000","last_unstale":"2024-09-19T08:10:13.786314+0000","last_undegraded":"2024-09-19T08:10:13.786314+0000","last_fullsized":"2024-09-19T08:10:13.786314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:57.639205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275274+0000","last_change":"2024-09-19T08:09:09.115252+0000","last_active":"2024-09-19T08:09:12.275274+0000","last_peered":"2024-09-19T08:09:12.275274+0000","last_clean":"2024-09-19T08:09:12.275274+0000","last_became_active":"2024-09-19T08:09:09.114908+0000","last_became_peered":"2024-09-19T08:09:09.114908+0000","last_unstale":"2024-09-19T08:09:12.275274+0000","last_undegraded":"2024-09-19T08:09:12.275274+0000","last_fullsized":"2024-09-19T08:09:12.275274+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:48.326221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260384+0000","last_change":"2024-09-19T08:09:11.249189+0000","last_active":"2024-09-19T08:09:12.260384+0000","last_peered":"2024-09-19T08:09:12.260384+0000","last_clean":"2024-09-19T08:09:12.260384+0000","last_became_active":"2024-09-19T08:09:11.248797+0000","last_became_peered":"2024-09-19T08:09:11.248797+0000","last_unstale":"2024-09-19T08:09:12.260384+0000","last_undegraded":"2024-09-19T08:09:12.260384+0000","last_fullsized":"2024-09-19T08:09:12.260384+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:20.915638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270335+0000","last_change":"2024-09-19T08:09:09.112973+0000","last_active":"2024-09-19T08:09:12.270335+0000","last_peered":"2024-09-19T08:09:12.270335+0000","last_clean":"2024-09-19T08:09:12.270335+0000","last_became_active":"2024-09-19T08:09:09.112616+0000","last_became_peered":"2024-09-19T08:09:09.112616+0000","last_unstale":"2024-09-19T08:09:12.270335+0000","last_undegraded":"2024-09-19T08:09:12.270335+0000","last_fullsized":"2024-09-19T08:09:12.270335+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:13.791926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275124+0000","last_change":"2024-09-19T08:09:11.240739+0000","last_active":"2024-09-19T08:09:12.275124+0000","last_peered":"2024-09-19T08:09:12.275124+0000","last_clean":"2024-09-19T08:09:12.275124+0000","last_became_active":"2024-09-19T08:09:11.240340+0000","last_became_peered":"2024-09-19T08:09:11.240340+0000","last_unstale":"2024-09-19T08:09:12.275124+0000","last_undegraded":"2024-09-19T08:09:12.275124+0000","last_fullsized":"2024-09-19T08:09:12.275124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:35.450279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786744+0000","last_change":"2024-09-19T08:09:09.112516+0000","last_active":"2024-09-19T08:10:13.786744+0000","last_peered":"2024-09-19T08:10:13.786744+0000","last_clean":"2024-09-19T08:10:13.786744+0000","last_became_active":"2024-09-19T08:09:09.112140+0000","last_became_peered":"2024-09-19T08:09:09.112140+0000","last_unstale":"2024-09-19T08:10:13.786744+0000","last_undegraded":"2024-09-19T08:10:13.786744+0000","last_fullsized":"2024-09-19T08:10:13.786744+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:05.434331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274943+0000","last_change":"2024-09-19T08:09:11.252163+0000","last_active":"2024-09-19T08:09:12.274943+0000","last_peered":"2024-09-19T08:09:12.274943+0000","last_clean":"2024-09-19T08:09:12.274943+0000","last_became_active":"2024-09-19T08:09:11.251762+0000","last_became_peered":"2024-09-19T08:09:11.251762+0000","last_unstale":"2024-09-19T08:09:12.274943+0000","last_undegraded":"2024-09-19T08:09:12.274943+0000","last_fullsized":"2024-09-19T08:09:12.274943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:33.941910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.789183+0000","last_change":"2024-09-19T08:10:14.788460+0000","last_active":"2024-09-19T08:10:14.789183+0000","last_peered":"2024-09-19T08:10:14.789183+0000","last_clean":"2024-09-19T08:10:14.789183+0000","last_became_active":"2024-09-19T08:10:14.787990+0000","last_became_peered":"2024-09-19T08:10:14.787990+0000","last_unstale":"2024-09-19T08:10:14.789183+0000","last_undegraded":"2024-09-19T08:10:14.789183+0000","last_fullsized":"2024-09-19T08:10:14.789183+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:24.549994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275301+0000","last_change":"2024-09-19T08:09:11.242438+0000","last_active":"2024-09-19T08:09:12.275301+0000","last_peered":"2024-09-19T08:09:12.275301+0000","last_clean":"2024-09-19T08:09:12.275301+0000","last_became_active":"2024-09-19T08:09:11.242114+0000","last_became_peered":"2024-09-19T08:09:11.242114+0000","last_unstale":"2024-09-19T08:09:12.275301+0000","last_undegraded":"2024-09-19T08:09:12.275301+0000","last_fullsized":"2024-09-19T08:09:12.275301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:54.183012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":341,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274753+0000","last_change":"2024-09-19T08:07:55.287566+0000","last_active":"2024-09-19T08:09:12.274753+0000","last_peered":"2024-09-19T08:09:12.274753+0000","last_clean":"2024-09-19T08:09:12.274753+0000","last_became_active":"2024-09-19T08:07:55.287037+0000","last_became_peered":"2024-09-19T08:07:55.287037+0000","last_unstale":"2024-09-19T08:09:12.274753+0000","last_undegraded":"2024-09-19T08:09:12.274753+0000","last_fullsized":"2024-09-19T08:09:12.274753+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_clean_scrub_stamp":"2024-09-19T08:04:29.468857+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:49.553882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784592+0000","last_change":"2024-09-19T08:09:09.113497+0000","last_active":"2024-09-19T08:10:14.784592+0000","last_peered":"2024-09-19T08:10:14.784592+0000","last_clean":"2024-09-19T08:10:14.784592+0000","last_became_active":"2024-09-19T08:09:09.112546+0000","last_became_peered":"2024-09-19T08:09:09.112546+0000","last_unstale":"2024-09-19T08:10:14.784592+0000","last_undegraded":"2024-09-19T08:10:14.784592+0000","last_fullsized":"2024-09-19T08:10:14.784592+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:09.906476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787709+0000","last_change":"2024-09-19T08:09:11.241478+0000","last_active":"2024-09-19T08:10:13.787709+0000","last_peered":"2024-09-19T08:10:13.787709+0000","last_clean":"2024-09-19T08:10:13.787709+0000","last_became_active":"2024-09-19T08:09:11.241138+0000","last_became_peered":"2024-09-19T08:09:11.241138+0000","last_unstale":"2024-09-19T08:10:13.787709+0000","last_undegraded":"2024-09-19T08:10:13.787709+0000","last_fullsized":"2024-09-19T08:10:13.787709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:32.884491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274978+0000","last_change":"2024-09-19T08:09:09.116571+0000","last_active":"2024-09-19T08:09:12.274978+0000","last_peered":"2024-09-19T08:09:12.274978+0000","last_clean":"2024-09-19T08:09:12.274978+0000","last_became_active":"2024-09-19T08:09:09.116180+0000","last_became_peered":"2024-09-19T08:09:09.116180+0000","last_unstale":"2024-09-19T08:09:12.274978+0000","last_undegraded":"2024-09-19T08:09:12.274978+0000","last_fullsized":"2024-09-19T08:09:12.274978+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:58.577320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259671+0000","last_change":"2024-09-19T08:09:11.254088+0000","last_active":"2024-09-19T08:09:12.259671+0000","last_peered":"2024-09-19T08:09:12.259671+0000","last_clean":"2024-09-19T08:09:12.259671+0000","last_became_active":"2024-09-19T08:09:11.253795+0000","last_became_peered":"2024-09-19T08:09:11.253795+0000","last_unstale":"2024-09-19T08:09:12.259671+0000","last_undegraded":"2024-09-19T08:09:12.259671+0000","last_fullsized":"2024-09-19T08:09:12.259671+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:30.528506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259700+0000","last_change":"2024-09-19T08:09:09.242166+0000","last_active":"2024-09-19T08:09:12.259700+0000","last_peered":"2024-09-19T08:09:12.259700+0000","last_clean":"2024-09-19T08:09:12.259700+0000","last_became_active":"2024-09-19T08:09:09.241270+0000","last_became_peered":"2024-09-19T08:09:09.241270+0000","last_unstale":"2024-09-19T08:09:12.259700+0000","last_undegraded":"2024-09-19T08:09:12.259700+0000","last_fullsized":"2024-09-19T08:09:12.259700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:51.899069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-19T08:09:14.748141+0000","last_change":"2024-09-19T08:10:13.786269+0000","last_active":"2024-09-19T08:10:13.786269+0000","last_peered":"2024-09-19T08:09:14.748141+0000","last_clean":"2024-09-19T08:09:14.748141+0000","last_became_active":"2024-09-19T08:09:11.252219+0000","last_became_peered":"2024-09-19T08:09:11.252219+0000","last_unstale":"2024-09-19T08:09:14.748141+0000","last_undegraded":"2024-09-19T08:09:14.748141+0000","last_fullsized":"2024-09-19T08:09:14.748141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,8],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275248+0000","last_change":"2024-09-19T08:09:09.118790+0000","last_active":"2024-09-19T08:09:12.275248+0000","last_peered":"2024-09-19T08:09:12.275248+0000","last_clean":"2024-09-19T08:09:12.275248+0000","last_became_active":"2024-09-19T08:09:09.117695+0000","last_became_peered":"2024-09-19T08:09:09.117695+0000","last_unstale":"2024-09-19T08:09:12.275248+0000","last_undegraded":"2024-09-19T08:09:12.275248+0000","last_fullsized":"2024-09-19T08:09:12.275248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:40.674039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264264+0000","last_change":"2024-09-19T08:09:11.249386+0000","last_active":"2024-09-19T08:09:12.264264+0000","last_peered":"2024-09-19T08:09:12.264264+0000","last_clean":"2024-09-19T08:09:12.264264+0000","last_became_active":"2024-09-19T08:09:11.249004+0000","last_became_peered":"2024-09-19T08:09:11.249004+0000","last_unstale":"2024-09-19T08:09:12.264264+0000","last_undegraded":"2024-09-19T08:09:12.264264+0000","last_fullsized":"2024-09-19T08:09:12.264264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:50.170799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272215+0000","last_change":"2024-09-19T08:09:09.241599+0000","last_active":"2024-09-19T08:09:12.272215+0000","last_peered":"2024-09-19T08:09:12.272215+0000","last_clean":"2024-09-19T08:09:12.272215+0000","last_became_active":"2024-09-19T08:09:09.241226+0000","last_became_peered":"2024-09-19T08:09:09.241226+0000","last_unstale":"2024-09-19T08:09:12.272215+0000","last_undegraded":"2024-09-19T08:09:12.272215+0000","last_fullsized":"2024-09-19T08:09:12.272215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:19.590966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.264496+0000","last_change":"2024-09-19T08:09:11.238098+0000","last_active":"2024-09-19T08:09:12.264496+0000","last_peered":"2024-09-19T08:09:12.264496+0000","last_clean":"2024-09-19T08:09:12.264496+0000","last_became_active":"2024-09-19T08:09:11.237737+0000","last_became_peered":"2024-09-19T08:09:11.237737+0000","last_unstale":"2024-09-19T08:09:12.264496+0000","last_undegraded":"2024-09-19T08:09:12.264496+0000","last_fullsized":"2024-09-19T08:09:12.264496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:00.134664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272482+0000","last_change":"2024-09-19T08:09:09.241775+0000","last_active":"2024-09-19T08:09:12.272482+0000","last_peered":"2024-09-19T08:09:12.272482+0000","last_clean":"2024-09-19T08:09:12.272482+0000","last_became_active":"2024-09-19T08:09:09.241367+0000","last_became_peered":"2024-09-19T08:09:09.241367+0000","last_unstale":"2024-09-19T08:09:12.272482+0000","last_undegraded":"2024-09-19T08:09:12.272482+0000","last_fullsized":"2024-09-19T08:09:12.272482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:11.862171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.259714+0000","last_change":"2024-09-19T08:09:11.251980+0000","last_active":"2024-09-19T08:09:12.259714+0000","last_peered":"2024-09-19T08:09:12.259714+0000","last_clean":"2024-09-19T08:09:12.259714+0000","last_became_active":"2024-09-19T08:09:11.251638+0000","last_became_peered":"2024-09-19T08:09:11.251638+0000","last_unstale":"2024-09-19T08:09:12.259714+0000","last_undegraded":"2024-09-19T08:09:12.259714+0000","last_fullsized":"2024-09-19T08:09:12.259714+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:35.905643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'8","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:34.279466+0000","last_change":"2024-09-19T08:09:09.117150+0000","last_active":"2024-09-19T08:09:34.279466+0000","last_peered":"2024-09-19T08:09:34.279466+0000","last_clean":"2024-09-19T08:09:34.279466+0000","last_became_active":"2024-09-19T08:09:09.116763+0000","last_became_peered":"2024-09-19T08:09:09.116763+0000","last_unstale":"2024-09-19T08:09:34.279466+0000","last_undegraded":"2024-09-19T08:09:34.279466+0000","last_fullsized":"2024-09-19T08:09:34.279466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:18.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.788673+0000","last_change":"2024-09-19T08:09:11.244366+0000","last_active":"2024-09-19T08:10:13.788673+0000","last_peered":"2024-09-19T08:10:13.788673+0000","last_clean":"2024-09-19T08:10:13.788673+0000","last_became_active":"2024-09-19T08:09:11.244023+0000","last_became_peered":"2024-09-19T08:09:11.244023+0000","last_unstale":"2024-09-19T08:10:13.788673+0000","last_undegraded":"2024-09-19T08:10:13.788673+0000","last_fullsized":"2024-09-19T08:10:13.788673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:18.572377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784549+0000","last_change":"2024-09-19T08:09:09.139557+0000","last_active":"2024-09-19T08:10:14.784549+0000","last_peered":"2024-09-19T08:10:14.784549+0000","last_clean":"2024-09-19T08:10:14.784549+0000","last_became_active":"2024-09-19T08:09:09.139190+0000","last_became_peered":"2024-09-19T08:09:09.139190+0000","last_unstale":"2024-09-19T08:10:14.784549+0000","last_undegraded":"2024-09-19T08:10:14.784549+0000","last_fullsized":"2024-09-19T08:10:14.784549+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:39.270432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273816+0000","last_change":"2024-09-19T08:09:11.249637+0000","last_active":"2024-09-19T08:09:12.273816+0000","last_peered":"2024-09-19T08:09:12.273816+0000","last_clean":"2024-09-19T08:09:12.273816+0000","last_became_active":"2024-09-19T08:09:11.249323+0000","last_became_peered":"2024-09-19T08:09:11.249323+0000","last_unstale":"2024-09-19T08:09:12.273816+0000","last_undegraded":"2024-09-19T08:09:12.273816+0000","last_fullsized":"2024-09-19T08:09:12.273816+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:28.270910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270693+0000","last_change":"2024-09-19T08:09:09.242444+0000","last_active":"2024-09-19T08:09:12.270693+0000","last_peered":"2024-09-19T08:09:12.270693+0000","last_clean":"2024-09-19T08:09:12.270693+0000","last_became_active":"2024-09-19T08:09:09.242095+0000","last_became_peered":"2024-09-19T08:09:09.242095+0000","last_unstale":"2024-09-19T08:09:12.270693+0000","last_undegraded":"2024-09-19T08:09:12.270693+0000","last_fullsized":"2024-09-19T08:09:12.270693+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:42.941930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269950+0000","last_change":"2024-09-19T08:09:11.241588+0000","last_active":"2024-09-19T08:09:12.269950+0000","last_peered":"2024-09-19T08:09:12.269950+0000","last_clean":"2024-09-19T08:09:12.269950+0000","last_became_active":"2024-09-19T08:09:11.241076+0000","last_became_peered":"2024-09-19T08:09:11.241076+0000","last_unstale":"2024-09-19T08:09:12.269950+0000","last_undegraded":"2024-09-19T08:09:12.269950+0000","last_fullsized":"2024-09-19T08:09:12.269950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:01.676410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787630+0000","last_change":"2024-09-19T08:09:09.112494+0000","last_active":"2024-09-19T08:10:13.787630+0000","last_peered":"2024-09-19T08:10:13.787630+0000","last_clean":"2024-09-19T08:10:13.787630+0000","last_became_active":"2024-09-19T08:09:09.112019+0000","last_became_peered":"2024-09-19T08:09:09.112019+0000","last_unstale":"2024-09-19T08:10:13.787630+0000","last_undegraded":"2024-09-19T08:10:13.787630+0000","last_fullsized":"2024-09-19T08:10:13.787630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:17.674092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260305+0000","last_change":"2024-09-19T08:09:11.251420+0000","last_active":"2024-09-19T08:09:12.260305+0000","last_peered":"2024-09-19T08:09:12.260305+0000","last_clean":"2024-09-19T08:09:12.260305+0000","last_became_active":"2024-09-19T08:09:11.251083+0000","last_became_peered":"2024-09-19T08:09:11.251083+0000","last_unstale":"2024-09-19T08:09:12.260305+0000","last_undegraded":"2024-09-19T08:09:12.260305+0000","last_fullsized":"2024-09-19T08:09:12.260305+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:38.810616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272113+0000","last_change":"2024-09-19T08:09:09.117705+0000","last_active":"2024-09-19T08:09:12.272113+0000","last_peered":"2024-09-19T08:09:12.272113+0000","last_clean":"2024-09-19T08:09:12.272113+0000","last_became_active":"2024-09-19T08:09:09.117367+0000","last_became_peered":"2024-09-19T08:09:09.117367+0000","last_unstale":"2024-09-19T08:09:12.272113+0000","last_undegraded":"2024-09-19T08:09:12.272113+0000","last_fullsized":"2024-09-19T08:09:12.272113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:21.256227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787802+0000","last_change":"2024-09-19T08:09:11.239096+0000","last_active":"2024-09-19T08:10:13.787802+0000","last_peered":"2024-09-19T08:10:13.787802+0000","last_clean":"2024-09-19T08:10:13.787802+0000","last_became_active":"2024-09-19T08:09:11.238739+0000","last_became_peered":"2024-09-19T08:09:11.238739+0000","last_unstale":"2024-09-19T08:10:13.787802+0000","last_undegraded":"2024-09-19T08:10:13.787802+0000","last_fullsized":"2024-09-19T08:10:13.787802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:27.161174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.279086+0000","last_change":"2024-09-19T08:09:09.115198+0000","last_active":"2024-09-19T08:09:12.279086+0000","last_peered":"2024-09-19T08:09:12.279086+0000","last_clean":"2024-09-19T08:09:12.279086+0000","last_became_active":"2024-09-19T08:09:09.114783+0000","last_became_peered":"2024-09-19T08:09:09.114783+0000","last_unstale":"2024-09-19T08:09:12.279086+0000","last_undegraded":"2024-09-19T08:09:12.279086+0000","last_fullsized":"2024-09-19T08:09:12.279086+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:45.674774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274921+0000","last_change":"2024-09-19T08:09:11.252450+0000","last_active":"2024-09-19T08:09:12.274921+0000","last_peered":"2024-09-19T08:09:12.274921+0000","last_clean":"2024-09-19T08:09:12.274921+0000","last_became_active":"2024-09-19T08:09:11.251696+0000","last_became_peered":"2024-09-19T08:09:11.251696+0000","last_unstale":"2024-09-19T08:09:12.274921+0000","last_undegraded":"2024-09-19T08:09:12.274921+0000","last_fullsized":"2024-09-19T08:09:12.274921+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:48.179795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786579+0000","last_change":"2024-09-19T08:09:11.244571+0000","last_active":"2024-09-19T08:10:13.786579+0000","last_peered":"2024-09-19T08:10:13.786579+0000","last_clean":"2024-09-19T08:10:13.786579+0000","last_became_active":"2024-09-19T08:09:11.244217+0000","last_became_peered":"2024-09-19T08:09:11.244217+0000","last_unstale":"2024-09-19T08:10:13.786579+0000","last_undegraded":"2024-09-19T08:10:13.786579+0000","last_fullsized":"2024-09-19T08:10:13.786579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:52.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.275687+0000","last_change":"2024-09-19T08:09:09.117355+0000","last_active":"2024-09-19T08:09:12.275687+0000","last_peered":"2024-09-19T08:09:12.275687+0000","last_clean":"2024-09-19T08:09:12.275687+0000","last_became_active":"2024-09-19T08:09:09.116806+0000","last_became_peered":"2024-09-19T08:09:09.116806+0000","last_unstale":"2024-09-19T08:09:12.275687+0000","last_undegraded":"2024-09-19T08:09:12.275687+0000","last_fullsized":"2024-09-19T08:09:12.275687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:42.113015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269943+0000","last_change":"2024-09-19T08:09:11.245745+0000","last_active":"2024-09-19T08:09:12.269943+0000","last_peered":"2024-09-19T08:09:12.269943+0000","last_clean":"2024-09-19T08:09:12.269943+0000","last_became_active":"2024-09-19T08:09:11.245373+0000","last_became_peered":"2024-09-19T08:09:11.245373+0000","last_unstale":"2024-09-19T08:09:12.269943+0000","last_undegraded":"2024-09-19T08:09:12.269943+0000","last_fullsized":"2024-09-19T08:09:12.269943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:56.500738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.278897+0000","last_change":"2024-09-19T08:09:09.119550+0000","last_active":"2024-09-19T08:09:12.278897+0000","last_peered":"2024-09-19T08:09:12.278897+0000","last_clean":"2024-09-19T08:09:12.278897+0000","last_became_active":"2024-09-19T08:09:09.119187+0000","last_became_peered":"2024-09-19T08:09:09.119187+0000","last_unstale":"2024-09-19T08:09:12.278897+0000","last_undegraded":"2024-09-19T08:09:12.278897+0000","last_fullsized":"2024-09-19T08:09:12.278897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:14.629824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274031+0000","last_change":"2024-09-19T08:09:11.245318+0000","last_active":"2024-09-19T08:09:12.274031+0000","last_peered":"2024-09-19T08:09:12.274031+0000","last_clean":"2024-09-19T08:09:12.274031+0000","last_became_active":"2024-09-19T08:09:11.245000+0000","last_became_peered":"2024-09-19T08:09:11.245000+0000","last_unstale":"2024-09-19T08:09:12.274031+0000","last_undegraded":"2024-09-19T08:09:12.274031+0000","last_fullsized":"2024-09-19T08:09:12.274031+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:53.590453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.788328+0000","last_change":"2024-09-19T08:09:09.241552+0000","last_active":"2024-09-19T08:10:13.788328+0000","last_peered":"2024-09-19T08:10:13.788328+0000","last_clean":"2024-09-19T08:10:13.788328+0000","last_became_active":"2024-09-19T08:09:09.241201+0000","last_became_peered":"2024-09-19T08:09:09.241201+0000","last_unstale":"2024-09-19T08:10:13.788328+0000","last_undegraded":"2024-09-19T08:10:13.788328+0000","last_fullsized":"2024-09-19T08:10:13.788328+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:09.374532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.788157+0000","last_change":"2024-09-19T08:09:11.246697+0000","last_active":"2024-09-19T08:10:13.788157+0000","last_peered":"2024-09-19T08:10:13.788157+0000","last_clean":"2024-09-19T08:10:13.788157+0000","last_became_active":"2024-09-19T08:09:11.246404+0000","last_became_peered":"2024-09-19T08:09:11.246404+0000","last_unstale":"2024-09-19T08:10:13.788157+0000","last_undegraded":"2024-09-19T08:10:13.788157+0000","last_fullsized":"2024-09-19T08:10:13.788157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.008875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.278644+0000","last_change":"2024-09-19T08:09:09.113401+0000","last_active":"2024-09-19T08:09:12.278644+0000","last_peered":"2024-09-19T08:09:12.278644+0000","last_clean":"2024-09-19T08:09:12.278644+0000","last_became_active":"2024-09-19T08:09:09.113026+0000","last_became_peered":"2024-09-19T08:09:09.113026+0000","last_unstale":"2024-09-19T08:09:12.278644+0000","last_undegraded":"2024-09-19T08:09:12.278644+0000","last_fullsized":"2024-09-19T08:09:12.278644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:54.740955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63617,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":120,"num_read_kb":124,"num_write":81,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":67,"ondisk_log_size":67,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281686,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547227,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":868352,"data_stored":419022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776159,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":1072520,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939685,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":419604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168617,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":876544,"data_stored":419626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397550,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":1010089,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561075,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":419139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790009,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":946176,"data_stored":1018274,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953535,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":884736,"data_stored":427629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182468,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":419360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":481875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":481841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":872448,"data_stored":419112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:10:16.490 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:10:16.755 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:17.052 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:16 smithi027 ceph-mon[31209]: pgmap v314: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-19T08:10:17.129 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:16 smithi027 ceph-mon[31209]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:10:17.129 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:16 smithi027 ceph-mon[31209]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-19T08:10:17.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:16 smithi155 ceph-mon[35362]: pgmap v314: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-19T08:10:17.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:16 smithi155 ceph-mon[35362]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:10:17.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:16 smithi155 ceph-mon[35362]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-19T08:10:17.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.230+0000 7f56b5129640 1 -- 172.21.15.27:0/3421204019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b01036e0 msgr2=0x7f56b0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:17.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.230+0000 7f56b5129640 1 --2- 172.21.15.27:0/3421204019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b01036e0 0x7f56b0107b90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f56a4009930 tx=0x7f56a402a420 comp rx=0 tx=0).stop 2024-09-19T08:10:17.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.230+0000 7f56b5129640 1 -- 172.21.15.27:0/3421204019 shutdown_connections 2024-09-19T08:10:17.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.230+0000 7f56b5129640 1 --2- 172.21.15.27:0/3421204019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56b01082a0 0x7f56b010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:17.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.230+0000 7f56b5129640 1 --2- 172.21.15.27:0/3421204019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b01036e0 0x7f56b0107b90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:17.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.230+0000 7f56b5129640 1 --2- 172.21.15.27:0/3421204019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56b0102d30 0x7f56b0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:17.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.230+0000 7f56b5129640 1 -- 172.21.15.27:0/3421204019 >> 172.21.15.27:0/3421204019 conn(0x7f56b00fc7d0 msgr2=0x7f56b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:17.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.230+0000 7f56b5129640 1 -- 172.21.15.27:0/3421204019 shutdown_connections 2024-09-19T08:10:17.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.230+0000 7f56b5129640 1 -- 172.21.15.27:0/3421204019 wait complete. 2024-09-19T08:10:17.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.231+0000 7f56b5129640 1 Processor -- start 2024-09-19T08:10:17.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.231+0000 7f56b5129640 1 -- start start 2024-09-19T08:10:17.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.232+0000 7f56b5129640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56b0102d30 0x7f56b01985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:17.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.232+0000 7f56b5129640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56b01036e0 0x7f56b0198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:17.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.232+0000 7f56b5129640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b01082a0 0x7f56b019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:17.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.232+0000 7f56b5129640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f56b01120a0 con 0x7f56b01082a0 2024-09-19T08:10:17.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.232+0000 7f56b5129640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f56b0111f20 con 0x7f56b01036e0 2024-09-19T08:10:17.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.232+0000 7f56b5129640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f56b0112220 con 0x7f56b0102d30 2024-09-19T08:10:17.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.232+0000 7f56af59e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b01082a0 0x7f56b019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:17.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.232+0000 7f56af59e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b01082a0 0x7f56b019ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35564/0 (socket says 172.21.15.27:35564) 2024-09-19T08:10:17.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.232+0000 7f56af59e640 1 -- 172.21.15.27:0/1210971608 learned_addr learned my addr 172.21.15.27:0/1210971608 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:17.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.232+0000 7f56ae59c640 1 --2- 172.21.15.27:0/1210971608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56b01036e0 0x7f56b0198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:17.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.232+0000 7f56af59e640 1 -- 172.21.15.27:0/1210971608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56b0102d30 msgr2=0x7f56b01985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:17.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.232+0000 7f56aed9d640 1 --2- 172.21.15.27:0/1210971608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56b0102d30 0x7f56b01985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:17.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.232+0000 7f56af59e640 1 --2- 172.21.15.27:0/1210971608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56b0102d30 0x7f56b01985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:17.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.232+0000 7f56af59e640 1 -- 172.21.15.27:0/1210971608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56b01036e0 msgr2=0x7f56b0198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:17.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.232+0000 7f56af59e640 1 --2- 172.21.15.27:0/1210971608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56b01036e0 0x7f56b0198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:17.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.232+0000 7f56af59e640 1 -- 172.21.15.27:0/1210971608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b019d590 con 0x7f56b01082a0 2024-09-19T08:10:17.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.232+0000 7f56aed9d640 1 --2- 172.21.15.27:0/1210971608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56b0102d30 0x7f56b01985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:10:17.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.232+0000 7f56af59e640 1 --2- 172.21.15.27:0/1210971608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b01082a0 0x7f56b019ceb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f56a800cad0 tx=0x7f56a800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:17.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.233+0000 7f5697fff640 1 -- 172.21.15.27:0/1210971608 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a800ae20 con 0x7f56b01082a0 2024-09-19T08:10:17.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.233+0000 7f56b5129640 1 -- 172.21.15.27:0/1210971608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b019d880 con 0x7f56b01082a0 2024-09-19T08:10:17.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.233+0000 7f5697fff640 1 -- 172.21.15.27:0/1210971608 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56a8005020 con 0x7f56b01082a0 2024-09-19T08:10:17.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.233+0000 7f5697fff640 1 -- 172.21.15.27:0/1210971608 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a800f6b0 con 0x7f56b01082a0 2024-09-19T08:10:17.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.233+0000 7f56b5129640 1 -- 172.21.15.27:0/1210971608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b01a5160 con 0x7f56b01082a0 2024-09-19T08:10:17.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.234+0000 7f56b5129640 1 -- 172.21.15.27:0/1210971608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56b0103110 con 0x7f56b01082a0 2024-09-19T08:10:17.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.235+0000 7f5697fff640 1 -- 172.21.15.27:0/1210971608 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f56a80051d0 con 0x7f56b01082a0 2024-09-19T08:10:17.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.236+0000 7f5697fff640 1 --2- 172.21.15.27:0/1210971608 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f56980a32d0 0x7f56980a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:17.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.236+0000 7f56aed9d640 1 --2- 172.21.15.27:0/1210971608 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f56980a32d0 0x7f56980a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:17.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.236+0000 7f5697fff640 1 -- 172.21.15.27:0/1210971608 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f56a80cfd70 con 0x7f56b01082a0 2024-09-19T08:10:17.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.236+0000 7f56aed9d640 1 --2- 172.21.15.27:0/1210971608 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f56980a32d0 0x7f56980a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f56a0009b40 tx=0x7f56a0005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:17.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.239+0000 7f5697fff640 1 -- 172.21.15.27:0/1210971608 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f56a8014030 con 0x7f56b01082a0 2024-09-19T08:10:17.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:16 smithi203 ceph-mon[35198]: pgmap v314: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-19T08:10:17.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:16 smithi203 ceph-mon[35198]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:10:17.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:16 smithi203 ceph-mon[35198]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-19T08:10:17.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.415+0000 7f56b5129640 1 -- 172.21.15.27:0/1210971608 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56b0062630 con 0x7f56980a32d0 2024-09-19T08:10:17.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.427+0000 7f5697fff640 1 -- 172.21.15.27:0/1210971608 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258790 (secure 0 0 0) 0x7f56b0062630 con 0x7f56980a32d0 2024-09-19T08:10:17.430 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:10:17.431 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-09-19T08:10:17.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.430+0000 7f56b5129640 1 -- 172.21.15.27:0/1210971608 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f56980a32d0 msgr2=0x7f56980a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:17.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.430+0000 7f56b5129640 1 --2- 172.21.15.27:0/1210971608 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f56980a32d0 0x7f56980a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f56a0009b40 tx=0x7f56a0005e50 comp rx=0 tx=0).stop 2024-09-19T08:10:17.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.430+0000 7f56b5129640 1 -- 172.21.15.27:0/1210971608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b01082a0 msgr2=0x7f56b019ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:17.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.430+0000 7f56b5129640 1 --2- 172.21.15.27:0/1210971608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b01082a0 0x7f56b019ceb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f56a800cad0 tx=0x7f56a800cf90 comp rx=0 tx=0).stop 2024-09-19T08:10:17.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.430+0000 7f56b5129640 1 -- 172.21.15.27:0/1210971608 shutdown_connections 2024-09-19T08:10:17.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.430+0000 7f56b5129640 1 --2- 172.21.15.27:0/1210971608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b01082a0 0x7f56b019ceb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:17.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.430+0000 7f56b5129640 1 --2- 172.21.15.27:0/1210971608 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f56980a32d0 0x7f56980a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:17.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.431+0000 7f56b5129640 1 --2- 172.21.15.27:0/1210971608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56b01036e0 0x7f56b0198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:17.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.431+0000 7f56b5129640 1 --2- 172.21.15.27:0/1210971608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56b0102d30 0x7f56b01985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:17.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.431+0000 7f56b5129640 1 -- 172.21.15.27:0/1210971608 >> 172.21.15.27:0/1210971608 conn(0x7f56b00fc7d0 msgr2=0x7f56b0105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:17.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.431+0000 7f56b5129640 1 -- 172.21.15.27:0/1210971608 shutdown_connections 2024-09-19T08:10:17.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:17.431+0000 7f56b5129640 1 -- 172.21.15.27:0/1210971608 wait complete. 2024-09-19T08:10:18.122 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2024-09-19T08:10:16.932429+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654219,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":266,"num_read_kb":248,"num_write":264,"num_write_kb":3026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355872,"kb_used_data":10740,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585952,"statfs":{"total":1151940427776,"available":1151576014848,"internally_reserved":0,"allocated":10997760,"data_stored":7076151,"data_compressed":107475,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001626"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260466+0000","last_change":"2024-09-19T08:09:11.246436+0000","last_active":"2024-09-19T08:09:12.260466+0000","last_peered":"2024-09-19T08:09:12.260466+0000","last_clean":"2024-09-19T08:09:12.260466+0000","last_became_active":"2024-09-19T08:09:11.245674+0000","last_became_peered":"2024-09-19T08:09:11.245674+0000","last_unstale":"2024-09-19T08:09:12.260466+0000","last_undegraded":"2024-09-19T08:09:12.260466+0000","last_fullsized":"2024-09-19T08:09:12.260466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:46.716474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273550+0000","last_change":"2024-09-19T08:09:11.243334+0000","last_active":"2024-09-19T08:09:12.273550+0000","last_peered":"2024-09-19T08:09:12.273550+0000","last_clean":"2024-09-19T08:09:12.273550+0000","last_became_active":"2024-09-19T08:09:11.243024+0000","last_became_peered":"2024-09-19T08:09:11.243024+0000","last_unstale":"2024-09-19T08:09:12.273550+0000","last_undegraded":"2024-09-19T08:09:12.273550+0000","last_fullsized":"2024-09-19T08:09:12.273550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.060068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273553+0000","last_change":"2024-09-19T08:09:11.254655+0000","last_active":"2024-09-19T08:09:12.273553+0000","last_peered":"2024-09-19T08:09:12.273553+0000","last_clean":"2024-09-19T08:09:12.273553+0000","last_became_active":"2024-09-19T08:09:11.254292+0000","last_became_peered":"2024-09-19T08:09:11.254292+0000","last_unstale":"2024-09-19T08:09:12.273553+0000","last_undegraded":"2024-09-19T08:09:12.273553+0000","last_fullsized":"2024-09-19T08:09:12.273553+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:01.977743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.785712+0000","last_change":"2024-09-19T08:09:11.257029+0000","last_active":"2024-09-19T08:10:14.785712+0000","last_peered":"2024-09-19T08:10:14.785712+0000","last_clean":"2024-09-19T08:10:14.785712+0000","last_became_active":"2024-09-19T08:09:11.256669+0000","last_became_peered":"2024-09-19T08:09:11.256669+0000","last_unstale":"2024-09-19T08:10:14.785712+0000","last_undegraded":"2024-09-19T08:10:14.785712+0000","last_fullsized":"2024-09-19T08:10:14.785712+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:32.831036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787404+0000","last_change":"2024-09-19T08:09:11.240341+0000","last_active":"2024-09-19T08:10:14.787404+0000","last_peered":"2024-09-19T08:10:14.787404+0000","last_clean":"2024-09-19T08:10:14.787404+0000","last_became_active":"2024-09-19T08:09:11.239996+0000","last_became_peered":"2024-09-19T08:09:11.239996+0000","last_unstale":"2024-09-19T08:10:14.787404+0000","last_undegraded":"2024-09-19T08:10:14.787404+0000","last_fullsized":"2024-09-19T08:10:14.787404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:20.331791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784344+0000","last_change":"2024-09-19T08:09:11.248089+0000","last_active":"2024-09-19T08:10:14.784344+0000","last_peered":"2024-09-19T08:10:14.784344+0000","last_clean":"2024-09-19T08:10:14.784344+0000","last_became_active":"2024-09-19T08:09:11.247802+0000","last_became_peered":"2024-09-19T08:09:11.247802+0000","last_unstale":"2024-09-19T08:10:14.784344+0000","last_undegraded":"2024-09-19T08:10:14.784344+0000","last_fullsized":"2024-09-19T08:10:14.784344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.249119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786463+0000","last_change":"2024-09-19T08:09:11.246853+0000","last_active":"2024-09-19T08:10:14.786463+0000","last_peered":"2024-09-19T08:10:14.786463+0000","last_clean":"2024-09-19T08:10:14.786463+0000","last_became_active":"2024-09-19T08:09:11.246523+0000","last_became_peered":"2024-09-19T08:09:11.246523+0000","last_unstale":"2024-09-19T08:10:14.786463+0000","last_undegraded":"2024-09-19T08:10:14.786463+0000","last_fullsized":"2024-09-19T08:10:14.786463+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:54.879087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787158+0000","last_change":"2024-09-19T08:09:11.232588+0000","last_active":"2024-09-19T08:10:13.787158+0000","last_peered":"2024-09-19T08:10:13.787158+0000","last_clean":"2024-09-19T08:10:13.787158+0000","last_became_active":"2024-09-19T08:09:11.232251+0000","last_became_peered":"2024-09-19T08:09:11.232251+0000","last_unstale":"2024-09-19T08:10:13.787158+0000","last_undegraded":"2024-09-19T08:10:13.787158+0000","last_fullsized":"2024-09-19T08:10:13.787158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:57.622086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270505+0000","last_change":"2024-09-19T08:09:11.248854+0000","last_active":"2024-09-19T08:09:12.270505+0000","last_peered":"2024-09-19T08:09:12.270505+0000","last_clean":"2024-09-19T08:09:12.270505+0000","last_became_active":"2024-09-19T08:09:11.248524+0000","last_became_peered":"2024-09-19T08:09:11.248524+0000","last_unstale":"2024-09-19T08:09:12.270505+0000","last_undegraded":"2024-09-19T08:09:12.270505+0000","last_fullsized":"2024-09-19T08:09:12.270505+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:57.978974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786848+0000","last_change":"2024-09-19T08:10:14.786848+0000","last_active":"2024-09-19T08:10:14.786848+0000","last_peered":"2024-09-19T08:10:14.786848+0000","last_clean":"2024-09-19T08:10:14.786848+0000","last_became_active":"2024-09-19T08:10:14.786460+0000","last_became_peered":"2024-09-19T08:10:14.786460+0000","last_unstale":"2024-09-19T08:10:14.786848+0000","last_undegraded":"2024-09-19T08:10:14.786848+0000","last_fullsized":"2024-09-19T08:10:14.786848+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:59.430185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786917+0000","last_change":"2024-09-19T08:09:11.247604+0000","last_active":"2024-09-19T08:10:14.786917+0000","last_peered":"2024-09-19T08:10:14.786917+0000","last_clean":"2024-09-19T08:10:14.786917+0000","last_became_active":"2024-09-19T08:09:11.247264+0000","last_became_peered":"2024-09-19T08:09:11.247264+0000","last_unstale":"2024-09-19T08:10:14.786917+0000","last_undegraded":"2024-09-19T08:10:14.786917+0000","last_fullsized":"2024-09-19T08:10:14.786917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:15.315022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.785754+0000","last_change":"2024-09-19T08:09:11.253948+0000","last_active":"2024-09-19T08:10:14.785754+0000","last_peered":"2024-09-19T08:10:14.785754+0000","last_clean":"2024-09-19T08:10:14.785754+0000","last_became_active":"2024-09-19T08:09:11.253402+0000","last_became_peered":"2024-09-19T08:09:11.253402+0000","last_unstale":"2024-09-19T08:10:14.785754+0000","last_undegraded":"2024-09-19T08:10:14.785754+0000","last_fullsized":"2024-09-19T08:10:14.785754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:04.884541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783801+0000","last_change":"2024-09-19T08:09:11.241770+0000","last_active":"2024-09-19T08:10:14.783801+0000","last_peered":"2024-09-19T08:10:14.783801+0000","last_clean":"2024-09-19T08:10:14.783801+0000","last_became_active":"2024-09-19T08:09:11.241356+0000","last_became_peered":"2024-09-19T08:09:11.241356+0000","last_unstale":"2024-09-19T08:10:14.783801+0000","last_undegraded":"2024-09-19T08:10:14.783801+0000","last_fullsized":"2024-09-19T08:10:14.783801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:02.722445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272890+0000","last_change":"2024-09-19T08:09:11.242874+0000","last_active":"2024-09-19T08:09:12.272890+0000","last_peered":"2024-09-19T08:09:12.272890+0000","last_clean":"2024-09-19T08:09:12.272890+0000","last_became_active":"2024-09-19T08:09:11.242383+0000","last_became_peered":"2024-09-19T08:09:11.242383+0000","last_unstale":"2024-09-19T08:09:12.272890+0000","last_undegraded":"2024-09-19T08:09:12.272890+0000","last_fullsized":"2024-09-19T08:09:12.272890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:51.900211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272762+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:09:12.272762+0000","last_peered":"2024-09-19T08:09:12.272762+0000","last_clean":"2024-09-19T08:09:12.272762+0000","last_became_active":"2024-09-19T08:09:11.250797+0000","last_became_peered":"2024-09-19T08:09:11.250797+0000","last_unstale":"2024-09-19T08:09:12.272762+0000","last_undegraded":"2024-09-19T08:09:12.272762+0000","last_fullsized":"2024-09-19T08:09:12.272762+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:46.183857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269901+0000","last_change":"2024-09-19T08:09:11.250884+0000","last_active":"2024-09-19T08:09:12.269901+0000","last_peered":"2024-09-19T08:09:12.269901+0000","last_clean":"2024-09-19T08:09:12.269901+0000","last_became_active":"2024-09-19T08:09:11.250543+0000","last_became_peered":"2024-09-19T08:09:11.250543+0000","last_unstale":"2024-09-19T08:09:12.269901+0000","last_undegraded":"2024-09-19T08:09:12.269901+0000","last_fullsized":"2024-09-19T08:09:12.269901+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.259466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260519+0000","last_change":"2024-09-19T08:09:11.246705+0000","last_active":"2024-09-19T08:09:12.260519+0000","last_peered":"2024-09-19T08:09:12.260519+0000","last_clean":"2024-09-19T08:09:12.260519+0000","last_became_active":"2024-09-19T08:09:11.246117+0000","last_became_peered":"2024-09-19T08:09:11.246117+0000","last_unstale":"2024-09-19T08:09:12.260519+0000","last_undegraded":"2024-09-19T08:09:12.260519+0000","last_fullsized":"2024-09-19T08:09:12.260519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:07.421222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272544+0000","last_change":"2024-09-19T08:09:11.242181+0000","last_active":"2024-09-19T08:09:12.272544+0000","last_peered":"2024-09-19T08:09:12.272544+0000","last_clean":"2024-09-19T08:09:12.272544+0000","last_became_active":"2024-09-19T08:09:11.241882+0000","last_became_peered":"2024-09-19T08:09:11.241882+0000","last_unstale":"2024-09-19T08:09:12.272544+0000","last_undegraded":"2024-09-19T08:09:12.272544+0000","last_fullsized":"2024-09-19T08:09:12.272544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:35.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270253+0000","last_change":"2024-09-19T08:09:11.246038+0000","last_active":"2024-09-19T08:09:12.270253+0000","last_peered":"2024-09-19T08:09:12.270253+0000","last_clean":"2024-09-19T08:09:12.270253+0000","last_became_active":"2024-09-19T08:09:11.245554+0000","last_became_peered":"2024-09-19T08:09:11.245554+0000","last_unstale":"2024-09-19T08:09:12.270253+0000","last_undegraded":"2024-09-19T08:09:12.270253+0000","last_fullsized":"2024-09-19T08:09:12.270253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:14.512425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260222+0000","last_change":"2024-09-19T08:09:11.249246+0000","last_active":"2024-09-19T08:09:12.260222+0000","last_peered":"2024-09-19T08:09:12.260222+0000","last_clean":"2024-09-19T08:09:12.260222+0000","last_became_active":"2024-09-19T08:09:11.248896+0000","last_became_peered":"2024-09-19T08:09:11.248896+0000","last_unstale":"2024-09-19T08:09:12.260222+0000","last_undegraded":"2024-09-19T08:09:12.260222+0000","last_fullsized":"2024-09-19T08:09:12.260222+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:40.406924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783875+0000","last_change":"2024-09-19T08:09:11.245421+0000","last_active":"2024-09-19T08:10:14.783875+0000","last_peered":"2024-09-19T08:10:14.783875+0000","last_clean":"2024-09-19T08:10:14.783875+0000","last_became_active":"2024-09-19T08:09:11.245071+0000","last_became_peered":"2024-09-19T08:09:11.245071+0000","last_unstale":"2024-09-19T08:10:14.783875+0000","last_undegraded":"2024-09-19T08:10:14.783875+0000","last_fullsized":"2024-09-19T08:10:14.783875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:58.594399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270143+0000","last_change":"2024-09-19T08:09:11.246097+0000","last_active":"2024-09-19T08:09:12.270143+0000","last_peered":"2024-09-19T08:09:12.270143+0000","last_clean":"2024-09-19T08:09:12.270143+0000","last_became_active":"2024-09-19T08:09:11.245741+0000","last_became_peered":"2024-09-19T08:09:11.245741+0000","last_unstale":"2024-09-19T08:09:12.270143+0000","last_undegraded":"2024-09-19T08:09:12.270143+0000","last_fullsized":"2024-09-19T08:09:12.270143+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:05.731148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787472+0000","last_change":"2024-09-19T08:09:11.251485+0000","last_active":"2024-09-19T08:10:13.787472+0000","last_peered":"2024-09-19T08:10:13.787472+0000","last_clean":"2024-09-19T08:10:13.787472+0000","last_became_active":"2024-09-19T08:09:11.251151+0000","last_became_peered":"2024-09-19T08:09:11.251151+0000","last_unstale":"2024-09-19T08:10:13.787472+0000","last_undegraded":"2024-09-19T08:10:13.787472+0000","last_fullsized":"2024-09-19T08:10:13.787472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:47.231056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787056+0000","last_change":"2024-09-19T08:09:11.234490+0000","last_active":"2024-09-19T08:10:13.787056+0000","last_peered":"2024-09-19T08:10:13.787056+0000","last_clean":"2024-09-19T08:10:13.787056+0000","last_became_active":"2024-09-19T08:09:11.234163+0000","last_became_peered":"2024-09-19T08:09:11.234163+0000","last_unstale":"2024-09-19T08:10:13.787056+0000","last_undegraded":"2024-09-19T08:10:13.787056+0000","last_fullsized":"2024-09-19T08:10:13.787056+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.610165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.788266+0000","last_change":"2024-09-19T08:09:11.247189+0000","last_active":"2024-09-19T08:10:13.788266+0000","last_peered":"2024-09-19T08:10:13.788266+0000","last_clean":"2024-09-19T08:10:13.788266+0000","last_became_active":"2024-09-19T08:09:11.246844+0000","last_became_peered":"2024-09-19T08:09:11.246844+0000","last_unstale":"2024-09-19T08:10:13.788266+0000","last_undegraded":"2024-09-19T08:10:13.788266+0000","last_fullsized":"2024-09-19T08:10:13.788266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:50.764694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273859+0000","last_change":"2024-09-19T08:09:11.251655+0000","last_active":"2024-09-19T08:09:12.273859+0000","last_peered":"2024-09-19T08:09:12.273859+0000","last_clean":"2024-09-19T08:09:12.273859+0000","last_became_active":"2024-09-19T08:09:11.250930+0000","last_became_peered":"2024-09-19T08:09:11.250930+0000","last_unstale":"2024-09-19T08:09:12.273859+0000","last_undegraded":"2024-09-19T08:09:12.273859+0000","last_fullsized":"2024-09-19T08:09:12.273859+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:17.658277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260441+0000","last_change":"2024-09-19T08:09:11.248095+0000","last_active":"2024-09-19T08:09:12.260441+0000","last_peered":"2024-09-19T08:09:12.260441+0000","last_clean":"2024-09-19T08:09:12.260441+0000","last_became_active":"2024-09-19T08:09:11.247719+0000","last_became_peered":"2024-09-19T08:09:11.247719+0000","last_unstale":"2024-09-19T08:09:12.260441+0000","last_undegraded":"2024-09-19T08:09:12.260441+0000","last_fullsized":"2024-09-19T08:09:12.260441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:26.701140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783926+0000","last_change":"2024-09-19T08:09:11.243232+0000","last_active":"2024-09-19T08:10:14.783926+0000","last_peered":"2024-09-19T08:10:14.783926+0000","last_clean":"2024-09-19T08:10:14.783926+0000","last_became_active":"2024-09-19T08:09:11.242927+0000","last_became_peered":"2024-09-19T08:09:11.242927+0000","last_unstale":"2024-09-19T08:10:14.783926+0000","last_undegraded":"2024-09-19T08:10:14.783926+0000","last_fullsized":"2024-09-19T08:10:14.783926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:19.877520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273190+0000","last_change":"2024-09-19T08:09:11.249588+0000","last_active":"2024-09-19T08:09:12.273190+0000","last_peered":"2024-09-19T08:09:12.273190+0000","last_clean":"2024-09-19T08:09:12.273190+0000","last_became_active":"2024-09-19T08:09:11.249266+0000","last_became_peered":"2024-09-19T08:09:11.249266+0000","last_unstale":"2024-09-19T08:09:12.273190+0000","last_undegraded":"2024-09-19T08:09:12.273190+0000","last_fullsized":"2024-09-19T08:09:12.273190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:43.332454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272135+0000","last_change":"2024-09-19T08:09:11.245866+0000","last_active":"2024-09-19T08:09:12.272135+0000","last_peered":"2024-09-19T08:09:12.272135+0000","last_clean":"2024-09-19T08:09:12.272135+0000","last_became_active":"2024-09-19T08:09:11.245505+0000","last_became_peered":"2024-09-19T08:09:11.245505+0000","last_unstale":"2024-09-19T08:09:12.272135+0000","last_undegraded":"2024-09-19T08:09:12.272135+0000","last_fullsized":"2024-09-19T08:09:12.272135+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:38.203790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270471+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:09:12.270471+0000","last_peered":"2024-09-19T08:09:12.270471+0000","last_clean":"2024-09-19T08:09:12.270471+0000","last_became_active":"2024-09-19T08:09:11.250745+0000","last_became_peered":"2024-09-19T08:09:11.250745+0000","last_unstale":"2024-09-19T08:09:12.270471+0000","last_undegraded":"2024-09-19T08:09:12.270471+0000","last_fullsized":"2024-09-19T08:09:12.270471+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:16.851230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260162+0000","last_change":"2024-09-19T08:09:11.255211+0000","last_active":"2024-09-19T08:09:12.260162+0000","last_peered":"2024-09-19T08:09:12.260162+0000","last_clean":"2024-09-19T08:09:12.260162+0000","last_became_active":"2024-09-19T08:09:11.254853+0000","last_became_peered":"2024-09-19T08:09:11.254853+0000","last_unstale":"2024-09-19T08:09:12.260162+0000","last_undegraded":"2024-09-19T08:09:12.260162+0000","last_fullsized":"2024-09-19T08:09:12.260162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.497502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.788405+0000","last_change":"2024-09-19T08:09:11.247201+0000","last_active":"2024-09-19T08:10:14.788405+0000","last_peered":"2024-09-19T08:10:14.788405+0000","last_clean":"2024-09-19T08:10:14.788405+0000","last_became_active":"2024-09-19T08:09:11.246854+0000","last_became_peered":"2024-09-19T08:09:11.246854+0000","last_unstale":"2024-09-19T08:10:14.788405+0000","last_undegraded":"2024-09-19T08:10:14.788405+0000","last_fullsized":"2024-09-19T08:10:14.788405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:19.262849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786157+0000","last_change":"2024-09-19T08:09:09.113754+0000","last_active":"2024-09-19T08:10:13.786157+0000","last_peered":"2024-09-19T08:10:13.786157+0000","last_clean":"2024-09-19T08:10:13.786157+0000","last_became_active":"2024-09-19T08:09:09.113389+0000","last_became_peered":"2024-09-19T08:09:09.113389+0000","last_unstale":"2024-09-19T08:10:13.786157+0000","last_undegraded":"2024-09-19T08:10:13.786157+0000","last_fullsized":"2024-09-19T08:10:13.786157+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:45.325895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786050+0000","last_change":"2024-09-19T08:09:11.244625+0000","last_active":"2024-09-19T08:10:13.786050+0000","last_peered":"2024-09-19T08:10:13.786050+0000","last_clean":"2024-09-19T08:10:13.786050+0000","last_became_active":"2024-09-19T08:09:11.244277+0000","last_became_peered":"2024-09-19T08:09:11.244277+0000","last_unstale":"2024-09-19T08:10:13.786050+0000","last_undegraded":"2024-09-19T08:10:13.786050+0000","last_fullsized":"2024-09-19T08:10:13.786050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:33:34.050343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784461+0000","last_change":"2024-09-19T08:09:09.116735+0000","last_active":"2024-09-19T08:10:14.784461+0000","last_peered":"2024-09-19T08:10:14.784461+0000","last_clean":"2024-09-19T08:10:14.784461+0000","last_became_active":"2024-09-19T08:09:09.116356+0000","last_became_peered":"2024-09-19T08:09:09.116356+0000","last_unstale":"2024-09-19T08:10:14.784461+0000","last_undegraded":"2024-09-19T08:10:14.784461+0000","last_fullsized":"2024-09-19T08:10:14.784461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:50.952567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783987+0000","last_change":"2024-09-19T08:09:09.113182+0000","last_active":"2024-09-19T08:10:14.783987+0000","last_peered":"2024-09-19T08:10:14.783987+0000","last_clean":"2024-09-19T08:10:14.783987+0000","last_became_active":"2024-09-19T08:09:09.112528+0000","last_became_peered":"2024-09-19T08:09:09.112528+0000","last_unstale":"2024-09-19T08:10:14.783987+0000","last_undegraded":"2024-09-19T08:10:14.783987+0000","last_fullsized":"2024-09-19T08:10:14.783987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:07.647351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787258+0000","last_change":"2024-09-19T08:09:11.241639+0000","last_active":"2024-09-19T08:10:13.787258+0000","last_peered":"2024-09-19T08:10:13.787258+0000","last_clean":"2024-09-19T08:10:13.787258+0000","last_became_active":"2024-09-19T08:09:11.241308+0000","last_became_peered":"2024-09-19T08:09:11.241308+0000","last_unstale":"2024-09-19T08:10:13.787258+0000","last_undegraded":"2024-09-19T08:10:13.787258+0000","last_fullsized":"2024-09-19T08:10:13.787258+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:57.826870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787237+0000","last_change":"2024-09-19T08:09:09.118334+0000","last_active":"2024-09-19T08:10:13.787237+0000","last_peered":"2024-09-19T08:10:13.787237+0000","last_clean":"2024-09-19T08:10:13.787237+0000","last_became_active":"2024-09-19T08:09:09.118010+0000","last_became_peered":"2024-09-19T08:09:09.118010+0000","last_unstale":"2024-09-19T08:10:13.787237+0000","last_undegraded":"2024-09-19T08:10:13.787237+0000","last_fullsized":"2024-09-19T08:10:13.787237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:51.046598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272762+0000","last_change":"2024-09-19T08:09:11.239990+0000","last_active":"2024-09-19T08:09:12.272762+0000","last_peered":"2024-09-19T08:09:12.272762+0000","last_clean":"2024-09-19T08:09:12.272762+0000","last_became_active":"2024-09-19T08:09:11.239643+0000","last_became_peered":"2024-09-19T08:09:11.239643+0000","last_unstale":"2024-09-19T08:09:12.272762+0000","last_undegraded":"2024-09-19T08:09:12.272762+0000","last_fullsized":"2024-09-19T08:09:12.272762+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:07.078244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784982+0000","last_change":"2024-09-19T08:09:09.114397+0000","last_active":"2024-09-19T08:10:14.784982+0000","last_peered":"2024-09-19T08:10:14.784982+0000","last_clean":"2024-09-19T08:10:14.784982+0000","last_became_active":"2024-09-19T08:09:09.114051+0000","last_became_peered":"2024-09-19T08:09:09.114051+0000","last_unstale":"2024-09-19T08:10:14.784982+0000","last_undegraded":"2024-09-19T08:10:14.784982+0000","last_fullsized":"2024-09-19T08:10:14.784982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:41.799442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270435+0000","last_change":"2024-09-19T08:09:11.254802+0000","last_active":"2024-09-19T08:09:12.270435+0000","last_peered":"2024-09-19T08:09:12.270435+0000","last_clean":"2024-09-19T08:09:12.270435+0000","last_became_active":"2024-09-19T08:09:11.253869+0000","last_became_peered":"2024-09-19T08:09:11.253869+0000","last_unstale":"2024-09-19T08:09:12.270435+0000","last_undegraded":"2024-09-19T08:09:12.270435+0000","last_fullsized":"2024-09-19T08:09:12.270435+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:00.164834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786687+0000","last_change":"2024-09-19T08:09:09.118585+0000","last_active":"2024-09-19T08:10:14.786687+0000","last_peered":"2024-09-19T08:10:14.786687+0000","last_clean":"2024-09-19T08:10:14.786687+0000","last_became_active":"2024-09-19T08:09:09.118216+0000","last_became_peered":"2024-09-19T08:09:09.118216+0000","last_unstale":"2024-09-19T08:10:14.786687+0000","last_undegraded":"2024-09-19T08:10:14.786687+0000","last_fullsized":"2024-09-19T08:10:14.786687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:41.905746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274037+0000","last_change":"2024-09-19T08:09:11.249835+0000","last_active":"2024-09-19T08:09:12.274037+0000","last_peered":"2024-09-19T08:09:12.274037+0000","last_clean":"2024-09-19T08:09:12.274037+0000","last_became_active":"2024-09-19T08:09:11.249443+0000","last_became_peered":"2024-09-19T08:09:11.249443+0000","last_unstale":"2024-09-19T08:09:12.274037+0000","last_undegraded":"2024-09-19T08:09:12.274037+0000","last_fullsized":"2024-09-19T08:09:12.274037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:06.373126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786711+0000","last_change":"2024-09-19T08:09:09.242565+0000","last_active":"2024-09-19T08:10:13.786711+0000","last_peered":"2024-09-19T08:10:13.786711+0000","last_clean":"2024-09-19T08:10:13.786711+0000","last_became_active":"2024-09-19T08:09:09.242199+0000","last_became_peered":"2024-09-19T08:09:09.242199+0000","last_unstale":"2024-09-19T08:10:13.786711+0000","last_undegraded":"2024-09-19T08:10:13.786711+0000","last_fullsized":"2024-09-19T08:10:13.786711+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:33.195385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270121+0000","last_change":"2024-09-19T08:09:11.251682+0000","last_active":"2024-09-19T08:09:12.270121+0000","last_peered":"2024-09-19T08:09:12.270121+0000","last_clean":"2024-09-19T08:09:12.270121+0000","last_became_active":"2024-09-19T08:09:11.251037+0000","last_became_peered":"2024-09-19T08:09:11.251037+0000","last_unstale":"2024-09-19T08:09:12.270121+0000","last_undegraded":"2024-09-19T08:09:12.270121+0000","last_fullsized":"2024-09-19T08:09:12.270121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:29.518828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":173,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:16.402993+0000","last_change":"2024-09-19T08:09:09.119090+0000","last_active":"2024-09-19T08:10:16.402993+0000","last_peered":"2024-09-19T08:10:16.402993+0000","last_clean":"2024-09-19T08:10:16.402993+0000","last_became_active":"2024-09-19T08:09:09.118685+0000","last_became_peered":"2024-09-19T08:09:09.118685+0000","last_unstale":"2024-09-19T08:10:16.402993+0000","last_undegraded":"2024-09-19T08:10:16.402993+0000","last_fullsized":"2024-09-19T08:10:16.402993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:21.540404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62819,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":123,"num_write":27,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.788088+0000","last_change":"2024-09-19T08:09:11.243200+0000","last_active":"2024-09-19T08:10:14.788088+0000","last_peered":"2024-09-19T08:10:14.788088+0000","last_clean":"2024-09-19T08:10:14.788088+0000","last_became_active":"2024-09-19T08:09:11.242873+0000","last_became_peered":"2024-09-19T08:09:11.242873+0000","last_unstale":"2024-09-19T08:10:14.788088+0000","last_undegraded":"2024-09-19T08:10:14.788088+0000","last_fullsized":"2024-09-19T08:10:14.788088+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:35.817609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.278392+0000","last_change":"2024-09-19T08:09:09.117117+0000","last_active":"2024-09-19T08:09:12.278392+0000","last_peered":"2024-09-19T08:09:12.278392+0000","last_clean":"2024-09-19T08:09:12.278392+0000","last_became_active":"2024-09-19T08:09:09.116512+0000","last_became_peered":"2024-09-19T08:09:09.116512+0000","last_unstale":"2024-09-19T08:09:12.278392+0000","last_undegraded":"2024-09-19T08:09:12.278392+0000","last_fullsized":"2024-09-19T08:09:12.278392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:15.010570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783609+0000","last_change":"2024-09-19T08:09:11.246648+0000","last_active":"2024-09-19T08:10:14.783609+0000","last_peered":"2024-09-19T08:10:14.783609+0000","last_clean":"2024-09-19T08:10:14.783609+0000","last_became_active":"2024-09-19T08:09:11.246317+0000","last_became_peered":"2024-09-19T08:09:11.246317+0000","last_unstale":"2024-09-19T08:10:14.783609+0000","last_undegraded":"2024-09-19T08:10:14.783609+0000","last_fullsized":"2024-09-19T08:10:14.783609+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:43.285257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786532+0000","last_change":"2024-09-19T08:09:09.112599+0000","last_active":"2024-09-19T08:10:13.786532+0000","last_peered":"2024-09-19T08:10:13.786532+0000","last_clean":"2024-09-19T08:10:13.786532+0000","last_became_active":"2024-09-19T08:09:09.112281+0000","last_became_peered":"2024-09-19T08:09:09.112281+0000","last_unstale":"2024-09-19T08:10:13.786532+0000","last_undegraded":"2024-09-19T08:10:13.786532+0000","last_fullsized":"2024-09-19T08:10:13.786532+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:47.710235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787152+0000","last_change":"2024-09-19T08:09:11.253814+0000","last_active":"2024-09-19T08:10:14.787152+0000","last_peered":"2024-09-19T08:10:14.787152+0000","last_clean":"2024-09-19T08:10:14.787152+0000","last_became_active":"2024-09-19T08:09:11.253490+0000","last_became_peered":"2024-09-19T08:09:11.253490+0000","last_unstale":"2024-09-19T08:10:14.787152+0000","last_undegraded":"2024-09-19T08:10:14.787152+0000","last_fullsized":"2024-09-19T08:10:14.787152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:09.287110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.785412+0000","last_change":"2024-09-19T08:09:09.114820+0000","last_active":"2024-09-19T08:10:14.785412+0000","last_peered":"2024-09-19T08:10:14.785412+0000","last_clean":"2024-09-19T08:10:14.785412+0000","last_became_active":"2024-09-19T08:09:09.114478+0000","last_became_peered":"2024-09-19T08:09:09.114478+0000","last_unstale":"2024-09-19T08:10:14.785412+0000","last_undegraded":"2024-09-19T08:10:14.785412+0000","last_fullsized":"2024-09-19T08:10:14.785412+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:24.243629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.789301+0000","last_change":"2024-09-19T08:10:14.789301+0000","last_active":"2024-09-19T08:10:14.789301+0000","last_peered":"2024-09-19T08:10:14.789301+0000","last_clean":"2024-09-19T08:10:14.789301+0000","last_became_active":"2024-09-19T08:10:14.788891+0000","last_became_peered":"2024-09-19T08:10:14.788891+0000","last_unstale":"2024-09-19T08:10:14.789301+0000","last_undegraded":"2024-09-19T08:10:14.789301+0000","last_fullsized":"2024-09-19T08:10:14.789301+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:03.142177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.279583+0000","last_change":"2024-09-19T08:09:09.244136+0000","last_active":"2024-09-19T08:09:12.279583+0000","last_peered":"2024-09-19T08:09:12.279583+0000","last_clean":"2024-09-19T08:09:12.279583+0000","last_became_active":"2024-09-19T08:09:09.243776+0000","last_became_peered":"2024-09-19T08:09:09.243776+0000","last_unstale":"2024-09-19T08:09:12.279583+0000","last_undegraded":"2024-09-19T08:09:12.279583+0000","last_fullsized":"2024-09-19T08:09:12.279583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:01.711310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786314+0000","last_change":"2024-09-19T08:09:11.245399+0000","last_active":"2024-09-19T08:10:13.786314+0000","last_peered":"2024-09-19T08:10:13.786314+0000","last_clean":"2024-09-19T08:10:13.786314+0000","last_became_active":"2024-09-19T08:09:11.245055+0000","last_became_peered":"2024-09-19T08:09:11.245055+0000","last_unstale":"2024-09-19T08:10:13.786314+0000","last_undegraded":"2024-09-19T08:10:13.786314+0000","last_fullsized":"2024-09-19T08:10:13.786314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:57.639205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.788242+0000","last_change":"2024-09-19T08:09:09.115252+0000","last_active":"2024-09-19T08:10:14.788242+0000","last_peered":"2024-09-19T08:10:14.788242+0000","last_clean":"2024-09-19T08:10:14.788242+0000","last_became_active":"2024-09-19T08:09:09.114908+0000","last_became_peered":"2024-09-19T08:09:09.114908+0000","last_unstale":"2024-09-19T08:10:14.788242+0000","last_undegraded":"2024-09-19T08:10:14.788242+0000","last_fullsized":"2024-09-19T08:10:14.788242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:48.326221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260384+0000","last_change":"2024-09-19T08:09:11.249189+0000","last_active":"2024-09-19T08:09:12.260384+0000","last_peered":"2024-09-19T08:09:12.260384+0000","last_clean":"2024-09-19T08:09:12.260384+0000","last_became_active":"2024-09-19T08:09:11.248797+0000","last_became_peered":"2024-09-19T08:09:11.248797+0000","last_unstale":"2024-09-19T08:09:12.260384+0000","last_undegraded":"2024-09-19T08:09:12.260384+0000","last_fullsized":"2024-09-19T08:09:12.260384+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:20.915638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783784+0000","last_change":"2024-09-19T08:09:09.112973+0000","last_active":"2024-09-19T08:10:14.783784+0000","last_peered":"2024-09-19T08:10:14.783784+0000","last_clean":"2024-09-19T08:10:14.783784+0000","last_became_active":"2024-09-19T08:09:09.112616+0000","last_became_peered":"2024-09-19T08:09:09.112616+0000","last_unstale":"2024-09-19T08:10:14.783784+0000","last_undegraded":"2024-09-19T08:10:14.783784+0000","last_fullsized":"2024-09-19T08:10:14.783784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:13.791926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787430+0000","last_change":"2024-09-19T08:09:11.240739+0000","last_active":"2024-09-19T08:10:14.787430+0000","last_peered":"2024-09-19T08:10:14.787430+0000","last_clean":"2024-09-19T08:10:14.787430+0000","last_became_active":"2024-09-19T08:09:11.240340+0000","last_became_peered":"2024-09-19T08:09:11.240340+0000","last_unstale":"2024-09-19T08:10:14.787430+0000","last_undegraded":"2024-09-19T08:10:14.787430+0000","last_fullsized":"2024-09-19T08:10:14.787430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:35.450279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786744+0000","last_change":"2024-09-19T08:09:09.112516+0000","last_active":"2024-09-19T08:10:13.786744+0000","last_peered":"2024-09-19T08:10:13.786744+0000","last_clean":"2024-09-19T08:10:13.786744+0000","last_became_active":"2024-09-19T08:09:09.112140+0000","last_became_peered":"2024-09-19T08:09:09.112140+0000","last_unstale":"2024-09-19T08:10:13.786744+0000","last_undegraded":"2024-09-19T08:10:13.786744+0000","last_fullsized":"2024-09-19T08:10:13.786744+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:05.434331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786545+0000","last_change":"2024-09-19T08:09:11.252163+0000","last_active":"2024-09-19T08:10:14.786545+0000","last_peered":"2024-09-19T08:10:14.786545+0000","last_clean":"2024-09-19T08:10:14.786545+0000","last_became_active":"2024-09-19T08:09:11.251762+0000","last_became_peered":"2024-09-19T08:09:11.251762+0000","last_unstale":"2024-09-19T08:10:14.786545+0000","last_undegraded":"2024-09-19T08:10:14.786545+0000","last_fullsized":"2024-09-19T08:10:14.786545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:33.941910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.789183+0000","last_change":"2024-09-19T08:10:14.788460+0000","last_active":"2024-09-19T08:10:14.789183+0000","last_peered":"2024-09-19T08:10:14.789183+0000","last_clean":"2024-09-19T08:10:14.789183+0000","last_became_active":"2024-09-19T08:10:14.787990+0000","last_became_peered":"2024-09-19T08:10:14.787990+0000","last_unstale":"2024-09-19T08:10:14.789183+0000","last_undegraded":"2024-09-19T08:10:14.789183+0000","last_fullsized":"2024-09-19T08:10:14.789183+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:24.549994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787042+0000","last_change":"2024-09-19T08:09:11.242438+0000","last_active":"2024-09-19T08:10:14.787042+0000","last_peered":"2024-09-19T08:10:14.787042+0000","last_clean":"2024-09-19T08:10:14.787042+0000","last_became_active":"2024-09-19T08:09:11.242114+0000","last_became_peered":"2024-09-19T08:09:11.242114+0000","last_unstale":"2024-09-19T08:10:14.787042+0000","last_undegraded":"2024-09-19T08:10:14.787042+0000","last_fullsized":"2024-09-19T08:10:14.787042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:54.183012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":345,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787300+0000","last_change":"2024-09-19T08:07:55.287566+0000","last_active":"2024-09-19T08:10:14.787300+0000","last_peered":"2024-09-19T08:10:14.787300+0000","last_clean":"2024-09-19T08:10:14.787300+0000","last_became_active":"2024-09-19T08:07:55.287037+0000","last_became_peered":"2024-09-19T08:07:55.287037+0000","last_unstale":"2024-09-19T08:10:14.787300+0000","last_undegraded":"2024-09-19T08:10:14.787300+0000","last_fullsized":"2024-09-19T08:10:14.787300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_clean_scrub_stamp":"2024-09-19T08:04:29.468857+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:49.553882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784592+0000","last_change":"2024-09-19T08:09:09.113497+0000","last_active":"2024-09-19T08:10:14.784592+0000","last_peered":"2024-09-19T08:10:14.784592+0000","last_clean":"2024-09-19T08:10:14.784592+0000","last_became_active":"2024-09-19T08:09:09.112546+0000","last_became_peered":"2024-09-19T08:09:09.112546+0000","last_unstale":"2024-09-19T08:10:14.784592+0000","last_undegraded":"2024-09-19T08:10:14.784592+0000","last_fullsized":"2024-09-19T08:10:14.784592+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:09.906476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787709+0000","last_change":"2024-09-19T08:09:11.241478+0000","last_active":"2024-09-19T08:10:13.787709+0000","last_peered":"2024-09-19T08:10:13.787709+0000","last_clean":"2024-09-19T08:10:13.787709+0000","last_became_active":"2024-09-19T08:09:11.241138+0000","last_became_peered":"2024-09-19T08:09:11.241138+0000","last_unstale":"2024-09-19T08:10:13.787709+0000","last_undegraded":"2024-09-19T08:10:13.787709+0000","last_fullsized":"2024-09-19T08:10:13.787709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:32.884491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787410+0000","last_change":"2024-09-19T08:09:09.116571+0000","last_active":"2024-09-19T08:10:14.787410+0000","last_peered":"2024-09-19T08:10:14.787410+0000","last_clean":"2024-09-19T08:10:14.787410+0000","last_became_active":"2024-09-19T08:09:09.116180+0000","last_became_peered":"2024-09-19T08:09:09.116180+0000","last_unstale":"2024-09-19T08:10:14.787410+0000","last_undegraded":"2024-09-19T08:10:14.787410+0000","last_fullsized":"2024-09-19T08:10:14.787410+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:58.577320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.791196+0000","last_change":"2024-09-19T08:10:14.791196+0000","last_active":"2024-09-19T08:10:14.791196+0000","last_peered":"2024-09-19T08:10:14.791196+0000","last_clean":"2024-09-19T08:10:14.791196+0000","last_became_active":"2024-09-19T08:10:14.790873+0000","last_became_peered":"2024-09-19T08:10:14.790873+0000","last_unstale":"2024-09-19T08:10:14.791196+0000","last_undegraded":"2024-09-19T08:10:14.791196+0000","last_fullsized":"2024-09-19T08:10:14.791196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:41.725521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784061+0000","last_change":"2024-09-19T08:09:09.242166+0000","last_active":"2024-09-19T08:10:14.784061+0000","last_peered":"2024-09-19T08:10:14.784061+0000","last_clean":"2024-09-19T08:10:14.784061+0000","last_became_active":"2024-09-19T08:09:09.241270+0000","last_became_peered":"2024-09-19T08:09:09.241270+0000","last_unstale":"2024-09-19T08:10:14.784061+0000","last_undegraded":"2024-09-19T08:10:14.784061+0000","last_fullsized":"2024-09-19T08:10:14.784061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:51.899069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-19T08:09:14.748141+0000","last_change":"2024-09-19T08:10:13.786269+0000","last_active":"2024-09-19T08:10:13.786269+0000","last_peered":"2024-09-19T08:09:14.748141+0000","last_clean":"2024-09-19T08:09:14.748141+0000","last_became_active":"2024-09-19T08:09:11.252219+0000","last_became_peered":"2024-09-19T08:09:11.252219+0000","last_unstale":"2024-09-19T08:09:14.748141+0000","last_undegraded":"2024-09-19T08:09:14.748141+0000","last_fullsized":"2024-09-19T08:09:14.748141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,8],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786956+0000","last_change":"2024-09-19T08:09:09.118790+0000","last_active":"2024-09-19T08:10:14.786956+0000","last_peered":"2024-09-19T08:10:14.786956+0000","last_clean":"2024-09-19T08:10:14.786956+0000","last_became_active":"2024-09-19T08:09:09.117695+0000","last_became_peered":"2024-09-19T08:09:09.117695+0000","last_unstale":"2024-09-19T08:10:14.786956+0000","last_undegraded":"2024-09-19T08:10:14.786956+0000","last_fullsized":"2024-09-19T08:10:14.786956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:40.674039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784329+0000","last_change":"2024-09-19T08:09:11.249386+0000","last_active":"2024-09-19T08:10:14.784329+0000","last_peered":"2024-09-19T08:10:14.784329+0000","last_clean":"2024-09-19T08:10:14.784329+0000","last_became_active":"2024-09-19T08:09:11.249004+0000","last_became_peered":"2024-09-19T08:09:11.249004+0000","last_unstale":"2024-09-19T08:10:14.784329+0000","last_undegraded":"2024-09-19T08:10:14.784329+0000","last_fullsized":"2024-09-19T08:10:14.784329+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:50.170799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272215+0000","last_change":"2024-09-19T08:09:09.241599+0000","last_active":"2024-09-19T08:09:12.272215+0000","last_peered":"2024-09-19T08:09:12.272215+0000","last_clean":"2024-09-19T08:09:12.272215+0000","last_became_active":"2024-09-19T08:09:09.241226+0000","last_became_peered":"2024-09-19T08:09:09.241226+0000","last_unstale":"2024-09-19T08:09:12.272215+0000","last_undegraded":"2024-09-19T08:09:12.272215+0000","last_fullsized":"2024-09-19T08:09:12.272215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:19.590966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784610+0000","last_change":"2024-09-19T08:09:11.238098+0000","last_active":"2024-09-19T08:10:14.784610+0000","last_peered":"2024-09-19T08:10:14.784610+0000","last_clean":"2024-09-19T08:10:14.784610+0000","last_became_active":"2024-09-19T08:09:11.237737+0000","last_became_peered":"2024-09-19T08:09:11.237737+0000","last_unstale":"2024-09-19T08:10:14.784610+0000","last_undegraded":"2024-09-19T08:10:14.784610+0000","last_fullsized":"2024-09-19T08:10:14.784610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:00.134664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.788301+0000","last_change":"2024-09-19T08:09:09.241775+0000","last_active":"2024-09-19T08:10:14.788301+0000","last_peered":"2024-09-19T08:10:14.788301+0000","last_clean":"2024-09-19T08:10:14.788301+0000","last_became_active":"2024-09-19T08:09:09.241367+0000","last_became_peered":"2024-09-19T08:09:09.241367+0000","last_unstale":"2024-09-19T08:10:14.788301+0000","last_undegraded":"2024-09-19T08:10:14.788301+0000","last_fullsized":"2024-09-19T08:10:14.788301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:11.862171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783853+0000","last_change":"2024-09-19T08:09:11.251980+0000","last_active":"2024-09-19T08:10:14.783853+0000","last_peered":"2024-09-19T08:10:14.783853+0000","last_clean":"2024-09-19T08:10:14.783853+0000","last_became_active":"2024-09-19T08:09:11.251638+0000","last_became_peered":"2024-09-19T08:09:11.251638+0000","last_unstale":"2024-09-19T08:10:14.783853+0000","last_undegraded":"2024-09-19T08:10:14.783853+0000","last_fullsized":"2024-09-19T08:10:14.783853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:35.905643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'8","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:34.279466+0000","last_change":"2024-09-19T08:09:09.117150+0000","last_active":"2024-09-19T08:09:34.279466+0000","last_peered":"2024-09-19T08:09:34.279466+0000","last_clean":"2024-09-19T08:09:34.279466+0000","last_became_active":"2024-09-19T08:09:09.116763+0000","last_became_peered":"2024-09-19T08:09:09.116763+0000","last_unstale":"2024-09-19T08:09:34.279466+0000","last_undegraded":"2024-09-19T08:09:34.279466+0000","last_fullsized":"2024-09-19T08:09:34.279466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:18.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.788673+0000","last_change":"2024-09-19T08:09:11.244366+0000","last_active":"2024-09-19T08:10:13.788673+0000","last_peered":"2024-09-19T08:10:13.788673+0000","last_clean":"2024-09-19T08:10:13.788673+0000","last_became_active":"2024-09-19T08:09:11.244023+0000","last_became_peered":"2024-09-19T08:09:11.244023+0000","last_unstale":"2024-09-19T08:10:13.788673+0000","last_undegraded":"2024-09-19T08:10:13.788673+0000","last_fullsized":"2024-09-19T08:10:13.788673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:18.572377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784549+0000","last_change":"2024-09-19T08:09:09.139557+0000","last_active":"2024-09-19T08:10:14.784549+0000","last_peered":"2024-09-19T08:10:14.784549+0000","last_clean":"2024-09-19T08:10:14.784549+0000","last_became_active":"2024-09-19T08:09:09.139190+0000","last_became_peered":"2024-09-19T08:09:09.139190+0000","last_unstale":"2024-09-19T08:10:14.784549+0000","last_undegraded":"2024-09-19T08:10:14.784549+0000","last_fullsized":"2024-09-19T08:10:14.784549+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:39.270432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.273816+0000","last_change":"2024-09-19T08:09:11.249637+0000","last_active":"2024-09-19T08:09:12.273816+0000","last_peered":"2024-09-19T08:09:12.273816+0000","last_clean":"2024-09-19T08:09:12.273816+0000","last_became_active":"2024-09-19T08:09:11.249323+0000","last_became_peered":"2024-09-19T08:09:11.249323+0000","last_unstale":"2024-09-19T08:09:12.273816+0000","last_undegraded":"2024-09-19T08:09:12.273816+0000","last_fullsized":"2024-09-19T08:09:12.273816+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:28.270910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.270693+0000","last_change":"2024-09-19T08:09:09.242444+0000","last_active":"2024-09-19T08:09:12.270693+0000","last_peered":"2024-09-19T08:09:12.270693+0000","last_clean":"2024-09-19T08:09:12.270693+0000","last_became_active":"2024-09-19T08:09:09.242095+0000","last_became_peered":"2024-09-19T08:09:09.242095+0000","last_unstale":"2024-09-19T08:09:12.270693+0000","last_undegraded":"2024-09-19T08:09:12.270693+0000","last_fullsized":"2024-09-19T08:09:12.270693+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:42.941930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787131+0000","last_change":"2024-09-19T08:09:11.241588+0000","last_active":"2024-09-19T08:10:14.787131+0000","last_peered":"2024-09-19T08:10:14.787131+0000","last_clean":"2024-09-19T08:10:14.787131+0000","last_became_active":"2024-09-19T08:09:11.241076+0000","last_became_peered":"2024-09-19T08:09:11.241076+0000","last_unstale":"2024-09-19T08:10:14.787131+0000","last_undegraded":"2024-09-19T08:10:14.787131+0000","last_fullsized":"2024-09-19T08:10:14.787131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:01.676410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787630+0000","last_change":"2024-09-19T08:09:09.112494+0000","last_active":"2024-09-19T08:10:13.787630+0000","last_peered":"2024-09-19T08:10:13.787630+0000","last_clean":"2024-09-19T08:10:13.787630+0000","last_became_active":"2024-09-19T08:09:09.112019+0000","last_became_peered":"2024-09-19T08:09:09.112019+0000","last_unstale":"2024-09-19T08:10:13.787630+0000","last_undegraded":"2024-09-19T08:10:13.787630+0000","last_fullsized":"2024-09-19T08:10:13.787630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:17.674092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.260305+0000","last_change":"2024-09-19T08:09:11.251420+0000","last_active":"2024-09-19T08:09:12.260305+0000","last_peered":"2024-09-19T08:09:12.260305+0000","last_clean":"2024-09-19T08:09:12.260305+0000","last_became_active":"2024-09-19T08:09:11.251083+0000","last_became_peered":"2024-09-19T08:09:11.251083+0000","last_unstale":"2024-09-19T08:09:12.260305+0000","last_undegraded":"2024-09-19T08:09:12.260305+0000","last_fullsized":"2024-09-19T08:09:12.260305+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:38.810616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.272113+0000","last_change":"2024-09-19T08:09:09.117705+0000","last_active":"2024-09-19T08:09:12.272113+0000","last_peered":"2024-09-19T08:09:12.272113+0000","last_clean":"2024-09-19T08:09:12.272113+0000","last_became_active":"2024-09-19T08:09:09.117367+0000","last_became_peered":"2024-09-19T08:09:09.117367+0000","last_unstale":"2024-09-19T08:09:12.272113+0000","last_undegraded":"2024-09-19T08:09:12.272113+0000","last_fullsized":"2024-09-19T08:09:12.272113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:21.256227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787802+0000","last_change":"2024-09-19T08:09:11.239096+0000","last_active":"2024-09-19T08:10:13.787802+0000","last_peered":"2024-09-19T08:10:13.787802+0000","last_clean":"2024-09-19T08:10:13.787802+0000","last_became_active":"2024-09-19T08:09:11.238739+0000","last_became_peered":"2024-09-19T08:09:11.238739+0000","last_unstale":"2024-09-19T08:10:13.787802+0000","last_undegraded":"2024-09-19T08:10:13.787802+0000","last_fullsized":"2024-09-19T08:10:13.787802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:27.161174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787536+0000","last_change":"2024-09-19T08:09:09.115198+0000","last_active":"2024-09-19T08:10:14.787536+0000","last_peered":"2024-09-19T08:10:14.787536+0000","last_clean":"2024-09-19T08:10:14.787536+0000","last_became_active":"2024-09-19T08:09:09.114783+0000","last_became_peered":"2024-09-19T08:09:09.114783+0000","last_unstale":"2024-09-19T08:10:14.787536+0000","last_undegraded":"2024-09-19T08:10:14.787536+0000","last_fullsized":"2024-09-19T08:10:14.787536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:45.674774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786764+0000","last_change":"2024-09-19T08:09:11.252450+0000","last_active":"2024-09-19T08:10:14.786764+0000","last_peered":"2024-09-19T08:10:14.786764+0000","last_clean":"2024-09-19T08:10:14.786764+0000","last_became_active":"2024-09-19T08:09:11.251696+0000","last_became_peered":"2024-09-19T08:09:11.251696+0000","last_unstale":"2024-09-19T08:10:14.786764+0000","last_undegraded":"2024-09-19T08:10:14.786764+0000","last_fullsized":"2024-09-19T08:10:14.786764+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:48.179795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786579+0000","last_change":"2024-09-19T08:09:11.244571+0000","last_active":"2024-09-19T08:10:13.786579+0000","last_peered":"2024-09-19T08:10:13.786579+0000","last_clean":"2024-09-19T08:10:13.786579+0000","last_became_active":"2024-09-19T08:09:11.244217+0000","last_became_peered":"2024-09-19T08:09:11.244217+0000","last_unstale":"2024-09-19T08:10:13.786579+0000","last_undegraded":"2024-09-19T08:10:13.786579+0000","last_fullsized":"2024-09-19T08:10:13.786579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:52.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787749+0000","last_change":"2024-09-19T08:09:09.117355+0000","last_active":"2024-09-19T08:10:14.787749+0000","last_peered":"2024-09-19T08:10:14.787749+0000","last_clean":"2024-09-19T08:10:14.787749+0000","last_became_active":"2024-09-19T08:09:09.116806+0000","last_became_peered":"2024-09-19T08:09:09.116806+0000","last_unstale":"2024-09-19T08:10:14.787749+0000","last_undegraded":"2024-09-19T08:10:14.787749+0000","last_fullsized":"2024-09-19T08:10:14.787749+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:42.113015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.269943+0000","last_change":"2024-09-19T08:09:11.245745+0000","last_active":"2024-09-19T08:09:12.269943+0000","last_peered":"2024-09-19T08:09:12.269943+0000","last_clean":"2024-09-19T08:09:12.269943+0000","last_became_active":"2024-09-19T08:09:11.245373+0000","last_became_peered":"2024-09-19T08:09:11.245373+0000","last_unstale":"2024-09-19T08:09:12.269943+0000","last_undegraded":"2024-09-19T08:09:12.269943+0000","last_fullsized":"2024-09-19T08:09:12.269943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:56.500738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.788193+0000","last_change":"2024-09-19T08:09:09.119550+0000","last_active":"2024-09-19T08:10:14.788193+0000","last_peered":"2024-09-19T08:10:14.788193+0000","last_clean":"2024-09-19T08:10:14.788193+0000","last_became_active":"2024-09-19T08:09:09.119187+0000","last_became_peered":"2024-09-19T08:09:09.119187+0000","last_unstale":"2024-09-19T08:10:14.788193+0000","last_undegraded":"2024-09-19T08:10:14.788193+0000","last_fullsized":"2024-09-19T08:10:14.788193+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:14.629824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.274031+0000","last_change":"2024-09-19T08:09:11.245318+0000","last_active":"2024-09-19T08:09:12.274031+0000","last_peered":"2024-09-19T08:09:12.274031+0000","last_clean":"2024-09-19T08:09:12.274031+0000","last_became_active":"2024-09-19T08:09:11.245000+0000","last_became_peered":"2024-09-19T08:09:11.245000+0000","last_unstale":"2024-09-19T08:09:12.274031+0000","last_undegraded":"2024-09-19T08:09:12.274031+0000","last_fullsized":"2024-09-19T08:09:12.274031+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:53.590453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.788328+0000","last_change":"2024-09-19T08:09:09.241552+0000","last_active":"2024-09-19T08:10:13.788328+0000","last_peered":"2024-09-19T08:10:13.788328+0000","last_clean":"2024-09-19T08:10:13.788328+0000","last_became_active":"2024-09-19T08:09:09.241201+0000","last_became_peered":"2024-09-19T08:09:09.241201+0000","last_unstale":"2024-09-19T08:10:13.788328+0000","last_undegraded":"2024-09-19T08:10:13.788328+0000","last_fullsized":"2024-09-19T08:10:13.788328+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:09.374532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.788157+0000","last_change":"2024-09-19T08:09:11.246697+0000","last_active":"2024-09-19T08:10:13.788157+0000","last_peered":"2024-09-19T08:10:13.788157+0000","last_clean":"2024-09-19T08:10:13.788157+0000","last_became_active":"2024-09-19T08:09:11.246404+0000","last_became_peered":"2024-09-19T08:09:11.246404+0000","last_unstale":"2024-09-19T08:10:13.788157+0000","last_undegraded":"2024-09-19T08:10:13.788157+0000","last_fullsized":"2024-09-19T08:10:13.788157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.008875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:09:12.278644+0000","last_change":"2024-09-19T08:09:09.113401+0000","last_active":"2024-09-19T08:09:12.278644+0000","last_peered":"2024-09-19T08:09:12.278644+0000","last_clean":"2024-09-19T08:09:12.278644+0000","last_became_active":"2024-09-19T08:09:09.113026+0000","last_became_peered":"2024-09-19T08:09:09.113026+0000","last_unstale":"2024-09-19T08:09:12.278644+0000","last_undegraded":"2024-09-19T08:09:12.278644+0000","last_fullsized":"2024-09-19T08:09:12.278644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:54.740955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63617,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":130,"num_read_kb":129,"num_write":81,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":67,"ondisk_log_size":67,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281686,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547227,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":868352,"data_stored":419022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776160,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1032192,"data_stored":1089535,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939685,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":419604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168618,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":901120,"data_stored":436641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397551,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":950272,"data_stored":1027104,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561076,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":436154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790009,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":946176,"data_stored":1018274,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953535,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":884736,"data_stored":427629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182468,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":419360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":481875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":481841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":872448,"data_stored":419112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:10:18.126 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-19T08:10:18.126 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 14, 'reported_epoch': 81, 'state': 'peering', 'last_fresh': '2024-09-19T08:09:14.748141+0000', 'last_change': '2024-09-19T08:10:13.786269+0000', 'last_active': '2024-09-19T08:10:13.786269+0000', 'last_peered': '2024-09-19T08:09:14.748141+0000', 'last_clean': '2024-09-19T08:09:14.748141+0000', 'last_became_active': '2024-09-19T08:09:11.252219+0000', 'last_became_peered': '2024-09-19T08:09:11.252219+0000', 'last_unstale': '2024-09-19T08:09:14.748141+0000', 'last_undegraded': '2024-09-19T08:09:14.748141+0000', 'last_fullsized': '2024-09-19T08:09:14.748141+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 80, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:09:10.223380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:09:10.223380+0000', 'last_clean_scrub_stamp': '2024-09-19T08:09:10.223380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2, 8], 'acting': [5, 2, 8], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2, 4, 8], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T08:10:18.127 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph status --format=json 2024-09-19T08:10:18.387 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:18.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.895+0000 7fd4e7da0640 1 -- 172.21.15.27:0/1448723629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e0101280 msgr2=0x7fd4e010df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:18.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.895+0000 7fd4e7da0640 1 --2- 172.21.15.27:0/1448723629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e0101280 0x7fd4e010df40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009900 tx=0x7fd4d402a410 comp rx=0 tx=0).stop 2024-09-19T08:10:18.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.895+0000 7fd4e7da0640 1 -- 172.21.15.27:0/1448723629 shutdown_connections 2024-09-19T08:10:18.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.895+0000 7fd4e7da0640 1 --2- 172.21.15.27:0/1448723629 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4e010e480 0x7fd4e0110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:18.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.895+0000 7fd4e7da0640 1 --2- 172.21.15.27:0/1448723629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e0101280 0x7fd4e010df40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:18.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.895+0000 7fd4e7da0640 1 --2- 172.21.15.27:0/1448723629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4e01008d0 0x7fd4e0100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:18.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.895+0000 7fd4e7da0640 1 -- 172.21.15.27:0/1448723629 >> 172.21.15.27:0/1448723629 conn(0x7fd4e00fc7a0 msgr2=0x7fd4e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:18.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.895+0000 7fd4e7da0640 1 -- 172.21.15.27:0/1448723629 shutdown_connections 2024-09-19T08:10:18.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.895+0000 7fd4e7da0640 1 -- 172.21.15.27:0/1448723629 wait complete. 2024-09-19T08:10:18.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.896+0000 7fd4e7da0640 1 Processor -- start 2024-09-19T08:10:18.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.896+0000 7fd4e7da0640 1 -- start start 2024-09-19T08:10:18.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.896+0000 7fd4e7da0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4e01008d0 0x7fd4e019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:18.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.896+0000 7fd4e7da0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e0101280 0x7fd4e019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.896+0000 7fd4e7da0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4e010e480 0x7fd4e019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.896+0000 7fd4e7da0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01141a0 con 0x7fd4e0101280 2024-09-19T08:10:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.896+0000 7fd4e7da0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e0114020 con 0x7fd4e01008d0 2024-09-19T08:10:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.896+0000 7fd4e7da0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e0114320 con 0x7fd4e010e480 2024-09-19T08:10:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.896+0000 7fd4e533b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e0101280 0x7fd4e019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.896+0000 7fd4e533b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e0101280 0x7fd4e019aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35584/0 (socket says 172.21.15.27:35584) 2024-09-19T08:10:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.896+0000 7fd4e533b640 1 -- 172.21.15.27:0/1945726625 learned_addr learned my addr 172.21.15.27:0/1945726625 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.896+0000 7fd4e633d640 1 --2- 172.21.15.27:0/1945726625 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4e010e480 0x7fd4e019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.897+0000 7fd4e5b3c640 1 --2- 172.21.15.27:0/1945726625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4e01008d0 0x7fd4e019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.897+0000 7fd4e533b640 1 -- 172.21.15.27:0/1945726625 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4e010e480 msgr2=0x7fd4e019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.897+0000 7fd4e533b640 1 --2- 172.21.15.27:0/1945726625 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4e010e480 0x7fd4e019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.897+0000 7fd4e533b640 1 -- 172.21.15.27:0/1945726625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4e01008d0 msgr2=0x7fd4e019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.897+0000 7fd4e533b640 1 --2- 172.21.15.27:0/1945726625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4e01008d0 0x7fd4e019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.897+0000 7fd4e533b640 1 -- 172.21.15.27:0/1945726625 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e019f610 con 0x7fd4e0101280 2024-09-19T08:10:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.897+0000 7fd4e5b3c640 1 --2- 172.21.15.27:0/1945726625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4e01008d0 0x7fd4e019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:10:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.897+0000 7fd4e533b640 1 --2- 172.21.15.27:0/1945726625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e0101280 0x7fd4e019aba0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4006010 tx=0x7fd4d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.897+0000 7fd4deffd640 1 -- 172.21.15.27:0/1945726625 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d403f030 con 0x7fd4e0101280 2024-09-19T08:10:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.897+0000 7fd4deffd640 1 -- 172.21.15.27:0/1945726625 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4d4003ce0 con 0x7fd4e0101280 2024-09-19T08:10:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.897+0000 7fd4e7da0640 1 -- 172.21.15.27:0/1945726625 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e019f8a0 con 0x7fd4e0101280 2024-09-19T08:10:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.897+0000 7fd4deffd640 1 -- 172.21.15.27:0/1945726625 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4035070 con 0x7fd4e0101280 2024-09-19T08:10:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.897+0000 7fd4e7da0640 1 -- 172.21.15.27:0/1945726625 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e01a71e0 con 0x7fd4e0101280 2024-09-19T08:10:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.898+0000 7fd4e7da0640 1 -- 172.21.15.27:0/1945726625 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e006b070 con 0x7fd4e0101280 2024-09-19T08:10:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.899+0000 7fd4deffd640 1 -- 172.21.15.27:0/1945726625 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd4d4042030 con 0x7fd4e0101280 2024-09-19T08:10:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.900+0000 7fd4deffd640 1 --2- 172.21.15.27:0/1945726625 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fd4c80a32d0 0x7fd4c80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.900+0000 7fd4e5b3c640 1 --2- 172.21.15.27:0/1945726625 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fd4c80a32d0 0x7fd4c80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:18.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.900+0000 7fd4deffd640 1 -- 172.21.15.27:0/1945726625 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fd4d40f0480 con 0x7fd4e0101280 2024-09-19T08:10:18.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.901+0000 7fd4e5b3c640 1 --2- 172.21.15.27:0/1945726625 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fd4c80a32d0 0x7fd4c80a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800baa0 tx=0x7fd4d8005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:18.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:18.903+0000 7fd4deffd640 1 -- 172.21.15.27:0/1945726625 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd4d40bd130 con 0x7fd4e0101280 2024-09-19T08:10:19.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:19.149+0000 7fd4e7da0640 1 -- 172.21.15.27:0/1945726625 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd4e0100cb0 con 0x7fd4e0101280 2024-09-19T08:10:19.149 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:18 smithi027 ceph-mon[31209]: pgmap v315: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:19.149 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:18 smithi027 ceph-mon[31209]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:10:19.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:19.150+0000 7fd4deffd640 1 -- 172.21.15.27:0/1945726625 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1578 (secure 0 0 0) 0x7fd4e0100cb0 con 0x7fd4e0101280 2024-09-19T08:10:19.150 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:10:19.150 INFO:teuthology.orchestra.run.smithi027.stdout:{"fsid":"35b531b0-765d-11ef-bceb-c7b262605968","health":{"status":"HEALTH_WARN","checks":{"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 1 pg peering","count":1},"muted":false}},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":436,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":83,"num_osds":12,"num_up_osds":12,"osd_up_since":1726733297,"num_in_osds":12,"osd_in_since":1726733274,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":96},{"state_name":"peering","count":1}],"num_pgs":97,"num_pools":3,"num_objects":26,"data_bytes":654219,"bytes_used":364412928,"bytes_avail":1151576014848,"bytes_total":1151940427776,"inactive_pgs_ratio":0.010309278033673763,"read_bytes_sec":1279,"read_op_per_sec":2,"write_op_per_sec":0},"fsmap":{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"i","status":"up:standby-replay","gid":24466},{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":24482}],"up:standby":10},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.27:8443/"}},"servicemap":{"epoch":29,"modified":"2024-09-19T08:10:16.932575+0000","services":{"mds":{"daemons":{"summary":"","i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T08:10:19.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:19.152+0000 7fd4e7da0640 1 -- 172.21.15.27:0/1945726625 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fd4c80a32d0 msgr2=0x7fd4c80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:19.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:19.152+0000 7fd4e7da0640 1 --2- 172.21.15.27:0/1945726625 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fd4c80a32d0 0x7fd4c80a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800baa0 tx=0x7fd4d8005d90 comp rx=0 tx=0).stop 2024-09-19T08:10:19.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:19.152+0000 7fd4e7da0640 1 -- 172.21.15.27:0/1945726625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e0101280 msgr2=0x7fd4e019aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:19.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:19.152+0000 7fd4e7da0640 1 --2- 172.21.15.27:0/1945726625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e0101280 0x7fd4e019aba0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4006010 tx=0x7fd4d40042f0 comp rx=0 tx=0).stop 2024-09-19T08:10:19.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:19.152+0000 7fd4e7da0640 1 -- 172.21.15.27:0/1945726625 shutdown_connections 2024-09-19T08:10:19.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:19.152+0000 7fd4e7da0640 1 --2- 172.21.15.27:0/1945726625 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4e010e480 0x7fd4e019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:19.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:19.152+0000 7fd4e7da0640 1 --2- 172.21.15.27:0/1945726625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e0101280 0x7fd4e019aba0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:19.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:19.152+0000 7fd4e7da0640 1 --2- 172.21.15.27:0/1945726625 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fd4c80a32d0 0x7fd4c80a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:19.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:19.152+0000 7fd4e7da0640 1 --2- 172.21.15.27:0/1945726625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4e01008d0 0x7fd4e019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:19.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:19.152+0000 7fd4e7da0640 1 -- 172.21.15.27:0/1945726625 >> 172.21.15.27:0/1945726625 conn(0x7fd4e00fc7a0 msgr2=0x7fd4e00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:19.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:19.152+0000 7fd4e7da0640 1 -- 172.21.15.27:0/1945726625 shutdown_connections 2024-09-19T08:10:19.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:19.152+0000 7fd4e7da0640 1 -- 172.21.15.27:0/1945726625 wait complete. 2024-09-19T08:10:19.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:18 smithi155 ceph-mon[35362]: pgmap v315: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:19.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:18 smithi155 ceph-mon[35362]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:10:19.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:18 smithi203 ceph-mon[35198]: pgmap v315: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:19.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:18 smithi203 ceph-mon[35198]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:10:19.882 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-19T08:10:19.883 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:10:20.148 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:20.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:19 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1945726625' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-19T08:10:20.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:19 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1945726625' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-19T08:10:20.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:19 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1945726625' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-19T08:10:20.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.657+0000 7f70fb850640 1 -- 172.21.15.27:0/466881166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70f4102d30 msgr2=0x7f70f4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:20.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.657+0000 7f70fb850640 1 --2- 172.21.15.27:0/466881166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70f4102d30 0x7f70f4103110 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009930 tx=0x7f70ec02a420 comp rx=0 tx=0).stop 2024-09-19T08:10:20.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.657+0000 7f70fb850640 1 -- 172.21.15.27:0/466881166 shutdown_connections 2024-09-19T08:10:20.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.657+0000 7f70fb850640 1 --2- 172.21.15.27:0/466881166 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70f41082a0 0x7f70f410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:20.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.657+0000 7f70fb850640 1 --2- 172.21.15.27:0/466881166 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70f41036e0 0x7f70f4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:20.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.657+0000 7f70fb850640 1 --2- 172.21.15.27:0/466881166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70f4102d30 0x7f70f4103110 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:20.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.657+0000 7f70fb850640 1 -- 172.21.15.27:0/466881166 >> 172.21.15.27:0/466881166 conn(0x7f70f40fc7d0 msgr2=0x7f70f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:20.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.657+0000 7f70fb850640 1 -- 172.21.15.27:0/466881166 shutdown_connections 2024-09-19T08:10:20.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.657+0000 7f70fb850640 1 -- 172.21.15.27:0/466881166 wait complete. 2024-09-19T08:10:20.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.657+0000 7f70fb850640 1 Processor -- start 2024-09-19T08:10:20.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.657+0000 7f70fb850640 1 -- start start 2024-09-19T08:10:20.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70fb850640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70f4102d30 0x7f70f4100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:20.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70fb850640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70f41036e0 0x7f70f4100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:20.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70fb850640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70f41082a0 0x7f70f4101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:20.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70fb850640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f70f41120a0 con 0x7f70f41082a0 2024-09-19T08:10:20.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70fb850640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f70f4111f20 con 0x7f70f4102d30 2024-09-19T08:10:20.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70fb850640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f70f4112220 con 0x7f70f41036e0 2024-09-19T08:10:20.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70f9ded640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70f41082a0 0x7f70f4101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:20.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70f9ded640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70f41082a0 0x7f70f4101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48438/0 (socket says 172.21.15.27:48438) 2024-09-19T08:10:20.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70f9ded640 1 -- 172.21.15.27:0/2901276501 learned_addr learned my addr 172.21.15.27:0/2901276501 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:20.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70f8deb640 1 --2- 172.21.15.27:0/2901276501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70f41036e0 0x7f70f4100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:20.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70f95ec640 1 --2- 172.21.15.27:0/2901276501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70f4102d30 0x7f70f4100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:20.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70f9ded640 1 -- 172.21.15.27:0/2901276501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70f41036e0 msgr2=0x7f70f4100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:20.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70f9ded640 1 --2- 172.21.15.27:0/2901276501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70f41036e0 0x7f70f4100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:20.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70f9ded640 1 -- 172.21.15.27:0/2901276501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70f4102d30 msgr2=0x7f70f4100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:20.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70f9ded640 1 --2- 172.21.15.27:0/2901276501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70f4102d30 0x7f70f4100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:20.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70f9ded640 1 -- 172.21.15.27:0/2901276501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f41a6a80 con 0x7f70f41082a0 2024-09-19T08:10:20.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70f9ded640 1 --2- 172.21.15.27:0/2901276501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70f41082a0 0x7f70f4101410 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f70e400eaa0 tx=0x7f70e400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:20.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70f27fc640 1 -- 172.21.15.27:0/2901276501 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e400cdb0 con 0x7f70f41082a0 2024-09-19T08:10:20.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70f27fc640 1 -- 172.21.15.27:0/2901276501 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70e4005020 con 0x7f70f41082a0 2024-09-19T08:10:20.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70f27fc640 1 -- 172.21.15.27:0/2901276501 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e40116b0 con 0x7f70f41082a0 2024-09-19T08:10:20.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.658+0000 7f70fb850640 1 -- 172.21.15.27:0/2901276501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f41a6d70 con 0x7f70f41082a0 2024-09-19T08:10:20.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.659+0000 7f70fb850640 1 -- 172.21.15.27:0/2901276501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f41a72d0 con 0x7f70f41082a0 2024-09-19T08:10:20.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.660+0000 7f70fb850640 1 -- 172.21.15.27:0/2901276501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70f406a850 con 0x7f70f41082a0 2024-09-19T08:10:20.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.661+0000 7f70f27fc640 1 -- 172.21.15.27:0/2901276501 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f70e4005560 con 0x7f70f41082a0 2024-09-19T08:10:20.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.661+0000 7f70f27fc640 1 --2- 172.21.15.27:0/2901276501 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f70dc0a3350 0x7f70dc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:20.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.662+0000 7f70f95ec640 1 --2- 172.21.15.27:0/2901276501 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f70dc0a3350 0x7f70dc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:20.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.662+0000 7f70f27fc640 1 -- 172.21.15.27:0/2901276501 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f70e40cfaf0 con 0x7f70f41082a0 2024-09-19T08:10:20.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.662+0000 7f70f95ec640 1 --2- 172.21.15.27:0/2901276501 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f70dc0a3350 0x7f70dc0a5810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009900 tx=0x7f70ec0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:20.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.666+0000 7f70f27fc640 1 -- 172.21.15.27:0/2901276501 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f70e4016030 con 0x7f70f41082a0 2024-09-19T08:10:20.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.840+0000 7f70fb850640 1 -- 172.21.15.27:0/2901276501 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f70f4062630 con 0x7f70dc0a3350 2024-09-19T08:10:20.840 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:20 smithi027 ceph-mon[31209]: pgmap v316: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:10:20.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.846+0000 7f70f27fc640 1 -- 172.21.15.27:0/2901276501 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258822 (secure 0 0 0) 0x7f70f4062630 con 0x7f70dc0a3350 2024-09-19T08:10:20.848 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:10:20.849 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-09-19T08:10:20.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.850+0000 7f70fb850640 1 -- 172.21.15.27:0/2901276501 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f70dc0a3350 msgr2=0x7f70dc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:20.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.851+0000 7f70fb850640 1 --2- 172.21.15.27:0/2901276501 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f70dc0a3350 0x7f70dc0a5810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009900 tx=0x7f70ec0058d0 comp rx=0 tx=0).stop 2024-09-19T08:10:20.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.851+0000 7f70fb850640 1 -- 172.21.15.27:0/2901276501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70f41082a0 msgr2=0x7f70f4101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:20.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.851+0000 7f70fb850640 1 --2- 172.21.15.27:0/2901276501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70f41082a0 0x7f70f4101410 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f70e400eaa0 tx=0x7f70e400ef60 comp rx=0 tx=0).stop 2024-09-19T08:10:20.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.851+0000 7f70fb850640 1 -- 172.21.15.27:0/2901276501 shutdown_connections 2024-09-19T08:10:20.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.851+0000 7f70fb850640 1 --2- 172.21.15.27:0/2901276501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70f41082a0 0x7f70f4101410 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:20.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.851+0000 7f70fb850640 1 --2- 172.21.15.27:0/2901276501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70f41036e0 0x7f70f4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:20.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.851+0000 7f70fb850640 1 --2- 172.21.15.27:0/2901276501 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f70dc0a3350 0x7f70dc0a5810 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:20.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.851+0000 7f70fb850640 1 --2- 172.21.15.27:0/2901276501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70f4102d30 0x7f70f4100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:20.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.851+0000 7f70fb850640 1 -- 172.21.15.27:0/2901276501 >> 172.21.15.27:0/2901276501 conn(0x7f70f40fc7d0 msgr2=0x7f70f4105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:20.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.851+0000 7f70fb850640 1 -- 172.21.15.27:0/2901276501 shutdown_connections 2024-09-19T08:10:20.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:20.851+0000 7f70fb850640 1 -- 172.21.15.27:0/2901276501 wait complete. 2024-09-19T08:10:21.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:20 smithi155 ceph-mon[35362]: pgmap v316: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:10:21.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:20 smithi203 ceph-mon[35198]: pgmap v316: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:10:21.515 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-09-19T08:10:18.932868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654219,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":266,"num_read_kb":248,"num_write":264,"num_write_kb":3026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":295,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356012,"kb_used_data":10860,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585812,"statfs":{"total":1151940427776,"available":1151575871488,"internally_reserved":0,"allocated":11120640,"data_stored":7161226,"data_compressed":107475,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001651"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784785+0000","last_change":"2024-09-19T08:09:11.246436+0000","last_active":"2024-09-19T08:10:14.784785+0000","last_peered":"2024-09-19T08:10:14.784785+0000","last_clean":"2024-09-19T08:10:14.784785+0000","last_became_active":"2024-09-19T08:09:11.245674+0000","last_became_peered":"2024-09-19T08:09:11.245674+0000","last_unstale":"2024-09-19T08:10:14.784785+0000","last_undegraded":"2024-09-19T08:10:14.784785+0000","last_fullsized":"2024-09-19T08:10:14.784785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:46.716474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786539+0000","last_change":"2024-09-19T08:09:11.243334+0000","last_active":"2024-09-19T08:10:14.786539+0000","last_peered":"2024-09-19T08:10:14.786539+0000","last_clean":"2024-09-19T08:10:14.786539+0000","last_became_active":"2024-09-19T08:09:11.243024+0000","last_became_peered":"2024-09-19T08:09:11.243024+0000","last_unstale":"2024-09-19T08:10:14.786539+0000","last_undegraded":"2024-09-19T08:10:14.786539+0000","last_fullsized":"2024-09-19T08:10:14.786539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.060068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786483+0000","last_change":"2024-09-19T08:09:11.254655+0000","last_active":"2024-09-19T08:10:14.786483+0000","last_peered":"2024-09-19T08:10:14.786483+0000","last_clean":"2024-09-19T08:10:14.786483+0000","last_became_active":"2024-09-19T08:09:11.254292+0000","last_became_peered":"2024-09-19T08:09:11.254292+0000","last_unstale":"2024-09-19T08:10:14.786483+0000","last_undegraded":"2024-09-19T08:10:14.786483+0000","last_fullsized":"2024-09-19T08:10:14.786483+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:01.977743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.785712+0000","last_change":"2024-09-19T08:09:11.257029+0000","last_active":"2024-09-19T08:10:14.785712+0000","last_peered":"2024-09-19T08:10:14.785712+0000","last_clean":"2024-09-19T08:10:14.785712+0000","last_became_active":"2024-09-19T08:09:11.256669+0000","last_became_peered":"2024-09-19T08:09:11.256669+0000","last_unstale":"2024-09-19T08:10:14.785712+0000","last_undegraded":"2024-09-19T08:10:14.785712+0000","last_fullsized":"2024-09-19T08:10:14.785712+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:32.831036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787404+0000","last_change":"2024-09-19T08:09:11.240341+0000","last_active":"2024-09-19T08:10:14.787404+0000","last_peered":"2024-09-19T08:10:14.787404+0000","last_clean":"2024-09-19T08:10:14.787404+0000","last_became_active":"2024-09-19T08:09:11.239996+0000","last_became_peered":"2024-09-19T08:09:11.239996+0000","last_unstale":"2024-09-19T08:10:14.787404+0000","last_undegraded":"2024-09-19T08:10:14.787404+0000","last_fullsized":"2024-09-19T08:10:14.787404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:20.331791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784344+0000","last_change":"2024-09-19T08:09:11.248089+0000","last_active":"2024-09-19T08:10:14.784344+0000","last_peered":"2024-09-19T08:10:14.784344+0000","last_clean":"2024-09-19T08:10:14.784344+0000","last_became_active":"2024-09-19T08:09:11.247802+0000","last_became_peered":"2024-09-19T08:09:11.247802+0000","last_unstale":"2024-09-19T08:10:14.784344+0000","last_undegraded":"2024-09-19T08:10:14.784344+0000","last_fullsized":"2024-09-19T08:10:14.784344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.249119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786463+0000","last_change":"2024-09-19T08:09:11.246853+0000","last_active":"2024-09-19T08:10:14.786463+0000","last_peered":"2024-09-19T08:10:14.786463+0000","last_clean":"2024-09-19T08:10:14.786463+0000","last_became_active":"2024-09-19T08:09:11.246523+0000","last_became_peered":"2024-09-19T08:09:11.246523+0000","last_unstale":"2024-09-19T08:10:14.786463+0000","last_undegraded":"2024-09-19T08:10:14.786463+0000","last_fullsized":"2024-09-19T08:10:14.786463+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:54.879087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787158+0000","last_change":"2024-09-19T08:09:11.232588+0000","last_active":"2024-09-19T08:10:13.787158+0000","last_peered":"2024-09-19T08:10:13.787158+0000","last_clean":"2024-09-19T08:10:13.787158+0000","last_became_active":"2024-09-19T08:09:11.232251+0000","last_became_peered":"2024-09-19T08:09:11.232251+0000","last_unstale":"2024-09-19T08:10:13.787158+0000","last_undegraded":"2024-09-19T08:10:13.787158+0000","last_fullsized":"2024-09-19T08:10:13.787158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:57.622086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.782467+0000","last_change":"2024-09-19T08:09:11.248854+0000","last_active":"2024-09-19T08:10:14.782467+0000","last_peered":"2024-09-19T08:10:14.782467+0000","last_clean":"2024-09-19T08:10:14.782467+0000","last_became_active":"2024-09-19T08:09:11.248524+0000","last_became_peered":"2024-09-19T08:09:11.248524+0000","last_unstale":"2024-09-19T08:10:14.782467+0000","last_undegraded":"2024-09-19T08:10:14.782467+0000","last_fullsized":"2024-09-19T08:10:14.782467+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:57.978974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786848+0000","last_change":"2024-09-19T08:10:14.786848+0000","last_active":"2024-09-19T08:10:14.786848+0000","last_peered":"2024-09-19T08:10:14.786848+0000","last_clean":"2024-09-19T08:10:14.786848+0000","last_became_active":"2024-09-19T08:10:14.786460+0000","last_became_peered":"2024-09-19T08:10:14.786460+0000","last_unstale":"2024-09-19T08:10:14.786848+0000","last_undegraded":"2024-09-19T08:10:14.786848+0000","last_fullsized":"2024-09-19T08:10:14.786848+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:59.430185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786917+0000","last_change":"2024-09-19T08:09:11.247604+0000","last_active":"2024-09-19T08:10:14.786917+0000","last_peered":"2024-09-19T08:10:14.786917+0000","last_clean":"2024-09-19T08:10:14.786917+0000","last_became_active":"2024-09-19T08:09:11.247264+0000","last_became_peered":"2024-09-19T08:09:11.247264+0000","last_unstale":"2024-09-19T08:10:14.786917+0000","last_undegraded":"2024-09-19T08:10:14.786917+0000","last_fullsized":"2024-09-19T08:10:14.786917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:15.315022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.785754+0000","last_change":"2024-09-19T08:09:11.253948+0000","last_active":"2024-09-19T08:10:14.785754+0000","last_peered":"2024-09-19T08:10:14.785754+0000","last_clean":"2024-09-19T08:10:14.785754+0000","last_became_active":"2024-09-19T08:09:11.253402+0000","last_became_peered":"2024-09-19T08:09:11.253402+0000","last_unstale":"2024-09-19T08:10:14.785754+0000","last_undegraded":"2024-09-19T08:10:14.785754+0000","last_fullsized":"2024-09-19T08:10:14.785754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:04.884541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783801+0000","last_change":"2024-09-19T08:09:11.241770+0000","last_active":"2024-09-19T08:10:14.783801+0000","last_peered":"2024-09-19T08:10:14.783801+0000","last_clean":"2024-09-19T08:10:14.783801+0000","last_became_active":"2024-09-19T08:09:11.241356+0000","last_became_peered":"2024-09-19T08:09:11.241356+0000","last_unstale":"2024-09-19T08:10:14.783801+0000","last_undegraded":"2024-09-19T08:10:14.783801+0000","last_fullsized":"2024-09-19T08:10:14.783801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:02.722445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786455+0000","last_change":"2024-09-19T08:09:11.242874+0000","last_active":"2024-09-19T08:10:14.786455+0000","last_peered":"2024-09-19T08:10:14.786455+0000","last_clean":"2024-09-19T08:10:14.786455+0000","last_became_active":"2024-09-19T08:09:11.242383+0000","last_became_peered":"2024-09-19T08:09:11.242383+0000","last_unstale":"2024-09-19T08:10:14.786455+0000","last_undegraded":"2024-09-19T08:10:14.786455+0000","last_fullsized":"2024-09-19T08:10:14.786455+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:51.900211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786416+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:10:14.786416+0000","last_peered":"2024-09-19T08:10:14.786416+0000","last_clean":"2024-09-19T08:10:14.786416+0000","last_became_active":"2024-09-19T08:09:11.250797+0000","last_became_peered":"2024-09-19T08:09:11.250797+0000","last_unstale":"2024-09-19T08:10:14.786416+0000","last_undegraded":"2024-09-19T08:10:14.786416+0000","last_fullsized":"2024-09-19T08:10:14.786416+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:46.183857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.781929+0000","last_change":"2024-09-19T08:09:11.250884+0000","last_active":"2024-09-19T08:10:14.781929+0000","last_peered":"2024-09-19T08:10:14.781929+0000","last_clean":"2024-09-19T08:10:14.781929+0000","last_became_active":"2024-09-19T08:09:11.250543+0000","last_became_peered":"2024-09-19T08:09:11.250543+0000","last_unstale":"2024-09-19T08:10:14.781929+0000","last_undegraded":"2024-09-19T08:10:14.781929+0000","last_fullsized":"2024-09-19T08:10:14.781929+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.259466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784758+0000","last_change":"2024-09-19T08:09:11.246705+0000","last_active":"2024-09-19T08:10:14.784758+0000","last_peered":"2024-09-19T08:10:14.784758+0000","last_clean":"2024-09-19T08:10:14.784758+0000","last_became_active":"2024-09-19T08:09:11.246117+0000","last_became_peered":"2024-09-19T08:09:11.246117+0000","last_unstale":"2024-09-19T08:10:14.784758+0000","last_undegraded":"2024-09-19T08:10:14.784758+0000","last_fullsized":"2024-09-19T08:10:14.784758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:07.421222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.781085+0000","last_change":"2024-09-19T08:09:11.242181+0000","last_active":"2024-09-19T08:10:14.781085+0000","last_peered":"2024-09-19T08:10:14.781085+0000","last_clean":"2024-09-19T08:10:14.781085+0000","last_became_active":"2024-09-19T08:09:11.241882+0000","last_became_peered":"2024-09-19T08:09:11.241882+0000","last_unstale":"2024-09-19T08:10:14.781085+0000","last_undegraded":"2024-09-19T08:10:14.781085+0000","last_fullsized":"2024-09-19T08:10:14.781085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:35.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.782190+0000","last_change":"2024-09-19T08:09:11.246038+0000","last_active":"2024-09-19T08:10:14.782190+0000","last_peered":"2024-09-19T08:10:14.782190+0000","last_clean":"2024-09-19T08:10:14.782190+0000","last_became_active":"2024-09-19T08:09:11.245554+0000","last_became_peered":"2024-09-19T08:09:11.245554+0000","last_unstale":"2024-09-19T08:10:14.782190+0000","last_undegraded":"2024-09-19T08:10:14.782190+0000","last_fullsized":"2024-09-19T08:10:14.782190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:14.512425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784039+0000","last_change":"2024-09-19T08:09:11.249246+0000","last_active":"2024-09-19T08:10:14.784039+0000","last_peered":"2024-09-19T08:10:14.784039+0000","last_clean":"2024-09-19T08:10:14.784039+0000","last_became_active":"2024-09-19T08:09:11.248896+0000","last_became_peered":"2024-09-19T08:09:11.248896+0000","last_unstale":"2024-09-19T08:10:14.784039+0000","last_undegraded":"2024-09-19T08:10:14.784039+0000","last_fullsized":"2024-09-19T08:10:14.784039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:40.406924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783875+0000","last_change":"2024-09-19T08:09:11.245421+0000","last_active":"2024-09-19T08:10:14.783875+0000","last_peered":"2024-09-19T08:10:14.783875+0000","last_clean":"2024-09-19T08:10:14.783875+0000","last_became_active":"2024-09-19T08:09:11.245071+0000","last_became_peered":"2024-09-19T08:09:11.245071+0000","last_unstale":"2024-09-19T08:10:14.783875+0000","last_undegraded":"2024-09-19T08:10:14.783875+0000","last_fullsized":"2024-09-19T08:10:14.783875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:58.594399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.782100+0000","last_change":"2024-09-19T08:09:11.246097+0000","last_active":"2024-09-19T08:10:14.782100+0000","last_peered":"2024-09-19T08:10:14.782100+0000","last_clean":"2024-09-19T08:10:14.782100+0000","last_became_active":"2024-09-19T08:09:11.245741+0000","last_became_peered":"2024-09-19T08:09:11.245741+0000","last_unstale":"2024-09-19T08:10:14.782100+0000","last_undegraded":"2024-09-19T08:10:14.782100+0000","last_fullsized":"2024-09-19T08:10:14.782100+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:05.731148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787472+0000","last_change":"2024-09-19T08:09:11.251485+0000","last_active":"2024-09-19T08:10:13.787472+0000","last_peered":"2024-09-19T08:10:13.787472+0000","last_clean":"2024-09-19T08:10:13.787472+0000","last_became_active":"2024-09-19T08:09:11.251151+0000","last_became_peered":"2024-09-19T08:09:11.251151+0000","last_unstale":"2024-09-19T08:10:13.787472+0000","last_undegraded":"2024-09-19T08:10:13.787472+0000","last_fullsized":"2024-09-19T08:10:13.787472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:47.231056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787056+0000","last_change":"2024-09-19T08:09:11.234490+0000","last_active":"2024-09-19T08:10:13.787056+0000","last_peered":"2024-09-19T08:10:13.787056+0000","last_clean":"2024-09-19T08:10:13.787056+0000","last_became_active":"2024-09-19T08:09:11.234163+0000","last_became_peered":"2024-09-19T08:09:11.234163+0000","last_unstale":"2024-09-19T08:10:13.787056+0000","last_undegraded":"2024-09-19T08:10:13.787056+0000","last_fullsized":"2024-09-19T08:10:13.787056+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.610165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.788266+0000","last_change":"2024-09-19T08:09:11.247189+0000","last_active":"2024-09-19T08:10:13.788266+0000","last_peered":"2024-09-19T08:10:13.788266+0000","last_clean":"2024-09-19T08:10:13.788266+0000","last_became_active":"2024-09-19T08:09:11.246844+0000","last_became_peered":"2024-09-19T08:09:11.246844+0000","last_unstale":"2024-09-19T08:10:13.788266+0000","last_undegraded":"2024-09-19T08:10:13.788266+0000","last_fullsized":"2024-09-19T08:10:13.788266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:50.764694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783070+0000","last_change":"2024-09-19T08:09:11.251655+0000","last_active":"2024-09-19T08:10:14.783070+0000","last_peered":"2024-09-19T08:10:14.783070+0000","last_clean":"2024-09-19T08:10:14.783070+0000","last_became_active":"2024-09-19T08:09:11.250930+0000","last_became_peered":"2024-09-19T08:09:11.250930+0000","last_unstale":"2024-09-19T08:10:14.783070+0000","last_undegraded":"2024-09-19T08:10:14.783070+0000","last_fullsized":"2024-09-19T08:10:14.783070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:17.658277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784437+0000","last_change":"2024-09-19T08:09:11.248095+0000","last_active":"2024-09-19T08:10:14.784437+0000","last_peered":"2024-09-19T08:10:14.784437+0000","last_clean":"2024-09-19T08:10:14.784437+0000","last_became_active":"2024-09-19T08:09:11.247719+0000","last_became_peered":"2024-09-19T08:09:11.247719+0000","last_unstale":"2024-09-19T08:10:14.784437+0000","last_undegraded":"2024-09-19T08:10:14.784437+0000","last_fullsized":"2024-09-19T08:10:14.784437+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:26.701140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783926+0000","last_change":"2024-09-19T08:09:11.243232+0000","last_active":"2024-09-19T08:10:14.783926+0000","last_peered":"2024-09-19T08:10:14.783926+0000","last_clean":"2024-09-19T08:10:14.783926+0000","last_became_active":"2024-09-19T08:09:11.242927+0000","last_became_peered":"2024-09-19T08:09:11.242927+0000","last_unstale":"2024-09-19T08:10:14.783926+0000","last_undegraded":"2024-09-19T08:10:14.783926+0000","last_fullsized":"2024-09-19T08:10:14.783926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:19.877520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786663+0000","last_change":"2024-09-19T08:09:11.249588+0000","last_active":"2024-09-19T08:10:14.786663+0000","last_peered":"2024-09-19T08:10:14.786663+0000","last_clean":"2024-09-19T08:10:14.786663+0000","last_became_active":"2024-09-19T08:09:11.249266+0000","last_became_peered":"2024-09-19T08:09:11.249266+0000","last_unstale":"2024-09-19T08:10:14.786663+0000","last_undegraded":"2024-09-19T08:10:14.786663+0000","last_fullsized":"2024-09-19T08:10:14.786663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:43.332454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.781836+0000","last_change":"2024-09-19T08:09:11.245866+0000","last_active":"2024-09-19T08:10:14.781836+0000","last_peered":"2024-09-19T08:10:14.781836+0000","last_clean":"2024-09-19T08:10:14.781836+0000","last_became_active":"2024-09-19T08:09:11.245505+0000","last_became_peered":"2024-09-19T08:09:11.245505+0000","last_unstale":"2024-09-19T08:10:14.781836+0000","last_undegraded":"2024-09-19T08:10:14.781836+0000","last_fullsized":"2024-09-19T08:10:14.781836+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:38.203790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.781915+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:10:14.781915+0000","last_peered":"2024-09-19T08:10:14.781915+0000","last_clean":"2024-09-19T08:10:14.781915+0000","last_became_active":"2024-09-19T08:09:11.250745+0000","last_became_peered":"2024-09-19T08:09:11.250745+0000","last_unstale":"2024-09-19T08:10:14.781915+0000","last_undegraded":"2024-09-19T08:10:14.781915+0000","last_fullsized":"2024-09-19T08:10:14.781915+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:16.851230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784356+0000","last_change":"2024-09-19T08:09:11.255211+0000","last_active":"2024-09-19T08:10:14.784356+0000","last_peered":"2024-09-19T08:10:14.784356+0000","last_clean":"2024-09-19T08:10:14.784356+0000","last_became_active":"2024-09-19T08:09:11.254853+0000","last_became_peered":"2024-09-19T08:09:11.254853+0000","last_unstale":"2024-09-19T08:10:14.784356+0000","last_undegraded":"2024-09-19T08:10:14.784356+0000","last_fullsized":"2024-09-19T08:10:14.784356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.497502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.788405+0000","last_change":"2024-09-19T08:09:11.247201+0000","last_active":"2024-09-19T08:10:14.788405+0000","last_peered":"2024-09-19T08:10:14.788405+0000","last_clean":"2024-09-19T08:10:14.788405+0000","last_became_active":"2024-09-19T08:09:11.246854+0000","last_became_peered":"2024-09-19T08:09:11.246854+0000","last_unstale":"2024-09-19T08:10:14.788405+0000","last_undegraded":"2024-09-19T08:10:14.788405+0000","last_fullsized":"2024-09-19T08:10:14.788405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:19.262849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786157+0000","last_change":"2024-09-19T08:09:09.113754+0000","last_active":"2024-09-19T08:10:13.786157+0000","last_peered":"2024-09-19T08:10:13.786157+0000","last_clean":"2024-09-19T08:10:13.786157+0000","last_became_active":"2024-09-19T08:09:09.113389+0000","last_became_peered":"2024-09-19T08:09:09.113389+0000","last_unstale":"2024-09-19T08:10:13.786157+0000","last_undegraded":"2024-09-19T08:10:13.786157+0000","last_fullsized":"2024-09-19T08:10:13.786157+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:45.325895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786050+0000","last_change":"2024-09-19T08:09:11.244625+0000","last_active":"2024-09-19T08:10:13.786050+0000","last_peered":"2024-09-19T08:10:13.786050+0000","last_clean":"2024-09-19T08:10:13.786050+0000","last_became_active":"2024-09-19T08:09:11.244277+0000","last_became_peered":"2024-09-19T08:09:11.244277+0000","last_unstale":"2024-09-19T08:10:13.786050+0000","last_undegraded":"2024-09-19T08:10:13.786050+0000","last_fullsized":"2024-09-19T08:10:13.786050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:33:34.050343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784461+0000","last_change":"2024-09-19T08:09:09.116735+0000","last_active":"2024-09-19T08:10:14.784461+0000","last_peered":"2024-09-19T08:10:14.784461+0000","last_clean":"2024-09-19T08:10:14.784461+0000","last_became_active":"2024-09-19T08:09:09.116356+0000","last_became_peered":"2024-09-19T08:09:09.116356+0000","last_unstale":"2024-09-19T08:10:14.784461+0000","last_undegraded":"2024-09-19T08:10:14.784461+0000","last_fullsized":"2024-09-19T08:10:14.784461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:50.952567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783987+0000","last_change":"2024-09-19T08:09:09.113182+0000","last_active":"2024-09-19T08:10:14.783987+0000","last_peered":"2024-09-19T08:10:14.783987+0000","last_clean":"2024-09-19T08:10:14.783987+0000","last_became_active":"2024-09-19T08:09:09.112528+0000","last_became_peered":"2024-09-19T08:09:09.112528+0000","last_unstale":"2024-09-19T08:10:14.783987+0000","last_undegraded":"2024-09-19T08:10:14.783987+0000","last_fullsized":"2024-09-19T08:10:14.783987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:07.647351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787258+0000","last_change":"2024-09-19T08:09:11.241639+0000","last_active":"2024-09-19T08:10:13.787258+0000","last_peered":"2024-09-19T08:10:13.787258+0000","last_clean":"2024-09-19T08:10:13.787258+0000","last_became_active":"2024-09-19T08:09:11.241308+0000","last_became_peered":"2024-09-19T08:09:11.241308+0000","last_unstale":"2024-09-19T08:10:13.787258+0000","last_undegraded":"2024-09-19T08:10:13.787258+0000","last_fullsized":"2024-09-19T08:10:13.787258+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:57.826870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787237+0000","last_change":"2024-09-19T08:09:09.118334+0000","last_active":"2024-09-19T08:10:13.787237+0000","last_peered":"2024-09-19T08:10:13.787237+0000","last_clean":"2024-09-19T08:10:13.787237+0000","last_became_active":"2024-09-19T08:09:09.118010+0000","last_became_peered":"2024-09-19T08:09:09.118010+0000","last_unstale":"2024-09-19T08:10:13.787237+0000","last_undegraded":"2024-09-19T08:10:13.787237+0000","last_fullsized":"2024-09-19T08:10:13.787237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:51.046598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.780899+0000","last_change":"2024-09-19T08:09:11.239990+0000","last_active":"2024-09-19T08:10:14.780899+0000","last_peered":"2024-09-19T08:10:14.780899+0000","last_clean":"2024-09-19T08:10:14.780899+0000","last_became_active":"2024-09-19T08:09:11.239643+0000","last_became_peered":"2024-09-19T08:09:11.239643+0000","last_unstale":"2024-09-19T08:10:14.780899+0000","last_undegraded":"2024-09-19T08:10:14.780899+0000","last_fullsized":"2024-09-19T08:10:14.780899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:07.078244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784982+0000","last_change":"2024-09-19T08:09:09.114397+0000","last_active":"2024-09-19T08:10:14.784982+0000","last_peered":"2024-09-19T08:10:14.784982+0000","last_clean":"2024-09-19T08:10:14.784982+0000","last_became_active":"2024-09-19T08:09:09.114051+0000","last_became_peered":"2024-09-19T08:09:09.114051+0000","last_unstale":"2024-09-19T08:10:14.784982+0000","last_undegraded":"2024-09-19T08:10:14.784982+0000","last_fullsized":"2024-09-19T08:10:14.784982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:41.799442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.782471+0000","last_change":"2024-09-19T08:09:11.254802+0000","last_active":"2024-09-19T08:10:14.782471+0000","last_peered":"2024-09-19T08:10:14.782471+0000","last_clean":"2024-09-19T08:10:14.782471+0000","last_became_active":"2024-09-19T08:09:11.253869+0000","last_became_peered":"2024-09-19T08:09:11.253869+0000","last_unstale":"2024-09-19T08:10:14.782471+0000","last_undegraded":"2024-09-19T08:10:14.782471+0000","last_fullsized":"2024-09-19T08:10:14.782471+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:00.164834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786687+0000","last_change":"2024-09-19T08:09:09.118585+0000","last_active":"2024-09-19T08:10:14.786687+0000","last_peered":"2024-09-19T08:10:14.786687+0000","last_clean":"2024-09-19T08:10:14.786687+0000","last_became_active":"2024-09-19T08:09:09.118216+0000","last_became_peered":"2024-09-19T08:09:09.118216+0000","last_unstale":"2024-09-19T08:10:14.786687+0000","last_undegraded":"2024-09-19T08:10:14.786687+0000","last_fullsized":"2024-09-19T08:10:14.786687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:41.905746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786880+0000","last_change":"2024-09-19T08:09:11.249835+0000","last_active":"2024-09-19T08:10:14.786880+0000","last_peered":"2024-09-19T08:10:14.786880+0000","last_clean":"2024-09-19T08:10:14.786880+0000","last_became_active":"2024-09-19T08:09:11.249443+0000","last_became_peered":"2024-09-19T08:09:11.249443+0000","last_unstale":"2024-09-19T08:10:14.786880+0000","last_undegraded":"2024-09-19T08:10:14.786880+0000","last_fullsized":"2024-09-19T08:10:14.786880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:06.373126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786711+0000","last_change":"2024-09-19T08:09:09.242565+0000","last_active":"2024-09-19T08:10:13.786711+0000","last_peered":"2024-09-19T08:10:13.786711+0000","last_clean":"2024-09-19T08:10:13.786711+0000","last_became_active":"2024-09-19T08:09:09.242199+0000","last_became_peered":"2024-09-19T08:09:09.242199+0000","last_unstale":"2024-09-19T08:10:13.786711+0000","last_undegraded":"2024-09-19T08:10:13.786711+0000","last_fullsized":"2024-09-19T08:10:13.786711+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:33.195385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.782108+0000","last_change":"2024-09-19T08:09:11.251682+0000","last_active":"2024-09-19T08:10:14.782108+0000","last_peered":"2024-09-19T08:10:14.782108+0000","last_clean":"2024-09-19T08:10:14.782108+0000","last_became_active":"2024-09-19T08:09:11.251037+0000","last_became_peered":"2024-09-19T08:09:11.251037+0000","last_unstale":"2024-09-19T08:10:14.782108+0000","last_undegraded":"2024-09-19T08:10:14.782108+0000","last_fullsized":"2024-09-19T08:10:14.782108+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:29.518828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":173,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:16.402993+0000","last_change":"2024-09-19T08:09:09.119090+0000","last_active":"2024-09-19T08:10:16.402993+0000","last_peered":"2024-09-19T08:10:16.402993+0000","last_clean":"2024-09-19T08:10:16.402993+0000","last_became_active":"2024-09-19T08:09:09.118685+0000","last_became_peered":"2024-09-19T08:09:09.118685+0000","last_unstale":"2024-09-19T08:10:16.402993+0000","last_undegraded":"2024-09-19T08:10:16.402993+0000","last_fullsized":"2024-09-19T08:10:16.402993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:21.540404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62819,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":123,"num_write":27,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.788088+0000","last_change":"2024-09-19T08:09:11.243200+0000","last_active":"2024-09-19T08:10:14.788088+0000","last_peered":"2024-09-19T08:10:14.788088+0000","last_clean":"2024-09-19T08:10:14.788088+0000","last_became_active":"2024-09-19T08:09:11.242873+0000","last_became_peered":"2024-09-19T08:09:11.242873+0000","last_unstale":"2024-09-19T08:10:14.788088+0000","last_undegraded":"2024-09-19T08:10:14.788088+0000","last_fullsized":"2024-09-19T08:10:14.788088+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:35.817609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.781892+0000","last_change":"2024-09-19T08:09:09.117117+0000","last_active":"2024-09-19T08:10:14.781892+0000","last_peered":"2024-09-19T08:10:14.781892+0000","last_clean":"2024-09-19T08:10:14.781892+0000","last_became_active":"2024-09-19T08:09:09.116512+0000","last_became_peered":"2024-09-19T08:09:09.116512+0000","last_unstale":"2024-09-19T08:10:14.781892+0000","last_undegraded":"2024-09-19T08:10:14.781892+0000","last_fullsized":"2024-09-19T08:10:14.781892+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:15.010570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783609+0000","last_change":"2024-09-19T08:09:11.246648+0000","last_active":"2024-09-19T08:10:14.783609+0000","last_peered":"2024-09-19T08:10:14.783609+0000","last_clean":"2024-09-19T08:10:14.783609+0000","last_became_active":"2024-09-19T08:09:11.246317+0000","last_became_peered":"2024-09-19T08:09:11.246317+0000","last_unstale":"2024-09-19T08:10:14.783609+0000","last_undegraded":"2024-09-19T08:10:14.783609+0000","last_fullsized":"2024-09-19T08:10:14.783609+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:43.285257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786532+0000","last_change":"2024-09-19T08:09:09.112599+0000","last_active":"2024-09-19T08:10:13.786532+0000","last_peered":"2024-09-19T08:10:13.786532+0000","last_clean":"2024-09-19T08:10:13.786532+0000","last_became_active":"2024-09-19T08:09:09.112281+0000","last_became_peered":"2024-09-19T08:09:09.112281+0000","last_unstale":"2024-09-19T08:10:13.786532+0000","last_undegraded":"2024-09-19T08:10:13.786532+0000","last_fullsized":"2024-09-19T08:10:13.786532+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:47.710235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787152+0000","last_change":"2024-09-19T08:09:11.253814+0000","last_active":"2024-09-19T08:10:14.787152+0000","last_peered":"2024-09-19T08:10:14.787152+0000","last_clean":"2024-09-19T08:10:14.787152+0000","last_became_active":"2024-09-19T08:09:11.253490+0000","last_became_peered":"2024-09-19T08:09:11.253490+0000","last_unstale":"2024-09-19T08:10:14.787152+0000","last_undegraded":"2024-09-19T08:10:14.787152+0000","last_fullsized":"2024-09-19T08:10:14.787152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:09.287110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.785412+0000","last_change":"2024-09-19T08:09:09.114820+0000","last_active":"2024-09-19T08:10:14.785412+0000","last_peered":"2024-09-19T08:10:14.785412+0000","last_clean":"2024-09-19T08:10:14.785412+0000","last_became_active":"2024-09-19T08:09:09.114478+0000","last_became_peered":"2024-09-19T08:09:09.114478+0000","last_unstale":"2024-09-19T08:10:14.785412+0000","last_undegraded":"2024-09-19T08:10:14.785412+0000","last_fullsized":"2024-09-19T08:10:14.785412+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:24.243629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.789301+0000","last_change":"2024-09-19T08:10:14.789301+0000","last_active":"2024-09-19T08:10:14.789301+0000","last_peered":"2024-09-19T08:10:14.789301+0000","last_clean":"2024-09-19T08:10:14.789301+0000","last_became_active":"2024-09-19T08:10:14.788891+0000","last_became_peered":"2024-09-19T08:10:14.788891+0000","last_unstale":"2024-09-19T08:10:14.789301+0000","last_undegraded":"2024-09-19T08:10:14.789301+0000","last_fullsized":"2024-09-19T08:10:14.789301+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:03.142177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.799601+0000","last_change":"2024-09-19T08:10:14.799207+0000","last_active":"2024-09-19T08:10:14.799601+0000","last_peered":"2024-09-19T08:10:14.799601+0000","last_clean":"2024-09-19T08:10:14.799601+0000","last_became_active":"2024-09-19T08:10:14.787612+0000","last_became_peered":"2024-09-19T08:10:14.787612+0000","last_unstale":"2024-09-19T08:10:14.799601+0000","last_undegraded":"2024-09-19T08:10:14.799601+0000","last_fullsized":"2024-09-19T08:10:14.799601+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:45.997778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786314+0000","last_change":"2024-09-19T08:09:11.245399+0000","last_active":"2024-09-19T08:10:13.786314+0000","last_peered":"2024-09-19T08:10:13.786314+0000","last_clean":"2024-09-19T08:10:13.786314+0000","last_became_active":"2024-09-19T08:09:11.245055+0000","last_became_peered":"2024-09-19T08:09:11.245055+0000","last_unstale":"2024-09-19T08:10:13.786314+0000","last_undegraded":"2024-09-19T08:10:13.786314+0000","last_fullsized":"2024-09-19T08:10:13.786314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:57.639205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.788242+0000","last_change":"2024-09-19T08:09:09.115252+0000","last_active":"2024-09-19T08:10:14.788242+0000","last_peered":"2024-09-19T08:10:14.788242+0000","last_clean":"2024-09-19T08:10:14.788242+0000","last_became_active":"2024-09-19T08:09:09.114908+0000","last_became_peered":"2024-09-19T08:09:09.114908+0000","last_unstale":"2024-09-19T08:10:14.788242+0000","last_undegraded":"2024-09-19T08:10:14.788242+0000","last_fullsized":"2024-09-19T08:10:14.788242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:48.326221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784415+0000","last_change":"2024-09-19T08:09:11.249189+0000","last_active":"2024-09-19T08:10:14.784415+0000","last_peered":"2024-09-19T08:10:14.784415+0000","last_clean":"2024-09-19T08:10:14.784415+0000","last_became_active":"2024-09-19T08:09:11.248797+0000","last_became_peered":"2024-09-19T08:09:11.248797+0000","last_unstale":"2024-09-19T08:10:14.784415+0000","last_undegraded":"2024-09-19T08:10:14.784415+0000","last_fullsized":"2024-09-19T08:10:14.784415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:20.915638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783784+0000","last_change":"2024-09-19T08:09:09.112973+0000","last_active":"2024-09-19T08:10:14.783784+0000","last_peered":"2024-09-19T08:10:14.783784+0000","last_clean":"2024-09-19T08:10:14.783784+0000","last_became_active":"2024-09-19T08:09:09.112616+0000","last_became_peered":"2024-09-19T08:09:09.112616+0000","last_unstale":"2024-09-19T08:10:14.783784+0000","last_undegraded":"2024-09-19T08:10:14.783784+0000","last_fullsized":"2024-09-19T08:10:14.783784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:13.791926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787430+0000","last_change":"2024-09-19T08:09:11.240739+0000","last_active":"2024-09-19T08:10:14.787430+0000","last_peered":"2024-09-19T08:10:14.787430+0000","last_clean":"2024-09-19T08:10:14.787430+0000","last_became_active":"2024-09-19T08:09:11.240340+0000","last_became_peered":"2024-09-19T08:09:11.240340+0000","last_unstale":"2024-09-19T08:10:14.787430+0000","last_undegraded":"2024-09-19T08:10:14.787430+0000","last_fullsized":"2024-09-19T08:10:14.787430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:35.450279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786744+0000","last_change":"2024-09-19T08:09:09.112516+0000","last_active":"2024-09-19T08:10:13.786744+0000","last_peered":"2024-09-19T08:10:13.786744+0000","last_clean":"2024-09-19T08:10:13.786744+0000","last_became_active":"2024-09-19T08:09:09.112140+0000","last_became_peered":"2024-09-19T08:09:09.112140+0000","last_unstale":"2024-09-19T08:10:13.786744+0000","last_undegraded":"2024-09-19T08:10:13.786744+0000","last_fullsized":"2024-09-19T08:10:13.786744+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:05.434331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786545+0000","last_change":"2024-09-19T08:09:11.252163+0000","last_active":"2024-09-19T08:10:14.786545+0000","last_peered":"2024-09-19T08:10:14.786545+0000","last_clean":"2024-09-19T08:10:14.786545+0000","last_became_active":"2024-09-19T08:09:11.251762+0000","last_became_peered":"2024-09-19T08:09:11.251762+0000","last_unstale":"2024-09-19T08:10:14.786545+0000","last_undegraded":"2024-09-19T08:10:14.786545+0000","last_fullsized":"2024-09-19T08:10:14.786545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:33.941910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.789183+0000","last_change":"2024-09-19T08:10:14.788460+0000","last_active":"2024-09-19T08:10:14.789183+0000","last_peered":"2024-09-19T08:10:14.789183+0000","last_clean":"2024-09-19T08:10:14.789183+0000","last_became_active":"2024-09-19T08:10:14.787990+0000","last_became_peered":"2024-09-19T08:10:14.787990+0000","last_unstale":"2024-09-19T08:10:14.789183+0000","last_undegraded":"2024-09-19T08:10:14.789183+0000","last_fullsized":"2024-09-19T08:10:14.789183+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:24.549994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787042+0000","last_change":"2024-09-19T08:09:11.242438+0000","last_active":"2024-09-19T08:10:14.787042+0000","last_peered":"2024-09-19T08:10:14.787042+0000","last_clean":"2024-09-19T08:10:14.787042+0000","last_became_active":"2024-09-19T08:09:11.242114+0000","last_became_peered":"2024-09-19T08:09:11.242114+0000","last_unstale":"2024-09-19T08:10:14.787042+0000","last_undegraded":"2024-09-19T08:10:14.787042+0000","last_fullsized":"2024-09-19T08:10:14.787042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:54.183012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":345,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787300+0000","last_change":"2024-09-19T08:07:55.287566+0000","last_active":"2024-09-19T08:10:14.787300+0000","last_peered":"2024-09-19T08:10:14.787300+0000","last_clean":"2024-09-19T08:10:14.787300+0000","last_became_active":"2024-09-19T08:07:55.287037+0000","last_became_peered":"2024-09-19T08:07:55.287037+0000","last_unstale":"2024-09-19T08:10:14.787300+0000","last_undegraded":"2024-09-19T08:10:14.787300+0000","last_fullsized":"2024-09-19T08:10:14.787300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_clean_scrub_stamp":"2024-09-19T08:04:29.468857+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:49.553882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784592+0000","last_change":"2024-09-19T08:09:09.113497+0000","last_active":"2024-09-19T08:10:14.784592+0000","last_peered":"2024-09-19T08:10:14.784592+0000","last_clean":"2024-09-19T08:10:14.784592+0000","last_became_active":"2024-09-19T08:09:09.112546+0000","last_became_peered":"2024-09-19T08:09:09.112546+0000","last_unstale":"2024-09-19T08:10:14.784592+0000","last_undegraded":"2024-09-19T08:10:14.784592+0000","last_fullsized":"2024-09-19T08:10:14.784592+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:09.906476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787709+0000","last_change":"2024-09-19T08:09:11.241478+0000","last_active":"2024-09-19T08:10:13.787709+0000","last_peered":"2024-09-19T08:10:13.787709+0000","last_clean":"2024-09-19T08:10:13.787709+0000","last_became_active":"2024-09-19T08:09:11.241138+0000","last_became_peered":"2024-09-19T08:09:11.241138+0000","last_unstale":"2024-09-19T08:10:13.787709+0000","last_undegraded":"2024-09-19T08:10:13.787709+0000","last_fullsized":"2024-09-19T08:10:13.787709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:32.884491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787410+0000","last_change":"2024-09-19T08:09:09.116571+0000","last_active":"2024-09-19T08:10:14.787410+0000","last_peered":"2024-09-19T08:10:14.787410+0000","last_clean":"2024-09-19T08:10:14.787410+0000","last_became_active":"2024-09-19T08:09:09.116180+0000","last_became_peered":"2024-09-19T08:09:09.116180+0000","last_unstale":"2024-09-19T08:10:14.787410+0000","last_undegraded":"2024-09-19T08:10:14.787410+0000","last_fullsized":"2024-09-19T08:10:14.787410+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:58.577320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.791196+0000","last_change":"2024-09-19T08:10:14.791196+0000","last_active":"2024-09-19T08:10:14.791196+0000","last_peered":"2024-09-19T08:10:14.791196+0000","last_clean":"2024-09-19T08:10:14.791196+0000","last_became_active":"2024-09-19T08:10:14.790873+0000","last_became_peered":"2024-09-19T08:10:14.790873+0000","last_unstale":"2024-09-19T08:10:14.791196+0000","last_undegraded":"2024-09-19T08:10:14.791196+0000","last_fullsized":"2024-09-19T08:10:14.791196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:41.725521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784061+0000","last_change":"2024-09-19T08:09:09.242166+0000","last_active":"2024-09-19T08:10:14.784061+0000","last_peered":"2024-09-19T08:10:14.784061+0000","last_clean":"2024-09-19T08:10:14.784061+0000","last_became_active":"2024-09-19T08:09:09.241270+0000","last_became_peered":"2024-09-19T08:09:09.241270+0000","last_unstale":"2024-09-19T08:10:14.784061+0000","last_undegraded":"2024-09-19T08:10:14.784061+0000","last_fullsized":"2024-09-19T08:10:14.784061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:51.899069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-19T08:09:14.748141+0000","last_change":"2024-09-19T08:10:13.786269+0000","last_active":"2024-09-19T08:10:13.786269+0000","last_peered":"2024-09-19T08:09:14.748141+0000","last_clean":"2024-09-19T08:09:14.748141+0000","last_became_active":"2024-09-19T08:09:11.252219+0000","last_became_peered":"2024-09-19T08:09:11.252219+0000","last_unstale":"2024-09-19T08:09:14.748141+0000","last_undegraded":"2024-09-19T08:09:14.748141+0000","last_fullsized":"2024-09-19T08:09:14.748141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,8],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786956+0000","last_change":"2024-09-19T08:09:09.118790+0000","last_active":"2024-09-19T08:10:14.786956+0000","last_peered":"2024-09-19T08:10:14.786956+0000","last_clean":"2024-09-19T08:10:14.786956+0000","last_became_active":"2024-09-19T08:09:09.117695+0000","last_became_peered":"2024-09-19T08:09:09.117695+0000","last_unstale":"2024-09-19T08:10:14.786956+0000","last_undegraded":"2024-09-19T08:10:14.786956+0000","last_fullsized":"2024-09-19T08:10:14.786956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:40.674039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784329+0000","last_change":"2024-09-19T08:09:11.249386+0000","last_active":"2024-09-19T08:10:14.784329+0000","last_peered":"2024-09-19T08:10:14.784329+0000","last_clean":"2024-09-19T08:10:14.784329+0000","last_became_active":"2024-09-19T08:09:11.249004+0000","last_became_peered":"2024-09-19T08:09:11.249004+0000","last_unstale":"2024-09-19T08:10:14.784329+0000","last_undegraded":"2024-09-19T08:10:14.784329+0000","last_fullsized":"2024-09-19T08:10:14.784329+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:50.170799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.781085+0000","last_change":"2024-09-19T08:09:09.241599+0000","last_active":"2024-09-19T08:10:14.781085+0000","last_peered":"2024-09-19T08:10:14.781085+0000","last_clean":"2024-09-19T08:10:14.781085+0000","last_became_active":"2024-09-19T08:09:09.241226+0000","last_became_peered":"2024-09-19T08:09:09.241226+0000","last_unstale":"2024-09-19T08:10:14.781085+0000","last_undegraded":"2024-09-19T08:10:14.781085+0000","last_fullsized":"2024-09-19T08:10:14.781085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:19.590966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784610+0000","last_change":"2024-09-19T08:09:11.238098+0000","last_active":"2024-09-19T08:10:14.784610+0000","last_peered":"2024-09-19T08:10:14.784610+0000","last_clean":"2024-09-19T08:10:14.784610+0000","last_became_active":"2024-09-19T08:09:11.237737+0000","last_became_peered":"2024-09-19T08:09:11.237737+0000","last_unstale":"2024-09-19T08:10:14.784610+0000","last_undegraded":"2024-09-19T08:10:14.784610+0000","last_fullsized":"2024-09-19T08:10:14.784610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:00.134664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.788301+0000","last_change":"2024-09-19T08:09:09.241775+0000","last_active":"2024-09-19T08:10:14.788301+0000","last_peered":"2024-09-19T08:10:14.788301+0000","last_clean":"2024-09-19T08:10:14.788301+0000","last_became_active":"2024-09-19T08:09:09.241367+0000","last_became_peered":"2024-09-19T08:09:09.241367+0000","last_unstale":"2024-09-19T08:10:14.788301+0000","last_undegraded":"2024-09-19T08:10:14.788301+0000","last_fullsized":"2024-09-19T08:10:14.788301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:11.862171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783853+0000","last_change":"2024-09-19T08:09:11.251980+0000","last_active":"2024-09-19T08:10:14.783853+0000","last_peered":"2024-09-19T08:10:14.783853+0000","last_clean":"2024-09-19T08:10:14.783853+0000","last_became_active":"2024-09-19T08:09:11.251638+0000","last_became_peered":"2024-09-19T08:09:11.251638+0000","last_unstale":"2024-09-19T08:10:14.783853+0000","last_undegraded":"2024-09-19T08:10:14.783853+0000","last_fullsized":"2024-09-19T08:10:14.783853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:35.905643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'8","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.781140+0000","last_change":"2024-09-19T08:09:09.117150+0000","last_active":"2024-09-19T08:10:14.781140+0000","last_peered":"2024-09-19T08:10:14.781140+0000","last_clean":"2024-09-19T08:10:14.781140+0000","last_became_active":"2024-09-19T08:09:09.116763+0000","last_became_peered":"2024-09-19T08:09:09.116763+0000","last_unstale":"2024-09-19T08:10:14.781140+0000","last_undegraded":"2024-09-19T08:10:14.781140+0000","last_fullsized":"2024-09-19T08:10:14.781140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:18.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.788673+0000","last_change":"2024-09-19T08:09:11.244366+0000","last_active":"2024-09-19T08:10:13.788673+0000","last_peered":"2024-09-19T08:10:13.788673+0000","last_clean":"2024-09-19T08:10:13.788673+0000","last_became_active":"2024-09-19T08:09:11.244023+0000","last_became_peered":"2024-09-19T08:09:11.244023+0000","last_unstale":"2024-09-19T08:10:13.788673+0000","last_undegraded":"2024-09-19T08:10:13.788673+0000","last_fullsized":"2024-09-19T08:10:13.788673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:18.572377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784549+0000","last_change":"2024-09-19T08:09:09.139557+0000","last_active":"2024-09-19T08:10:14.784549+0000","last_peered":"2024-09-19T08:10:14.784549+0000","last_clean":"2024-09-19T08:10:14.784549+0000","last_became_active":"2024-09-19T08:09:09.139190+0000","last_became_peered":"2024-09-19T08:09:09.139190+0000","last_unstale":"2024-09-19T08:10:14.784549+0000","last_undegraded":"2024-09-19T08:10:14.784549+0000","last_fullsized":"2024-09-19T08:10:14.784549+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:39.270432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786623+0000","last_change":"2024-09-19T08:09:11.249637+0000","last_active":"2024-09-19T08:10:14.786623+0000","last_peered":"2024-09-19T08:10:14.786623+0000","last_clean":"2024-09-19T08:10:14.786623+0000","last_became_active":"2024-09-19T08:09:11.249323+0000","last_became_peered":"2024-09-19T08:09:11.249323+0000","last_unstale":"2024-09-19T08:10:14.786623+0000","last_undegraded":"2024-09-19T08:10:14.786623+0000","last_fullsized":"2024-09-19T08:10:14.786623+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:28.270910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.782063+0000","last_change":"2024-09-19T08:09:09.242444+0000","last_active":"2024-09-19T08:10:14.782063+0000","last_peered":"2024-09-19T08:10:14.782063+0000","last_clean":"2024-09-19T08:10:14.782063+0000","last_became_active":"2024-09-19T08:09:09.242095+0000","last_became_peered":"2024-09-19T08:09:09.242095+0000","last_unstale":"2024-09-19T08:10:14.782063+0000","last_undegraded":"2024-09-19T08:10:14.782063+0000","last_fullsized":"2024-09-19T08:10:14.782063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:42.941930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787131+0000","last_change":"2024-09-19T08:09:11.241588+0000","last_active":"2024-09-19T08:10:14.787131+0000","last_peered":"2024-09-19T08:10:14.787131+0000","last_clean":"2024-09-19T08:10:14.787131+0000","last_became_active":"2024-09-19T08:09:11.241076+0000","last_became_peered":"2024-09-19T08:09:11.241076+0000","last_unstale":"2024-09-19T08:10:14.787131+0000","last_undegraded":"2024-09-19T08:10:14.787131+0000","last_fullsized":"2024-09-19T08:10:14.787131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:01.676410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787630+0000","last_change":"2024-09-19T08:09:09.112494+0000","last_active":"2024-09-19T08:10:13.787630+0000","last_peered":"2024-09-19T08:10:13.787630+0000","last_clean":"2024-09-19T08:10:13.787630+0000","last_became_active":"2024-09-19T08:09:09.112019+0000","last_became_peered":"2024-09-19T08:09:09.112019+0000","last_unstale":"2024-09-19T08:10:13.787630+0000","last_undegraded":"2024-09-19T08:10:13.787630+0000","last_fullsized":"2024-09-19T08:10:13.787630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:17.674092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784464+0000","last_change":"2024-09-19T08:09:11.251420+0000","last_active":"2024-09-19T08:10:14.784464+0000","last_peered":"2024-09-19T08:10:14.784464+0000","last_clean":"2024-09-19T08:10:14.784464+0000","last_became_active":"2024-09-19T08:09:11.251083+0000","last_became_peered":"2024-09-19T08:09:11.251083+0000","last_unstale":"2024-09-19T08:10:14.784464+0000","last_undegraded":"2024-09-19T08:10:14.784464+0000","last_fullsized":"2024-09-19T08:10:14.784464+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:38.810616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.826422+0000","last_change":"2024-09-19T08:10:14.825972+0000","last_active":"2024-09-19T08:10:14.826422+0000","last_peered":"2024-09-19T08:10:14.826422+0000","last_clean":"2024-09-19T08:10:14.826422+0000","last_became_active":"2024-09-19T08:10:14.825579+0000","last_became_peered":"2024-09-19T08:10:14.825579+0000","last_unstale":"2024-09-19T08:10:14.826422+0000","last_undegraded":"2024-09-19T08:10:14.826422+0000","last_fullsized":"2024-09-19T08:10:14.826422+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:06.708622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.787802+0000","last_change":"2024-09-19T08:09:11.239096+0000","last_active":"2024-09-19T08:10:13.787802+0000","last_peered":"2024-09-19T08:10:13.787802+0000","last_clean":"2024-09-19T08:10:13.787802+0000","last_became_active":"2024-09-19T08:09:11.238739+0000","last_became_peered":"2024-09-19T08:09:11.238739+0000","last_unstale":"2024-09-19T08:10:13.787802+0000","last_undegraded":"2024-09-19T08:10:13.787802+0000","last_fullsized":"2024-09-19T08:10:13.787802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:27.161174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787536+0000","last_change":"2024-09-19T08:09:09.115198+0000","last_active":"2024-09-19T08:10:14.787536+0000","last_peered":"2024-09-19T08:10:14.787536+0000","last_clean":"2024-09-19T08:10:14.787536+0000","last_became_active":"2024-09-19T08:09:09.114783+0000","last_became_peered":"2024-09-19T08:09:09.114783+0000","last_unstale":"2024-09-19T08:10:14.787536+0000","last_undegraded":"2024-09-19T08:10:14.787536+0000","last_fullsized":"2024-09-19T08:10:14.787536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:45.674774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786764+0000","last_change":"2024-09-19T08:09:11.252450+0000","last_active":"2024-09-19T08:10:14.786764+0000","last_peered":"2024-09-19T08:10:14.786764+0000","last_clean":"2024-09-19T08:10:14.786764+0000","last_became_active":"2024-09-19T08:09:11.251696+0000","last_became_peered":"2024-09-19T08:09:11.251696+0000","last_unstale":"2024-09-19T08:10:14.786764+0000","last_undegraded":"2024-09-19T08:10:14.786764+0000","last_fullsized":"2024-09-19T08:10:14.786764+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:48.179795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.786579+0000","last_change":"2024-09-19T08:09:11.244571+0000","last_active":"2024-09-19T08:10:13.786579+0000","last_peered":"2024-09-19T08:10:13.786579+0000","last_clean":"2024-09-19T08:10:13.786579+0000","last_became_active":"2024-09-19T08:09:11.244217+0000","last_became_peered":"2024-09-19T08:09:11.244217+0000","last_unstale":"2024-09-19T08:10:13.786579+0000","last_undegraded":"2024-09-19T08:10:13.786579+0000","last_fullsized":"2024-09-19T08:10:13.786579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:52.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787749+0000","last_change":"2024-09-19T08:09:09.117355+0000","last_active":"2024-09-19T08:10:14.787749+0000","last_peered":"2024-09-19T08:10:14.787749+0000","last_clean":"2024-09-19T08:10:14.787749+0000","last_became_active":"2024-09-19T08:09:09.116806+0000","last_became_peered":"2024-09-19T08:09:09.116806+0000","last_unstale":"2024-09-19T08:10:14.787749+0000","last_undegraded":"2024-09-19T08:10:14.787749+0000","last_fullsized":"2024-09-19T08:10:14.787749+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:42.113015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.782099+0000","last_change":"2024-09-19T08:09:11.245745+0000","last_active":"2024-09-19T08:10:14.782099+0000","last_peered":"2024-09-19T08:10:14.782099+0000","last_clean":"2024-09-19T08:10:14.782099+0000","last_became_active":"2024-09-19T08:09:11.245373+0000","last_became_peered":"2024-09-19T08:09:11.245373+0000","last_unstale":"2024-09-19T08:10:14.782099+0000","last_undegraded":"2024-09-19T08:10:14.782099+0000","last_fullsized":"2024-09-19T08:10:14.782099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:56.500738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.788193+0000","last_change":"2024-09-19T08:09:09.119550+0000","last_active":"2024-09-19T08:10:14.788193+0000","last_peered":"2024-09-19T08:10:14.788193+0000","last_clean":"2024-09-19T08:10:14.788193+0000","last_became_active":"2024-09-19T08:09:09.119187+0000","last_became_peered":"2024-09-19T08:09:09.119187+0000","last_unstale":"2024-09-19T08:10:14.788193+0000","last_undegraded":"2024-09-19T08:10:14.788193+0000","last_fullsized":"2024-09-19T08:10:14.788193+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:14.629824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786666+0000","last_change":"2024-09-19T08:09:11.245318+0000","last_active":"2024-09-19T08:10:14.786666+0000","last_peered":"2024-09-19T08:10:14.786666+0000","last_clean":"2024-09-19T08:10:14.786666+0000","last_became_active":"2024-09-19T08:09:11.245000+0000","last_became_peered":"2024-09-19T08:09:11.245000+0000","last_unstale":"2024-09-19T08:10:14.786666+0000","last_undegraded":"2024-09-19T08:10:14.786666+0000","last_fullsized":"2024-09-19T08:10:14.786666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:53.590453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.788328+0000","last_change":"2024-09-19T08:09:09.241552+0000","last_active":"2024-09-19T08:10:13.788328+0000","last_peered":"2024-09-19T08:10:13.788328+0000","last_clean":"2024-09-19T08:10:13.788328+0000","last_became_active":"2024-09-19T08:09:09.241201+0000","last_became_peered":"2024-09-19T08:09:09.241201+0000","last_unstale":"2024-09-19T08:10:13.788328+0000","last_undegraded":"2024-09-19T08:10:13.788328+0000","last_fullsized":"2024-09-19T08:10:13.788328+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:09.374532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:10:13.788157+0000","last_change":"2024-09-19T08:09:11.246697+0000","last_active":"2024-09-19T08:10:13.788157+0000","last_peered":"2024-09-19T08:10:13.788157+0000","last_clean":"2024-09-19T08:10:13.788157+0000","last_became_active":"2024-09-19T08:09:11.246404+0000","last_became_peered":"2024-09-19T08:09:11.246404+0000","last_unstale":"2024-09-19T08:10:13.788157+0000","last_undegraded":"2024-09-19T08:10:13.788157+0000","last_fullsized":"2024-09-19T08:10:13.788157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.008875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.781212+0000","last_change":"2024-09-19T08:09:09.113401+0000","last_active":"2024-09-19T08:10:14.781212+0000","last_peered":"2024-09-19T08:10:14.781212+0000","last_clean":"2024-09-19T08:10:14.781212+0000","last_became_active":"2024-09-19T08:09:09.113026+0000","last_became_peered":"2024-09-19T08:09:09.113026+0000","last_unstale":"2024-09-19T08:10:14.781212+0000","last_undegraded":"2024-09-19T08:10:14.781212+0000","last_fullsized":"2024-09-19T08:10:14.781212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:54.740955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63617,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":130,"num_read_kb":129,"num_write":81,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":67,"ondisk_log_size":67,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281686,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547228,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":436037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776160,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1032192,"data_stored":1089535,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939686,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":436619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168618,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":901120,"data_stored":436641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397551,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":950272,"data_stored":1027104,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561076,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":436154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790009,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":946176,"data_stored":1018274,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953535,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":884736,"data_stored":427629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182468,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":419360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411402,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":970752,"data_stored":498890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":966656,"data_stored":498856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":436127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:10:22.159 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:21 smithi203 ceph-mon[35198]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:10:22.160 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:21 smithi203 ceph-mon[35198]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:10:22.160 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:21 smithi203 ceph-mon[35198]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-19T08:10:22.160 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:21 smithi203 ceph-mon[35198]: Cluster is now healthy 2024-09-19T08:10:22.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:21 smithi155 ceph-mon[35362]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:10:22.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:21 smithi155 ceph-mon[35362]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:10:22.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:21 smithi155 ceph-mon[35362]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-19T08:10:22.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:21 smithi155 ceph-mon[35362]: Cluster is now healthy 2024-09-19T08:10:22.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:21 smithi027 ceph-mon[31209]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:10:22.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:21 smithi027 ceph-mon[31209]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:10:22.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:21 smithi027 ceph-mon[31209]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-19T08:10:22.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:21 smithi027 ceph-mon[31209]: Cluster is now healthy 2024-09-19T08:10:24.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:23 smithi027 ceph-mon[31209]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:10:24.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:23 smithi203 ceph-mon[35198]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:10:24.310 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:23 smithi155 ceph-mon[35362]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:10:24.520 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:10:24.792 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:25.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.294+0000 7f7871d3f640 1 -- 172.21.15.27:0/884143142 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f786c102570 msgr2=0x7f786c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:25.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.294+0000 7f7871d3f640 1 --2- 172.21.15.27:0/884143142 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f786c102570 0x7f786c1029b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7854009900 tx=0x7f785402a480 comp rx=0 tx=0).stop 2024-09-19T08:10:25.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.294+0000 7f7871d3f640 1 -- 172.21.15.27:0/884143142 shutdown_connections 2024-09-19T08:10:25.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.294+0000 7f7871d3f640 1 --2- 172.21.15.27:0/884143142 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f786c102ef0 0x7f786c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:25.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.294+0000 7f7871d3f640 1 --2- 172.21.15.27:0/884143142 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f786c102570 0x7f786c1029b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:25.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.294+0000 7f7871d3f640 1 --2- 172.21.15.27:0/884143142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f786c100e20 0x7f786c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:25.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.294+0000 7f7871d3f640 1 -- 172.21.15.27:0/884143142 >> 172.21.15.27:0/884143142 conn(0x7f786c0fc7d0 msgr2=0x7f786c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:25.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.294+0000 7f7871d3f640 1 -- 172.21.15.27:0/884143142 shutdown_connections 2024-09-19T08:10:25.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.294+0000 7f7871d3f640 1 -- 172.21.15.27:0/884143142 wait complete. 2024-09-19T08:10:25.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.295+0000 7f7871d3f640 1 Processor -- start 2024-09-19T08:10:25.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.295+0000 7f7871d3f640 1 -- start start 2024-09-19T08:10:25.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.295+0000 7f7871d3f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f786c100e20 0x7f786c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:25.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.295+0000 7f7871d3f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f786c102570 0x7f786c199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:25.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.295+0000 7f7871d3f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f786c102ef0 0x7f786c1a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:25.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.295+0000 7f7871d3f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f786c110f80 con 0x7f786c102570 2024-09-19T08:10:25.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.295+0000 7f7871d3f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f786c110e00 con 0x7f786c102ef0 2024-09-19T08:10:25.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.295+0000 7f7871d3f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f786c111100 con 0x7f786c100e20 2024-09-19T08:10:25.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.295+0000 7f786affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f786c102570 0x7f786c199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:25.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.295+0000 7f786affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f786c102570 0x7f786c199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48454/0 (socket says 172.21.15.27:48454) 2024-09-19T08:10:25.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.295+0000 7f786affd640 1 -- 172.21.15.27:0/3825772021 learned_addr learned my addr 172.21.15.27:0/3825772021 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:25.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.295+0000 7f786b7fe640 1 --2- 172.21.15.27:0/3825772021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f786c100e20 0x7f786c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:25.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.295+0000 7f786bfff640 1 --2- 172.21.15.27:0/3825772021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f786c102ef0 0x7f786c1a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:25.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.296+0000 7f786affd640 1 -- 172.21.15.27:0/3825772021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f786c100e20 msgr2=0x7f786c199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:25.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.296+0000 7f786affd640 1 --2- 172.21.15.27:0/3825772021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f786c100e20 0x7f786c199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:25.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.296+0000 7f786affd640 1 -- 172.21.15.27:0/3825772021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f786c102ef0 msgr2=0x7f786c1a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:25.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.296+0000 7f786affd640 1 --2- 172.21.15.27:0/3825772021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f786c102ef0 0x7f786c1a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:25.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.296+0000 7f786affd640 1 -- 172.21.15.27:0/3825772021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f786c1a4910 con 0x7f786c102570 2024-09-19T08:10:25.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.296+0000 7f786affd640 1 --2- 172.21.15.27:0/3825772021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f786c102570 0x7f786c199890 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7854006010 tx=0x7f7854003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:25.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.296+0000 7f7868ff9640 1 -- 172.21.15.27:0/3825772021 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785403f070 con 0x7f786c102570 2024-09-19T08:10:25.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.296+0000 7f7868ff9640 1 -- 172.21.15.27:0/3825772021 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7854031c30 con 0x7f786c102570 2024-09-19T08:10:25.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.296+0000 7f7871d3f640 1 -- 172.21.15.27:0/3825772021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f786c1a4ae0 con 0x7f786c102570 2024-09-19T08:10:25.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.296+0000 7f7868ff9640 1 -- 172.21.15.27:0/3825772021 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7854035030 con 0x7f786c102570 2024-09-19T08:10:25.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.296+0000 7f7871d3f640 1 -- 172.21.15.27:0/3825772021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f786c1a4f90 con 0x7f786c102570 2024-09-19T08:10:25.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.297+0000 7f7871d3f640 1 -- 172.21.15.27:0/3825772021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f786c101200 con 0x7f786c102570 2024-09-19T08:10:25.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.298+0000 7f7868ff9640 1 -- 172.21.15.27:0/3825772021 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7854042070 con 0x7f786c102570 2024-09-19T08:10:25.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.299+0000 7f7868ff9640 1 --2- 172.21.15.27:0/3825772021 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f78580a3350 0x7f78580a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:25.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.299+0000 7f786b7fe640 1 --2- 172.21.15.27:0/3825772021 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f78580a3350 0x7f78580a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:25.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.299+0000 7f7868ff9640 1 -- 172.21.15.27:0/3825772021 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f78540f01a0 con 0x7f786c102570 2024-09-19T08:10:25.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.299+0000 7f786b7fe640 1 --2- 172.21.15.27:0/3825772021 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f78580a3350 0x7f78580a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f785c00bbe0 tx=0x7f785c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:25.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.303+0000 7f7868ff9640 1 -- 172.21.15.27:0/3825772021 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7854031de0 con 0x7f786c102570 2024-09-19T08:10:25.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.477+0000 7f7871d3f640 1 -- 172.21.15.27:0/3825772021 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f786c109100 con 0x7f78580a3350 2024-09-19T08:10:25.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.484+0000 7f7868ff9640 1 -- 172.21.15.27:0/3825772021 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258800 (secure 0 0 0) 0x7f785c010c30 con 0x7f78580a3350 2024-09-19T08:10:25.486 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:10:25.487 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-09-19T08:10:25.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.488+0000 7f7871d3f640 1 -- 172.21.15.27:0/3825772021 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f78580a3350 msgr2=0x7f78580a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:25.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.488+0000 7f7871d3f640 1 --2- 172.21.15.27:0/3825772021 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f78580a3350 0x7f78580a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f785c00bbe0 tx=0x7f785c00b390 comp rx=0 tx=0).stop 2024-09-19T08:10:25.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.488+0000 7f7871d3f640 1 -- 172.21.15.27:0/3825772021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f786c102570 msgr2=0x7f786c199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:25.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.488+0000 7f7871d3f640 1 --2- 172.21.15.27:0/3825772021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f786c102570 0x7f786c199890 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7854006010 tx=0x7f7854003c10 comp rx=0 tx=0).stop 2024-09-19T08:10:25.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.488+0000 7f7871d3f640 1 -- 172.21.15.27:0/3825772021 shutdown_connections 2024-09-19T08:10:25.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.488+0000 7f7871d3f640 1 --2- 172.21.15.27:0/3825772021 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f78580a3350 0x7f78580a5810 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:25.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.488+0000 7f7871d3f640 1 --2- 172.21.15.27:0/3825772021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f786c102ef0 0x7f786c1a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:25.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.488+0000 7f7871d3f640 1 --2- 172.21.15.27:0/3825772021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f786c102570 0x7f786c199890 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:25.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.488+0000 7f7871d3f640 1 --2- 172.21.15.27:0/3825772021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f786c100e20 0x7f786c199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:25.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.488+0000 7f7871d3f640 1 -- 172.21.15.27:0/3825772021 >> 172.21.15.27:0/3825772021 conn(0x7f786c0fc7d0 msgr2=0x7f786c1068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:25.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.488+0000 7f7871d3f640 1 -- 172.21.15.27:0/3825772021 shutdown_connections 2024-09-19T08:10:25.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:25.488+0000 7f7871d3f640 1 -- 172.21.15.27:0/3825772021 wait complete. 2024-09-19T08:10:26.141 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:25 smithi027 ceph-mon[31209]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1008 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:10:26.141 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:25 smithi027 ceph-mon[31209]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:10:26.171 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2024-09-19T08:10:24.934351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654219,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":276,"num_read_kb":253,"num_write":264,"num_write_kb":3026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356072,"kb_used_data":10908,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585752,"statfs":{"total":1151940427776,"available":1151575810048,"internally_reserved":0,"allocated":11169792,"data_stored":7195101,"data_compressed":107475,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.154516"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784785+0000","last_change":"2024-09-19T08:09:11.246436+0000","last_active":"2024-09-19T08:10:14.784785+0000","last_peered":"2024-09-19T08:10:14.784785+0000","last_clean":"2024-09-19T08:10:14.784785+0000","last_became_active":"2024-09-19T08:09:11.245674+0000","last_became_peered":"2024-09-19T08:09:11.245674+0000","last_unstale":"2024-09-19T08:10:14.784785+0000","last_undegraded":"2024-09-19T08:10:14.784785+0000","last_fullsized":"2024-09-19T08:10:14.784785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:46.716474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786539+0000","last_change":"2024-09-19T08:09:11.243334+0000","last_active":"2024-09-19T08:10:14.786539+0000","last_peered":"2024-09-19T08:10:14.786539+0000","last_clean":"2024-09-19T08:10:14.786539+0000","last_became_active":"2024-09-19T08:09:11.243024+0000","last_became_peered":"2024-09-19T08:09:11.243024+0000","last_unstale":"2024-09-19T08:10:14.786539+0000","last_undegraded":"2024-09-19T08:10:14.786539+0000","last_fullsized":"2024-09-19T08:10:14.786539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.060068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786483+0000","last_change":"2024-09-19T08:09:11.254655+0000","last_active":"2024-09-19T08:10:14.786483+0000","last_peered":"2024-09-19T08:10:14.786483+0000","last_clean":"2024-09-19T08:10:14.786483+0000","last_became_active":"2024-09-19T08:09:11.254292+0000","last_became_peered":"2024-09-19T08:09:11.254292+0000","last_unstale":"2024-09-19T08:10:14.786483+0000","last_undegraded":"2024-09-19T08:10:14.786483+0000","last_fullsized":"2024-09-19T08:10:14.786483+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:01.977743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.785712+0000","last_change":"2024-09-19T08:09:11.257029+0000","last_active":"2024-09-19T08:10:14.785712+0000","last_peered":"2024-09-19T08:10:14.785712+0000","last_clean":"2024-09-19T08:10:14.785712+0000","last_became_active":"2024-09-19T08:09:11.256669+0000","last_became_peered":"2024-09-19T08:09:11.256669+0000","last_unstale":"2024-09-19T08:10:14.785712+0000","last_undegraded":"2024-09-19T08:10:14.785712+0000","last_fullsized":"2024-09-19T08:10:14.785712+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:32.831036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787404+0000","last_change":"2024-09-19T08:09:11.240341+0000","last_active":"2024-09-19T08:10:14.787404+0000","last_peered":"2024-09-19T08:10:14.787404+0000","last_clean":"2024-09-19T08:10:14.787404+0000","last_became_active":"2024-09-19T08:09:11.239996+0000","last_became_peered":"2024-09-19T08:09:11.239996+0000","last_unstale":"2024-09-19T08:10:14.787404+0000","last_undegraded":"2024-09-19T08:10:14.787404+0000","last_fullsized":"2024-09-19T08:10:14.787404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:20.331791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784344+0000","last_change":"2024-09-19T08:09:11.248089+0000","last_active":"2024-09-19T08:10:14.784344+0000","last_peered":"2024-09-19T08:10:14.784344+0000","last_clean":"2024-09-19T08:10:14.784344+0000","last_became_active":"2024-09-19T08:09:11.247802+0000","last_became_peered":"2024-09-19T08:09:11.247802+0000","last_unstale":"2024-09-19T08:10:14.784344+0000","last_undegraded":"2024-09-19T08:10:14.784344+0000","last_fullsized":"2024-09-19T08:10:14.784344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.249119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786463+0000","last_change":"2024-09-19T08:09:11.246853+0000","last_active":"2024-09-19T08:10:14.786463+0000","last_peered":"2024-09-19T08:10:14.786463+0000","last_clean":"2024-09-19T08:10:14.786463+0000","last_became_active":"2024-09-19T08:09:11.246523+0000","last_became_peered":"2024-09-19T08:09:11.246523+0000","last_unstale":"2024-09-19T08:10:14.786463+0000","last_undegraded":"2024-09-19T08:10:14.786463+0000","last_fullsized":"2024-09-19T08:10:14.786463+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:54.879087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.824520+0000","last_change":"2024-09-19T08:09:11.232588+0000","last_active":"2024-09-19T08:10:14.824520+0000","last_peered":"2024-09-19T08:10:14.824520+0000","last_clean":"2024-09-19T08:10:14.824520+0000","last_became_active":"2024-09-19T08:09:11.232251+0000","last_became_peered":"2024-09-19T08:09:11.232251+0000","last_unstale":"2024-09-19T08:10:14.824520+0000","last_undegraded":"2024-09-19T08:10:14.824520+0000","last_fullsized":"2024-09-19T08:10:14.824520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:57.622086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.782467+0000","last_change":"2024-09-19T08:09:11.248854+0000","last_active":"2024-09-19T08:10:14.782467+0000","last_peered":"2024-09-19T08:10:14.782467+0000","last_clean":"2024-09-19T08:10:14.782467+0000","last_became_active":"2024-09-19T08:09:11.248524+0000","last_became_peered":"2024-09-19T08:09:11.248524+0000","last_unstale":"2024-09-19T08:10:14.782467+0000","last_undegraded":"2024-09-19T08:10:14.782467+0000","last_fullsized":"2024-09-19T08:10:14.782467+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:57.978974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786848+0000","last_change":"2024-09-19T08:10:14.786848+0000","last_active":"2024-09-19T08:10:14.786848+0000","last_peered":"2024-09-19T08:10:14.786848+0000","last_clean":"2024-09-19T08:10:14.786848+0000","last_became_active":"2024-09-19T08:10:14.786460+0000","last_became_peered":"2024-09-19T08:10:14.786460+0000","last_unstale":"2024-09-19T08:10:14.786848+0000","last_undegraded":"2024-09-19T08:10:14.786848+0000","last_fullsized":"2024-09-19T08:10:14.786848+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:59.430185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786917+0000","last_change":"2024-09-19T08:09:11.247604+0000","last_active":"2024-09-19T08:10:14.786917+0000","last_peered":"2024-09-19T08:10:14.786917+0000","last_clean":"2024-09-19T08:10:14.786917+0000","last_became_active":"2024-09-19T08:09:11.247264+0000","last_became_peered":"2024-09-19T08:09:11.247264+0000","last_unstale":"2024-09-19T08:10:14.786917+0000","last_undegraded":"2024-09-19T08:10:14.786917+0000","last_fullsized":"2024-09-19T08:10:14.786917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:15.315022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.785754+0000","last_change":"2024-09-19T08:09:11.253948+0000","last_active":"2024-09-19T08:10:14.785754+0000","last_peered":"2024-09-19T08:10:14.785754+0000","last_clean":"2024-09-19T08:10:14.785754+0000","last_became_active":"2024-09-19T08:09:11.253402+0000","last_became_peered":"2024-09-19T08:09:11.253402+0000","last_unstale":"2024-09-19T08:10:14.785754+0000","last_undegraded":"2024-09-19T08:10:14.785754+0000","last_fullsized":"2024-09-19T08:10:14.785754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:04.884541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783801+0000","last_change":"2024-09-19T08:09:11.241770+0000","last_active":"2024-09-19T08:10:14.783801+0000","last_peered":"2024-09-19T08:10:14.783801+0000","last_clean":"2024-09-19T08:10:14.783801+0000","last_became_active":"2024-09-19T08:09:11.241356+0000","last_became_peered":"2024-09-19T08:09:11.241356+0000","last_unstale":"2024-09-19T08:10:14.783801+0000","last_undegraded":"2024-09-19T08:10:14.783801+0000","last_fullsized":"2024-09-19T08:10:14.783801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:02.722445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786455+0000","last_change":"2024-09-19T08:09:11.242874+0000","last_active":"2024-09-19T08:10:14.786455+0000","last_peered":"2024-09-19T08:10:14.786455+0000","last_clean":"2024-09-19T08:10:14.786455+0000","last_became_active":"2024-09-19T08:09:11.242383+0000","last_became_peered":"2024-09-19T08:09:11.242383+0000","last_unstale":"2024-09-19T08:10:14.786455+0000","last_undegraded":"2024-09-19T08:10:14.786455+0000","last_fullsized":"2024-09-19T08:10:14.786455+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:51.900211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786416+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:10:14.786416+0000","last_peered":"2024-09-19T08:10:14.786416+0000","last_clean":"2024-09-19T08:10:14.786416+0000","last_became_active":"2024-09-19T08:09:11.250797+0000","last_became_peered":"2024-09-19T08:09:11.250797+0000","last_unstale":"2024-09-19T08:10:14.786416+0000","last_undegraded":"2024-09-19T08:10:14.786416+0000","last_fullsized":"2024-09-19T08:10:14.786416+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:46.183857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.781929+0000","last_change":"2024-09-19T08:09:11.250884+0000","last_active":"2024-09-19T08:10:14.781929+0000","last_peered":"2024-09-19T08:10:14.781929+0000","last_clean":"2024-09-19T08:10:14.781929+0000","last_became_active":"2024-09-19T08:09:11.250543+0000","last_became_peered":"2024-09-19T08:09:11.250543+0000","last_unstale":"2024-09-19T08:10:14.781929+0000","last_undegraded":"2024-09-19T08:10:14.781929+0000","last_fullsized":"2024-09-19T08:10:14.781929+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.259466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784758+0000","last_change":"2024-09-19T08:09:11.246705+0000","last_active":"2024-09-19T08:10:14.784758+0000","last_peered":"2024-09-19T08:10:14.784758+0000","last_clean":"2024-09-19T08:10:14.784758+0000","last_became_active":"2024-09-19T08:09:11.246117+0000","last_became_peered":"2024-09-19T08:09:11.246117+0000","last_unstale":"2024-09-19T08:10:14.784758+0000","last_undegraded":"2024-09-19T08:10:14.784758+0000","last_fullsized":"2024-09-19T08:10:14.784758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:07.421222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.781085+0000","last_change":"2024-09-19T08:09:11.242181+0000","last_active":"2024-09-19T08:10:14.781085+0000","last_peered":"2024-09-19T08:10:14.781085+0000","last_clean":"2024-09-19T08:10:14.781085+0000","last_became_active":"2024-09-19T08:09:11.241882+0000","last_became_peered":"2024-09-19T08:09:11.241882+0000","last_unstale":"2024-09-19T08:10:14.781085+0000","last_undegraded":"2024-09-19T08:10:14.781085+0000","last_fullsized":"2024-09-19T08:10:14.781085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:35.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.782190+0000","last_change":"2024-09-19T08:09:11.246038+0000","last_active":"2024-09-19T08:10:14.782190+0000","last_peered":"2024-09-19T08:10:14.782190+0000","last_clean":"2024-09-19T08:10:14.782190+0000","last_became_active":"2024-09-19T08:09:11.245554+0000","last_became_peered":"2024-09-19T08:09:11.245554+0000","last_unstale":"2024-09-19T08:10:14.782190+0000","last_undegraded":"2024-09-19T08:10:14.782190+0000","last_fullsized":"2024-09-19T08:10:14.782190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:14.512425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784039+0000","last_change":"2024-09-19T08:09:11.249246+0000","last_active":"2024-09-19T08:10:14.784039+0000","last_peered":"2024-09-19T08:10:14.784039+0000","last_clean":"2024-09-19T08:10:14.784039+0000","last_became_active":"2024-09-19T08:09:11.248896+0000","last_became_peered":"2024-09-19T08:09:11.248896+0000","last_unstale":"2024-09-19T08:10:14.784039+0000","last_undegraded":"2024-09-19T08:10:14.784039+0000","last_fullsized":"2024-09-19T08:10:14.784039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:40.406924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783875+0000","last_change":"2024-09-19T08:09:11.245421+0000","last_active":"2024-09-19T08:10:14.783875+0000","last_peered":"2024-09-19T08:10:14.783875+0000","last_clean":"2024-09-19T08:10:14.783875+0000","last_became_active":"2024-09-19T08:09:11.245071+0000","last_became_peered":"2024-09-19T08:09:11.245071+0000","last_unstale":"2024-09-19T08:10:14.783875+0000","last_undegraded":"2024-09-19T08:10:14.783875+0000","last_fullsized":"2024-09-19T08:10:14.783875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:58.594399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.782100+0000","last_change":"2024-09-19T08:09:11.246097+0000","last_active":"2024-09-19T08:10:14.782100+0000","last_peered":"2024-09-19T08:10:14.782100+0000","last_clean":"2024-09-19T08:10:14.782100+0000","last_became_active":"2024-09-19T08:09:11.245741+0000","last_became_peered":"2024-09-19T08:09:11.245741+0000","last_unstale":"2024-09-19T08:10:14.782100+0000","last_undegraded":"2024-09-19T08:10:14.782100+0000","last_fullsized":"2024-09-19T08:10:14.782100+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:05.731148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.824569+0000","last_change":"2024-09-19T08:09:11.251485+0000","last_active":"2024-09-19T08:10:14.824569+0000","last_peered":"2024-09-19T08:10:14.824569+0000","last_clean":"2024-09-19T08:10:14.824569+0000","last_became_active":"2024-09-19T08:09:11.251151+0000","last_became_peered":"2024-09-19T08:09:11.251151+0000","last_unstale":"2024-09-19T08:10:14.824569+0000","last_undegraded":"2024-09-19T08:10:14.824569+0000","last_fullsized":"2024-09-19T08:10:14.824569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:47.231056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783832+0000","last_change":"2024-09-19T08:09:11.234490+0000","last_active":"2024-09-19T08:10:14.783832+0000","last_peered":"2024-09-19T08:10:14.783832+0000","last_clean":"2024-09-19T08:10:14.783832+0000","last_became_active":"2024-09-19T08:09:11.234163+0000","last_became_peered":"2024-09-19T08:09:11.234163+0000","last_unstale":"2024-09-19T08:10:14.783832+0000","last_undegraded":"2024-09-19T08:10:14.783832+0000","last_fullsized":"2024-09-19T08:10:14.783832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.610165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.825080+0000","last_change":"2024-09-19T08:09:11.247189+0000","last_active":"2024-09-19T08:10:14.825080+0000","last_peered":"2024-09-19T08:10:14.825080+0000","last_clean":"2024-09-19T08:10:14.825080+0000","last_became_active":"2024-09-19T08:09:11.246844+0000","last_became_peered":"2024-09-19T08:09:11.246844+0000","last_unstale":"2024-09-19T08:10:14.825080+0000","last_undegraded":"2024-09-19T08:10:14.825080+0000","last_fullsized":"2024-09-19T08:10:14.825080+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:50.764694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783070+0000","last_change":"2024-09-19T08:09:11.251655+0000","last_active":"2024-09-19T08:10:14.783070+0000","last_peered":"2024-09-19T08:10:14.783070+0000","last_clean":"2024-09-19T08:10:14.783070+0000","last_became_active":"2024-09-19T08:09:11.250930+0000","last_became_peered":"2024-09-19T08:09:11.250930+0000","last_unstale":"2024-09-19T08:10:14.783070+0000","last_undegraded":"2024-09-19T08:10:14.783070+0000","last_fullsized":"2024-09-19T08:10:14.783070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:17.658277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784437+0000","last_change":"2024-09-19T08:09:11.248095+0000","last_active":"2024-09-19T08:10:14.784437+0000","last_peered":"2024-09-19T08:10:14.784437+0000","last_clean":"2024-09-19T08:10:14.784437+0000","last_became_active":"2024-09-19T08:09:11.247719+0000","last_became_peered":"2024-09-19T08:09:11.247719+0000","last_unstale":"2024-09-19T08:10:14.784437+0000","last_undegraded":"2024-09-19T08:10:14.784437+0000","last_fullsized":"2024-09-19T08:10:14.784437+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:26.701140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783926+0000","last_change":"2024-09-19T08:09:11.243232+0000","last_active":"2024-09-19T08:10:14.783926+0000","last_peered":"2024-09-19T08:10:14.783926+0000","last_clean":"2024-09-19T08:10:14.783926+0000","last_became_active":"2024-09-19T08:09:11.242927+0000","last_became_peered":"2024-09-19T08:09:11.242927+0000","last_unstale":"2024-09-19T08:10:14.783926+0000","last_undegraded":"2024-09-19T08:10:14.783926+0000","last_fullsized":"2024-09-19T08:10:14.783926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:19.877520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786663+0000","last_change":"2024-09-19T08:09:11.249588+0000","last_active":"2024-09-19T08:10:14.786663+0000","last_peered":"2024-09-19T08:10:14.786663+0000","last_clean":"2024-09-19T08:10:14.786663+0000","last_became_active":"2024-09-19T08:09:11.249266+0000","last_became_peered":"2024-09-19T08:09:11.249266+0000","last_unstale":"2024-09-19T08:10:14.786663+0000","last_undegraded":"2024-09-19T08:10:14.786663+0000","last_fullsized":"2024-09-19T08:10:14.786663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:43.332454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.781836+0000","last_change":"2024-09-19T08:09:11.245866+0000","last_active":"2024-09-19T08:10:14.781836+0000","last_peered":"2024-09-19T08:10:14.781836+0000","last_clean":"2024-09-19T08:10:14.781836+0000","last_became_active":"2024-09-19T08:09:11.245505+0000","last_became_peered":"2024-09-19T08:09:11.245505+0000","last_unstale":"2024-09-19T08:10:14.781836+0000","last_undegraded":"2024-09-19T08:10:14.781836+0000","last_fullsized":"2024-09-19T08:10:14.781836+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:38.203790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.781915+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:10:14.781915+0000","last_peered":"2024-09-19T08:10:14.781915+0000","last_clean":"2024-09-19T08:10:14.781915+0000","last_became_active":"2024-09-19T08:09:11.250745+0000","last_became_peered":"2024-09-19T08:09:11.250745+0000","last_unstale":"2024-09-19T08:10:14.781915+0000","last_undegraded":"2024-09-19T08:10:14.781915+0000","last_fullsized":"2024-09-19T08:10:14.781915+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:16.851230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784356+0000","last_change":"2024-09-19T08:09:11.255211+0000","last_active":"2024-09-19T08:10:14.784356+0000","last_peered":"2024-09-19T08:10:14.784356+0000","last_clean":"2024-09-19T08:10:14.784356+0000","last_became_active":"2024-09-19T08:09:11.254853+0000","last_became_peered":"2024-09-19T08:09:11.254853+0000","last_unstale":"2024-09-19T08:10:14.784356+0000","last_undegraded":"2024-09-19T08:10:14.784356+0000","last_fullsized":"2024-09-19T08:10:14.784356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.497502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.788405+0000","last_change":"2024-09-19T08:09:11.247201+0000","last_active":"2024-09-19T08:10:14.788405+0000","last_peered":"2024-09-19T08:10:14.788405+0000","last_clean":"2024-09-19T08:10:14.788405+0000","last_became_active":"2024-09-19T08:09:11.246854+0000","last_became_peered":"2024-09-19T08:09:11.246854+0000","last_unstale":"2024-09-19T08:10:14.788405+0000","last_undegraded":"2024-09-19T08:10:14.788405+0000","last_fullsized":"2024-09-19T08:10:14.788405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:19.262849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.785583+0000","last_change":"2024-09-19T08:09:09.113754+0000","last_active":"2024-09-19T08:10:14.785583+0000","last_peered":"2024-09-19T08:10:14.785583+0000","last_clean":"2024-09-19T08:10:14.785583+0000","last_became_active":"2024-09-19T08:09:09.113389+0000","last_became_peered":"2024-09-19T08:09:09.113389+0000","last_unstale":"2024-09-19T08:10:14.785583+0000","last_undegraded":"2024-09-19T08:10:14.785583+0000","last_fullsized":"2024-09-19T08:10:14.785583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:45.325895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.785472+0000","last_change":"2024-09-19T08:09:11.244625+0000","last_active":"2024-09-19T08:10:14.785472+0000","last_peered":"2024-09-19T08:10:14.785472+0000","last_clean":"2024-09-19T08:10:14.785472+0000","last_became_active":"2024-09-19T08:09:11.244277+0000","last_became_peered":"2024-09-19T08:09:11.244277+0000","last_unstale":"2024-09-19T08:10:14.785472+0000","last_undegraded":"2024-09-19T08:10:14.785472+0000","last_fullsized":"2024-09-19T08:10:14.785472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:33:34.050343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784461+0000","last_change":"2024-09-19T08:09:09.116735+0000","last_active":"2024-09-19T08:10:14.784461+0000","last_peered":"2024-09-19T08:10:14.784461+0000","last_clean":"2024-09-19T08:10:14.784461+0000","last_became_active":"2024-09-19T08:09:09.116356+0000","last_became_peered":"2024-09-19T08:09:09.116356+0000","last_unstale":"2024-09-19T08:10:14.784461+0000","last_undegraded":"2024-09-19T08:10:14.784461+0000","last_fullsized":"2024-09-19T08:10:14.784461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:50.952567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783987+0000","last_change":"2024-09-19T08:09:09.113182+0000","last_active":"2024-09-19T08:10:14.783987+0000","last_peered":"2024-09-19T08:10:14.783987+0000","last_clean":"2024-09-19T08:10:14.783987+0000","last_became_active":"2024-09-19T08:09:09.112528+0000","last_became_peered":"2024-09-19T08:09:09.112528+0000","last_unstale":"2024-09-19T08:10:14.783987+0000","last_undegraded":"2024-09-19T08:10:14.783987+0000","last_fullsized":"2024-09-19T08:10:14.783987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:07.647351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.824569+0000","last_change":"2024-09-19T08:09:11.241639+0000","last_active":"2024-09-19T08:10:14.824569+0000","last_peered":"2024-09-19T08:10:14.824569+0000","last_clean":"2024-09-19T08:10:14.824569+0000","last_became_active":"2024-09-19T08:09:11.241308+0000","last_became_peered":"2024-09-19T08:09:11.241308+0000","last_unstale":"2024-09-19T08:10:14.824569+0000","last_undegraded":"2024-09-19T08:10:14.824569+0000","last_fullsized":"2024-09-19T08:10:14.824569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:57.826870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784167+0000","last_change":"2024-09-19T08:09:09.118334+0000","last_active":"2024-09-19T08:10:14.784167+0000","last_peered":"2024-09-19T08:10:14.784167+0000","last_clean":"2024-09-19T08:10:14.784167+0000","last_became_active":"2024-09-19T08:09:09.118010+0000","last_became_peered":"2024-09-19T08:09:09.118010+0000","last_unstale":"2024-09-19T08:10:14.784167+0000","last_undegraded":"2024-09-19T08:10:14.784167+0000","last_fullsized":"2024-09-19T08:10:14.784167+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:51.046598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.780899+0000","last_change":"2024-09-19T08:09:11.239990+0000","last_active":"2024-09-19T08:10:14.780899+0000","last_peered":"2024-09-19T08:10:14.780899+0000","last_clean":"2024-09-19T08:10:14.780899+0000","last_became_active":"2024-09-19T08:09:11.239643+0000","last_became_peered":"2024-09-19T08:09:11.239643+0000","last_unstale":"2024-09-19T08:10:14.780899+0000","last_undegraded":"2024-09-19T08:10:14.780899+0000","last_fullsized":"2024-09-19T08:10:14.780899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:07.078244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784982+0000","last_change":"2024-09-19T08:09:09.114397+0000","last_active":"2024-09-19T08:10:14.784982+0000","last_peered":"2024-09-19T08:10:14.784982+0000","last_clean":"2024-09-19T08:10:14.784982+0000","last_became_active":"2024-09-19T08:09:09.114051+0000","last_became_peered":"2024-09-19T08:09:09.114051+0000","last_unstale":"2024-09-19T08:10:14.784982+0000","last_undegraded":"2024-09-19T08:10:14.784982+0000","last_fullsized":"2024-09-19T08:10:14.784982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:41.799442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.782471+0000","last_change":"2024-09-19T08:09:11.254802+0000","last_active":"2024-09-19T08:10:14.782471+0000","last_peered":"2024-09-19T08:10:14.782471+0000","last_clean":"2024-09-19T08:10:14.782471+0000","last_became_active":"2024-09-19T08:09:11.253869+0000","last_became_peered":"2024-09-19T08:09:11.253869+0000","last_unstale":"2024-09-19T08:10:14.782471+0000","last_undegraded":"2024-09-19T08:10:14.782471+0000","last_fullsized":"2024-09-19T08:10:14.782471+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:00.164834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786687+0000","last_change":"2024-09-19T08:09:09.118585+0000","last_active":"2024-09-19T08:10:14.786687+0000","last_peered":"2024-09-19T08:10:14.786687+0000","last_clean":"2024-09-19T08:10:14.786687+0000","last_became_active":"2024-09-19T08:09:09.118216+0000","last_became_peered":"2024-09-19T08:09:09.118216+0000","last_unstale":"2024-09-19T08:10:14.786687+0000","last_undegraded":"2024-09-19T08:10:14.786687+0000","last_fullsized":"2024-09-19T08:10:14.786687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:41.905746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786880+0000","last_change":"2024-09-19T08:09:11.249835+0000","last_active":"2024-09-19T08:10:14.786880+0000","last_peered":"2024-09-19T08:10:14.786880+0000","last_clean":"2024-09-19T08:10:14.786880+0000","last_became_active":"2024-09-19T08:09:11.249443+0000","last_became_peered":"2024-09-19T08:09:11.249443+0000","last_unstale":"2024-09-19T08:10:14.786880+0000","last_undegraded":"2024-09-19T08:10:14.786880+0000","last_fullsized":"2024-09-19T08:10:14.786880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:06.373126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.785252+0000","last_change":"2024-09-19T08:09:09.242565+0000","last_active":"2024-09-19T08:10:14.785252+0000","last_peered":"2024-09-19T08:10:14.785252+0000","last_clean":"2024-09-19T08:10:14.785252+0000","last_became_active":"2024-09-19T08:09:09.242199+0000","last_became_peered":"2024-09-19T08:09:09.242199+0000","last_unstale":"2024-09-19T08:10:14.785252+0000","last_undegraded":"2024-09-19T08:10:14.785252+0000","last_fullsized":"2024-09-19T08:10:14.785252+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:33.195385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.782108+0000","last_change":"2024-09-19T08:09:11.251682+0000","last_active":"2024-09-19T08:10:14.782108+0000","last_peered":"2024-09-19T08:10:14.782108+0000","last_clean":"2024-09-19T08:10:14.782108+0000","last_became_active":"2024-09-19T08:09:11.251037+0000","last_became_peered":"2024-09-19T08:09:11.251037+0000","last_unstale":"2024-09-19T08:10:14.782108+0000","last_undegraded":"2024-09-19T08:10:14.782108+0000","last_fullsized":"2024-09-19T08:10:14.782108+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:29.518828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":183,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:21.410908+0000","last_change":"2024-09-19T08:09:09.119090+0000","last_active":"2024-09-19T08:10:21.410908+0000","last_peered":"2024-09-19T08:10:21.410908+0000","last_clean":"2024-09-19T08:10:21.410908+0000","last_became_active":"2024-09-19T08:09:09.118685+0000","last_became_peered":"2024-09-19T08:09:09.118685+0000","last_unstale":"2024-09-19T08:10:21.410908+0000","last_undegraded":"2024-09-19T08:10:21.410908+0000","last_fullsized":"2024-09-19T08:10:21.410908+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:21.540404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62819,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":128,"num_write":27,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.788088+0000","last_change":"2024-09-19T08:09:11.243200+0000","last_active":"2024-09-19T08:10:14.788088+0000","last_peered":"2024-09-19T08:10:14.788088+0000","last_clean":"2024-09-19T08:10:14.788088+0000","last_became_active":"2024-09-19T08:09:11.242873+0000","last_became_peered":"2024-09-19T08:09:11.242873+0000","last_unstale":"2024-09-19T08:10:14.788088+0000","last_undegraded":"2024-09-19T08:10:14.788088+0000","last_fullsized":"2024-09-19T08:10:14.788088+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:35.817609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.781892+0000","last_change":"2024-09-19T08:09:09.117117+0000","last_active":"2024-09-19T08:10:14.781892+0000","last_peered":"2024-09-19T08:10:14.781892+0000","last_clean":"2024-09-19T08:10:14.781892+0000","last_became_active":"2024-09-19T08:09:09.116512+0000","last_became_peered":"2024-09-19T08:09:09.116512+0000","last_unstale":"2024-09-19T08:10:14.781892+0000","last_undegraded":"2024-09-19T08:10:14.781892+0000","last_fullsized":"2024-09-19T08:10:14.781892+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:15.010570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783609+0000","last_change":"2024-09-19T08:09:11.246648+0000","last_active":"2024-09-19T08:10:14.783609+0000","last_peered":"2024-09-19T08:10:14.783609+0000","last_clean":"2024-09-19T08:10:14.783609+0000","last_became_active":"2024-09-19T08:09:11.246317+0000","last_became_peered":"2024-09-19T08:09:11.246317+0000","last_unstale":"2024-09-19T08:10:14.783609+0000","last_undegraded":"2024-09-19T08:10:14.783609+0000","last_fullsized":"2024-09-19T08:10:14.783609+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:43.285257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.785704+0000","last_change":"2024-09-19T08:09:09.112599+0000","last_active":"2024-09-19T08:10:14.785704+0000","last_peered":"2024-09-19T08:10:14.785704+0000","last_clean":"2024-09-19T08:10:14.785704+0000","last_became_active":"2024-09-19T08:09:09.112281+0000","last_became_peered":"2024-09-19T08:09:09.112281+0000","last_unstale":"2024-09-19T08:10:14.785704+0000","last_undegraded":"2024-09-19T08:10:14.785704+0000","last_fullsized":"2024-09-19T08:10:14.785704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:47.710235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787152+0000","last_change":"2024-09-19T08:09:11.253814+0000","last_active":"2024-09-19T08:10:14.787152+0000","last_peered":"2024-09-19T08:10:14.787152+0000","last_clean":"2024-09-19T08:10:14.787152+0000","last_became_active":"2024-09-19T08:09:11.253490+0000","last_became_peered":"2024-09-19T08:09:11.253490+0000","last_unstale":"2024-09-19T08:10:14.787152+0000","last_undegraded":"2024-09-19T08:10:14.787152+0000","last_fullsized":"2024-09-19T08:10:14.787152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:09.287110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.785412+0000","last_change":"2024-09-19T08:09:09.114820+0000","last_active":"2024-09-19T08:10:14.785412+0000","last_peered":"2024-09-19T08:10:14.785412+0000","last_clean":"2024-09-19T08:10:14.785412+0000","last_became_active":"2024-09-19T08:09:09.114478+0000","last_became_peered":"2024-09-19T08:09:09.114478+0000","last_unstale":"2024-09-19T08:10:14.785412+0000","last_undegraded":"2024-09-19T08:10:14.785412+0000","last_fullsized":"2024-09-19T08:10:14.785412+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:24.243629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.789301+0000","last_change":"2024-09-19T08:10:14.789301+0000","last_active":"2024-09-19T08:10:14.789301+0000","last_peered":"2024-09-19T08:10:14.789301+0000","last_clean":"2024-09-19T08:10:14.789301+0000","last_became_active":"2024-09-19T08:10:14.788891+0000","last_became_peered":"2024-09-19T08:10:14.788891+0000","last_unstale":"2024-09-19T08:10:14.789301+0000","last_undegraded":"2024-09-19T08:10:14.789301+0000","last_fullsized":"2024-09-19T08:10:14.789301+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:03.142177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.799601+0000","last_change":"2024-09-19T08:10:14.799207+0000","last_active":"2024-09-19T08:10:14.799601+0000","last_peered":"2024-09-19T08:10:14.799601+0000","last_clean":"2024-09-19T08:10:14.799601+0000","last_became_active":"2024-09-19T08:10:14.787612+0000","last_became_peered":"2024-09-19T08:10:14.787612+0000","last_unstale":"2024-09-19T08:10:14.799601+0000","last_undegraded":"2024-09-19T08:10:14.799601+0000","last_fullsized":"2024-09-19T08:10:14.799601+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:45.997778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784778+0000","last_change":"2024-09-19T08:09:11.245399+0000","last_active":"2024-09-19T08:10:14.784778+0000","last_peered":"2024-09-19T08:10:14.784778+0000","last_clean":"2024-09-19T08:10:14.784778+0000","last_became_active":"2024-09-19T08:09:11.245055+0000","last_became_peered":"2024-09-19T08:09:11.245055+0000","last_unstale":"2024-09-19T08:10:14.784778+0000","last_undegraded":"2024-09-19T08:10:14.784778+0000","last_fullsized":"2024-09-19T08:10:14.784778+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:57.639205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.788242+0000","last_change":"2024-09-19T08:09:09.115252+0000","last_active":"2024-09-19T08:10:14.788242+0000","last_peered":"2024-09-19T08:10:14.788242+0000","last_clean":"2024-09-19T08:10:14.788242+0000","last_became_active":"2024-09-19T08:09:09.114908+0000","last_became_peered":"2024-09-19T08:09:09.114908+0000","last_unstale":"2024-09-19T08:10:14.788242+0000","last_undegraded":"2024-09-19T08:10:14.788242+0000","last_fullsized":"2024-09-19T08:10:14.788242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:48.326221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784415+0000","last_change":"2024-09-19T08:09:11.249189+0000","last_active":"2024-09-19T08:10:14.784415+0000","last_peered":"2024-09-19T08:10:14.784415+0000","last_clean":"2024-09-19T08:10:14.784415+0000","last_became_active":"2024-09-19T08:09:11.248797+0000","last_became_peered":"2024-09-19T08:09:11.248797+0000","last_unstale":"2024-09-19T08:10:14.784415+0000","last_undegraded":"2024-09-19T08:10:14.784415+0000","last_fullsized":"2024-09-19T08:10:14.784415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:20.915638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783784+0000","last_change":"2024-09-19T08:09:09.112973+0000","last_active":"2024-09-19T08:10:14.783784+0000","last_peered":"2024-09-19T08:10:14.783784+0000","last_clean":"2024-09-19T08:10:14.783784+0000","last_became_active":"2024-09-19T08:09:09.112616+0000","last_became_peered":"2024-09-19T08:09:09.112616+0000","last_unstale":"2024-09-19T08:10:14.783784+0000","last_undegraded":"2024-09-19T08:10:14.783784+0000","last_fullsized":"2024-09-19T08:10:14.783784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:13.791926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787430+0000","last_change":"2024-09-19T08:09:11.240739+0000","last_active":"2024-09-19T08:10:14.787430+0000","last_peered":"2024-09-19T08:10:14.787430+0000","last_clean":"2024-09-19T08:10:14.787430+0000","last_became_active":"2024-09-19T08:09:11.240340+0000","last_became_peered":"2024-09-19T08:09:11.240340+0000","last_unstale":"2024-09-19T08:10:14.787430+0000","last_undegraded":"2024-09-19T08:10:14.787430+0000","last_fullsized":"2024-09-19T08:10:14.787430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:35.450279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.785352+0000","last_change":"2024-09-19T08:09:09.112516+0000","last_active":"2024-09-19T08:10:14.785352+0000","last_peered":"2024-09-19T08:10:14.785352+0000","last_clean":"2024-09-19T08:10:14.785352+0000","last_became_active":"2024-09-19T08:09:09.112140+0000","last_became_peered":"2024-09-19T08:09:09.112140+0000","last_unstale":"2024-09-19T08:10:14.785352+0000","last_undegraded":"2024-09-19T08:10:14.785352+0000","last_fullsized":"2024-09-19T08:10:14.785352+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:05.434331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786545+0000","last_change":"2024-09-19T08:09:11.252163+0000","last_active":"2024-09-19T08:10:14.786545+0000","last_peered":"2024-09-19T08:10:14.786545+0000","last_clean":"2024-09-19T08:10:14.786545+0000","last_became_active":"2024-09-19T08:09:11.251762+0000","last_became_peered":"2024-09-19T08:09:11.251762+0000","last_unstale":"2024-09-19T08:10:14.786545+0000","last_undegraded":"2024-09-19T08:10:14.786545+0000","last_fullsized":"2024-09-19T08:10:14.786545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:33.941910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.789183+0000","last_change":"2024-09-19T08:10:14.788460+0000","last_active":"2024-09-19T08:10:14.789183+0000","last_peered":"2024-09-19T08:10:14.789183+0000","last_clean":"2024-09-19T08:10:14.789183+0000","last_became_active":"2024-09-19T08:10:14.787990+0000","last_became_peered":"2024-09-19T08:10:14.787990+0000","last_unstale":"2024-09-19T08:10:14.789183+0000","last_undegraded":"2024-09-19T08:10:14.789183+0000","last_fullsized":"2024-09-19T08:10:14.789183+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:24.549994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787042+0000","last_change":"2024-09-19T08:09:11.242438+0000","last_active":"2024-09-19T08:10:14.787042+0000","last_peered":"2024-09-19T08:10:14.787042+0000","last_clean":"2024-09-19T08:10:14.787042+0000","last_became_active":"2024-09-19T08:09:11.242114+0000","last_became_peered":"2024-09-19T08:09:11.242114+0000","last_unstale":"2024-09-19T08:10:14.787042+0000","last_undegraded":"2024-09-19T08:10:14.787042+0000","last_fullsized":"2024-09-19T08:10:14.787042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:54.183012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":345,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787300+0000","last_change":"2024-09-19T08:07:55.287566+0000","last_active":"2024-09-19T08:10:14.787300+0000","last_peered":"2024-09-19T08:10:14.787300+0000","last_clean":"2024-09-19T08:10:14.787300+0000","last_became_active":"2024-09-19T08:07:55.287037+0000","last_became_peered":"2024-09-19T08:07:55.287037+0000","last_unstale":"2024-09-19T08:10:14.787300+0000","last_undegraded":"2024-09-19T08:10:14.787300+0000","last_fullsized":"2024-09-19T08:10:14.787300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_clean_scrub_stamp":"2024-09-19T08:04:29.468857+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:49.553882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784592+0000","last_change":"2024-09-19T08:09:09.113497+0000","last_active":"2024-09-19T08:10:14.784592+0000","last_peered":"2024-09-19T08:10:14.784592+0000","last_clean":"2024-09-19T08:10:14.784592+0000","last_became_active":"2024-09-19T08:09:09.112546+0000","last_became_peered":"2024-09-19T08:09:09.112546+0000","last_unstale":"2024-09-19T08:10:14.784592+0000","last_undegraded":"2024-09-19T08:10:14.784592+0000","last_fullsized":"2024-09-19T08:10:14.784592+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:09.906476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.824920+0000","last_change":"2024-09-19T08:09:11.241478+0000","last_active":"2024-09-19T08:10:14.824920+0000","last_peered":"2024-09-19T08:10:14.824920+0000","last_clean":"2024-09-19T08:10:14.824920+0000","last_became_active":"2024-09-19T08:09:11.241138+0000","last_became_peered":"2024-09-19T08:09:11.241138+0000","last_unstale":"2024-09-19T08:10:14.824920+0000","last_undegraded":"2024-09-19T08:10:14.824920+0000","last_fullsized":"2024-09-19T08:10:14.824920+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:32.884491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787410+0000","last_change":"2024-09-19T08:09:09.116571+0000","last_active":"2024-09-19T08:10:14.787410+0000","last_peered":"2024-09-19T08:10:14.787410+0000","last_clean":"2024-09-19T08:10:14.787410+0000","last_became_active":"2024-09-19T08:09:09.116180+0000","last_became_peered":"2024-09-19T08:09:09.116180+0000","last_unstale":"2024-09-19T08:10:14.787410+0000","last_undegraded":"2024-09-19T08:10:14.787410+0000","last_fullsized":"2024-09-19T08:10:14.787410+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:58.577320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.791196+0000","last_change":"2024-09-19T08:10:14.791196+0000","last_active":"2024-09-19T08:10:14.791196+0000","last_peered":"2024-09-19T08:10:14.791196+0000","last_clean":"2024-09-19T08:10:14.791196+0000","last_became_active":"2024-09-19T08:10:14.790873+0000","last_became_peered":"2024-09-19T08:10:14.790873+0000","last_unstale":"2024-09-19T08:10:14.791196+0000","last_undegraded":"2024-09-19T08:10:14.791196+0000","last_fullsized":"2024-09-19T08:10:14.791196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:41.725521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784061+0000","last_change":"2024-09-19T08:09:09.242166+0000","last_active":"2024-09-19T08:10:14.784061+0000","last_peered":"2024-09-19T08:10:14.784061+0000","last_clean":"2024-09-19T08:10:14.784061+0000","last_became_active":"2024-09-19T08:09:09.241270+0000","last_became_peered":"2024-09-19T08:09:09.241270+0000","last_unstale":"2024-09-19T08:10:14.784061+0000","last_undegraded":"2024-09-19T08:10:14.784061+0000","last_fullsized":"2024-09-19T08:10:14.784061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:51.899069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.793572+0000","last_change":"2024-09-19T08:10:14.793572+0000","last_active":"2024-09-19T08:10:14.793572+0000","last_peered":"2024-09-19T08:10:14.793572+0000","last_clean":"2024-09-19T08:10:14.793572+0000","last_became_active":"2024-09-19T08:10:14.793258+0000","last_became_peered":"2024-09-19T08:10:14.793258+0000","last_unstale":"2024-09-19T08:10:14.793572+0000","last_undegraded":"2024-09-19T08:10:14.793572+0000","last_fullsized":"2024-09-19T08:10:14.793572+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:53.912430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786956+0000","last_change":"2024-09-19T08:09:09.118790+0000","last_active":"2024-09-19T08:10:14.786956+0000","last_peered":"2024-09-19T08:10:14.786956+0000","last_clean":"2024-09-19T08:10:14.786956+0000","last_became_active":"2024-09-19T08:09:09.117695+0000","last_became_peered":"2024-09-19T08:09:09.117695+0000","last_unstale":"2024-09-19T08:10:14.786956+0000","last_undegraded":"2024-09-19T08:10:14.786956+0000","last_fullsized":"2024-09-19T08:10:14.786956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:40.674039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784329+0000","last_change":"2024-09-19T08:09:11.249386+0000","last_active":"2024-09-19T08:10:14.784329+0000","last_peered":"2024-09-19T08:10:14.784329+0000","last_clean":"2024-09-19T08:10:14.784329+0000","last_became_active":"2024-09-19T08:09:11.249004+0000","last_became_peered":"2024-09-19T08:09:11.249004+0000","last_unstale":"2024-09-19T08:10:14.784329+0000","last_undegraded":"2024-09-19T08:10:14.784329+0000","last_fullsized":"2024-09-19T08:10:14.784329+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:50.170799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.781085+0000","last_change":"2024-09-19T08:09:09.241599+0000","last_active":"2024-09-19T08:10:14.781085+0000","last_peered":"2024-09-19T08:10:14.781085+0000","last_clean":"2024-09-19T08:10:14.781085+0000","last_became_active":"2024-09-19T08:09:09.241226+0000","last_became_peered":"2024-09-19T08:09:09.241226+0000","last_unstale":"2024-09-19T08:10:14.781085+0000","last_undegraded":"2024-09-19T08:10:14.781085+0000","last_fullsized":"2024-09-19T08:10:14.781085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:19.590966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784610+0000","last_change":"2024-09-19T08:09:11.238098+0000","last_active":"2024-09-19T08:10:14.784610+0000","last_peered":"2024-09-19T08:10:14.784610+0000","last_clean":"2024-09-19T08:10:14.784610+0000","last_became_active":"2024-09-19T08:09:11.237737+0000","last_became_peered":"2024-09-19T08:09:11.237737+0000","last_unstale":"2024-09-19T08:10:14.784610+0000","last_undegraded":"2024-09-19T08:10:14.784610+0000","last_fullsized":"2024-09-19T08:10:14.784610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:00.134664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.788301+0000","last_change":"2024-09-19T08:09:09.241775+0000","last_active":"2024-09-19T08:10:14.788301+0000","last_peered":"2024-09-19T08:10:14.788301+0000","last_clean":"2024-09-19T08:10:14.788301+0000","last_became_active":"2024-09-19T08:09:09.241367+0000","last_became_peered":"2024-09-19T08:09:09.241367+0000","last_unstale":"2024-09-19T08:10:14.788301+0000","last_undegraded":"2024-09-19T08:10:14.788301+0000","last_fullsized":"2024-09-19T08:10:14.788301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:11.862171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.783853+0000","last_change":"2024-09-19T08:09:11.251980+0000","last_active":"2024-09-19T08:10:14.783853+0000","last_peered":"2024-09-19T08:10:14.783853+0000","last_clean":"2024-09-19T08:10:14.783853+0000","last_became_active":"2024-09-19T08:09:11.251638+0000","last_became_peered":"2024-09-19T08:09:11.251638+0000","last_unstale":"2024-09-19T08:10:14.783853+0000","last_undegraded":"2024-09-19T08:10:14.783853+0000","last_fullsized":"2024-09-19T08:10:14.783853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:35.905643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'8","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.781140+0000","last_change":"2024-09-19T08:09:09.117150+0000","last_active":"2024-09-19T08:10:14.781140+0000","last_peered":"2024-09-19T08:10:14.781140+0000","last_clean":"2024-09-19T08:10:14.781140+0000","last_became_active":"2024-09-19T08:09:09.116763+0000","last_became_peered":"2024-09-19T08:09:09.116763+0000","last_unstale":"2024-09-19T08:10:14.781140+0000","last_undegraded":"2024-09-19T08:10:14.781140+0000","last_fullsized":"2024-09-19T08:10:14.781140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:18.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.825086+0000","last_change":"2024-09-19T08:09:11.244366+0000","last_active":"2024-09-19T08:10:14.825086+0000","last_peered":"2024-09-19T08:10:14.825086+0000","last_clean":"2024-09-19T08:10:14.825086+0000","last_became_active":"2024-09-19T08:09:11.244023+0000","last_became_peered":"2024-09-19T08:09:11.244023+0000","last_unstale":"2024-09-19T08:10:14.825086+0000","last_undegraded":"2024-09-19T08:10:14.825086+0000","last_fullsized":"2024-09-19T08:10:14.825086+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:18.572377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784549+0000","last_change":"2024-09-19T08:09:09.139557+0000","last_active":"2024-09-19T08:10:14.784549+0000","last_peered":"2024-09-19T08:10:14.784549+0000","last_clean":"2024-09-19T08:10:14.784549+0000","last_became_active":"2024-09-19T08:09:09.139190+0000","last_became_peered":"2024-09-19T08:09:09.139190+0000","last_unstale":"2024-09-19T08:10:14.784549+0000","last_undegraded":"2024-09-19T08:10:14.784549+0000","last_fullsized":"2024-09-19T08:10:14.784549+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:39.270432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786623+0000","last_change":"2024-09-19T08:09:11.249637+0000","last_active":"2024-09-19T08:10:14.786623+0000","last_peered":"2024-09-19T08:10:14.786623+0000","last_clean":"2024-09-19T08:10:14.786623+0000","last_became_active":"2024-09-19T08:09:11.249323+0000","last_became_peered":"2024-09-19T08:09:11.249323+0000","last_unstale":"2024-09-19T08:10:14.786623+0000","last_undegraded":"2024-09-19T08:10:14.786623+0000","last_fullsized":"2024-09-19T08:10:14.786623+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:28.270910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.782063+0000","last_change":"2024-09-19T08:09:09.242444+0000","last_active":"2024-09-19T08:10:14.782063+0000","last_peered":"2024-09-19T08:10:14.782063+0000","last_clean":"2024-09-19T08:10:14.782063+0000","last_became_active":"2024-09-19T08:09:09.242095+0000","last_became_peered":"2024-09-19T08:09:09.242095+0000","last_unstale":"2024-09-19T08:10:14.782063+0000","last_undegraded":"2024-09-19T08:10:14.782063+0000","last_fullsized":"2024-09-19T08:10:14.782063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:42.941930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787131+0000","last_change":"2024-09-19T08:09:11.241588+0000","last_active":"2024-09-19T08:10:14.787131+0000","last_peered":"2024-09-19T08:10:14.787131+0000","last_clean":"2024-09-19T08:10:14.787131+0000","last_became_active":"2024-09-19T08:09:11.241076+0000","last_became_peered":"2024-09-19T08:09:11.241076+0000","last_unstale":"2024-09-19T08:10:14.787131+0000","last_undegraded":"2024-09-19T08:10:14.787131+0000","last_fullsized":"2024-09-19T08:10:14.787131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:01.676410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.824783+0000","last_change":"2024-09-19T08:09:09.112494+0000","last_active":"2024-09-19T08:10:14.824783+0000","last_peered":"2024-09-19T08:10:14.824783+0000","last_clean":"2024-09-19T08:10:14.824783+0000","last_became_active":"2024-09-19T08:09:09.112019+0000","last_became_peered":"2024-09-19T08:09:09.112019+0000","last_unstale":"2024-09-19T08:10:14.824783+0000","last_undegraded":"2024-09-19T08:10:14.824783+0000","last_fullsized":"2024-09-19T08:10:14.824783+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:17.674092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.784464+0000","last_change":"2024-09-19T08:09:11.251420+0000","last_active":"2024-09-19T08:10:14.784464+0000","last_peered":"2024-09-19T08:10:14.784464+0000","last_clean":"2024-09-19T08:10:14.784464+0000","last_became_active":"2024-09-19T08:09:11.251083+0000","last_became_peered":"2024-09-19T08:09:11.251083+0000","last_unstale":"2024-09-19T08:10:14.784464+0000","last_undegraded":"2024-09-19T08:10:14.784464+0000","last_fullsized":"2024-09-19T08:10:14.784464+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:38.810616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.826422+0000","last_change":"2024-09-19T08:10:14.825972+0000","last_active":"2024-09-19T08:10:14.826422+0000","last_peered":"2024-09-19T08:10:14.826422+0000","last_clean":"2024-09-19T08:10:14.826422+0000","last_became_active":"2024-09-19T08:10:14.825579+0000","last_became_peered":"2024-09-19T08:10:14.825579+0000","last_unstale":"2024-09-19T08:10:14.826422+0000","last_undegraded":"2024-09-19T08:10:14.826422+0000","last_fullsized":"2024-09-19T08:10:14.826422+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:06.708622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.824734+0000","last_change":"2024-09-19T08:09:11.239096+0000","last_active":"2024-09-19T08:10:14.824734+0000","last_peered":"2024-09-19T08:10:14.824734+0000","last_clean":"2024-09-19T08:10:14.824734+0000","last_became_active":"2024-09-19T08:09:11.238739+0000","last_became_peered":"2024-09-19T08:09:11.238739+0000","last_unstale":"2024-09-19T08:10:14.824734+0000","last_undegraded":"2024-09-19T08:10:14.824734+0000","last_fullsized":"2024-09-19T08:10:14.824734+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:27.161174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787536+0000","last_change":"2024-09-19T08:09:09.115198+0000","last_active":"2024-09-19T08:10:14.787536+0000","last_peered":"2024-09-19T08:10:14.787536+0000","last_clean":"2024-09-19T08:10:14.787536+0000","last_became_active":"2024-09-19T08:09:09.114783+0000","last_became_peered":"2024-09-19T08:09:09.114783+0000","last_unstale":"2024-09-19T08:10:14.787536+0000","last_undegraded":"2024-09-19T08:10:14.787536+0000","last_fullsized":"2024-09-19T08:10:14.787536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:45.674774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786764+0000","last_change":"2024-09-19T08:09:11.252450+0000","last_active":"2024-09-19T08:10:14.786764+0000","last_peered":"2024-09-19T08:10:14.786764+0000","last_clean":"2024-09-19T08:10:14.786764+0000","last_became_active":"2024-09-19T08:09:11.251696+0000","last_became_peered":"2024-09-19T08:09:11.251696+0000","last_unstale":"2024-09-19T08:10:14.786764+0000","last_undegraded":"2024-09-19T08:10:14.786764+0000","last_fullsized":"2024-09-19T08:10:14.786764+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:48.179795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.785147+0000","last_change":"2024-09-19T08:09:11.244571+0000","last_active":"2024-09-19T08:10:14.785147+0000","last_peered":"2024-09-19T08:10:14.785147+0000","last_clean":"2024-09-19T08:10:14.785147+0000","last_became_active":"2024-09-19T08:09:11.244217+0000","last_became_peered":"2024-09-19T08:09:11.244217+0000","last_unstale":"2024-09-19T08:10:14.785147+0000","last_undegraded":"2024-09-19T08:10:14.785147+0000","last_fullsized":"2024-09-19T08:10:14.785147+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:52.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.787749+0000","last_change":"2024-09-19T08:09:09.117355+0000","last_active":"2024-09-19T08:10:14.787749+0000","last_peered":"2024-09-19T08:10:14.787749+0000","last_clean":"2024-09-19T08:10:14.787749+0000","last_became_active":"2024-09-19T08:09:09.116806+0000","last_became_peered":"2024-09-19T08:09:09.116806+0000","last_unstale":"2024-09-19T08:10:14.787749+0000","last_undegraded":"2024-09-19T08:10:14.787749+0000","last_fullsized":"2024-09-19T08:10:14.787749+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:42.113015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.782099+0000","last_change":"2024-09-19T08:09:11.245745+0000","last_active":"2024-09-19T08:10:14.782099+0000","last_peered":"2024-09-19T08:10:14.782099+0000","last_clean":"2024-09-19T08:10:14.782099+0000","last_became_active":"2024-09-19T08:09:11.245373+0000","last_became_peered":"2024-09-19T08:09:11.245373+0000","last_unstale":"2024-09-19T08:10:14.782099+0000","last_undegraded":"2024-09-19T08:10:14.782099+0000","last_fullsized":"2024-09-19T08:10:14.782099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:56.500738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.788193+0000","last_change":"2024-09-19T08:09:09.119550+0000","last_active":"2024-09-19T08:10:14.788193+0000","last_peered":"2024-09-19T08:10:14.788193+0000","last_clean":"2024-09-19T08:10:14.788193+0000","last_became_active":"2024-09-19T08:09:09.119187+0000","last_became_peered":"2024-09-19T08:09:09.119187+0000","last_unstale":"2024-09-19T08:10:14.788193+0000","last_undegraded":"2024-09-19T08:10:14.788193+0000","last_fullsized":"2024-09-19T08:10:14.788193+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:14.629824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.786666+0000","last_change":"2024-09-19T08:09:11.245318+0000","last_active":"2024-09-19T08:10:14.786666+0000","last_peered":"2024-09-19T08:10:14.786666+0000","last_clean":"2024-09-19T08:10:14.786666+0000","last_became_active":"2024-09-19T08:09:11.245000+0000","last_became_peered":"2024-09-19T08:09:11.245000+0000","last_unstale":"2024-09-19T08:10:14.786666+0000","last_undegraded":"2024-09-19T08:10:14.786666+0000","last_fullsized":"2024-09-19T08:10:14.786666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:53.590453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.825179+0000","last_change":"2024-09-19T08:09:09.241552+0000","last_active":"2024-09-19T08:10:14.825179+0000","last_peered":"2024-09-19T08:10:14.825179+0000","last_clean":"2024-09-19T08:10:14.825179+0000","last_became_active":"2024-09-19T08:09:09.241201+0000","last_became_peered":"2024-09-19T08:09:09.241201+0000","last_unstale":"2024-09-19T08:10:14.825179+0000","last_undegraded":"2024-09-19T08:10:14.825179+0000","last_fullsized":"2024-09-19T08:10:14.825179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:09.374532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.825024+0000","last_change":"2024-09-19T08:09:11.246697+0000","last_active":"2024-09-19T08:10:14.825024+0000","last_peered":"2024-09-19T08:10:14.825024+0000","last_clean":"2024-09-19T08:10:14.825024+0000","last_became_active":"2024-09-19T08:09:11.246404+0000","last_became_peered":"2024-09-19T08:09:11.246404+0000","last_unstale":"2024-09-19T08:10:14.825024+0000","last_undegraded":"2024-09-19T08:10:14.825024+0000","last_fullsized":"2024-09-19T08:10:14.825024+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.008875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:10:14.781212+0000","last_change":"2024-09-19T08:09:09.113401+0000","last_active":"2024-09-19T08:10:14.781212+0000","last_peered":"2024-09-19T08:10:14.781212+0000","last_clean":"2024-09-19T08:10:14.781212+0000","last_became_active":"2024-09-19T08:09:09.113026+0000","last_became_peered":"2024-09-19T08:09:09.113026+0000","last_unstale":"2024-09-19T08:10:14.781212+0000","last_undegraded":"2024-09-19T08:10:14.781212+0000","last_fullsized":"2024-09-19T08:10:14.781212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:54.740955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63617,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":81,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":67,"ondisk_log_size":67,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281686,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547229,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":436037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776161,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1032192,"data_stored":1089535,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939687,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":436619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168619,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":901120,"data_stored":436641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397552,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":950272,"data_stored":1027104,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561077,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":436154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790011,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":958464,"data_stored":1026704,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953537,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":436059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182470,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":436375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411403,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":970752,"data_stored":498890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":966656,"data_stored":498856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":436127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34187,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:10:26.175 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T08:10:26.176 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T08:10:26.176 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T08:10:26.176 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T08:10:26.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:25 smithi203 ceph-mon[35198]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1008 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:10:26.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:25 smithi203 ceph-mon[35198]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:10:26.432 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:26.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:25 smithi155 ceph-mon[35362]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1008 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:10:26.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:25 smithi155 ceph-mon[35362]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:10:26.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.917+0000 7fb5a783f640 1 -- 172.21.15.27:0/1719021806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5a0112b90 msgr2=0x7fb5a0114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.917+0000 7fb5a783f640 1 --2- 172.21.15.27:0/1719021806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5a0112b90 0x7fb5a0114f80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb598009ca0 tx=0x7fb59802a950 comp rx=0 tx=0).stop 2024-09-19T08:10:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.918+0000 7fb5a783f640 1 -- 172.21.15.27:0/1719021806 shutdown_connections 2024-09-19T08:10:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.918+0000 7fb5a783f640 1 --2- 172.21.15.27:0/1719021806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5a0112b90 0x7fb5a0114f80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.918+0000 7fb5a783f640 1 --2- 172.21.15.27:0/1719021806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5a0074eb0 0x7fb5a0112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.918+0000 7fb5a783f640 1 --2- 172.21.15.27:0/1719021806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5a0074590 0x7fb5a0074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.918+0000 7fb5a783f640 1 -- 172.21.15.27:0/1719021806 >> 172.21.15.27:0/1719021806 conn(0x7fb5a00fd8c0 msgr2=0x7fb5a00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.918+0000 7fb5a783f640 1 -- 172.21.15.27:0/1719021806 shutdown_connections 2024-09-19T08:10:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.918+0000 7fb5a783f640 1 -- 172.21.15.27:0/1719021806 wait complete. 2024-09-19T08:10:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.918+0000 7fb5a783f640 1 Processor -- start 2024-09-19T08:10:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.918+0000 7fb5a783f640 1 -- start start 2024-09-19T08:10:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5a783f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5a0074590 0x7fb5a01a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5a783f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5a0074eb0 0x7fb5a01a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:26.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5a783f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5a0112b90 0x7fb5a019ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:26.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5a783f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a0118630 con 0x7fb5a0112b90 2024-09-19T08:10:26.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5a783f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a01184b0 con 0x7fb5a0074590 2024-09-19T08:10:26.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5a783f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a01187b0 con 0x7fb5a0074eb0 2024-09-19T08:10:26.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5a5ddc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5a0112b90 0x7fb5a019ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:26.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5a5ddc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5a0112b90 0x7fb5a019ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48480/0 (socket says 172.21.15.27:48480) 2024-09-19T08:10:26.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5a5ddc640 1 -- 172.21.15.27:0/1632192194 learned_addr learned my addr 172.21.15.27:0/1632192194 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:26.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5a4dda640 1 --2- 172.21.15.27:0/1632192194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5a0074eb0 0x7fb5a01a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:26.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5a55db640 1 --2- 172.21.15.27:0/1632192194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5a0074590 0x7fb5a01a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:26.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5a5ddc640 1 -- 172.21.15.27:0/1632192194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5a0074eb0 msgr2=0x7fb5a01a4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:26.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5a5ddc640 1 --2- 172.21.15.27:0/1632192194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5a0074eb0 0x7fb5a01a4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:26.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5a5ddc640 1 -- 172.21.15.27:0/1632192194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5a0074590 msgr2=0x7fb5a01a48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:26.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5a5ddc640 1 --2- 172.21.15.27:0/1632192194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5a0074590 0x7fb5a01a48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:26.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5a5ddc640 1 -- 172.21.15.27:0/1632192194 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a019f190 con 0x7fb5a0112b90 2024-09-19T08:10:26.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5a5ddc640 1 --2- 172.21.15.27:0/1632192194 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5a0112b90 0x7fb5a019ea60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb598006010 tx=0x7fb59802f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:26.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5967fc640 1 -- 172.21.15.27:0/1632192194 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598034040 con 0x7fb5a0112b90 2024-09-19T08:10:26.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5a783f640 1 -- 172.21.15.27:0/1632192194 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a019f420 con 0x7fb5a0112b90 2024-09-19T08:10:26.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5967fc640 1 -- 172.21.15.27:0/1632192194 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb598003e00 con 0x7fb5a0112b90 2024-09-19T08:10:26.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5967fc640 1 -- 172.21.15.27:0/1632192194 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5980456e0 con 0x7fb5a0112b90 2024-09-19T08:10:26.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.919+0000 7fb5a783f640 1 -- 172.21.15.27:0/1632192194 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a01ab770 con 0x7fb5a0112b90 2024-09-19T08:10:26.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.921+0000 7fb5a783f640 1 -- 172.21.15.27:0/1632192194 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a00749f0 con 0x7fb5a0112b90 2024-09-19T08:10:26.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.922+0000 7fb5967fc640 1 -- 172.21.15.27:0/1632192194 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb598037020 con 0x7fb5a0112b90 2024-09-19T08:10:26.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.922+0000 7fb5967fc640 1 --2- 172.21.15.27:0/1632192194 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fb58c0a32d0 0x7fb58c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:26.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.923+0000 7fb5a55db640 1 --2- 172.21.15.27:0/1632192194 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fb58c0a32d0 0x7fb58c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:26.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.923+0000 7fb5967fc640 1 -- 172.21.15.27:0/1632192194 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fb5980f0b20 con 0x7fb5a0112b90 2024-09-19T08:10:26.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.923+0000 7fb5a55db640 1 --2- 172.21.15.27:0/1632192194 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fb58c0a32d0 0x7fb58c0a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb5a019fba0 tx=0x7fb59c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:26.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:26.927+0000 7fb5967fc640 1 -- 172.21.15.27:0/1632192194 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb5980bd8b0 con 0x7fb5a0112b90 2024-09-19T08:10:27.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:27.142+0000 7fb5a783f640 1 -- 172.21.15.27:0/1632192194 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb5a0104fd0 con 0x7fb5a0112b90 2024-09-19T08:10:27.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:27.142+0000 7fb5967fc640 1 -- 172.21.15.27:0/1632192194 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fb5980bd1b0 con 0x7fb5a0112b90 2024-09-19T08:10:27.142 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:10:27.142 INFO:teuthology.orchestra.run.smithi027.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T08:10:27.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:27.144+0000 7fb5a783f640 1 -- 172.21.15.27:0/1632192194 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fb58c0a32d0 msgr2=0x7fb58c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:27.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:27.144+0000 7fb5a783f640 1 --2- 172.21.15.27:0/1632192194 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fb58c0a32d0 0x7fb58c0a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb5a019fba0 tx=0x7fb59c008040 comp rx=0 tx=0).stop 2024-09-19T08:10:27.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:27.144+0000 7fb5a783f640 1 -- 172.21.15.27:0/1632192194 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5a0112b90 msgr2=0x7fb5a019ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:27.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:27.144+0000 7fb5a783f640 1 --2- 172.21.15.27:0/1632192194 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5a0112b90 0x7fb5a019ea60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb598006010 tx=0x7fb59802f710 comp rx=0 tx=0).stop 2024-09-19T08:10:27.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:27.144+0000 7fb5a783f640 1 -- 172.21.15.27:0/1632192194 shutdown_connections 2024-09-19T08:10:27.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:27.144+0000 7fb5a783f640 1 --2- 172.21.15.27:0/1632192194 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5a0112b90 0x7fb5a019ea60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:27.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:27.144+0000 7fb5a783f640 1 --2- 172.21.15.27:0/1632192194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5a0074eb0 0x7fb5a01a4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:27.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:27.144+0000 7fb5a783f640 1 --2- 172.21.15.27:0/1632192194 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fb58c0a32d0 0x7fb58c0a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:27.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:27.144+0000 7fb5a783f640 1 --2- 172.21.15.27:0/1632192194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5a0074590 0x7fb5a01a48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:27.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:27.144+0000 7fb5a783f640 1 -- 172.21.15.27:0/1632192194 >> 172.21.15.27:0/1632192194 conn(0x7fb5a00fd8c0 msgr2=0x7fb5a00ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:27.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:27.145+0000 7fb5a783f640 1 -- 172.21.15.27:0/1632192194 shutdown_connections 2024-09-19T08:10:27.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:27.145+0000 7fb5a783f640 1 -- 172.21.15.27:0/1632192194 wait complete. 2024-09-19T08:10:27.883 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T08:10:27.883 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:10:28.140 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:28.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:27 smithi027 ceph-mon[31209]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:10:28.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:27 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1632192194' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T08:10:28.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:27 smithi203 ceph-mon[35198]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:10:28.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:27 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1632192194' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T08:10:28.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:27 smithi155 ceph-mon[35362]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:10:28.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:27 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1632192194' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T08:10:28.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.645+0000 7f729ec57640 1 -- 172.21.15.27:0/3510783358 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7298101de0 msgr2=0x7f72981021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:28.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.645+0000 7f729ec57640 1 --2- 172.21.15.27:0/3510783358 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7298101de0 0x7f72981021c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f728c009900 tx=0x7f728c02a410 comp rx=0 tx=0).stop 2024-09-19T08:10:28.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.645+0000 7f729ec57640 1 -- 172.21.15.27:0/3510783358 shutdown_connections 2024-09-19T08:10:28.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.645+0000 7f729ec57640 1 --2- 172.21.15.27:0/3510783358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7298106f10 0x7f729810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:28.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.645+0000 7f729ec57640 1 --2- 172.21.15.27:0/3510783358 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7298102790 0x7f72981067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:28.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.645+0000 7f729ec57640 1 --2- 172.21.15.27:0/3510783358 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7298101de0 0x7f72981021c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:28.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.645+0000 7f729ec57640 1 -- 172.21.15.27:0/3510783358 >> 172.21.15.27:0/3510783358 conn(0x7f72980fd8c0 msgr2=0x7f72980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:28.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.645+0000 7f729ec57640 1 -- 172.21.15.27:0/3510783358 shutdown_connections 2024-09-19T08:10:28.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.645+0000 7f729ec57640 1 -- 172.21.15.27:0/3510783358 wait complete. 2024-09-19T08:10:28.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.646+0000 7f729ec57640 1 Processor -- start 2024-09-19T08:10:28.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.646+0000 7f729ec57640 1 -- start start 2024-09-19T08:10:28.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.646+0000 7f729ec57640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7298101de0 0x7f7298198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:28.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.646+0000 7f729ec57640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7298102790 0x7f72981989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:28.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.646+0000 7f729ec57640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7298106f10 0x7f729819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:28.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.646+0000 7f729ec57640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7298111f90 con 0x7f7298101de0 2024-09-19T08:10:28.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.646+0000 7f729ec57640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7298111e10 con 0x7f7298102790 2024-09-19T08:10:28.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.646+0000 7f729ec57640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7298112110 con 0x7f7298106f10 2024-09-19T08:10:28.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.646+0000 7f729c9f3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7298101de0 0x7f7298198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:28.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.646+0000 7f729c9f3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7298101de0 0x7f7298198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48498/0 (socket says 172.21.15.27:48498) 2024-09-19T08:10:28.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.646+0000 7f729c9f3640 1 -- 172.21.15.27:0/3961932855 learned_addr learned my addr 172.21.15.27:0/3961932855 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:28.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.646+0000 7f7297fff640 1 --2- 172.21.15.27:0/3961932855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7298102790 0x7f72981989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:28.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.646+0000 7f729d1f4640 1 --2- 172.21.15.27:0/3961932855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7298106f10 0x7f729819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:28.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.647+0000 7f729c9f3640 1 -- 172.21.15.27:0/3961932855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7298106f10 msgr2=0x7f729819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:28.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.647+0000 7f729c9f3640 1 --2- 172.21.15.27:0/3961932855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7298106f10 0x7f729819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:28.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.647+0000 7f729c9f3640 1 -- 172.21.15.27:0/3961932855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7298102790 msgr2=0x7f72981989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:28.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.647+0000 7f729c9f3640 1 --2- 172.21.15.27:0/3961932855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7298102790 0x7f72981989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:28.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.647+0000 7f729c9f3640 1 -- 172.21.15.27:0/3961932855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729819d440 con 0x7f7298101de0 2024-09-19T08:10:28.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.647+0000 7f729c9f3640 1 --2- 172.21.15.27:0/3961932855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7298101de0 0x7f7298198490 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f728c006010 tx=0x7f728c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:28.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.647+0000 7f7295ffb640 1 -- 172.21.15.27:0/3961932855 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c03f030 con 0x7f7298101de0 2024-09-19T08:10:28.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.647+0000 7f7295ffb640 1 -- 172.21.15.27:0/3961932855 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f728c003ce0 con 0x7f7298101de0 2024-09-19T08:10:28.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.647+0000 7f729ec57640 1 -- 172.21.15.27:0/3961932855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f729819d6d0 con 0x7f7298101de0 2024-09-19T08:10:28.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.647+0000 7f7295ffb640 1 -- 172.21.15.27:0/3961932855 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c035070 con 0x7f7298101de0 2024-09-19T08:10:28.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.647+0000 7f729ec57640 1 -- 172.21.15.27:0/3961932855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72981a5010 con 0x7f7298101de0 2024-09-19T08:10:28.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.648+0000 7f729ec57640 1 -- 172.21.15.27:0/3961932855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72981032c0 con 0x7f7298101de0 2024-09-19T08:10:28.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.649+0000 7f7295ffb640 1 -- 172.21.15.27:0/3961932855 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f728c042030 con 0x7f7298101de0 2024-09-19T08:10:28.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.650+0000 7f7295ffb640 1 --2- 172.21.15.27:0/3961932855 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f72880a32d0 0x7f72880a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:28.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.651+0000 7f7297fff640 1 --2- 172.21.15.27:0/3961932855 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f72880a32d0 0x7f72880a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:28.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.651+0000 7f7295ffb640 1 -- 172.21.15.27:0/3961932855 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f728c0f01d0 con 0x7f7298101de0 2024-09-19T08:10:28.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.651+0000 7f7297fff640 1 --2- 172.21.15.27:0/3961932855 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f72880a32d0 0x7f72880a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f72980fdd50 tx=0x7f7284009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:28.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.654+0000 7f7295ffb640 1 -- 172.21.15.27:0/3961932855 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f728c0bcd60 con 0x7f7298101de0 2024-09-19T08:10:28.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.867+0000 7f729ec57640 1 -- 172.21.15.27:0/3961932855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f729810a0f0 con 0x7f7298101de0 2024-09-19T08:10:28.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.868+0000 7f7295ffb640 1 -- 172.21.15.27:0/3961932855 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f728c0bc660 con 0x7f7298101de0 2024-09-19T08:10:28.868 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:10:28.868 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:10:28.868 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:10:28.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.870+0000 7f729ec57640 1 -- 172.21.15.27:0/3961932855 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f72880a32d0 msgr2=0x7f72880a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:28.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.870+0000 7f729ec57640 1 --2- 172.21.15.27:0/3961932855 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f72880a32d0 0x7f72880a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f72980fdd50 tx=0x7f7284009110 comp rx=0 tx=0).stop 2024-09-19T08:10:28.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.870+0000 7f729ec57640 1 -- 172.21.15.27:0/3961932855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7298101de0 msgr2=0x7f7298198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:28.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.870+0000 7f729ec57640 1 --2- 172.21.15.27:0/3961932855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7298101de0 0x7f7298198490 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f728c006010 tx=0x7f728c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:10:28.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.871+0000 7f729ec57640 1 -- 172.21.15.27:0/3961932855 shutdown_connections 2024-09-19T08:10:28.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.871+0000 7f729ec57640 1 --2- 172.21.15.27:0/3961932855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7298106f10 0x7f729819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:28.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.871+0000 7f729ec57640 1 --2- 172.21.15.27:0/3961932855 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f72880a32d0 0x7f72880a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:28.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.871+0000 7f729ec57640 1 --2- 172.21.15.27:0/3961932855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7298102790 0x7f72981989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:28.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.871+0000 7f729ec57640 1 --2- 172.21.15.27:0/3961932855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7298101de0 0x7f7298198490 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:28.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.871+0000 7f729ec57640 1 -- 172.21.15.27:0/3961932855 >> 172.21.15.27:0/3961932855 conn(0x7f72980fd8c0 msgr2=0x7f72980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:28.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.871+0000 7f729ec57640 1 -- 172.21.15.27:0/3961932855 shutdown_connections 2024-09-19T08:10:28.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:28.871+0000 7f729ec57640 1 -- 172.21.15.27:0/3961932855 wait complete. 2024-09-19T08:10:29.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:28 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3961932855' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:10:29.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:28 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3961932855' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:10:29.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:29 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3961932855' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:10:29.639 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:10:29.896 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:30.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:29 smithi027 ceph-mon[31209]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:10:30.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:29 smithi203 ceph-mon[35198]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:10:30.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.372+0000 7f1f07680640 1 -- 172.21.15.27:0/484650436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f0010c180 msgr2=0x7f1f0010e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:30.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.372+0000 7f1f07680640 1 --2- 172.21.15.27:0/484650436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f0010c180 0x7f1f0010e600 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009ca0 tx=0x7f1ef802a950 comp rx=0 tx=0).stop 2024-09-19T08:10:30.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.372+0000 7f1f07680640 1 -- 172.21.15.27:0/484650436 shutdown_connections 2024-09-19T08:10:30.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.372+0000 7f1f07680640 1 --2- 172.21.15.27:0/484650436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f0010c180 0x7f1f0010e600 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:30.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.372+0000 7f1f07680640 1 --2- 172.21.15.27:0/484650436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f001036c0 0x7f1f0010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:30.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.372+0000 7f1f07680640 1 --2- 172.21.15.27:0/484650436 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f00102da0 0x7f1f00103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:30.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.372+0000 7f1f07680640 1 -- 172.21.15.27:0/484650436 >> 172.21.15.27:0/484650436 conn(0x7f1f000fc7a0 msgr2=0x7f1f000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:30.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.372+0000 7f1f07680640 1 -- 172.21.15.27:0/484650436 shutdown_connections 2024-09-19T08:10:30.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.372+0000 7f1f07680640 1 -- 172.21.15.27:0/484650436 wait complete. 2024-09-19T08:10:30.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.373+0000 7f1f07680640 1 Processor -- start 2024-09-19T08:10:30.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.373+0000 7f1f07680640 1 -- start start 2024-09-19T08:10:30.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.373+0000 7f1f07680640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f00102da0 0x7f1f001983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:30.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.373+0000 7f1f07680640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f001036c0 0x7f1f001988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:30.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.373+0000 7f1f07680640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f0010c180 0x7f1f0019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:30.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.373+0000 7f1f07680640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1f00111fa0 con 0x7f1f0010c180 2024-09-19T08:10:30.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.373+0000 7f1f07680640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1f00111e20 con 0x7f1f001036c0 2024-09-19T08:10:30.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.373+0000 7f1f07680640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1f00112120 con 0x7f1f00102da0 2024-09-19T08:10:30.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.373+0000 7f1f05c1d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f0010c180 0x7f1f0019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:30.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.373+0000 7f1f05c1d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f0010c180 0x7f1f0019cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60296/0 (socket says 172.21.15.27:60296) 2024-09-19T08:10:30.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.373+0000 7f1f05c1d640 1 -- 172.21.15.27:0/49121859 learned_addr learned my addr 172.21.15.27:0/49121859 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:30.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.373+0000 7f1f0541c640 1 --2- 172.21.15.27:0/49121859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f00102da0 0x7f1f001983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:30.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.373+0000 7f1f04c1b640 1 --2- 172.21.15.27:0/49121859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f001036c0 0x7f1f001988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:30.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.374+0000 7f1f05c1d640 1 -- 172.21.15.27:0/49121859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f00102da0 msgr2=0x7f1f001983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:30.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.374+0000 7f1f05c1d640 1 --2- 172.21.15.27:0/49121859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f00102da0 0x7f1f001983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:30.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.374+0000 7f1f05c1d640 1 -- 172.21.15.27:0/49121859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f001036c0 msgr2=0x7f1f001988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:30.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.374+0000 7f1f05c1d640 1 --2- 172.21.15.27:0/49121859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f001036c0 0x7f1f001988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:30.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.374+0000 7f1f05c1d640 1 -- 172.21.15.27:0/49121859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0019d350 con 0x7f1f0010c180 2024-09-19T08:10:30.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.374+0000 7f1f0541c640 1 --2- 172.21.15.27:0/49121859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f00102da0 0x7f1f001983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:10:30.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.374+0000 7f1f04c1b640 1 --2- 172.21.15.27:0/49121859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f001036c0 0x7f1f001988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:10:30.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.374+0000 7f1f05c1d640 1 --2- 172.21.15.27:0/49121859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f0010c180 0x7f1f0019cc70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8006010 tx=0x7f1ef802f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:30.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.374+0000 7f1efe7fc640 1 -- 172.21.15.27:0/49121859 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef8034040 con 0x7f1f0010c180 2024-09-19T08:10:30.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.374+0000 7f1efe7fc640 1 -- 172.21.15.27:0/49121859 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ef8003e00 con 0x7f1f0010c180 2024-09-19T08:10:30.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.374+0000 7f1f07680640 1 -- 172.21.15.27:0/49121859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0019d5e0 con 0x7f1f0010c180 2024-09-19T08:10:30.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.374+0000 7f1efe7fc640 1 -- 172.21.15.27:0/49121859 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef80456e0 con 0x7f1f0010c180 2024-09-19T08:10:30.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.374+0000 7f1f07680640 1 -- 172.21.15.27:0/49121859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f001a4f20 con 0x7f1f0010c180 2024-09-19T08:10:30.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.375+0000 7f1f07680640 1 -- 172.21.15.27:0/49121859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f00103180 con 0x7f1f0010c180 2024-09-19T08:10:30.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.376+0000 7f1efe7fc640 1 -- 172.21.15.27:0/49121859 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1ef8037020 con 0x7f1f0010c180 2024-09-19T08:10:30.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.377+0000 7f1efe7fc640 1 --2- 172.21.15.27:0/49121859 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f1eec0a32d0 0x7f1eec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:30.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.377+0000 7f1f0541c640 1 --2- 172.21.15.27:0/49121859 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f1eec0a32d0 0x7f1eec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:30.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.377+0000 7f1efe7fc640 1 -- 172.21.15.27:0/49121859 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f1ef80f0ad0 con 0x7f1f0010c180 2024-09-19T08:10:30.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.377+0000 7f1f0541c640 1 --2- 172.21.15.27:0/49121859 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f1eec0a32d0 0x7f1eec0a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0009930 tx=0x7f1ef0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:30.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.381+0000 7f1efe7fc640 1 -- 172.21.15.27:0/49121859 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1ef80bd7d0 con 0x7f1f0010c180 2024-09-19T08:10:30.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:29 smithi155 ceph-mon[35362]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:10:30.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.596+0000 7f1f07680640 1 -- 172.21.15.27:0/49121859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f001a5150 con 0x7f1f0010c180 2024-09-19T08:10:30.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.596+0000 7f1efe7fc640 1 -- 172.21.15.27:0/49121859 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f1ef80bd0d0 con 0x7f1f0010c180 2024-09-19T08:10:30.597 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:10:30.598 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:10:30.598 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:10:30.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.599+0000 7f1f07680640 1 -- 172.21.15.27:0/49121859 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f1eec0a32d0 msgr2=0x7f1eec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:30.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.599+0000 7f1f07680640 1 --2- 172.21.15.27:0/49121859 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f1eec0a32d0 0x7f1eec0a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0009930 tx=0x7f1ef0008040 comp rx=0 tx=0).stop 2024-09-19T08:10:30.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.599+0000 7f1f07680640 1 -- 172.21.15.27:0/49121859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f0010c180 msgr2=0x7f1f0019cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:30.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.599+0000 7f1f07680640 1 --2- 172.21.15.27:0/49121859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f0010c180 0x7f1f0019cc70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8006010 tx=0x7f1ef802f710 comp rx=0 tx=0).stop 2024-09-19T08:10:30.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.599+0000 7f1f07680640 1 -- 172.21.15.27:0/49121859 shutdown_connections 2024-09-19T08:10:30.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.599+0000 7f1f07680640 1 --2- 172.21.15.27:0/49121859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f0010c180 0x7f1f0019cc70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:30.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.599+0000 7f1f07680640 1 --2- 172.21.15.27:0/49121859 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f1eec0a32d0 0x7f1eec0a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:30.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.599+0000 7f1f07680640 1 --2- 172.21.15.27:0/49121859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f001036c0 0x7f1f001988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:30.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.599+0000 7f1f07680640 1 --2- 172.21.15.27:0/49121859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f00102da0 0x7f1f001983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:30.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.599+0000 7f1f07680640 1 -- 172.21.15.27:0/49121859 >> 172.21.15.27:0/49121859 conn(0x7f1f000fc7a0 msgr2=0x7f1f000fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:30.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.599+0000 7f1f07680640 1 -- 172.21.15.27:0/49121859 shutdown_connections 2024-09-19T08:10:30.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:30.599+0000 7f1f07680640 1 -- 172.21.15.27:0/49121859 wait complete. 2024-09-19T08:10:31.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:31 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/49121859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:10:31.271 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:31 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/49121859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:10:31.301 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:10:31.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:31 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/49121859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:10:31.557 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:32.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.048+0000 7f41c7821640 1 -- 172.21.15.27:0/3334771645 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41c0102790 msgr2=0x7f41c01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:32.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.048+0000 7f41c7821640 1 --2- 172.21.15.27:0/3334771645 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41c0102790 0x7f41c01067e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009900 tx=0x7f41b402a410 comp rx=0 tx=0).stop 2024-09-19T08:10:32.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.048+0000 7f41c7821640 1 -- 172.21.15.27:0/3334771645 shutdown_connections 2024-09-19T08:10:32.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.048+0000 7f41c7821640 1 --2- 172.21.15.27:0/3334771645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c0106f10 0x7f41c010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:32.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.048+0000 7f41c7821640 1 --2- 172.21.15.27:0/3334771645 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41c0102790 0x7f41c01067e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:32.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.048+0000 7f41c7821640 1 --2- 172.21.15.27:0/3334771645 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41c0101de0 0x7f41c01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:32.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.048+0000 7f41c7821640 1 -- 172.21.15.27:0/3334771645 >> 172.21.15.27:0/3334771645 conn(0x7f41c00fd8c0 msgr2=0x7f41c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:32.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.048+0000 7f41c7821640 1 -- 172.21.15.27:0/3334771645 shutdown_connections 2024-09-19T08:10:32.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.048+0000 7f41c7821640 1 -- 172.21.15.27:0/3334771645 wait complete. 2024-09-19T08:10:32.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.049+0000 7f41c7821640 1 Processor -- start 2024-09-19T08:10:32.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.049+0000 7f41c7821640 1 -- start start 2024-09-19T08:10:32.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.049+0000 7f41c7821640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41c0101de0 0x7f41c019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:32.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.049+0000 7f41c7821640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c0102790 0x7f41c019ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:32.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.049+0000 7f41c7821640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41c0106f10 0x7f41c019f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:32.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.049+0000 7f41c7821640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f41c0111fb0 con 0x7f41c0101de0 2024-09-19T08:10:32.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.049+0000 7f41c7821640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f41c0111e30 con 0x7f41c0102790 2024-09-19T08:10:32.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.049+0000 7f41c7821640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f41c0112130 con 0x7f41c0106f10 2024-09-19T08:10:32.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.049+0000 7f41c55bd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41c0101de0 0x7f41c019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:32.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.049+0000 7f41c55bd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41c0101de0 0x7f41c019a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60328/0 (socket says 172.21.15.27:60328) 2024-09-19T08:10:32.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.049+0000 7f41c55bd640 1 -- 172.21.15.27:0/2381094185 learned_addr learned my addr 172.21.15.27:0/2381094185 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:32.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.049+0000 7f41c4dbc640 1 --2- 172.21.15.27:0/2381094185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c0102790 0x7f41c019ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:32.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.049+0000 7f41c5dbe640 1 --2- 172.21.15.27:0/2381094185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41c0106f10 0x7f41c019f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:32.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.049+0000 7f41c55bd640 1 -- 172.21.15.27:0/2381094185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41c0106f10 msgr2=0x7f41c019f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:32.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.049+0000 7f41c55bd640 1 --2- 172.21.15.27:0/2381094185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41c0106f10 0x7f41c019f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:32.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.049+0000 7f41c55bd640 1 -- 172.21.15.27:0/2381094185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c0102790 msgr2=0x7f41c019ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:32.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.049+0000 7f41c55bd640 1 --2- 172.21.15.27:0/2381094185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c0102790 0x7f41c019ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:32.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.049+0000 7f41c55bd640 1 -- 172.21.15.27:0/2381094185 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c019f700 con 0x7f41c0101de0 2024-09-19T08:10:32.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.049+0000 7f41c4dbc640 1 --2- 172.21.15.27:0/2381094185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c0102790 0x7f41c019ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:10:32.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.050+0000 7f41c55bd640 1 --2- 172.21.15.27:0/2381094185 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41c0101de0 0x7f41c019a750 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f41b800ba50 tx=0x7f41b800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:32.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.050+0000 7f41be7fc640 1 -- 172.21.15.27:0/2381094185 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b8019070 con 0x7f41c0101de0 2024-09-19T08:10:32.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.050+0000 7f41c7821640 1 -- 172.21.15.27:0/2381094185 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c019f9f0 con 0x7f41c0101de0 2024-09-19T08:10:32.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.050+0000 7f41be7fc640 1 -- 172.21.15.27:0/2381094185 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41b800cbe0 con 0x7f41c0101de0 2024-09-19T08:10:32.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.050+0000 7f41be7fc640 1 -- 172.21.15.27:0/2381094185 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b80076e0 con 0x7f41c0101de0 2024-09-19T08:10:32.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.050+0000 7f41c7821640 1 -- 172.21.15.27:0/2381094185 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c01a72d0 con 0x7f41c0101de0 2024-09-19T08:10:32.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.051+0000 7f41c7821640 1 -- 172.21.15.27:0/2381094185 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41c01021c0 con 0x7f41c0101de0 2024-09-19T08:10:32.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.052+0000 7f41be7fc640 1 -- 172.21.15.27:0/2381094185 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f41b801c070 con 0x7f41c0101de0 2024-09-19T08:10:32.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.053+0000 7f41be7fc640 1 --2- 172.21.15.27:0/2381094185 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f41a80a32d0 0x7f41a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:32.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.053+0000 7f41c4dbc640 1 --2- 172.21.15.27:0/2381094185 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f41a80a32d0 0x7f41a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:32.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.053+0000 7f41be7fc640 1 -- 172.21.15.27:0/2381094185 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f41b80cef70 con 0x7f41c0101de0 2024-09-19T08:10:32.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.053+0000 7f41c4dbc640 1 --2- 172.21.15.27:0/2381094185 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f41a80a32d0 0x7f41a80a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f41b4000c00 tx=0x7f41b4032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:32.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.057+0000 7f41be7fc640 1 -- 172.21.15.27:0/2381094185 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f41b809bd10 con 0x7f41c0101de0 2024-09-19T08:10:32.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.233+0000 7f41c7821640 1 -- 172.21.15.27:0/2381094185 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41c019bab0 con 0x7f41c0101de0 2024-09-19T08:10:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:32 smithi027 ceph-mon[31209]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:32.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.235+0000 7f41be7fc640 1 -- 172.21.15.27:0/2381094185 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22650 (secure 0 0 0) 0x7f41b809b610 con 0x7f41c0101de0 2024-09-19T08:10:32.237 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:10:32.237 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":83,"fsid":"35b531b0-765d-11ef-bceb-c7b262605968","created":"2024-09-19T08:01:20.929241+0000","modified":"2024-09-19T08:10:14.777420+0000","last_up_change":"2024-09-19T08:08:17.919001+0000","last_in_change":"2024-09-19T08:07:54.277124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:04:29.312984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:09:08.046858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:09:10.223258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66fd6732-4cac-4eda-bf06-50638995ee80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6803","nonce":3645201250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6805","nonce":3645201250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6809","nonce":3645201250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6807","nonce":3645201250}]},"public_addr":"172.21.15.27:6803/3645201250","cluster_addr":"172.21.15.27:6805/3645201250","heartbeat_back_addr":"172.21.15.27:6809/3645201250","heartbeat_front_addr":"172.21.15.27:6807/3645201250","state":["exists","up"]},{"osd":1,"uuid":"36628767-66ac-433b-938e-10e75b51a877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6801","nonce":3977510449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6803","nonce":3977510449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6807","nonce":3977510449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6805","nonce":3977510449}]},"public_addr":"172.21.15.155:6801/3977510449","cluster_addr":"172.21.15.155:6803/3977510449","heartbeat_back_addr":"172.21.15.155:6807/3977510449","heartbeat_front_addr":"172.21.15.155:6805/3977510449","state":["exists","up"]},{"osd":2,"uuid":"3dc80404-a56b-456a-af02-f01e9c6c6dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6801","nonce":3796057016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6803","nonce":3796057016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6807","nonce":3796057016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6805","nonce":3796057016}]},"public_addr":"172.21.15.203:6801/3796057016","cluster_addr":"172.21.15.203:6803/3796057016","heartbeat_back_addr":"172.21.15.203:6807/3796057016","heartbeat_front_addr":"172.21.15.203:6805/3796057016","state":["exists","up"]},{"osd":3,"uuid":"a51077d0-5e04-49b5-bb3e-91711cc45ff1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6811","nonce":1608304347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6813","nonce":1608304347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6817","nonce":1608304347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6815","nonce":1608304347}]},"public_addr":"172.21.15.27:6811/1608304347","cluster_addr":"172.21.15.27:6813/1608304347","heartbeat_back_addr":"172.21.15.27:6817/1608304347","heartbeat_front_addr":"172.21.15.27:6815/1608304347","state":["exists","up"]},{"osd":4,"uuid":"0df35548-90b4-434d-8d7e-c037072c9ae4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6809","nonce":569913150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6811","nonce":569913150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6815","nonce":569913150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6813","nonce":569913150}]},"public_addr":"172.21.15.155:6809/569913150","cluster_addr":"172.21.15.155:6811/569913150","heartbeat_back_addr":"172.21.15.155:6815/569913150","heartbeat_front_addr":"172.21.15.155:6813/569913150","state":["exists","up"]},{"osd":5,"uuid":"de193c5f-1019-43e5-9f4f-6c2aaa4330e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6809","nonce":991491203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6811","nonce":991491203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6815","nonce":991491203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6813","nonce":991491203}]},"public_addr":"172.21.15.203:6809/991491203","cluster_addr":"172.21.15.203:6811/991491203","heartbeat_back_addr":"172.21.15.203:6815/991491203","heartbeat_front_addr":"172.21.15.203:6813/991491203","state":["exists","up"]},{"osd":6,"uuid":"28938e4f-9f22-466f-8cf7-62ee56a0c926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6819","nonce":3516868131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6821","nonce":3516868131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6825","nonce":3516868131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6823","nonce":3516868131}]},"public_addr":"172.21.15.27:6819/3516868131","cluster_addr":"172.21.15.27:6821/3516868131","heartbeat_back_addr":"172.21.15.27:6825/3516868131","heartbeat_front_addr":"172.21.15.27:6823/3516868131","state":["exists","up"]},{"osd":7,"uuid":"855f1728-be52-4445-8561-a90c08f2b2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6817","nonce":2047506436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6819","nonce":2047506436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6823","nonce":2047506436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6821","nonce":2047506436}]},"public_addr":"172.21.15.155:6817/2047506436","cluster_addr":"172.21.15.155:6819/2047506436","heartbeat_back_addr":"172.21.15.155:6823/2047506436","heartbeat_front_addr":"172.21.15.155:6821/2047506436","state":["exists","up"]},{"osd":8,"uuid":"5d7a8ffd-a039-403e-8b9a-c80e19fd67ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6817","nonce":199970687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6819","nonce":199970687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6823","nonce":199970687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6821","nonce":199970687}]},"public_addr":"172.21.15.203:6817/199970687","cluster_addr":"172.21.15.203:6819/199970687","heartbeat_back_addr":"172.21.15.203:6823/199970687","heartbeat_front_addr":"172.21.15.203:6821/199970687","state":["exists","up"]},{"osd":9,"uuid":"cdb90242-80a1-4cef-b5e3-ddecb05664e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6827","nonce":118390483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6829","nonce":118390483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6833","nonce":118390483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6831","nonce":118390483}]},"public_addr":"172.21.15.27:6827/118390483","cluster_addr":"172.21.15.27:6829/118390483","heartbeat_back_addr":"172.21.15.27:6833/118390483","heartbeat_front_addr":"172.21.15.27:6831/118390483","state":["exists","up"]},{"osd":10,"uuid":"c7f4c9da-d913-47a5-8629-53de21efe8c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6825","nonce":1687418565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6827","nonce":1687418565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6831","nonce":1687418565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6829","nonce":1687418565}]},"public_addr":"172.21.15.155:6825/1687418565","cluster_addr":"172.21.15.155:6827/1687418565","heartbeat_back_addr":"172.21.15.155:6831/1687418565","heartbeat_front_addr":"172.21.15.155:6829/1687418565","state":["exists","up"]},{"osd":11,"uuid":"45c11a90-585e-46fa-a5a0-51a29e29eba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6825","nonce":224768827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6827","nonce":224768827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6831","nonce":224768827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6829","nonce":224768827}]},"public_addr":"172.21.15.203:6825/224768827","cluster_addr":"172.21.15.203:6827/224768827","heartbeat_back_addr":"172.21.15.203:6831/224768827","heartbeat_front_addr":"172.21.15.203:6829/224768827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:03:35.559549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:00.526006+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:25.809346+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:51.889445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:17.246017+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:43.515854+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:08.638182+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:34.653060+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:59.469837+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:26.122937+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:50.196159+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:08:16.245770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:6800/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/958829150":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1174736321":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1908865720":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/416476667":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6800/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/1717932879":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1963219497":"2024-09-20T08:01:48.686812+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:10:32.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.238+0000 7f41c7821640 1 -- 172.21.15.27:0/2381094185 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f41a80a32d0 msgr2=0x7f41a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:32.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.238+0000 7f41c7821640 1 --2- 172.21.15.27:0/2381094185 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f41a80a32d0 0x7f41a80a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f41b4000c00 tx=0x7f41b4032d50 comp rx=0 tx=0).stop 2024-09-19T08:10:32.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.238+0000 7f41c7821640 1 -- 172.21.15.27:0/2381094185 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41c0101de0 msgr2=0x7f41c019a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:32.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.238+0000 7f41c7821640 1 --2- 172.21.15.27:0/2381094185 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41c0101de0 0x7f41c019a750 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f41b800ba50 tx=0x7f41b800bf10 comp rx=0 tx=0).stop 2024-09-19T08:10:32.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.238+0000 7f41c7821640 1 -- 172.21.15.27:0/2381094185 shutdown_connections 2024-09-19T08:10:32.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.238+0000 7f41c7821640 1 --2- 172.21.15.27:0/2381094185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41c0106f10 0x7f41c019f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:32.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.238+0000 7f41c7821640 1 --2- 172.21.15.27:0/2381094185 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f41a80a32d0 0x7f41a80a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:32.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.238+0000 7f41c7821640 1 --2- 172.21.15.27:0/2381094185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41c0102790 0x7f41c019ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:32.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.238+0000 7f41c7821640 1 --2- 172.21.15.27:0/2381094185 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41c0101de0 0x7f41c019a750 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:32.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.238+0000 7f41c7821640 1 -- 172.21.15.27:0/2381094185 >> 172.21.15.27:0/2381094185 conn(0x7f41c00fd8c0 msgr2=0x7f41c00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:32.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.238+0000 7f41c7821640 1 -- 172.21.15.27:0/2381094185 shutdown_connections 2024-09-19T08:10:32.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:32.238+0000 7f41c7821640 1 -- 172.21.15.27:0/2381094185 wait complete. 2024-09-19T08:10:32.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:32 smithi203 ceph-mon[35198]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:32.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:32 smithi155 ceph-mon[35362]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:32.895 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:10:33.156 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:33.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:33 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2381094185' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:10:33.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:33 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2381094185' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:10:33.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:33 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2381094185' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:10:33.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.798+0000 7f7f452b8640 1 -- 172.21.15.27:0/4159487212 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f40102790 msgr2=0x7f7f401067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:33.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.798+0000 7f7f452b8640 1 --2- 172.21.15.27:0/4159487212 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f40102790 0x7f7f401067e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7f28009900 tx=0x7f7f2802a410 comp rx=0 tx=0).stop 2024-09-19T08:10:33.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.798+0000 7f7f452b8640 1 -- 172.21.15.27:0/4159487212 shutdown_connections 2024-09-19T08:10:33.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.798+0000 7f7f452b8640 1 --2- 172.21.15.27:0/4159487212 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f40106f10 0x7f7f4010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:33.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.798+0000 7f7f452b8640 1 --2- 172.21.15.27:0/4159487212 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f40102790 0x7f7f401067e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:33.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.798+0000 7f7f452b8640 1 --2- 172.21.15.27:0/4159487212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f40101de0 0x7f7f401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:33.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.798+0000 7f7f452b8640 1 -- 172.21.15.27:0/4159487212 >> 172.21.15.27:0/4159487212 conn(0x7f7f400fd8c0 msgr2=0x7f7f400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:33.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.798+0000 7f7f452b8640 1 -- 172.21.15.27:0/4159487212 shutdown_connections 2024-09-19T08:10:33.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.798+0000 7f7f452b8640 1 -- 172.21.15.27:0/4159487212 wait complete. 2024-09-19T08:10:33.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.799+0000 7f7f452b8640 1 Processor -- start 2024-09-19T08:10:33.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.799+0000 7f7f452b8640 1 -- start start 2024-09-19T08:10:33.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.799+0000 7f7f452b8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f40101de0 0x7f7f40198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:33.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.799+0000 7f7f452b8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f40102790 0x7f7f401988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:33.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.799+0000 7f7f452b8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f40106f10 0x7f7f4019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:33.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.799+0000 7f7f452b8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7f40111f70 con 0x7f7f40102790 2024-09-19T08:10:33.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.799+0000 7f7f452b8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7f40111df0 con 0x7f7f40106f10 2024-09-19T08:10:33.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.799+0000 7f7f452b8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7f401120f0 con 0x7f7f40101de0 2024-09-19T08:10:33.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.799+0000 7f7f3e7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f40102790 0x7f7f401988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:33.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.799+0000 7f7f3e7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f40102790 0x7f7f401988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60342/0 (socket says 172.21.15.27:60342) 2024-09-19T08:10:33.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.799+0000 7f7f3e7fc640 1 -- 172.21.15.27:0/1455396785 learned_addr learned my addr 172.21.15.27:0/1455396785 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:33.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.799+0000 7f7f3effd640 1 --2- 172.21.15.27:0/1455396785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f40101de0 0x7f7f40198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:33.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.799+0000 7f7f3f7fe640 1 --2- 172.21.15.27:0/1455396785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f40106f10 0x7f7f4019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:33.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.800+0000 7f7f3e7fc640 1 -- 172.21.15.27:0/1455396785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f40101de0 msgr2=0x7f7f40198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:33.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.800+0000 7f7f3e7fc640 1 --2- 172.21.15.27:0/1455396785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f40101de0 0x7f7f40198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:33.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.800+0000 7f7f3e7fc640 1 -- 172.21.15.27:0/1455396785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f40106f10 msgr2=0x7f7f4019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:33.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.800+0000 7f7f3e7fc640 1 --2- 172.21.15.27:0/1455396785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f40106f10 0x7f7f4019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:33.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.800+0000 7f7f3e7fc640 1 -- 172.21.15.27:0/1455396785 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4019d310 con 0x7f7f40102790 2024-09-19T08:10:33.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.800+0000 7f7f3effd640 1 --2- 172.21.15.27:0/1455396785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f40101de0 0x7f7f40198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:10:33.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.800+0000 7f7f3e7fc640 1 --2- 172.21.15.27:0/1455396785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f40102790 0x7f7f401988a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7f28006010 tx=0x7f7f280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:33.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.800+0000 7f7f37fff640 1 -- 172.21.15.27:0/1455396785 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2803f030 con 0x7f7f40102790 2024-09-19T08:10:33.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.800+0000 7f7f37fff640 1 -- 172.21.15.27:0/1455396785 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f28003ce0 con 0x7f7f40102790 2024-09-19T08:10:33.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.800+0000 7f7f452b8640 1 -- 172.21.15.27:0/1455396785 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f4019d5a0 con 0x7f7f40102790 2024-09-19T08:10:33.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.800+0000 7f7f37fff640 1 -- 172.21.15.27:0/1455396785 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f28035070 con 0x7f7f40102790 2024-09-19T08:10:33.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.800+0000 7f7f452b8640 1 -- 172.21.15.27:0/1455396785 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f401a4ee0 con 0x7f7f40102790 2024-09-19T08:10:33.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.801+0000 7f7f452b8640 1 -- 172.21.15.27:0/1455396785 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f401032c0 con 0x7f7f40102790 2024-09-19T08:10:33.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.802+0000 7f7f37fff640 1 -- 172.21.15.27:0/1455396785 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7f28042030 con 0x7f7f40102790 2024-09-19T08:10:33.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.803+0000 7f7f37fff640 1 --2- 172.21.15.27:0/1455396785 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7f2c0a32d0 0x7f7f2c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:33.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.803+0000 7f7f3effd640 1 --2- 172.21.15.27:0/1455396785 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7f2c0a32d0 0x7f7f2c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:33.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.803+0000 7f7f37fff640 1 -- 172.21.15.27:0/1455396785 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f7f280efde0 con 0x7f7f40102790 2024-09-19T08:10:33.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.804+0000 7f7f3effd640 1 --2- 172.21.15.27:0/1455396785 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7f2c0a32d0 0x7f7f2c0a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7f3000afb0 tx=0x7f7f3000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:33.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:33.807+0000 7f7f37fff640 1 -- 172.21.15.27:0/1455396785 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7f280bc9d0 con 0x7f7f40102790 2024-09-19T08:10:34.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:34.019+0000 7f7f452b8640 1 -- 172.21.15.27:0/1455396785 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f4010a0f0 con 0x7f7f40102790 2024-09-19T08:10:34.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:34.019+0000 7f7f37fff640 1 -- 172.21.15.27:0/1455396785 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f7f280bc2d0 con 0x7f7f40102790 2024-09-19T08:10:34.021 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:10:34.021 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:10:34.023 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:10:34.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:34.022+0000 7f7f452b8640 1 -- 172.21.15.27:0/1455396785 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7f2c0a32d0 msgr2=0x7f7f2c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:34.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:34.022+0000 7f7f452b8640 1 --2- 172.21.15.27:0/1455396785 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7f2c0a32d0 0x7f7f2c0a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7f3000afb0 tx=0x7f7f3000a2d0 comp rx=0 tx=0).stop 2024-09-19T08:10:34.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:34.022+0000 7f7f452b8640 1 -- 172.21.15.27:0/1455396785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f40102790 msgr2=0x7f7f401988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:34.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:34.022+0000 7f7f452b8640 1 --2- 172.21.15.27:0/1455396785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f40102790 0x7f7f401988a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7f28006010 tx=0x7f7f280042f0 comp rx=0 tx=0).stop 2024-09-19T08:10:34.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:34.022+0000 7f7f452b8640 1 -- 172.21.15.27:0/1455396785 shutdown_connections 2024-09-19T08:10:34.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:34.022+0000 7f7f452b8640 1 --2- 172.21.15.27:0/1455396785 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7f2c0a32d0 0x7f7f2c0a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:34.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:34.022+0000 7f7f452b8640 1 --2- 172.21.15.27:0/1455396785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f40106f10 0x7f7f4019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:34.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:34.022+0000 7f7f452b8640 1 --2- 172.21.15.27:0/1455396785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f40102790 0x7f7f401988a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:34.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:34.022+0000 7f7f452b8640 1 --2- 172.21.15.27:0/1455396785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f40101de0 0x7f7f40198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:34.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:34.022+0000 7f7f452b8640 1 -- 172.21.15.27:0/1455396785 >> 172.21.15.27:0/1455396785 conn(0x7f7f400fd8c0 msgr2=0x7f7f400fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:34.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:34.022+0000 7f7f452b8640 1 -- 172.21.15.27:0/1455396785 shutdown_connections 2024-09-19T08:10:34.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:34.022+0000 7f7f452b8640 1 -- 172.21.15.27:0/1455396785 wait complete. 2024-09-19T08:10:34.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:34 smithi203 ceph-mon[35198]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:34.318 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:34 smithi027 ceph-mon[31209]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:34.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:34 smithi155 ceph-mon[35362]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:34.685 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T08:09:11.930032+0000', 'modified': '2024-09-19T08:09:20.890507+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24482}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24466': {'gid': 24466, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.203:6839/1481040099', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6838', 'nonce': 1481040099}, {'type': 'v1', 'addr': '172.21.15.203:6839', 'nonce': 1481040099}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.155:6839/1929184836', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6838', 'nonce': 1929184836}, {'type': 'v1', 'addr': '172.21.15.155:6839', 'nonce': 1929184836}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24482, 'qdb_cluster': [24482]} 2024-09-19T08:10:34.685 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T08:10:34.685 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T08:10:34.960 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:35.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:35 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1455396785' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:10:35.266 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:35 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1455396785' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:10:35.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.486+0000 7fdf68098640 1 -- 172.21.15.27:0/117549094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf60100e20 msgr2=0x7fdf60101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:35.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.486+0000 7fdf68098640 1 --2- 172.21.15.27:0/117549094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf60100e20 0x7fdf60101200 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdf58009900 tx=0x7fdf5802a480 comp rx=0 tx=0).stop 2024-09-19T08:10:35.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.486+0000 7fdf68098640 1 -- 172.21.15.27:0/117549094 shutdown_connections 2024-09-19T08:10:35.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.486+0000 7fdf68098640 1 --2- 172.21.15.27:0/117549094 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf60102ef0 0x7fdf6010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.486+0000 7fdf68098640 1 --2- 172.21.15.27:0/117549094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf60102570 0x7fdf601029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.486+0000 7fdf68098640 1 --2- 172.21.15.27:0/117549094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf60100e20 0x7fdf60101200 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.486+0000 7fdf68098640 1 -- 172.21.15.27:0/117549094 >> 172.21.15.27:0/117549094 conn(0x7fdf600fc7d0 msgr2=0x7fdf600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:35.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.486+0000 7fdf68098640 1 -- 172.21.15.27:0/117549094 shutdown_connections 2024-09-19T08:10:35.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.486+0000 7fdf68098640 1 -- 172.21.15.27:0/117549094 wait complete. 2024-09-19T08:10:35.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.487+0000 7fdf68098640 1 Processor -- start 2024-09-19T08:10:35.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.487+0000 7fdf68098640 1 -- start start 2024-09-19T08:10:35.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.487+0000 7fdf68098640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf60100e20 0x7fdf60198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:35.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.487+0000 7fdf68098640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf60102570 0x7fdf60198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:35.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.487+0000 7fdf68098640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf60102ef0 0x7fdf6019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:35.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.487+0000 7fdf68098640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fdf60110f80 con 0x7fdf60102ef0 2024-09-19T08:10:35.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.487+0000 7fdf68098640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdf60110e00 con 0x7fdf60100e20 2024-09-19T08:10:35.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.487+0000 7fdf68098640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdf60111100 con 0x7fdf60102570 2024-09-19T08:10:35.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.487+0000 7fdf66635640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf60102ef0 0x7fdf6019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:35.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.487+0000 7fdf66635640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf60102ef0 0x7fdf6019cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60368/0 (socket says 172.21.15.27:60368) 2024-09-19T08:10:35.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.487+0000 7fdf66635640 1 -- 172.21.15.27:0/574618600 learned_addr learned my addr 172.21.15.27:0/574618600 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:35.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.487+0000 7fdf65e34640 1 --2- 172.21.15.27:0/574618600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf60100e20 0x7fdf60198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:35.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.487+0000 7fdf65633640 1 --2- 172.21.15.27:0/574618600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf60102570 0x7fdf60198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:35.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.487+0000 7fdf66635640 1 -- 172.21.15.27:0/574618600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf60102570 msgr2=0x7fdf60198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:35.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.487+0000 7fdf66635640 1 --2- 172.21.15.27:0/574618600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf60102570 0x7fdf60198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.487+0000 7fdf66635640 1 -- 172.21.15.27:0/574618600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf60100e20 msgr2=0x7fdf60198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:35.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.487+0000 7fdf66635640 1 --2- 172.21.15.27:0/574618600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf60100e20 0x7fdf60198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.487+0000 7fdf66635640 1 -- 172.21.15.27:0/574618600 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf6019d4b0 con 0x7fdf60102ef0 2024-09-19T08:10:35.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.487+0000 7fdf65633640 1 --2- 172.21.15.27:0/574618600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf60102570 0x7fdf60198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:10:35.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.488+0000 7fdf66635640 1 --2- 172.21.15.27:0/574618600 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf60102ef0 0x7fdf6019cdd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000d750 tx=0x7fdf5000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:35.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.488+0000 7fdf5effd640 1 -- 172.21.15.27:0/574618600 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50017070 con 0x7fdf60102ef0 2024-09-19T08:10:35.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.488+0000 7fdf5effd640 1 -- 172.21.15.27:0/574618600 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf50005500 con 0x7fdf60102ef0 2024-09-19T08:10:35.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.488+0000 7fdf68098640 1 -- 172.21.15.27:0/574618600 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf6019d7a0 con 0x7fdf60102ef0 2024-09-19T08:10:35.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.488+0000 7fdf5effd640 1 -- 172.21.15.27:0/574618600 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50004d90 con 0x7fdf60102ef0 2024-09-19T08:10:35.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.488+0000 7fdf68098640 1 -- 172.21.15.27:0/574618600 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf601a5080 con 0x7fdf60102ef0 2024-09-19T08:10:35.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.490+0000 7fdf5effd640 1 -- 172.21.15.27:0/574618600 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdf50004f30 con 0x7fdf60102ef0 2024-09-19T08:10:35.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.490+0000 7fdf6a471740 1 Processor -- start 2024-09-19T08:10:35.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.491+0000 7fdf6a471740 1 -- start start 2024-09-19T08:10:35.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.491+0000 7fdf6a471740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eb496738d0 0x55eb49673cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:35.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.491+0000 7fdf6a471740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eb496741f0 0x55eb49682a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:35.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.491+0000 7fdf6a471740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb49682fc0 0x55eb496853b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:35.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.491+0000 7fdf6a471740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55eb495da090 con 0x55eb49682fc0 2024-09-19T08:10:35.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.491+0000 7fdf6a471740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55eb49581a70 con 0x55eb496741f0 2024-09-19T08:10:35.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.491+0000 7fdf6a471740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55eb495d6050 con 0x55eb496738d0 2024-09-19T08:10:35.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.491+0000 7fdf5effd640 1 --2- 172.21.15.27:0/574618600 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fdf480a32d0 0x7fdf480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:35.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.491+0000 7fdf66635640 1 --2- 172.21.15.27:0/574618600 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fdf480a32d0 0x7fdf480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:35.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.491+0000 7fdf65633640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb49682fc0 0x55eb496853b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:35.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.491+0000 7fdf65633640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb49682fc0 0x55eb496853b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60378/0 (socket says 172.21.15.27:60378) 2024-09-19T08:10:35.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.491+0000 7fdf65633640 1 -- 172.21.15.27:0/206229106 learned_addr learned my addr 172.21.15.27:0/206229106 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:35.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.491+0000 7fdf65e34640 1 --2- 172.21.15.27:0/206229106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eb496741f0 0x55eb49682a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:35.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.491+0000 7fdf5effd640 1 -- 172.21.15.27:0/574618600 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fdf500cf510 con 0x7fdf60102ef0 2024-09-19T08:10:35.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.491+0000 7fdf65633640 1 --2- 172.21.15.27:0/206229106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eb496738d0 0x55eb49673cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:35.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.492+0000 7fdf66635640 1 --2- 172.21.15.27:0/574618600 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fdf480a32d0 0x7fdf480a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdf50097e00 tx=0x7fdf50004830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:35.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.492+0000 7fdf65e34640 1 -- 172.21.15.27:0/206229106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eb496738d0 msgr2=0x55eb49673cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:10:35.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.492+0000 7fdf65e34640 1 --2- 172.21.15.27:0/206229106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eb496738d0 0x55eb49673cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.492+0000 7fdf65e34640 1 -- 172.21.15.27:0/206229106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb49682fc0 msgr2=0x55eb496853b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:10:35.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.492+0000 7fdf65e34640 1 --2- 172.21.15.27:0/206229106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb49682fc0 0x55eb496853b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.492+0000 7fdf65e34640 1 -- 172.21.15.27:0/206229106 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb4958e130 con 0x55eb496741f0 2024-09-19T08:10:35.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.492+0000 7fdf65633640 1 --2- 172.21.15.27:0/206229106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb49682fc0 0x55eb496853b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:10:35.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.492+0000 7fdf65e34640 1 --2- 172.21.15.27:0/206229106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eb496741f0 0x55eb49682a80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdf58005940 tx=0x7fdf580040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a2d7d65f852200c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:35.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.492+0000 7fdf47fff640 1 -- 172.21.15.27:0/206229106 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58035030 con 0x55eb496741f0 2024-09-19T08:10:35.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.492+0000 7fdf47fff640 1 -- 172.21.15.27:0/206229106 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf58040070 con 0x55eb496741f0 2024-09-19T08:10:35.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.492+0000 7fdf47fff640 1 -- 172.21.15.27:0/206229106 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58031540 con 0x55eb496741f0 2024-09-19T08:10:35.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.493+0000 7fdf6a471740 1 -- 172.21.15.27:0/206229106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eb496741f0 msgr2=0x55eb49682a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:35.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.493+0000 7fdf6a471740 1 --2- 172.21.15.27:0/206229106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eb496741f0 0x55eb49682a80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdf58005940 tx=0x7fdf580040c0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.493+0000 7fdf6a471740 1 -- 172.21.15.27:0/206229106 shutdown_connections 2024-09-19T08:10:35.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.493+0000 7fdf6a471740 1 --2- 172.21.15.27:0/206229106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb49682fc0 0x55eb496853b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.493+0000 7fdf6a471740 1 --2- 172.21.15.27:0/206229106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eb496741f0 0x55eb49682a80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.493+0000 7fdf6a471740 1 --2- 172.21.15.27:0/206229106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eb496738d0 0x55eb49673cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.493+0000 7fdf6a471740 1 -- 172.21.15.27:0/206229106 >> 172.21.15.27:0/206229106 conn(0x55eb4966ff60 msgr2=0x55eb49670340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:35.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.493+0000 7fdf6a471740 1 -- 172.21.15.27:0/206229106 shutdown_connections 2024-09-19T08:10:35.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.493+0000 7fdf6a471740 1 -- 172.21.15.27:0/206229106 wait complete. 2024-09-19T08:10:35.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.494+0000 7fdf6a471740 1 -- start start 2024-09-19T08:10:35.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.494+0000 7fdf6a471740 1 Processor -- start 2024-09-19T08:10:35.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.494+0000 7fdf6a471740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb496738d0 0x55eb49682910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:35.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.494+0000 7fdf6a471740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eb496741f0 0x55eb4967fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:35.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.494+0000 7fdf6a471740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eb49682fc0 0x55eb496801c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:35.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.494+0000 7fdf6a471740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55eb49685b90 con 0x55eb496738d0 2024-09-19T08:10:35.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.494+0000 7fdf6a471740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55eb49594f20 con 0x55eb49682fc0 2024-09-19T08:10:35.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.494+0000 7fdf6a471740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55eb49685d10 con 0x55eb496741f0 2024-09-19T08:10:35.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.494+0000 7fdf6a471740 10 client.0 _ll_register_callbacks cb 0x55eb4955e030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:10:35.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.494+0000 7fdf65633640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb496738d0 0x55eb49682910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:35.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.494+0000 7fdf65633640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb496738d0 0x55eb49682910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60380/0 (socket says 172.21.15.27:60380) 2024-09-19T08:10:35.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.494+0000 7fdf65633640 1 -- 172.21.15.27:0/3331803128 learned_addr learned my addr 172.21.15.27:0/3331803128 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:35.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.494+0000 7fdf65e34640 1 --2- 172.21.15.27:0/3331803128 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eb496741f0 0x55eb4967fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:35.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.494+0000 7fdf65633640 1 --2- 172.21.15.27:0/3331803128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eb49682fc0 0x55eb496801c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:35.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.495+0000 7fdf65633640 1 -- 172.21.15.27:0/3331803128 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eb496741f0 msgr2=0x55eb4967fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:10:35.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.495+0000 7fdf65633640 1 --2- 172.21.15.27:0/3331803128 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eb496741f0 0x55eb4967fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.495+0000 7fdf65633640 1 -- 172.21.15.27:0/3331803128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eb49682fc0 msgr2=0x55eb496801c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:10:35.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.495+0000 7fdf65633640 1 --2- 172.21.15.27:0/3331803128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eb49682fc0 0x55eb496801c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.495+0000 7fdf65633640 1 -- 172.21.15.27:0/3331803128 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb4934b2b0 con 0x55eb496738d0 2024-09-19T08:10:35.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.495+0000 7fdf65633640 1 --2- 172.21.15.27:0/3331803128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb496738d0 0x55eb49682910 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdf54011660 tx=0x7fdf54016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b525c108aeb6bf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:35.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.495+0000 7fdf457fa640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:10:35.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.495+0000 7fdf457fa640 1 -- 172.21.15.27:0/3331803128 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf540140d0 con 0x55eb496738d0 2024-09-19T08:10:35.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.495+0000 7fdf457fa640 1 -- 172.21.15.27:0/3331803128 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fdf54003970 con 0x55eb496738d0 2024-09-19T08:10:35.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.495+0000 7fdf6a471740 1 -- 172.21.15.27:0/3331803128 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf58040070 con 0x55eb496738d0 2024-09-19T08:10:35.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.495+0000 7fdf457fa640 1 -- 172.21.15.27:0/3331803128 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fdf54029050 con 0x55eb496738d0 2024-09-19T08:10:35.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.495+0000 7fdf6a471740 10 client.14985 fetch_fsmap learned FSMap version 20 2024-09-19T08:10:35.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.495+0000 7fdf6a471740 1 -- 172.21.15.27:0/3331803128 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55eb49691600 con 0x55eb496738d0 2024-09-19T08:10:35.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.495+0000 7fdf457fa640 1 -- 172.21.15.27:0/3331803128 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf58040070 con 0x55eb496738d0 2024-09-19T08:10:35.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.495+0000 7fdf457fa640 1 -- 172.21.15.27:0/3331803128 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fdf54004610 con 0x55eb496738d0 2024-09-19T08:10:35.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.496+0000 7fdf6a471740 10 client.14985 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:10:35.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.496+0000 7fdf6a471740 10 client.14985 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:10:35.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.496+0000 7fdf6a471740 20 client.14985 populate_metadata read hostname 'smithi027' 2024-09-19T08:10:35.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.496+0000 7fdf6a471740 1 --2- 172.21.15.27:0/3331803128 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55eb49693ba0 0x55eb49695010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:35.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.496+0000 7fdf6a471740 4 client.14985 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:10:35.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.496+0000 7fdf6a471740 1 -- 172.21.15.27:0/3331803128 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb495e7600 con 0x55eb49693ba0 2024-09-19T08:10:35.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.496+0000 7fdf65e34640 1 --2- 172.21.15.27:0/3331803128 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55eb49693ba0 0x55eb49695010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:35.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.496+0000 7fdf65e34640 1 --2- 172.21.15.27:0/3331803128 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55eb49693ba0 0x55eb49695010 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adf9e41aa9f83ece server_cookie=2ebc4b3edcefb073 in_seq=0 out_seq=0 2024-09-19T08:10:35.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.496+0000 7fdf457fa640 10 client.14985 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:10:35.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.497+0000 7fdf457fa640 1 -- 172.21.15.27:0/3331803128 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eb495e7600 con 0x55eb49693ba0 2024-09-19T08:10:35.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.497+0000 7fdf457fa640 10 client.14985 handle_command_reply: tid=0 2024-09-19T08:10:35.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.497+0000 7fdf6a471740 1 client.14985 shutdown 2024-09-19T08:10:35.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.497+0000 7fdf6a471740 1 -- 172.21.15.27:0/3331803128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb496738d0 msgr2=0x55eb49682910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:35.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.497+0000 7fdf6a471740 1 --2- 172.21.15.27:0/3331803128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb496738d0 0x55eb49682910 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdf54011660 tx=0x7fdf54016040 comp rx=0 tx=0).stop 2024-09-19T08:10:35.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.498+0000 7fdf6a471740 1 -- 172.21.15.27:0/3331803128 shutdown_connections 2024-09-19T08:10:35.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.498+0000 7fdf6a471740 1 --2- 172.21.15.27:0/3331803128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eb49682fc0 0x55eb496801c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.498+0000 7fdf6a471740 1 --2- 172.21.15.27:0/3331803128 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55eb49693ba0 0x55eb49695010 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.498+0000 7fdf6a471740 1 --2- 172.21.15.27:0/3331803128 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eb496741f0 0x55eb4967fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.498+0000 7fdf6a471740 1 --2- 172.21.15.27:0/3331803128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb496738d0 0x55eb49682910 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.498+0000 7fdf6a471740 1 -- 172.21.15.27:0/3331803128 >> 172.21.15.27:0/3331803128 conn(0x55eb4966ff60 msgr2=0x55eb49675cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:35.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.498+0000 7fdf457fa640 0 client.14985 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:10:35.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.498+0000 7fdf6a471740 1 -- 172.21.15.27:0/3331803128 shutdown_connections 2024-09-19T08:10:35.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.498+0000 7fdf6a471740 1 -- 172.21.15.27:0/3331803128 wait complete. 2024-09-19T08:10:35.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.498+0000 7fdf6a471740 20 client.14985 trim_cache size 0 max 16384 2024-09-19T08:10:35.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:35 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1455396785' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:10:35.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.516+0000 7fdf6a471740 1 Processor -- start 2024-09-19T08:10:35.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.516+0000 7fdf6a471740 1 -- start start 2024-09-19T08:10:35.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.516+0000 7fdf6a471740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb496738d0 0x55eb496934d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:35.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.516+0000 7fdf6a471740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eb496741f0 0x55eb49695010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:35.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.516+0000 7fdf6a471740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eb49682fc0 0x55eb4967f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:35.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.516+0000 7fdf6a471740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55eb49693350 con 0x55eb496738d0 2024-09-19T08:10:35.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.516+0000 7fdf6a471740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55eb49693a20 con 0x55eb49682fc0 2024-09-19T08:10:35.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.516+0000 7fdf6a471740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55eb496940f0 con 0x55eb496741f0 2024-09-19T08:10:35.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.516+0000 7fdf65633640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb496738d0 0x55eb496934d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:35.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.516+0000 7fdf65633640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb496738d0 0x55eb496934d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60388/0 (socket says 172.21.15.27:60388) 2024-09-19T08:10:35.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.516+0000 7fdf65633640 1 -- 172.21.15.27:0/1248779428 learned_addr learned my addr 172.21.15.27:0/1248779428 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:35.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.516+0000 7fdf65e34640 1 --2- 172.21.15.27:0/1248779428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eb496741f0 0x55eb49695010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:35.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.516+0000 7fdf65633640 1 -- 172.21.15.27:0/1248779428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eb496741f0 msgr2=0x55eb49695010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:10:35.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.516+0000 7fdf65633640 1 --2- 172.21.15.27:0/1248779428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eb496741f0 0x55eb49695010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.516+0000 7fdf65633640 1 -- 172.21.15.27:0/1248779428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eb49682fc0 msgr2=0x55eb4967f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:10:35.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.516+0000 7fdf65633640 1 --2- 172.21.15.27:0/1248779428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eb49682fc0 0x55eb4967f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.516+0000 7fdf65633640 1 -- 172.21.15.27:0/1248779428 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb49674020 con 0x55eb496738d0 2024-09-19T08:10:35.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.516+0000 7fdf65633640 1 --2- 172.21.15.27:0/1248779428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb496738d0 0x55eb496934d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdf54002230 tx=0x7fdf54009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51fe1f4cbdac8dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:35.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.517+0000 7fdf477fe640 1 -- 172.21.15.27:0/1248779428 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf540095e0 con 0x55eb496738d0 2024-09-19T08:10:35.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.517+0000 7fdf477fe640 1 -- 172.21.15.27:0/1248779428 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf540140d0 con 0x55eb496738d0 2024-09-19T08:10:35.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.517+0000 7fdf477fe640 1 -- 172.21.15.27:0/1248779428 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5402d430 con 0x55eb496738d0 2024-09-19T08:10:35.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.517+0000 7fdf6a471740 1 -- 172.21.15.27:0/1248779428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb496738d0 msgr2=0x55eb496934d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:35.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.517+0000 7fdf6a471740 1 --2- 172.21.15.27:0/1248779428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb496738d0 0x55eb496934d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdf54002230 tx=0x7fdf54009be0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.517+0000 7fdf6a471740 1 -- 172.21.15.27:0/1248779428 shutdown_connections 2024-09-19T08:10:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.517+0000 7fdf6a471740 1 --2- 172.21.15.27:0/1248779428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eb49682fc0 0x55eb4967f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.517+0000 7fdf6a471740 1 --2- 172.21.15.27:0/1248779428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eb496741f0 0x55eb49695010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.517+0000 7fdf6a471740 1 --2- 172.21.15.27:0/1248779428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb496738d0 0x55eb496934d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.517+0000 7fdf6a471740 1 -- 172.21.15.27:0/1248779428 >> 172.21.15.27:0/1248779428 conn(0x55eb4966ff60 msgr2=0x55eb49670340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.518+0000 7fdf6a471740 1 -- 172.21.15.27:0/1248779428 shutdown_connections 2024-09-19T08:10:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.518+0000 7fdf6a471740 1 -- 172.21.15.27:0/1248779428 wait complete. 2024-09-19T08:10:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.518+0000 7fdf6a471740 1 -- start start 2024-09-19T08:10:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.518+0000 7fdf6a471740 1 Processor -- start 2024-09-19T08:10:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.518+0000 7fdf6a471740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eb496738d0 0x55eb4969bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.518+0000 7fdf6a471740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eb496741f0 0x55eb4969c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.518+0000 7fdf6a471740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb49682fc0 0x55eb4969a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.518+0000 7fdf6a471740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55eb49694e90 con 0x55eb49682fc0 2024-09-19T08:10:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.518+0000 7fdf6a471740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55eb496947c0 con 0x55eb496738d0 2024-09-19T08:10:35.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.518+0000 7fdf6a471740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55eb49695560 con 0x55eb496741f0 2024-09-19T08:10:35.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.519+0000 7fdf6a471740 10 client.0 _ll_register_callbacks cb 0x7fdf540114b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:10:35.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.519+0000 7fdf65633640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb49682fc0 0x55eb4969a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:35.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.519+0000 7fdf65633640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb49682fc0 0x55eb4969a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60390/0 (socket says 172.21.15.27:60390) 2024-09-19T08:10:35.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.519+0000 7fdf65633640 1 -- 172.21.15.27:0/620330675 learned_addr learned my addr 172.21.15.27:0/620330675 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:35.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.519+0000 7fdf65633640 1 --2- 172.21.15.27:0/620330675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eb496738d0 0x55eb4969bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:35.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.519+0000 7fdf65e34640 1 --2- 172.21.15.27:0/620330675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eb496741f0 0x55eb4969c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:35.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.519+0000 7fdf65633640 1 -- 172.21.15.27:0/620330675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eb496741f0 msgr2=0x55eb4969c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:10:35.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.519+0000 7fdf65633640 1 --2- 172.21.15.27:0/620330675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eb496741f0 0x55eb4969c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.519+0000 7fdf65633640 1 -- 172.21.15.27:0/620330675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eb496738d0 msgr2=0x55eb4969bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:10:35.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.519+0000 7fdf65633640 1 --2- 172.21.15.27:0/620330675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eb496738d0 0x55eb4969bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.519+0000 7fdf65633640 1 -- 172.21.15.27:0/620330675 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb4969ddd0 con 0x55eb49682fc0 2024-09-19T08:10:35.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.519+0000 7fdf65633640 1 --2- 172.21.15.27:0/620330675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb49682fc0 0x55eb4969a820 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdf54012010 tx=0x7fdf54011130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89161ea5f24ab82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:35.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.519+0000 7fdf457fa640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:10:35.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.519+0000 7fdf457fa640 1 -- 172.21.15.27:0/620330675 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf540108a0 con 0x55eb49682fc0 2024-09-19T08:10:35.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.519+0000 7fdf457fa640 1 -- 172.21.15.27:0/620330675 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fdf54010bb0 con 0x55eb49682fc0 2024-09-19T08:10:35.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.519+0000 7fdf6a471740 1 -- 172.21.15.27:0/620330675 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf540140d0 con 0x55eb49682fc0 2024-09-19T08:10:35.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.520+0000 7fdf457fa640 1 -- 172.21.15.27:0/620330675 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fdf54010db0 con 0x55eb49682fc0 2024-09-19T08:10:35.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.520+0000 7fdf6a471740 10 client.14991 fetch_fsmap learned FSMap version 20 2024-09-19T08:10:35.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.520+0000 7fdf6a471740 1 -- 172.21.15.27:0/620330675 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55eb49696710 con 0x55eb49682fc0 2024-09-19T08:10:35.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.520+0000 7fdf457fa640 1 -- 172.21.15.27:0/620330675 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf540140d0 con 0x55eb49682fc0 2024-09-19T08:10:35.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.520+0000 7fdf457fa640 1 -- 172.21.15.27:0/620330675 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fdf540123f0 con 0x55eb49682fc0 2024-09-19T08:10:35.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.520+0000 7fdf6a471740 10 client.14991 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:10:35.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.520+0000 7fdf6a471740 10 client.14991 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:10:35.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.520+0000 7fdf6a471740 20 client.14991 populate_metadata read hostname 'smithi027' 2024-09-19T08:10:35.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.520+0000 7fdf6a471740 1 --2- 172.21.15.27:0/620330675 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55eb49701f00 0x55eb49700c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:35.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.520+0000 7fdf6a471740 4 client.14991 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:10:35.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.520+0000 7fdf6a471740 1 -- 172.21.15.27:0/620330675 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "status"}) -- 0x55eb495e1b10 con 0x55eb49701f00 2024-09-19T08:10:35.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.520+0000 7fdf65e34640 1 --2- 172.21.15.27:0/620330675 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55eb49701f00 0x55eb49700c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:35.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.521+0000 7fdf65e34640 1 --2- 172.21.15.27:0/620330675 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55eb49701f00 0x55eb49700c10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c4b2bca8525a37c server_cookie=4e3b11fd5749429f in_seq=0 out_seq=0 2024-09-19T08:10:35.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.521+0000 7fdf457fa640 10 client.14991 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:10:35.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.521+0000 7fdf457fa640 1 -- 172.21.15.27:0/620330675 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55eb495e1b10 con 0x55eb49701f00 2024-09-19T08:10:35.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.521+0000 7fdf457fa640 10 client.14991 handle_command_reply: tid=0 2024-09-19T08:10:35.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.521+0000 7fdf6a471740 1 client.14991 shutdown 2024-09-19T08:10:35.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.521+0000 7fdf6a471740 1 -- 172.21.15.27:0/620330675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb49682fc0 msgr2=0x55eb4969a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:35.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.521+0000 7fdf6a471740 1 --2- 172.21.15.27:0/620330675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb49682fc0 0x55eb4969a820 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdf54012010 tx=0x7fdf54011130 comp rx=0 tx=0).stop 2024-09-19T08:10:35.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.521+0000 7fdf6a471740 1 -- 172.21.15.27:0/620330675 shutdown_connections 2024-09-19T08:10:35.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.521+0000 7fdf6a471740 1 --2- 172.21.15.27:0/620330675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eb49682fc0 0x55eb4969a820 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.521+0000 7fdf6a471740 1 --2- 172.21.15.27:0/620330675 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55eb49701f00 0x55eb49700c10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.521+0000 7fdf6a471740 1 --2- 172.21.15.27:0/620330675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eb496741f0 0x55eb4969c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.521+0000 7fdf6a471740 1 --2- 172.21.15.27:0/620330675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eb496738d0 0x55eb4969bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.521+0000 7fdf457fa640 0 client.14991 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:10:35.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.521+0000 7fdf6a471740 1 -- 172.21.15.27:0/620330675 >> 172.21.15.27:0/620330675 conn(0x55eb4966ff60 msgr2=0x55eb4967aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:35.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.521+0000 7fdf6a471740 1 -- 172.21.15.27:0/620330675 shutdown_connections 2024-09-19T08:10:35.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.521+0000 7fdf6a471740 1 -- 172.21.15.27:0/620330675 wait complete. 2024-09-19T08:10:35.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.522+0000 7fdf6a471740 20 client.14991 trim_cache size 0 max 16384 2024-09-19T08:10:35.527 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:10:35.528 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "35b531b0-765d-11ef-bceb-c7b262605968", 2024-09-19T08:10:35.528 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2024-09-19T08:10:35.528 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 24482, 2024-09-19T08:10:35.528 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2024-09-19T08:10:35.528 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2024-09-19T08:10:35.528 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2024-09-19T08:10:35.528 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 83.262318440000001, 2024-09-19T08:10:35.528 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 20, 2024-09-19T08:10:35.528 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 83, 2024-09-19T08:10:35.528 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T08:10:35.528 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 95.264468187999995 2024-09-19T08:10:35.529 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:10:35.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.522+0000 7fdf68098640 1 -- 172.21.15.27:0/574618600 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fdf480a32d0 msgr2=0x7fdf480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:35.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.522+0000 7fdf68098640 1 --2- 172.21.15.27:0/574618600 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fdf480a32d0 0x7fdf480a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdf50097e00 tx=0x7fdf50004830 comp rx=0 tx=0).stop 2024-09-19T08:10:35.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.522+0000 7fdf68098640 1 -- 172.21.15.27:0/574618600 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf60102ef0 msgr2=0x7fdf6019cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:35.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.522+0000 7fdf68098640 1 --2- 172.21.15.27:0/574618600 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf60102ef0 0x7fdf6019cdd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000d750 tx=0x7fdf5000dc10 comp rx=0 tx=0).stop 2024-09-19T08:10:35.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.522+0000 7fdf68098640 1 -- 172.21.15.27:0/574618600 shutdown_connections 2024-09-19T08:10:35.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.522+0000 7fdf68098640 1 --2- 172.21.15.27:0/574618600 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf60102ef0 0x7fdf6019cdd0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.522+0000 7fdf68098640 1 --2- 172.21.15.27:0/574618600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf60102570 0x7fdf60198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.522+0000 7fdf68098640 1 --2- 172.21.15.27:0/574618600 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fdf480a32d0 0x7fdf480a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.522+0000 7fdf68098640 1 --2- 172.21.15.27:0/574618600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf60100e20 0x7fdf60198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:35.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.522+0000 7fdf68098640 1 -- 172.21.15.27:0/574618600 >> 172.21.15.27:0/574618600 conn(0x7fdf600fc7d0 msgr2=0x7fdf6006a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:35.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.522+0000 7fdf68098640 1 -- 172.21.15.27:0/574618600 shutdown_connections 2024-09-19T08:10:35.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:35.523+0000 7fdf68098640 1 -- 172.21.15.27:0/574618600 wait complete. 2024-09-19T08:10:36.187 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T08:10:36.187 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T08:10:36.197 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi027.front.sepia.ceph.com 2024-09-19T08:10:36.197 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T08:10:36.455 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:36.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:36 smithi155 ceph-mon[35362]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:36.501 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:36 smithi027 ceph-mon[31209]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:36.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:36 smithi203 ceph-mon[35198]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:36.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.953+0000 7f91b6a52640 1 -- 172.21.15.27:0/3573019202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91b01079a0 msgr2=0x7f91b0109d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:36.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.953+0000 7f91b6a52640 1 --2- 172.21.15.27:0/3573019202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91b01079a0 0x7f91b0109d90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009ca0 tx=0x7f91a802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:10:36.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.953+0000 7f91b6a52640 1 -- 172.21.15.27:0/3573019202 shutdown_connections 2024-09-19T08:10:36.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.953+0000 7f91b6a52640 1 --2- 172.21.15.27:0/3573019202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91b01079a0 0x7f91b0109d90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:36.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.953+0000 7f91b6a52640 1 --2- 172.21.15.27:0/3573019202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91b0105070 0x7f91b0107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:36.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.953+0000 7f91b6a52640 1 --2- 172.21.15.27:0/3573019202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b0102740 0x7f91b0104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:36.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.953+0000 7f91b6a52640 1 -- 172.21.15.27:0/3573019202 >> 172.21.15.27:0/3573019202 conn(0x7f91b00fc2a0 msgr2=0x7f91b00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:36.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.953+0000 7f91b6a52640 1 -- 172.21.15.27:0/3573019202 shutdown_connections 2024-09-19T08:10:36.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.954+0000 7f91b6a52640 1 -- 172.21.15.27:0/3573019202 wait complete. 2024-09-19T08:10:36.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.954+0000 7f91b6a52640 1 Processor -- start 2024-09-19T08:10:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.954+0000 7f91b6a52640 1 -- start start 2024-09-19T08:10:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.954+0000 7f91b6a52640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91b0102740 0x7f91b0197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.954+0000 7f91b6a52640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91b0105070 0x7f91b0198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.954+0000 7f91b6a52640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b01079a0 0x7f91b019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.954+0000 7f91b6a52640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f91b010d8c0 con 0x7f91b0102740 2024-09-19T08:10:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.954+0000 7f91b6a52640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f91b010d740 con 0x7f91b01079a0 2024-09-19T08:10:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.954+0000 7f91b6a52640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f91b010da40 con 0x7f91b0105070 2024-09-19T08:10:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.954+0000 7f91affff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91b0102740 0x7f91b0197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.954+0000 7f91affff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91b0102740 0x7f91b0197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60406/0 (socket says 172.21.15.27:60406) 2024-09-19T08:10:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.954+0000 7f91affff640 1 -- 172.21.15.27:0/625793782 learned_addr learned my addr 172.21.15.27:0/625793782 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.955+0000 7f91af7fe640 1 --2- 172.21.15.27:0/625793782 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91b0105070 0x7f91b0198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.955+0000 7f91b4fef640 1 --2- 172.21.15.27:0/625793782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b01079a0 0x7f91b019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.955+0000 7f91affff640 1 -- 172.21.15.27:0/625793782 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91b0105070 msgr2=0x7f91b0198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.955+0000 7f91affff640 1 --2- 172.21.15.27:0/625793782 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91b0105070 0x7f91b0198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.955+0000 7f91affff640 1 -- 172.21.15.27:0/625793782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b01079a0 msgr2=0x7f91b019f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.955+0000 7f91affff640 1 --2- 172.21.15.27:0/625793782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b01079a0 0x7f91b019f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.955+0000 7f91affff640 1 -- 172.21.15.27:0/625793782 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b019faf0 con 0x7f91b0102740 2024-09-19T08:10:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.955+0000 7f91b4fef640 1 --2- 172.21.15.27:0/625793782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b01079a0 0x7f91b019f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:10:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.955+0000 7f91affff640 1 --2- 172.21.15.27:0/625793782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91b0102740 0x7f91b0197ec0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f91a000d950 tx=0x7f91a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.955+0000 7f91ad7fa640 1 -- 172.21.15.27:0/625793782 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0017070 con 0x7f91b0102740 2024-09-19T08:10:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.955+0000 7f91ad7fa640 1 -- 172.21.15.27:0/625793782 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91a0009c30 con 0x7f91b0102740 2024-09-19T08:10:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.955+0000 7f91b6a52640 1 -- 172.21.15.27:0/625793782 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b019fde0 con 0x7f91b0102740 2024-09-19T08:10:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.955+0000 7f91ad7fa640 1 -- 172.21.15.27:0/625793782 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a000f6b0 con 0x7f91b0102740 2024-09-19T08:10:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.955+0000 7f91b6a52640 1 -- 172.21.15.27:0/625793782 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b01a0290 con 0x7f91b0102740 2024-09-19T08:10:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.956+0000 7f91b6a52640 1 -- 172.21.15.27:0/625793782 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b00fdd90 con 0x7f91b0102740 2024-09-19T08:10:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.957+0000 7f91ad7fa640 1 -- 172.21.15.27:0/625793782 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f91a00109d0 con 0x7f91b0102740 2024-09-19T08:10:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.958+0000 7f91ad7fa640 1 --2- 172.21.15.27:0/625793782 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f91980a3380 0x7f91980a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.958+0000 7f91af7fe640 1 --2- 172.21.15.27:0/625793782 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f91980a3380 0x7f91980a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.958+0000 7f91ad7fa640 1 -- 172.21.15.27:0/625793782 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f91a00cf6c0 con 0x7f91b0102740 2024-09-19T08:10:36.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.959+0000 7f91af7fe640 1 --2- 172.21.15.27:0/625793782 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f91980a3380 0x7f91980a5840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f91a4005fd0 tx=0x7f91a4005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:36.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:36.962+0000 7f91ad7fa640 1 -- 172.21.15.27:0/625793782 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f91a009c330 con 0x7f91b0102740 2024-09-19T08:10:37.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:37.154+0000 7f91b6a52640 1 -- 172.21.15.27:0/625793782 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f91b0062630 con 0x7f91980a3380 2024-09-19T08:10:37.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:37.155+0000 7f91ad7fa640 1 -- 172.21.15.27:0/625793782 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f91b0062630 con 0x7f91980a3380 2024-09-19T08:10:37.155 INFO:teuthology.orchestra.run.smithi027.stdout:Backend: cephadm 2024-09-19T08:10:37.156 INFO:teuthology.orchestra.run.smithi027.stdout:Available: Yes 2024-09-19T08:10:37.156 INFO:teuthology.orchestra.run.smithi027.stdout:Paused: No 2024-09-19T08:10:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:37.157+0000 7f91b6a52640 1 -- 172.21.15.27:0/625793782 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f91980a3380 msgr2=0x7f91980a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:37.157+0000 7f91b6a52640 1 --2- 172.21.15.27:0/625793782 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f91980a3380 0x7f91980a5840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f91a4005fd0 tx=0x7f91a4005e20 comp rx=0 tx=0).stop 2024-09-19T08:10:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:37.157+0000 7f91b6a52640 1 -- 172.21.15.27:0/625793782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91b0102740 msgr2=0x7f91b0197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:37.157+0000 7f91b6a52640 1 --2- 172.21.15.27:0/625793782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91b0102740 0x7f91b0197ec0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f91a000d950 tx=0x7f91a000de10 comp rx=0 tx=0).stop 2024-09-19T08:10:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:37.157+0000 7f91b6a52640 1 -- 172.21.15.27:0/625793782 shutdown_connections 2024-09-19T08:10:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:37.157+0000 7f91b6a52640 1 --2- 172.21.15.27:0/625793782 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f91980a3380 0x7f91980a5840 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:37.157+0000 7f91b6a52640 1 --2- 172.21.15.27:0/625793782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b01079a0 0x7f91b019f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:37.157+0000 7f91b6a52640 1 --2- 172.21.15.27:0/625793782 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91b0105070 0x7f91b0198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:37.157+0000 7f91b6a52640 1 --2- 172.21.15.27:0/625793782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91b0102740 0x7f91b0197ec0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:37.157+0000 7f91b6a52640 1 -- 172.21.15.27:0/625793782 >> 172.21.15.27:0/625793782 conn(0x7f91b00fc2a0 msgr2=0x7f91b0103080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:37.157+0000 7f91b6a52640 1 -- 172.21.15.27:0/625793782 shutdown_connections 2024-09-19T08:10:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:37.157+0000 7f91b6a52640 1 -- 172.21.15.27:0/625793782 wait complete. 2024-09-19T08:10:37.864 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T08:10:38.126 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:38.247 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:38 smithi027 ceph-mon[31209]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:38.247 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:38 smithi027 ceph-mon[31209]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:10:38.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:38 smithi155 ceph-mon[35362]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:38.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:38 smithi155 ceph-mon[35362]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:10:38.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:38 smithi203 ceph-mon[35198]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:38.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:38 smithi203 ceph-mon[35198]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:10:38.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.611+0000 7f009341d640 1 -- 172.21.15.27:0/3654589924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f008c101bf0 msgr2=0x7f008c101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:38.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.611+0000 7f009341d640 1 --2- 172.21.15.27:0/3654589924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f008c101bf0 0x7f008c101ff0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0088009900 tx=0x7f008802a410 comp rx=0 tx=0).stop 2024-09-19T08:10:38.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.611+0000 7f009341d640 1 -- 172.21.15.27:0/3654589924 shutdown_connections 2024-09-19T08:10:38.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.611+0000 7f009341d640 1 --2- 172.21.15.27:0/3654589924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f008c1037b0 0x7f008c10a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:38.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.611+0000 7f009341d640 1 --2- 172.21.15.27:0/3654589924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f008c102df0 0x7f008c103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:38.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.611+0000 7f009341d640 1 --2- 172.21.15.27:0/3654589924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f008c101bf0 0x7f008c101ff0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:38.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.611+0000 7f009341d640 1 -- 172.21.15.27:0/3654589924 >> 172.21.15.27:0/3654589924 conn(0x7f008c0fd3c0 msgr2=0x7f008c0ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:38.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.611+0000 7f009341d640 1 -- 172.21.15.27:0/3654589924 shutdown_connections 2024-09-19T08:10:38.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.611+0000 7f009341d640 1 -- 172.21.15.27:0/3654589924 wait complete. 2024-09-19T08:10:38.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.611+0000 7f009341d640 1 Processor -- start 2024-09-19T08:10:38.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.612+0000 7f009341d640 1 -- start start 2024-09-19T08:10:38.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.612+0000 7f009341d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f008c101bf0 0x7f008c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:38.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.612+0000 7f009341d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f008c102df0 0x7f008c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:38.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.612+0000 7f009341d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f008c1037b0 0x7f008c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:38.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.612+0000 7f009341d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f008c10d870 con 0x7f008c102df0 2024-09-19T08:10:38.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.612+0000 7f009341d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f008c10d6f0 con 0x7f008c101bf0 2024-09-19T08:10:38.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.612+0000 7f009341d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f008c10d9f0 con 0x7f008c1037b0 2024-09-19T08:10:38.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.612+0000 7f00909b8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f008c102df0 0x7f008c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:38.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.612+0000 7f00909b8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f008c102df0 0x7f008c0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60428/0 (socket says 172.21.15.27:60428) 2024-09-19T08:10:38.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.612+0000 7f00909b8640 1 -- 172.21.15.27:0/1461710864 learned_addr learned my addr 172.21.15.27:0/1461710864 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:38.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.612+0000 7f00919ba640 1 --2- 172.21.15.27:0/1461710864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f008c1037b0 0x7f008c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:38.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.612+0000 7f00911b9640 1 --2- 172.21.15.27:0/1461710864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f008c101bf0 0x7f008c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:38.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.612+0000 7f00909b8640 1 -- 172.21.15.27:0/1461710864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f008c1037b0 msgr2=0x7f008c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:38.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.612+0000 7f00909b8640 1 --2- 172.21.15.27:0/1461710864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f008c1037b0 0x7f008c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:38.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.612+0000 7f00909b8640 1 -- 172.21.15.27:0/1461710864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f008c101bf0 msgr2=0x7f008c075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:38.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.612+0000 7f00909b8640 1 --2- 172.21.15.27:0/1461710864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f008c101bf0 0x7f008c075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:38.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.612+0000 7f00909b8640 1 -- 172.21.15.27:0/1461710864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008c0753e0 con 0x7f008c102df0 2024-09-19T08:10:38.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.612+0000 7f00919ba640 1 --2- 172.21.15.27:0/1461710864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f008c1037b0 0x7f008c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:10:38.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.612+0000 7f00911b9640 1 --2- 172.21.15.27:0/1461710864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f008c101bf0 0x7f008c075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:10:38.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.612+0000 7f00909b8640 1 --2- 172.21.15.27:0/1461710864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f008c102df0 0x7f008c0745e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f008000d770 tx=0x7f008000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:38.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.613+0000 7f007e7fc640 1 -- 172.21.15.27:0/1461710864 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0080017070 con 0x7f008c102df0 2024-09-19T08:10:38.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.613+0000 7f007e7fc640 1 -- 172.21.15.27:0/1461710864 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0080005500 con 0x7f008c102df0 2024-09-19T08:10:38.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.613+0000 7f007e7fc640 1 -- 172.21.15.27:0/1461710864 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0080004e00 con 0x7f008c102df0 2024-09-19T08:10:38.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.613+0000 7f009341d640 1 -- 172.21.15.27:0/1461710864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f008c1a1fa0 con 0x7f008c102df0 2024-09-19T08:10:38.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.613+0000 7f009341d640 1 -- 172.21.15.27:0/1461710864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f008c1a2450 con 0x7f008c102df0 2024-09-19T08:10:38.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.614+0000 7f009341d640 1 -- 172.21.15.27:0/1461710864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f008c108fa0 con 0x7f008c102df0 2024-09-19T08:10:38.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.615+0000 7f007e7fc640 1 -- 172.21.15.27:0/1461710864 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0080004fa0 con 0x7f008c102df0 2024-09-19T08:10:38.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.615+0000 7f007e7fc640 1 --2- 172.21.15.27:0/1461710864 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f00780a3350 0x7f00780a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:38.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.616+0000 7f00911b9640 1 --2- 172.21.15.27:0/1461710864 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f00780a3350 0x7f00780a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:38.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.616+0000 7f007e7fc640 1 -- 172.21.15.27:0/1461710864 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f00800cf4f0 con 0x7f008c102df0 2024-09-19T08:10:38.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.616+0000 7f00911b9640 1 --2- 172.21.15.27:0/1461710864 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f00780a3350 0x7f00780a5810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0088006010 tx=0x7f0088032dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:38.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.620+0000 7f007e7fc640 1 -- 172.21.15.27:0/1461710864 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f008009c0e0 con 0x7f008c102df0 2024-09-19T08:10:38.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.806+0000 7f009341d640 1 -- 172.21.15.27:0/1461710864 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f008c062630 con 0x7f00780a3350 2024-09-19T08:10:38.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.819+0000 7f007e7fc640 1 -- 172.21.15.27:0/1461710864 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f008c062630 con 0x7f00780a3350 2024-09-19T08:10:38.819 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T08:10:38.819 INFO:teuthology.orchestra.run.smithi027.stdout:mds.a smithi027 running (102s) 24s ago 101s 15.8M - 19.1.1-361-g2f599a46 d2baa855c067 edf337402a2a 2024-09-19T08:10:38.819 INFO:teuthology.orchestra.run.smithi027.stdout:mds.b smithi155 running (98s) 32s ago 98s 26.2M - 19.1.1-361-g2f599a46 d2baa855c067 ff521ea2d664 2024-09-19T08:10:38.820 INFO:teuthology.orchestra.run.smithi027.stdout:mds.c smithi203 running (114s) 32s ago 113s 14.1M - 19.1.1-361-g2f599a46 d2baa855c067 710f87852e90 2024-09-19T08:10:38.820 INFO:teuthology.orchestra.run.smithi027.stdout:mds.d smithi027 running (2m) 24s ago 2m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 42fc02a85573 2024-09-19T08:10:38.820 INFO:teuthology.orchestra.run.smithi027.stdout:mds.e smithi155 running (119s) 32s ago 119s 14.1M - 19.1.1-361-g2f599a46 d2baa855c067 c5f73582f5f3 2024-09-19T08:10:38.820 INFO:teuthology.orchestra.run.smithi027.stdout:mds.f smithi203 running (116s) 32s ago 116s 14.0M - 19.1.1-361-g2f599a46 d2baa855c067 68d83f6463ba 2024-09-19T08:10:38.820 INFO:teuthology.orchestra.run.smithi027.stdout:mds.g smithi027 running (105s) 24s ago 104s 13.4M - 19.1.1-361-g2f599a46 d2baa855c067 8cfeaa3e68e8 2024-09-19T08:10:38.820 INFO:teuthology.orchestra.run.smithi027.stdout:mds.h smithi155 running (111s) 32s ago 111s 16.5M - 19.1.1-361-g2f599a46 d2baa855c067 ef634561e67b 2024-09-19T08:10:38.820 INFO:teuthology.orchestra.run.smithi027.stdout:mds.i smithi203 running (108s) 32s ago 108s 18.0M - 19.1.1-361-g2f599a46 d2baa855c067 8ad256707352 2024-09-19T08:10:38.820 INFO:teuthology.orchestra.run.smithi027.stdout:mds.j smithi027 running (2m) 24s ago 2m 14.5M - 19.1.1-361-g2f599a46 d2baa855c067 b10afa03a215 2024-09-19T08:10:38.820 INFO:teuthology.orchestra.run.smithi027.stdout:mds.k smithi155 running (2m) 32s ago 2m 13.6M - 19.1.1-361-g2f599a46 d2baa855c067 bb25850358b3 2024-09-19T08:10:38.820 INFO:teuthology.orchestra.run.smithi027.stdout:mds.l smithi203 running (2m) 32s ago 2m 14.5M - 19.1.1-361-g2f599a46 d2baa855c067 effc17931e78 2024-09-19T08:10:38.820 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.x smithi027 *:9283,8765 running (9m) 24s ago 9m 508M - 19.1.1-361-g2f599a46 d2baa855c067 868aa2f80ed4 2024-09-19T08:10:38.820 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.y smithi155 *:8443,8765 running (7m) 32s ago 7m 444M - 19.1.1-361-g2f599a46 d2baa855c067 fdcbf3cd4456 2024-09-19T08:10:38.820 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.z smithi203 *:8443,8765 running (7m) 32s ago 7m 443M - 19.1.1-361-g2f599a46 d2baa855c067 8ba3e5d00917 2024-09-19T08:10:38.820 INFO:teuthology.orchestra.run.smithi027.stdout:mon.a smithi027 running (9m) 24s ago 9m 50.3M 2048M 19.1.1-361-g2f599a46 d2baa855c067 e1632427225e 2024-09-19T08:10:38.821 INFO:teuthology.orchestra.run.smithi027.stdout:mon.b smithi155 running (7m) 32s ago 7m 42.8M 2048M 19.1.1-361-g2f599a46 d2baa855c067 5eee4da52791 2024-09-19T08:10:38.821 INFO:teuthology.orchestra.run.smithi027.stdout:mon.c smithi203 running (7m) 32s ago 7m 42.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 0541a1fc7087 2024-09-19T08:10:38.821 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (7m) 24s ago 7m 45.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 70bab8b2a5bc 2024-09-19T08:10:38.821 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi155 running (6m) 32s ago 6m 45.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 143b21f5c7db 2024-09-19T08:10:38.821 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi203 running (6m) 32s ago 6m 48.8M 4272M 19.1.1-361-g2f599a46 d2baa855c067 d46f3b451cb0 2024-09-19T08:10:38.821 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi027 running (5m) 24s ago 5m 57.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 aa09c0a764dd 2024-09-19T08:10:38.821 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi155 running (5m) 32s ago 5m 51.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 a245360cc30d 2024-09-19T08:10:38.821 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi203 running (5m) 32s ago 5m 57.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 d0732610ef17 2024-09-19T08:10:38.821 INFO:teuthology.orchestra.run.smithi027.stdout:osd.6 smithi027 running (4m) 24s ago 4m 41.6M 4272M 19.1.1-361-g2f599a46 d2baa855c067 b646494ce1c4 2024-09-19T08:10:38.821 INFO:teuthology.orchestra.run.smithi027.stdout:osd.7 smithi155 running (4m) 32s ago 4m 44.6M 4272M 19.1.1-361-g2f599a46 d2baa855c067 e56de711f44c 2024-09-19T08:10:38.821 INFO:teuthology.orchestra.run.smithi027.stdout:osd.8 smithi203 running (3m) 32s ago 3m 55.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 4ab27f123912 2024-09-19T08:10:38.821 INFO:teuthology.orchestra.run.smithi027.stdout:osd.9 smithi027 running (3m) 24s ago 3m 42.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 f76a870aed4e 2024-09-19T08:10:38.821 INFO:teuthology.orchestra.run.smithi027.stdout:osd.10 smithi155 running (2m) 32s ago 2m 43.1M 4272M 19.1.1-361-g2f599a46 d2baa855c067 47ece2f80cf2 2024-09-19T08:10:38.822 INFO:teuthology.orchestra.run.smithi027.stdout:osd.11 smithi203 running (2m) 32s ago 2m 51.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 446652cf3975 2024-09-19T08:10:38.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.821+0000 7f009341d640 1 -- 172.21.15.27:0/1461710864 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f00780a3350 msgr2=0x7f00780a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:38.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.821+0000 7f009341d640 1 --2- 172.21.15.27:0/1461710864 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f00780a3350 0x7f00780a5810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0088006010 tx=0x7f0088032dd0 comp rx=0 tx=0).stop 2024-09-19T08:10:38.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.821+0000 7f009341d640 1 -- 172.21.15.27:0/1461710864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f008c102df0 msgr2=0x7f008c0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:38.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.821+0000 7f009341d640 1 --2- 172.21.15.27:0/1461710864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f008c102df0 0x7f008c0745e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f008000d770 tx=0x7f008000dc30 comp rx=0 tx=0).stop 2024-09-19T08:10:38.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.821+0000 7f009341d640 1 -- 172.21.15.27:0/1461710864 shutdown_connections 2024-09-19T08:10:38.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.821+0000 7f009341d640 1 --2- 172.21.15.27:0/1461710864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f008c1037b0 0x7f008c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:38.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.821+0000 7f009341d640 1 --2- 172.21.15.27:0/1461710864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f008c102df0 0x7f008c0745e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:38.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.821+0000 7f009341d640 1 --2- 172.21.15.27:0/1461710864 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f00780a3350 0x7f00780a5810 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:38.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.821+0000 7f009341d640 1 --2- 172.21.15.27:0/1461710864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f008c101bf0 0x7f008c075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:38.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.821+0000 7f009341d640 1 -- 172.21.15.27:0/1461710864 >> 172.21.15.27:0/1461710864 conn(0x7f008c0fd3c0 msgr2=0x7f008c106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:38.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.821+0000 7f009341d640 1 -- 172.21.15.27:0/1461710864 shutdown_connections 2024-09-19T08:10:38.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:38.821+0000 7f009341d640 1 -- 172.21.15.27:0/1461710864 wait complete. 2024-09-19T08:10:39.192 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:39 smithi027 ceph-mon[31209]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:10:39.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:39 smithi155 ceph-mon[35362]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:10:39.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:39 smithi203 ceph-mon[35198]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:10:39.551 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T08:10:39.813 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:40.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:40 smithi027 ceph-mon[31209]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:40.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.374+0000 7f1531e3e640 1 -- 172.21.15.27:0/3422620356 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f152c101d10 msgr2=0x7f152c102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:40.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.374+0000 7f1531e3e640 1 --2- 172.21.15.27:0/3422620356 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f152c101d10 0x7f152c102190 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1520009900 tx=0x7f152002a410 comp rx=0 tx=0).stop 2024-09-19T08:10:40.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.374+0000 7f1531e3e640 1 -- 172.21.15.27:0/3422620356 shutdown_connections 2024-09-19T08:10:40.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.374+0000 7f1531e3e640 1 --2- 172.21.15.27:0/3422620356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f152c1026d0 0x7f152c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:40.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.374+0000 7f1531e3e640 1 --2- 172.21.15.27:0/3422620356 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f152c101d10 0x7f152c102190 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.374+0000 7f1531e3e640 1 --2- 172.21.15.27:0/3422620356 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f152c100b10 0x7f152c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.374+0000 7f1531e3e640 1 -- 172.21.15.27:0/3422620356 >> 172.21.15.27:0/3422620356 conn(0x7f152c0fc2a0 msgr2=0x7f152c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.374+0000 7f1531e3e640 1 -- 172.21.15.27:0/3422620356 shutdown_connections 2024-09-19T08:10:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.374+0000 7f1531e3e640 1 -- 172.21.15.27:0/3422620356 wait complete. 2024-09-19T08:10:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.374+0000 7f1531e3e640 1 Processor -- start 2024-09-19T08:10:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.375+0000 7f1531e3e640 1 -- start start 2024-09-19T08:10:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.375+0000 7f1531e3e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f152c100b10 0x7f152c06b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.375+0000 7f1531e3e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f152c101d10 0x7f152c19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.375+0000 7f1531e3e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f152c1026d0 0x7f152c19f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.375+0000 7f1531e3e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f152c10c810 con 0x7f152c100b10 2024-09-19T08:10:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.375+0000 7f1531e3e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f152c10c690 con 0x7f152c1026d0 2024-09-19T08:10:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.375+0000 7f1531e3e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f152c10c990 con 0x7f152c101d10 2024-09-19T08:10:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.375+0000 7f152b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f152c100b10 0x7f152c06b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.375+0000 7f152b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f152c100b10 0x7f152c06b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44358/0 (socket says 172.21.15.27:44358) 2024-09-19T08:10:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.375+0000 7f152b7fe640 1 -- 172.21.15.27:0/3344538437 learned_addr learned my addr 172.21.15.27:0/3344538437 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.375+0000 7f152affd640 1 --2- 172.21.15.27:0/3344538437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f152c101d10 0x7f152c19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.375+0000 7f152bfff640 1 --2- 172.21.15.27:0/3344538437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f152c1026d0 0x7f152c19f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.375+0000 7f152b7fe640 1 -- 172.21.15.27:0/3344538437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f152c101d10 msgr2=0x7f152c19ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.375+0000 7f152b7fe640 1 --2- 172.21.15.27:0/3344538437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f152c101d10 0x7f152c19ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.375+0000 7f152b7fe640 1 -- 172.21.15.27:0/3344538437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f152c1026d0 msgr2=0x7f152c19f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.375+0000 7f152b7fe640 1 --2- 172.21.15.27:0/3344538437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f152c1026d0 0x7f152c19f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.375+0000 7f152b7fe640 1 -- 172.21.15.27:0/3344538437 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152c19fbc0 con 0x7f152c100b10 2024-09-19T08:10:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.375+0000 7f152bfff640 1 --2- 172.21.15.27:0/3344538437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f152c1026d0 0x7f152c19f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:10:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.375+0000 7f152b7fe640 1 --2- 172.21.15.27:0/3344538437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f152c100b10 0x7f152c06b330 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f151c00eaa0 tx=0x7f151c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.376+0000 7f1528ff9640 1 -- 172.21.15.27:0/3344538437 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151c016070 con 0x7f152c100b10 2024-09-19T08:10:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.376+0000 7f1528ff9640 1 -- 172.21.15.27:0/3344538437 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f151c003e50 con 0x7f152c100b10 2024-09-19T08:10:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.376+0000 7f1528ff9640 1 -- 172.21.15.27:0/3344538437 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151c0116d0 con 0x7f152c100b10 2024-09-19T08:10:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.376+0000 7f1531e3e640 1 -- 172.21.15.27:0/3344538437 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f152c19feb0 con 0x7f152c100b10 2024-09-19T08:10:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.376+0000 7f1531e3e640 1 -- 172.21.15.27:0/3344538437 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f152c1a0330 con 0x7f152c100b10 2024-09-19T08:10:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.377+0000 7f1531e3e640 1 -- 172.21.15.27:0/3344538437 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f152c107ee0 con 0x7f152c100b10 2024-09-19T08:10:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.378+0000 7f1528ff9640 1 -- 172.21.15.27:0/3344538437 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f151c019070 con 0x7f152c100b10 2024-09-19T08:10:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.379+0000 7f1528ff9640 1 --2- 172.21.15.27:0/3344538437 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f15140a3350 0x7f15140a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.379+0000 7f152affd640 1 --2- 172.21.15.27:0/3344538437 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f15140a3350 0x7f15140a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.379+0000 7f1528ff9640 1 -- 172.21.15.27:0/3344538437 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f151c0cfe90 con 0x7f152c100b10 2024-09-19T08:10:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.379+0000 7f152affd640 1 --2- 172.21.15.27:0/3344538437 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f15140a3350 0x7f15140a5810 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f15200314e0 tx=0x7f1520000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.382+0000 7f1528ff9640 1 -- 172.21.15.27:0/3344538437 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f151c09cb00 con 0x7f152c100b10 2024-09-19T08:10:40.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:40 smithi155 ceph-mon[35362]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:40.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:40 smithi203 ceph-mon[35198]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:40.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.568+0000 7f1531e3e640 1 -- 172.21.15.27:0/3344538437 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f152c062630 con 0x7f15140a3350 2024-09-19T08:10:40.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.574+0000 7f1528ff9640 1 -- 172.21.15.27:0/3344538437 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f152c062630 con 0x7f15140a3350 2024-09-19T08:10:40.575 INFO:teuthology.orchestra.run.smithi027.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T08:10:40.575 INFO:teuthology.orchestra.run.smithi027.stdout:mds.all 12/12 34s ago 2m smithi027=a;smithi027=d;smithi027=g;smithi027=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l;count:12 2024-09-19T08:10:40.575 INFO:teuthology.orchestra.run.smithi027.stdout:mgr 3/3 34s ago 7m smithi027=x;smithi155=y;smithi203=z;count:3 2024-09-19T08:10:40.575 INFO:teuthology.orchestra.run.smithi027.stdout:mon 3/3 34s ago 7m smithi027:172.21.15.27=a;smithi155:172.21.15.155=b;smithi203:172.21.15.203=c;count:3 2024-09-19T08:10:40.575 INFO:teuthology.orchestra.run.smithi027.stdout:osd 12 34s ago - 2024-09-19T08:10:40.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.577+0000 7f1531e3e640 1 -- 172.21.15.27:0/3344538437 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f15140a3350 msgr2=0x7f15140a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:40.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.577+0000 7f1531e3e640 1 --2- 172.21.15.27:0/3344538437 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f15140a3350 0x7f15140a5810 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f15200314e0 tx=0x7f1520000bc0 comp rx=0 tx=0).stop 2024-09-19T08:10:40.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.577+0000 7f1531e3e640 1 -- 172.21.15.27:0/3344538437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f152c100b10 msgr2=0x7f152c06b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:40.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.577+0000 7f1531e3e640 1 --2- 172.21.15.27:0/3344538437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f152c100b10 0x7f152c06b330 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f151c00eaa0 tx=0x7f151c00ef60 comp rx=0 tx=0).stop 2024-09-19T08:10:40.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.577+0000 7f1531e3e640 1 -- 172.21.15.27:0/3344538437 shutdown_connections 2024-09-19T08:10:40.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.577+0000 7f1531e3e640 1 --2- 172.21.15.27:0/3344538437 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f15140a3350 0x7f15140a5810 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:40.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.577+0000 7f1531e3e640 1 --2- 172.21.15.27:0/3344538437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f152c1026d0 0x7f152c19f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:40.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.577+0000 7f1531e3e640 1 --2- 172.21.15.27:0/3344538437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f152c101d10 0x7f152c19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:40.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.577+0000 7f1531e3e640 1 --2- 172.21.15.27:0/3344538437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f152c100b10 0x7f152c06b330 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:40.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.577+0000 7f1531e3e640 1 -- 172.21.15.27:0/3344538437 >> 172.21.15.27:0/3344538437 conn(0x7f152c0fc2a0 msgr2=0x7f152c1050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:40.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.577+0000 7f1531e3e640 1 -- 172.21.15.27:0/3344538437 shutdown_connections 2024-09-19T08:10:40.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:40.577+0000 7f1531e3e640 1 -- 172.21.15.27:0/3344538437 wait complete. 2024-09-19T08:10:41.223 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T08:10:41.479 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:41.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:41 smithi155 ceph-mon[35362]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:10:41.501 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:41 smithi027 ceph-mon[31209]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:10:41.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:41 smithi203 ceph-mon[35198]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:10:41.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.957+0000 7f0f1a04d640 1 -- 172.21.15.27:0/2915889304 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f14102740 msgr2=0x7f0f14104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:41.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.957+0000 7f0f1a04d640 1 --2- 172.21.15.27:0/2915889304 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f14102740 0x7f0f14104b30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009900 tx=0x7f0f0402a410 comp rx=0 tx=0).stop 2024-09-19T08:10:41.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.957+0000 7f0f1a04d640 1 -- 172.21.15.27:0/2915889304 shutdown_connections 2024-09-19T08:10:41.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.957+0000 7f0f1a04d640 1 --2- 172.21.15.27:0/2915889304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f141079a0 0x7f0f14109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:41.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.957+0000 7f0f1a04d640 1 --2- 172.21.15.27:0/2915889304 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f14105070 0x7f0f14107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:41.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.957+0000 7f0f1a04d640 1 --2- 172.21.15.27:0/2915889304 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f14102740 0x7f0f14104b30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:41.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.957+0000 7f0f1a04d640 1 -- 172.21.15.27:0/2915889304 >> 172.21.15.27:0/2915889304 conn(0x7f0f140fc2a0 msgr2=0x7f0f140fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:41.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.957+0000 7f0f1a04d640 1 -- 172.21.15.27:0/2915889304 shutdown_connections 2024-09-19T08:10:41.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.957+0000 7f0f1a04d640 1 -- 172.21.15.27:0/2915889304 wait complete. 2024-09-19T08:10:41.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.958+0000 7f0f1a04d640 1 Processor -- start 2024-09-19T08:10:41.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.958+0000 7f0f1a04d640 1 -- start start 2024-09-19T08:10:41.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.958+0000 7f0f1a04d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f14102740 0x7f0f14197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:41.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.958+0000 7f0f1a04d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f14105070 0x7f0f141983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:41.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.958+0000 7f0f1a04d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f141079a0 0x7f0f1419f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:41.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.958+0000 7f0f1a04d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1410d8a0 con 0x7f0f14105070 2024-09-19T08:10:41.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.958+0000 7f0f1a04d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1410d720 con 0x7f0f141079a0 2024-09-19T08:10:41.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.958+0000 7f0f1a04d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1410da20 con 0x7f0f14102740 2024-09-19T08:10:41.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.958+0000 7f0f12ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f14105070 0x7f0f141983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:41.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.958+0000 7f0f12ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f14105070 0x7f0f141983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44378/0 (socket says 172.21.15.27:44378) 2024-09-19T08:10:41.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.958+0000 7f0f12ffd640 1 -- 172.21.15.27:0/3650488893 learned_addr learned my addr 172.21.15.27:0/3650488893 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:41.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.958+0000 7f0f13fff640 1 --2- 172.21.15.27:0/3650488893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f141079a0 0x7f0f1419f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:41.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.958+0000 7f0f137fe640 1 --2- 172.21.15.27:0/3650488893 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f14102740 0x7f0f14197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:41.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.958+0000 7f0f12ffd640 1 -- 172.21.15.27:0/3650488893 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f14102740 msgr2=0x7f0f14197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:41.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.959+0000 7f0f12ffd640 1 --2- 172.21.15.27:0/3650488893 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f14102740 0x7f0f14197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:41.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.959+0000 7f0f12ffd640 1 -- 172.21.15.27:0/3650488893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f141079a0 msgr2=0x7f0f1419f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:41.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.959+0000 7f0f12ffd640 1 --2- 172.21.15.27:0/3650488893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f141079a0 0x7f0f1419f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:41.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.959+0000 7f0f12ffd640 1 -- 172.21.15.27:0/3650488893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1419fab0 con 0x7f0f14105070 2024-09-19T08:10:41.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.959+0000 7f0f13fff640 1 --2- 172.21.15.27:0/3650488893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f141079a0 0x7f0f1419f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:10:41.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.959+0000 7f0f12ffd640 1 --2- 172.21.15.27:0/3650488893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f14105070 0x7f0f141983c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800c970 tx=0x7f0f0800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:41.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.959+0000 7f0f10ff9640 1 -- 172.21.15.27:0/3650488893 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f08014070 con 0x7f0f14105070 2024-09-19T08:10:41.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.959+0000 7f0f10ff9640 1 -- 172.21.15.27:0/3650488893 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f08004440 con 0x7f0f14105070 2024-09-19T08:10:41.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.959+0000 7f0f1a04d640 1 -- 172.21.15.27:0/3650488893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1419fda0 con 0x7f0f14105070 2024-09-19T08:10:41.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.959+0000 7f0f10ff9640 1 -- 172.21.15.27:0/3650488893 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0800f450 con 0x7f0f14105070 2024-09-19T08:10:41.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.959+0000 7f0f1a04d640 1 -- 172.21.15.27:0/3650488893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f141a0250 con 0x7f0f14105070 2024-09-19T08:10:41.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.960+0000 7f0f1a04d640 1 -- 172.21.15.27:0/3650488893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f140fdd90 con 0x7f0f14105070 2024-09-19T08:10:41.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.961+0000 7f0f10ff9640 1 -- 172.21.15.27:0/3650488893 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0f08017070 con 0x7f0f14105070 2024-09-19T08:10:41.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.962+0000 7f0f10ff9640 1 --2- 172.21.15.27:0/3650488893 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f0efc0a3300 0x7f0efc0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:41.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.962+0000 7f0f137fe640 1 --2- 172.21.15.27:0/3650488893 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f0efc0a3300 0x7f0efc0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:41.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.962+0000 7f0f10ff9640 1 -- 172.21.15.27:0/3650488893 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f0f080cf650 con 0x7f0f14105070 2024-09-19T08:10:41.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.962+0000 7f0f137fe640 1 --2- 172.21.15.27:0/3650488893 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f0efc0a3300 0x7f0efc0a57c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0f04031610 tx=0x7f0f04000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:41.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:41.966+0000 7f0f10ff9640 1 -- 172.21.15.27:0/3650488893 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0f0801e030 con 0x7f0f14105070 2024-09-19T08:10:42.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:42.147+0000 7f0f1a04d640 1 -- 172.21.15.27:0/3650488893 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f0f14062630 con 0x7f0efc0a3300 2024-09-19T08:10:42.148 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:42 smithi027 ceph-mon[31209]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:42.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:42.149+0000 7f0f10ff9640 1 -- 172.21.15.27:0/3650488893 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f0f14062630 con 0x7f0efc0a3300 2024-09-19T08:10:42.149 INFO:teuthology.orchestra.run.smithi027.stdout:HOST ADDR LABELS STATUS 2024-09-19T08:10:42.149 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027 172.21.15.27 2024-09-19T08:10:42.149 INFO:teuthology.orchestra.run.smithi027.stdout:smithi155 172.21.15.155 2024-09-19T08:10:42.149 INFO:teuthology.orchestra.run.smithi027.stdout:smithi203 172.21.15.203 2024-09-19T08:10:42.149 INFO:teuthology.orchestra.run.smithi027.stdout:3 hosts in cluster 2024-09-19T08:10:42.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:42.151+0000 7f0f1a04d640 1 -- 172.21.15.27:0/3650488893 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f0efc0a3300 msgr2=0x7f0efc0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:42.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:42.151+0000 7f0f1a04d640 1 --2- 172.21.15.27:0/3650488893 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f0efc0a3300 0x7f0efc0a57c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0f04031610 tx=0x7f0f04000bc0 comp rx=0 tx=0).stop 2024-09-19T08:10:42.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:42.151+0000 7f0f1a04d640 1 -- 172.21.15.27:0/3650488893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f14105070 msgr2=0x7f0f141983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:42.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:42.151+0000 7f0f1a04d640 1 --2- 172.21.15.27:0/3650488893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f14105070 0x7f0f141983c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800c970 tx=0x7f0f0800ce30 comp rx=0 tx=0).stop 2024-09-19T08:10:42.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:42.151+0000 7f0f1a04d640 1 -- 172.21.15.27:0/3650488893 shutdown_connections 2024-09-19T08:10:42.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:42.151+0000 7f0f1a04d640 1 --2- 172.21.15.27:0/3650488893 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f0efc0a3300 0x7f0efc0a57c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:42.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:42.151+0000 7f0f1a04d640 1 --2- 172.21.15.27:0/3650488893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f141079a0 0x7f0f1419f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:42.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:42.151+0000 7f0f1a04d640 1 --2- 172.21.15.27:0/3650488893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f14105070 0x7f0f141983c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:42.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:42.151+0000 7f0f1a04d640 1 --2- 172.21.15.27:0/3650488893 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f14102740 0x7f0f14197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:42.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:42.151+0000 7f0f1a04d640 1 -- 172.21.15.27:0/3650488893 >> 172.21.15.27:0/3650488893 conn(0x7f0f140fc2a0 msgr2=0x7f0f14103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:42.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:42.151+0000 7f0f1a04d640 1 -- 172.21.15.27:0/3650488893 shutdown_connections 2024-09-19T08:10:42.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:42.151+0000 7f0f1a04d640 1 -- 172.21.15.27:0/3650488893 wait complete. 2024-09-19T08:10:42.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:42 smithi155 ceph-mon[35362]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:42.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:42 smithi203 ceph-mon[35198]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:10:42.973 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T08:10:43.233 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:43.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:43 smithi027 ceph-mon[31209]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:10:43.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:43 smithi155 ceph-mon[35362]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:10:43.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:43 smithi203 ceph-mon[35198]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:10:43.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.725+0000 7fe6d2275640 1 -- 172.21.15.27:0/409096678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6cc101030 msgr2=0x7fe6cc101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:43.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.725+0000 7fe6d2275640 1 --2- 172.21.15.27:0/409096678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6cc101030 0x7fe6cc101430 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009900 tx=0x7fe6bc02a410 comp rx=0 tx=0).stop 2024-09-19T08:10:43.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.725+0000 7fe6d2275640 1 -- 172.21.15.27:0/409096678 shutdown_connections 2024-09-19T08:10:43.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.725+0000 7fe6d2275640 1 --2- 172.21.15.27:0/409096678 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6cc102710 0x7fe6cc108fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:43.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.725+0000 7fe6d2275640 1 --2- 172.21.15.27:0/409096678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6cc101d50 0x7fe6cc1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:43.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.725+0000 7fe6d2275640 1 --2- 172.21.15.27:0/409096678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6cc101030 0x7fe6cc101430 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:43.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.725+0000 7fe6d2275640 1 -- 172.21.15.27:0/409096678 >> 172.21.15.27:0/409096678 conn(0x7fe6cc0fba40 msgr2=0x7fe6cc0fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:43.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.725+0000 7fe6d2275640 1 -- 172.21.15.27:0/409096678 shutdown_connections 2024-09-19T08:10:43.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.725+0000 7fe6d2275640 1 -- 172.21.15.27:0/409096678 wait complete. 2024-09-19T08:10:43.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.726+0000 7fe6d2275640 1 Processor -- start 2024-09-19T08:10:43.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.726+0000 7fe6d2275640 1 -- start start 2024-09-19T08:10:43.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.726+0000 7fe6d2275640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6cc101030 0x7fe6cc198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:43.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.726+0000 7fe6d2275640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6cc101d50 0x7fe6cc198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:43.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.726+0000 7fe6d2275640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6cc102710 0x7fe6cc19f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:43.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.726+0000 7fe6d2275640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe6cc10c880 con 0x7fe6cc101030 2024-09-19T08:10:43.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.726+0000 7fe6d2275640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe6cc10c700 con 0x7fe6cc102710 2024-09-19T08:10:43.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.726+0000 7fe6d2275640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe6cc10ca00 con 0x7fe6cc101d50 2024-09-19T08:10:43.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.726+0000 7fe6cbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6cc101030 0x7fe6cc198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:43.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.726+0000 7fe6cbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6cc101030 0x7fe6cc198110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44396/0 (socket says 172.21.15.27:44396) 2024-09-19T08:10:43.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.726+0000 7fe6cbfff640 1 -- 172.21.15.27:0/3506957925 learned_addr learned my addr 172.21.15.27:0/3506957925 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:43.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.726+0000 7fe6d0812640 1 --2- 172.21.15.27:0/3506957925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6cc102710 0x7fe6cc19f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:43.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.727+0000 7fe6c3fff640 1 --2- 172.21.15.27:0/3506957925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6cc101d50 0x7fe6cc198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:43.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.727+0000 7fe6cbfff640 1 -- 172.21.15.27:0/3506957925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6cc101d50 msgr2=0x7fe6cc198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:43.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.727+0000 7fe6cbfff640 1 --2- 172.21.15.27:0/3506957925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6cc101d50 0x7fe6cc198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:43.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.727+0000 7fe6cbfff640 1 -- 172.21.15.27:0/3506957925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6cc102710 msgr2=0x7fe6cc19f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:43.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.727+0000 7fe6cbfff640 1 --2- 172.21.15.27:0/3506957925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6cc102710 0x7fe6cc19f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:43.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.727+0000 7fe6cbfff640 1 -- 172.21.15.27:0/3506957925 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6cc19fd40 con 0x7fe6cc101030 2024-09-19T08:10:43.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.727+0000 7fe6d0812640 1 --2- 172.21.15.27:0/3506957925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6cc102710 0x7fe6cc19f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:10:43.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.727+0000 7fe6cbfff640 1 --2- 172.21.15.27:0/3506957925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6cc101030 0x7fe6cc198110 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc005ab0 tx=0x7fe6bc004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:43.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.727+0000 7fe6c9ffb640 1 -- 172.21.15.27:0/3506957925 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc03f030 con 0x7fe6cc101030 2024-09-19T08:10:43.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.727+0000 7fe6d2275640 1 -- 172.21.15.27:0/3506957925 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6cc19ffd0 con 0x7fe6cc101030 2024-09-19T08:10:43.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.727+0000 7fe6c9ffb640 1 -- 172.21.15.27:0/3506957925 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6bc003ce0 con 0x7fe6cc101030 2024-09-19T08:10:43.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.727+0000 7fe6c9ffb640 1 -- 172.21.15.27:0/3506957925 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc035070 con 0x7fe6cc101030 2024-09-19T08:10:43.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.727+0000 7fe6d2275640 1 -- 172.21.15.27:0/3506957925 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6cc1a0450 con 0x7fe6cc101030 2024-09-19T08:10:43.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.728+0000 7fe6d2275640 1 -- 172.21.15.27:0/3506957925 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6cc1a0680 con 0x7fe6cc101030 2024-09-19T08:10:43.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.729+0000 7fe6c9ffb640 1 -- 172.21.15.27:0/3506957925 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe6bc042030 con 0x7fe6cc101030 2024-09-19T08:10:43.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.730+0000 7fe6c9ffb640 1 --2- 172.21.15.27:0/3506957925 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe6b80a3270 0x7fe6b80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:43.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.730+0000 7fe6c3fff640 1 --2- 172.21.15.27:0/3506957925 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe6b80a3270 0x7fe6b80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:43.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.730+0000 7fe6c9ffb640 1 -- 172.21.15.27:0/3506957925 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fe6bc0effb0 con 0x7fe6cc101030 2024-09-19T08:10:43.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.730+0000 7fe6c3fff640 1 --2- 172.21.15.27:0/3506957925 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe6b80a3270 0x7fe6b80a5730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc199630 tx=0x7fe6b4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:43.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.734+0000 7fe6c9ffb640 1 -- 172.21.15.27:0/3506957925 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe6bc0bcd00 con 0x7fe6cc101030 2024-09-19T08:10:43.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.917+0000 7fe6d2275640 1 -- 172.21.15.27:0/3506957925 --> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fe6cc100310 con 0x7fe6b80a3270 2024-09-19T08:10:43.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.919+0000 7fe6c9ffb640 1 -- 172.21.15.27:0/3506957925 <== mgr.14150 v2:172.21.15.27:6800/4220278108 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fe6cc100310 con 0x7fe6b80a3270 2024-09-19T08:10:43.919 INFO:teuthology.orchestra.run.smithi027.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T08:10:43.920 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331001C400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-19T08:10:43.920 INFO:teuthology.orchestra.run.smithi027.stdout:smithi155 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GW400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T08:10:43.920 INFO:teuthology.orchestra.run.smithi027.stdout:smithi203 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GK400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T08:10:43.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.921+0000 7fe6d2275640 1 -- 172.21.15.27:0/3506957925 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe6b80a3270 msgr2=0x7fe6b80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:43.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.921+0000 7fe6d2275640 1 --2- 172.21.15.27:0/3506957925 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe6b80a3270 0x7fe6b80a5730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc199630 tx=0x7fe6b4008040 comp rx=0 tx=0).stop 2024-09-19T08:10:43.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.921+0000 7fe6d2275640 1 -- 172.21.15.27:0/3506957925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6cc101030 msgr2=0x7fe6cc198110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:43.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.921+0000 7fe6d2275640 1 --2- 172.21.15.27:0/3506957925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6cc101030 0x7fe6cc198110 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc005ab0 tx=0x7fe6bc004360 comp rx=0 tx=0).stop 2024-09-19T08:10:43.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.921+0000 7fe6d2275640 1 -- 172.21.15.27:0/3506957925 shutdown_connections 2024-09-19T08:10:43.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.921+0000 7fe6d2275640 1 --2- 172.21.15.27:0/3506957925 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe6b80a3270 0x7fe6b80a5730 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:43.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.921+0000 7fe6d2275640 1 --2- 172.21.15.27:0/3506957925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6cc102710 0x7fe6cc19f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:43.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.921+0000 7fe6d2275640 1 --2- 172.21.15.27:0/3506957925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6cc101d50 0x7fe6cc198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:43.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.921+0000 7fe6d2275640 1 --2- 172.21.15.27:0/3506957925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6cc101030 0x7fe6cc198110 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:43.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.921+0000 7fe6d2275640 1 -- 172.21.15.27:0/3506957925 >> 172.21.15.27:0/3506957925 conn(0x7fe6cc0fba40 msgr2=0x7fe6cc0ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:43.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.921+0000 7fe6d2275640 1 -- 172.21.15.27:0/3506957925 shutdown_connections 2024-09-19T08:10:43.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:43.921+0000 7fe6d2275640 1 -- 172.21.15.27:0/3506957925 wait complete. 2024-09-19T08:10:44.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:44 smithi027 ceph-mon[31209]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:44.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:44 smithi027 ceph-mon[31209]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T08:10:44.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:44 smithi155 ceph-mon[35362]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:44.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:44 smithi155 ceph-mon[35362]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T08:10:44.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:44 smithi203 ceph-mon[35198]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:10:44.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:44 smithi203 ceph-mon[35198]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T08:10:44.748 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T08:10:44.757 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi027.front.sepia.ceph.com 2024-09-19T08:10:44.757 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T08:10:45.025 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:45.415 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:45 smithi027 ceph-mon[31209]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:10:45.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:45 smithi155 ceph-mon[35362]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:10:45.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:45 smithi203 ceph-mon[35198]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:10:45.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.500+0000 7fc8e2d41640 1 -- 172.21.15.27:0/2008816674 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc8dc1026c0 msgr2=0x7fc8dc108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:45.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.500+0000 7fc8e2d41640 1 --2- 172.21.15.27:0/2008816674 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc8dc1026c0 0x7fc8dc108f50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009ca0 tx=0x7fc8d402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:10:45.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.500+0000 7fc8e2d41640 1 -- 172.21.15.27:0/2008816674 shutdown_connections 2024-09-19T08:10:45.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.500+0000 7fc8e2d41640 1 --2- 172.21.15.27:0/2008816674 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc8dc1026c0 0x7fc8dc108f50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:45.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.500+0000 7fc8e2d41640 1 --2- 172.21.15.27:0/2008816674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8dc101d00 0x7fc8dc102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:45.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.500+0000 7fc8e2d41640 1 --2- 172.21.15.27:0/2008816674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8dc100b00 0x7fc8dc100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:45.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.500+0000 7fc8e2d41640 1 -- 172.21.15.27:0/2008816674 >> 172.21.15.27:0/2008816674 conn(0x7fc8dc0fc290 msgr2=0x7fc8dc0fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:45.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.500+0000 7fc8e2d41640 1 -- 172.21.15.27:0/2008816674 shutdown_connections 2024-09-19T08:10:45.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.500+0000 7fc8e2d41640 1 -- 172.21.15.27:0/2008816674 wait complete. 2024-09-19T08:10:45.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.500+0000 7fc8e2d41640 1 Processor -- start 2024-09-19T08:10:45.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.500+0000 7fc8e2d41640 1 -- start start 2024-09-19T08:10:45.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.501+0000 7fc8e2d41640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8dc100b00 0x7fc8dc197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:45.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.501+0000 7fc8e2d41640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc8dc101d00 0x7fc8dc198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:45.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.501+0000 7fc8e2d41640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8dc1026c0 0x7fc8dc19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:45.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.501+0000 7fc8e2d41640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc10c760 con 0x7fc8dc101d00 2024-09-19T08:10:45.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.501+0000 7fc8e2d41640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc10c5e0 con 0x7fc8dc100b00 2024-09-19T08:10:45.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.501+0000 7fc8e2d41640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc10c8e0 con 0x7fc8dc1026c0 2024-09-19T08:10:45.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.501+0000 7fc8dbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc8dc101d00 0x7fc8dc198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:45.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.501+0000 7fc8dbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc8dc101d00 0x7fc8dc198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44418/0 (socket says 172.21.15.27:44418) 2024-09-19T08:10:45.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.501+0000 7fc8dbfff640 1 -- 172.21.15.27:0/1834907088 learned_addr learned my addr 172.21.15.27:0/1834907088 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:45.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.501+0000 7fc8e0add640 1 --2- 172.21.15.27:0/1834907088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8dc100b00 0x7fc8dc197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:45.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.501+0000 7fc8e12de640 1 --2- 172.21.15.27:0/1834907088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8dc1026c0 0x7fc8dc19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:45.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.501+0000 7fc8dbfff640 1 -- 172.21.15.27:0/1834907088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8dc1026c0 msgr2=0x7fc8dc19f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:45.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.501+0000 7fc8dbfff640 1 --2- 172.21.15.27:0/1834907088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8dc1026c0 0x7fc8dc19f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:45.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.501+0000 7fc8dbfff640 1 -- 172.21.15.27:0/1834907088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8dc100b00 msgr2=0x7fc8dc197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:45.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.501+0000 7fc8dbfff640 1 --2- 172.21.15.27:0/1834907088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8dc100b00 0x7fc8dc197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:45.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.501+0000 7fc8dbfff640 1 -- 172.21.15.27:0/1834907088 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8dc19fb00 con 0x7fc8dc101d00 2024-09-19T08:10:45.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.501+0000 7fc8e12de640 1 --2- 172.21.15.27:0/1834907088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8dc1026c0 0x7fc8dc19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:10:45.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.501+0000 7fc8dbfff640 1 --2- 172.21.15.27:0/1834907088 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc8dc101d00 0x7fc8dc198410 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800e9f0 tx=0x7fc8c800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:45.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.502+0000 7fc8d9ffb640 1 -- 172.21.15.27:0/1834907088 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c800cd80 con 0x7fc8dc101d00 2024-09-19T08:10:45.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.502+0000 7fc8d9ffb640 1 -- 172.21.15.27:0/1834907088 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8c8010910 con 0x7fc8dc101d00 2024-09-19T08:10:45.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.502+0000 7fc8e2d41640 1 -- 172.21.15.27:0/1834907088 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8dc19fdf0 con 0x7fc8dc101d00 2024-09-19T08:10:45.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.502+0000 7fc8d9ffb640 1 -- 172.21.15.27:0/1834907088 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8018990 con 0x7fc8dc101d00 2024-09-19T08:10:45.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.502+0000 7fc8e2d41640 1 -- 172.21.15.27:0/1834907088 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8dc1a02a0 con 0x7fc8dc101d00 2024-09-19T08:10:45.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.503+0000 7fc8e2d41640 1 -- 172.21.15.27:0/1834907088 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8dc1a04d0 con 0x7fc8dc101d00 2024-09-19T08:10:45.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.504+0000 7fc8d9ffb640 1 -- 172.21.15.27:0/1834907088 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc8c8010ac0 con 0x7fc8dc101d00 2024-09-19T08:10:45.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.505+0000 7fc8d9ffb640 1 --2- 172.21.15.27:0/1834907088 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc8cc0a3270 0x7fc8cc0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:45.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.505+0000 7fc8d9ffb640 1 -- 172.21.15.27:0/1834907088 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fc8c80cff50 con 0x7fc8dc101d00 2024-09-19T08:10:45.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.505+0000 7fc8e0add640 1 --2- 172.21.15.27:0/1834907088 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc8cc0a3270 0x7fc8cc0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:45.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.505+0000 7fc8e0add640 1 --2- 172.21.15.27:0/1834907088 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc8cc0a3270 0x7fc8cc0a5730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0005fd0 tx=0x7fc8d000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:45.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.508+0000 7fc8d9ffb640 1 -- 172.21.15.27:0/1834907088 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc8c809cca0 con 0x7fc8dc101d00 2024-09-19T08:10:45.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.726+0000 7fc8e2d41640 1 -- 172.21.15.27:0/1834907088 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fc8dc1a0860 con 0x7fc8dc101d00 2024-09-19T08:10:45.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.727+0000 7fc8d9ffb640 1 -- 172.21.15.27:0/1834907088 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) ==== 76+0+3054 (secure 0 0 0) 0x7fc8c809c5a0 con 0x7fc8dc101d00 2024-09-19T08:10:45.728 INFO:teuthology.orchestra.run.smithi027.stdout:e20 2024-09-19T08:10:45.728 INFO:teuthology.orchestra.run.smithi027.stdout:btime 2024-09-19T08:09:21:292345+0000 2024-09-19T08:10:45.728 INFO:teuthology.orchestra.run.smithi027.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:10:45.728 INFO:teuthology.orchestra.run.smithi027.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:10:45.728 INFO:teuthology.orchestra.run.smithi027.stdout:legacy client fscid: 1 2024-09-19T08:10:45.728 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:10:45.728 INFO:teuthology.orchestra.run.smithi027.stdout:Filesystem 'cephfs' (1) 2024-09-19T08:10:45.728 INFO:teuthology.orchestra.run.smithi027.stdout:fs_name cephfs 2024-09-19T08:10:45.729 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 20 2024-09-19T08:10:45.729 INFO:teuthology.orchestra.run.smithi027.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T08:10:45.729 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-09-19T08:09:11.930032+0000 2024-09-19T08:10:45.729 INFO:teuthology.orchestra.run.smithi027.stdout:modified 2024-09-19T08:09:20.890507+0000 2024-09-19T08:10:45.729 INFO:teuthology.orchestra.run.smithi027.stdout:tableserver 0 2024-09-19T08:10:45.729 INFO:teuthology.orchestra.run.smithi027.stdout:root 0 2024-09-19T08:10:45.729 INFO:teuthology.orchestra.run.smithi027.stdout:session_timeout 300 2024-09-19T08:10:45.729 INFO:teuthology.orchestra.run.smithi027.stdout:session_autoclose 300 2024-09-19T08:10:45.729 INFO:teuthology.orchestra.run.smithi027.stdout:max_file_size 1099511627776 2024-09-19T08:10:45.729 INFO:teuthology.orchestra.run.smithi027.stdout:max_xattr_size 65536 2024-09-19T08:10:45.729 INFO:teuthology.orchestra.run.smithi027.stdout:required_client_features {} 2024-09-19T08:10:45.730 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure 0 2024-09-19T08:10:45.730 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure_osd_epoch 0 2024-09-19T08:10:45.730 INFO:teuthology.orchestra.run.smithi027.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:10:45.730 INFO:teuthology.orchestra.run.smithi027.stdout:max_mds 1 2024-09-19T08:10:45.730 INFO:teuthology.orchestra.run.smithi027.stdout:in 0 2024-09-19T08:10:45.730 INFO:teuthology.orchestra.run.smithi027.stdout:up {0=24482} 2024-09-19T08:10:45.730 INFO:teuthology.orchestra.run.smithi027.stdout:failed 2024-09-19T08:10:45.730 INFO:teuthology.orchestra.run.smithi027.stdout:damaged 2024-09-19T08:10:45.730 INFO:teuthology.orchestra.run.smithi027.stdout:stopped 2024-09-19T08:10:45.730 INFO:teuthology.orchestra.run.smithi027.stdout:data_pools [3] 2024-09-19T08:10:45.730 INFO:teuthology.orchestra.run.smithi027.stdout:metadata_pool 2 2024-09-19T08:10:45.730 INFO:teuthology.orchestra.run.smithi027.stdout:inline_data disabled 2024-09-19T08:10:45.731 INFO:teuthology.orchestra.run.smithi027.stdout:balancer 2024-09-19T08:10:45.731 INFO:teuthology.orchestra.run.smithi027.stdout:bal_rank_mask -1 2024-09-19T08:10:45.731 INFO:teuthology.orchestra.run.smithi027.stdout:standby_count_wanted 0 2024-09-19T08:10:45.731 INFO:teuthology.orchestra.run.smithi027.stdout:qdb_cluster leader: 24482 members: 24482 2024-09-19T08:10:45.731 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.b{0:24482} state up:active seq 5 addr [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:10:45.731 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.i{0:24466} state up:standby-replay seq 1 addr [v2:172.21.15.203:6838/1481040099,v1:172.21.15.203:6839/1481040099] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:10:45.731 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:10:45.731 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:10:45.731 INFO:teuthology.orchestra.run.smithi027.stdout:Standby daemons: 2024-09-19T08:10:45.731 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:10:45.731 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.j{-1:14526} state up:standby seq 1 addr [v2:172.21.15.27:6834/2839073918,v1:172.21.15.27:6835/2839073918] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:10:45.731 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.d{-1:14538} state up:standby seq 1 addr [v2:172.21.15.27:6836/1473265593,v1:172.21.15.27:6837/1473265593] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:10:45.732 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.g{-1:14595} state up:standby seq 1 addr [v2:172.21.15.27:6838/4163950622,v1:172.21.15.27:6839/4163950622] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:10:45.732 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.a{-1:14607} state up:standby seq 1 addr [v2:172.21.15.27:6840/2368031257,v1:172.21.15.27:6841/2368031257] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:10:45.732 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.l{-1:24406} state up:standby seq 1 addr [v2:172.21.15.203:6832/3132962224,v1:172.21.15.203:6833/3132962224] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:10:45.732 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.k{-1:24410} state up:standby seq 1 addr [v2:172.21.15.155:6832/1589376541,v1:172.21.15.155:6833/1589376541] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:10:45.732 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.f{-1:24439} state up:standby seq 1 addr [v2:172.21.15.203:6834/3596726506,v1:172.21.15.203:6835/3596726506] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:10:45.732 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.e{-1:24443} state up:standby seq 1 addr [v2:172.21.15.155:6834/3102690439,v1:172.21.15.155:6835/3102690439] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:10:45.732 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.c{-1:24445} state up:standby seq 1 addr [v2:172.21.15.203:6836/3575223508,v1:172.21.15.203:6837/3575223508] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:10:45.732 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.h{-1:24461} state up:standby seq 1 addr [v2:172.21.15.155:6836/532811783,v1:172.21.15.155:6837/532811783] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:10:45.733 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:10:45.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.729+0000 7fc8e2d41640 1 -- 172.21.15.27:0/1834907088 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc8cc0a3270 msgr2=0x7fc8cc0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:45.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.729+0000 7fc8e2d41640 1 --2- 172.21.15.27:0/1834907088 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc8cc0a3270 0x7fc8cc0a5730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0005fd0 tx=0x7fc8d000b410 comp rx=0 tx=0).stop 2024-09-19T08:10:45.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.729+0000 7fc8e2d41640 1 -- 172.21.15.27:0/1834907088 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc8dc101d00 msgr2=0x7fc8dc198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:45.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.729+0000 7fc8e2d41640 1 --2- 172.21.15.27:0/1834907088 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc8dc101d00 0x7fc8dc198410 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800e9f0 tx=0x7fc8c800eeb0 comp rx=0 tx=0).stop 2024-09-19T08:10:45.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.729+0000 7fc8e2d41640 1 -- 172.21.15.27:0/1834907088 shutdown_connections 2024-09-19T08:10:45.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.729+0000 7fc8e2d41640 1 --2- 172.21.15.27:0/1834907088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8dc1026c0 0x7fc8dc19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:45.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.729+0000 7fc8e2d41640 1 --2- 172.21.15.27:0/1834907088 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc8dc101d00 0x7fc8dc198410 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:45.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.729+0000 7fc8e2d41640 1 --2- 172.21.15.27:0/1834907088 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fc8cc0a3270 0x7fc8cc0a5730 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:45.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.729+0000 7fc8e2d41640 1 --2- 172.21.15.27:0/1834907088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8dc100b00 0x7fc8dc197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:45.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.729+0000 7fc8e2d41640 1 -- 172.21.15.27:0/1834907088 >> 172.21.15.27:0/1834907088 conn(0x7fc8dc0fc290 msgr2=0x7fc8dc06a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:45.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.729+0000 7fc8e2d41640 1 -- 172.21.15.27:0/1834907088 shutdown_connections 2024-09-19T08:10:45.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:45.729+0000 7fc8e2d41640 1 -- 172.21.15.27:0/1834907088 wait complete. 2024-09-19T08:10:46.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:46 smithi155 ceph-mon[35362]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-19T08:10:46.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:46 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1834907088' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T08:10:46.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:46 smithi027 ceph-mon[31209]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-19T08:10:46.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:46 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1834907088' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T08:10:46.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:46 smithi203 ceph-mon[35198]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-19T08:10:46.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:46 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1834907088' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T08:10:46.568 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T08:10:46.830 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:47.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.384+0000 7f7d6807e640 1 -- 172.21.15.27:0/3495622981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d60100b10 msgr2=0x7f7d60100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:47.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.384+0000 7f7d6807e640 1 --2- 172.21.15.27:0/3495622981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d60100b10 0x7f7d60100f10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c009900 tx=0x7f7d5c02a410 comp rx=0 tx=0).stop 2024-09-19T08:10:47.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.384+0000 7f7d6807e640 1 -- 172.21.15.27:0/3495622981 shutdown_connections 2024-09-19T08:10:47.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.384+0000 7f7d6807e640 1 --2- 172.21.15.27:0/3495622981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d601026d0 0x7f7d60108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:47.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.384+0000 7f7d6807e640 1 --2- 172.21.15.27:0/3495622981 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d60101d10 0x7f7d60102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:47.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.384+0000 7f7d6807e640 1 --2- 172.21.15.27:0/3495622981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d60100b10 0x7f7d60100f10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:47.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.384+0000 7f7d6807e640 1 -- 172.21.15.27:0/3495622981 >> 172.21.15.27:0/3495622981 conn(0x7f7d600fc2a0 msgr2=0x7f7d600fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:47.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.384+0000 7f7d6807e640 1 -- 172.21.15.27:0/3495622981 shutdown_connections 2024-09-19T08:10:47.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.384+0000 7f7d6807e640 1 -- 172.21.15.27:0/3495622981 wait complete. 2024-09-19T08:10:47.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.385+0000 7f7d6807e640 1 Processor -- start 2024-09-19T08:10:47.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.385+0000 7f7d6807e640 1 -- start start 2024-09-19T08:10:47.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.385+0000 7f7d6807e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d60100b10 0x7f7d60197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:47.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.385+0000 7f7d6807e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d60101d10 0x7f7d60198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:47.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.385+0000 7f7d6807e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d601026d0 0x7f7d6019f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:47.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.385+0000 7f7d6807e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6010d8c0 con 0x7f7d60101d10 2024-09-19T08:10:47.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.385+0000 7f7d6807e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6010d740 con 0x7f7d601026d0 2024-09-19T08:10:47.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.385+0000 7f7d6807e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6010da40 con 0x7f7d60100b10 2024-09-19T08:10:47.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.385+0000 7f7d65619640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d60101d10 0x7f7d60198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:47.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.385+0000 7f7d65619640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d60101d10 0x7f7d60198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44436/0 (socket says 172.21.15.27:44436) 2024-09-19T08:10:47.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.385+0000 7f7d65619640 1 -- 172.21.15.27:0/2779250413 learned_addr learned my addr 172.21.15.27:0/2779250413 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:47.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.385+0000 7f7d6661b640 1 --2- 172.21.15.27:0/2779250413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d601026d0 0x7f7d6019f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:47.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.385+0000 7f7d65e1a640 1 --2- 172.21.15.27:0/2779250413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d60100b10 0x7f7d60197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:47.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.386+0000 7f7d65619640 1 -- 172.21.15.27:0/2779250413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d60100b10 msgr2=0x7f7d60197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:47.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.386+0000 7f7d65619640 1 --2- 172.21.15.27:0/2779250413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d60100b10 0x7f7d60197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:47.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.386+0000 7f7d65619640 1 -- 172.21.15.27:0/2779250413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d601026d0 msgr2=0x7f7d6019f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:47.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.386+0000 7f7d65619640 1 --2- 172.21.15.27:0/2779250413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d601026d0 0x7f7d6019f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:47.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.386+0000 7f7d65619640 1 -- 172.21.15.27:0/2779250413 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d6019fb60 con 0x7f7d60101d10 2024-09-19T08:10:47.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.386+0000 7f7d6661b640 1 --2- 172.21.15.27:0/2779250413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d601026d0 0x7f7d6019f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:10:47.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.386+0000 7f7d65e1a640 1 --2- 172.21.15.27:0/2779250413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d60100b10 0x7f7d60197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:10:47.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.386+0000 7f7d65619640 1 --2- 172.21.15.27:0/2779250413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d60101d10 0x7f7d60198470 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000c970 tx=0x7f7d5000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:47.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.386+0000 7f7d56ffd640 1 -- 172.21.15.27:0/2779250413 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50007bb0 con 0x7f7d60101d10 2024-09-19T08:10:47.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.386+0000 7f7d56ffd640 1 -- 172.21.15.27:0/2779250413 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d50007d50 con 0x7f7d60101d10 2024-09-19T08:10:47.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.386+0000 7f7d6807e640 1 -- 172.21.15.27:0/2779250413 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d6019fe50 con 0x7f7d60101d10 2024-09-19T08:10:47.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.386+0000 7f7d56ffd640 1 -- 172.21.15.27:0/2779250413 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5000f450 con 0x7f7d60101d10 2024-09-19T08:10:47.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.386+0000 7f7d6807e640 1 -- 172.21.15.27:0/2779250413 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d601a02b0 con 0x7f7d60101d10 2024-09-19T08:10:47.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.387+0000 7f7d6807e640 1 -- 172.21.15.27:0/2779250413 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d60107f60 con 0x7f7d60101d10 2024-09-19T08:10:47.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.388+0000 7f7d56ffd640 1 -- 172.21.15.27:0/2779250413 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7d50004fa0 con 0x7f7d60101d10 2024-09-19T08:10:47.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.389+0000 7f7d56ffd640 1 --2- 172.21.15.27:0/2779250413 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7d4c0a3270 0x7f7d4c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:47.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.389+0000 7f7d65e1a640 1 --2- 172.21.15.27:0/2779250413 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7d4c0a3270 0x7f7d4c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:47.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.389+0000 7f7d56ffd640 1 -- 172.21.15.27:0/2779250413 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f7d500cfab0 con 0x7f7d60101d10 2024-09-19T08:10:47.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.390+0000 7f7d65e1a640 1 --2- 172.21.15.27:0/2779250413 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7d4c0a3270 0x7f7d4c0a5730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c006010 tx=0x7f7d5c032dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:47.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.393+0000 7f7d56ffd640 1 -- 172.21.15.27:0/2779250413 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7d50014030 con 0x7f7d60101d10 2024-09-19T08:10:47.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.572+0000 7f7d6807e640 1 -- 172.21.15.27:0/2779250413 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f7d6002d7c0 con 0x7f7d60101d10 2024-09-19T08:10:47.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.573+0000 7f7d56ffd640 1 -- 172.21.15.27:0/2779250413 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v83) ==== 56+0+5246 (secure 0 0 0) 0x7f7d5009c800 con 0x7f7d60101d10 2024-09-19T08:10:47.573 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 83 2024-09-19T08:10:47.573 INFO:teuthology.orchestra.run.smithi027.stdout:fsid 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:10:47.574 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-09-19T08:01:20.929241+0000 2024-09-19T08:10:47.574 INFO:teuthology.orchestra.run.smithi027.stdout:modified 2024-09-19T08:10:14.777420+0000 2024-09-19T08:10:47.574 INFO:teuthology.orchestra.run.smithi027.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T08:10:47.574 INFO:teuthology.orchestra.run.smithi027.stdout:crush_version 26 2024-09-19T08:10:47.574 INFO:teuthology.orchestra.run.smithi027.stdout:full_ratio 0.95 2024-09-19T08:10:47.574 INFO:teuthology.orchestra.run.smithi027.stdout:backfillfull_ratio 0.9 2024-09-19T08:10:47.574 INFO:teuthology.orchestra.run.smithi027.stdout:nearfull_ratio 0.85 2024-09-19T08:10:47.574 INFO:teuthology.orchestra.run.smithi027.stdout:require_min_compat_client luminous 2024-09-19T08:10:47.574 INFO:teuthology.orchestra.run.smithi027.stdout:min_compat_client luminous 2024-09-19T08:10:47.574 INFO:teuthology.orchestra.run.smithi027.stdout:require_osd_release squid 2024-09-19T08:10:47.574 INFO:teuthology.orchestra.run.smithi027.stdout:stretch_mode_enabled false 2024-09-19T08:10:47.574 INFO:teuthology.orchestra.run.smithi027.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T08:10:47.574 INFO:teuthology.orchestra.run.smithi027.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-19T08:10:47.575 INFO:teuthology.orchestra.run.smithi027.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T08:10:47.575 INFO:teuthology.orchestra.run.smithi027.stdout:max_osd 12 2024-09-19T08:10:47.575 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 up in weight 1 up_from 8 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.27:6802/3645201250,v1:172.21.15.27:6803/3645201250] [v2:172.21.15.27:6804/3645201250,v1:172.21.15.27:6805/3645201250] exists,up 66fd6732-4cac-4eda-bf06-50638995ee80 2024-09-19T08:10:47.575 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 up in weight 1 up_from 13 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6800/3977510449,v1:172.21.15.155:6801/3977510449] [v2:172.21.15.155:6802/3977510449,v1:172.21.15.155:6803/3977510449] exists,up 36628767-66ac-433b-938e-10e75b51a877 2024-09-19T08:10:47.575 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 up in weight 1 up_from 18 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.203:6800/3796057016,v1:172.21.15.203:6801/3796057016] [v2:172.21.15.203:6802/3796057016,v1:172.21.15.203:6803/3796057016] exists,up 3dc80404-a56b-456a-af02-f01e9c6c6dfe 2024-09-19T08:10:47.575 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 up in weight 1 up_from 25 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.27:6810/1608304347,v1:172.21.15.27:6811/1608304347] [v2:172.21.15.27:6812/1608304347,v1:172.21.15.27:6813/1608304347] exists,up a51077d0-5e04-49b5-bb3e-91711cc45ff1 2024-09-19T08:10:47.575 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 up in weight 1 up_from 32 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6808/569913150,v1:172.21.15.155:6809/569913150] [v2:172.21.15.155:6810/569913150,v1:172.21.15.155:6811/569913150] exists,up 0df35548-90b4-434d-8d7e-c037072c9ae4 2024-09-19T08:10:47.575 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 up in weight 1 up_from 37 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.203:6808/991491203,v1:172.21.15.203:6809/991491203] [v2:172.21.15.203:6810/991491203,v1:172.21.15.203:6811/991491203] exists,up de193c5f-1019-43e5-9f4f-6c2aaa4330e1 2024-09-19T08:10:47.575 INFO:teuthology.orchestra.run.smithi027.stdout:osd.6 up in weight 1 up_from 44 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.27:6818/3516868131,v1:172.21.15.27:6819/3516868131] [v2:172.21.15.27:6820/3516868131,v1:172.21.15.27:6821/3516868131] exists,up 28938e4f-9f22-466f-8cf7-62ee56a0c926 2024-09-19T08:10:47.575 INFO:teuthology.orchestra.run.smithi027.stdout:osd.7 up in weight 1 up_from 49 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6816/2047506436,v1:172.21.15.155:6817/2047506436] [v2:172.21.15.155:6818/2047506436,v1:172.21.15.155:6819/2047506436] exists,up 855f1728-be52-4445-8561-a90c08f2b2c0 2024-09-19T08:10:47.575 INFO:teuthology.orchestra.run.smithi027.stdout:osd.8 up in weight 1 up_from 56 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.203:6816/199970687,v1:172.21.15.203:6817/199970687] [v2:172.21.15.203:6818/199970687,v1:172.21.15.203:6819/199970687] exists,up 5d7a8ffd-a039-403e-8b9a-c80e19fd67ec 2024-09-19T08:10:47.575 INFO:teuthology.orchestra.run.smithi027.stdout:osd.9 up in weight 1 up_from 63 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.27:6826/118390483,v1:172.21.15.27:6827/118390483] [v2:172.21.15.27:6828/118390483,v1:172.21.15.27:6829/118390483] exists,up cdb90242-80a1-4cef-b5e3-ddecb05664e1 2024-09-19T08:10:47.575 INFO:teuthology.orchestra.run.smithi027.stdout:osd.10 up in weight 1 up_from 68 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6824/1687418565,v1:172.21.15.155:6825/1687418565] [v2:172.21.15.155:6826/1687418565,v1:172.21.15.155:6827/1687418565] exists,up c7f4c9da-d913-47a5-8629-53de21efe8c5 2024-09-19T08:10:47.575 INFO:teuthology.orchestra.run.smithi027.stdout:osd.11 up in weight 1 up_from 75 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.203:6824/224768827,v1:172.21.15.203:6825/224768827] [v2:172.21.15.203:6826/224768827,v1:172.21.15.203:6827/224768827] exists,up 45c11a90-585e-46fa-a5a0-51a29e29eba0 2024-09-19T08:10:47.576 INFO:teuthology.orchestra.run.smithi027.stdout:pg_upmap_items 2.a [2,11] 2024-09-19T08:10:47.576 INFO:teuthology.orchestra.run.smithi027.stdout:pg_upmap_items 2.c [2,4] 2024-09-19T08:10:47.576 INFO:teuthology.orchestra.run.smithi027.stdout:pg_upmap_items 2.10 [8,11] 2024-09-19T08:10:47.576 INFO:teuthology.orchestra.run.smithi027.stdout:pg_upmap_items 3.0 [4,8] 2024-09-19T08:10:47.576 INFO:teuthology.orchestra.run.smithi027.stdout:pg_upmap_items 3.1 [4,9] 2024-09-19T08:10:47.576 INFO:teuthology.orchestra.run.smithi027.stdout:pg_upmap_items 3.10 [5,9] 2024-09-19T08:10:47.576 INFO:teuthology.orchestra.run.smithi027.stdout:pg_upmap_items 3.36 [4,9] 2024-09-19T08:10:47.576 INFO:teuthology.orchestra.run.smithi027.stdout:blocklist 172.21.15.27:6800/538175414 expires 2024-09-20T08:02:12.808047+0000 2024-09-19T08:10:47.576 INFO:teuthology.orchestra.run.smithi027.stdout:blocklist 172.21.15.27:0/958829150 expires 2024-09-20T08:02:12.808047+0000 2024-09-19T08:10:47.576 INFO:teuthology.orchestra.run.smithi027.stdout:blocklist 172.21.15.27:0/1174736321 expires 2024-09-20T08:02:12.808047+0000 2024-09-19T08:10:47.576 INFO:teuthology.orchestra.run.smithi027.stdout:blocklist 172.21.15.27:0/1908865720 expires 2024-09-20T08:02:12.808047+0000 2024-09-19T08:10:47.576 INFO:teuthology.orchestra.run.smithi027.stdout:blocklist 172.21.15.27:0/416476667 expires 2024-09-20T08:01:48.686812+0000 2024-09-19T08:10:47.576 INFO:teuthology.orchestra.run.smithi027.stdout:blocklist 172.21.15.27:6801/4146960985 expires 2024-09-20T08:01:48.686812+0000 2024-09-19T08:10:47.576 INFO:teuthology.orchestra.run.smithi027.stdout:blocklist 172.21.15.27:6800/4146960985 expires 2024-09-20T08:01:48.686812+0000 2024-09-19T08:10:47.577 INFO:teuthology.orchestra.run.smithi027.stdout:blocklist 172.21.15.27:0/1717932879 expires 2024-09-20T08:01:48.686812+0000 2024-09-19T08:10:47.577 INFO:teuthology.orchestra.run.smithi027.stdout:blocklist 172.21.15.27:6801/538175414 expires 2024-09-20T08:02:12.808047+0000 2024-09-19T08:10:47.577 INFO:teuthology.orchestra.run.smithi027.stdout:blocklist 172.21.15.27:0/1963219497 expires 2024-09-20T08:01:48.686812+0000 2024-09-19T08:10:47.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.575+0000 7f7d6807e640 1 -- 172.21.15.27:0/2779250413 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7d4c0a3270 msgr2=0x7f7d4c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:47.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.575+0000 7f7d6807e640 1 --2- 172.21.15.27:0/2779250413 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7d4c0a3270 0x7f7d4c0a5730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c006010 tx=0x7f7d5c032dd0 comp rx=0 tx=0).stop 2024-09-19T08:10:47.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.575+0000 7f7d6807e640 1 -- 172.21.15.27:0/2779250413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d60101d10 msgr2=0x7f7d60198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:47.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.575+0000 7f7d6807e640 1 --2- 172.21.15.27:0/2779250413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d60101d10 0x7f7d60198470 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000c970 tx=0x7f7d5000ce30 comp rx=0 tx=0).stop 2024-09-19T08:10:47.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.575+0000 7f7d6807e640 1 -- 172.21.15.27:0/2779250413 shutdown_connections 2024-09-19T08:10:47.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.575+0000 7f7d6807e640 1 --2- 172.21.15.27:0/2779250413 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f7d4c0a3270 0x7f7d4c0a5730 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:47.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.575+0000 7f7d6807e640 1 --2- 172.21.15.27:0/2779250413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d601026d0 0x7f7d6019f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:47.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.575+0000 7f7d6807e640 1 --2- 172.21.15.27:0/2779250413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d60101d10 0x7f7d60198470 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:47.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.575+0000 7f7d6807e640 1 --2- 172.21.15.27:0/2779250413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d60100b10 0x7f7d60197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:47.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.575+0000 7f7d6807e640 1 -- 172.21.15.27:0/2779250413 >> 172.21.15.27:0/2779250413 conn(0x7f7d600fc2a0 msgr2=0x7f7d60105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:47.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.575+0000 7f7d6807e640 1 -- 172.21.15.27:0/2779250413 shutdown_connections 2024-09-19T08:10:47.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:47.575+0000 7f7d6807e640 1 -- 172.21.15.27:0/2779250413 wait complete. 2024-09-19T08:10:48.242 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:48 smithi027 ceph-mon[31209]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:10:48.242 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:48 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2779250413' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T08:10:48.271 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T08:10:48.282 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:10:48.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:48 smithi155 ceph-mon[35362]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:10:48.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:48 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2779250413' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T08:10:48.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:48 smithi203 ceph-mon[35198]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:10:48.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:48 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2779250413' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T08:10:48.540 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:49.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.055+0000 7ff36a9c6640 1 -- 172.21.15.27:0/3546004524 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff364102d40 msgr2=0x7ff364103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:49.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.055+0000 7ff36a9c6640 1 --2- 172.21.15.27:0/3546004524 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff364102d40 0x7ff364103120 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff354009900 tx=0x7ff35402a480 comp rx=0 tx=0).stop 2024-09-19T08:10:49.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.055+0000 7ff36a9c6640 1 -- 172.21.15.27:0/3546004524 shutdown_connections 2024-09-19T08:10:49.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.055+0000 7ff36a9c6640 1 --2- 172.21.15.27:0/3546004524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff36410c170 0x7ff36410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:49.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.055+0000 7ff36a9c6640 1 --2- 172.21.15.27:0/3546004524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff364103660 0x7ff36410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:49.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.055+0000 7ff36a9c6640 1 --2- 172.21.15.27:0/3546004524 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff364102d40 0x7ff364103120 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:49.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.055+0000 7ff36a9c6640 1 -- 172.21.15.27:0/3546004524 >> 172.21.15.27:0/3546004524 conn(0x7ff3640fc7a0 msgr2=0x7ff3640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:49.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.055+0000 7ff36a9c6640 1 -- 172.21.15.27:0/3546004524 shutdown_connections 2024-09-19T08:10:49.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.055+0000 7ff36a9c6640 1 -- 172.21.15.27:0/3546004524 wait complete. 2024-09-19T08:10:49.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.056+0000 7ff36a9c6640 1 Processor -- start 2024-09-19T08:10:49.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.056+0000 7ff36a9c6640 1 -- start start 2024-09-19T08:10:49.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.056+0000 7ff36a9c6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff364102d40 0x7ff364198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:49.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.056+0000 7ff36a9c6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff364103660 0x7ff3641988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:49.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.056+0000 7ff36a9c6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff36410c170 0x7ff36419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:49.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.056+0000 7ff36a9c6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff364111f70 con 0x7ff364102d40 2024-09-19T08:10:49.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.056+0000 7ff36a9c6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff364111df0 con 0x7ff36410c170 2024-09-19T08:10:49.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.056+0000 7ff36a9c6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff3641120f0 con 0x7ff364103660 2024-09-19T08:10:49.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.056+0000 7ff363fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff364102d40 0x7ff364198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:49.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.056+0000 7ff363fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff364102d40 0x7ff364198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44452/0 (socket says 172.21.15.27:44452) 2024-09-19T08:10:49.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.056+0000 7ff363fff640 1 -- 172.21.15.27:0/1230139152 learned_addr learned my addr 172.21.15.27:0/1230139152 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:49.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.057+0000 7ff3637fe640 1 --2- 172.21.15.27:0/1230139152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff364103660 0x7ff3641988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:49.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.057+0000 7ff368f63640 1 --2- 172.21.15.27:0/1230139152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff36410c170 0x7ff36419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:49.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.057+0000 7ff363fff640 1 -- 172.21.15.27:0/1230139152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff364103660 msgr2=0x7ff3641988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:49.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.057+0000 7ff363fff640 1 --2- 172.21.15.27:0/1230139152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff364103660 0x7ff3641988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:49.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.057+0000 7ff363fff640 1 -- 172.21.15.27:0/1230139152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff36410c170 msgr2=0x7ff36419cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:49.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.057+0000 7ff363fff640 1 --2- 172.21.15.27:0/1230139152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff36410c170 0x7ff36419cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:49.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.057+0000 7ff363fff640 1 -- 172.21.15.27:0/1230139152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36419d320 con 0x7ff364102d40 2024-09-19T08:10:49.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.057+0000 7ff3637fe640 1 --2- 172.21.15.27:0/1230139152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff364103660 0x7ff3641988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:10:49.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.057+0000 7ff363fff640 1 --2- 172.21.15.27:0/1230139152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff364102d40 0x7ff364198370 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff354005ab0 tx=0x7ff3540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:49.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.057+0000 7ff3617fa640 1 -- 172.21.15.27:0/1230139152 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35403f030 con 0x7ff364102d40 2024-09-19T08:10:49.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.057+0000 7ff36a9c6640 1 -- 172.21.15.27:0/1230139152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff36419d5b0 con 0x7ff364102d40 2024-09-19T08:10:49.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.057+0000 7ff3617fa640 1 -- 172.21.15.27:0/1230139152 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff354003ce0 con 0x7ff364102d40 2024-09-19T08:10:49.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.057+0000 7ff3617fa640 1 -- 172.21.15.27:0/1230139152 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff354035070 con 0x7ff364102d40 2024-09-19T08:10:49.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.057+0000 7ff36a9c6640 1 -- 172.21.15.27:0/1230139152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3641a4ef0 con 0x7ff364102d40 2024-09-19T08:10:49.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.058+0000 7ff36a9c6640 1 -- 172.21.15.27:0/1230139152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff36406b070 con 0x7ff364102d40 2024-09-19T08:10:49.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.059+0000 7ff3617fa640 1 -- 172.21.15.27:0/1230139152 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff354042030 con 0x7ff364102d40 2024-09-19T08:10:49.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.060+0000 7ff3617fa640 1 --2- 172.21.15.27:0/1230139152 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff34c0a3240 0x7ff34c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:49.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.060+0000 7ff3637fe640 1 --2- 172.21.15.27:0/1230139152 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff34c0a3240 0x7ff34c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:49.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.060+0000 7ff3617fa640 1 -- 172.21.15.27:0/1230139152 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7ff3540f02e0 con 0x7ff364102d40 2024-09-19T08:10:49.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.061+0000 7ff3637fe640 1 --2- 172.21.15.27:0/1230139152 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff34c0a3240 0x7ff34c0a5700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff358005e10 tx=0x7ff358005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:49.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.064+0000 7ff3617fa640 1 -- 172.21.15.27:0/1230139152 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff3540bcfd0 con 0x7ff364102d40 2024-09-19T08:10:49.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.277+0000 7ff36a9c6640 1 -- 172.21.15.27:0/1230139152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3641a50c0 con 0x7ff364102d40 2024-09-19T08:10:49.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.277+0000 7ff3617fa640 1 -- 172.21.15.27:0/1230139152 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7ff3540bc8d0 con 0x7ff364102d40 2024-09-19T08:10:49.278 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:10:49.279 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:10:49.279 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:10:49.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.279+0000 7ff36a9c6640 1 -- 172.21.15.27:0/1230139152 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff34c0a3240 msgr2=0x7ff34c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:49.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.279+0000 7ff36a9c6640 1 --2- 172.21.15.27:0/1230139152 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff34c0a3240 0x7ff34c0a5700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff358005e10 tx=0x7ff358005da0 comp rx=0 tx=0).stop 2024-09-19T08:10:49.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.279+0000 7ff36a9c6640 1 -- 172.21.15.27:0/1230139152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff364102d40 msgr2=0x7ff364198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:49.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.280+0000 7ff36a9c6640 1 --2- 172.21.15.27:0/1230139152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff364102d40 0x7ff364198370 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff354005ab0 tx=0x7ff3540042f0 comp rx=0 tx=0).stop 2024-09-19T08:10:49.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.280+0000 7ff36a9c6640 1 -- 172.21.15.27:0/1230139152 shutdown_connections 2024-09-19T08:10:49.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.280+0000 7ff36a9c6640 1 --2- 172.21.15.27:0/1230139152 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7ff34c0a3240 0x7ff34c0a5700 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:49.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.280+0000 7ff36a9c6640 1 --2- 172.21.15.27:0/1230139152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff36410c170 0x7ff36419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:49.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.280+0000 7ff36a9c6640 1 --2- 172.21.15.27:0/1230139152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff364103660 0x7ff3641988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:49.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.280+0000 7ff36a9c6640 1 --2- 172.21.15.27:0/1230139152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff364102d40 0x7ff364198370 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:49.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.280+0000 7ff36a9c6640 1 -- 172.21.15.27:0/1230139152 >> 172.21.15.27:0/1230139152 conn(0x7ff3640fc7a0 msgr2=0x7ff3640fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:49.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.280+0000 7ff36a9c6640 1 -- 172.21.15.27:0/1230139152 shutdown_connections 2024-09-19T08:10:49.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:49.280+0000 7ff36a9c6640 1 -- 172.21.15.27:0/1230139152 wait complete. 2024-09-19T08:10:49.982 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:10:50.241 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:50.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:50 smithi027 ceph-mon[31209]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:10:50.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:50 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1230139152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:10:50.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:50 smithi155 ceph-mon[35362]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:10:50.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:50 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1230139152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:10:50.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:50 smithi203 ceph-mon[35198]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:10:50.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:50 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1230139152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:10:50.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.746+0000 7f08c3ca5640 1 -- 172.21.15.27:0/2347509719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08bc106f10 msgr2=0x7f08bc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:50.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.746+0000 7f08c3ca5640 1 --2- 172.21.15.27:0/2347509719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08bc106f10 0x7f08bc10ea90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009ca0 tx=0x7f08b402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:10:50.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.746+0000 7f08c3ca5640 1 -- 172.21.15.27:0/2347509719 shutdown_connections 2024-09-19T08:10:50.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.746+0000 7f08c3ca5640 1 --2- 172.21.15.27:0/2347509719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08bc106f10 0x7f08bc10ea90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:50.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.746+0000 7f08c3ca5640 1 --2- 172.21.15.27:0/2347509719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08bc102790 0x7f08bc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:50.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.746+0000 7f08c3ca5640 1 --2- 172.21.15.27:0/2347509719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08bc101de0 0x7f08bc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:50.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.746+0000 7f08c3ca5640 1 -- 172.21.15.27:0/2347509719 >> 172.21.15.27:0/2347509719 conn(0x7f08bc0fd8e0 msgr2=0x7f08bc0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:50.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.746+0000 7f08c3ca5640 1 -- 172.21.15.27:0/2347509719 shutdown_connections 2024-09-19T08:10:50.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.746+0000 7f08c3ca5640 1 -- 172.21.15.27:0/2347509719 wait complete. 2024-09-19T08:10:50.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.746+0000 7f08c3ca5640 1 Processor -- start 2024-09-19T08:10:50.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.746+0000 7f08c3ca5640 1 -- start start 2024-09-19T08:10:50.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.747+0000 7f08c3ca5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08bc101de0 0x7f08bc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:50.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.747+0000 7f08c3ca5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08bc102790 0x7f08bc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:50.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.747+0000 7f08c3ca5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08bc106f10 0x7f08bc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.747+0000 7f08c3ca5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f08bc111f70 con 0x7f08bc106f10 2024-09-19T08:10:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.747+0000 7f08c3ca5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f08bc111df0 con 0x7f08bc102790 2024-09-19T08:10:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.747+0000 7f08c3ca5640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f08bc1120f0 con 0x7f08bc101de0 2024-09-19T08:10:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.747+0000 7f08c2242640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08bc106f10 0x7f08bc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.747+0000 7f08c2242640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08bc106f10 0x7f08bc074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59076/0 (socket says 172.21.15.27:59076) 2024-09-19T08:10:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.747+0000 7f08c2242640 1 -- 172.21.15.27:0/149800451 learned_addr learned my addr 172.21.15.27:0/149800451 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.747+0000 7f08c1240640 1 --2- 172.21.15.27:0/149800451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08bc102790 0x7f08bc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.747+0000 7f08c2242640 1 -- 172.21.15.27:0/149800451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08bc101de0 msgr2=0x7f08bc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.747+0000 7f08c2242640 1 --2- 172.21.15.27:0/149800451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08bc101de0 0x7f08bc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.747+0000 7f08c2242640 1 -- 172.21.15.27:0/149800451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08bc102790 msgr2=0x7f08bc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.747+0000 7f08c2242640 1 --2- 172.21.15.27:0/149800451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08bc102790 0x7f08bc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.747+0000 7f08c2242640 1 -- 172.21.15.27:0/149800451 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08bc1a6870 con 0x7f08bc106f10 2024-09-19T08:10:50.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.747+0000 7f08c2242640 1 --2- 172.21.15.27:0/149800451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08bc106f10 0x7f08bc074f70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f08b4031a20 tx=0x7f08b4031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:50.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.747+0000 7f08b2ffd640 1 -- 172.21.15.27:0/149800451 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b4003c30 con 0x7f08bc106f10 2024-09-19T08:10:50.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.747+0000 7f08b2ffd640 1 -- 172.21.15.27:0/149800451 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08b4003dd0 con 0x7f08bc106f10 2024-09-19T08:10:50.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.747+0000 7f08c3ca5640 1 -- 172.21.15.27:0/149800451 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08bc1a6b00 con 0x7f08bc106f10 2024-09-19T08:10:50.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.747+0000 7f08b2ffd640 1 -- 172.21.15.27:0/149800451 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b402fc40 con 0x7f08bc106f10 2024-09-19T08:10:50.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.748+0000 7f08c3ca5640 1 -- 172.21.15.27:0/149800451 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08bc1a7040 con 0x7f08bc106f10 2024-09-19T08:10:50.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.749+0000 7f08c3ca5640 1 -- 172.21.15.27:0/149800451 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08bc1021c0 con 0x7f08bc106f10 2024-09-19T08:10:50.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.750+0000 7f08b2ffd640 1 -- 172.21.15.27:0/149800451 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f08b4004b40 con 0x7f08bc106f10 2024-09-19T08:10:50.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.750+0000 7f08b2ffd640 1 --2- 172.21.15.27:0/149800451 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f08a80a3240 0x7f08a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:50.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.751+0000 7f08c1a41640 1 --2- 172.21.15.27:0/149800451 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f08a80a3240 0x7f08a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:50.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.751+0000 7f08b2ffd640 1 -- 172.21.15.27:0/149800451 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f08b40f0d00 con 0x7f08bc106f10 2024-09-19T08:10:50.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.751+0000 7f08c1a41640 1 --2- 172.21.15.27:0/149800451 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f08a80a3240 0x7f08a80a5700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f08b8005fd0 tx=0x7f08b8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:50.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.754+0000 7f08b2ffd640 1 -- 172.21.15.27:0/149800451 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f08b40bdb70 con 0x7f08bc106f10 2024-09-19T08:10:50.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.964+0000 7f08c3ca5640 1 -- 172.21.15.27:0/149800451 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08bc075a20 con 0x7f08bc106f10 2024-09-19T08:10:50.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.965+0000 7f08b2ffd640 1 -- 172.21.15.27:0/149800451 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f08b40bd470 con 0x7f08bc106f10 2024-09-19T08:10:50.965 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:10:50.966 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:10:50.966 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:10:50.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.967+0000 7f08c3ca5640 1 -- 172.21.15.27:0/149800451 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f08a80a3240 msgr2=0x7f08a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:50.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.967+0000 7f08c3ca5640 1 --2- 172.21.15.27:0/149800451 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f08a80a3240 0x7f08a80a5700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f08b8005fd0 tx=0x7f08b8005850 comp rx=0 tx=0).stop 2024-09-19T08:10:50.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.967+0000 7f08c3ca5640 1 -- 172.21.15.27:0/149800451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08bc106f10 msgr2=0x7f08bc074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:50.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.967+0000 7f08c3ca5640 1 --2- 172.21.15.27:0/149800451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08bc106f10 0x7f08bc074f70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f08b4031a20 tx=0x7f08b4031a50 comp rx=0 tx=0).stop 2024-09-19T08:10:50.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.967+0000 7f08c3ca5640 1 -- 172.21.15.27:0/149800451 shutdown_connections 2024-09-19T08:10:50.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.967+0000 7f08c3ca5640 1 --2- 172.21.15.27:0/149800451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08bc106f10 0x7f08bc074f70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:50.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.967+0000 7f08c3ca5640 1 --2- 172.21.15.27:0/149800451 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f08a80a3240 0x7f08a80a5700 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:50.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.967+0000 7f08c3ca5640 1 --2- 172.21.15.27:0/149800451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08bc102790 0x7f08bc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:50.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.967+0000 7f08c3ca5640 1 --2- 172.21.15.27:0/149800451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08bc101de0 0x7f08bc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:50.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.967+0000 7f08c3ca5640 1 -- 172.21.15.27:0/149800451 >> 172.21.15.27:0/149800451 conn(0x7f08bc0fd8e0 msgr2=0x7f08bc0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:50.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.967+0000 7f08c3ca5640 1 -- 172.21.15.27:0/149800451 shutdown_connections 2024-09-19T08:10:50.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:50.967+0000 7f08c3ca5640 1 -- 172.21.15.27:0/149800451 wait complete. 2024-09-19T08:10:51.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:51 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/149800451' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:10:51.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:51 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/149800451' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:10:51.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:51 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/149800451' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:10:51.668 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:10:51.928 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:52.339 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:52 smithi027 ceph-mon[31209]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:10:52.409 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:52 smithi203 ceph-mon[35198]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:10:52.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.420+0000 7f4b88dc4640 1 -- 172.21.15.27:0/3957371282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b84101de0 msgr2=0x7f4b841021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.420+0000 7f4b88dc4640 1 --2- 172.21.15.27:0/3957371282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b84101de0 0x7f4b841021c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009900 tx=0x7f4b7402a410 comp rx=0 tx=0).stop 2024-09-19T08:10:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.420+0000 7f4b88dc4640 1 -- 172.21.15.27:0/3957371282 shutdown_connections 2024-09-19T08:10:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.420+0000 7f4b88dc4640 1 --2- 172.21.15.27:0/3957371282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b84106f10 0x7f4b8410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.420+0000 7f4b88dc4640 1 --2- 172.21.15.27:0/3957371282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b84102790 0x7f4b841067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.420+0000 7f4b88dc4640 1 --2- 172.21.15.27:0/3957371282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b84101de0 0x7f4b841021c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.420+0000 7f4b88dc4640 1 -- 172.21.15.27:0/3957371282 >> 172.21.15.27:0/3957371282 conn(0x7f4b840fd8c0 msgr2=0x7f4b840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.420+0000 7f4b88dc4640 1 -- 172.21.15.27:0/3957371282 shutdown_connections 2024-09-19T08:10:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.420+0000 7f4b88dc4640 1 -- 172.21.15.27:0/3957371282 wait complete. 2024-09-19T08:10:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.421+0000 7f4b88dc4640 1 Processor -- start 2024-09-19T08:10:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.421+0000 7f4b88dc4640 1 -- start start 2024-09-19T08:10:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.421+0000 7f4b88dc4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b84101de0 0x7f4b84198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.421+0000 7f4b88dc4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b84102790 0x7f4b841989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.421+0000 7f4b88dc4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b84106f10 0x7f4b8419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.421+0000 7f4b88dc4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4b84111f70 con 0x7f4b84102790 2024-09-19T08:10:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.421+0000 7f4b88dc4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4b84111df0 con 0x7f4b84101de0 2024-09-19T08:10:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.421+0000 7f4b88dc4640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4b841120f0 con 0x7f4b84106f10 2024-09-19T08:10:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.421+0000 7f4b81d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b84102790 0x7f4b841989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.422+0000 7f4b81d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b84102790 0x7f4b841989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59086/0 (socket says 172.21.15.27:59086) 2024-09-19T08:10:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.422+0000 7f4b81d9b640 1 -- 172.21.15.27:0/674665773 learned_addr learned my addr 172.21.15.27:0/674665773 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.422+0000 7f4b82d9d640 1 --2- 172.21.15.27:0/674665773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b84106f10 0x7f4b8419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.422+0000 7f4b8259c640 1 --2- 172.21.15.27:0/674665773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b84101de0 0x7f4b84198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.422+0000 7f4b81d9b640 1 -- 172.21.15.27:0/674665773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b84106f10 msgr2=0x7f4b8419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:52.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.422+0000 7f4b81d9b640 1 --2- 172.21.15.27:0/674665773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b84106f10 0x7f4b8419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:52.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.422+0000 7f4b81d9b640 1 -- 172.21.15.27:0/674665773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b84101de0 msgr2=0x7f4b84198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:52.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.422+0000 7f4b81d9b640 1 --2- 172.21.15.27:0/674665773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b84101de0 0x7f4b84198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:52.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.422+0000 7f4b81d9b640 1 -- 172.21.15.27:0/674665773 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8419d420 con 0x7f4b84102790 2024-09-19T08:10:52.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.422+0000 7f4b82d9d640 1 --2- 172.21.15.27:0/674665773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b84106f10 0x7f4b8419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:10:52.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.422+0000 7f4b81d9b640 1 --2- 172.21.15.27:0/674665773 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b84102790 0x7f4b841989b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800c970 tx=0x7f4b7800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:52.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.422+0000 7f4b737fe640 1 -- 172.21.15.27:0/674665773 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b78007bb0 con 0x7f4b84102790 2024-09-19T08:10:52.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.422+0000 7f4b88dc4640 1 -- 172.21.15.27:0/674665773 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b8419d710 con 0x7f4b84102790 2024-09-19T08:10:52.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.422+0000 7f4b737fe640 1 -- 172.21.15.27:0/674665773 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b78007d50 con 0x7f4b84102790 2024-09-19T08:10:52.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.422+0000 7f4b737fe640 1 -- 172.21.15.27:0/674665773 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7800f450 con 0x7f4b84102790 2024-09-19T08:10:52.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.422+0000 7f4b88dc4640 1 -- 172.21.15.27:0/674665773 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b841a4ff0 con 0x7f4b84102790 2024-09-19T08:10:52.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.423+0000 7f4b88dc4640 1 -- 172.21.15.27:0/674665773 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b841021c0 con 0x7f4b84102790 2024-09-19T08:10:52.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.424+0000 7f4b737fe640 1 -- 172.21.15.27:0/674665773 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4b78004fe0 con 0x7f4b84102790 2024-09-19T08:10:52.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.425+0000 7f4b737fe640 1 --2- 172.21.15.27:0/674665773 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f4b6c0a3240 0x7f4b6c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:52.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.425+0000 7f4b737fe640 1 -- 172.21.15.27:0/674665773 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f4b780cfb60 con 0x7f4b84102790 2024-09-19T08:10:52.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.425+0000 7f4b8259c640 1 --2- 172.21.15.27:0/674665773 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f4b6c0a3240 0x7f4b6c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:52.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.426+0000 7f4b8259c640 1 --2- 172.21.15.27:0/674665773 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f4b6c0a3240 0x7f4b6c0a5700 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4b740096c0 tx=0x7f4b74000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:52.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.428+0000 7f4b737fe640 1 -- 172.21.15.27:0/674665773 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4b78014030 con 0x7f4b84102790 2024-09-19T08:10:52.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:52 smithi155 ceph-mon[35362]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:10:52.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.606+0000 7f4b88dc4640 1 -- 172.21.15.27:0/674665773 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b841997d0 con 0x7f4b84102790 2024-09-19T08:10:52.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.608+0000 7f4b737fe640 1 -- 172.21.15.27:0/674665773 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22650 (secure 0 0 0) 0x7f4b7809c8b0 con 0x7f4b84102790 2024-09-19T08:10:52.609 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:10:52.609 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":83,"fsid":"35b531b0-765d-11ef-bceb-c7b262605968","created":"2024-09-19T08:01:20.929241+0000","modified":"2024-09-19T08:10:14.777420+0000","last_up_change":"2024-09-19T08:08:17.919001+0000","last_in_change":"2024-09-19T08:07:54.277124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:04:29.312984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:09:08.046858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:09:10.223258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66fd6732-4cac-4eda-bf06-50638995ee80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6803","nonce":3645201250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6805","nonce":3645201250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6809","nonce":3645201250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6807","nonce":3645201250}]},"public_addr":"172.21.15.27:6803/3645201250","cluster_addr":"172.21.15.27:6805/3645201250","heartbeat_back_addr":"172.21.15.27:6809/3645201250","heartbeat_front_addr":"172.21.15.27:6807/3645201250","state":["exists","up"]},{"osd":1,"uuid":"36628767-66ac-433b-938e-10e75b51a877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6801","nonce":3977510449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6803","nonce":3977510449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6807","nonce":3977510449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6805","nonce":3977510449}]},"public_addr":"172.21.15.155:6801/3977510449","cluster_addr":"172.21.15.155:6803/3977510449","heartbeat_back_addr":"172.21.15.155:6807/3977510449","heartbeat_front_addr":"172.21.15.155:6805/3977510449","state":["exists","up"]},{"osd":2,"uuid":"3dc80404-a56b-456a-af02-f01e9c6c6dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6801","nonce":3796057016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6803","nonce":3796057016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6807","nonce":3796057016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6805","nonce":3796057016}]},"public_addr":"172.21.15.203:6801/3796057016","cluster_addr":"172.21.15.203:6803/3796057016","heartbeat_back_addr":"172.21.15.203:6807/3796057016","heartbeat_front_addr":"172.21.15.203:6805/3796057016","state":["exists","up"]},{"osd":3,"uuid":"a51077d0-5e04-49b5-bb3e-91711cc45ff1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6811","nonce":1608304347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6813","nonce":1608304347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6817","nonce":1608304347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6815","nonce":1608304347}]},"public_addr":"172.21.15.27:6811/1608304347","cluster_addr":"172.21.15.27:6813/1608304347","heartbeat_back_addr":"172.21.15.27:6817/1608304347","heartbeat_front_addr":"172.21.15.27:6815/1608304347","state":["exists","up"]},{"osd":4,"uuid":"0df35548-90b4-434d-8d7e-c037072c9ae4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6809","nonce":569913150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6811","nonce":569913150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6815","nonce":569913150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6813","nonce":569913150}]},"public_addr":"172.21.15.155:6809/569913150","cluster_addr":"172.21.15.155:6811/569913150","heartbeat_back_addr":"172.21.15.155:6815/569913150","heartbeat_front_addr":"172.21.15.155:6813/569913150","state":["exists","up"]},{"osd":5,"uuid":"de193c5f-1019-43e5-9f4f-6c2aaa4330e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6809","nonce":991491203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6811","nonce":991491203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6815","nonce":991491203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6813","nonce":991491203}]},"public_addr":"172.21.15.203:6809/991491203","cluster_addr":"172.21.15.203:6811/991491203","heartbeat_back_addr":"172.21.15.203:6815/991491203","heartbeat_front_addr":"172.21.15.203:6813/991491203","state":["exists","up"]},{"osd":6,"uuid":"28938e4f-9f22-466f-8cf7-62ee56a0c926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6819","nonce":3516868131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6821","nonce":3516868131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6825","nonce":3516868131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6823","nonce":3516868131}]},"public_addr":"172.21.15.27:6819/3516868131","cluster_addr":"172.21.15.27:6821/3516868131","heartbeat_back_addr":"172.21.15.27:6825/3516868131","heartbeat_front_addr":"172.21.15.27:6823/3516868131","state":["exists","up"]},{"osd":7,"uuid":"855f1728-be52-4445-8561-a90c08f2b2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6817","nonce":2047506436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6819","nonce":2047506436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6823","nonce":2047506436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6821","nonce":2047506436}]},"public_addr":"172.21.15.155:6817/2047506436","cluster_addr":"172.21.15.155:6819/2047506436","heartbeat_back_addr":"172.21.15.155:6823/2047506436","heartbeat_front_addr":"172.21.15.155:6821/2047506436","state":["exists","up"]},{"osd":8,"uuid":"5d7a8ffd-a039-403e-8b9a-c80e19fd67ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6817","nonce":199970687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6819","nonce":199970687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6823","nonce":199970687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6821","nonce":199970687}]},"public_addr":"172.21.15.203:6817/199970687","cluster_addr":"172.21.15.203:6819/199970687","heartbeat_back_addr":"172.21.15.203:6823/199970687","heartbeat_front_addr":"172.21.15.203:6821/199970687","state":["exists","up"]},{"osd":9,"uuid":"cdb90242-80a1-4cef-b5e3-ddecb05664e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6827","nonce":118390483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6829","nonce":118390483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6833","nonce":118390483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6831","nonce":118390483}]},"public_addr":"172.21.15.27:6827/118390483","cluster_addr":"172.21.15.27:6829/118390483","heartbeat_back_addr":"172.21.15.27:6833/118390483","heartbeat_front_addr":"172.21.15.27:6831/118390483","state":["exists","up"]},{"osd":10,"uuid":"c7f4c9da-d913-47a5-8629-53de21efe8c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6825","nonce":1687418565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6827","nonce":1687418565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6831","nonce":1687418565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6829","nonce":1687418565}]},"public_addr":"172.21.15.155:6825/1687418565","cluster_addr":"172.21.15.155:6827/1687418565","heartbeat_back_addr":"172.21.15.155:6831/1687418565","heartbeat_front_addr":"172.21.15.155:6829/1687418565","state":["exists","up"]},{"osd":11,"uuid":"45c11a90-585e-46fa-a5a0-51a29e29eba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6825","nonce":224768827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6827","nonce":224768827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6831","nonce":224768827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6829","nonce":224768827}]},"public_addr":"172.21.15.203:6825/224768827","cluster_addr":"172.21.15.203:6827/224768827","heartbeat_back_addr":"172.21.15.203:6831/224768827","heartbeat_front_addr":"172.21.15.203:6829/224768827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:03:35.559549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:00.526006+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:25.809346+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:51.889445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:17.246017+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:43.515854+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:08.638182+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:34.653060+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:59.469837+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:26.122937+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:50.196159+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:08:16.245770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:6800/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/958829150":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1174736321":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1908865720":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/416476667":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6800/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/1717932879":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1963219497":"2024-09-20T08:01:48.686812+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:10:52.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.610+0000 7f4b88dc4640 1 -- 172.21.15.27:0/674665773 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f4b6c0a3240 msgr2=0x7f4b6c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:52.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.610+0000 7f4b88dc4640 1 --2- 172.21.15.27:0/674665773 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f4b6c0a3240 0x7f4b6c0a5700 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4b740096c0 tx=0x7f4b74000bc0 comp rx=0 tx=0).stop 2024-09-19T08:10:52.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.610+0000 7f4b88dc4640 1 -- 172.21.15.27:0/674665773 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b84102790 msgr2=0x7f4b841989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:52.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.610+0000 7f4b88dc4640 1 --2- 172.21.15.27:0/674665773 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b84102790 0x7f4b841989b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800c970 tx=0x7f4b7800ce30 comp rx=0 tx=0).stop 2024-09-19T08:10:52.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.610+0000 7f4b88dc4640 1 -- 172.21.15.27:0/674665773 shutdown_connections 2024-09-19T08:10:52.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.610+0000 7f4b88dc4640 1 --2- 172.21.15.27:0/674665773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b84106f10 0x7f4b8419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:52.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.610+0000 7f4b88dc4640 1 --2- 172.21.15.27:0/674665773 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b84102790 0x7f4b841989b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:52.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.610+0000 7f4b88dc4640 1 --2- 172.21.15.27:0/674665773 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f4b6c0a3240 0x7f4b6c0a5700 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:52.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.610+0000 7f4b88dc4640 1 --2- 172.21.15.27:0/674665773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b84101de0 0x7f4b84198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:52.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.610+0000 7f4b88dc4640 1 -- 172.21.15.27:0/674665773 >> 172.21.15.27:0/674665773 conn(0x7f4b840fd8c0 msgr2=0x7f4b840fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:52.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.610+0000 7f4b88dc4640 1 -- 172.21.15.27:0/674665773 shutdown_connections 2024-09-19T08:10:52.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:52.610+0000 7f4b88dc4640 1 -- 172.21.15.27:0/674665773 wait complete. 2024-09-19T08:10:53.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:53 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/674665773' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:10:53.443 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T08:09:11.930032+0000', 'modified': '2024-09-19T08:09:20.890507+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24482}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24466': {'gid': 24466, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.203:6839/1481040099', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6838', 'nonce': 1481040099}, {'type': 'v1', 'addr': '172.21.15.203:6839', 'nonce': 1481040099}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.155:6839/1929184836', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6838', 'nonce': 1929184836}, {'type': 'v1', 'addr': '172.21.15.155:6839', 'nonce': 1929184836}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24482, 'qdb_cluster': [24482]} 2024-09-19T08:10:53.443 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T08:10:53.443 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T08:10:53.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:53 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/674665773' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:10:53.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:53 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/674665773' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:10:53.703 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:54.091 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:54 smithi027 ceph-mon[31209]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:10:54.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.176+0000 7f1468d2e640 1 -- 172.21.15.27:0/1792297256 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1464102570 msgr2=0x7f14641029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:54.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.176+0000 7f1468d2e640 1 --2- 172.21.15.27:0/1792297256 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1464102570 0x7f14641029b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f144c009900 tx=0x7f144c02a480 comp rx=0 tx=0).stop 2024-09-19T08:10:54.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.176+0000 7f1468d2e640 1 -- 172.21.15.27:0/1792297256 shutdown_connections 2024-09-19T08:10:54.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.176+0000 7f1468d2e640 1 --2- 172.21.15.27:0/1792297256 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1464102ef0 0x7f146410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.176+0000 7f1468d2e640 1 --2- 172.21.15.27:0/1792297256 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1464102570 0x7f14641029b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.176+0000 7f1468d2e640 1 --2- 172.21.15.27:0/1792297256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1464100e20 0x7f1464101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.176+0000 7f1468d2e640 1 -- 172.21.15.27:0/1792297256 >> 172.21.15.27:0/1792297256 conn(0x7f14640fc7d0 msgr2=0x7f14640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:54.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.176+0000 7f1468d2e640 1 -- 172.21.15.27:0/1792297256 shutdown_connections 2024-09-19T08:10:54.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.176+0000 7f1468d2e640 1 -- 172.21.15.27:0/1792297256 wait complete. 2024-09-19T08:10:54.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.177+0000 7f1468d2e640 1 Processor -- start 2024-09-19T08:10:54.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.177+0000 7f1468d2e640 1 -- start start 2024-09-19T08:10:54.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.177+0000 7f1468d2e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1464100e20 0x7f14640fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:54.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.177+0000 7f1468d2e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1464102570 0x7f14640fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:54.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.177+0000 7f1468d2e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1464102ef0 0x7f14640fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:54.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.177+0000 7f1468d2e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1464110fa0 con 0x7f1464102ef0 2024-09-19T08:10:54.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.177+0000 7f1468d2e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1464110e20 con 0x7f1464102570 2024-09-19T08:10:54.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.177+0000 7f1468d2e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1464111120 con 0x7f1464100e20 2024-09-19T08:10:54.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.177+0000 7f1462d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1464102ef0 0x7f14640fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:54.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.177+0000 7f1462d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1464102ef0 0x7f14640fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59112/0 (socket says 172.21.15.27:59112) 2024-09-19T08:10:54.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.177+0000 7f1462d9d640 1 -- 172.21.15.27:0/2791549851 learned_addr learned my addr 172.21.15.27:0/2791549851 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:54.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.177+0000 7f1461d9b640 1 --2- 172.21.15.27:0/2791549851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1464102570 0x7f14640fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:54.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.177+0000 7f146259c640 1 --2- 172.21.15.27:0/2791549851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1464100e20 0x7f14640fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:54.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.177+0000 7f1462d9d640 1 -- 172.21.15.27:0/2791549851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1464100e20 msgr2=0x7f14640fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:54.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.177+0000 7f1462d9d640 1 --2- 172.21.15.27:0/2791549851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1464100e20 0x7f14640fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.177+0000 7f1462d9d640 1 -- 172.21.15.27:0/2791549851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1464102570 msgr2=0x7f14640fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:54.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.177+0000 7f1462d9d640 1 --2- 172.21.15.27:0/2791549851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1464102570 0x7f14640fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.177+0000 7f1462d9d640 1 -- 172.21.15.27:0/2791549851 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14641a6a20 con 0x7f1464102ef0 2024-09-19T08:10:54.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.177+0000 7f146259c640 1 --2- 172.21.15.27:0/2791549851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1464100e20 0x7f14640fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:10:54.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.178+0000 7f1462d9d640 1 --2- 172.21.15.27:0/2791549851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1464102ef0 0x7f14640fd700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1454009fd0 tx=0x7f145400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:54.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.178+0000 7f145b7fe640 1 -- 172.21.15.27:0/2791549851 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1454011830 con 0x7f1464102ef0 2024-09-19T08:10:54.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.178+0000 7f145b7fe640 1 -- 172.21.15.27:0/2791549851 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1454016070 con 0x7f1464102ef0 2024-09-19T08:10:54.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.178+0000 7f1468d2e640 1 -- 172.21.15.27:0/2791549851 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14641a6d10 con 0x7f1464102ef0 2024-09-19T08:10:54.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.178+0000 7f145b7fe640 1 -- 172.21.15.27:0/2791549851 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145400f2e0 con 0x7f1464102ef0 2024-09-19T08:10:54.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.178+0000 7f1468d2e640 1 -- 172.21.15.27:0/2791549851 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14641a7270 con 0x7f1464102ef0 2024-09-19T08:10:54.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.180+0000 7f145b7fe640 1 -- 172.21.15.27:0/2791549851 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f14540119d0 con 0x7f1464102ef0 2024-09-19T08:10:54.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.180+0000 7f146b107740 1 Processor -- start 2024-09-19T08:10:54.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.181+0000 7f146b107740 1 -- start start 2024-09-19T08:10:54.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.181+0000 7f146b107740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd466fb9d0 0x55dd466fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:54.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.181+0000 7f146b107740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd466fc2f0 0x55dd46706670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:54.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.181+0000 7f146b107740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd46706bb0 0x55dd46708fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:54.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.181+0000 7f146b107740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55dd46662090 con 0x55dd46706bb0 2024-09-19T08:10:54.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.181+0000 7f146b107740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55dd46609a70 con 0x55dd466fb9d0 2024-09-19T08:10:54.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.181+0000 7f146b107740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55dd4665e050 con 0x55dd466fc2f0 2024-09-19T08:10:54.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.181+0000 7f1461d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd46706bb0 0x55dd46708fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:54.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.181+0000 7f1461d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd46706bb0 0x55dd46708fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59128/0 (socket says 172.21.15.27:59128) 2024-09-19T08:10:54.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.181+0000 7f145b7fe640 1 --2- 172.21.15.27:0/2791549851 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f14500a32c0 0x7f14500a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:54.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.181+0000 7f1461d9b640 1 -- 172.21.15.27:0/3187653816 learned_addr learned my addr 172.21.15.27:0/3187653816 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:54.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.181+0000 7f146259c640 1 --2- 172.21.15.27:0/3187653816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd466fc2f0 0x55dd46706670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:54.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.181+0000 7f1462d9d640 1 --2- 172.21.15.27:0/2791549851 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f14500a32c0 0x7f14500a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:54.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.181+0000 7f1461d9b640 1 --2- 172.21.15.27:0/3187653816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd466fb9d0 0x55dd466fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:54.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.181+0000 7f1461d9b640 1 -- 172.21.15.27:0/3187653816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd466fc2f0 msgr2=0x55dd46706670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:10:54.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.181+0000 7f1461d9b640 1 --2- 172.21.15.27:0/3187653816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd466fc2f0 0x55dd46706670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.181+0000 7f1461d9b640 1 -- 172.21.15.27:0/3187653816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd466fb9d0 msgr2=0x55dd466fbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:10:54.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.181+0000 7f1461d9b640 1 --2- 172.21.15.27:0/3187653816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd466fb9d0 0x55dd466fbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.181+0000 7f1461d9b640 1 -- 172.21.15.27:0/3187653816 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd46616130 con 0x55dd46706bb0 2024-09-19T08:10:54.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.181+0000 7f145b7fe640 1 -- 172.21.15.27:0/2791549851 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f14540cee70 con 0x7f1464102ef0 2024-09-19T08:10:54.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.182+0000 7f1461d9b640 1 --2- 172.21.15.27:0/3187653816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd46706bb0 0x55dd46708fa0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f144c009900 tx=0x7f144c005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78cd9e3f236c0104 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:54.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.182+0000 7f1462d9d640 1 --2- 172.21.15.27:0/2791549851 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f14500a32c0 0x7f14500a5780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1454000c00 tx=0x7f145406b130 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:54.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.182+0000 7f1458ff9640 1 -- 172.21.15.27:0/3187653816 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c035040 con 0x55dd46706bb0 2024-09-19T08:10:54.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.182+0000 7f1458ff9640 1 -- 172.21.15.27:0/3187653816 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f144c003d50 con 0x55dd46706bb0 2024-09-19T08:10:54.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.182+0000 7f1458ff9640 1 -- 172.21.15.27:0/3187653816 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c03d480 con 0x55dd46706bb0 2024-09-19T08:10:54.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.183+0000 7f146b107740 1 -- 172.21.15.27:0/3187653816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd46706bb0 msgr2=0x55dd46708fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:54.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.183+0000 7f146b107740 1 --2- 172.21.15.27:0/3187653816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd46706bb0 0x55dd46708fa0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f144c009900 tx=0x7f144c005c00 comp rx=0 tx=0).stop 2024-09-19T08:10:54.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.183+0000 7f146b107740 1 -- 172.21.15.27:0/3187653816 shutdown_connections 2024-09-19T08:10:54.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.183+0000 7f146b107740 1 --2- 172.21.15.27:0/3187653816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd46706bb0 0x55dd46708fa0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.183+0000 7f146b107740 1 --2- 172.21.15.27:0/3187653816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd466fc2f0 0x55dd46706670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.183+0000 7f146b107740 1 --2- 172.21.15.27:0/3187653816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd466fb9d0 0x55dd466fbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.183+0000 7f146b107740 1 -- 172.21.15.27:0/3187653816 >> 172.21.15.27:0/3187653816 conn(0x55dd466f7f60 msgr2=0x55dd466f8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:54.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.183+0000 7f146b107740 1 -- 172.21.15.27:0/3187653816 shutdown_connections 2024-09-19T08:10:54.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.183+0000 7f146b107740 1 -- 172.21.15.27:0/3187653816 wait complete. 2024-09-19T08:10:54.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.183+0000 7f146b107740 1 -- start start 2024-09-19T08:10:54.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.183+0000 7f146b107740 1 Processor -- start 2024-09-19T08:10:54.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f146b107740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd466fb9d0 0x55dd46706410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:54.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f146b107740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd466fc2f0 0x55dd46703760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:54.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f146b107740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd46706bb0 0x55dd46703ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:54.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f146b107740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55dd46709780 con 0x55dd466fc2f0 2024-09-19T08:10:54.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f146b107740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55dd4661cf20 con 0x55dd46706bb0 2024-09-19T08:10:54.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f146b107740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55dd46709900 con 0x55dd466fb9d0 2024-09-19T08:10:54.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f146b107740 10 client.0 _ll_register_callbacks cb 0x55dd465e6030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:10:54.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f146259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd466fc2f0 0x55dd46703760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:54.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f146259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd466fc2f0 0x55dd46703760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59144/0 (socket says 172.21.15.27:59144) 2024-09-19T08:10:54.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f146259c640 1 -- 172.21.15.27:0/2472344732 learned_addr learned my addr 172.21.15.27:0/2472344732 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:54.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f1461d9b640 1 --2- 172.21.15.27:0/2472344732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd46706bb0 0x55dd46703ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:54.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f1461d9b640 1 --2- 172.21.15.27:0/2472344732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd466fb9d0 0x55dd46706410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:54.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f146259c640 1 -- 172.21.15.27:0/2472344732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd466fb9d0 msgr2=0x55dd46706410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:10:54.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f146259c640 1 --2- 172.21.15.27:0/2472344732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd466fb9d0 0x55dd46706410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f146259c640 1 -- 172.21.15.27:0/2472344732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd46706bb0 msgr2=0x55dd46703ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:10:54.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f146259c640 1 --2- 172.21.15.27:0/2472344732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd46706bb0 0x55dd46703ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f146259c640 1 -- 172.21.15.27:0/2472344732 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd463d32b0 con 0x55dd466fc2f0 2024-09-19T08:10:54.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f146259c640 1 --2- 172.21.15.27:0/2472344732 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd466fc2f0 0x55dd46703760 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f145c012a70 tx=0x7f145c012f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d20c3aa0fc2eaa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:54.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f1449ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:10:54.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f1449ffb640 1 -- 172.21.15.27:0/2472344732 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c010ba0 con 0x55dd466fc2f0 2024-09-19T08:10:54.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f1449ffb640 1 -- 172.21.15.27:0/2472344732 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f145c010d40 con 0x55dd466fc2f0 2024-09-19T08:10:54.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.184+0000 7f146b107740 1 -- 172.21.15.27:0/2472344732 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f144c003d50 con 0x55dd466fc2f0 2024-09-19T08:10:54.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.185+0000 7f1449ffb640 1 -- 172.21.15.27:0/2472344732 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f145c003970 con 0x55dd466fc2f0 2024-09-19T08:10:54.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.185+0000 7f146b107740 10 client.15063 fetch_fsmap learned FSMap version 20 2024-09-19T08:10:54.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.185+0000 7f146b107740 1 -- 172.21.15.27:0/2472344732 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dd46715130 con 0x55dd466fc2f0 2024-09-19T08:10:54.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.185+0000 7f1449ffb640 1 -- 172.21.15.27:0/2472344732 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f144c003d50 con 0x55dd466fc2f0 2024-09-19T08:10:54.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.185+0000 7f1449ffb640 1 -- 172.21.15.27:0/2472344732 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f145c01a6e0 con 0x55dd466fc2f0 2024-09-19T08:10:54.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.185+0000 7f146b107740 10 client.15063 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:10:54.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.185+0000 7f146b107740 10 client.15063 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:10:54.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.185+0000 7f146b107740 20 client.15063 populate_metadata read hostname 'smithi027' 2024-09-19T08:10:54.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.185+0000 7f146b107740 1 --2- 172.21.15.27:0/2472344732 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55dd46717770 0x55dd46718be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:54.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.185+0000 7f146b107740 4 client.15063 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:10:54.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.185+0000 7f146b107740 1 -- 172.21.15.27:0/2472344732 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd4666f600 con 0x55dd46717770 2024-09-19T08:10:54.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.185+0000 7f1461d9b640 1 --2- 172.21.15.27:0/2472344732 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55dd46717770 0x55dd46718be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:54.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.186+0000 7f1461d9b640 1 --2- 172.21.15.27:0/2472344732 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55dd46717770 0x55dd46718be0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1674a46c2e0e2c0 server_cookie=642ad3b25eb6f671 in_seq=0 out_seq=0 2024-09-19T08:10:54.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.186+0000 7f1449ffb640 10 client.15063 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:10:54.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.186+0000 7f1449ffb640 1 -- 172.21.15.27:0/2472344732 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd4666f600 con 0x55dd46717770 2024-09-19T08:10:54.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.186+0000 7f1449ffb640 10 client.15063 handle_command_reply: tid=0 2024-09-19T08:10:54.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.187+0000 7f146b107740 1 client.15063 shutdown 2024-09-19T08:10:54.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.187+0000 7f146b107740 1 -- 172.21.15.27:0/2472344732 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd466fc2f0 msgr2=0x55dd46703760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:54.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.187+0000 7f146b107740 1 --2- 172.21.15.27:0/2472344732 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd466fc2f0 0x55dd46703760 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f145c012a70 tx=0x7f145c012f30 comp rx=0 tx=0).stop 2024-09-19T08:10:54.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.187+0000 7f146b107740 1 -- 172.21.15.27:0/2472344732 shutdown_connections 2024-09-19T08:10:54.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.187+0000 7f146b107740 1 --2- 172.21.15.27:0/2472344732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd46706bb0 0x55dd46703ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.187+0000 7f146b107740 1 --2- 172.21.15.27:0/2472344732 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd466fc2f0 0x55dd46703760 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.187+0000 7f146b107740 1 --2- 172.21.15.27:0/2472344732 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55dd46717770 0x55dd46718be0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.187+0000 7f146b107740 1 --2- 172.21.15.27:0/2472344732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd466fb9d0 0x55dd46706410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.187+0000 7f146b107740 1 -- 172.21.15.27:0/2472344732 >> 172.21.15.27:0/2472344732 conn(0x55dd466f7f60 msgr2=0x55dd466fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:54.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.187+0000 7f1449ffb640 0 client.15063 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:10:54.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.187+0000 7f146b107740 1 -- 172.21.15.27:0/2472344732 shutdown_connections 2024-09-19T08:10:54.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.187+0000 7f146b107740 1 -- 172.21.15.27:0/2472344732 wait complete. 2024-09-19T08:10:54.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.187+0000 7f146b107740 20 client.15063 trim_cache size 0 max 16384 2024-09-19T08:10:54.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.205+0000 7f146b107740 1 Processor -- start 2024-09-19T08:10:54.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.205+0000 7f146b107740 1 -- start start 2024-09-19T08:10:54.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.205+0000 7f146b107740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd466fb9d0 0x55dd467170a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:54.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.205+0000 7f146b107740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd466fc2f0 0x55dd46718510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:54.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.205+0000 7f146b107740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd46706bb0 0x55dd467009e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:54.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.205+0000 7f146b107740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55dd46716f20 con 0x55dd466fc2f0 2024-09-19T08:10:54.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.205+0000 7f146b107740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55dd467175f0 con 0x55dd46706bb0 2024-09-19T08:10:54.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.205+0000 7f146b107740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55dd46717cc0 con 0x55dd466fb9d0 2024-09-19T08:10:54.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.205+0000 7f146259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd466fc2f0 0x55dd46718510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:54.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.205+0000 7f146259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd466fc2f0 0x55dd46718510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59150/0 (socket says 172.21.15.27:59150) 2024-09-19T08:10:54.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.205+0000 7f146259c640 1 -- 172.21.15.27:0/1145117978 learned_addr learned my addr 172.21.15.27:0/1145117978 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:54.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.206+0000 7f1461d9b640 1 --2- 172.21.15.27:0/1145117978 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd466fb9d0 0x55dd467170a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:54.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.206+0000 7f1461d9b640 1 --2- 172.21.15.27:0/1145117978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd46706bb0 0x55dd467009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:54.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.206+0000 7f146259c640 1 -- 172.21.15.27:0/1145117978 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd466fb9d0 msgr2=0x55dd467170a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:10:54.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.206+0000 7f146259c640 1 --2- 172.21.15.27:0/1145117978 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd466fb9d0 0x55dd467170a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.206+0000 7f146259c640 1 -- 172.21.15.27:0/1145117978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd46706bb0 msgr2=0x55dd467009e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:10:54.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.206+0000 7f146259c640 1 --2- 172.21.15.27:0/1145117978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd46706bb0 0x55dd467009e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.206+0000 7f146259c640 1 -- 172.21.15.27:0/1145117978 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd467047a0 con 0x55dd466fc2f0 2024-09-19T08:10:54.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.206+0000 7f146259c640 1 --2- 172.21.15.27:0/1145117978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd466fc2f0 0x55dd46718510 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f145c005c40 tx=0x7f145c00ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af722d842453965 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:54.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.206+0000 7f144bfff640 1 -- 172.21.15.27:0/1145117978 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c010da0 con 0x55dd466fc2f0 2024-09-19T08:10:54.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.206+0000 7f144bfff640 1 -- 172.21.15.27:0/1145117978 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f145c01a410 con 0x55dd466fc2f0 2024-09-19T08:10:54.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.206+0000 7f144bfff640 1 -- 172.21.15.27:0/1145117978 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c005360 con 0x55dd466fc2f0 2024-09-19T08:10:54.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.207+0000 7f146b107740 1 -- 172.21.15.27:0/1145117978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd466fc2f0 msgr2=0x55dd46718510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:54.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.207+0000 7f146b107740 1 --2- 172.21.15.27:0/1145117978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd466fc2f0 0x55dd46718510 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f145c005c40 tx=0x7f145c00ad30 comp rx=0 tx=0).stop 2024-09-19T08:10:54.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.207+0000 7f146b107740 1 -- 172.21.15.27:0/1145117978 shutdown_connections 2024-09-19T08:10:54.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.207+0000 7f146b107740 1 --2- 172.21.15.27:0/1145117978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd46706bb0 0x55dd467009e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.207+0000 7f146b107740 1 --2- 172.21.15.27:0/1145117978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd466fc2f0 0x55dd46718510 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.207+0000 7f146b107740 1 --2- 172.21.15.27:0/1145117978 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd466fb9d0 0x55dd467170a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.207+0000 7f146b107740 1 -- 172.21.15.27:0/1145117978 >> 172.21.15.27:0/1145117978 conn(0x55dd466f7f60 msgr2=0x55dd466f8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:54.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.207+0000 7f146b107740 1 -- 172.21.15.27:0/1145117978 shutdown_connections 2024-09-19T08:10:54.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.207+0000 7f146b107740 1 -- 172.21.15.27:0/1145117978 wait complete. 2024-09-19T08:10:54.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.207+0000 7f146b107740 1 -- start start 2024-09-19T08:10:54.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.207+0000 7f146b107740 1 Processor -- start 2024-09-19T08:10:54.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.207+0000 7f146b107740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd466fb9d0 0x55dd466ffa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:54.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.207+0000 7f146b107740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd466fc2f0 0x55dd466fff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:54.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.207+0000 7f146b107740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd46706bb0 0x55dd467004d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:54.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.207+0000 7f146b107740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55dd46718a60 con 0x55dd46706bb0 2024-09-19T08:10:54.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f146b107740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55dd46718390 con 0x55dd466fc2f0 2024-09-19T08:10:54.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f146b107740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55dd46719130 con 0x55dd466fb9d0 2024-09-19T08:10:54.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f146b107740 10 client.0 _ll_register_callbacks cb 0x7f145c00aad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:10:54.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f1461d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd46706bb0 0x55dd467004d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:54.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f1461d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd46706bb0 0x55dd467004d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59160/0 (socket says 172.21.15.27:59160) 2024-09-19T08:10:54.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f1461d9b640 1 -- 172.21.15.27:0/3121293928 learned_addr learned my addr 172.21.15.27:0/3121293928 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:54.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f1461d9b640 1 --2- 172.21.15.27:0/3121293928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd466fb9d0 0x55dd466ffa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:54.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f146259c640 1 --2- 172.21.15.27:0/3121293928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd466fc2f0 0x55dd466fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:54.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f1461d9b640 1 -- 172.21.15.27:0/3121293928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd466fb9d0 msgr2=0x55dd466ffa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:10:54.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f1461d9b640 1 --2- 172.21.15.27:0/3121293928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd466fb9d0 0x55dd466ffa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f1461d9b640 1 -- 172.21.15.27:0/3121293928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd466fc2f0 msgr2=0x55dd466fff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:10:54.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f1461d9b640 1 --2- 172.21.15.27:0/3121293928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd466fc2f0 0x55dd466fff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f1461d9b640 1 -- 172.21.15.27:0/3121293928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd4671ffe0 con 0x55dd46706bb0 2024-09-19T08:10:54.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f1461d9b640 1 --2- 172.21.15.27:0/3121293928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd46706bb0 0x55dd467004d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f144c031b70 tx=0x7f144c055040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97eed21120b3a00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:54.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f1449ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:10:54.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f1449ffb640 1 -- 172.21.15.27:0/3121293928 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c035040 con 0x55dd46706bb0 2024-09-19T08:10:54.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f1449ffb640 1 -- 172.21.15.27:0/3121293928 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f144c003a00 con 0x55dd46706bb0 2024-09-19T08:10:54.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f146b107740 1 -- 172.21.15.27:0/3121293928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f145c01a410 con 0x55dd46706bb0 2024-09-19T08:10:54.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f1449ffb640 1 -- 172.21.15.27:0/3121293928 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f144c003c00 con 0x55dd46706bb0 2024-09-19T08:10:54.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f146b107740 10 client.15069 fetch_fsmap learned FSMap version 20 2024-09-19T08:10:54.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.208+0000 7f146b107740 1 -- 172.21.15.27:0/3121293928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dd467212e0 con 0x55dd46706bb0 2024-09-19T08:10:54.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.209+0000 7f1449ffb640 1 -- 172.21.15.27:0/3121293928 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f145c01a410 con 0x55dd46706bb0 2024-09-19T08:10:54.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.209+0000 7f1449ffb640 1 -- 172.21.15.27:0/3121293928 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f144c04b440 con 0x55dd46706bb0 2024-09-19T08:10:54.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.209+0000 7f146b107740 10 client.15069 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:10:54.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.209+0000 7f146b107740 10 client.15069 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:10:54.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.209+0000 7f146b107740 20 client.15069 populate_metadata read hostname 'smithi027' 2024-09-19T08:10:54.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.209+0000 7f146b107740 1 --2- 172.21.15.27:0/3121293928 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55dd46785b70 0x55dd46784880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:54.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.209+0000 7f146b107740 4 client.15069 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:10:54.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.209+0000 7f146b107740 1 -- 172.21.15.27:0/3121293928 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "status"}) -- 0x55dd46669b10 con 0x55dd46785b70 2024-09-19T08:10:54.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.209+0000 7f146259c640 1 --2- 172.21.15.27:0/3121293928 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55dd46785b70 0x55dd46784880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:54.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.210+0000 7f146259c640 1 --2- 172.21.15.27:0/3121293928 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55dd46785b70 0x55dd46784880 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=446561cf265c7f97 server_cookie=4042154463fd3a2a in_seq=0 out_seq=0 2024-09-19T08:10:54.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.210+0000 7f1449ffb640 10 client.15069 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:10:54.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.210+0000 7f1449ffb640 1 -- 172.21.15.27:0/3121293928 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55dd46669b10 con 0x55dd46785b70 2024-09-19T08:10:54.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.210+0000 7f1449ffb640 10 client.15069 handle_command_reply: tid=0 2024-09-19T08:10:54.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.210+0000 7f146b107740 1 client.15069 shutdown 2024-09-19T08:10:54.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.210+0000 7f146b107740 1 -- 172.21.15.27:0/3121293928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd46706bb0 msgr2=0x55dd467004d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:54.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.210+0000 7f146b107740 1 --2- 172.21.15.27:0/3121293928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd46706bb0 0x55dd467004d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f144c031b70 tx=0x7f144c055040 comp rx=0 tx=0).stop 2024-09-19T08:10:54.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.210+0000 7f146b107740 1 -- 172.21.15.27:0/3121293928 shutdown_connections 2024-09-19T08:10:54.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.210+0000 7f146b107740 1 --2- 172.21.15.27:0/3121293928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd46706bb0 0x55dd467004d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.210+0000 7f146b107740 1 --2- 172.21.15.27:0/3121293928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd466fc2f0 0x55dd466fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.210+0000 7f146b107740 1 --2- 172.21.15.27:0/3121293928 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55dd46785b70 0x55dd46784880 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.210+0000 7f146b107740 1 --2- 172.21.15.27:0/3121293928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd466fb9d0 0x55dd466ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.210+0000 7f1449ffb640 0 client.15069 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:10:54.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.210+0000 7f146b107740 1 -- 172.21.15.27:0/3121293928 >> 172.21.15.27:0/3121293928 conn(0x55dd466f7f60 msgr2=0x55dd466fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:54.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.210+0000 7f146b107740 1 -- 172.21.15.27:0/3121293928 shutdown_connections 2024-09-19T08:10:54.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.210+0000 7f146b107740 1 -- 172.21.15.27:0/3121293928 wait complete. 2024-09-19T08:10:54.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.210+0000 7f146b107740 20 client.15069 trim_cache size 0 max 16384 2024-09-19T08:10:54.220 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:10:54.220 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "35b531b0-765d-11ef-bceb-c7b262605968", 2024-09-19T08:10:54.220 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2024-09-19T08:10:54.221 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 24482, 2024-09-19T08:10:54.221 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2024-09-19T08:10:54.221 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2024-09-19T08:10:54.221 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2024-09-19T08:10:54.221 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 101.950063442, 2024-09-19T08:10:54.221 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 20, 2024-09-19T08:10:54.221 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 83, 2024-09-19T08:10:54.221 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T08:10:54.221 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 113.952211314 2024-09-19T08:10:54.221 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:10:54.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.211+0000 7f1468d2e640 1 -- 172.21.15.27:0/2791549851 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f14500a32c0 msgr2=0x7f14500a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:54.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.211+0000 7f1468d2e640 1 --2- 172.21.15.27:0/2791549851 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f14500a32c0 0x7f14500a5780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1454000c00 tx=0x7f145406b130 comp rx=0 tx=0).stop 2024-09-19T08:10:54.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.211+0000 7f1468d2e640 1 -- 172.21.15.27:0/2791549851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1464102ef0 msgr2=0x7f14640fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:54.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.211+0000 7f1468d2e640 1 --2- 172.21.15.27:0/2791549851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1464102ef0 0x7f14640fd700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1454009fd0 tx=0x7f145400b8e0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.211+0000 7f1468d2e640 1 -- 172.21.15.27:0/2791549851 shutdown_connections 2024-09-19T08:10:54.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.211+0000 7f1468d2e640 1 --2- 172.21.15.27:0/2791549851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1464102ef0 0x7f14640fd700 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.211+0000 7f1468d2e640 1 --2- 172.21.15.27:0/2791549851 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f14500a32c0 0x7f14500a5780 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.211+0000 7f1468d2e640 1 --2- 172.21.15.27:0/2791549851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1464102570 0x7f14640fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.211+0000 7f1468d2e640 1 --2- 172.21.15.27:0/2791549851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1464100e20 0x7f14640fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:54.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.211+0000 7f1468d2e640 1 -- 172.21.15.27:0/2791549851 >> 172.21.15.27:0/2791549851 conn(0x7f14640fc7d0 msgr2=0x7f146406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:54.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.211+0000 7f1468d2e640 1 -- 172.21.15.27:0/2791549851 shutdown_connections 2024-09-19T08:10:54.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:54.211+0000 7f1468d2e640 1 -- 172.21.15.27:0/2791549851 wait complete. 2024-09-19T08:10:54.388 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:54 smithi155 ceph-mon[35362]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:10:54.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:54 smithi203 ceph-mon[35198]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:10:55.035 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T08:10:55.049 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T08:10:55.049 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T08:10:55.050 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T08:10:55.050 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-19T08:10:55.051 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T08:10:55.051 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi027.front.sepia.ceph.com 2024-09-19T08:10:55.051 DEBUG:teuthology.orchestra.run.smithi027:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-19T08:10:55.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.181+0000 7fe453ad0640 1 -- 172.21.15.27:0/4107329725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe44c101c50 msgr2=0x7fe44c1020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:55.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.181+0000 7fe453ad0640 1 --2- 172.21.15.27:0/4107329725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe44c101c50 0x7fe44c1020d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009900 tx=0x7fe43c02a410 comp rx=0 tx=0).stop 2024-09-19T08:10:55.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.181+0000 7fe453ad0640 1 -- 172.21.15.27:0/4107329725 shutdown_connections 2024-09-19T08:10:55.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.181+0000 7fe453ad0640 1 --2- 172.21.15.27:0/4107329725 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe44c102610 0x7fe44c108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:55.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.181+0000 7fe453ad0640 1 --2- 172.21.15.27:0/4107329725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe44c101c50 0x7fe44c1020d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:55.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.181+0000 7fe453ad0640 1 --2- 172.21.15.27:0/4107329725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe44c100a60 0x7fe44c100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:55.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.181+0000 7fe453ad0640 1 -- 172.21.15.27:0/4107329725 >> 172.21.15.27:0/4107329725 conn(0x7fe44c0fc1e0 msgr2=0x7fe44c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:55.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.181+0000 7fe453ad0640 1 -- 172.21.15.27:0/4107329725 shutdown_connections 2024-09-19T08:10:55.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.181+0000 7fe453ad0640 1 -- 172.21.15.27:0/4107329725 wait complete. 2024-09-19T08:10:55.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.182+0000 7fe453ad0640 1 Processor -- start 2024-09-19T08:10:55.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.182+0000 7fe453ad0640 1 -- start start 2024-09-19T08:10:55.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.182+0000 7fe453ad0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe44c100a60 0x7fe44c06ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:55.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.182+0000 7fe453ad0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe44c101c50 0x7fe44c19cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:55.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.182+0000 7fe453ad0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe44c102610 0x7fe44c19f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:55.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.182+0000 7fe453ad0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c10c710 con 0x7fe44c102610 2024-09-19T08:10:55.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.182+0000 7fe453ad0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c10c590 con 0x7fe44c100a60 2024-09-19T08:10:55.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.182+0000 7fe453ad0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c10c890 con 0x7fe44c101c50 2024-09-19T08:10:55.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.182+0000 7fe45206d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe44c102610 0x7fe44c19f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:55.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.182+0000 7fe45206d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe44c102610 0x7fe44c19f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59174/0 (socket says 172.21.15.27:59174) 2024-09-19T08:10:55.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.182+0000 7fe45206d640 1 -- 172.21.15.27:0/2571484823 learned_addr learned my addr 172.21.15.27:0/2571484823 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:55.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.182+0000 7fe45106b640 1 --2- 172.21.15.27:0/2571484823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe44c101c50 0x7fe44c19cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:55.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.183+0000 7fe45186c640 1 --2- 172.21.15.27:0/2571484823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe44c100a60 0x7fe44c06ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:55.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.183+0000 7fe45206d640 1 -- 172.21.15.27:0/2571484823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe44c101c50 msgr2=0x7fe44c19cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:55.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.183+0000 7fe45206d640 1 --2- 172.21.15.27:0/2571484823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe44c101c50 0x7fe44c19cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:55.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.183+0000 7fe45206d640 1 -- 172.21.15.27:0/2571484823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe44c100a60 msgr2=0x7fe44c06ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:55.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.183+0000 7fe45206d640 1 --2- 172.21.15.27:0/2571484823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe44c100a60 0x7fe44c06ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:55.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.183+0000 7fe45206d640 1 -- 172.21.15.27:0/2571484823 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44c19fa50 con 0x7fe44c102610 2024-09-19T08:10:55.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.183+0000 7fe45186c640 1 --2- 172.21.15.27:0/2571484823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe44c100a60 0x7fe44c06ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:10:55.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.183+0000 7fe45106b640 1 --2- 172.21.15.27:0/2571484823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe44c101c50 0x7fe44c19cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:10:55.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.183+0000 7fe45206d640 1 --2- 172.21.15.27:0/2571484823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe44c102610 0x7fe44c19f140 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe444009fd0 tx=0x7fe44400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:55.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.183+0000 7fe442ffd640 1 -- 172.21.15.27:0/2571484823 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe444017070 con 0x7fe44c102610 2024-09-19T08:10:55.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.183+0000 7fe453ad0640 1 -- 172.21.15.27:0/2571484823 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe44c19fce0 con 0x7fe44c102610 2024-09-19T08:10:55.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.183+0000 7fe442ffd640 1 -- 172.21.15.27:0/2571484823 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe444003e50 con 0x7fe44c102610 2024-09-19T08:10:55.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.183+0000 7fe442ffd640 1 -- 172.21.15.27:0/2571484823 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4440106c0 con 0x7fe44c102610 2024-09-19T08:10:55.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.183+0000 7fe453ad0640 1 -- 172.21.15.27:0/2571484823 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe44c1a01b0 con 0x7fe44c102610 2024-09-19T08:10:55.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.184+0000 7fe453ad0640 1 -- 172.21.15.27:0/2571484823 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe44c107da0 con 0x7fe44c102610 2024-09-19T08:10:55.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.185+0000 7fe442ffd640 1 -- 172.21.15.27:0/2571484823 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe444003970 con 0x7fe44c102610 2024-09-19T08:10:55.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.186+0000 7fe442ffd640 1 --2- 172.21.15.27:0/2571484823 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe4380a32f0 0x7fe4380a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:55.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.186+0000 7fe45186c640 1 --2- 172.21.15.27:0/2571484823 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe4380a32f0 0x7fe4380a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:55.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.186+0000 7fe442ffd640 1 -- 172.21.15.27:0/2571484823 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fe4440cf730 con 0x7fe44c102610 2024-09-19T08:10:55.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.187+0000 7fe45186c640 1 --2- 172.21.15.27:0/2571484823 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe4380a32f0 0x7fe4380a57b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe44c101ab0 tx=0x7fe448005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:55.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.190+0000 7fe442ffd640 1 -- 172.21.15.27:0/2571484823 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe44409c480 con 0x7fe44c102610 2024-09-19T08:10:55.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:55.421+0000 7fe453ad0640 1 -- 172.21.15.27:0/2571484823 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7fe44c02d9c0 con 0x7fe44c102610 2024-09-19T08:10:56.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:56.076+0000 7fe442ffd640 1 -- 172.21.15.27:0/2571484823 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7fe44409bd80 con 0x7fe44c102610 2024-09-19T08:10:56.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:56.079+0000 7fe453ad0640 1 -- 172.21.15.27:0/2571484823 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe4380a32f0 msgr2=0x7fe4380a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:56.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:56.079+0000 7fe453ad0640 1 --2- 172.21.15.27:0/2571484823 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe4380a32f0 0x7fe4380a57b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe44c101ab0 tx=0x7fe448005d30 comp rx=0 tx=0).stop 2024-09-19T08:10:56.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:56.079+0000 7fe453ad0640 1 -- 172.21.15.27:0/2571484823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe44c102610 msgr2=0x7fe44c19f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:56.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:56.079+0000 7fe453ad0640 1 --2- 172.21.15.27:0/2571484823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe44c102610 0x7fe44c19f140 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe444009fd0 tx=0x7fe44400b260 comp rx=0 tx=0).stop 2024-09-19T08:10:56.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:56.079+0000 7fe453ad0640 1 -- 172.21.15.27:0/2571484823 shutdown_connections 2024-09-19T08:10:56.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:56.079+0000 7fe453ad0640 1 --2- 172.21.15.27:0/2571484823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe44c102610 0x7fe44c19f140 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:56.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:56.079+0000 7fe453ad0640 1 --2- 172.21.15.27:0/2571484823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe44c101c50 0x7fe44c19cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:56.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:56.079+0000 7fe453ad0640 1 --2- 172.21.15.27:0/2571484823 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fe4380a32f0 0x7fe4380a57b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:56.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:56.079+0000 7fe453ad0640 1 --2- 172.21.15.27:0/2571484823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe44c100a60 0x7fe44c06ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:56.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:56.079+0000 7fe453ad0640 1 -- 172.21.15.27:0/2571484823 >> 172.21.15.27:0/2571484823 conn(0x7fe44c0fc1e0 msgr2=0x7fe44c104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:56.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:56.081+0000 7fe453ad0640 1 -- 172.21.15.27:0/2571484823 shutdown_connections 2024-09-19T08:10:56.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:56.081+0000 7fe453ad0640 1 -- 172.21.15.27:0/2571484823 wait complete. 2024-09-19T08:10:56.097 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T08:10:56.129 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T08:10:56.129 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T08:10:56.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:10:56.129 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2024-09-19T08:10:56.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:10:56.149 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link delete ceph-brx 2024-09-19T08:10:56.220 INFO:teuthology.orchestra.run.smithi027.stderr:Cannot find device "ceph-brx" 2024-09-19T08:10:56.226 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:10:56.226 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-19T08:10:56.226 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T08:10:56.226 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T08:10:56.227 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T08:10:56.431 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:56 smithi203 ceph-mon[35198]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:10:56.431 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:56 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2571484823' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T08:10:56.431 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:56 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: ignoring --setuser ceph since I am not root 2024-09-19T08:10:56.432 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:56 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: ignoring --setgroup ceph since I am not root 2024-09-19T08:10:56.432 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:56 smithi203 ceph-mgr[37014]: -- 172.21.15.203:0/1666551765 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f3aa7a90e0 con 0x55f3aa786800 2024-09-19T08:10:56.432 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:56 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:56.226+0000 7f4985490040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:10:56.432 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:56 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:56.284+0000 7f4985490040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:10:56.432 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:56 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:56.431+0000 7f4985490040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:10:56.432 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:56 smithi155 ceph-mon[35362]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:10:56.433 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:56 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2571484823' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T08:10:56.433 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:56 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: ignoring --setuser ceph since I am not root 2024-09-19T08:10:56.433 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:56 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: ignoring --setgroup ceph since I am not root 2024-09-19T08:10:56.433 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:56 smithi155 ceph-mgr[36736]: -- 172.21.15.155:0/646839645 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562107f250e0 con 0x562107f03400 2024-09-19T08:10:56.433 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:56 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:56.227+0000 7ff71361a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:10:56.433 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:56 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:56.284+0000 7ff71361a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:10:56.433 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:56 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:56.432+0000 7ff71361a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:10:56.461 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:56 smithi027 ceph-mon[31209]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:10:56.461 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:56 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2571484823' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T08:10:56.461 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:10:56 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: ignoring --setuser ceph since I am not root 2024-09-19T08:10:56.461 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:10:56 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: ignoring --setgroup ceph since I am not root 2024-09-19T08:10:56.462 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:10:56 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:10:56.241+0000 7f1b27ea8040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:10:56.462 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:10:56 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:10:56.302+0000 7f1b27ea8040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:10:56.462 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:10:56 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:10:56.460+0000 7f1b27ea8040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:10:56.533 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:10:56.737 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:56 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:56.499+0000 7ff71361a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:10:56.737 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:56 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:56.646+0000 7ff71361a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:10:56.752 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:10:56 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:10:56.541+0000 7f1b27ea8040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:10:56.752 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:10:56 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:10:56.698+0000 7f1b27ea8040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:10:56.758 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:56 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:56.497+0000 7f4985490040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:10:56.758 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:56 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:56.643+0000 7f4985490040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:10:57.046 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:10:56 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:10:56.865+0000 7f1b27ea8040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:10:57.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.036+0000 7f286fbde640 1 -- 172.21.15.27:0/699036225 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2868102d90 msgr2=0x7f2868103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:57.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.036+0000 7f286fbde640 1 --2- 172.21.15.27:0/699036225 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2868102d90 0x7f2868103170 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2864009930 tx=0x7f286402a420 comp rx=0 tx=0).stop 2024-09-19T08:10:57.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.037+0000 7f286fbde640 1 -- 172.21.15.27:0/699036225 shutdown_connections 2024-09-19T08:10:57.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.037+0000 7f286fbde640 1 --2- 172.21.15.27:0/699036225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2868108290 0x7f286810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:57.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.037+0000 7f286fbde640 1 --2- 172.21.15.27:0/699036225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2868103740 0x7f2868107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:57.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.037+0000 7f286fbde640 1 --2- 172.21.15.27:0/699036225 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2868102d90 0x7f2868103170 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:57.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.037+0000 7f286fbde640 1 -- 172.21.15.27:0/699036225 >> 172.21.15.27:0/699036225 conn(0x7f28680fc7d0 msgr2=0x7f28680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:57.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.037+0000 7f286fbde640 1 -- 172.21.15.27:0/699036225 shutdown_connections 2024-09-19T08:10:57.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.037+0000 7f286fbde640 1 -- 172.21.15.27:0/699036225 wait complete. 2024-09-19T08:10:57.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.037+0000 7f286fbde640 1 Processor -- start 2024-09-19T08:10:57.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.037+0000 7f286fbde640 1 -- start start 2024-09-19T08:10:57.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f286fbde640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2868102d90 0x7f28681985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:57.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f286fbde640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2868103740 0x7f2868198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:57.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f286fbde640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2868108290 0x7f286819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:57.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f286fbde640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2868112090 con 0x7f2868108290 2024-09-19T08:10:57.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f286fbde640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2868111f10 con 0x7f2868103740 2024-09-19T08:10:57.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f286fbde640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2868112210 con 0x7f2868102d90 2024-09-19T08:10:57.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f286e17b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2868108290 0x7f286819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:57.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f286e17b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2868108290 0x7f286819cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59206/0 (socket says 172.21.15.27:59206) 2024-09-19T08:10:57.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f286e17b640 1 -- 172.21.15.27:0/465309986 learned_addr learned my addr 172.21.15.27:0/465309986 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:10:57.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f286d97a640 1 --2- 172.21.15.27:0/465309986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2868102d90 0x7f28681985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:57.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f286d179640 1 --2- 172.21.15.27:0/465309986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2868103740 0x7f2868198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:10:57.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f286e17b640 1 -- 172.21.15.27:0/465309986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2868102d90 msgr2=0x7f28681985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:57.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f286e17b640 1 --2- 172.21.15.27:0/465309986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2868102d90 0x7f28681985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:57.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f286e17b640 1 -- 172.21.15.27:0/465309986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2868103740 msgr2=0x7f2868198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:57.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f286e17b640 1 --2- 172.21.15.27:0/465309986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2868103740 0x7f2868198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:57.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f286e17b640 1 -- 172.21.15.27:0/465309986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286819d5a0 con 0x7f2868108290 2024-09-19T08:10:57.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f286e17b640 1 --2- 172.21.15.27:0/465309986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2868108290 0x7f286819cec0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f286000eaa0 tx=0x7f286000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:10:57.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f285effd640 1 -- 172.21.15.27:0/465309986 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286000cdb0 con 0x7f2868108290 2024-09-19T08:10:57.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f286fbde640 1 -- 172.21.15.27:0/465309986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f286819d890 con 0x7f2868108290 2024-09-19T08:10:57.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f285effd640 1 -- 172.21.15.27:0/465309986 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2860005020 con 0x7f2868108290 2024-09-19T08:10:57.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.038+0000 7f285effd640 1 -- 172.21.15.27:0/465309986 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28600116d0 con 0x7f2868108290 2024-09-19T08:10:57.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.039+0000 7f286fbde640 1 -- 172.21.15.27:0/465309986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28681a5170 con 0x7f2868108290 2024-09-19T08:10:57.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.040+0000 7f286fbde640 1 -- 172.21.15.27:0/465309986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f286806a7f0 con 0x7f2868108290 2024-09-19T08:10:57.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.041+0000 7f285effd640 1 -- 172.21.15.27:0/465309986 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7f28600054d0 con 0x7f2868108290 2024-09-19T08:10:57.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.041+0000 7f285effd640 1 --2- 172.21.15.27:0/465309986 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f28540a3290 0x7f28540a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:10:57.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.041+0000 7f286d97a640 1 -- 172.21.15.27:0/465309986 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f28540a3290 msgr2=0x7f28540a5750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/4220278108 2024-09-19T08:10:57.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.042+0000 7f285effd640 1 -- 172.21.15.27:0/465309986 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f28600cfa90 con 0x7f2868108290 2024-09-19T08:10:57.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.042+0000 7f286d97a640 1 --2- 172.21.15.27:0/465309986 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f28540a3290 0x7f28540a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:10:57.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.046+0000 7f285effd640 1 -- 172.21.15.27:0/465309986 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2860016030 con 0x7f2868108290 2024-09-19T08:10:57.077 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:56 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:56.786+0000 7f4985490040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:10:57.077 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:56 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:56.787+0000 7ff71361a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:10:57.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.243+0000 7f286d97a640 1 -- 172.21.15.27:0/465309986 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f28540a3290 msgr2=0x7f28540a5750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/4220278108 2024-09-19T08:10:57.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.243+0000 7f286d97a640 1 --2- 172.21.15.27:0/465309986 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f28540a3290 0x7f28540a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:10:57.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.266+0000 7f286fbde640 1 -- 172.21.15.27:0/465309986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f286810a2a0 con 0x7f2868108290 2024-09-19T08:10:57.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.266+0000 7f285effd640 1 -- 172.21.15.27:0/465309986 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+73 (secure 0 0 0) 0x7f286009c190 con 0x7f2868108290 2024-09-19T08:10:57.266 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T08:10:57.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.268+0000 7f286fbde640 1 -- 172.21.15.27:0/465309986 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f28540a3290 msgr2=0x7f28540a5750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:10:57.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.268+0000 7f286fbde640 1 --2- 172.21.15.27:0/465309986 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f28540a3290 0x7f28540a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:57.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.268+0000 7f286fbde640 1 -- 172.21.15.27:0/465309986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2868108290 msgr2=0x7f286819cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:10:57.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.268+0000 7f286fbde640 1 --2- 172.21.15.27:0/465309986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2868108290 0x7f286819cec0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f286000eaa0 tx=0x7f286000ef60 comp rx=0 tx=0).stop 2024-09-19T08:10:57.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.268+0000 7f286fbde640 1 -- 172.21.15.27:0/465309986 shutdown_connections 2024-09-19T08:10:57.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.268+0000 7f286fbde640 1 --2- 172.21.15.27:0/465309986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2868108290 0x7f286819cec0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:57.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.268+0000 7f286fbde640 1 --2- 172.21.15.27:0/465309986 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f28540a3290 0x7f28540a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:57.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.268+0000 7f286fbde640 1 --2- 172.21.15.27:0/465309986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2868103740 0x7f2868198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:57.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.268+0000 7f286fbde640 1 --2- 172.21.15.27:0/465309986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2868102d90 0x7f28681985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:10:57.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.268+0000 7f286fbde640 1 -- 172.21.15.27:0/465309986 >> 172.21.15.27:0/465309986 conn(0x7f28680fc7d0 msgr2=0x7f2868106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:10:57.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.268+0000 7f286fbde640 1 -- 172.21.15.27:0/465309986 shutdown_connections 2024-09-19T08:10:57.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:57.269+0000 7f286fbde640 1 -- 172.21.15.27:0/465309986 wait complete. 2024-09-19T08:10:57.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:57 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2571484823' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T08:10:57.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:57 smithi203 ceph-mon[35198]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T08:10:57.346 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:57 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:57.101+0000 7f4985490040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:10:57.346 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:57 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:57.162+0000 7f4985490040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:10:57.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:57 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2571484823' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T08:10:57.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:57 smithi155 ceph-mon[35362]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T08:10:57.347 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:57 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:57.100+0000 7ff71361a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:10:57.347 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:57 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:57.162+0000 7ff71361a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:10:57.347 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:57 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:57.347+0000 7ff71361a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:10:57.462 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:57 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2571484823' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T08:10:57.462 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:57 smithi027 ceph-mon[31209]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T08:10:57.463 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:10:57 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:10:57.202+0000 7f1b27ea8040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:10:57.463 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:10:57 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:10:57.265+0000 7f1b27ea8040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:10:57.463 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:10:57 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:10:57.463+0000 7f1b27ea8040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:10:57.758 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:57 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:57.346+0000 7f4985490040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:10:58.064 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T08:10:58.064 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T08:10:58.064 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2024-09-19T08:10:58.064 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T08:10:58.064 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T08:10:58.064 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T08:10:58.064 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T08:10:58.064 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T08:10:58.064 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T08:10:58.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:10:58.065 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2024-09-19T08:10:58.082 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T08:10:58.082 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T08:10:58.083 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T08:10:58.083 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:10:58.083 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2024-09-19T08:10:58.083 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:10:58.083 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:10:58.083 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:10:58.083 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp7s0f0 2024-09-19T08:10:58.083 INFO:teuthology.orchestra.run.smithi027.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:10:58.084 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:10:58.084 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp7s0f1 2024-09-19T08:10:58.084 INFO:teuthology.orchestra.run.smithi027.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T08:10:58.084 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2024-09-19T08:10:58.084 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp1s0f0 2024-09-19T08:10:58.084 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T08:10:58.084 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 42179sec preferred_lft 42179sec 2024-09-19T08:10:58.084 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2024-09-19T08:10:58.084 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:10:58.084 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:10:58.084 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2024-09-19T08:10:58.085 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp1s0f1 2024-09-19T08:10:58.085 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T08:10:58.085 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:10:58.085 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-09-19T08:10:58.085 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add name ceph-brx type bridge 2024-09-19T08:10:58.085 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip addr flush dev ceph-brx 2024-09-19T08:10:58.085 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set ceph-brx up 2024-09-19T08:10:58.085 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T08:10:58.086 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-09-19T08:10:58.173 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:10:58.284 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:10:58 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/465309986' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T08:10:58.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:10:58.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:10:58.315 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T08:10:58.342 INFO:teuthology.orchestra.run.smithi027.stdout:1 2024-09-19T08:10:58.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:10:58.344 DEBUG:teuthology.orchestra.run.smithi027:> route 2024-09-19T08:10:58.411 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2024-09-19T08:10:58.411 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T08:10:58.411 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T08:10:58.411 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T08:10:58.411 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T08:10:58.411 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:10:58.412 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-09-19T08:10:58.412 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T08:10:58.412 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T08:10:58.412 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T08:10:58.412 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-09-19T08:10:58.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:10:58 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/465309986' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T08:10:58.487 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:58 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:58.227+0000 7ff71361a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:10:58.487 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:58 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:58.295+0000 7ff71361a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:10:58.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:10:58.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:10:58 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/465309986' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T08:10:58.508 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:58 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:58.230+0000 7f4985490040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:10:58.508 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:58 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:58.298+0000 7f4985490040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:10:58.618 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:10:58 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:10:58.414+0000 7f1b27ea8040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:10:58.618 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:10:58 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:10:58.485+0000 7f1b27ea8040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:10:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:10:58.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:10:58.736 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2024-09-19T08:10:58.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:10:58.753 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list-id 2024-09-19T08:10:58.808 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:10:58.809 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-09-19T08:10:58.809 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:10:58.809 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T08:10:58.809 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-09-19T08:10:58.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:10:58.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:10:58.934 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T08:10:58.934 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:10:58.934 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-09-19T08:10:58.934 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T08:10:58.935 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T08:10:58.935 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T08:10:58.935 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T08:10:58.935 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T08:10:58.935 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-09-19T08:10:58.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:10:59.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:10:59.067 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:10:59.067 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-09-19T08:10:59.067 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2024-09-19T08:10:59.067 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T08:10:59.068 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-09-19T08:10:59.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:10:59.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:10:59.148 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:10:59.149 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T08:10:59.164 INFO:teuthology.orchestra.run.smithi027.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T08:10:59.165 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:10:59.165 DEBUG:teuthology.orchestra.run.smithi027:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T08:10:59.221 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-19T08:10:59.221 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-19T08:10:59.221 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/fd5652cb-0319-42ec-8770-4c09e6ed2340 2024-09-19T08:10:59.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:10:59.222 DEBUG:teuthology.orchestra.run.smithi027:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/fd5652cb-0319-42ec-8770-4c09e6ed2340 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-19T08:10:59.263 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:59 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:59.005+0000 7ff71361a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:10:59.263 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:59 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:59.121+0000 7ff71361a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:10:59.267 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:59 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:59.008+0000 7f4985490040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:10:59.268 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:59 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:59.124+0000 7f4985490040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:10:59.327 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-19T08:10:59.327 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-19T08:10:59.327 INFO:teuthology.orchestra.run.smithi027.stdout:invalid new device string format 2024-09-19T08:10:59.475 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-19T08:10:59.475 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-19T08:10:59.475 INFO:teuthology.orchestra.run.smithi027.stdout:invalid new device string format 2024-09-19T08:10:59.475 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: resolved to: "172.21.15.27:3300,172.21.15.155:3300,172.21.15.203:3300" 2024-09-19T08:10:59.475 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.27:3300,172.21.15.155:3300,172.21.15.203:3300:/volumes/qa/sv_1/fd5652cb-0319-42ec-8770-4c09e6ed2340 2024-09-19T08:10:59.475 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=35b531b0-765d-11ef-bceb-c7b262605968" will pass to kernel 2024-09-19T08:10:59.476 INFO:teuthology.orchestra.run.smithi027.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T08:10:59.476 INFO:teuthology.orchestra.run.smithi027.stdout: You just mounted a file system that supports labels which does not 2024-09-19T08:10:59.476 INFO:teuthology.orchestra.run.smithi027.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T08:10:59.476 INFO:teuthology.orchestra.run.smithi027.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T08:10:59.476 INFO:teuthology.orchestra.run.smithi027.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T08:10:59.478 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T08:10:59.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:10:59.478 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T08:10:59.505 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T08:10:59.544 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:59 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:59.263+0000 7ff71361a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:10:59.545 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:59 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:59.325+0000 7ff71361a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:10:59.545 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:59 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:59.476+0000 7ff71361a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:10:59.545 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:59 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:59.544+0000 7ff71361a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:10:59.550 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:59 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:59.267+0000 7f4985490040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:10:59.550 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:59 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:59.329+0000 7f4985490040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:10:59.550 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:59 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:59.478+0000 7f4985490040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:10:59.550 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:59 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:59.547+0000 7f4985490040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:10:59.560 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:10:59 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:10:59.273+0000 7f1b27ea8040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:10:59.560 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:10:59 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:10:59.400+0000 7f1b27ea8040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:10:59.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T08:10:59.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:10:59.607 INFO:teuthology.orchestra.run.smithi027.stdout:client24773 2024-09-19T08:10:59.608 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-19T08:10:59.608 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:10:59.666 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T08:10:59.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T08:10:59.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:10:59.765 INFO:teuthology.orchestra.run.smithi027.stdout:client24773 2024-09-19T08:10:59.766 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T08:10:59.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T08:10:59.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:10:59.824 INFO:teuthology.orchestra.run.smithi027.stdout:client24773 2024-09-19T08:10:59.824 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/35b531b0-765d-11ef-bceb-c7b262605968.client24773/status') 2024-09-19T08:10:59.830 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:59 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:59.607+0000 7f4985490040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:10:59.830 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:59 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:59.765+0000 7f4985490040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:10:59.831 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:59 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:59.606+0000 7ff71361a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:10:59.831 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:59 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:59.764+0000 7ff71361a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:10:59.831 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:59 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:59.830+0000 7ff71361a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:10:59.858 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:10:59 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:10:59.560+0000 7f1b27ea8040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:10:59.858 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:10:59 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:10:59.626+0000 7f1b27ea8040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:10:59.859 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:10:59 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:10:59.785+0000 7f1b27ea8040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:10:59.859 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:10:59 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:10:59.859+0000 7f1b27ea8040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:10:59.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:10:59.885 INFO:teuthology.orchestra.run.smithi027.stdout:instance: client.24773 (3)172.21.15.27:0/596952121 2024-09-19T08:10:59.885 INFO:teuthology.orchestra.run.smithi027.stdout:blocklisted: false 2024-09-19T08:10:59.885 INFO:teuthology.orchestra.run.smithi027.stderr:0+1 records in 2024-09-19T08:10:59.885 INFO:teuthology.orchestra.run.smithi027.stderr:0+1 records out 2024-09-19T08:10:59.886 INFO:teuthology.orchestra.run.smithi027.stderr:70 bytes copied, 2.5118e-05 s, 2.8 MB/s 2024-09-19T08:10:59.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:10:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:10:59.893 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T08:10:59.905 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T08:10:59.936 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:11:00.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.043+0000 7f9a2e191640 1 -- 172.21.15.27:0/626160389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a28104ec0 msgr2=0x7f9a281072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:00.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.043+0000 7f9a2e191640 1 --2- 172.21.15.27:0/626160389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a28104ec0 0x7f9a281072b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9a10009900 tx=0x7f9a1002a410 comp rx=0 tx=0).stop 2024-09-19T08:11:00.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.043+0000 7f9a2e191640 1 -- 172.21.15.27:0/626160389 shutdown_connections 2024-09-19T08:11:00.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.043+0000 7f9a2e191640 1 --2- 172.21.15.27:0/626160389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a281077f0 0x7f9a28109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.043+0000 7f9a2e191640 1 --2- 172.21.15.27:0/626160389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a28104ec0 0x7f9a281072b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.043+0000 7f9a2e191640 1 --2- 172.21.15.27:0/626160389 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a28102590 0x7f9a28104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.043+0000 7f9a2e191640 1 -- 172.21.15.27:0/626160389 >> 172.21.15.27:0/626160389 conn(0x7f9a280fc170 msgr2=0x7f9a280fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:00.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.043+0000 7f9a2e191640 1 -- 172.21.15.27:0/626160389 shutdown_connections 2024-09-19T08:11:00.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.043+0000 7f9a2e191640 1 -- 172.21.15.27:0/626160389 wait complete. 2024-09-19T08:11:00.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.043+0000 7f9a2e191640 1 Processor -- start 2024-09-19T08:11:00.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.043+0000 7f9a2e191640 1 -- start start 2024-09-19T08:11:00.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.044+0000 7f9a2e191640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a28102590 0x7f9a28197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:00.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.044+0000 7f9a2e191640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a28104ec0 0x7f9a28198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:00.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.044+0000 7f9a2e191640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a281077f0 0x7f9a2819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:00.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.044+0000 7f9a2e191640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2810d810 con 0x7f9a281077f0 2024-09-19T08:11:00.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.044+0000 7f9a2e191640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2810d690 con 0x7f9a28102590 2024-09-19T08:11:00.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.044+0000 7f9a2e191640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2810d990 con 0x7f9a28104ec0 2024-09-19T08:11:00.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.044+0000 7f9a27fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a281077f0 0x7f9a2819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:00.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.044+0000 7f9a27fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a281077f0 0x7f9a2819f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59216/0 (socket says 172.21.15.27:59216) 2024-09-19T08:11:00.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.044+0000 7f9a27fff640 1 -- 172.21.15.27:0/1547277052 learned_addr learned my addr 172.21.15.27:0/1547277052 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:00.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.044+0000 7f9a277fe640 1 --2- 172.21.15.27:0/1547277052 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a28102590 0x7f9a28197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:00.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.044+0000 7f9a1ffff640 1 --2- 172.21.15.27:0/1547277052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a28104ec0 0x7f9a28198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:00.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.044+0000 7f9a27fff640 1 -- 172.21.15.27:0/1547277052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a28104ec0 msgr2=0x7f9a28198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:00.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.044+0000 7f9a27fff640 1 --2- 172.21.15.27:0/1547277052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a28104ec0 0x7f9a28198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.044+0000 7f9a27fff640 1 -- 172.21.15.27:0/1547277052 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a28102590 msgr2=0x7f9a28197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:00.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.044+0000 7f9a27fff640 1 --2- 172.21.15.27:0/1547277052 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a28102590 0x7f9a28197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.044+0000 7f9a27fff640 1 -- 172.21.15.27:0/1547277052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a2819fb50 con 0x7f9a281077f0 2024-09-19T08:11:00.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.044+0000 7f9a27fff640 1 --2- 172.21.15.27:0/1547277052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a281077f0 0x7f9a2819f4e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000eb40 tx=0x7f9a2000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:00.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.044+0000 7f9a257fa640 1 -- 172.21.15.27:0/1547277052 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a20004b20 con 0x7f9a281077f0 2024-09-19T08:11:00.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.045+0000 7f9a257fa640 1 -- 172.21.15.27:0/1547277052 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a20004cc0 con 0x7f9a281077f0 2024-09-19T08:11:00.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.045+0000 7f9a2e191640 1 -- 172.21.15.27:0/1547277052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a2819fe40 con 0x7f9a281077f0 2024-09-19T08:11:00.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.045+0000 7f9a257fa640 1 -- 172.21.15.27:0/1547277052 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a20010850 con 0x7f9a281077f0 2024-09-19T08:11:00.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.045+0000 7f9a2e191640 1 -- 172.21.15.27:0/1547277052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a281a0300 con 0x7f9a281077f0 2024-09-19T08:11:00.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.046+0000 7f9a2e191640 1 -- 172.21.15.27:0/1547277052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a280fdc60 con 0x7f9a281077f0 2024-09-19T08:11:00.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.047+0000 7f9a257fa640 1 -- 172.21.15.27:0/1547277052 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7f9a20005000 con 0x7f9a281077f0 2024-09-19T08:11:00.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.048+0000 7f9a257fa640 1 --2- 172.21.15.27:0/1547277052 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f9a140a3320 0x7f9a140a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:00.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.048+0000 7f9a277fe640 1 -- 172.21.15.27:0/1547277052 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f9a140a3320 msgr2=0x7f9a140a57e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/4220278108 2024-09-19T08:11:00.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.048+0000 7f9a257fa640 1 -- 172.21.15.27:0/1547277052 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f9a200cffc0 con 0x7f9a281077f0 2024-09-19T08:11:00.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.048+0000 7f9a277fe640 1 --2- 172.21.15.27:0/1547277052 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f9a140a3320 0x7f9a140a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:11:00.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.055+0000 7f9a257fa640 1 -- 172.21.15.27:0/1547277052 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9a2009cdb0 con 0x7f9a281077f0 2024-09-19T08:11:00.100 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:59 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:59.830+0000 7f4985490040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:11:00.100 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:59 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:59.896+0000 7f4985490040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:11:00.100 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:10:59 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:10:59.980+0000 7f4985490040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:11:00.100 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:11:00 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:11:00.040+0000 7f4985490040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:11:00.100 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:11:00 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:11:00.100+0000 7f4985490040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:11:00.101 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:59 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:59.897+0000 7ff71361a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:11:00.101 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:10:59 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:10:59.981+0000 7ff71361a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:11:00.101 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:11:00 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:11:00.041+0000 7ff71361a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:11:00.101 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:11:00 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:11:00.101+0000 7ff71361a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:11:00.167 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:10:59 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:10:59.923+0000 7f1b27ea8040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:11:00.167 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:11:00.098+0000 7f1b27ea8040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:11:00.167 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:11:00.167+0000 7f1b27ea8040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:11:00.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.234+0000 7f9a2e191640 1 -- 172.21.15.27:0/1547277052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a2802da10 con 0x7f9a281077f0 2024-09-19T08:11:00.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.236+0000 7f9a257fa640 1 -- 172.21.15.27:0/1547277052 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22650 (secure 0 0 0) 0x7f9a2009c6b0 con 0x7f9a281077f0 2024-09-19T08:11:00.236 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:11:00.236 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":83,"fsid":"35b531b0-765d-11ef-bceb-c7b262605968","created":"2024-09-19T08:01:20.929241+0000","modified":"2024-09-19T08:10:14.777420+0000","last_up_change":"2024-09-19T08:08:17.919001+0000","last_in_change":"2024-09-19T08:07:54.277124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:04:29.312984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:09:08.046858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:09:10.223258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66fd6732-4cac-4eda-bf06-50638995ee80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6803","nonce":3645201250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6805","nonce":3645201250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6809","nonce":3645201250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6807","nonce":3645201250}]},"public_addr":"172.21.15.27:6803/3645201250","cluster_addr":"172.21.15.27:6805/3645201250","heartbeat_back_addr":"172.21.15.27:6809/3645201250","heartbeat_front_addr":"172.21.15.27:6807/3645201250","state":["exists","up"]},{"osd":1,"uuid":"36628767-66ac-433b-938e-10e75b51a877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6801","nonce":3977510449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6803","nonce":3977510449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6807","nonce":3977510449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6805","nonce":3977510449}]},"public_addr":"172.21.15.155:6801/3977510449","cluster_addr":"172.21.15.155:6803/3977510449","heartbeat_back_addr":"172.21.15.155:6807/3977510449","heartbeat_front_addr":"172.21.15.155:6805/3977510449","state":["exists","up"]},{"osd":2,"uuid":"3dc80404-a56b-456a-af02-f01e9c6c6dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6801","nonce":3796057016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6803","nonce":3796057016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6807","nonce":3796057016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6805","nonce":3796057016}]},"public_addr":"172.21.15.203:6801/3796057016","cluster_addr":"172.21.15.203:6803/3796057016","heartbeat_back_addr":"172.21.15.203:6807/3796057016","heartbeat_front_addr":"172.21.15.203:6805/3796057016","state":["exists","up"]},{"osd":3,"uuid":"a51077d0-5e04-49b5-bb3e-91711cc45ff1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6811","nonce":1608304347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6813","nonce":1608304347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6817","nonce":1608304347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6815","nonce":1608304347}]},"public_addr":"172.21.15.27:6811/1608304347","cluster_addr":"172.21.15.27:6813/1608304347","heartbeat_back_addr":"172.21.15.27:6817/1608304347","heartbeat_front_addr":"172.21.15.27:6815/1608304347","state":["exists","up"]},{"osd":4,"uuid":"0df35548-90b4-434d-8d7e-c037072c9ae4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6809","nonce":569913150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6811","nonce":569913150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6815","nonce":569913150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6813","nonce":569913150}]},"public_addr":"172.21.15.155:6809/569913150","cluster_addr":"172.21.15.155:6811/569913150","heartbeat_back_addr":"172.21.15.155:6815/569913150","heartbeat_front_addr":"172.21.15.155:6813/569913150","state":["exists","up"]},{"osd":5,"uuid":"de193c5f-1019-43e5-9f4f-6c2aaa4330e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6809","nonce":991491203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6811","nonce":991491203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6815","nonce":991491203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6813","nonce":991491203}]},"public_addr":"172.21.15.203:6809/991491203","cluster_addr":"172.21.15.203:6811/991491203","heartbeat_back_addr":"172.21.15.203:6815/991491203","heartbeat_front_addr":"172.21.15.203:6813/991491203","state":["exists","up"]},{"osd":6,"uuid":"28938e4f-9f22-466f-8cf7-62ee56a0c926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6819","nonce":3516868131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6821","nonce":3516868131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6825","nonce":3516868131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6823","nonce":3516868131}]},"public_addr":"172.21.15.27:6819/3516868131","cluster_addr":"172.21.15.27:6821/3516868131","heartbeat_back_addr":"172.21.15.27:6825/3516868131","heartbeat_front_addr":"172.21.15.27:6823/3516868131","state":["exists","up"]},{"osd":7,"uuid":"855f1728-be52-4445-8561-a90c08f2b2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6817","nonce":2047506436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6819","nonce":2047506436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6823","nonce":2047506436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6821","nonce":2047506436}]},"public_addr":"172.21.15.155:6817/2047506436","cluster_addr":"172.21.15.155:6819/2047506436","heartbeat_back_addr":"172.21.15.155:6823/2047506436","heartbeat_front_addr":"172.21.15.155:6821/2047506436","state":["exists","up"]},{"osd":8,"uuid":"5d7a8ffd-a039-403e-8b9a-c80e19fd67ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6817","nonce":199970687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6819","nonce":199970687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6823","nonce":199970687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6821","nonce":199970687}]},"public_addr":"172.21.15.203:6817/199970687","cluster_addr":"172.21.15.203:6819/199970687","heartbeat_back_addr":"172.21.15.203:6823/199970687","heartbeat_front_addr":"172.21.15.203:6821/199970687","state":["exists","up"]},{"osd":9,"uuid":"cdb90242-80a1-4cef-b5e3-ddecb05664e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6827","nonce":118390483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6829","nonce":118390483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6833","nonce":118390483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6831","nonce":118390483}]},"public_addr":"172.21.15.27:6827/118390483","cluster_addr":"172.21.15.27:6829/118390483","heartbeat_back_addr":"172.21.15.27:6833/118390483","heartbeat_front_addr":"172.21.15.27:6831/118390483","state":["exists","up"]},{"osd":10,"uuid":"c7f4c9da-d913-47a5-8629-53de21efe8c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6825","nonce":1687418565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6827","nonce":1687418565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6831","nonce":1687418565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6829","nonce":1687418565}]},"public_addr":"172.21.15.155:6825/1687418565","cluster_addr":"172.21.15.155:6827/1687418565","heartbeat_back_addr":"172.21.15.155:6831/1687418565","heartbeat_front_addr":"172.21.15.155:6829/1687418565","state":["exists","up"]},{"osd":11,"uuid":"45c11a90-585e-46fa-a5a0-51a29e29eba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6825","nonce":224768827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6827","nonce":224768827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6831","nonce":224768827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6829","nonce":224768827}]},"public_addr":"172.21.15.203:6825/224768827","cluster_addr":"172.21.15.203:6827/224768827","heartbeat_back_addr":"172.21.15.203:6831/224768827","heartbeat_front_addr":"172.21.15.203:6829/224768827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:03:35.559549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:00.526006+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:25.809346+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:51.889445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:17.246017+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:43.515854+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:08.638182+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:34.653060+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:59.469837+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:26.122937+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:50.196159+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:08:16.245770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:6800/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/958829150":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1174736321":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1908865720":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/416476667":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6800/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/1717932879":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1963219497":"2024-09-20T08:01:48.686812+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:11:00.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.238+0000 7f9a2e191640 1 -- 172.21.15.27:0/1547277052 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f9a140a3320 msgr2=0x7f9a140a57e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:11:00.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.238+0000 7f9a2e191640 1 --2- 172.21.15.27:0/1547277052 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f9a140a3320 0x7f9a140a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.238+0000 7f9a2e191640 1 -- 172.21.15.27:0/1547277052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a281077f0 msgr2=0x7f9a2819f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:00.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.238+0000 7f9a2e191640 1 --2- 172.21.15.27:0/1547277052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a281077f0 0x7f9a2819f4e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000eb40 tx=0x7f9a2000c2d0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.238+0000 7f9a2e191640 1 -- 172.21.15.27:0/1547277052 shutdown_connections 2024-09-19T08:11:00.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.238+0000 7f9a2e191640 1 --2- 172.21.15.27:0/1547277052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a281077f0 0x7f9a2819f4e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.238+0000 7f9a2e191640 1 --2- 172.21.15.27:0/1547277052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a28104ec0 0x7f9a28198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.238+0000 7f9a2e191640 1 --2- 172.21.15.27:0/1547277052 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f9a140a3320 0x7f9a140a57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.238+0000 7f9a2e191640 1 --2- 172.21.15.27:0/1547277052 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a28102590 0x7f9a28197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.238+0000 7f9a2e191640 1 -- 172.21.15.27:0/1547277052 >> 172.21.15.27:0/1547277052 conn(0x7f9a280fc170 msgr2=0x7f9a28102ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:00.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.238+0000 7f9a2e191640 1 -- 172.21.15.27:0/1547277052 shutdown_connections 2024-09-19T08:11:00.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.238+0000 7f9a2e191640 1 -- 172.21.15.27:0/1547277052 wait complete. 2024-09-19T08:11:00.249 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:04:29.312984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T08:09:08.046858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T08:09:10.223258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T08:11:00.250 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T08:11:00.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.360+0000 7f3b03427640 1 -- 172.21.15.27:0/16147383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3afc1077e0 msgr2=0x7f3afc109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:00.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.360+0000 7f3b03427640 1 --2- 172.21.15.27:0/16147383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3afc1077e0 0x7f3afc109c50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009ca0 tx=0x7f3af402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.360+0000 7f3b03427640 1 -- 172.21.15.27:0/16147383 shutdown_connections 2024-09-19T08:11:00.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.360+0000 7f3b03427640 1 --2- 172.21.15.27:0/16147383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3afc1077e0 0x7f3afc109c50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.360+0000 7f3b03427640 1 --2- 172.21.15.27:0/16147383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3afc104eb0 0x7f3afc1072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.360+0000 7f3b03427640 1 --2- 172.21.15.27:0/16147383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3afc102580 0x7f3afc104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.360+0000 7f3b03427640 1 -- 172.21.15.27:0/16147383 >> 172.21.15.27:0/16147383 conn(0x7f3afc0fc140 msgr2=0x7f3afc0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.360+0000 7f3b03427640 1 -- 172.21.15.27:0/16147383 shutdown_connections 2024-09-19T08:11:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.360+0000 7f3b03427640 1 -- 172.21.15.27:0/16147383 wait complete. 2024-09-19T08:11:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.361+0000 7f3b03427640 1 Processor -- start 2024-09-19T08:11:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.361+0000 7f3b03427640 1 -- start start 2024-09-19T08:11:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.361+0000 7f3b03427640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3afc102580 0x7f3afc197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.361+0000 7f3b03427640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3afc104eb0 0x7f3afc1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.361+0000 7f3b03427640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3afc1077e0 0x7f3afc19f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.361+0000 7f3b03427640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc10d7a0 con 0x7f3afc102580 2024-09-19T08:11:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.361+0000 7f3b03427640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc10d620 con 0x7f3afc1077e0 2024-09-19T08:11:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.361+0000 7f3b03427640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc10d920 con 0x7f3afc104eb0 2024-09-19T08:11:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.361+0000 7f3b011c3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3afc102580 0x7f3afc197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.361+0000 7f3b011c3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3afc102580 0x7f3afc197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35572/0 (socket says 172.21.15.27:35572) 2024-09-19T08:11:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.361+0000 7f3b011c3640 1 -- 172.21.15.27:0/4248299000 learned_addr learned my addr 172.21.15.27:0/4248299000 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.361+0000 7f3b009c2640 1 --2- 172.21.15.27:0/4248299000 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3afc104eb0 0x7f3afc1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.361+0000 7f3b019c4640 1 --2- 172.21.15.27:0/4248299000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3afc1077e0 0x7f3afc19f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.362+0000 7f3b011c3640 1 -- 172.21.15.27:0/4248299000 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3afc104eb0 msgr2=0x7f3afc1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.362+0000 7f3b011c3640 1 --2- 172.21.15.27:0/4248299000 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3afc104eb0 0x7f3afc1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.362+0000 7f3b011c3640 1 -- 172.21.15.27:0/4248299000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3afc1077e0 msgr2=0x7f3afc19f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.362+0000 7f3b011c3640 1 --2- 172.21.15.27:0/4248299000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3afc1077e0 0x7f3afc19f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.362+0000 7f3b011c3640 1 -- 172.21.15.27:0/4248299000 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3afc19faa0 con 0x7f3afc102580 2024-09-19T08:11:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.362+0000 7f3b009c2640 1 --2- 172.21.15.27:0/4248299000 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3afc104eb0 0x7f3afc1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:11:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.362+0000 7f3b011c3640 1 --2- 172.21.15.27:0/4248299000 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3afc102580 0x7f3afc197e80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3af800e9f0 tx=0x7f3af800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.362+0000 7f3aee7fc640 1 -- 172.21.15.27:0/4248299000 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af800cd80 con 0x7f3afc102580 2024-09-19T08:11:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.362+0000 7f3aee7fc640 1 -- 172.21.15.27:0/4248299000 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3af8010910 con 0x7f3afc102580 2024-09-19T08:11:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.362+0000 7f3aee7fc640 1 -- 172.21.15.27:0/4248299000 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af8018990 con 0x7f3afc102580 2024-09-19T08:11:00.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.362+0000 7f3b03427640 1 -- 172.21.15.27:0/4248299000 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3afc19fd90 con 0x7f3afc102580 2024-09-19T08:11:00.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.362+0000 7f3b03427640 1 -- 172.21.15.27:0/4248299000 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3afc1a0220 con 0x7f3afc102580 2024-09-19T08:11:00.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.363+0000 7f3b03427640 1 -- 172.21.15.27:0/4248299000 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3afc0fdc30 con 0x7f3afc102580 2024-09-19T08:11:00.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.364+0000 7f3aee7fc640 1 -- 172.21.15.27:0/4248299000 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7f3af8010ac0 con 0x7f3afc102580 2024-09-19T08:11:00.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.365+0000 7f3aee7fc640 1 --2- 172.21.15.27:0/4248299000 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f3ae80a32a0 0x7f3ae80a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:00.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.365+0000 7f3b009c2640 1 -- 172.21.15.27:0/4248299000 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f3ae80a32a0 msgr2=0x7f3ae80a5760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/4220278108 2024-09-19T08:11:00.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.365+0000 7f3aee7fc640 1 -- 172.21.15.27:0/4248299000 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f3af80cfc30 con 0x7f3afc102580 2024-09-19T08:11:00.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.365+0000 7f3b009c2640 1 --2- 172.21.15.27:0/4248299000 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f3ae80a32a0 0x7f3ae80a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:11:00.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.369+0000 7f3aee7fc640 1 -- 172.21.15.27:0/4248299000 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3af809c330 con 0x7f3afc102580 2024-09-19T08:11:00.458 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:00 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1547277052' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:11:00.458 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:11:00.238+0000 7f1b27ea8040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:11:00.458 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:11:00.329+0000 7f1b27ea8040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:11:00.458 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:11:00.395+0000 7f1b27ea8040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:11:00.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:00 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1547277052' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:11:00.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:00 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1547277052' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:11:00.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.547+0000 7f3b03427640 1 -- 172.21.15.27:0/4248299000 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3afc062ef0 con 0x7f3afc102580 2024-09-19T08:11:00.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.548+0000 7f3aee7fc640 1 -- 172.21.15.27:0/4248299000 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) ==== 93+0+10 (secure 0 0 0) 0x7f3af80a0630 con 0x7f3afc102580 2024-09-19T08:11:00.547 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-09-19T08:11:00.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.550+0000 7f3b03427640 1 -- 172.21.15.27:0/4248299000 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f3ae80a32a0 msgr2=0x7f3ae80a5760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:11:00.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.550+0000 7f3b03427640 1 --2- 172.21.15.27:0/4248299000 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f3ae80a32a0 0x7f3ae80a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.550+0000 7f3b03427640 1 -- 172.21.15.27:0/4248299000 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3afc102580 msgr2=0x7f3afc197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:00.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.550+0000 7f3b03427640 1 --2- 172.21.15.27:0/4248299000 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3afc102580 0x7f3afc197e80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3af800e9f0 tx=0x7f3af800eeb0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.550+0000 7f3b03427640 1 -- 172.21.15.27:0/4248299000 shutdown_connections 2024-09-19T08:11:00.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.550+0000 7f3b03427640 1 --2- 172.21.15.27:0/4248299000 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f3ae80a32a0 0x7f3ae80a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.550+0000 7f3b03427640 1 --2- 172.21.15.27:0/4248299000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3afc1077e0 0x7f3afc19f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.550+0000 7f3b03427640 1 --2- 172.21.15.27:0/4248299000 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3afc104eb0 0x7f3afc1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.550+0000 7f3b03427640 1 --2- 172.21.15.27:0/4248299000 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3afc102580 0x7f3afc197e80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.550+0000 7f3b03427640 1 -- 172.21.15.27:0/4248299000 >> 172.21.15.27:0/4248299000 conn(0x7f3afc0fc140 msgr2=0x7f3afc102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:00.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.550+0000 7f3b03427640 1 -- 172.21.15.27:0/4248299000 shutdown_connections 2024-09-19T08:11:00.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.550+0000 7f3b03427640 1 -- 172.21.15.27:0/4248299000 wait complete. 2024-09-19T08:11:00.561 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T08:11:00.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.670+0000 7fbc21731640 1 -- 172.21.15.27:0/4077076472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc1c102640 msgr2=0x7fbc1c104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:00.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.670+0000 7fbc21731640 1 --2- 172.21.15.27:0/4077076472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc1c102640 0x7fbc1c104a30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c009900 tx=0x7fbc0c02a410 comp rx=0 tx=0).stop 2024-09-19T08:11:00.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.670+0000 7fbc21731640 1 -- 172.21.15.27:0/4077076472 shutdown_connections 2024-09-19T08:11:00.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.670+0000 7fbc21731640 1 --2- 172.21.15.27:0/4077076472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc1c1078a0 0x7fbc1c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.670+0000 7fbc21731640 1 --2- 172.21.15.27:0/4077076472 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc1c104f70 0x7fbc1c107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.670+0000 7fbc21731640 1 --2- 172.21.15.27:0/4077076472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc1c102640 0x7fbc1c104a30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.670+0000 7fbc21731640 1 -- 172.21.15.27:0/4077076472 >> 172.21.15.27:0/4077076472 conn(0x7fbc1c0fc140 msgr2=0x7fbc1c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:00.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.670+0000 7fbc21731640 1 -- 172.21.15.27:0/4077076472 shutdown_connections 2024-09-19T08:11:00.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.670+0000 7fbc21731640 1 -- 172.21.15.27:0/4077076472 wait complete. 2024-09-19T08:11:00.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.670+0000 7fbc21731640 1 Processor -- start 2024-09-19T08:11:00.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.671+0000 7fbc21731640 1 -- start start 2024-09-19T08:11:00.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.671+0000 7fbc21731640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc1c102640 0x7fbc1c101fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:00.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.671+0000 7fbc21731640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc1c104f70 0x7fbc1c1005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:00.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.671+0000 7fbc21731640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc1c1078a0 0x7fbc1c100b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:00.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.671+0000 7fbc21731640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c10d790 con 0x7fbc1c104f70 2024-09-19T08:11:00.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.671+0000 7fbc21731640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c10d610 con 0x7fbc1c1078a0 2024-09-19T08:11:00.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.671+0000 7fbc21731640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c10d910 con 0x7fbc1c102640 2024-09-19T08:11:00.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.671+0000 7fbc1a7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc1c104f70 0x7fbc1c1005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:00.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.671+0000 7fbc1a7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc1c104f70 0x7fbc1c1005f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35592/0 (socket says 172.21.15.27:35592) 2024-09-19T08:11:00.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.671+0000 7fbc1a7fc640 1 -- 172.21.15.27:0/2040350230 learned_addr learned my addr 172.21.15.27:0/2040350230 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:00.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.671+0000 7fbc1affd640 1 --2- 172.21.15.27:0/2040350230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc1c102640 0x7fbc1c101fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:00.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.671+0000 7fbc1b7fe640 1 --2- 172.21.15.27:0/2040350230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc1c1078a0 0x7fbc1c100b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:00.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.671+0000 7fbc1a7fc640 1 -- 172.21.15.27:0/2040350230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc1c102640 msgr2=0x7fbc1c101fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:00.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.671+0000 7fbc1a7fc640 1 --2- 172.21.15.27:0/2040350230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc1c102640 0x7fbc1c101fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.671+0000 7fbc1a7fc640 1 -- 172.21.15.27:0/2040350230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc1c1078a0 msgr2=0x7fbc1c100b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:00.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.671+0000 7fbc1a7fc640 1 --2- 172.21.15.27:0/2040350230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc1c1078a0 0x7fbc1c100b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.671+0000 7fbc1a7fc640 1 -- 172.21.15.27:0/2040350230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc1c1013c0 con 0x7fbc1c104f70 2024-09-19T08:11:00.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.671+0000 7fbc1a7fc640 1 --2- 172.21.15.27:0/2040350230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc1c104f70 0x7fbc1c1005f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000e9c0 tx=0x7fbc1000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:00.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.672+0000 7fbc03fff640 1 -- 172.21.15.27:0/2040350230 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1000cd80 con 0x7fbc1c104f70 2024-09-19T08:11:00.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.672+0000 7fbc03fff640 1 -- 172.21.15.27:0/2040350230 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc10005500 con 0x7fbc1c104f70 2024-09-19T08:11:00.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.672+0000 7fbc21731640 1 -- 172.21.15.27:0/2040350230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc1c1a1fc0 con 0x7fbc1c104f70 2024-09-19T08:11:00.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.672+0000 7fbc03fff640 1 -- 172.21.15.27:0/2040350230 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc10010690 con 0x7fbc1c104f70 2024-09-19T08:11:00.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.672+0000 7fbc21731640 1 -- 172.21.15.27:0/2040350230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc1c1a2420 con 0x7fbc1c104f70 2024-09-19T08:11:00.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.673+0000 7fbc21731640 1 -- 172.21.15.27:0/2040350230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc1c0fdc30 con 0x7fbc1c104f70 2024-09-19T08:11:00.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.674+0000 7fbc03fff640 1 -- 172.21.15.27:0/2040350230 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7fbc100046c0 con 0x7fbc1c104f70 2024-09-19T08:11:00.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.675+0000 7fbc03fff640 1 --2- 172.21.15.27:0/2040350230 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fbc040a32a0 0x7fbc040a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:00.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.675+0000 7fbc1affd640 1 -- 172.21.15.27:0/2040350230 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fbc040a32a0 msgr2=0x7fbc040a5760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/4220278108 2024-09-19T08:11:00.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.675+0000 7fbc03fff640 1 -- 172.21.15.27:0/2040350230 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fbc100cfc70 con 0x7fbc1c104f70 2024-09-19T08:11:00.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.675+0000 7fbc1affd640 1 --2- 172.21.15.27:0/2040350230 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fbc040a32a0 0x7fbc040a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:11:00.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.679+0000 7fbc03fff640 1 -- 172.21.15.27:0/2040350230 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbc1009c9c0 con 0x7fbc1c104f70 2024-09-19T08:11:00.752 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:11:00.458+0000 7f1b27ea8040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:11:00.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.857+0000 7fbc21731640 1 -- 172.21.15.27:0/2040350230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbc1c062ef0 con 0x7fbc1c104f70 2024-09-19T08:11:00.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.857+0000 7fbc03fff640 1 -- 172.21.15.27:0/2040350230 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) ==== 104+0+11 (secure 0 0 0) 0x7fbc1009c2c0 con 0x7fbc1c104f70 2024-09-19T08:11:00.857 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-09-19T08:11:00.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.859+0000 7fbc21731640 1 -- 172.21.15.27:0/2040350230 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fbc040a32a0 msgr2=0x7fbc040a5760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:11:00.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.859+0000 7fbc21731640 1 --2- 172.21.15.27:0/2040350230 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fbc040a32a0 0x7fbc040a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.859+0000 7fbc21731640 1 -- 172.21.15.27:0/2040350230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc1c104f70 msgr2=0x7fbc1c1005f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:00.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.859+0000 7fbc21731640 1 --2- 172.21.15.27:0/2040350230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc1c104f70 0x7fbc1c1005f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000e9c0 tx=0x7fbc1000ee80 comp rx=0 tx=0).stop 2024-09-19T08:11:00.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.859+0000 7fbc21731640 1 -- 172.21.15.27:0/2040350230 shutdown_connections 2024-09-19T08:11:00.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.859+0000 7fbc21731640 1 --2- 172.21.15.27:0/2040350230 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7fbc040a32a0 0x7fbc040a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.859+0000 7fbc21731640 1 --2- 172.21.15.27:0/2040350230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc1c1078a0 0x7fbc1c100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.859+0000 7fbc21731640 1 --2- 172.21.15.27:0/2040350230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc1c104f70 0x7fbc1c1005f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.859+0000 7fbc21731640 1 --2- 172.21.15.27:0/2040350230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc1c102640 0x7fbc1c101fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.859+0000 7fbc21731640 1 -- 172.21.15.27:0/2040350230 >> 172.21.15.27:0/2040350230 conn(0x7fbc1c0fc140 msgr2=0x7fbc1c103080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:00.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.859+0000 7fbc21731640 1 -- 172.21.15.27:0/2040350230 shutdown_connections 2024-09-19T08:11:00.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.859+0000 7fbc21731640 1 -- 172.21.15.27:0/2040350230 wait complete. 2024-09-19T08:11:00.870 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T08:11:00.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.979+0000 7f88c55e4640 1 -- 172.21.15.27:0/3750413192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88c0101c20 msgr2=0x7f88c01020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:00.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.979+0000 7f88c55e4640 1 --2- 172.21.15.27:0/3750413192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88c0101c20 0x7f88c01020a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009900 tx=0x7f88b402a410 comp rx=0 tx=0).stop 2024-09-19T08:11:00.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.979+0000 7f88c55e4640 1 -- 172.21.15.27:0/3750413192 shutdown_connections 2024-09-19T08:11:00.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.979+0000 7f88c55e4640 1 --2- 172.21.15.27:0/3750413192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88c01025e0 0x7f88c0108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.979+0000 7f88c55e4640 1 --2- 172.21.15.27:0/3750413192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88c0101c20 0x7f88c01020a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.979+0000 7f88c55e4640 1 --2- 172.21.15.27:0/3750413192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88c0100a30 0x7f88c0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.979+0000 7f88c55e4640 1 -- 172.21.15.27:0/3750413192 >> 172.21.15.27:0/3750413192 conn(0x7f88c00fc1b0 msgr2=0x7f88c00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:00.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.979+0000 7f88c55e4640 1 -- 172.21.15.27:0/3750413192 shutdown_connections 2024-09-19T08:11:00.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.979+0000 7f88c55e4640 1 -- 172.21.15.27:0/3750413192 wait complete. 2024-09-19T08:11:00.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.980+0000 7f88c55e4640 1 Processor -- start 2024-09-19T08:11:00.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.980+0000 7f88c55e4640 1 -- start start 2024-09-19T08:11:00.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.980+0000 7f88c55e4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88c0100a30 0x7f88c006aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:00.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.980+0000 7f88c55e4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88c0101c20 0x7f88c019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:00.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.980+0000 7f88c55e4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88c01025e0 0x7f88c019f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:00.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.980+0000 7f88c55e4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f88c010c690 con 0x7f88c01025e0 2024-09-19T08:11:00.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.980+0000 7f88c55e4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f88c010c510 con 0x7f88c0100a30 2024-09-19T08:11:00.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.980+0000 7f88c55e4640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f88c010c810 con 0x7f88c0101c20 2024-09-19T08:11:00.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.980+0000 7f88bf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88c01025e0 0x7f88c019f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:00.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.980+0000 7f88bf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88c01025e0 0x7f88c019f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35606/0 (socket says 172.21.15.27:35606) 2024-09-19T08:11:00.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.980+0000 7f88bf7fe640 1 -- 172.21.15.27:0/1657924131 learned_addr learned my addr 172.21.15.27:0/1657924131 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:00.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.980+0000 7f88beffd640 1 --2- 172.21.15.27:0/1657924131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88c0100a30 0x7f88c006aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:00.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.980+0000 7f88be7fc640 1 --2- 172.21.15.27:0/1657924131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88c0101c20 0x7f88c019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:00.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.981+0000 7f88bf7fe640 1 -- 172.21.15.27:0/1657924131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88c0101c20 msgr2=0x7f88c019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:00.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.981+0000 7f88bf7fe640 1 --2- 172.21.15.27:0/1657924131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88c0101c20 0x7f88c019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.981+0000 7f88bf7fe640 1 -- 172.21.15.27:0/1657924131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88c0100a30 msgr2=0x7f88c006aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:00.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.981+0000 7f88bf7fe640 1 --2- 172.21.15.27:0/1657924131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88c0100a30 0x7f88c006aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:00.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.981+0000 7f88bf7fe640 1 -- 172.21.15.27:0/1657924131 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c019fb20 con 0x7f88c01025e0 2024-09-19T08:11:00.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.981+0000 7f88beffd640 1 --2- 172.21.15.27:0/1657924131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88c0100a30 0x7f88c006aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:11:00.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.981+0000 7f88bf7fe640 1 --2- 172.21.15.27:0/1657924131 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88c01025e0 0x7f88c019f210 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f88b800eb10 tx=0x7f88b800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:00.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.981+0000 7f88a7fff640 1 -- 172.21.15.27:0/1657924131 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b8004b20 con 0x7f88c01025e0 2024-09-19T08:11:00.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.981+0000 7f88c55e4640 1 -- 172.21.15.27:0/1657924131 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c019fdb0 con 0x7f88c01025e0 2024-09-19T08:11:00.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.981+0000 7f88a7fff640 1 -- 172.21.15.27:0/1657924131 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88b8004cc0 con 0x7f88c01025e0 2024-09-19T08:11:00.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.981+0000 7f88a7fff640 1 -- 172.21.15.27:0/1657924131 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b8010760 con 0x7f88c01025e0 2024-09-19T08:11:00.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.981+0000 7f88c55e4640 1 -- 172.21.15.27:0/1657924131 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c01a0270 con 0x7f88c01025e0 2024-09-19T08:11:00.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.982+0000 7f88c55e4640 1 -- 172.21.15.27:0/1657924131 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c0107e60 con 0x7f88c01025e0 2024-09-19T08:11:00.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.983+0000 7f88a7fff640 1 -- 172.21.15.27:0/1657924131 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7f88b8010900 con 0x7f88c01025e0 2024-09-19T08:11:00.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.984+0000 7f88a7fff640 1 --2- 172.21.15.27:0/1657924131 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f88a80a32a0 0x7f88a80a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:00.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.984+0000 7f88beffd640 1 -- 172.21.15.27:0/1657924131 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f88a80a32a0 msgr2=0x7f88a80a5760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/4220278108 2024-09-19T08:11:00.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.984+0000 7f88a7fff640 1 -- 172.21.15.27:0/1657924131 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f88b80d00c0 con 0x7f88c01025e0 2024-09-19T08:11:00.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.984+0000 7f88beffd640 1 --2- 172.21.15.27:0/1657924131 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f88a80a32a0 0x7f88a80a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:11:00.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:00.987+0000 7f88a7fff640 1 -- 172.21.15.27:0/1657924131 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f88b8054210 con 0x7f88c01025e0 2024-09-19T08:11:01.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:01.167+0000 7f88c55e4640 1 -- 172.21.15.27:0/1657924131 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f88c002d990 con 0x7f88c01025e0 2024-09-19T08:11:01.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:01.168+0000 7f88a7fff640 1 -- 172.21.15.27:0/1657924131 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) ==== 100+0+11 (secure 0 0 0) 0x7f88b809ce10 con 0x7f88c01025e0 2024-09-19T08:11:01.167 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-09-19T08:11:01.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:01.170+0000 7f88c55e4640 1 -- 172.21.15.27:0/1657924131 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f88a80a32a0 msgr2=0x7f88a80a5760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:11:01.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:01.170+0000 7f88c55e4640 1 --2- 172.21.15.27:0/1657924131 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f88a80a32a0 0x7f88a80a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:01.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:01.170+0000 7f88c55e4640 1 -- 172.21.15.27:0/1657924131 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88c01025e0 msgr2=0x7f88c019f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:01.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:01.170+0000 7f88c55e4640 1 --2- 172.21.15.27:0/1657924131 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88c01025e0 0x7f88c019f210 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f88b800eb10 tx=0x7f88b800c2d0 comp rx=0 tx=0).stop 2024-09-19T08:11:01.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:01.170+0000 7f88c55e4640 1 -- 172.21.15.27:0/1657924131 shutdown_connections 2024-09-19T08:11:01.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:01.170+0000 7f88c55e4640 1 --2- 172.21.15.27:0/1657924131 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88c01025e0 0x7f88c019f210 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:01.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:01.170+0000 7f88c55e4640 1 --2- 172.21.15.27:0/1657924131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88c0101c20 0x7f88c019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:01.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:01.170+0000 7f88c55e4640 1 --2- 172.21.15.27:0/1657924131 >> [v2:172.21.15.27:6800/4220278108,v1:172.21.15.27:6801/4220278108] conn(0x7f88a80a32a0 0x7f88a80a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:01.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:01.170+0000 7f88c55e4640 1 --2- 172.21.15.27:0/1657924131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88c0100a30 0x7f88c006aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:01.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:01.170+0000 7f88c55e4640 1 -- 172.21.15.27:0/1657924131 >> 172.21.15.27:0/1657924131 conn(0x7f88c00fc1b0 msgr2=0x7f88c0105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:01.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:01.170+0000 7f88c55e4640 1 -- 172.21.15.27:0/1657924131 shutdown_connections 2024-09-19T08:11:01.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:01.170+0000 7f88c55e4640 1 -- 172.21.15.27:0/1657924131 wait complete. 2024-09-19T08:11:01.182 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T08:11:01.182 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:11:01.237 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:11:00 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y[36732]: 2024-09-19T08:11:00.894+0000 7ff71361a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:11:01.258 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:11:00 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z[37010]: 2024-09-19T08:11:00.893+0000 7f4985490040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:11:01.491 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:01.502 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:11:01.316+0000 7f1b27ea8040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:11:01.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/4248299000' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:11:01.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2040350230' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:11:01.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-mon[31209]: Standby manager daemon z restarted 2024-09-19T08:11:01.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-mon[31209]: Standby manager daemon z started 2024-09-19T08:11:01.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-mon[31209]: Standby manager daemon y restarted 2024-09-19T08:11:01.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-mon[31209]: Standby manager daemon y started 2024-09-19T08:11:01.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-mon[31209]: from='mgr.? 172.21.15.203:0/1651526148' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:11:01.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-mon[31209]: from='mgr.? 172.21.15.203:0/1651526148' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:11:01.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-mon[31209]: from='mgr.? 172.21.15.203:0/1651526148' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:11:01.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-mon[31209]: from='mgr.? 172.21.15.155:0/1268560045' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:11:01.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-mon[31209]: from='mgr.? 172.21.15.203:0/1651526148' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:11:01.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-mon[31209]: from='mgr.? 172.21.15.155:0/1268560045' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:11:01.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-mon[31209]: from='mgr.? 172.21.15.155:0/1268560045' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:11:01.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-mon[31209]: from='mgr.? 172.21.15.155:0/1268560045' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:11:01.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1657924131' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:11:01.734 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:01 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/4248299000' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:11:01.734 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:01 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2040350230' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:11:01.734 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:01 smithi203 ceph-mon[35198]: Standby manager daemon z restarted 2024-09-19T08:11:01.734 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:01 smithi203 ceph-mon[35198]: Standby manager daemon z started 2024-09-19T08:11:01.734 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:01 smithi203 ceph-mon[35198]: Standby manager daemon y restarted 2024-09-19T08:11:01.734 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:01 smithi203 ceph-mon[35198]: Standby manager daemon y started 2024-09-19T08:11:01.734 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:01 smithi203 ceph-mon[35198]: from='mgr.? 172.21.15.203:0/1651526148' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:11:01.734 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:01 smithi203 ceph-mon[35198]: from='mgr.? 172.21.15.203:0/1651526148' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:11:01.734 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:01 smithi203 ceph-mon[35198]: from='mgr.? 172.21.15.203:0/1651526148' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:11:01.735 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:01 smithi203 ceph-mon[35198]: from='mgr.? 172.21.15.155:0/1268560045' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:11:01.735 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:01 smithi203 ceph-mon[35198]: from='mgr.? 172.21.15.203:0/1651526148' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:11:01.735 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:01 smithi203 ceph-mon[35198]: from='mgr.? 172.21.15.155:0/1268560045' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:11:01.735 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:01 smithi203 ceph-mon[35198]: from='mgr.? 172.21.15.155:0/1268560045' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:11:01.735 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:01 smithi203 ceph-mon[35198]: from='mgr.? 172.21.15.155:0/1268560045' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:11:01.735 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:01 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1657924131' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:11:01.735 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:01 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/4248299000' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:11:01.735 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:01 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2040350230' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:11:01.736 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:01 smithi155 ceph-mon[35362]: Standby manager daemon z restarted 2024-09-19T08:11:01.736 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:01 smithi155 ceph-mon[35362]: Standby manager daemon z started 2024-09-19T08:11:01.736 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:01 smithi155 ceph-mon[35362]: Standby manager daemon y restarted 2024-09-19T08:11:01.736 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:01 smithi155 ceph-mon[35362]: Standby manager daemon y started 2024-09-19T08:11:01.736 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:01 smithi155 ceph-mon[35362]: from='mgr.? 172.21.15.203:0/1651526148' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:11:01.736 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:01 smithi155 ceph-mon[35362]: from='mgr.? 172.21.15.203:0/1651526148' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:11:01.736 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:01 smithi155 ceph-mon[35362]: from='mgr.? 172.21.15.203:0/1651526148' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:11:01.736 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:01 smithi155 ceph-mon[35362]: from='mgr.? 172.21.15.155:0/1268560045' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:11:01.736 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:01 smithi155 ceph-mon[35362]: from='mgr.? 172.21.15.203:0/1651526148' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:11:01.736 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:01 smithi155 ceph-mon[35362]: from='mgr.? 172.21.15.155:0/1268560045' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:11:01.736 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:01 smithi155 ceph-mon[35362]: from='mgr.? 172.21.15.155:0/1268560045' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:11:01.736 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:01 smithi155 ceph-mon[35362]: from='mgr.? 172.21.15.155:0/1268560045' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:11:01.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:01 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1657924131' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:11:01.864 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:11:01.612+0000 7f1a924c0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:11:01.864 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:11:01.612+0000 7f1a924c0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:11:01.864 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:11:01.612+0000 7f1a924c0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:11:01.864 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:11:01.612+0000 7f1a924c0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:11:01.864 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:11:01.613+0000 7f1a924c0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:11:01.864 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:11:01.614+0000 7f1a8ecb9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:11:01.864 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:11:01.614+0000 7f1a8ecb9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:11:01.864 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:11:01.614+0000 7f1a8ecb9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:11:01.865 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:11:01.614+0000 7f1a8ecb9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:11:01.865 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:01 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:11:01.614+0000 7f1a8ecb9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:11:02.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.063+0000 7f9ee33c7640 1 -- 172.21.15.27:0/317142089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9edc1036e0 msgr2=0x7f9edc107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:02.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.063+0000 7f9ee33c7640 1 --2- 172.21.15.27:0/317142089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9edc1036e0 0x7f9edc107b90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009930 tx=0x7f9ecc02a420 comp rx=0 tx=0).stop 2024-09-19T08:11:02.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.063+0000 7f9ee33c7640 1 -- 172.21.15.27:0/317142089 shutdown_connections 2024-09-19T08:11:02.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.063+0000 7f9ee33c7640 1 --2- 172.21.15.27:0/317142089 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9edc1082a0 0x7f9edc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:02.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.063+0000 7f9ee33c7640 1 --2- 172.21.15.27:0/317142089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9edc1036e0 0x7f9edc107b90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:02.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.063+0000 7f9ee33c7640 1 --2- 172.21.15.27:0/317142089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9edc102d30 0x7f9edc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:02.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.063+0000 7f9ee33c7640 1 -- 172.21.15.27:0/317142089 >> 172.21.15.27:0/317142089 conn(0x7f9edc0fc7d0 msgr2=0x7f9edc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:02.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.063+0000 7f9ee33c7640 1 -- 172.21.15.27:0/317142089 shutdown_connections 2024-09-19T08:11:02.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.063+0000 7f9ee33c7640 1 -- 172.21.15.27:0/317142089 wait complete. 2024-09-19T08:11:02.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.064+0000 7f9ee33c7640 1 Processor -- start 2024-09-19T08:11:02.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.064+0000 7f9ee33c7640 1 -- start start 2024-09-19T08:11:02.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.064+0000 7f9ee33c7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9edc102d30 0x7f9edc198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:02.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.064+0000 7f9ee33c7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9edc1036e0 0x7f9edc198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:02.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.064+0000 7f9ee33c7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9edc1082a0 0x7f9edc19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:02.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.064+0000 7f9ee33c7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc1120a0 con 0x7f9edc1082a0 2024-09-19T08:11:02.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.064+0000 7f9ee33c7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc111f20 con 0x7f9edc102d30 2024-09-19T08:11:02.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.064+0000 7f9ee33c7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc112220 con 0x7f9edc1036e0 2024-09-19T08:11:02.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.064+0000 7f9ee1163640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9edc102d30 0x7f9edc198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:02.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.064+0000 7f9ee1964640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9edc1082a0 0x7f9edc19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:02.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.064+0000 7f9ee1163640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9edc102d30 0x7f9edc198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.27:35800/0 (socket says 172.21.15.27:35800) 2024-09-19T08:11:02.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.064+0000 7f9ee1163640 1 -- 172.21.15.27:0/1779725291 learned_addr learned my addr 172.21.15.27:0/1779725291 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:02.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.064+0000 7f9ee0962640 1 --2- 172.21.15.27:0/1779725291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9edc1036e0 0x7f9edc198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:02.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.065+0000 7f9ee1964640 1 -- 172.21.15.27:0/1779725291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9edc1036e0 msgr2=0x7f9edc198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:02.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.065+0000 7f9ee1964640 1 --2- 172.21.15.27:0/1779725291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9edc1036e0 0x7f9edc198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:02.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.065+0000 7f9ee1964640 1 -- 172.21.15.27:0/1779725291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9edc102d30 msgr2=0x7f9edc198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:02.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.065+0000 7f9ee1964640 1 --2- 172.21.15.27:0/1779725291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9edc102d30 0x7f9edc198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:02.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.065+0000 7f9ee1964640 1 -- 172.21.15.27:0/1779725291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc19d5f0 con 0x7f9edc1082a0 2024-09-19T08:11:02.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.065+0000 7f9ee1163640 1 --2- 172.21.15.27:0/1779725291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9edc102d30 0x7f9edc198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:11:02.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.065+0000 7f9ee1964640 1 --2- 172.21.15.27:0/1779725291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9edc1082a0 0x7f9edc19cf10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4009fd0 tx=0x7f9ed400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:02.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.065+0000 7f9ed27fc640 1 -- 172.21.15.27:0/1779725291 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed400ce20 con 0x7f9edc1082a0 2024-09-19T08:11:02.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.065+0000 7f9ee33c7640 1 -- 172.21.15.27:0/1779725291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9edc19d8e0 con 0x7f9edc1082a0 2024-09-19T08:11:02.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.065+0000 7f9ed27fc640 1 -- 172.21.15.27:0/1779725291 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ed4005020 con 0x7f9edc1082a0 2024-09-19T08:11:02.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.065+0000 7f9ee33c7640 1 -- 172.21.15.27:0/1779725291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9edc1a51c0 con 0x7f9edc1082a0 2024-09-19T08:11:02.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.065+0000 7f9ed27fc640 1 -- 172.21.15.27:0/1779725291 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4010720 con 0x7f9edc1082a0 2024-09-19T08:11:02.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.066+0000 7f9ee33c7640 1 -- 172.21.15.27:0/1779725291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9edc103110 con 0x7f9edc1082a0 2024-09-19T08:11:02.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.068+0000 7f9ed27fc640 1 -- 172.21.15.27:0/1779725291 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 21) ==== 138040+0+0 (secure 0 0 0) 0x7f9ed4005540 con 0x7f9edc1082a0 2024-09-19T08:11:02.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.069+0000 7f9ed27fc640 1 -- 172.21.15.27:0/1779725291 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f9ed40cfc30 con 0x7f9edc1082a0 2024-09-19T08:11:02.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.071+0000 7f9ed27fc640 1 -- 172.21.15.27:0/1779725291 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9ed409cd10 con 0x7f9edc1082a0 2024-09-19T08:11:02.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.314+0000 7f9ee33c7640 1 -- 172.21.15.27:0/1779725291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9edc1999a0 con 0x7f9edc1082a0 2024-09-19T08:11:02.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.315+0000 7f9ed27fc640 1 -- 172.21.15.27:0/1779725291 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f9edc1999a0 con 0x7f9edc1082a0 2024-09-19T08:11:02.315 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:11:02.315 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:11:02.316 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:11:02.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.318+0000 7f9ee33c7640 1 -- 172.21.15.27:0/1779725291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9edc1082a0 msgr2=0x7f9edc19cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:02.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.318+0000 7f9ee33c7640 1 --2- 172.21.15.27:0/1779725291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9edc1082a0 0x7f9edc19cf10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4009fd0 tx=0x7f9ed400ef10 comp rx=0 tx=0).stop 2024-09-19T08:11:02.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.318+0000 7f9ee33c7640 1 -- 172.21.15.27:0/1779725291 shutdown_connections 2024-09-19T08:11:02.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.318+0000 7f9ee33c7640 1 --2- 172.21.15.27:0/1779725291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9edc1082a0 0x7f9edc19cf10 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:02.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.318+0000 7f9ee33c7640 1 --2- 172.21.15.27:0/1779725291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9edc1036e0 0x7f9edc198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:02.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.318+0000 7f9ee33c7640 1 --2- 172.21.15.27:0/1779725291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9edc102d30 0x7f9edc198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:02.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.318+0000 7f9ee33c7640 1 -- 172.21.15.27:0/1779725291 >> 172.21.15.27:0/1779725291 conn(0x7f9edc0fc7d0 msgr2=0x7f9edc106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:02.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.318+0000 7f9ee33c7640 1 -- 172.21.15.27:0/1779725291 shutdown_connections 2024-09-19T08:11:02.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:02.318+0000 7f9ee33c7640 1 -- 172.21.15.27:0/1779725291 wait complete. 2024-09-19T08:11:02.565 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: mgrmap e20: x(active, since 8m), standbys: y, z 2024-09-19T08:11:02.566 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: Active manager daemon x restarted 2024-09-19T08:11:02.566 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: Activating manager daemon x 2024-09-19T08:11:02.566 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T08:11:02.566 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: mgrmap e21: x(active, starting, since 0.0125582s), standbys: y, z 2024-09-19T08:11:02.566 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:11:02.566 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:11:02.566 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:11:02.566 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:11:02.566 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:11:02.566 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:11:02.566 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:11:02.567 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:11:02.567 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:11:02.567 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:11:02.567 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:11:02.567 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:11:02.567 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:11:02.567 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:11:02.567 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:11:02.567 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:11:02.567 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:11:02.567 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:11:02.567 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:11:02.567 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:11:02.568 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:11:02.568 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:11:02.568 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:11:02.568 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:11:02.568 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:11:02.568 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:11:02.568 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:11:02.568 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:11:02.568 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:11:02.568 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:11:02.568 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:11:02.568 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:11:02.568 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:11:02.569 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: Manager daemon x is now available 2024-09-19T08:11:02.569 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:11:02.569 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:11:02.569 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:11:02.569 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:11:02.569 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:02 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:11:02.576 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: mgrmap e20: x(active, since 8m), standbys: y, z 2024-09-19T08:11:02.576 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: Active manager daemon x restarted 2024-09-19T08:11:02.576 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: Activating manager daemon x 2024-09-19T08:11:02.576 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T08:11:02.577 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: mgrmap e21: x(active, starting, since 0.0125582s), standbys: y, z 2024-09-19T08:11:02.577 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:11:02.577 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:11:02.577 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:11:02.577 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:11:02.577 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:11:02.577 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:11:02.577 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:11:02.577 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:11:02.577 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:11:02.577 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:11:02.577 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:11:02.578 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:11:02.578 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:11:02.578 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:11:02.578 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:11:02.578 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:11:02.578 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:11:02.578 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:11:02.578 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:11:02.578 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:11:02.578 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:11:02.578 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:11:02.578 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:11:02.578 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:11:02.578 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:11:02.578 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:11:02.579 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:11:02.579 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:11:02.579 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:11:02.579 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:11:02.579 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:11:02.579 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:11:02.579 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:11:02.579 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: Manager daemon x is now available 2024-09-19T08:11:02.579 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:11:02.579 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:11:02.579 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:11:02.579 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:11:02.579 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:02 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:11:02.704 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: mgrmap e20: x(active, since 8m), standbys: y, z 2024-09-19T08:11:02.704 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: Active manager daemon x restarted 2024-09-19T08:11:02.704 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: Activating manager daemon x 2024-09-19T08:11:02.705 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T08:11:02.705 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: mgrmap e21: x(active, starting, since 0.0125582s), standbys: y, z 2024-09-19T08:11:02.705 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:11:02.705 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:11:02.705 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:11:02.705 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:11:02.705 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:11:02.705 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:11:02.705 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:11:02.706 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:11:02.706 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:11:02.706 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:11:02.706 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:11:02.706 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:11:02.706 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:11:02.706 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:11:02.706 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:11:02.706 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:11:02.706 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:11:02.706 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:11:02.706 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:11:02.706 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:11:02.707 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:11:02.707 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:11:02.707 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:11:02.707 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:11:02.707 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:11:02.707 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:11:02.707 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:11:02.707 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:11:02.707 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:11:02.707 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:11:02.707 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:11:02.707 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:11:02.707 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:11:02.707 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: Manager daemon x is now available 2024-09-19T08:11:02.708 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:11:02.708 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:11:02.708 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:11:02.708 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:11:02.708 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:02 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:11:03.142 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T08:11:03.142 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T08:11:03.142 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:11:03.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.252+0000 7fb34f253640 1 -- 172.21.15.27:0/2807110140 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb348101c00 msgr2=0x7fb348102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:03.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.252+0000 7fb34f253640 1 --2- 172.21.15.27:0/2807110140 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb348101c00 0x7fb348102080 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb334009900 tx=0x7fb33402a410 comp rx=0 tx=0).stop 2024-09-19T08:11:03.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.252+0000 7fb34f253640 1 -- 172.21.15.27:0/2807110140 shutdown_connections 2024-09-19T08:11:03.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.252+0000 7fb34f253640 1 --2- 172.21.15.27:0/2807110140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3481025c0 0x7fb348108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.252+0000 7fb34f253640 1 --2- 172.21.15.27:0/2807110140 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb348101c00 0x7fb348102080 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.252+0000 7fb34f253640 1 --2- 172.21.15.27:0/2807110140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb348100a10 0x7fb348100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.252+0000 7fb34f253640 1 -- 172.21.15.27:0/2807110140 >> 172.21.15.27:0/2807110140 conn(0x7fb3480fc170 msgr2=0x7fb3480fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:03.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.252+0000 7fb34f253640 1 -- 172.21.15.27:0/2807110140 shutdown_connections 2024-09-19T08:11:03.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.252+0000 7fb34f253640 1 -- 172.21.15.27:0/2807110140 wait complete. 2024-09-19T08:11:03.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.253+0000 7fb34f253640 1 Processor -- start 2024-09-19T08:11:03.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.253+0000 7fb34f253640 1 -- start start 2024-09-19T08:11:03.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.253+0000 7fb34f253640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb348100a10 0x7fb348197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:03.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.253+0000 7fb34f253640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb348101c00 0x7fb3481983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:03.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.253+0000 7fb34f253640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3481025c0 0x7fb34819f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:03.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.253+0000 7fb34f253640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb34810c690 con 0x7fb348101c00 2024-09-19T08:11:03.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.253+0000 7fb34f253640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb34810c510 con 0x7fb348100a10 2024-09-19T08:11:03.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.253+0000 7fb34f253640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb34810c810 con 0x7fb3481025c0 2024-09-19T08:11:03.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.253+0000 7fb34cfef640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb348100a10 0x7fb348197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:03.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.253+0000 7fb347fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb348101c00 0x7fb3481983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:03.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.253+0000 7fb34cfef640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb348100a10 0x7fb348197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.27:35808/0 (socket says 172.21.15.27:35808) 2024-09-19T08:11:03.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.253+0000 7fb34cfef640 1 -- 172.21.15.27:0/3231595381 learned_addr learned my addr 172.21.15.27:0/3231595381 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:03.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.253+0000 7fb347fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb348101c00 0x7fb3481983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35758/0 (socket says 172.21.15.27:35758) 2024-09-19T08:11:03.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.253+0000 7fb34d7f0640 1 --2- 172.21.15.27:0/3231595381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3481025c0 0x7fb34819f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:03.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.254+0000 7fb34cfef640 1 -- 172.21.15.27:0/3231595381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3481025c0 msgr2=0x7fb34819f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:03.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.254+0000 7fb34cfef640 1 --2- 172.21.15.27:0/3231595381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3481025c0 0x7fb34819f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.254+0000 7fb34cfef640 1 -- 172.21.15.27:0/3231595381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb348101c00 msgr2=0x7fb3481983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:03.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.254+0000 7fb34cfef640 1 --2- 172.21.15.27:0/3231595381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb348101c00 0x7fb3481983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.254+0000 7fb34cfef640 1 -- 172.21.15.27:0/3231595381 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34819fa80 con 0x7fb348100a10 2024-09-19T08:11:03.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.254+0000 7fb347fff640 1 --2- 172.21.15.27:0/3231595381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb348101c00 0x7fb3481983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:11:03.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.254+0000 7fb34cfef640 1 --2- 172.21.15.27:0/3231595381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb348100a10 0x7fb348197eb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00e9c0 tx=0x7fb33c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:03.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.254+0000 7fb345ffb640 1 -- 172.21.15.27:0/3231595381 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c00cd80 con 0x7fb348100a10 2024-09-19T08:11:03.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.254+0000 7fb345ffb640 1 -- 172.21.15.27:0/3231595381 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb33c0035f0 con 0x7fb348100a10 2024-09-19T08:11:03.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.254+0000 7fb34f253640 1 -- 172.21.15.27:0/3231595381 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb348102e80 con 0x7fb348100a10 2024-09-19T08:11:03.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.254+0000 7fb345ffb640 1 -- 172.21.15.27:0/3231595381 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c010690 con 0x7fb348100a10 2024-09-19T08:11:03.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.254+0000 7fb34f253640 1 -- 172.21.15.27:0/3231595381 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3481033a0 con 0x7fb348100a10 2024-09-19T08:11:03.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.255+0000 7fb34f253640 1 -- 172.21.15.27:0/3231595381 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb348103660 con 0x7fb348100a10 2024-09-19T08:11:03.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.256+0000 7fb345ffb640 1 -- 172.21.15.27:0/3231595381 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 22) ==== 138167+0+0 (secure 0 0 0) 0x7fb33c0037a0 con 0x7fb348100a10 2024-09-19T08:11:03.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.257+0000 7fb345ffb640 1 --2- 172.21.15.27:0/3231595381 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb3380a3050 0x7fb3380a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:03.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.257+0000 7fb347fff640 1 --2- 172.21.15.27:0/3231595381 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb3380a3050 0x7fb3380a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:03.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.258+0000 7fb345ffb640 1 -- 172.21.15.27:0/3231595381 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fb33c0cf9c0 con 0x7fb348100a10 2024-09-19T08:11:03.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.258+0000 7fb347fff640 1 --2- 172.21.15.27:0/3231595381 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb3380a3050 0x7fb3380a5510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb3340314e0 tx=0x7fb33403c040 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:03.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.262+0000 7fb345ffb640 1 -- 172.21.15.27:0/3231595381 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb33c09c900 con 0x7fb348100a10 2024-09-19T08:11:03.369 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1779725291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:03.369 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-mon[31209]: mgrmap e22: x(active, since 1.02151s), standbys: y, z 2024-09-19T08:11:03.369 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-mon[31209]: [19/Sep/2024:08:11:03] ENGINE Bus STARTING 2024-09-19T08:11:03.370 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-mon[31209]: [19/Sep/2024:08:11:03] ENGINE Serving on http://172.21.15.27:8765 2024-09-19T08:11:03.370 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:11:03.230+0000 7f1a75ec8640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:08:11:03] ENGINE Error in HTTPServer.serve 2024-09-19T08:11:03.370 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: Traceback (most recent call last): 2024-09-19T08:11:03.370 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:11:03.370 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: self._connections.run(self.expiration_interval) 2024-09-19T08:11:03.370 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:11:03.370 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: self._run(expiration_interval) 2024-09-19T08:11:03.370 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:11:03.371 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:11:03.371 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:11:03.371 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:11:03.371 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:11:03.371 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: s = self.context.wrap_socket( 2024-09-19T08:11:03.371 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:11:03.371 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: return self.sslsocket_class._create( 2024-09-19T08:11:03.371 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:11:03.371 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: self.do_handshake() 2024-09-19T08:11:03.371 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:11:03.371 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: self._sslobj.do_handshake() 2024-09-19T08:11:03.371 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:11:03.372 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:11:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:11:03.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.451+0000 7fb34f253640 1 -- 172.21.15.27:0/3231595381 --> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb348069b00 con 0x7fb3380a3050 2024-09-19T08:11:03.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.459+0000 7fb345ffb640 1 -- 172.21.15.27:0/3231595381 <== mgr.15093 v2:172.21.15.27:6800/1578338135 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257890 (secure 0 0 0) 0x7fb348069b00 con 0x7fb3380a3050 2024-09-19T08:11:03.461 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:11:03.463 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-09-19T08:11:03.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.462+0000 7fb34f253640 1 -- 172.21.15.27:0/3231595381 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb3380a3050 msgr2=0x7fb3380a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:03.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.462+0000 7fb34f253640 1 --2- 172.21.15.27:0/3231595381 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb3380a3050 0x7fb3380a5510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb3340314e0 tx=0x7fb33403c040 comp rx=0 tx=0).stop 2024-09-19T08:11:03.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.462+0000 7fb34f253640 1 -- 172.21.15.27:0/3231595381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb348100a10 msgr2=0x7fb348197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:03.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.462+0000 7fb34f253640 1 --2- 172.21.15.27:0/3231595381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb348100a10 0x7fb348197eb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00e9c0 tx=0x7fb33c00ee80 comp rx=0 tx=0).stop 2024-09-19T08:11:03.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.462+0000 7fb34f253640 1 -- 172.21.15.27:0/3231595381 shutdown_connections 2024-09-19T08:11:03.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.462+0000 7fb34f253640 1 --2- 172.21.15.27:0/3231595381 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb3380a3050 0x7fb3380a5510 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.462+0000 7fb34f253640 1 --2- 172.21.15.27:0/3231595381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3481025c0 0x7fb34819f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.462+0000 7fb34f253640 1 --2- 172.21.15.27:0/3231595381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb348101c00 0x7fb3481983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.462+0000 7fb34f253640 1 --2- 172.21.15.27:0/3231595381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb348100a10 0x7fb348197eb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.462+0000 7fb34f253640 1 -- 172.21.15.27:0/3231595381 >> 172.21.15.27:0/3231595381 conn(0x7fb3480fc170 msgr2=0x7fb3480693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:03.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.462+0000 7fb34f253640 1 -- 172.21.15.27:0/3231595381 shutdown_connections 2024-09-19T08:11:03.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.462+0000 7fb34f253640 1 -- 172.21.15.27:0/3231595381 wait complete. 2024-09-19T08:11:03.474 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-19T08:11:03.336147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1185751,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":450,"num_read_kb":379,"num_write":386,"num_write_kb":4347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":789,"ondisk_log_size":789,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356252,"kb_used_data":11128,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585572,"statfs":{"total":1151940427776,"available":1151575625728,"internally_reserved":0,"allocated":11395072,"data_stored":8411019,"data_compressed":187014,"data_compressed_allocated":241664,"data_compressed_original":2936832,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.985362"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244732+0000","last_change":"2024-09-19T08:09:11.246436+0000","last_active":"2024-09-19T08:11:02.244732+0000","last_peered":"2024-09-19T08:11:02.244732+0000","last_clean":"2024-09-19T08:11:02.244732+0000","last_became_active":"2024-09-19T08:09:11.245674+0000","last_became_peered":"2024-09-19T08:09:11.245674+0000","last_unstale":"2024-09-19T08:11:02.244732+0000","last_undegraded":"2024-09-19T08:11:02.244732+0000","last_fullsized":"2024-09-19T08:11:02.244732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:46.716474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898632+0000","last_change":"2024-09-19T08:09:11.243334+0000","last_active":"2024-09-19T08:11:01.898632+0000","last_peered":"2024-09-19T08:11:01.898632+0000","last_clean":"2024-09-19T08:11:01.898632+0000","last_became_active":"2024-09-19T08:09:11.243024+0000","last_became_peered":"2024-09-19T08:09:11.243024+0000","last_unstale":"2024-09-19T08:11:01.898632+0000","last_undegraded":"2024-09-19T08:11:01.898632+0000","last_fullsized":"2024-09-19T08:11:01.898632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.060068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898635+0000","last_change":"2024-09-19T08:09:11.254655+0000","last_active":"2024-09-19T08:11:01.898635+0000","last_peered":"2024-09-19T08:11:01.898635+0000","last_clean":"2024-09-19T08:11:01.898635+0000","last_became_active":"2024-09-19T08:09:11.254292+0000","last_became_peered":"2024-09-19T08:09:11.254292+0000","last_unstale":"2024-09-19T08:11:01.898635+0000","last_undegraded":"2024-09-19T08:11:01.898635+0000","last_fullsized":"2024-09-19T08:11:01.898635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:01.977743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899014+0000","last_change":"2024-09-19T08:09:11.257029+0000","last_active":"2024-09-19T08:11:01.899014+0000","last_peered":"2024-09-19T08:11:01.899014+0000","last_clean":"2024-09-19T08:11:01.899014+0000","last_became_active":"2024-09-19T08:09:11.256669+0000","last_became_peered":"2024-09-19T08:09:11.256669+0000","last_unstale":"2024-09-19T08:11:01.899014+0000","last_undegraded":"2024-09-19T08:11:01.899014+0000","last_fullsized":"2024-09-19T08:11:01.899014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:32.831036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413590+0000","last_change":"2024-09-19T08:09:11.240341+0000","last_active":"2024-09-19T08:11:01.413590+0000","last_peered":"2024-09-19T08:11:01.413590+0000","last_clean":"2024-09-19T08:11:01.413590+0000","last_became_active":"2024-09-19T08:09:11.239996+0000","last_became_peered":"2024-09-19T08:09:11.239996+0000","last_unstale":"2024-09-19T08:11:01.413590+0000","last_undegraded":"2024-09-19T08:11:01.413590+0000","last_fullsized":"2024-09-19T08:11:01.413590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:20.331791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325570+0000","last_change":"2024-09-19T08:09:11.248089+0000","last_active":"2024-09-19T08:11:01.325570+0000","last_peered":"2024-09-19T08:11:01.325570+0000","last_clean":"2024-09-19T08:11:01.325570+0000","last_became_active":"2024-09-19T08:09:11.247802+0000","last_became_peered":"2024-09-19T08:09:11.247802+0000","last_unstale":"2024-09-19T08:11:01.325570+0000","last_undegraded":"2024-09-19T08:11:01.325570+0000","last_fullsized":"2024-09-19T08:11:01.325570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.249119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898629+0000","last_change":"2024-09-19T08:09:11.246853+0000","last_active":"2024-09-19T08:11:01.898629+0000","last_peered":"2024-09-19T08:11:01.898629+0000","last_clean":"2024-09-19T08:11:01.898629+0000","last_became_active":"2024-09-19T08:09:11.246523+0000","last_became_peered":"2024-09-19T08:09:11.246523+0000","last_unstale":"2024-09-19T08:11:01.898629+0000","last_undegraded":"2024-09-19T08:11:01.898629+0000","last_fullsized":"2024-09-19T08:11:01.898629+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:54.879087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413783+0000","last_change":"2024-09-19T08:09:11.232588+0000","last_active":"2024-09-19T08:11:01.413783+0000","last_peered":"2024-09-19T08:11:01.413783+0000","last_clean":"2024-09-19T08:11:01.413783+0000","last_became_active":"2024-09-19T08:09:11.232251+0000","last_became_peered":"2024-09-19T08:09:11.232251+0000","last_unstale":"2024-09-19T08:11:01.413783+0000","last_undegraded":"2024-09-19T08:11:01.413783+0000","last_fullsized":"2024-09-19T08:11:01.413783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:57.622086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619576+0000","last_change":"2024-09-19T08:09:11.248854+0000","last_active":"2024-09-19T08:11:01.619576+0000","last_peered":"2024-09-19T08:11:01.619576+0000","last_clean":"2024-09-19T08:11:01.619576+0000","last_became_active":"2024-09-19T08:09:11.248524+0000","last_became_peered":"2024-09-19T08:09:11.248524+0000","last_unstale":"2024-09-19T08:11:01.619576+0000","last_undegraded":"2024-09-19T08:11:01.619576+0000","last_fullsized":"2024-09-19T08:11:01.619576+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:57.978974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325967+0000","last_change":"2024-09-19T08:10:14.786848+0000","last_active":"2024-09-19T08:11:01.325967+0000","last_peered":"2024-09-19T08:11:01.325967+0000","last_clean":"2024-09-19T08:11:01.325967+0000","last_became_active":"2024-09-19T08:10:14.786460+0000","last_became_peered":"2024-09-19T08:10:14.786460+0000","last_unstale":"2024-09-19T08:11:01.325967+0000","last_undegraded":"2024-09-19T08:11:01.325967+0000","last_fullsized":"2024-09-19T08:11:01.325967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:59.430185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899200+0000","last_change":"2024-09-19T08:09:11.247604+0000","last_active":"2024-09-19T08:11:01.899200+0000","last_peered":"2024-09-19T08:11:01.899200+0000","last_clean":"2024-09-19T08:11:01.899200+0000","last_became_active":"2024-09-19T08:09:11.247264+0000","last_became_peered":"2024-09-19T08:09:11.247264+0000","last_unstale":"2024-09-19T08:11:01.899200+0000","last_undegraded":"2024-09-19T08:11:01.899200+0000","last_fullsized":"2024-09-19T08:11:01.899200+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:15.315022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899033+0000","last_change":"2024-09-19T08:09:11.253948+0000","last_active":"2024-09-19T08:11:01.899033+0000","last_peered":"2024-09-19T08:11:01.899033+0000","last_clean":"2024-09-19T08:11:01.899033+0000","last_became_active":"2024-09-19T08:09:11.253402+0000","last_became_peered":"2024-09-19T08:09:11.253402+0000","last_unstale":"2024-09-19T08:11:01.899033+0000","last_undegraded":"2024-09-19T08:11:01.899033+0000","last_fullsized":"2024-09-19T08:11:01.899033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:04.884541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324201+0000","last_change":"2024-09-19T08:09:11.241770+0000","last_active":"2024-09-19T08:11:01.324201+0000","last_peered":"2024-09-19T08:11:01.324201+0000","last_clean":"2024-09-19T08:11:01.324201+0000","last_became_active":"2024-09-19T08:09:11.241356+0000","last_became_peered":"2024-09-19T08:09:11.241356+0000","last_unstale":"2024-09-19T08:11:01.324201+0000","last_undegraded":"2024-09-19T08:11:01.324201+0000","last_fullsized":"2024-09-19T08:11:01.324201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:02.722445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898444+0000","last_change":"2024-09-19T08:09:11.242874+0000","last_active":"2024-09-19T08:11:01.898444+0000","last_peered":"2024-09-19T08:11:01.898444+0000","last_clean":"2024-09-19T08:11:01.898444+0000","last_became_active":"2024-09-19T08:09:11.242383+0000","last_became_peered":"2024-09-19T08:09:11.242383+0000","last_unstale":"2024-09-19T08:11:01.898444+0000","last_undegraded":"2024-09-19T08:11:01.898444+0000","last_fullsized":"2024-09-19T08:11:01.898444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:51.900211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898325+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:11:01.898325+0000","last_peered":"2024-09-19T08:11:01.898325+0000","last_clean":"2024-09-19T08:11:01.898325+0000","last_became_active":"2024-09-19T08:09:11.250797+0000","last_became_peered":"2024-09-19T08:09:11.250797+0000","last_unstale":"2024-09-19T08:11:01.898325+0000","last_undegraded":"2024-09-19T08:11:01.898325+0000","last_fullsized":"2024-09-19T08:11:01.898325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:46.183857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619237+0000","last_change":"2024-09-19T08:09:11.250884+0000","last_active":"2024-09-19T08:11:01.619237+0000","last_peered":"2024-09-19T08:11:01.619237+0000","last_clean":"2024-09-19T08:11:01.619237+0000","last_became_active":"2024-09-19T08:09:11.250543+0000","last_became_peered":"2024-09-19T08:09:11.250543+0000","last_unstale":"2024-09-19T08:11:01.619237+0000","last_undegraded":"2024-09-19T08:11:01.619237+0000","last_fullsized":"2024-09-19T08:11:01.619237+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.259466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244747+0000","last_change":"2024-09-19T08:09:11.246705+0000","last_active":"2024-09-19T08:11:02.244747+0000","last_peered":"2024-09-19T08:11:02.244747+0000","last_clean":"2024-09-19T08:11:02.244747+0000","last_became_active":"2024-09-19T08:09:11.246117+0000","last_became_peered":"2024-09-19T08:09:11.246117+0000","last_unstale":"2024-09-19T08:11:02.244747+0000","last_undegraded":"2024-09-19T08:11:02.244747+0000","last_fullsized":"2024-09-19T08:11:02.244747+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:07.421222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.411014+0000","last_change":"2024-09-19T08:09:11.242181+0000","last_active":"2024-09-19T08:11:01.411014+0000","last_peered":"2024-09-19T08:11:01.411014+0000","last_clean":"2024-09-19T08:11:01.411014+0000","last_became_active":"2024-09-19T08:09:11.241882+0000","last_became_peered":"2024-09-19T08:09:11.241882+0000","last_unstale":"2024-09-19T08:11:01.411014+0000","last_undegraded":"2024-09-19T08:11:01.411014+0000","last_fullsized":"2024-09-19T08:11:01.411014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:35.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619497+0000","last_change":"2024-09-19T08:09:11.246038+0000","last_active":"2024-09-19T08:11:01.619497+0000","last_peered":"2024-09-19T08:11:01.619497+0000","last_clean":"2024-09-19T08:11:01.619497+0000","last_became_active":"2024-09-19T08:09:11.245554+0000","last_became_peered":"2024-09-19T08:09:11.245554+0000","last_unstale":"2024-09-19T08:11:01.619497+0000","last_undegraded":"2024-09-19T08:11:01.619497+0000","last_fullsized":"2024-09-19T08:11:01.619497+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:14.512425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244438+0000","last_change":"2024-09-19T08:09:11.249246+0000","last_active":"2024-09-19T08:11:02.244438+0000","last_peered":"2024-09-19T08:11:02.244438+0000","last_clean":"2024-09-19T08:11:02.244438+0000","last_became_active":"2024-09-19T08:09:11.248896+0000","last_became_peered":"2024-09-19T08:09:11.248896+0000","last_unstale":"2024-09-19T08:11:02.244438+0000","last_undegraded":"2024-09-19T08:11:02.244438+0000","last_fullsized":"2024-09-19T08:11:02.244438+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:40.406924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324207+0000","last_change":"2024-09-19T08:09:11.245421+0000","last_active":"2024-09-19T08:11:01.324207+0000","last_peered":"2024-09-19T08:11:01.324207+0000","last_clean":"2024-09-19T08:11:01.324207+0000","last_became_active":"2024-09-19T08:09:11.245071+0000","last_became_peered":"2024-09-19T08:09:11.245071+0000","last_unstale":"2024-09-19T08:11:01.324207+0000","last_undegraded":"2024-09-19T08:11:01.324207+0000","last_fullsized":"2024-09-19T08:11:01.324207+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:58.594399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619396+0000","last_change":"2024-09-19T08:09:11.246097+0000","last_active":"2024-09-19T08:11:01.619396+0000","last_peered":"2024-09-19T08:11:01.619396+0000","last_clean":"2024-09-19T08:11:01.619396+0000","last_became_active":"2024-09-19T08:09:11.245741+0000","last_became_peered":"2024-09-19T08:09:11.245741+0000","last_unstale":"2024-09-19T08:11:01.619396+0000","last_undegraded":"2024-09-19T08:11:01.619396+0000","last_fullsized":"2024-09-19T08:11:01.619396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:05.731148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414178+0000","last_change":"2024-09-19T08:09:11.251485+0000","last_active":"2024-09-19T08:11:01.414178+0000","last_peered":"2024-09-19T08:11:01.414178+0000","last_clean":"2024-09-19T08:11:01.414178+0000","last_became_active":"2024-09-19T08:09:11.251151+0000","last_became_peered":"2024-09-19T08:09:11.251151+0000","last_unstale":"2024-09-19T08:11:01.414178+0000","last_undegraded":"2024-09-19T08:11:01.414178+0000","last_fullsized":"2024-09-19T08:11:01.414178+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:47.231056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327085+0000","last_change":"2024-09-19T08:09:11.234490+0000","last_active":"2024-09-19T08:11:01.327085+0000","last_peered":"2024-09-19T08:11:01.327085+0000","last_clean":"2024-09-19T08:11:01.327085+0000","last_became_active":"2024-09-19T08:09:11.234163+0000","last_became_peered":"2024-09-19T08:09:11.234163+0000","last_unstale":"2024-09-19T08:11:01.327085+0000","last_undegraded":"2024-09-19T08:11:01.327085+0000","last_fullsized":"2024-09-19T08:11:01.327085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.610165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.415513+0000","last_change":"2024-09-19T08:09:11.247189+0000","last_active":"2024-09-19T08:11:01.415513+0000","last_peered":"2024-09-19T08:11:01.415513+0000","last_clean":"2024-09-19T08:11:01.415513+0000","last_became_active":"2024-09-19T08:09:11.246844+0000","last_became_peered":"2024-09-19T08:09:11.246844+0000","last_unstale":"2024-09-19T08:11:01.415513+0000","last_undegraded":"2024-09-19T08:11:01.415513+0000","last_fullsized":"2024-09-19T08:11:01.415513+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:50.764694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619668+0000","last_change":"2024-09-19T08:09:11.251655+0000","last_active":"2024-09-19T08:11:01.619668+0000","last_peered":"2024-09-19T08:11:01.619668+0000","last_clean":"2024-09-19T08:11:01.619668+0000","last_became_active":"2024-09-19T08:09:11.250930+0000","last_became_peered":"2024-09-19T08:09:11.250930+0000","last_unstale":"2024-09-19T08:11:01.619668+0000","last_undegraded":"2024-09-19T08:11:01.619668+0000","last_fullsized":"2024-09-19T08:11:01.619668+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:17.658277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244670+0000","last_change":"2024-09-19T08:09:11.248095+0000","last_active":"2024-09-19T08:11:02.244670+0000","last_peered":"2024-09-19T08:11:02.244670+0000","last_clean":"2024-09-19T08:11:02.244670+0000","last_became_active":"2024-09-19T08:09:11.247719+0000","last_became_peered":"2024-09-19T08:09:11.247719+0000","last_unstale":"2024-09-19T08:11:02.244670+0000","last_undegraded":"2024-09-19T08:11:02.244670+0000","last_fullsized":"2024-09-19T08:11:02.244670+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:26.701140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324250+0000","last_change":"2024-09-19T08:09:11.243232+0000","last_active":"2024-09-19T08:11:01.324250+0000","last_peered":"2024-09-19T08:11:01.324250+0000","last_clean":"2024-09-19T08:11:01.324250+0000","last_became_active":"2024-09-19T08:09:11.242927+0000","last_became_peered":"2024-09-19T08:09:11.242927+0000","last_unstale":"2024-09-19T08:11:01.324250+0000","last_undegraded":"2024-09-19T08:11:01.324250+0000","last_fullsized":"2024-09-19T08:11:01.324250+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:19.877520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898534+0000","last_change":"2024-09-19T08:09:11.249588+0000","last_active":"2024-09-19T08:11:01.898534+0000","last_peered":"2024-09-19T08:11:01.898534+0000","last_clean":"2024-09-19T08:11:01.898534+0000","last_became_active":"2024-09-19T08:09:11.249266+0000","last_became_peered":"2024-09-19T08:09:11.249266+0000","last_unstale":"2024-09-19T08:11:01.898534+0000","last_undegraded":"2024-09-19T08:11:01.898534+0000","last_fullsized":"2024-09-19T08:11:01.898534+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:43.332454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619356+0000","last_change":"2024-09-19T08:09:11.245866+0000","last_active":"2024-09-19T08:11:01.619356+0000","last_peered":"2024-09-19T08:11:01.619356+0000","last_clean":"2024-09-19T08:11:01.619356+0000","last_became_active":"2024-09-19T08:09:11.245505+0000","last_became_peered":"2024-09-19T08:09:11.245505+0000","last_unstale":"2024-09-19T08:11:01.619356+0000","last_undegraded":"2024-09-19T08:11:01.619356+0000","last_fullsized":"2024-09-19T08:11:01.619356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:38.203790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619389+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:11:01.619389+0000","last_peered":"2024-09-19T08:11:01.619389+0000","last_clean":"2024-09-19T08:11:01.619389+0000","last_became_active":"2024-09-19T08:09:11.250745+0000","last_became_peered":"2024-09-19T08:09:11.250745+0000","last_unstale":"2024-09-19T08:11:01.619389+0000","last_undegraded":"2024-09-19T08:11:01.619389+0000","last_fullsized":"2024-09-19T08:11:01.619389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:16.851230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244514+0000","last_change":"2024-09-19T08:09:11.255211+0000","last_active":"2024-09-19T08:11:02.244514+0000","last_peered":"2024-09-19T08:11:02.244514+0000","last_clean":"2024-09-19T08:11:02.244514+0000","last_became_active":"2024-09-19T08:09:11.254853+0000","last_became_peered":"2024-09-19T08:09:11.254853+0000","last_unstale":"2024-09-19T08:11:02.244514+0000","last_undegraded":"2024-09-19T08:11:02.244514+0000","last_fullsized":"2024-09-19T08:11:02.244514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.497502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413533+0000","last_change":"2024-09-19T08:09:11.247201+0000","last_active":"2024-09-19T08:11:01.413533+0000","last_peered":"2024-09-19T08:11:01.413533+0000","last_clean":"2024-09-19T08:11:01.413533+0000","last_became_active":"2024-09-19T08:09:11.246854+0000","last_became_peered":"2024-09-19T08:09:11.246854+0000","last_unstale":"2024-09-19T08:11:01.413533+0000","last_undegraded":"2024-09-19T08:11:01.413533+0000","last_fullsized":"2024-09-19T08:11:01.413533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:19.262849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327350+0000","last_change":"2024-09-19T08:09:09.113754+0000","last_active":"2024-09-19T08:11:01.327350+0000","last_peered":"2024-09-19T08:11:01.327350+0000","last_clean":"2024-09-19T08:11:01.327350+0000","last_became_active":"2024-09-19T08:09:09.113389+0000","last_became_peered":"2024-09-19T08:09:09.113389+0000","last_unstale":"2024-09-19T08:11:01.327350+0000","last_undegraded":"2024-09-19T08:11:01.327350+0000","last_fullsized":"2024-09-19T08:11:01.327350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:45.325895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327320+0000","last_change":"2024-09-19T08:09:11.244625+0000","last_active":"2024-09-19T08:11:01.327320+0000","last_peered":"2024-09-19T08:11:01.327320+0000","last_clean":"2024-09-19T08:11:01.327320+0000","last_became_active":"2024-09-19T08:09:11.244277+0000","last_became_peered":"2024-09-19T08:09:11.244277+0000","last_unstale":"2024-09-19T08:11:01.327320+0000","last_undegraded":"2024-09-19T08:11:01.327320+0000","last_fullsized":"2024-09-19T08:11:01.327320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:33:34.050343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325579+0000","last_change":"2024-09-19T08:09:09.116735+0000","last_active":"2024-09-19T08:11:01.325579+0000","last_peered":"2024-09-19T08:11:01.325579+0000","last_clean":"2024-09-19T08:11:01.325579+0000","last_became_active":"2024-09-19T08:09:09.116356+0000","last_became_peered":"2024-09-19T08:09:09.116356+0000","last_unstale":"2024-09-19T08:11:01.325579+0000","last_undegraded":"2024-09-19T08:11:01.325579+0000","last_fullsized":"2024-09-19T08:11:01.325579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:50.952567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323834+0000","last_change":"2024-09-19T08:09:09.113182+0000","last_active":"2024-09-19T08:11:01.323834+0000","last_peered":"2024-09-19T08:11:01.323834+0000","last_clean":"2024-09-19T08:11:01.323834+0000","last_became_active":"2024-09-19T08:09:09.112528+0000","last_became_peered":"2024-09-19T08:09:09.112528+0000","last_unstale":"2024-09-19T08:11:01.323834+0000","last_undegraded":"2024-09-19T08:11:01.323834+0000","last_fullsized":"2024-09-19T08:11:01.323834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:07.647351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413961+0000","last_change":"2024-09-19T08:09:11.241639+0000","last_active":"2024-09-19T08:11:01.413961+0000","last_peered":"2024-09-19T08:11:01.413961+0000","last_clean":"2024-09-19T08:11:01.413961+0000","last_became_active":"2024-09-19T08:09:11.241308+0000","last_became_peered":"2024-09-19T08:09:11.241308+0000","last_unstale":"2024-09-19T08:11:01.413961+0000","last_undegraded":"2024-09-19T08:11:01.413961+0000","last_fullsized":"2024-09-19T08:11:01.413961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:57.826870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327401+0000","last_change":"2024-09-19T08:09:09.118334+0000","last_active":"2024-09-19T08:11:01.327401+0000","last_peered":"2024-09-19T08:11:01.327401+0000","last_clean":"2024-09-19T08:11:01.327401+0000","last_became_active":"2024-09-19T08:09:09.118010+0000","last_became_peered":"2024-09-19T08:09:09.118010+0000","last_unstale":"2024-09-19T08:11:01.327401+0000","last_undegraded":"2024-09-19T08:11:01.327401+0000","last_fullsized":"2024-09-19T08:11:01.327401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:51.046598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.410546+0000","last_change":"2024-09-19T08:09:11.239990+0000","last_active":"2024-09-19T08:11:01.410546+0000","last_peered":"2024-09-19T08:11:01.410546+0000","last_clean":"2024-09-19T08:11:01.410546+0000","last_became_active":"2024-09-19T08:09:11.239643+0000","last_became_peered":"2024-09-19T08:09:11.239643+0000","last_unstale":"2024-09-19T08:11:01.410546+0000","last_undegraded":"2024-09-19T08:11:01.410546+0000","last_fullsized":"2024-09-19T08:11:01.410546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:07.078244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325867+0000","last_change":"2024-09-19T08:09:09.114397+0000","last_active":"2024-09-19T08:11:01.325867+0000","last_peered":"2024-09-19T08:11:01.325867+0000","last_clean":"2024-09-19T08:11:01.325867+0000","last_became_active":"2024-09-19T08:09:09.114051+0000","last_became_peered":"2024-09-19T08:09:09.114051+0000","last_unstale":"2024-09-19T08:11:01.325867+0000","last_undegraded":"2024-09-19T08:11:01.325867+0000","last_fullsized":"2024-09-19T08:11:01.325867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:41.799442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619494+0000","last_change":"2024-09-19T08:09:11.254802+0000","last_active":"2024-09-19T08:11:01.619494+0000","last_peered":"2024-09-19T08:11:01.619494+0000","last_clean":"2024-09-19T08:11:01.619494+0000","last_became_active":"2024-09-19T08:09:11.253869+0000","last_became_peered":"2024-09-19T08:09:11.253869+0000","last_unstale":"2024-09-19T08:11:01.619494+0000","last_undegraded":"2024-09-19T08:11:01.619494+0000","last_fullsized":"2024-09-19T08:11:01.619494+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:00.164834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899209+0000","last_change":"2024-09-19T08:09:09.118585+0000","last_active":"2024-09-19T08:11:01.899209+0000","last_peered":"2024-09-19T08:11:01.899209+0000","last_clean":"2024-09-19T08:11:01.899209+0000","last_became_active":"2024-09-19T08:09:09.118216+0000","last_became_peered":"2024-09-19T08:09:09.118216+0000","last_unstale":"2024-09-19T08:11:01.899209+0000","last_undegraded":"2024-09-19T08:11:01.899209+0000","last_fullsized":"2024-09-19T08:11:01.899209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:41.905746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898880+0000","last_change":"2024-09-19T08:09:11.249835+0000","last_active":"2024-09-19T08:11:01.898880+0000","last_peered":"2024-09-19T08:11:01.898880+0000","last_clean":"2024-09-19T08:11:01.898880+0000","last_became_active":"2024-09-19T08:09:11.249443+0000","last_became_peered":"2024-09-19T08:09:11.249443+0000","last_unstale":"2024-09-19T08:11:01.898880+0000","last_undegraded":"2024-09-19T08:11:01.898880+0000","last_fullsized":"2024-09-19T08:11:01.898880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:06.373126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327565+0000","last_change":"2024-09-19T08:09:09.242565+0000","last_active":"2024-09-19T08:11:01.327565+0000","last_peered":"2024-09-19T08:11:01.327565+0000","last_clean":"2024-09-19T08:11:01.327565+0000","last_became_active":"2024-09-19T08:09:09.242199+0000","last_became_peered":"2024-09-19T08:09:09.242199+0000","last_unstale":"2024-09-19T08:11:01.327565+0000","last_undegraded":"2024-09-19T08:11:01.327565+0000","last_fullsized":"2024-09-19T08:11:01.327565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:33.195385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619322+0000","last_change":"2024-09-19T08:09:11.251682+0000","last_active":"2024-09-19T08:11:01.619322+0000","last_peered":"2024-09-19T08:11:01.619322+0000","last_clean":"2024-09-19T08:11:01.619322+0000","last_became_active":"2024-09-19T08:09:11.251037+0000","last_became_peered":"2024-09-19T08:09:11.251037+0000","last_unstale":"2024-09-19T08:11:01.619322+0000","last_undegraded":"2024-09-19T08:11:01.619322+0000","last_fullsized":"2024-09-19T08:11:01.619322+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:29.518828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'35","reported_seq":275,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619210+0000","last_change":"2024-09-19T08:09:09.119090+0000","last_active":"2024-09-19T08:11:01.619210+0000","last_peered":"2024-09-19T08:11:01.619210+0000","last_clean":"2024-09-19T08:11:01.619210+0000","last_became_active":"2024-09-19T08:09:09.118685+0000","last_became_peered":"2024-09-19T08:09:09.118685+0000","last_unstale":"2024-09-19T08:11:01.619210+0000","last_undegraded":"2024-09-19T08:11:01.619210+0000","last_fullsized":"2024-09-19T08:11:01.619210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:21.540404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69535,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":175,"num_write":35,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413753+0000","last_change":"2024-09-19T08:09:11.243200+0000","last_active":"2024-09-19T08:11:01.413753+0000","last_peered":"2024-09-19T08:11:01.413753+0000","last_clean":"2024-09-19T08:11:01.413753+0000","last_became_active":"2024-09-19T08:09:11.242873+0000","last_became_peered":"2024-09-19T08:09:11.242873+0000","last_unstale":"2024-09-19T08:11:01.413753+0000","last_undegraded":"2024-09-19T08:11:01.413753+0000","last_fullsized":"2024-09-19T08:11:01.413753+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:35.817609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619483+0000","last_change":"2024-09-19T08:09:09.117117+0000","last_active":"2024-09-19T08:11:01.619483+0000","last_peered":"2024-09-19T08:11:01.619483+0000","last_clean":"2024-09-19T08:11:01.619483+0000","last_became_active":"2024-09-19T08:09:09.116512+0000","last_became_peered":"2024-09-19T08:09:09.116512+0000","last_unstale":"2024-09-19T08:11:01.619483+0000","last_undegraded":"2024-09-19T08:11:01.619483+0000","last_fullsized":"2024-09-19T08:11:01.619483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:15.010570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323874+0000","last_change":"2024-09-19T08:09:11.246648+0000","last_active":"2024-09-19T08:11:01.323874+0000","last_peered":"2024-09-19T08:11:01.323874+0000","last_clean":"2024-09-19T08:11:01.323874+0000","last_became_active":"2024-09-19T08:09:11.246317+0000","last_became_peered":"2024-09-19T08:09:11.246317+0000","last_unstale":"2024-09-19T08:11:01.323874+0000","last_undegraded":"2024-09-19T08:11:01.323874+0000","last_fullsized":"2024-09-19T08:11:01.323874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:43.285257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327239+0000","last_change":"2024-09-19T08:09:09.112599+0000","last_active":"2024-09-19T08:11:01.327239+0000","last_peered":"2024-09-19T08:11:01.327239+0000","last_clean":"2024-09-19T08:11:01.327239+0000","last_became_active":"2024-09-19T08:09:09.112281+0000","last_became_peered":"2024-09-19T08:09:09.112281+0000","last_unstale":"2024-09-19T08:11:01.327239+0000","last_undegraded":"2024-09-19T08:11:01.327239+0000","last_fullsized":"2024-09-19T08:11:01.327239+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:47.710235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898887+0000","last_change":"2024-09-19T08:09:11.253814+0000","last_active":"2024-09-19T08:11:01.898887+0000","last_peered":"2024-09-19T08:11:01.898887+0000","last_clean":"2024-09-19T08:11:01.898887+0000","last_became_active":"2024-09-19T08:09:11.253490+0000","last_became_peered":"2024-09-19T08:09:11.253490+0000","last_unstale":"2024-09-19T08:11:01.898887+0000","last_undegraded":"2024-09-19T08:11:01.898887+0000","last_fullsized":"2024-09-19T08:11:01.898887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:09.287110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898591+0000","last_change":"2024-09-19T08:09:09.114820+0000","last_active":"2024-09-19T08:11:01.898591+0000","last_peered":"2024-09-19T08:11:01.898591+0000","last_clean":"2024-09-19T08:11:01.898591+0000","last_became_active":"2024-09-19T08:09:09.114478+0000","last_became_peered":"2024-09-19T08:09:09.114478+0000","last_unstale":"2024-09-19T08:11:01.898591+0000","last_undegraded":"2024-09-19T08:11:01.898591+0000","last_fullsized":"2024-09-19T08:11:01.898591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:24.243629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898477+0000","last_change":"2024-09-19T08:10:14.789301+0000","last_active":"2024-09-19T08:11:01.898477+0000","last_peered":"2024-09-19T08:11:01.898477+0000","last_clean":"2024-09-19T08:11:01.898477+0000","last_became_active":"2024-09-19T08:10:14.788891+0000","last_became_peered":"2024-09-19T08:10:14.788891+0000","last_unstale":"2024-09-19T08:11:01.898477+0000","last_undegraded":"2024-09-19T08:11:01.898477+0000","last_fullsized":"2024-09-19T08:11:01.898477+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:03.142177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244400+0000","last_change":"2024-09-19T08:10:14.799207+0000","last_active":"2024-09-19T08:11:02.244400+0000","last_peered":"2024-09-19T08:11:02.244400+0000","last_clean":"2024-09-19T08:11:02.244400+0000","last_became_active":"2024-09-19T08:10:14.787612+0000","last_became_peered":"2024-09-19T08:10:14.787612+0000","last_unstale":"2024-09-19T08:11:02.244400+0000","last_undegraded":"2024-09-19T08:11:02.244400+0000","last_fullsized":"2024-09-19T08:11:02.244400+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:45.997778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327130+0000","last_change":"2024-09-19T08:09:11.245399+0000","last_active":"2024-09-19T08:11:01.327130+0000","last_peered":"2024-09-19T08:11:01.327130+0000","last_clean":"2024-09-19T08:11:01.327130+0000","last_became_active":"2024-09-19T08:09:11.245055+0000","last_became_peered":"2024-09-19T08:09:11.245055+0000","last_unstale":"2024-09-19T08:11:01.327130+0000","last_undegraded":"2024-09-19T08:11:01.327130+0000","last_fullsized":"2024-09-19T08:11:01.327130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:57.639205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413806+0000","last_change":"2024-09-19T08:09:09.115252+0000","last_active":"2024-09-19T08:11:01.413806+0000","last_peered":"2024-09-19T08:11:01.413806+0000","last_clean":"2024-09-19T08:11:01.413806+0000","last_became_active":"2024-09-19T08:09:09.114908+0000","last_became_peered":"2024-09-19T08:09:09.114908+0000","last_unstale":"2024-09-19T08:11:01.413806+0000","last_undegraded":"2024-09-19T08:11:01.413806+0000","last_fullsized":"2024-09-19T08:11:01.413806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:48.326221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244581+0000","last_change":"2024-09-19T08:09:11.249189+0000","last_active":"2024-09-19T08:11:02.244581+0000","last_peered":"2024-09-19T08:11:02.244581+0000","last_clean":"2024-09-19T08:11:02.244581+0000","last_became_active":"2024-09-19T08:09:11.248797+0000","last_became_peered":"2024-09-19T08:09:11.248797+0000","last_unstale":"2024-09-19T08:11:02.244581+0000","last_undegraded":"2024-09-19T08:11:02.244581+0000","last_fullsized":"2024-09-19T08:11:02.244581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:20.915638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324421+0000","last_change":"2024-09-19T08:09:09.112973+0000","last_active":"2024-09-19T08:11:01.324421+0000","last_peered":"2024-09-19T08:11:01.324421+0000","last_clean":"2024-09-19T08:11:01.324421+0000","last_became_active":"2024-09-19T08:09:09.112616+0000","last_became_peered":"2024-09-19T08:09:09.112616+0000","last_unstale":"2024-09-19T08:11:01.324421+0000","last_undegraded":"2024-09-19T08:11:01.324421+0000","last_fullsized":"2024-09-19T08:11:01.324421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:13.791926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899227+0000","last_change":"2024-09-19T08:09:11.240739+0000","last_active":"2024-09-19T08:11:01.899227+0000","last_peered":"2024-09-19T08:11:01.899227+0000","last_clean":"2024-09-19T08:11:01.899227+0000","last_became_active":"2024-09-19T08:09:11.240340+0000","last_became_peered":"2024-09-19T08:09:11.240340+0000","last_unstale":"2024-09-19T08:11:01.899227+0000","last_undegraded":"2024-09-19T08:11:01.899227+0000","last_fullsized":"2024-09-19T08:11:01.899227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:35.450279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'39","reported_seq":71,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.551893+0000","last_change":"2024-09-19T08:09:09.112516+0000","last_active":"2024-09-19T08:11:01.551893+0000","last_peered":"2024-09-19T08:11:01.551893+0000","last_clean":"2024-09-19T08:11:01.551893+0000","last_became_active":"2024-09-19T08:09:09.112140+0000","last_became_peered":"2024-09-19T08:09:09.112140+0000","last_unstale":"2024-09-19T08:11:01.551893+0000","last_undegraded":"2024-09-19T08:11:01.551893+0000","last_fullsized":"2024-09-19T08:11:01.551893+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:05.434331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899052+0000","last_change":"2024-09-19T08:09:11.252163+0000","last_active":"2024-09-19T08:11:01.899052+0000","last_peered":"2024-09-19T08:11:01.899052+0000","last_clean":"2024-09-19T08:11:01.899052+0000","last_became_active":"2024-09-19T08:09:11.251762+0000","last_became_peered":"2024-09-19T08:09:11.251762+0000","last_unstale":"2024-09-19T08:11:01.899052+0000","last_undegraded":"2024-09-19T08:11:01.899052+0000","last_fullsized":"2024-09-19T08:11:01.899052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:33.941910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898722+0000","last_change":"2024-09-19T08:10:14.788460+0000","last_active":"2024-09-19T08:11:01.898722+0000","last_peered":"2024-09-19T08:11:01.898722+0000","last_clean":"2024-09-19T08:11:01.898722+0000","last_became_active":"2024-09-19T08:10:14.787990+0000","last_became_peered":"2024-09-19T08:10:14.787990+0000","last_unstale":"2024-09-19T08:11:01.898722+0000","last_undegraded":"2024-09-19T08:11:01.898722+0000","last_fullsized":"2024-09-19T08:11:01.898722+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:24.549994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899257+0000","last_change":"2024-09-19T08:09:11.242438+0000","last_active":"2024-09-19T08:11:01.899257+0000","last_peered":"2024-09-19T08:11:01.899257+0000","last_clean":"2024-09-19T08:11:01.899257+0000","last_became_active":"2024-09-19T08:09:11.242114+0000","last_became_peered":"2024-09-19T08:09:11.242114+0000","last_unstale":"2024-09-19T08:11:01.899257+0000","last_undegraded":"2024-09-19T08:11:01.899257+0000","last_fullsized":"2024-09-19T08:11:01.899257+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:54.183012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":348,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898629+0000","last_change":"2024-09-19T08:07:55.287566+0000","last_active":"2024-09-19T08:11:01.898629+0000","last_peered":"2024-09-19T08:11:01.898629+0000","last_clean":"2024-09-19T08:11:01.898629+0000","last_became_active":"2024-09-19T08:07:55.287037+0000","last_became_peered":"2024-09-19T08:07:55.287037+0000","last_unstale":"2024-09-19T08:11:01.898629+0000","last_undegraded":"2024-09-19T08:11:01.898629+0000","last_fullsized":"2024-09-19T08:11:01.898629+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_clean_scrub_stamp":"2024-09-19T08:04:29.468857+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:49.553882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898721+0000","last_change":"2024-09-19T08:09:09.113497+0000","last_active":"2024-09-19T08:11:01.898721+0000","last_peered":"2024-09-19T08:11:01.898721+0000","last_clean":"2024-09-19T08:11:01.898721+0000","last_became_active":"2024-09-19T08:09:09.112546+0000","last_became_peered":"2024-09-19T08:09:09.112546+0000","last_unstale":"2024-09-19T08:11:01.898721+0000","last_undegraded":"2024-09-19T08:11:01.898721+0000","last_fullsized":"2024-09-19T08:11:01.898721+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:09.906476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414661+0000","last_change":"2024-09-19T08:09:11.241478+0000","last_active":"2024-09-19T08:11:01.414661+0000","last_peered":"2024-09-19T08:11:01.414661+0000","last_clean":"2024-09-19T08:11:01.414661+0000","last_became_active":"2024-09-19T08:09:11.241138+0000","last_became_peered":"2024-09-19T08:09:11.241138+0000","last_unstale":"2024-09-19T08:11:01.414661+0000","last_undegraded":"2024-09-19T08:11:01.414661+0000","last_fullsized":"2024-09-19T08:11:01.414661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:32.884491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898598+0000","last_change":"2024-09-19T08:09:09.116571+0000","last_active":"2024-09-19T08:11:01.898598+0000","last_peered":"2024-09-19T08:11:01.898598+0000","last_clean":"2024-09-19T08:11:01.898598+0000","last_became_active":"2024-09-19T08:09:09.116180+0000","last_became_peered":"2024-09-19T08:09:09.116180+0000","last_unstale":"2024-09-19T08:11:01.898598+0000","last_undegraded":"2024-09-19T08:11:01.898598+0000","last_fullsized":"2024-09-19T08:11:01.898598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:58.577320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323834+0000","last_change":"2024-09-19T08:10:14.791196+0000","last_active":"2024-09-19T08:11:01.323834+0000","last_peered":"2024-09-19T08:11:01.323834+0000","last_clean":"2024-09-19T08:11:01.323834+0000","last_became_active":"2024-09-19T08:10:14.790873+0000","last_became_peered":"2024-09-19T08:10:14.790873+0000","last_unstale":"2024-09-19T08:11:01.323834+0000","last_undegraded":"2024-09-19T08:11:01.323834+0000","last_fullsized":"2024-09-19T08:11:01.323834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:41.725521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323966+0000","last_change":"2024-09-19T08:09:09.242166+0000","last_active":"2024-09-19T08:11:01.323966+0000","last_peered":"2024-09-19T08:11:01.323966+0000","last_clean":"2024-09-19T08:11:01.323966+0000","last_became_active":"2024-09-19T08:09:09.241270+0000","last_became_peered":"2024-09-19T08:09:09.241270+0000","last_unstale":"2024-09-19T08:11:01.323966+0000","last_undegraded":"2024-09-19T08:11:01.323966+0000","last_fullsized":"2024-09-19T08:11:01.323966+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:51.899069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327090+0000","last_change":"2024-09-19T08:10:14.793572+0000","last_active":"2024-09-19T08:11:01.327090+0000","last_peered":"2024-09-19T08:11:01.327090+0000","last_clean":"2024-09-19T08:11:01.327090+0000","last_became_active":"2024-09-19T08:10:14.793258+0000","last_became_peered":"2024-09-19T08:10:14.793258+0000","last_unstale":"2024-09-19T08:11:01.327090+0000","last_undegraded":"2024-09-19T08:11:01.327090+0000","last_fullsized":"2024-09-19T08:11:01.327090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:53.912430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899060+0000","last_change":"2024-09-19T08:09:09.118790+0000","last_active":"2024-09-19T08:11:01.899060+0000","last_peered":"2024-09-19T08:11:01.899060+0000","last_clean":"2024-09-19T08:11:01.899060+0000","last_became_active":"2024-09-19T08:09:09.117695+0000","last_became_peered":"2024-09-19T08:09:09.117695+0000","last_unstale":"2024-09-19T08:11:01.899060+0000","last_undegraded":"2024-09-19T08:11:01.899060+0000","last_fullsized":"2024-09-19T08:11:01.899060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:40.674039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325589+0000","last_change":"2024-09-19T08:09:11.249386+0000","last_active":"2024-09-19T08:11:01.325589+0000","last_peered":"2024-09-19T08:11:01.325589+0000","last_clean":"2024-09-19T08:11:01.325589+0000","last_became_active":"2024-09-19T08:09:11.249004+0000","last_became_peered":"2024-09-19T08:09:11.249004+0000","last_unstale":"2024-09-19T08:11:01.325589+0000","last_undegraded":"2024-09-19T08:11:01.325589+0000","last_fullsized":"2024-09-19T08:11:01.325589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:50.170799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.410707+0000","last_change":"2024-09-19T08:09:09.241599+0000","last_active":"2024-09-19T08:11:01.410707+0000","last_peered":"2024-09-19T08:11:01.410707+0000","last_clean":"2024-09-19T08:11:01.410707+0000","last_became_active":"2024-09-19T08:09:09.241226+0000","last_became_peered":"2024-09-19T08:09:09.241226+0000","last_unstale":"2024-09-19T08:11:01.410707+0000","last_undegraded":"2024-09-19T08:11:01.410707+0000","last_fullsized":"2024-09-19T08:11:01.410707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:19.590966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325735+0000","last_change":"2024-09-19T08:09:11.238098+0000","last_active":"2024-09-19T08:11:01.325735+0000","last_peered":"2024-09-19T08:11:01.325735+0000","last_clean":"2024-09-19T08:11:01.325735+0000","last_became_active":"2024-09-19T08:09:11.237737+0000","last_became_peered":"2024-09-19T08:09:11.237737+0000","last_unstale":"2024-09-19T08:11:01.325735+0000","last_undegraded":"2024-09-19T08:11:01.325735+0000","last_fullsized":"2024-09-19T08:11:01.325735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:00.134664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413888+0000","last_change":"2024-09-19T08:09:09.241775+0000","last_active":"2024-09-19T08:11:01.413888+0000","last_peered":"2024-09-19T08:11:01.413888+0000","last_clean":"2024-09-19T08:11:01.413888+0000","last_became_active":"2024-09-19T08:09:09.241367+0000","last_became_peered":"2024-09-19T08:09:09.241367+0000","last_unstale":"2024-09-19T08:11:01.413888+0000","last_undegraded":"2024-09-19T08:11:01.413888+0000","last_fullsized":"2024-09-19T08:11:01.413888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:11.862171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324396+0000","last_change":"2024-09-19T08:09:11.251980+0000","last_active":"2024-09-19T08:11:01.324396+0000","last_peered":"2024-09-19T08:11:01.324396+0000","last_clean":"2024-09-19T08:11:01.324396+0000","last_became_active":"2024-09-19T08:09:11.251638+0000","last_became_peered":"2024-09-19T08:09:11.251638+0000","last_unstale":"2024-09-19T08:11:01.324396+0000","last_undegraded":"2024-09-19T08:11:01.324396+0000","last_fullsized":"2024-09-19T08:11:01.324396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:35.905643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'45","reported_seq":92,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.558199+0000","last_change":"2024-09-19T08:09:09.117150+0000","last_active":"2024-09-19T08:11:01.558199+0000","last_peered":"2024-09-19T08:11:01.558199+0000","last_clean":"2024-09-19T08:11:01.558199+0000","last_became_active":"2024-09-19T08:09:09.116763+0000","last_became_peered":"2024-09-19T08:09:09.116763+0000","last_unstale":"2024-09-19T08:11:01.558199+0000","last_undegraded":"2024-09-19T08:11:01.558199+0000","last_fullsized":"2024-09-19T08:11:01.558199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:18.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":82,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.415619+0000","last_change":"2024-09-19T08:09:11.244366+0000","last_active":"2024-09-19T08:11:01.415619+0000","last_peered":"2024-09-19T08:11:01.415619+0000","last_clean":"2024-09-19T08:11:01.415619+0000","last_became_active":"2024-09-19T08:09:11.244023+0000","last_became_peered":"2024-09-19T08:09:11.244023+0000","last_unstale":"2024-09-19T08:11:01.415619+0000","last_undegraded":"2024-09-19T08:11:01.415619+0000","last_fullsized":"2024-09-19T08:11:01.415619+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:18.572377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898860+0000","last_change":"2024-09-19T08:09:09.139557+0000","last_active":"2024-09-19T08:11:01.898860+0000","last_peered":"2024-09-19T08:11:01.898860+0000","last_clean":"2024-09-19T08:11:01.898860+0000","last_became_active":"2024-09-19T08:09:09.139190+0000","last_became_peered":"2024-09-19T08:09:09.139190+0000","last_unstale":"2024-09-19T08:11:01.898860+0000","last_undegraded":"2024-09-19T08:11:01.898860+0000","last_fullsized":"2024-09-19T08:11:01.898860+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:39.270432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898761+0000","last_change":"2024-09-19T08:09:11.249637+0000","last_active":"2024-09-19T08:11:01.898761+0000","last_peered":"2024-09-19T08:11:01.898761+0000","last_clean":"2024-09-19T08:11:01.898761+0000","last_became_active":"2024-09-19T08:09:11.249323+0000","last_became_peered":"2024-09-19T08:09:11.249323+0000","last_unstale":"2024-09-19T08:11:01.898761+0000","last_undegraded":"2024-09-19T08:11:01.898761+0000","last_fullsized":"2024-09-19T08:11:01.898761+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:28.270910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619321+0000","last_change":"2024-09-19T08:09:09.242444+0000","last_active":"2024-09-19T08:11:01.619321+0000","last_peered":"2024-09-19T08:11:01.619321+0000","last_clean":"2024-09-19T08:11:01.619321+0000","last_became_active":"2024-09-19T08:09:09.242095+0000","last_became_peered":"2024-09-19T08:09:09.242095+0000","last_unstale":"2024-09-19T08:11:01.619321+0000","last_undegraded":"2024-09-19T08:11:01.619321+0000","last_fullsized":"2024-09-19T08:11:01.619321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:42.941930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413514+0000","last_change":"2024-09-19T08:09:11.241588+0000","last_active":"2024-09-19T08:11:01.413514+0000","last_peered":"2024-09-19T08:11:01.413514+0000","last_clean":"2024-09-19T08:11:01.413514+0000","last_became_active":"2024-09-19T08:09:11.241076+0000","last_became_peered":"2024-09-19T08:09:11.241076+0000","last_unstale":"2024-09-19T08:11:01.413514+0000","last_undegraded":"2024-09-19T08:11:01.413514+0000","last_fullsized":"2024-09-19T08:11:01.413514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:01.676410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414370+0000","last_change":"2024-09-19T08:09:09.112494+0000","last_active":"2024-09-19T08:11:01.414370+0000","last_peered":"2024-09-19T08:11:01.414370+0000","last_clean":"2024-09-19T08:11:01.414370+0000","last_became_active":"2024-09-19T08:09:09.112019+0000","last_became_peered":"2024-09-19T08:09:09.112019+0000","last_unstale":"2024-09-19T08:11:01.414370+0000","last_undegraded":"2024-09-19T08:11:01.414370+0000","last_fullsized":"2024-09-19T08:11:01.414370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:17.674092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244542+0000","last_change":"2024-09-19T08:09:11.251420+0000","last_active":"2024-09-19T08:11:02.244542+0000","last_peered":"2024-09-19T08:11:02.244542+0000","last_clean":"2024-09-19T08:11:02.244542+0000","last_became_active":"2024-09-19T08:09:11.251083+0000","last_became_peered":"2024-09-19T08:09:11.251083+0000","last_unstale":"2024-09-19T08:11:02.244542+0000","last_undegraded":"2024-09-19T08:11:02.244542+0000","last_fullsized":"2024-09-19T08:11:02.244542+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:38.810616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244424+0000","last_change":"2024-09-19T08:10:14.825972+0000","last_active":"2024-09-19T08:11:02.244424+0000","last_peered":"2024-09-19T08:11:02.244424+0000","last_clean":"2024-09-19T08:11:02.244424+0000","last_became_active":"2024-09-19T08:10:14.825579+0000","last_became_peered":"2024-09-19T08:10:14.825579+0000","last_unstale":"2024-09-19T08:11:02.244424+0000","last_undegraded":"2024-09-19T08:11:02.244424+0000","last_fullsized":"2024-09-19T08:11:02.244424+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:06.708622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414973+0000","last_change":"2024-09-19T08:09:11.239096+0000","last_active":"2024-09-19T08:11:01.414973+0000","last_peered":"2024-09-19T08:11:01.414973+0000","last_clean":"2024-09-19T08:11:01.414973+0000","last_became_active":"2024-09-19T08:09:11.238739+0000","last_became_peered":"2024-09-19T08:09:11.238739+0000","last_unstale":"2024-09-19T08:11:01.414973+0000","last_undegraded":"2024-09-19T08:11:01.414973+0000","last_fullsized":"2024-09-19T08:11:01.414973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:27.161174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413598+0000","last_change":"2024-09-19T08:09:09.115198+0000","last_active":"2024-09-19T08:11:01.413598+0000","last_peered":"2024-09-19T08:11:01.413598+0000","last_clean":"2024-09-19T08:11:01.413598+0000","last_became_active":"2024-09-19T08:09:09.114783+0000","last_became_peered":"2024-09-19T08:09:09.114783+0000","last_unstale":"2024-09-19T08:11:01.413598+0000","last_undegraded":"2024-09-19T08:11:01.413598+0000","last_fullsized":"2024-09-19T08:11:01.413598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:45.674774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898887+0000","last_change":"2024-09-19T08:09:11.252450+0000","last_active":"2024-09-19T08:11:01.898887+0000","last_peered":"2024-09-19T08:11:01.898887+0000","last_clean":"2024-09-19T08:11:01.898887+0000","last_became_active":"2024-09-19T08:09:11.251696+0000","last_became_peered":"2024-09-19T08:09:11.251696+0000","last_unstale":"2024-09-19T08:11:01.898887+0000","last_undegraded":"2024-09-19T08:11:01.898887+0000","last_fullsized":"2024-09-19T08:11:01.898887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:48.179795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327527+0000","last_change":"2024-09-19T08:09:11.244571+0000","last_active":"2024-09-19T08:11:01.327527+0000","last_peered":"2024-09-19T08:11:01.327527+0000","last_clean":"2024-09-19T08:11:01.327527+0000","last_became_active":"2024-09-19T08:09:11.244217+0000","last_became_peered":"2024-09-19T08:09:11.244217+0000","last_unstale":"2024-09-19T08:11:01.327527+0000","last_undegraded":"2024-09-19T08:11:01.327527+0000","last_fullsized":"2024-09-19T08:11:01.327527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:52.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413805+0000","last_change":"2024-09-19T08:09:09.117355+0000","last_active":"2024-09-19T08:11:01.413805+0000","last_peered":"2024-09-19T08:11:01.413805+0000","last_clean":"2024-09-19T08:11:01.413805+0000","last_became_active":"2024-09-19T08:09:09.116806+0000","last_became_peered":"2024-09-19T08:09:09.116806+0000","last_unstale":"2024-09-19T08:11:01.413805+0000","last_undegraded":"2024-09-19T08:11:01.413805+0000","last_fullsized":"2024-09-19T08:11:01.413805+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:42.113015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619575+0000","last_change":"2024-09-19T08:09:11.245745+0000","last_active":"2024-09-19T08:11:01.619575+0000","last_peered":"2024-09-19T08:11:01.619575+0000","last_clean":"2024-09-19T08:11:01.619575+0000","last_became_active":"2024-09-19T08:09:11.245373+0000","last_became_peered":"2024-09-19T08:09:11.245373+0000","last_unstale":"2024-09-19T08:11:01.619575+0000","last_undegraded":"2024-09-19T08:11:01.619575+0000","last_fullsized":"2024-09-19T08:11:01.619575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:56.500738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413790+0000","last_change":"2024-09-19T08:09:09.119550+0000","last_active":"2024-09-19T08:11:01.413790+0000","last_peered":"2024-09-19T08:11:01.413790+0000","last_clean":"2024-09-19T08:11:01.413790+0000","last_became_active":"2024-09-19T08:09:09.119187+0000","last_became_peered":"2024-09-19T08:09:09.119187+0000","last_unstale":"2024-09-19T08:11:01.413790+0000","last_undegraded":"2024-09-19T08:11:01.413790+0000","last_fullsized":"2024-09-19T08:11:01.413790+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:14.629824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898802+0000","last_change":"2024-09-19T08:09:11.245318+0000","last_active":"2024-09-19T08:11:01.898802+0000","last_peered":"2024-09-19T08:11:01.898802+0000","last_clean":"2024-09-19T08:11:01.898802+0000","last_became_active":"2024-09-19T08:09:11.245000+0000","last_became_peered":"2024-09-19T08:09:11.245000+0000","last_unstale":"2024-09-19T08:11:01.898802+0000","last_undegraded":"2024-09-19T08:11:01.898802+0000","last_fullsized":"2024-09-19T08:11:01.898802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:53.590453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.416088+0000","last_change":"2024-09-19T08:09:09.241552+0000","last_active":"2024-09-19T08:11:01.416088+0000","last_peered":"2024-09-19T08:11:01.416088+0000","last_clean":"2024-09-19T08:11:01.416088+0000","last_became_active":"2024-09-19T08:09:09.241201+0000","last_became_peered":"2024-09-19T08:09:09.241201+0000","last_unstale":"2024-09-19T08:11:01.416088+0000","last_undegraded":"2024-09-19T08:11:01.416088+0000","last_fullsized":"2024-09-19T08:11:01.416088+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:09.374532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.415847+0000","last_change":"2024-09-19T08:09:11.246697+0000","last_active":"2024-09-19T08:11:01.415847+0000","last_peered":"2024-09-19T08:11:01.415847+0000","last_clean":"2024-09-19T08:11:01.415847+0000","last_became_active":"2024-09-19T08:09:11.246404+0000","last_became_peered":"2024-09-19T08:09:11.246404+0000","last_unstale":"2024-09-19T08:11:01.415847+0000","last_undegraded":"2024-09-19T08:11:01.415847+0000","last_fullsized":"2024-09-19T08:11:01.415847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.008875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.410864+0000","last_change":"2024-09-19T08:09:09.113401+0000","last_active":"2024-09-19T08:11:01.410864+0000","last_peered":"2024-09-19T08:11:01.410864+0000","last_clean":"2024-09-19T08:11:01.410864+0000","last_became_active":"2024-09-19T08:09:09.113026+0000","last_became_peered":"2024-09-19T08:09:09.113026+0000","last_unstale":"2024-09-19T08:11:01.410864+0000","last_undegraded":"2024-09-19T08:11:01.410864+0000","last_fullsized":"2024-09-19T08:11:01.410864+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:54.740955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595149,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":314,"num_read_kb":260,"num_write":203,"num_write_kb":1407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1785447,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107475,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547236,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":436037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776168,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1069056,"data_stored":1236749,"data_compressed":44853,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939694,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":445517,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168627,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":937984,"data_stored":838755,"data_compressed":22018,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397560,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":1027104,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561085,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":445052,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790018,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":983040,"data_stored":1101658,"data_compressed":41784,"data_compressed_allocated":53248,"data_compressed_original":659456,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953544,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":444957,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":970089,"data_compressed":28174,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":987136,"data_stored":514504,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":514470,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":436127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":524920,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":131782,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":393820,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":393798,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":201329,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:11:03.479 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:11:03.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.619+0000 7ff065aed640 1 -- 172.21.15.27:0/3053561026 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0601077f0 msgr2=0x7ff060109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:03.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.619+0000 7ff065aed640 1 --2- 172.21.15.27:0/3053561026 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0601077f0 0x7ff060109c60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff058009ca0 tx=0x7ff05802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.619+0000 7ff065aed640 1 -- 172.21.15.27:0/3053561026 shutdown_connections 2024-09-19T08:11:03.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.619+0000 7ff065aed640 1 --2- 172.21.15.27:0/3053561026 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0601077f0 0x7ff060109c60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.619+0000 7ff065aed640 1 --2- 172.21.15.27:0/3053561026 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff060104ec0 0x7ff0601072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.619+0000 7ff065aed640 1 --2- 172.21.15.27:0/3053561026 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff060102590 0x7ff060104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.619+0000 7ff065aed640 1 -- 172.21.15.27:0/3053561026 >> 172.21.15.27:0/3053561026 conn(0x7ff0600fc170 msgr2=0x7ff0600fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:03.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.619+0000 7ff065aed640 1 -- 172.21.15.27:0/3053561026 shutdown_connections 2024-09-19T08:11:03.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.619+0000 7ff065aed640 1 -- 172.21.15.27:0/3053561026 wait complete. 2024-09-19T08:11:03.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.620+0000 7ff065aed640 1 Processor -- start 2024-09-19T08:11:03.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.620+0000 7ff065aed640 1 -- start start 2024-09-19T08:11:03.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.620+0000 7ff065aed640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff060102590 0x7ff060197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:03.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.620+0000 7ff065aed640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff060104ec0 0x7ff0601983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:03.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.620+0000 7ff065aed640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0601077f0 0x7ff06019f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:03.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.620+0000 7ff065aed640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff06010d7d0 con 0x7ff060104ec0 2024-09-19T08:11:03.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.620+0000 7ff065aed640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff06010d650 con 0x7ff0601077f0 2024-09-19T08:11:03.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.620+0000 7ff065aed640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff06010d950 con 0x7ff060102590 2024-09-19T08:11:03.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.620+0000 7ff05effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff060104ec0 0x7ff0601983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:03.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.620+0000 7ff05effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff060104ec0 0x7ff0601983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35808/0 (socket says 172.21.15.27:35808) 2024-09-19T08:11:03.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.620+0000 7ff05effd640 1 -- 172.21.15.27:0/3347597164 learned_addr learned my addr 172.21.15.27:0/3347597164 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:03.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.620+0000 7ff05f7fe640 1 --2- 172.21.15.27:0/3347597164 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff060102590 0x7ff060197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:03.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.620+0000 7ff05ffff640 1 --2- 172.21.15.27:0/3347597164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0601077f0 0x7ff06019f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:03.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.621+0000 7ff05f7fe640 1 -- 172.21.15.27:0/3347597164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0601077f0 msgr2=0x7ff06019f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:03.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.621+0000 7ff05f7fe640 1 --2- 172.21.15.27:0/3347597164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0601077f0 0x7ff06019f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.621+0000 7ff05f7fe640 1 -- 172.21.15.27:0/3347597164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff060104ec0 msgr2=0x7ff0601983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:03.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.621+0000 7ff05f7fe640 1 --2- 172.21.15.27:0/3347597164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff060104ec0 0x7ff0601983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.621+0000 7ff05f7fe640 1 -- 172.21.15.27:0/3347597164 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff06019fad0 con 0x7ff060102590 2024-09-19T08:11:03.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.621+0000 7ff05effd640 1 --2- 172.21.15.27:0/3347597164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff060104ec0 0x7ff0601983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:11:03.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.621+0000 7ff05f7fe640 1 --2- 172.21.15.27:0/3347597164 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff060102590 0x7ff060197eb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff05000e9f0 tx=0x7ff05000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:03.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.621+0000 7ff05cff9640 1 -- 172.21.15.27:0/3347597164 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05000ccc0 con 0x7ff060102590 2024-09-19T08:11:03.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.621+0000 7ff065aed640 1 -- 172.21.15.27:0/3347597164 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff06019fdc0 con 0x7ff060102590 2024-09-19T08:11:03.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.621+0000 7ff05cff9640 1 -- 172.21.15.27:0/3347597164 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff050005020 con 0x7ff060102590 2024-09-19T08:11:03.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.621+0000 7ff05cff9640 1 -- 172.21.15.27:0/3347597164 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0500049e0 con 0x7ff060102590 2024-09-19T08:11:03.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.621+0000 7ff065aed640 1 -- 172.21.15.27:0/3347597164 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0601a0230 con 0x7ff060102590 2024-09-19T08:11:03.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.622+0000 7ff065aed640 1 -- 172.21.15.27:0/3347597164 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0600fdc60 con 0x7ff060102590 2024-09-19T08:11:03.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.623+0000 7ff05cff9640 1 -- 172.21.15.27:0/3347597164 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 22) ==== 138167+0+0 (secure 0 0 0) 0x7ff050005560 con 0x7ff060102590 2024-09-19T08:11:03.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.624+0000 7ff05cff9640 1 --2- 172.21.15.27:0/3347597164 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff0480a3050 0x7ff0480a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:03.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.624+0000 7ff05effd640 1 --2- 172.21.15.27:0/3347597164 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff0480a3050 0x7ff0480a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:03.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.624+0000 7ff05cff9640 1 -- 172.21.15.27:0/3347597164 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff0500cf8d0 con 0x7ff060102590 2024-09-19T08:11:03.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.625+0000 7ff05effd640 1 --2- 172.21.15.27:0/3347597164 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff0480a3050 0x7ff0480a5510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff0601993c0 tx=0x7ff054005f90 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:03.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.627+0000 7ff05cff9640 1 -- 172.21.15.27:0/3347597164 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff0500051d0 con 0x7ff060102590 2024-09-19T08:11:03.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:03 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1779725291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:03.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:03 smithi155 ceph-mon[35362]: mgrmap e22: x(active, since 1.02151s), standbys: y, z 2024-09-19T08:11:03.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:03 smithi155 ceph-mon[35362]: [19/Sep/2024:08:11:03] ENGINE Bus STARTING 2024-09-19T08:11:03.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:03 smithi155 ceph-mon[35362]: [19/Sep/2024:08:11:03] ENGINE Serving on http://172.21.15.27:8765 2024-09-19T08:11:03.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:03 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1779725291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:03.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:03 smithi203 ceph-mon[35198]: mgrmap e22: x(active, since 1.02151s), standbys: y, z 2024-09-19T08:11:03.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:03 smithi203 ceph-mon[35198]: [19/Sep/2024:08:11:03] ENGINE Bus STARTING 2024-09-19T08:11:03.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:03 smithi203 ceph-mon[35198]: [19/Sep/2024:08:11:03] ENGINE Serving on http://172.21.15.27:8765 2024-09-19T08:11:03.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.803+0000 7ff065aed640 1 -- 172.21.15.27:0/3347597164 --> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff060062630 con 0x7ff0480a3050 2024-09-19T08:11:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.809+0000 7ff05cff9640 1 -- 172.21.15.27:0/3347597164 <== mgr.15093 v2:172.21.15.27:6800/1578338135 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257890 (secure 0 0 0) 0x7ff060062630 con 0x7ff0480a3050 2024-09-19T08:11:03.811 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:11:03.812 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-09-19T08:11:03.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.812+0000 7ff065aed640 1 -- 172.21.15.27:0/3347597164 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff0480a3050 msgr2=0x7ff0480a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:03.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.812+0000 7ff065aed640 1 --2- 172.21.15.27:0/3347597164 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff0480a3050 0x7ff0480a5510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff0601993c0 tx=0x7ff054005f90 comp rx=0 tx=0).stop 2024-09-19T08:11:03.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.812+0000 7ff065aed640 1 -- 172.21.15.27:0/3347597164 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff060102590 msgr2=0x7ff060197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:03.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.812+0000 7ff065aed640 1 --2- 172.21.15.27:0/3347597164 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff060102590 0x7ff060197eb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff05000e9f0 tx=0x7ff05000eeb0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.812+0000 7ff065aed640 1 -- 172.21.15.27:0/3347597164 shutdown_connections 2024-09-19T08:11:03.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.812+0000 7ff065aed640 1 --2- 172.21.15.27:0/3347597164 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff0480a3050 0x7ff0480a5510 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.812+0000 7ff065aed640 1 --2- 172.21.15.27:0/3347597164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0601077f0 0x7ff06019f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.812+0000 7ff065aed640 1 --2- 172.21.15.27:0/3347597164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff060104ec0 0x7ff0601983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.812+0000 7ff065aed640 1 --2- 172.21.15.27:0/3347597164 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff060102590 0x7ff060197eb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.812+0000 7ff065aed640 1 -- 172.21.15.27:0/3347597164 >> 172.21.15.27:0/3347597164 conn(0x7ff0600fc170 msgr2=0x7ff060102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:03.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.813+0000 7ff065aed640 1 -- 172.21.15.27:0/3347597164 shutdown_connections 2024-09-19T08:11:03.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.813+0000 7ff065aed640 1 -- 172.21.15.27:0/3347597164 wait complete. 2024-09-19T08:11:03.823 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-19T08:11:03.336147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1185751,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":450,"num_read_kb":379,"num_write":386,"num_write_kb":4347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":789,"ondisk_log_size":789,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356252,"kb_used_data":11128,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585572,"statfs":{"total":1151940427776,"available":1151575625728,"internally_reserved":0,"allocated":11395072,"data_stored":8411019,"data_compressed":187014,"data_compressed_allocated":241664,"data_compressed_original":2936832,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.985362"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244732+0000","last_change":"2024-09-19T08:09:11.246436+0000","last_active":"2024-09-19T08:11:02.244732+0000","last_peered":"2024-09-19T08:11:02.244732+0000","last_clean":"2024-09-19T08:11:02.244732+0000","last_became_active":"2024-09-19T08:09:11.245674+0000","last_became_peered":"2024-09-19T08:09:11.245674+0000","last_unstale":"2024-09-19T08:11:02.244732+0000","last_undegraded":"2024-09-19T08:11:02.244732+0000","last_fullsized":"2024-09-19T08:11:02.244732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:46.716474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898632+0000","last_change":"2024-09-19T08:09:11.243334+0000","last_active":"2024-09-19T08:11:01.898632+0000","last_peered":"2024-09-19T08:11:01.898632+0000","last_clean":"2024-09-19T08:11:01.898632+0000","last_became_active":"2024-09-19T08:09:11.243024+0000","last_became_peered":"2024-09-19T08:09:11.243024+0000","last_unstale":"2024-09-19T08:11:01.898632+0000","last_undegraded":"2024-09-19T08:11:01.898632+0000","last_fullsized":"2024-09-19T08:11:01.898632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.060068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898635+0000","last_change":"2024-09-19T08:09:11.254655+0000","last_active":"2024-09-19T08:11:01.898635+0000","last_peered":"2024-09-19T08:11:01.898635+0000","last_clean":"2024-09-19T08:11:01.898635+0000","last_became_active":"2024-09-19T08:09:11.254292+0000","last_became_peered":"2024-09-19T08:09:11.254292+0000","last_unstale":"2024-09-19T08:11:01.898635+0000","last_undegraded":"2024-09-19T08:11:01.898635+0000","last_fullsized":"2024-09-19T08:11:01.898635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:01.977743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899014+0000","last_change":"2024-09-19T08:09:11.257029+0000","last_active":"2024-09-19T08:11:01.899014+0000","last_peered":"2024-09-19T08:11:01.899014+0000","last_clean":"2024-09-19T08:11:01.899014+0000","last_became_active":"2024-09-19T08:09:11.256669+0000","last_became_peered":"2024-09-19T08:09:11.256669+0000","last_unstale":"2024-09-19T08:11:01.899014+0000","last_undegraded":"2024-09-19T08:11:01.899014+0000","last_fullsized":"2024-09-19T08:11:01.899014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:32.831036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413590+0000","last_change":"2024-09-19T08:09:11.240341+0000","last_active":"2024-09-19T08:11:01.413590+0000","last_peered":"2024-09-19T08:11:01.413590+0000","last_clean":"2024-09-19T08:11:01.413590+0000","last_became_active":"2024-09-19T08:09:11.239996+0000","last_became_peered":"2024-09-19T08:09:11.239996+0000","last_unstale":"2024-09-19T08:11:01.413590+0000","last_undegraded":"2024-09-19T08:11:01.413590+0000","last_fullsized":"2024-09-19T08:11:01.413590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:20.331791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325570+0000","last_change":"2024-09-19T08:09:11.248089+0000","last_active":"2024-09-19T08:11:01.325570+0000","last_peered":"2024-09-19T08:11:01.325570+0000","last_clean":"2024-09-19T08:11:01.325570+0000","last_became_active":"2024-09-19T08:09:11.247802+0000","last_became_peered":"2024-09-19T08:09:11.247802+0000","last_unstale":"2024-09-19T08:11:01.325570+0000","last_undegraded":"2024-09-19T08:11:01.325570+0000","last_fullsized":"2024-09-19T08:11:01.325570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.249119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898629+0000","last_change":"2024-09-19T08:09:11.246853+0000","last_active":"2024-09-19T08:11:01.898629+0000","last_peered":"2024-09-19T08:11:01.898629+0000","last_clean":"2024-09-19T08:11:01.898629+0000","last_became_active":"2024-09-19T08:09:11.246523+0000","last_became_peered":"2024-09-19T08:09:11.246523+0000","last_unstale":"2024-09-19T08:11:01.898629+0000","last_undegraded":"2024-09-19T08:11:01.898629+0000","last_fullsized":"2024-09-19T08:11:01.898629+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:54.879087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413783+0000","last_change":"2024-09-19T08:09:11.232588+0000","last_active":"2024-09-19T08:11:01.413783+0000","last_peered":"2024-09-19T08:11:01.413783+0000","last_clean":"2024-09-19T08:11:01.413783+0000","last_became_active":"2024-09-19T08:09:11.232251+0000","last_became_peered":"2024-09-19T08:09:11.232251+0000","last_unstale":"2024-09-19T08:11:01.413783+0000","last_undegraded":"2024-09-19T08:11:01.413783+0000","last_fullsized":"2024-09-19T08:11:01.413783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:57.622086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619576+0000","last_change":"2024-09-19T08:09:11.248854+0000","last_active":"2024-09-19T08:11:01.619576+0000","last_peered":"2024-09-19T08:11:01.619576+0000","last_clean":"2024-09-19T08:11:01.619576+0000","last_became_active":"2024-09-19T08:09:11.248524+0000","last_became_peered":"2024-09-19T08:09:11.248524+0000","last_unstale":"2024-09-19T08:11:01.619576+0000","last_undegraded":"2024-09-19T08:11:01.619576+0000","last_fullsized":"2024-09-19T08:11:01.619576+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:57.978974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325967+0000","last_change":"2024-09-19T08:10:14.786848+0000","last_active":"2024-09-19T08:11:01.325967+0000","last_peered":"2024-09-19T08:11:01.325967+0000","last_clean":"2024-09-19T08:11:01.325967+0000","last_became_active":"2024-09-19T08:10:14.786460+0000","last_became_peered":"2024-09-19T08:10:14.786460+0000","last_unstale":"2024-09-19T08:11:01.325967+0000","last_undegraded":"2024-09-19T08:11:01.325967+0000","last_fullsized":"2024-09-19T08:11:01.325967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:59.430185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899200+0000","last_change":"2024-09-19T08:09:11.247604+0000","last_active":"2024-09-19T08:11:01.899200+0000","last_peered":"2024-09-19T08:11:01.899200+0000","last_clean":"2024-09-19T08:11:01.899200+0000","last_became_active":"2024-09-19T08:09:11.247264+0000","last_became_peered":"2024-09-19T08:09:11.247264+0000","last_unstale":"2024-09-19T08:11:01.899200+0000","last_undegraded":"2024-09-19T08:11:01.899200+0000","last_fullsized":"2024-09-19T08:11:01.899200+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:15.315022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899033+0000","last_change":"2024-09-19T08:09:11.253948+0000","last_active":"2024-09-19T08:11:01.899033+0000","last_peered":"2024-09-19T08:11:01.899033+0000","last_clean":"2024-09-19T08:11:01.899033+0000","last_became_active":"2024-09-19T08:09:11.253402+0000","last_became_peered":"2024-09-19T08:09:11.253402+0000","last_unstale":"2024-09-19T08:11:01.899033+0000","last_undegraded":"2024-09-19T08:11:01.899033+0000","last_fullsized":"2024-09-19T08:11:01.899033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:04.884541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324201+0000","last_change":"2024-09-19T08:09:11.241770+0000","last_active":"2024-09-19T08:11:01.324201+0000","last_peered":"2024-09-19T08:11:01.324201+0000","last_clean":"2024-09-19T08:11:01.324201+0000","last_became_active":"2024-09-19T08:09:11.241356+0000","last_became_peered":"2024-09-19T08:09:11.241356+0000","last_unstale":"2024-09-19T08:11:01.324201+0000","last_undegraded":"2024-09-19T08:11:01.324201+0000","last_fullsized":"2024-09-19T08:11:01.324201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:02.722445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898444+0000","last_change":"2024-09-19T08:09:11.242874+0000","last_active":"2024-09-19T08:11:01.898444+0000","last_peered":"2024-09-19T08:11:01.898444+0000","last_clean":"2024-09-19T08:11:01.898444+0000","last_became_active":"2024-09-19T08:09:11.242383+0000","last_became_peered":"2024-09-19T08:09:11.242383+0000","last_unstale":"2024-09-19T08:11:01.898444+0000","last_undegraded":"2024-09-19T08:11:01.898444+0000","last_fullsized":"2024-09-19T08:11:01.898444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:51.900211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898325+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:11:01.898325+0000","last_peered":"2024-09-19T08:11:01.898325+0000","last_clean":"2024-09-19T08:11:01.898325+0000","last_became_active":"2024-09-19T08:09:11.250797+0000","last_became_peered":"2024-09-19T08:09:11.250797+0000","last_unstale":"2024-09-19T08:11:01.898325+0000","last_undegraded":"2024-09-19T08:11:01.898325+0000","last_fullsized":"2024-09-19T08:11:01.898325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:46.183857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619237+0000","last_change":"2024-09-19T08:09:11.250884+0000","last_active":"2024-09-19T08:11:01.619237+0000","last_peered":"2024-09-19T08:11:01.619237+0000","last_clean":"2024-09-19T08:11:01.619237+0000","last_became_active":"2024-09-19T08:09:11.250543+0000","last_became_peered":"2024-09-19T08:09:11.250543+0000","last_unstale":"2024-09-19T08:11:01.619237+0000","last_undegraded":"2024-09-19T08:11:01.619237+0000","last_fullsized":"2024-09-19T08:11:01.619237+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.259466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244747+0000","last_change":"2024-09-19T08:09:11.246705+0000","last_active":"2024-09-19T08:11:02.244747+0000","last_peered":"2024-09-19T08:11:02.244747+0000","last_clean":"2024-09-19T08:11:02.244747+0000","last_became_active":"2024-09-19T08:09:11.246117+0000","last_became_peered":"2024-09-19T08:09:11.246117+0000","last_unstale":"2024-09-19T08:11:02.244747+0000","last_undegraded":"2024-09-19T08:11:02.244747+0000","last_fullsized":"2024-09-19T08:11:02.244747+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:07.421222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.411014+0000","last_change":"2024-09-19T08:09:11.242181+0000","last_active":"2024-09-19T08:11:01.411014+0000","last_peered":"2024-09-19T08:11:01.411014+0000","last_clean":"2024-09-19T08:11:01.411014+0000","last_became_active":"2024-09-19T08:09:11.241882+0000","last_became_peered":"2024-09-19T08:09:11.241882+0000","last_unstale":"2024-09-19T08:11:01.411014+0000","last_undegraded":"2024-09-19T08:11:01.411014+0000","last_fullsized":"2024-09-19T08:11:01.411014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:35.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619497+0000","last_change":"2024-09-19T08:09:11.246038+0000","last_active":"2024-09-19T08:11:01.619497+0000","last_peered":"2024-09-19T08:11:01.619497+0000","last_clean":"2024-09-19T08:11:01.619497+0000","last_became_active":"2024-09-19T08:09:11.245554+0000","last_became_peered":"2024-09-19T08:09:11.245554+0000","last_unstale":"2024-09-19T08:11:01.619497+0000","last_undegraded":"2024-09-19T08:11:01.619497+0000","last_fullsized":"2024-09-19T08:11:01.619497+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:14.512425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244438+0000","last_change":"2024-09-19T08:09:11.249246+0000","last_active":"2024-09-19T08:11:02.244438+0000","last_peered":"2024-09-19T08:11:02.244438+0000","last_clean":"2024-09-19T08:11:02.244438+0000","last_became_active":"2024-09-19T08:09:11.248896+0000","last_became_peered":"2024-09-19T08:09:11.248896+0000","last_unstale":"2024-09-19T08:11:02.244438+0000","last_undegraded":"2024-09-19T08:11:02.244438+0000","last_fullsized":"2024-09-19T08:11:02.244438+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:40.406924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324207+0000","last_change":"2024-09-19T08:09:11.245421+0000","last_active":"2024-09-19T08:11:01.324207+0000","last_peered":"2024-09-19T08:11:01.324207+0000","last_clean":"2024-09-19T08:11:01.324207+0000","last_became_active":"2024-09-19T08:09:11.245071+0000","last_became_peered":"2024-09-19T08:09:11.245071+0000","last_unstale":"2024-09-19T08:11:01.324207+0000","last_undegraded":"2024-09-19T08:11:01.324207+0000","last_fullsized":"2024-09-19T08:11:01.324207+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:58.594399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619396+0000","last_change":"2024-09-19T08:09:11.246097+0000","last_active":"2024-09-19T08:11:01.619396+0000","last_peered":"2024-09-19T08:11:01.619396+0000","last_clean":"2024-09-19T08:11:01.619396+0000","last_became_active":"2024-09-19T08:09:11.245741+0000","last_became_peered":"2024-09-19T08:09:11.245741+0000","last_unstale":"2024-09-19T08:11:01.619396+0000","last_undegraded":"2024-09-19T08:11:01.619396+0000","last_fullsized":"2024-09-19T08:11:01.619396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:05.731148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414178+0000","last_change":"2024-09-19T08:09:11.251485+0000","last_active":"2024-09-19T08:11:01.414178+0000","last_peered":"2024-09-19T08:11:01.414178+0000","last_clean":"2024-09-19T08:11:01.414178+0000","last_became_active":"2024-09-19T08:09:11.251151+0000","last_became_peered":"2024-09-19T08:09:11.251151+0000","last_unstale":"2024-09-19T08:11:01.414178+0000","last_undegraded":"2024-09-19T08:11:01.414178+0000","last_fullsized":"2024-09-19T08:11:01.414178+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:47.231056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327085+0000","last_change":"2024-09-19T08:09:11.234490+0000","last_active":"2024-09-19T08:11:01.327085+0000","last_peered":"2024-09-19T08:11:01.327085+0000","last_clean":"2024-09-19T08:11:01.327085+0000","last_became_active":"2024-09-19T08:09:11.234163+0000","last_became_peered":"2024-09-19T08:09:11.234163+0000","last_unstale":"2024-09-19T08:11:01.327085+0000","last_undegraded":"2024-09-19T08:11:01.327085+0000","last_fullsized":"2024-09-19T08:11:01.327085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.610165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.415513+0000","last_change":"2024-09-19T08:09:11.247189+0000","last_active":"2024-09-19T08:11:01.415513+0000","last_peered":"2024-09-19T08:11:01.415513+0000","last_clean":"2024-09-19T08:11:01.415513+0000","last_became_active":"2024-09-19T08:09:11.246844+0000","last_became_peered":"2024-09-19T08:09:11.246844+0000","last_unstale":"2024-09-19T08:11:01.415513+0000","last_undegraded":"2024-09-19T08:11:01.415513+0000","last_fullsized":"2024-09-19T08:11:01.415513+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:50.764694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619668+0000","last_change":"2024-09-19T08:09:11.251655+0000","last_active":"2024-09-19T08:11:01.619668+0000","last_peered":"2024-09-19T08:11:01.619668+0000","last_clean":"2024-09-19T08:11:01.619668+0000","last_became_active":"2024-09-19T08:09:11.250930+0000","last_became_peered":"2024-09-19T08:09:11.250930+0000","last_unstale":"2024-09-19T08:11:01.619668+0000","last_undegraded":"2024-09-19T08:11:01.619668+0000","last_fullsized":"2024-09-19T08:11:01.619668+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:17.658277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244670+0000","last_change":"2024-09-19T08:09:11.248095+0000","last_active":"2024-09-19T08:11:02.244670+0000","last_peered":"2024-09-19T08:11:02.244670+0000","last_clean":"2024-09-19T08:11:02.244670+0000","last_became_active":"2024-09-19T08:09:11.247719+0000","last_became_peered":"2024-09-19T08:09:11.247719+0000","last_unstale":"2024-09-19T08:11:02.244670+0000","last_undegraded":"2024-09-19T08:11:02.244670+0000","last_fullsized":"2024-09-19T08:11:02.244670+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:26.701140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324250+0000","last_change":"2024-09-19T08:09:11.243232+0000","last_active":"2024-09-19T08:11:01.324250+0000","last_peered":"2024-09-19T08:11:01.324250+0000","last_clean":"2024-09-19T08:11:01.324250+0000","last_became_active":"2024-09-19T08:09:11.242927+0000","last_became_peered":"2024-09-19T08:09:11.242927+0000","last_unstale":"2024-09-19T08:11:01.324250+0000","last_undegraded":"2024-09-19T08:11:01.324250+0000","last_fullsized":"2024-09-19T08:11:01.324250+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:19.877520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898534+0000","last_change":"2024-09-19T08:09:11.249588+0000","last_active":"2024-09-19T08:11:01.898534+0000","last_peered":"2024-09-19T08:11:01.898534+0000","last_clean":"2024-09-19T08:11:01.898534+0000","last_became_active":"2024-09-19T08:09:11.249266+0000","last_became_peered":"2024-09-19T08:09:11.249266+0000","last_unstale":"2024-09-19T08:11:01.898534+0000","last_undegraded":"2024-09-19T08:11:01.898534+0000","last_fullsized":"2024-09-19T08:11:01.898534+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:43.332454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619356+0000","last_change":"2024-09-19T08:09:11.245866+0000","last_active":"2024-09-19T08:11:01.619356+0000","last_peered":"2024-09-19T08:11:01.619356+0000","last_clean":"2024-09-19T08:11:01.619356+0000","last_became_active":"2024-09-19T08:09:11.245505+0000","last_became_peered":"2024-09-19T08:09:11.245505+0000","last_unstale":"2024-09-19T08:11:01.619356+0000","last_undegraded":"2024-09-19T08:11:01.619356+0000","last_fullsized":"2024-09-19T08:11:01.619356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:38.203790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619389+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:11:01.619389+0000","last_peered":"2024-09-19T08:11:01.619389+0000","last_clean":"2024-09-19T08:11:01.619389+0000","last_became_active":"2024-09-19T08:09:11.250745+0000","last_became_peered":"2024-09-19T08:09:11.250745+0000","last_unstale":"2024-09-19T08:11:01.619389+0000","last_undegraded":"2024-09-19T08:11:01.619389+0000","last_fullsized":"2024-09-19T08:11:01.619389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:16.851230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244514+0000","last_change":"2024-09-19T08:09:11.255211+0000","last_active":"2024-09-19T08:11:02.244514+0000","last_peered":"2024-09-19T08:11:02.244514+0000","last_clean":"2024-09-19T08:11:02.244514+0000","last_became_active":"2024-09-19T08:09:11.254853+0000","last_became_peered":"2024-09-19T08:09:11.254853+0000","last_unstale":"2024-09-19T08:11:02.244514+0000","last_undegraded":"2024-09-19T08:11:02.244514+0000","last_fullsized":"2024-09-19T08:11:02.244514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.497502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413533+0000","last_change":"2024-09-19T08:09:11.247201+0000","last_active":"2024-09-19T08:11:01.413533+0000","last_peered":"2024-09-19T08:11:01.413533+0000","last_clean":"2024-09-19T08:11:01.413533+0000","last_became_active":"2024-09-19T08:09:11.246854+0000","last_became_peered":"2024-09-19T08:09:11.246854+0000","last_unstale":"2024-09-19T08:11:01.413533+0000","last_undegraded":"2024-09-19T08:11:01.413533+0000","last_fullsized":"2024-09-19T08:11:01.413533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:19.262849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327350+0000","last_change":"2024-09-19T08:09:09.113754+0000","last_active":"2024-09-19T08:11:01.327350+0000","last_peered":"2024-09-19T08:11:01.327350+0000","last_clean":"2024-09-19T08:11:01.327350+0000","last_became_active":"2024-09-19T08:09:09.113389+0000","last_became_peered":"2024-09-19T08:09:09.113389+0000","last_unstale":"2024-09-19T08:11:01.327350+0000","last_undegraded":"2024-09-19T08:11:01.327350+0000","last_fullsized":"2024-09-19T08:11:01.327350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:45.325895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327320+0000","last_change":"2024-09-19T08:09:11.244625+0000","last_active":"2024-09-19T08:11:01.327320+0000","last_peered":"2024-09-19T08:11:01.327320+0000","last_clean":"2024-09-19T08:11:01.327320+0000","last_became_active":"2024-09-19T08:09:11.244277+0000","last_became_peered":"2024-09-19T08:09:11.244277+0000","last_unstale":"2024-09-19T08:11:01.327320+0000","last_undegraded":"2024-09-19T08:11:01.327320+0000","last_fullsized":"2024-09-19T08:11:01.327320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:33:34.050343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325579+0000","last_change":"2024-09-19T08:09:09.116735+0000","last_active":"2024-09-19T08:11:01.325579+0000","last_peered":"2024-09-19T08:11:01.325579+0000","last_clean":"2024-09-19T08:11:01.325579+0000","last_became_active":"2024-09-19T08:09:09.116356+0000","last_became_peered":"2024-09-19T08:09:09.116356+0000","last_unstale":"2024-09-19T08:11:01.325579+0000","last_undegraded":"2024-09-19T08:11:01.325579+0000","last_fullsized":"2024-09-19T08:11:01.325579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:50.952567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323834+0000","last_change":"2024-09-19T08:09:09.113182+0000","last_active":"2024-09-19T08:11:01.323834+0000","last_peered":"2024-09-19T08:11:01.323834+0000","last_clean":"2024-09-19T08:11:01.323834+0000","last_became_active":"2024-09-19T08:09:09.112528+0000","last_became_peered":"2024-09-19T08:09:09.112528+0000","last_unstale":"2024-09-19T08:11:01.323834+0000","last_undegraded":"2024-09-19T08:11:01.323834+0000","last_fullsized":"2024-09-19T08:11:01.323834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:07.647351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413961+0000","last_change":"2024-09-19T08:09:11.241639+0000","last_active":"2024-09-19T08:11:01.413961+0000","last_peered":"2024-09-19T08:11:01.413961+0000","last_clean":"2024-09-19T08:11:01.413961+0000","last_became_active":"2024-09-19T08:09:11.241308+0000","last_became_peered":"2024-09-19T08:09:11.241308+0000","last_unstale":"2024-09-19T08:11:01.413961+0000","last_undegraded":"2024-09-19T08:11:01.413961+0000","last_fullsized":"2024-09-19T08:11:01.413961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:57.826870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327401+0000","last_change":"2024-09-19T08:09:09.118334+0000","last_active":"2024-09-19T08:11:01.327401+0000","last_peered":"2024-09-19T08:11:01.327401+0000","last_clean":"2024-09-19T08:11:01.327401+0000","last_became_active":"2024-09-19T08:09:09.118010+0000","last_became_peered":"2024-09-19T08:09:09.118010+0000","last_unstale":"2024-09-19T08:11:01.327401+0000","last_undegraded":"2024-09-19T08:11:01.327401+0000","last_fullsized":"2024-09-19T08:11:01.327401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:51.046598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.410546+0000","last_change":"2024-09-19T08:09:11.239990+0000","last_active":"2024-09-19T08:11:01.410546+0000","last_peered":"2024-09-19T08:11:01.410546+0000","last_clean":"2024-09-19T08:11:01.410546+0000","last_became_active":"2024-09-19T08:09:11.239643+0000","last_became_peered":"2024-09-19T08:09:11.239643+0000","last_unstale":"2024-09-19T08:11:01.410546+0000","last_undegraded":"2024-09-19T08:11:01.410546+0000","last_fullsized":"2024-09-19T08:11:01.410546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:07.078244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325867+0000","last_change":"2024-09-19T08:09:09.114397+0000","last_active":"2024-09-19T08:11:01.325867+0000","last_peered":"2024-09-19T08:11:01.325867+0000","last_clean":"2024-09-19T08:11:01.325867+0000","last_became_active":"2024-09-19T08:09:09.114051+0000","last_became_peered":"2024-09-19T08:09:09.114051+0000","last_unstale":"2024-09-19T08:11:01.325867+0000","last_undegraded":"2024-09-19T08:11:01.325867+0000","last_fullsized":"2024-09-19T08:11:01.325867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:41.799442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619494+0000","last_change":"2024-09-19T08:09:11.254802+0000","last_active":"2024-09-19T08:11:01.619494+0000","last_peered":"2024-09-19T08:11:01.619494+0000","last_clean":"2024-09-19T08:11:01.619494+0000","last_became_active":"2024-09-19T08:09:11.253869+0000","last_became_peered":"2024-09-19T08:09:11.253869+0000","last_unstale":"2024-09-19T08:11:01.619494+0000","last_undegraded":"2024-09-19T08:11:01.619494+0000","last_fullsized":"2024-09-19T08:11:01.619494+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:00.164834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899209+0000","last_change":"2024-09-19T08:09:09.118585+0000","last_active":"2024-09-19T08:11:01.899209+0000","last_peered":"2024-09-19T08:11:01.899209+0000","last_clean":"2024-09-19T08:11:01.899209+0000","last_became_active":"2024-09-19T08:09:09.118216+0000","last_became_peered":"2024-09-19T08:09:09.118216+0000","last_unstale":"2024-09-19T08:11:01.899209+0000","last_undegraded":"2024-09-19T08:11:01.899209+0000","last_fullsized":"2024-09-19T08:11:01.899209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:41.905746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898880+0000","last_change":"2024-09-19T08:09:11.249835+0000","last_active":"2024-09-19T08:11:01.898880+0000","last_peered":"2024-09-19T08:11:01.898880+0000","last_clean":"2024-09-19T08:11:01.898880+0000","last_became_active":"2024-09-19T08:09:11.249443+0000","last_became_peered":"2024-09-19T08:09:11.249443+0000","last_unstale":"2024-09-19T08:11:01.898880+0000","last_undegraded":"2024-09-19T08:11:01.898880+0000","last_fullsized":"2024-09-19T08:11:01.898880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:06.373126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327565+0000","last_change":"2024-09-19T08:09:09.242565+0000","last_active":"2024-09-19T08:11:01.327565+0000","last_peered":"2024-09-19T08:11:01.327565+0000","last_clean":"2024-09-19T08:11:01.327565+0000","last_became_active":"2024-09-19T08:09:09.242199+0000","last_became_peered":"2024-09-19T08:09:09.242199+0000","last_unstale":"2024-09-19T08:11:01.327565+0000","last_undegraded":"2024-09-19T08:11:01.327565+0000","last_fullsized":"2024-09-19T08:11:01.327565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:33.195385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619322+0000","last_change":"2024-09-19T08:09:11.251682+0000","last_active":"2024-09-19T08:11:01.619322+0000","last_peered":"2024-09-19T08:11:01.619322+0000","last_clean":"2024-09-19T08:11:01.619322+0000","last_became_active":"2024-09-19T08:09:11.251037+0000","last_became_peered":"2024-09-19T08:09:11.251037+0000","last_unstale":"2024-09-19T08:11:01.619322+0000","last_undegraded":"2024-09-19T08:11:01.619322+0000","last_fullsized":"2024-09-19T08:11:01.619322+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:29.518828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'35","reported_seq":275,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619210+0000","last_change":"2024-09-19T08:09:09.119090+0000","last_active":"2024-09-19T08:11:01.619210+0000","last_peered":"2024-09-19T08:11:01.619210+0000","last_clean":"2024-09-19T08:11:01.619210+0000","last_became_active":"2024-09-19T08:09:09.118685+0000","last_became_peered":"2024-09-19T08:09:09.118685+0000","last_unstale":"2024-09-19T08:11:01.619210+0000","last_undegraded":"2024-09-19T08:11:01.619210+0000","last_fullsized":"2024-09-19T08:11:01.619210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:21.540404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69535,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":175,"num_write":35,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413753+0000","last_change":"2024-09-19T08:09:11.243200+0000","last_active":"2024-09-19T08:11:01.413753+0000","last_peered":"2024-09-19T08:11:01.413753+0000","last_clean":"2024-09-19T08:11:01.413753+0000","last_became_active":"2024-09-19T08:09:11.242873+0000","last_became_peered":"2024-09-19T08:09:11.242873+0000","last_unstale":"2024-09-19T08:11:01.413753+0000","last_undegraded":"2024-09-19T08:11:01.413753+0000","last_fullsized":"2024-09-19T08:11:01.413753+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:35.817609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619483+0000","last_change":"2024-09-19T08:09:09.117117+0000","last_active":"2024-09-19T08:11:01.619483+0000","last_peered":"2024-09-19T08:11:01.619483+0000","last_clean":"2024-09-19T08:11:01.619483+0000","last_became_active":"2024-09-19T08:09:09.116512+0000","last_became_peered":"2024-09-19T08:09:09.116512+0000","last_unstale":"2024-09-19T08:11:01.619483+0000","last_undegraded":"2024-09-19T08:11:01.619483+0000","last_fullsized":"2024-09-19T08:11:01.619483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:15.010570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323874+0000","last_change":"2024-09-19T08:09:11.246648+0000","last_active":"2024-09-19T08:11:01.323874+0000","last_peered":"2024-09-19T08:11:01.323874+0000","last_clean":"2024-09-19T08:11:01.323874+0000","last_became_active":"2024-09-19T08:09:11.246317+0000","last_became_peered":"2024-09-19T08:09:11.246317+0000","last_unstale":"2024-09-19T08:11:01.323874+0000","last_undegraded":"2024-09-19T08:11:01.323874+0000","last_fullsized":"2024-09-19T08:11:01.323874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:43.285257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327239+0000","last_change":"2024-09-19T08:09:09.112599+0000","last_active":"2024-09-19T08:11:01.327239+0000","last_peered":"2024-09-19T08:11:01.327239+0000","last_clean":"2024-09-19T08:11:01.327239+0000","last_became_active":"2024-09-19T08:09:09.112281+0000","last_became_peered":"2024-09-19T08:09:09.112281+0000","last_unstale":"2024-09-19T08:11:01.327239+0000","last_undegraded":"2024-09-19T08:11:01.327239+0000","last_fullsized":"2024-09-19T08:11:01.327239+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:47.710235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898887+0000","last_change":"2024-09-19T08:09:11.253814+0000","last_active":"2024-09-19T08:11:01.898887+0000","last_peered":"2024-09-19T08:11:01.898887+0000","last_clean":"2024-09-19T08:11:01.898887+0000","last_became_active":"2024-09-19T08:09:11.253490+0000","last_became_peered":"2024-09-19T08:09:11.253490+0000","last_unstale":"2024-09-19T08:11:01.898887+0000","last_undegraded":"2024-09-19T08:11:01.898887+0000","last_fullsized":"2024-09-19T08:11:01.898887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:09.287110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898591+0000","last_change":"2024-09-19T08:09:09.114820+0000","last_active":"2024-09-19T08:11:01.898591+0000","last_peered":"2024-09-19T08:11:01.898591+0000","last_clean":"2024-09-19T08:11:01.898591+0000","last_became_active":"2024-09-19T08:09:09.114478+0000","last_became_peered":"2024-09-19T08:09:09.114478+0000","last_unstale":"2024-09-19T08:11:01.898591+0000","last_undegraded":"2024-09-19T08:11:01.898591+0000","last_fullsized":"2024-09-19T08:11:01.898591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:24.243629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898477+0000","last_change":"2024-09-19T08:10:14.789301+0000","last_active":"2024-09-19T08:11:01.898477+0000","last_peered":"2024-09-19T08:11:01.898477+0000","last_clean":"2024-09-19T08:11:01.898477+0000","last_became_active":"2024-09-19T08:10:14.788891+0000","last_became_peered":"2024-09-19T08:10:14.788891+0000","last_unstale":"2024-09-19T08:11:01.898477+0000","last_undegraded":"2024-09-19T08:11:01.898477+0000","last_fullsized":"2024-09-19T08:11:01.898477+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:03.142177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244400+0000","last_change":"2024-09-19T08:10:14.799207+0000","last_active":"2024-09-19T08:11:02.244400+0000","last_peered":"2024-09-19T08:11:02.244400+0000","last_clean":"2024-09-19T08:11:02.244400+0000","last_became_active":"2024-09-19T08:10:14.787612+0000","last_became_peered":"2024-09-19T08:10:14.787612+0000","last_unstale":"2024-09-19T08:11:02.244400+0000","last_undegraded":"2024-09-19T08:11:02.244400+0000","last_fullsized":"2024-09-19T08:11:02.244400+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:45.997778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327130+0000","last_change":"2024-09-19T08:09:11.245399+0000","last_active":"2024-09-19T08:11:01.327130+0000","last_peered":"2024-09-19T08:11:01.327130+0000","last_clean":"2024-09-19T08:11:01.327130+0000","last_became_active":"2024-09-19T08:09:11.245055+0000","last_became_peered":"2024-09-19T08:09:11.245055+0000","last_unstale":"2024-09-19T08:11:01.327130+0000","last_undegraded":"2024-09-19T08:11:01.327130+0000","last_fullsized":"2024-09-19T08:11:01.327130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:57.639205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413806+0000","last_change":"2024-09-19T08:09:09.115252+0000","last_active":"2024-09-19T08:11:01.413806+0000","last_peered":"2024-09-19T08:11:01.413806+0000","last_clean":"2024-09-19T08:11:01.413806+0000","last_became_active":"2024-09-19T08:09:09.114908+0000","last_became_peered":"2024-09-19T08:09:09.114908+0000","last_unstale":"2024-09-19T08:11:01.413806+0000","last_undegraded":"2024-09-19T08:11:01.413806+0000","last_fullsized":"2024-09-19T08:11:01.413806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:48.326221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244581+0000","last_change":"2024-09-19T08:09:11.249189+0000","last_active":"2024-09-19T08:11:02.244581+0000","last_peered":"2024-09-19T08:11:02.244581+0000","last_clean":"2024-09-19T08:11:02.244581+0000","last_became_active":"2024-09-19T08:09:11.248797+0000","last_became_peered":"2024-09-19T08:09:11.248797+0000","last_unstale":"2024-09-19T08:11:02.244581+0000","last_undegraded":"2024-09-19T08:11:02.244581+0000","last_fullsized":"2024-09-19T08:11:02.244581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:20.915638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324421+0000","last_change":"2024-09-19T08:09:09.112973+0000","last_active":"2024-09-19T08:11:01.324421+0000","last_peered":"2024-09-19T08:11:01.324421+0000","last_clean":"2024-09-19T08:11:01.324421+0000","last_became_active":"2024-09-19T08:09:09.112616+0000","last_became_peered":"2024-09-19T08:09:09.112616+0000","last_unstale":"2024-09-19T08:11:01.324421+0000","last_undegraded":"2024-09-19T08:11:01.324421+0000","last_fullsized":"2024-09-19T08:11:01.324421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:13.791926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899227+0000","last_change":"2024-09-19T08:09:11.240739+0000","last_active":"2024-09-19T08:11:01.899227+0000","last_peered":"2024-09-19T08:11:01.899227+0000","last_clean":"2024-09-19T08:11:01.899227+0000","last_became_active":"2024-09-19T08:09:11.240340+0000","last_became_peered":"2024-09-19T08:09:11.240340+0000","last_unstale":"2024-09-19T08:11:01.899227+0000","last_undegraded":"2024-09-19T08:11:01.899227+0000","last_fullsized":"2024-09-19T08:11:01.899227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:35.450279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'39","reported_seq":71,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.551893+0000","last_change":"2024-09-19T08:09:09.112516+0000","last_active":"2024-09-19T08:11:01.551893+0000","last_peered":"2024-09-19T08:11:01.551893+0000","last_clean":"2024-09-19T08:11:01.551893+0000","last_became_active":"2024-09-19T08:09:09.112140+0000","last_became_peered":"2024-09-19T08:09:09.112140+0000","last_unstale":"2024-09-19T08:11:01.551893+0000","last_undegraded":"2024-09-19T08:11:01.551893+0000","last_fullsized":"2024-09-19T08:11:01.551893+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:05.434331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899052+0000","last_change":"2024-09-19T08:09:11.252163+0000","last_active":"2024-09-19T08:11:01.899052+0000","last_peered":"2024-09-19T08:11:01.899052+0000","last_clean":"2024-09-19T08:11:01.899052+0000","last_became_active":"2024-09-19T08:09:11.251762+0000","last_became_peered":"2024-09-19T08:09:11.251762+0000","last_unstale":"2024-09-19T08:11:01.899052+0000","last_undegraded":"2024-09-19T08:11:01.899052+0000","last_fullsized":"2024-09-19T08:11:01.899052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:33.941910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898722+0000","last_change":"2024-09-19T08:10:14.788460+0000","last_active":"2024-09-19T08:11:01.898722+0000","last_peered":"2024-09-19T08:11:01.898722+0000","last_clean":"2024-09-19T08:11:01.898722+0000","last_became_active":"2024-09-19T08:10:14.787990+0000","last_became_peered":"2024-09-19T08:10:14.787990+0000","last_unstale":"2024-09-19T08:11:01.898722+0000","last_undegraded":"2024-09-19T08:11:01.898722+0000","last_fullsized":"2024-09-19T08:11:01.898722+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:24.549994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899257+0000","last_change":"2024-09-19T08:09:11.242438+0000","last_active":"2024-09-19T08:11:01.899257+0000","last_peered":"2024-09-19T08:11:01.899257+0000","last_clean":"2024-09-19T08:11:01.899257+0000","last_became_active":"2024-09-19T08:09:11.242114+0000","last_became_peered":"2024-09-19T08:09:11.242114+0000","last_unstale":"2024-09-19T08:11:01.899257+0000","last_undegraded":"2024-09-19T08:11:01.899257+0000","last_fullsized":"2024-09-19T08:11:01.899257+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:54.183012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":348,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898629+0000","last_change":"2024-09-19T08:07:55.287566+0000","last_active":"2024-09-19T08:11:01.898629+0000","last_peered":"2024-09-19T08:11:01.898629+0000","last_clean":"2024-09-19T08:11:01.898629+0000","last_became_active":"2024-09-19T08:07:55.287037+0000","last_became_peered":"2024-09-19T08:07:55.287037+0000","last_unstale":"2024-09-19T08:11:01.898629+0000","last_undegraded":"2024-09-19T08:11:01.898629+0000","last_fullsized":"2024-09-19T08:11:01.898629+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_clean_scrub_stamp":"2024-09-19T08:04:29.468857+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:49.553882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898721+0000","last_change":"2024-09-19T08:09:09.113497+0000","last_active":"2024-09-19T08:11:01.898721+0000","last_peered":"2024-09-19T08:11:01.898721+0000","last_clean":"2024-09-19T08:11:01.898721+0000","last_became_active":"2024-09-19T08:09:09.112546+0000","last_became_peered":"2024-09-19T08:09:09.112546+0000","last_unstale":"2024-09-19T08:11:01.898721+0000","last_undegraded":"2024-09-19T08:11:01.898721+0000","last_fullsized":"2024-09-19T08:11:01.898721+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:09.906476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414661+0000","last_change":"2024-09-19T08:09:11.241478+0000","last_active":"2024-09-19T08:11:01.414661+0000","last_peered":"2024-09-19T08:11:01.414661+0000","last_clean":"2024-09-19T08:11:01.414661+0000","last_became_active":"2024-09-19T08:09:11.241138+0000","last_became_peered":"2024-09-19T08:09:11.241138+0000","last_unstale":"2024-09-19T08:11:01.414661+0000","last_undegraded":"2024-09-19T08:11:01.414661+0000","last_fullsized":"2024-09-19T08:11:01.414661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:32.884491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898598+0000","last_change":"2024-09-19T08:09:09.116571+0000","last_active":"2024-09-19T08:11:01.898598+0000","last_peered":"2024-09-19T08:11:01.898598+0000","last_clean":"2024-09-19T08:11:01.898598+0000","last_became_active":"2024-09-19T08:09:09.116180+0000","last_became_peered":"2024-09-19T08:09:09.116180+0000","last_unstale":"2024-09-19T08:11:01.898598+0000","last_undegraded":"2024-09-19T08:11:01.898598+0000","last_fullsized":"2024-09-19T08:11:01.898598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:58.577320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323834+0000","last_change":"2024-09-19T08:10:14.791196+0000","last_active":"2024-09-19T08:11:01.323834+0000","last_peered":"2024-09-19T08:11:01.323834+0000","last_clean":"2024-09-19T08:11:01.323834+0000","last_became_active":"2024-09-19T08:10:14.790873+0000","last_became_peered":"2024-09-19T08:10:14.790873+0000","last_unstale":"2024-09-19T08:11:01.323834+0000","last_undegraded":"2024-09-19T08:11:01.323834+0000","last_fullsized":"2024-09-19T08:11:01.323834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:41.725521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323966+0000","last_change":"2024-09-19T08:09:09.242166+0000","last_active":"2024-09-19T08:11:01.323966+0000","last_peered":"2024-09-19T08:11:01.323966+0000","last_clean":"2024-09-19T08:11:01.323966+0000","last_became_active":"2024-09-19T08:09:09.241270+0000","last_became_peered":"2024-09-19T08:09:09.241270+0000","last_unstale":"2024-09-19T08:11:01.323966+0000","last_undegraded":"2024-09-19T08:11:01.323966+0000","last_fullsized":"2024-09-19T08:11:01.323966+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:51.899069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327090+0000","last_change":"2024-09-19T08:10:14.793572+0000","last_active":"2024-09-19T08:11:01.327090+0000","last_peered":"2024-09-19T08:11:01.327090+0000","last_clean":"2024-09-19T08:11:01.327090+0000","last_became_active":"2024-09-19T08:10:14.793258+0000","last_became_peered":"2024-09-19T08:10:14.793258+0000","last_unstale":"2024-09-19T08:11:01.327090+0000","last_undegraded":"2024-09-19T08:11:01.327090+0000","last_fullsized":"2024-09-19T08:11:01.327090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:53.912430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899060+0000","last_change":"2024-09-19T08:09:09.118790+0000","last_active":"2024-09-19T08:11:01.899060+0000","last_peered":"2024-09-19T08:11:01.899060+0000","last_clean":"2024-09-19T08:11:01.899060+0000","last_became_active":"2024-09-19T08:09:09.117695+0000","last_became_peered":"2024-09-19T08:09:09.117695+0000","last_unstale":"2024-09-19T08:11:01.899060+0000","last_undegraded":"2024-09-19T08:11:01.899060+0000","last_fullsized":"2024-09-19T08:11:01.899060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:40.674039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325589+0000","last_change":"2024-09-19T08:09:11.249386+0000","last_active":"2024-09-19T08:11:01.325589+0000","last_peered":"2024-09-19T08:11:01.325589+0000","last_clean":"2024-09-19T08:11:01.325589+0000","last_became_active":"2024-09-19T08:09:11.249004+0000","last_became_peered":"2024-09-19T08:09:11.249004+0000","last_unstale":"2024-09-19T08:11:01.325589+0000","last_undegraded":"2024-09-19T08:11:01.325589+0000","last_fullsized":"2024-09-19T08:11:01.325589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:50.170799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.410707+0000","last_change":"2024-09-19T08:09:09.241599+0000","last_active":"2024-09-19T08:11:01.410707+0000","last_peered":"2024-09-19T08:11:01.410707+0000","last_clean":"2024-09-19T08:11:01.410707+0000","last_became_active":"2024-09-19T08:09:09.241226+0000","last_became_peered":"2024-09-19T08:09:09.241226+0000","last_unstale":"2024-09-19T08:11:01.410707+0000","last_undegraded":"2024-09-19T08:11:01.410707+0000","last_fullsized":"2024-09-19T08:11:01.410707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:19.590966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325735+0000","last_change":"2024-09-19T08:09:11.238098+0000","last_active":"2024-09-19T08:11:01.325735+0000","last_peered":"2024-09-19T08:11:01.325735+0000","last_clean":"2024-09-19T08:11:01.325735+0000","last_became_active":"2024-09-19T08:09:11.237737+0000","last_became_peered":"2024-09-19T08:09:11.237737+0000","last_unstale":"2024-09-19T08:11:01.325735+0000","last_undegraded":"2024-09-19T08:11:01.325735+0000","last_fullsized":"2024-09-19T08:11:01.325735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:00.134664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413888+0000","last_change":"2024-09-19T08:09:09.241775+0000","last_active":"2024-09-19T08:11:01.413888+0000","last_peered":"2024-09-19T08:11:01.413888+0000","last_clean":"2024-09-19T08:11:01.413888+0000","last_became_active":"2024-09-19T08:09:09.241367+0000","last_became_peered":"2024-09-19T08:09:09.241367+0000","last_unstale":"2024-09-19T08:11:01.413888+0000","last_undegraded":"2024-09-19T08:11:01.413888+0000","last_fullsized":"2024-09-19T08:11:01.413888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:11.862171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324396+0000","last_change":"2024-09-19T08:09:11.251980+0000","last_active":"2024-09-19T08:11:01.324396+0000","last_peered":"2024-09-19T08:11:01.324396+0000","last_clean":"2024-09-19T08:11:01.324396+0000","last_became_active":"2024-09-19T08:09:11.251638+0000","last_became_peered":"2024-09-19T08:09:11.251638+0000","last_unstale":"2024-09-19T08:11:01.324396+0000","last_undegraded":"2024-09-19T08:11:01.324396+0000","last_fullsized":"2024-09-19T08:11:01.324396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:35.905643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'45","reported_seq":92,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.558199+0000","last_change":"2024-09-19T08:09:09.117150+0000","last_active":"2024-09-19T08:11:01.558199+0000","last_peered":"2024-09-19T08:11:01.558199+0000","last_clean":"2024-09-19T08:11:01.558199+0000","last_became_active":"2024-09-19T08:09:09.116763+0000","last_became_peered":"2024-09-19T08:09:09.116763+0000","last_unstale":"2024-09-19T08:11:01.558199+0000","last_undegraded":"2024-09-19T08:11:01.558199+0000","last_fullsized":"2024-09-19T08:11:01.558199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:18.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":82,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.415619+0000","last_change":"2024-09-19T08:09:11.244366+0000","last_active":"2024-09-19T08:11:01.415619+0000","last_peered":"2024-09-19T08:11:01.415619+0000","last_clean":"2024-09-19T08:11:01.415619+0000","last_became_active":"2024-09-19T08:09:11.244023+0000","last_became_peered":"2024-09-19T08:09:11.244023+0000","last_unstale":"2024-09-19T08:11:01.415619+0000","last_undegraded":"2024-09-19T08:11:01.415619+0000","last_fullsized":"2024-09-19T08:11:01.415619+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:18.572377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898860+0000","last_change":"2024-09-19T08:09:09.139557+0000","last_active":"2024-09-19T08:11:01.898860+0000","last_peered":"2024-09-19T08:11:01.898860+0000","last_clean":"2024-09-19T08:11:01.898860+0000","last_became_active":"2024-09-19T08:09:09.139190+0000","last_became_peered":"2024-09-19T08:09:09.139190+0000","last_unstale":"2024-09-19T08:11:01.898860+0000","last_undegraded":"2024-09-19T08:11:01.898860+0000","last_fullsized":"2024-09-19T08:11:01.898860+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:39.270432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898761+0000","last_change":"2024-09-19T08:09:11.249637+0000","last_active":"2024-09-19T08:11:01.898761+0000","last_peered":"2024-09-19T08:11:01.898761+0000","last_clean":"2024-09-19T08:11:01.898761+0000","last_became_active":"2024-09-19T08:09:11.249323+0000","last_became_peered":"2024-09-19T08:09:11.249323+0000","last_unstale":"2024-09-19T08:11:01.898761+0000","last_undegraded":"2024-09-19T08:11:01.898761+0000","last_fullsized":"2024-09-19T08:11:01.898761+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:28.270910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619321+0000","last_change":"2024-09-19T08:09:09.242444+0000","last_active":"2024-09-19T08:11:01.619321+0000","last_peered":"2024-09-19T08:11:01.619321+0000","last_clean":"2024-09-19T08:11:01.619321+0000","last_became_active":"2024-09-19T08:09:09.242095+0000","last_became_peered":"2024-09-19T08:09:09.242095+0000","last_unstale":"2024-09-19T08:11:01.619321+0000","last_undegraded":"2024-09-19T08:11:01.619321+0000","last_fullsized":"2024-09-19T08:11:01.619321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:42.941930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413514+0000","last_change":"2024-09-19T08:09:11.241588+0000","last_active":"2024-09-19T08:11:01.413514+0000","last_peered":"2024-09-19T08:11:01.413514+0000","last_clean":"2024-09-19T08:11:01.413514+0000","last_became_active":"2024-09-19T08:09:11.241076+0000","last_became_peered":"2024-09-19T08:09:11.241076+0000","last_unstale":"2024-09-19T08:11:01.413514+0000","last_undegraded":"2024-09-19T08:11:01.413514+0000","last_fullsized":"2024-09-19T08:11:01.413514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:01.676410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414370+0000","last_change":"2024-09-19T08:09:09.112494+0000","last_active":"2024-09-19T08:11:01.414370+0000","last_peered":"2024-09-19T08:11:01.414370+0000","last_clean":"2024-09-19T08:11:01.414370+0000","last_became_active":"2024-09-19T08:09:09.112019+0000","last_became_peered":"2024-09-19T08:09:09.112019+0000","last_unstale":"2024-09-19T08:11:01.414370+0000","last_undegraded":"2024-09-19T08:11:01.414370+0000","last_fullsized":"2024-09-19T08:11:01.414370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:17.674092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244542+0000","last_change":"2024-09-19T08:09:11.251420+0000","last_active":"2024-09-19T08:11:02.244542+0000","last_peered":"2024-09-19T08:11:02.244542+0000","last_clean":"2024-09-19T08:11:02.244542+0000","last_became_active":"2024-09-19T08:09:11.251083+0000","last_became_peered":"2024-09-19T08:09:11.251083+0000","last_unstale":"2024-09-19T08:11:02.244542+0000","last_undegraded":"2024-09-19T08:11:02.244542+0000","last_fullsized":"2024-09-19T08:11:02.244542+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:38.810616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244424+0000","last_change":"2024-09-19T08:10:14.825972+0000","last_active":"2024-09-19T08:11:02.244424+0000","last_peered":"2024-09-19T08:11:02.244424+0000","last_clean":"2024-09-19T08:11:02.244424+0000","last_became_active":"2024-09-19T08:10:14.825579+0000","last_became_peered":"2024-09-19T08:10:14.825579+0000","last_unstale":"2024-09-19T08:11:02.244424+0000","last_undegraded":"2024-09-19T08:11:02.244424+0000","last_fullsized":"2024-09-19T08:11:02.244424+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:06.708622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414973+0000","last_change":"2024-09-19T08:09:11.239096+0000","last_active":"2024-09-19T08:11:01.414973+0000","last_peered":"2024-09-19T08:11:01.414973+0000","last_clean":"2024-09-19T08:11:01.414973+0000","last_became_active":"2024-09-19T08:09:11.238739+0000","last_became_peered":"2024-09-19T08:09:11.238739+0000","last_unstale":"2024-09-19T08:11:01.414973+0000","last_undegraded":"2024-09-19T08:11:01.414973+0000","last_fullsized":"2024-09-19T08:11:01.414973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:27.161174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413598+0000","last_change":"2024-09-19T08:09:09.115198+0000","last_active":"2024-09-19T08:11:01.413598+0000","last_peered":"2024-09-19T08:11:01.413598+0000","last_clean":"2024-09-19T08:11:01.413598+0000","last_became_active":"2024-09-19T08:09:09.114783+0000","last_became_peered":"2024-09-19T08:09:09.114783+0000","last_unstale":"2024-09-19T08:11:01.413598+0000","last_undegraded":"2024-09-19T08:11:01.413598+0000","last_fullsized":"2024-09-19T08:11:01.413598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:45.674774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898887+0000","last_change":"2024-09-19T08:09:11.252450+0000","last_active":"2024-09-19T08:11:01.898887+0000","last_peered":"2024-09-19T08:11:01.898887+0000","last_clean":"2024-09-19T08:11:01.898887+0000","last_became_active":"2024-09-19T08:09:11.251696+0000","last_became_peered":"2024-09-19T08:09:11.251696+0000","last_unstale":"2024-09-19T08:11:01.898887+0000","last_undegraded":"2024-09-19T08:11:01.898887+0000","last_fullsized":"2024-09-19T08:11:01.898887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:48.179795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327527+0000","last_change":"2024-09-19T08:09:11.244571+0000","last_active":"2024-09-19T08:11:01.327527+0000","last_peered":"2024-09-19T08:11:01.327527+0000","last_clean":"2024-09-19T08:11:01.327527+0000","last_became_active":"2024-09-19T08:09:11.244217+0000","last_became_peered":"2024-09-19T08:09:11.244217+0000","last_unstale":"2024-09-19T08:11:01.327527+0000","last_undegraded":"2024-09-19T08:11:01.327527+0000","last_fullsized":"2024-09-19T08:11:01.327527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:52.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413805+0000","last_change":"2024-09-19T08:09:09.117355+0000","last_active":"2024-09-19T08:11:01.413805+0000","last_peered":"2024-09-19T08:11:01.413805+0000","last_clean":"2024-09-19T08:11:01.413805+0000","last_became_active":"2024-09-19T08:09:09.116806+0000","last_became_peered":"2024-09-19T08:09:09.116806+0000","last_unstale":"2024-09-19T08:11:01.413805+0000","last_undegraded":"2024-09-19T08:11:01.413805+0000","last_fullsized":"2024-09-19T08:11:01.413805+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:42.113015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619575+0000","last_change":"2024-09-19T08:09:11.245745+0000","last_active":"2024-09-19T08:11:01.619575+0000","last_peered":"2024-09-19T08:11:01.619575+0000","last_clean":"2024-09-19T08:11:01.619575+0000","last_became_active":"2024-09-19T08:09:11.245373+0000","last_became_peered":"2024-09-19T08:09:11.245373+0000","last_unstale":"2024-09-19T08:11:01.619575+0000","last_undegraded":"2024-09-19T08:11:01.619575+0000","last_fullsized":"2024-09-19T08:11:01.619575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:56.500738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413790+0000","last_change":"2024-09-19T08:09:09.119550+0000","last_active":"2024-09-19T08:11:01.413790+0000","last_peered":"2024-09-19T08:11:01.413790+0000","last_clean":"2024-09-19T08:11:01.413790+0000","last_became_active":"2024-09-19T08:09:09.119187+0000","last_became_peered":"2024-09-19T08:09:09.119187+0000","last_unstale":"2024-09-19T08:11:01.413790+0000","last_undegraded":"2024-09-19T08:11:01.413790+0000","last_fullsized":"2024-09-19T08:11:01.413790+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:14.629824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898802+0000","last_change":"2024-09-19T08:09:11.245318+0000","last_active":"2024-09-19T08:11:01.898802+0000","last_peered":"2024-09-19T08:11:01.898802+0000","last_clean":"2024-09-19T08:11:01.898802+0000","last_became_active":"2024-09-19T08:09:11.245000+0000","last_became_peered":"2024-09-19T08:09:11.245000+0000","last_unstale":"2024-09-19T08:11:01.898802+0000","last_undegraded":"2024-09-19T08:11:01.898802+0000","last_fullsized":"2024-09-19T08:11:01.898802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:53.590453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.416088+0000","last_change":"2024-09-19T08:09:09.241552+0000","last_active":"2024-09-19T08:11:01.416088+0000","last_peered":"2024-09-19T08:11:01.416088+0000","last_clean":"2024-09-19T08:11:01.416088+0000","last_became_active":"2024-09-19T08:09:09.241201+0000","last_became_peered":"2024-09-19T08:09:09.241201+0000","last_unstale":"2024-09-19T08:11:01.416088+0000","last_undegraded":"2024-09-19T08:11:01.416088+0000","last_fullsized":"2024-09-19T08:11:01.416088+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:09.374532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.415847+0000","last_change":"2024-09-19T08:09:11.246697+0000","last_active":"2024-09-19T08:11:01.415847+0000","last_peered":"2024-09-19T08:11:01.415847+0000","last_clean":"2024-09-19T08:11:01.415847+0000","last_became_active":"2024-09-19T08:09:11.246404+0000","last_became_peered":"2024-09-19T08:09:11.246404+0000","last_unstale":"2024-09-19T08:11:01.415847+0000","last_undegraded":"2024-09-19T08:11:01.415847+0000","last_fullsized":"2024-09-19T08:11:01.415847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.008875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.410864+0000","last_change":"2024-09-19T08:09:09.113401+0000","last_active":"2024-09-19T08:11:01.410864+0000","last_peered":"2024-09-19T08:11:01.410864+0000","last_clean":"2024-09-19T08:11:01.410864+0000","last_became_active":"2024-09-19T08:09:09.113026+0000","last_became_peered":"2024-09-19T08:09:09.113026+0000","last_unstale":"2024-09-19T08:11:01.410864+0000","last_undegraded":"2024-09-19T08:11:01.410864+0000","last_fullsized":"2024-09-19T08:11:01.410864+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:54.740955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595149,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":314,"num_read_kb":260,"num_write":203,"num_write_kb":1407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1785447,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107475,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547236,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":436037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776168,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1069056,"data_stored":1236749,"data_compressed":44853,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939694,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":445517,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168627,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":937984,"data_stored":838755,"data_compressed":22018,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397560,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":1027104,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561085,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":445052,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790018,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":983040,"data_stored":1101658,"data_compressed":41784,"data_compressed_allocated":53248,"data_compressed_original":659456,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953544,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":444957,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":970089,"data_compressed":28174,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":987136,"data_stored":514504,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":514470,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":436127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":524920,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":131782,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":393820,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":393798,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":201329,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:11:03.827 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T08:11:03.827 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:11:03.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.976+0000 7f6ce2a23640 1 -- 172.21.15.27:0/4008464254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cdc1025e0 msgr2=0x7f6cdc108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:03.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.976+0000 7f6ce2a23640 1 --2- 172.21.15.27:0/4008464254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cdc1025e0 0x7f6cdc108e70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009ca0 tx=0x7f6cd402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.976+0000 7f6ce2a23640 1 -- 172.21.15.27:0/4008464254 shutdown_connections 2024-09-19T08:11:03.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.976+0000 7f6ce2a23640 1 --2- 172.21.15.27:0/4008464254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cdc1025e0 0x7f6cdc108e70 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.976+0000 7f6ce2a23640 1 --2- 172.21.15.27:0/4008464254 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cdc101c20 0x7f6cdc1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.976+0000 7f6ce2a23640 1 --2- 172.21.15.27:0/4008464254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cdc100a30 0x7f6cdc100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.976+0000 7f6ce2a23640 1 -- 172.21.15.27:0/4008464254 >> 172.21.15.27:0/4008464254 conn(0x7f6cdc0fc1b0 msgr2=0x7f6cdc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:03.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.976+0000 7f6ce2a23640 1 -- 172.21.15.27:0/4008464254 shutdown_connections 2024-09-19T08:11:03.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.976+0000 7f6ce2a23640 1 -- 172.21.15.27:0/4008464254 wait complete. 2024-09-19T08:11:03.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.977+0000 7f6ce2a23640 1 Processor -- start 2024-09-19T08:11:03.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.977+0000 7f6ce2a23640 1 -- start start 2024-09-19T08:11:03.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.977+0000 7f6ce2a23640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cdc100a30 0x7f6cdc1049c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:03.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.977+0000 7f6ce2a23640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cdc101c20 0x7f6cdc103000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:03.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.977+0000 7f6ce2a23640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cdc1025e0 0x7f6cdc103540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:03.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.977+0000 7f6ce2a23640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc10c6b0 con 0x7f6cdc101c20 2024-09-19T08:11:03.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.977+0000 7f6ce2a23640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc10c530 con 0x7f6cdc1025e0 2024-09-19T08:11:03.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.977+0000 7f6ce2a23640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc10c830 con 0x7f6cdc100a30 2024-09-19T08:11:03.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.977+0000 7f6cdb7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cdc101c20 0x7f6cdc103000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:03.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.977+0000 7f6cdbfff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cdc100a30 0x7f6cdc1049c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:03.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.977+0000 7f6cdb7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cdc101c20 0x7f6cdc103000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35828/0 (socket says 172.21.15.27:35828) 2024-09-19T08:11:03.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.977+0000 7f6cdbfff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cdc100a30 0x7f6cdc1049c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.27:53266/0 (socket says 172.21.15.27:53266) 2024-09-19T08:11:03.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.977+0000 7f6cdb7fe640 1 -- 172.21.15.27:0/1898649451 learned_addr learned my addr 172.21.15.27:0/1898649451 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:03.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.977+0000 7f6ce0fc0640 1 --2- 172.21.15.27:0/1898649451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cdc1025e0 0x7f6cdc103540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:03.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.978+0000 7f6cdbfff640 1 -- 172.21.15.27:0/1898649451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cdc1025e0 msgr2=0x7f6cdc103540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:03.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.978+0000 7f6cdbfff640 1 --2- 172.21.15.27:0/1898649451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cdc1025e0 0x7f6cdc103540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.978+0000 7f6cdbfff640 1 -- 172.21.15.27:0/1898649451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cdc101c20 msgr2=0x7f6cdc103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:03.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.978+0000 7f6cdbfff640 1 --2- 172.21.15.27:0/1898649451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cdc101c20 0x7f6cdc103000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:03.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.978+0000 7f6cdbfff640 1 -- 172.21.15.27:0/1898649451 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cdc103dd0 con 0x7f6cdc100a30 2024-09-19T08:11:03.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.978+0000 7f6cdb7fe640 1 --2- 172.21.15.27:0/1898649451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cdc101c20 0x7f6cdc103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:11:03.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.978+0000 7f6ce0fc0640 1 --2- 172.21.15.27:0/1898649451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cdc1025e0 0x7f6cdc103540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:11:03.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.978+0000 7f6cdbfff640 1 --2- 172.21.15.27:0/1898649451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cdc100a30 0x7f6cdc1049c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00e9c0 tx=0x7f6ccc00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:03.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.978+0000 7f6cd97fa640 1 -- 172.21.15.27:0/1898649451 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc00ccc0 con 0x7f6cdc100a30 2024-09-19T08:11:03.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.978+0000 7f6cd97fa640 1 -- 172.21.15.27:0/1898649451 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ccc0035f0 con 0x7f6cdc100a30 2024-09-19T08:11:03.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.978+0000 7f6ce2a23640 1 -- 172.21.15.27:0/1898649451 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cdc1a1f50 con 0x7f6cdc100a30 2024-09-19T08:11:03.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.978+0000 7f6cd97fa640 1 -- 172.21.15.27:0/1898649451 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc00ce60 con 0x7f6cdc100a30 2024-09-19T08:11:03.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.978+0000 7f6ce2a23640 1 -- 172.21.15.27:0/1898649451 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cdc1a2360 con 0x7f6cdc100a30 2024-09-19T08:11:03.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.979+0000 7f6ce2a23640 1 -- 172.21.15.27:0/1898649451 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cdc1a2650 con 0x7f6cdc100a30 2024-09-19T08:11:03.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.981+0000 7f6cd97fa640 1 -- 172.21.15.27:0/1898649451 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 22) ==== 138167+0+0 (secure 0 0 0) 0x7f6ccc0037a0 con 0x7f6cdc100a30 2024-09-19T08:11:03.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.982+0000 7f6cd97fa640 1 --2- 172.21.15.27:0/1898649451 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6cc40a3050 0x7f6cc40a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:03.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.982+0000 7f6cd97fa640 1 -- 172.21.15.27:0/1898649451 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f6ccc0cfd20 con 0x7f6cdc100a30 2024-09-19T08:11:03.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.982+0000 7f6cdb7fe640 1 --2- 172.21.15.27:0/1898649451 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6cc40a3050 0x7f6cc40a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:03.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.983+0000 7f6cdb7fe640 1 --2- 172.21.15.27:0/1898649451 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6cc40a3050 0x7f6cc40a5510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc104730 tx=0x7f6cd0005f90 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:03.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:03.984+0000 7f6cd97fa640 1 -- 172.21.15.27:0/1898649451 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6ccc09cc60 con 0x7f6cdc100a30 2024-09-19T08:11:04.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:04.181+0000 7f6ce2a23640 1 -- 172.21.15.27:0/1898649451 --> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6cdc0fe3d0 con 0x7f6cc40a3050 2024-09-19T08:11:04.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:04.188+0000 7f6cd97fa640 1 -- 172.21.15.27:0/1898649451 <== mgr.15093 v2:172.21.15.27:6800/1578338135 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257890 (secure 0 0 0) 0x7f6cdc0fe3d0 con 0x7f6cc40a3050 2024-09-19T08:11:04.190 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:11:04.191 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-09-19T08:11:04.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:04.192+0000 7f6ce2a23640 1 -- 172.21.15.27:0/1898649451 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6cc40a3050 msgr2=0x7f6cc40a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:04.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:04.192+0000 7f6ce2a23640 1 --2- 172.21.15.27:0/1898649451 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6cc40a3050 0x7f6cc40a5510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc104730 tx=0x7f6cd0005f90 comp rx=0 tx=0).stop 2024-09-19T08:11:04.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:04.192+0000 7f6ce2a23640 1 -- 172.21.15.27:0/1898649451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cdc100a30 msgr2=0x7f6cdc1049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:04.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:04.192+0000 7f6ce2a23640 1 --2- 172.21.15.27:0/1898649451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cdc100a30 0x7f6cdc1049c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00e9c0 tx=0x7f6ccc00ee80 comp rx=0 tx=0).stop 2024-09-19T08:11:04.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:04.192+0000 7f6ce2a23640 1 -- 172.21.15.27:0/1898649451 shutdown_connections 2024-09-19T08:11:04.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:04.192+0000 7f6ce2a23640 1 --2- 172.21.15.27:0/1898649451 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6cc40a3050 0x7f6cc40a5510 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:04.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:04.192+0000 7f6ce2a23640 1 --2- 172.21.15.27:0/1898649451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cdc1025e0 0x7f6cdc103540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:04.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:04.192+0000 7f6ce2a23640 1 --2- 172.21.15.27:0/1898649451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cdc101c20 0x7f6cdc103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:04.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:04.192+0000 7f6ce2a23640 1 --2- 172.21.15.27:0/1898649451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cdc100a30 0x7f6cdc1049c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:04.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:04.192+0000 7f6ce2a23640 1 -- 172.21.15.27:0/1898649451 >> 172.21.15.27:0/1898649451 conn(0x7f6cdc0fc1b0 msgr2=0x7f6cdc0fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:04.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:04.192+0000 7f6ce2a23640 1 -- 172.21.15.27:0/1898649451 shutdown_connections 2024-09-19T08:11:04.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:04.192+0000 7f6ce2a23640 1 -- 172.21.15.27:0/1898649451 wait complete. 2024-09-19T08:11:04.203 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-19T08:11:03.336147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1185751,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":450,"num_read_kb":379,"num_write":386,"num_write_kb":4347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":789,"ondisk_log_size":789,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356252,"kb_used_data":11128,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585572,"statfs":{"total":1151940427776,"available":1151575625728,"internally_reserved":0,"allocated":11395072,"data_stored":8411019,"data_compressed":187014,"data_compressed_allocated":241664,"data_compressed_original":2936832,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.985362"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244732+0000","last_change":"2024-09-19T08:09:11.246436+0000","last_active":"2024-09-19T08:11:02.244732+0000","last_peered":"2024-09-19T08:11:02.244732+0000","last_clean":"2024-09-19T08:11:02.244732+0000","last_became_active":"2024-09-19T08:09:11.245674+0000","last_became_peered":"2024-09-19T08:09:11.245674+0000","last_unstale":"2024-09-19T08:11:02.244732+0000","last_undegraded":"2024-09-19T08:11:02.244732+0000","last_fullsized":"2024-09-19T08:11:02.244732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:46.716474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898632+0000","last_change":"2024-09-19T08:09:11.243334+0000","last_active":"2024-09-19T08:11:01.898632+0000","last_peered":"2024-09-19T08:11:01.898632+0000","last_clean":"2024-09-19T08:11:01.898632+0000","last_became_active":"2024-09-19T08:09:11.243024+0000","last_became_peered":"2024-09-19T08:09:11.243024+0000","last_unstale":"2024-09-19T08:11:01.898632+0000","last_undegraded":"2024-09-19T08:11:01.898632+0000","last_fullsized":"2024-09-19T08:11:01.898632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.060068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898635+0000","last_change":"2024-09-19T08:09:11.254655+0000","last_active":"2024-09-19T08:11:01.898635+0000","last_peered":"2024-09-19T08:11:01.898635+0000","last_clean":"2024-09-19T08:11:01.898635+0000","last_became_active":"2024-09-19T08:09:11.254292+0000","last_became_peered":"2024-09-19T08:09:11.254292+0000","last_unstale":"2024-09-19T08:11:01.898635+0000","last_undegraded":"2024-09-19T08:11:01.898635+0000","last_fullsized":"2024-09-19T08:11:01.898635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:01.977743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899014+0000","last_change":"2024-09-19T08:09:11.257029+0000","last_active":"2024-09-19T08:11:01.899014+0000","last_peered":"2024-09-19T08:11:01.899014+0000","last_clean":"2024-09-19T08:11:01.899014+0000","last_became_active":"2024-09-19T08:09:11.256669+0000","last_became_peered":"2024-09-19T08:09:11.256669+0000","last_unstale":"2024-09-19T08:11:01.899014+0000","last_undegraded":"2024-09-19T08:11:01.899014+0000","last_fullsized":"2024-09-19T08:11:01.899014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:32.831036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413590+0000","last_change":"2024-09-19T08:09:11.240341+0000","last_active":"2024-09-19T08:11:01.413590+0000","last_peered":"2024-09-19T08:11:01.413590+0000","last_clean":"2024-09-19T08:11:01.413590+0000","last_became_active":"2024-09-19T08:09:11.239996+0000","last_became_peered":"2024-09-19T08:09:11.239996+0000","last_unstale":"2024-09-19T08:11:01.413590+0000","last_undegraded":"2024-09-19T08:11:01.413590+0000","last_fullsized":"2024-09-19T08:11:01.413590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:20.331791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325570+0000","last_change":"2024-09-19T08:09:11.248089+0000","last_active":"2024-09-19T08:11:01.325570+0000","last_peered":"2024-09-19T08:11:01.325570+0000","last_clean":"2024-09-19T08:11:01.325570+0000","last_became_active":"2024-09-19T08:09:11.247802+0000","last_became_peered":"2024-09-19T08:09:11.247802+0000","last_unstale":"2024-09-19T08:11:01.325570+0000","last_undegraded":"2024-09-19T08:11:01.325570+0000","last_fullsized":"2024-09-19T08:11:01.325570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.249119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898629+0000","last_change":"2024-09-19T08:09:11.246853+0000","last_active":"2024-09-19T08:11:01.898629+0000","last_peered":"2024-09-19T08:11:01.898629+0000","last_clean":"2024-09-19T08:11:01.898629+0000","last_became_active":"2024-09-19T08:09:11.246523+0000","last_became_peered":"2024-09-19T08:09:11.246523+0000","last_unstale":"2024-09-19T08:11:01.898629+0000","last_undegraded":"2024-09-19T08:11:01.898629+0000","last_fullsized":"2024-09-19T08:11:01.898629+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:54.879087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413783+0000","last_change":"2024-09-19T08:09:11.232588+0000","last_active":"2024-09-19T08:11:01.413783+0000","last_peered":"2024-09-19T08:11:01.413783+0000","last_clean":"2024-09-19T08:11:01.413783+0000","last_became_active":"2024-09-19T08:09:11.232251+0000","last_became_peered":"2024-09-19T08:09:11.232251+0000","last_unstale":"2024-09-19T08:11:01.413783+0000","last_undegraded":"2024-09-19T08:11:01.413783+0000","last_fullsized":"2024-09-19T08:11:01.413783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:57.622086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619576+0000","last_change":"2024-09-19T08:09:11.248854+0000","last_active":"2024-09-19T08:11:01.619576+0000","last_peered":"2024-09-19T08:11:01.619576+0000","last_clean":"2024-09-19T08:11:01.619576+0000","last_became_active":"2024-09-19T08:09:11.248524+0000","last_became_peered":"2024-09-19T08:09:11.248524+0000","last_unstale":"2024-09-19T08:11:01.619576+0000","last_undegraded":"2024-09-19T08:11:01.619576+0000","last_fullsized":"2024-09-19T08:11:01.619576+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:57.978974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325967+0000","last_change":"2024-09-19T08:10:14.786848+0000","last_active":"2024-09-19T08:11:01.325967+0000","last_peered":"2024-09-19T08:11:01.325967+0000","last_clean":"2024-09-19T08:11:01.325967+0000","last_became_active":"2024-09-19T08:10:14.786460+0000","last_became_peered":"2024-09-19T08:10:14.786460+0000","last_unstale":"2024-09-19T08:11:01.325967+0000","last_undegraded":"2024-09-19T08:11:01.325967+0000","last_fullsized":"2024-09-19T08:11:01.325967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:59.430185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899200+0000","last_change":"2024-09-19T08:09:11.247604+0000","last_active":"2024-09-19T08:11:01.899200+0000","last_peered":"2024-09-19T08:11:01.899200+0000","last_clean":"2024-09-19T08:11:01.899200+0000","last_became_active":"2024-09-19T08:09:11.247264+0000","last_became_peered":"2024-09-19T08:09:11.247264+0000","last_unstale":"2024-09-19T08:11:01.899200+0000","last_undegraded":"2024-09-19T08:11:01.899200+0000","last_fullsized":"2024-09-19T08:11:01.899200+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:15.315022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899033+0000","last_change":"2024-09-19T08:09:11.253948+0000","last_active":"2024-09-19T08:11:01.899033+0000","last_peered":"2024-09-19T08:11:01.899033+0000","last_clean":"2024-09-19T08:11:01.899033+0000","last_became_active":"2024-09-19T08:09:11.253402+0000","last_became_peered":"2024-09-19T08:09:11.253402+0000","last_unstale":"2024-09-19T08:11:01.899033+0000","last_undegraded":"2024-09-19T08:11:01.899033+0000","last_fullsized":"2024-09-19T08:11:01.899033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:04.884541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324201+0000","last_change":"2024-09-19T08:09:11.241770+0000","last_active":"2024-09-19T08:11:01.324201+0000","last_peered":"2024-09-19T08:11:01.324201+0000","last_clean":"2024-09-19T08:11:01.324201+0000","last_became_active":"2024-09-19T08:09:11.241356+0000","last_became_peered":"2024-09-19T08:09:11.241356+0000","last_unstale":"2024-09-19T08:11:01.324201+0000","last_undegraded":"2024-09-19T08:11:01.324201+0000","last_fullsized":"2024-09-19T08:11:01.324201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:02.722445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898444+0000","last_change":"2024-09-19T08:09:11.242874+0000","last_active":"2024-09-19T08:11:01.898444+0000","last_peered":"2024-09-19T08:11:01.898444+0000","last_clean":"2024-09-19T08:11:01.898444+0000","last_became_active":"2024-09-19T08:09:11.242383+0000","last_became_peered":"2024-09-19T08:09:11.242383+0000","last_unstale":"2024-09-19T08:11:01.898444+0000","last_undegraded":"2024-09-19T08:11:01.898444+0000","last_fullsized":"2024-09-19T08:11:01.898444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:51.900211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898325+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:11:01.898325+0000","last_peered":"2024-09-19T08:11:01.898325+0000","last_clean":"2024-09-19T08:11:01.898325+0000","last_became_active":"2024-09-19T08:09:11.250797+0000","last_became_peered":"2024-09-19T08:09:11.250797+0000","last_unstale":"2024-09-19T08:11:01.898325+0000","last_undegraded":"2024-09-19T08:11:01.898325+0000","last_fullsized":"2024-09-19T08:11:01.898325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:46.183857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619237+0000","last_change":"2024-09-19T08:09:11.250884+0000","last_active":"2024-09-19T08:11:01.619237+0000","last_peered":"2024-09-19T08:11:01.619237+0000","last_clean":"2024-09-19T08:11:01.619237+0000","last_became_active":"2024-09-19T08:09:11.250543+0000","last_became_peered":"2024-09-19T08:09:11.250543+0000","last_unstale":"2024-09-19T08:11:01.619237+0000","last_undegraded":"2024-09-19T08:11:01.619237+0000","last_fullsized":"2024-09-19T08:11:01.619237+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.259466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244747+0000","last_change":"2024-09-19T08:09:11.246705+0000","last_active":"2024-09-19T08:11:02.244747+0000","last_peered":"2024-09-19T08:11:02.244747+0000","last_clean":"2024-09-19T08:11:02.244747+0000","last_became_active":"2024-09-19T08:09:11.246117+0000","last_became_peered":"2024-09-19T08:09:11.246117+0000","last_unstale":"2024-09-19T08:11:02.244747+0000","last_undegraded":"2024-09-19T08:11:02.244747+0000","last_fullsized":"2024-09-19T08:11:02.244747+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:07.421222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.411014+0000","last_change":"2024-09-19T08:09:11.242181+0000","last_active":"2024-09-19T08:11:01.411014+0000","last_peered":"2024-09-19T08:11:01.411014+0000","last_clean":"2024-09-19T08:11:01.411014+0000","last_became_active":"2024-09-19T08:09:11.241882+0000","last_became_peered":"2024-09-19T08:09:11.241882+0000","last_unstale":"2024-09-19T08:11:01.411014+0000","last_undegraded":"2024-09-19T08:11:01.411014+0000","last_fullsized":"2024-09-19T08:11:01.411014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:35.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619497+0000","last_change":"2024-09-19T08:09:11.246038+0000","last_active":"2024-09-19T08:11:01.619497+0000","last_peered":"2024-09-19T08:11:01.619497+0000","last_clean":"2024-09-19T08:11:01.619497+0000","last_became_active":"2024-09-19T08:09:11.245554+0000","last_became_peered":"2024-09-19T08:09:11.245554+0000","last_unstale":"2024-09-19T08:11:01.619497+0000","last_undegraded":"2024-09-19T08:11:01.619497+0000","last_fullsized":"2024-09-19T08:11:01.619497+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:14.512425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244438+0000","last_change":"2024-09-19T08:09:11.249246+0000","last_active":"2024-09-19T08:11:02.244438+0000","last_peered":"2024-09-19T08:11:02.244438+0000","last_clean":"2024-09-19T08:11:02.244438+0000","last_became_active":"2024-09-19T08:09:11.248896+0000","last_became_peered":"2024-09-19T08:09:11.248896+0000","last_unstale":"2024-09-19T08:11:02.244438+0000","last_undegraded":"2024-09-19T08:11:02.244438+0000","last_fullsized":"2024-09-19T08:11:02.244438+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:40.406924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324207+0000","last_change":"2024-09-19T08:09:11.245421+0000","last_active":"2024-09-19T08:11:01.324207+0000","last_peered":"2024-09-19T08:11:01.324207+0000","last_clean":"2024-09-19T08:11:01.324207+0000","last_became_active":"2024-09-19T08:09:11.245071+0000","last_became_peered":"2024-09-19T08:09:11.245071+0000","last_unstale":"2024-09-19T08:11:01.324207+0000","last_undegraded":"2024-09-19T08:11:01.324207+0000","last_fullsized":"2024-09-19T08:11:01.324207+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:58.594399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619396+0000","last_change":"2024-09-19T08:09:11.246097+0000","last_active":"2024-09-19T08:11:01.619396+0000","last_peered":"2024-09-19T08:11:01.619396+0000","last_clean":"2024-09-19T08:11:01.619396+0000","last_became_active":"2024-09-19T08:09:11.245741+0000","last_became_peered":"2024-09-19T08:09:11.245741+0000","last_unstale":"2024-09-19T08:11:01.619396+0000","last_undegraded":"2024-09-19T08:11:01.619396+0000","last_fullsized":"2024-09-19T08:11:01.619396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:05.731148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414178+0000","last_change":"2024-09-19T08:09:11.251485+0000","last_active":"2024-09-19T08:11:01.414178+0000","last_peered":"2024-09-19T08:11:01.414178+0000","last_clean":"2024-09-19T08:11:01.414178+0000","last_became_active":"2024-09-19T08:09:11.251151+0000","last_became_peered":"2024-09-19T08:09:11.251151+0000","last_unstale":"2024-09-19T08:11:01.414178+0000","last_undegraded":"2024-09-19T08:11:01.414178+0000","last_fullsized":"2024-09-19T08:11:01.414178+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:47.231056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327085+0000","last_change":"2024-09-19T08:09:11.234490+0000","last_active":"2024-09-19T08:11:01.327085+0000","last_peered":"2024-09-19T08:11:01.327085+0000","last_clean":"2024-09-19T08:11:01.327085+0000","last_became_active":"2024-09-19T08:09:11.234163+0000","last_became_peered":"2024-09-19T08:09:11.234163+0000","last_unstale":"2024-09-19T08:11:01.327085+0000","last_undegraded":"2024-09-19T08:11:01.327085+0000","last_fullsized":"2024-09-19T08:11:01.327085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.610165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.415513+0000","last_change":"2024-09-19T08:09:11.247189+0000","last_active":"2024-09-19T08:11:01.415513+0000","last_peered":"2024-09-19T08:11:01.415513+0000","last_clean":"2024-09-19T08:11:01.415513+0000","last_became_active":"2024-09-19T08:09:11.246844+0000","last_became_peered":"2024-09-19T08:09:11.246844+0000","last_unstale":"2024-09-19T08:11:01.415513+0000","last_undegraded":"2024-09-19T08:11:01.415513+0000","last_fullsized":"2024-09-19T08:11:01.415513+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:50.764694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619668+0000","last_change":"2024-09-19T08:09:11.251655+0000","last_active":"2024-09-19T08:11:01.619668+0000","last_peered":"2024-09-19T08:11:01.619668+0000","last_clean":"2024-09-19T08:11:01.619668+0000","last_became_active":"2024-09-19T08:09:11.250930+0000","last_became_peered":"2024-09-19T08:09:11.250930+0000","last_unstale":"2024-09-19T08:11:01.619668+0000","last_undegraded":"2024-09-19T08:11:01.619668+0000","last_fullsized":"2024-09-19T08:11:01.619668+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:17.658277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244670+0000","last_change":"2024-09-19T08:09:11.248095+0000","last_active":"2024-09-19T08:11:02.244670+0000","last_peered":"2024-09-19T08:11:02.244670+0000","last_clean":"2024-09-19T08:11:02.244670+0000","last_became_active":"2024-09-19T08:09:11.247719+0000","last_became_peered":"2024-09-19T08:09:11.247719+0000","last_unstale":"2024-09-19T08:11:02.244670+0000","last_undegraded":"2024-09-19T08:11:02.244670+0000","last_fullsized":"2024-09-19T08:11:02.244670+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:26.701140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324250+0000","last_change":"2024-09-19T08:09:11.243232+0000","last_active":"2024-09-19T08:11:01.324250+0000","last_peered":"2024-09-19T08:11:01.324250+0000","last_clean":"2024-09-19T08:11:01.324250+0000","last_became_active":"2024-09-19T08:09:11.242927+0000","last_became_peered":"2024-09-19T08:09:11.242927+0000","last_unstale":"2024-09-19T08:11:01.324250+0000","last_undegraded":"2024-09-19T08:11:01.324250+0000","last_fullsized":"2024-09-19T08:11:01.324250+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:19.877520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898534+0000","last_change":"2024-09-19T08:09:11.249588+0000","last_active":"2024-09-19T08:11:01.898534+0000","last_peered":"2024-09-19T08:11:01.898534+0000","last_clean":"2024-09-19T08:11:01.898534+0000","last_became_active":"2024-09-19T08:09:11.249266+0000","last_became_peered":"2024-09-19T08:09:11.249266+0000","last_unstale":"2024-09-19T08:11:01.898534+0000","last_undegraded":"2024-09-19T08:11:01.898534+0000","last_fullsized":"2024-09-19T08:11:01.898534+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:43.332454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619356+0000","last_change":"2024-09-19T08:09:11.245866+0000","last_active":"2024-09-19T08:11:01.619356+0000","last_peered":"2024-09-19T08:11:01.619356+0000","last_clean":"2024-09-19T08:11:01.619356+0000","last_became_active":"2024-09-19T08:09:11.245505+0000","last_became_peered":"2024-09-19T08:09:11.245505+0000","last_unstale":"2024-09-19T08:11:01.619356+0000","last_undegraded":"2024-09-19T08:11:01.619356+0000","last_fullsized":"2024-09-19T08:11:01.619356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:38.203790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619389+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:11:01.619389+0000","last_peered":"2024-09-19T08:11:01.619389+0000","last_clean":"2024-09-19T08:11:01.619389+0000","last_became_active":"2024-09-19T08:09:11.250745+0000","last_became_peered":"2024-09-19T08:09:11.250745+0000","last_unstale":"2024-09-19T08:11:01.619389+0000","last_undegraded":"2024-09-19T08:11:01.619389+0000","last_fullsized":"2024-09-19T08:11:01.619389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:16.851230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244514+0000","last_change":"2024-09-19T08:09:11.255211+0000","last_active":"2024-09-19T08:11:02.244514+0000","last_peered":"2024-09-19T08:11:02.244514+0000","last_clean":"2024-09-19T08:11:02.244514+0000","last_became_active":"2024-09-19T08:09:11.254853+0000","last_became_peered":"2024-09-19T08:09:11.254853+0000","last_unstale":"2024-09-19T08:11:02.244514+0000","last_undegraded":"2024-09-19T08:11:02.244514+0000","last_fullsized":"2024-09-19T08:11:02.244514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.497502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413533+0000","last_change":"2024-09-19T08:09:11.247201+0000","last_active":"2024-09-19T08:11:01.413533+0000","last_peered":"2024-09-19T08:11:01.413533+0000","last_clean":"2024-09-19T08:11:01.413533+0000","last_became_active":"2024-09-19T08:09:11.246854+0000","last_became_peered":"2024-09-19T08:09:11.246854+0000","last_unstale":"2024-09-19T08:11:01.413533+0000","last_undegraded":"2024-09-19T08:11:01.413533+0000","last_fullsized":"2024-09-19T08:11:01.413533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:19.262849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327350+0000","last_change":"2024-09-19T08:09:09.113754+0000","last_active":"2024-09-19T08:11:01.327350+0000","last_peered":"2024-09-19T08:11:01.327350+0000","last_clean":"2024-09-19T08:11:01.327350+0000","last_became_active":"2024-09-19T08:09:09.113389+0000","last_became_peered":"2024-09-19T08:09:09.113389+0000","last_unstale":"2024-09-19T08:11:01.327350+0000","last_undegraded":"2024-09-19T08:11:01.327350+0000","last_fullsized":"2024-09-19T08:11:01.327350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:45.325895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327320+0000","last_change":"2024-09-19T08:09:11.244625+0000","last_active":"2024-09-19T08:11:01.327320+0000","last_peered":"2024-09-19T08:11:01.327320+0000","last_clean":"2024-09-19T08:11:01.327320+0000","last_became_active":"2024-09-19T08:09:11.244277+0000","last_became_peered":"2024-09-19T08:09:11.244277+0000","last_unstale":"2024-09-19T08:11:01.327320+0000","last_undegraded":"2024-09-19T08:11:01.327320+0000","last_fullsized":"2024-09-19T08:11:01.327320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:33:34.050343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325579+0000","last_change":"2024-09-19T08:09:09.116735+0000","last_active":"2024-09-19T08:11:01.325579+0000","last_peered":"2024-09-19T08:11:01.325579+0000","last_clean":"2024-09-19T08:11:01.325579+0000","last_became_active":"2024-09-19T08:09:09.116356+0000","last_became_peered":"2024-09-19T08:09:09.116356+0000","last_unstale":"2024-09-19T08:11:01.325579+0000","last_undegraded":"2024-09-19T08:11:01.325579+0000","last_fullsized":"2024-09-19T08:11:01.325579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:50.952567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323834+0000","last_change":"2024-09-19T08:09:09.113182+0000","last_active":"2024-09-19T08:11:01.323834+0000","last_peered":"2024-09-19T08:11:01.323834+0000","last_clean":"2024-09-19T08:11:01.323834+0000","last_became_active":"2024-09-19T08:09:09.112528+0000","last_became_peered":"2024-09-19T08:09:09.112528+0000","last_unstale":"2024-09-19T08:11:01.323834+0000","last_undegraded":"2024-09-19T08:11:01.323834+0000","last_fullsized":"2024-09-19T08:11:01.323834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:07.647351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413961+0000","last_change":"2024-09-19T08:09:11.241639+0000","last_active":"2024-09-19T08:11:01.413961+0000","last_peered":"2024-09-19T08:11:01.413961+0000","last_clean":"2024-09-19T08:11:01.413961+0000","last_became_active":"2024-09-19T08:09:11.241308+0000","last_became_peered":"2024-09-19T08:09:11.241308+0000","last_unstale":"2024-09-19T08:11:01.413961+0000","last_undegraded":"2024-09-19T08:11:01.413961+0000","last_fullsized":"2024-09-19T08:11:01.413961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:57.826870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327401+0000","last_change":"2024-09-19T08:09:09.118334+0000","last_active":"2024-09-19T08:11:01.327401+0000","last_peered":"2024-09-19T08:11:01.327401+0000","last_clean":"2024-09-19T08:11:01.327401+0000","last_became_active":"2024-09-19T08:09:09.118010+0000","last_became_peered":"2024-09-19T08:09:09.118010+0000","last_unstale":"2024-09-19T08:11:01.327401+0000","last_undegraded":"2024-09-19T08:11:01.327401+0000","last_fullsized":"2024-09-19T08:11:01.327401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:51.046598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.410546+0000","last_change":"2024-09-19T08:09:11.239990+0000","last_active":"2024-09-19T08:11:01.410546+0000","last_peered":"2024-09-19T08:11:01.410546+0000","last_clean":"2024-09-19T08:11:01.410546+0000","last_became_active":"2024-09-19T08:09:11.239643+0000","last_became_peered":"2024-09-19T08:09:11.239643+0000","last_unstale":"2024-09-19T08:11:01.410546+0000","last_undegraded":"2024-09-19T08:11:01.410546+0000","last_fullsized":"2024-09-19T08:11:01.410546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:07.078244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325867+0000","last_change":"2024-09-19T08:09:09.114397+0000","last_active":"2024-09-19T08:11:01.325867+0000","last_peered":"2024-09-19T08:11:01.325867+0000","last_clean":"2024-09-19T08:11:01.325867+0000","last_became_active":"2024-09-19T08:09:09.114051+0000","last_became_peered":"2024-09-19T08:09:09.114051+0000","last_unstale":"2024-09-19T08:11:01.325867+0000","last_undegraded":"2024-09-19T08:11:01.325867+0000","last_fullsized":"2024-09-19T08:11:01.325867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:41.799442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619494+0000","last_change":"2024-09-19T08:09:11.254802+0000","last_active":"2024-09-19T08:11:01.619494+0000","last_peered":"2024-09-19T08:11:01.619494+0000","last_clean":"2024-09-19T08:11:01.619494+0000","last_became_active":"2024-09-19T08:09:11.253869+0000","last_became_peered":"2024-09-19T08:09:11.253869+0000","last_unstale":"2024-09-19T08:11:01.619494+0000","last_undegraded":"2024-09-19T08:11:01.619494+0000","last_fullsized":"2024-09-19T08:11:01.619494+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:00.164834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899209+0000","last_change":"2024-09-19T08:09:09.118585+0000","last_active":"2024-09-19T08:11:01.899209+0000","last_peered":"2024-09-19T08:11:01.899209+0000","last_clean":"2024-09-19T08:11:01.899209+0000","last_became_active":"2024-09-19T08:09:09.118216+0000","last_became_peered":"2024-09-19T08:09:09.118216+0000","last_unstale":"2024-09-19T08:11:01.899209+0000","last_undegraded":"2024-09-19T08:11:01.899209+0000","last_fullsized":"2024-09-19T08:11:01.899209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:41.905746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898880+0000","last_change":"2024-09-19T08:09:11.249835+0000","last_active":"2024-09-19T08:11:01.898880+0000","last_peered":"2024-09-19T08:11:01.898880+0000","last_clean":"2024-09-19T08:11:01.898880+0000","last_became_active":"2024-09-19T08:09:11.249443+0000","last_became_peered":"2024-09-19T08:09:11.249443+0000","last_unstale":"2024-09-19T08:11:01.898880+0000","last_undegraded":"2024-09-19T08:11:01.898880+0000","last_fullsized":"2024-09-19T08:11:01.898880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:06.373126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327565+0000","last_change":"2024-09-19T08:09:09.242565+0000","last_active":"2024-09-19T08:11:01.327565+0000","last_peered":"2024-09-19T08:11:01.327565+0000","last_clean":"2024-09-19T08:11:01.327565+0000","last_became_active":"2024-09-19T08:09:09.242199+0000","last_became_peered":"2024-09-19T08:09:09.242199+0000","last_unstale":"2024-09-19T08:11:01.327565+0000","last_undegraded":"2024-09-19T08:11:01.327565+0000","last_fullsized":"2024-09-19T08:11:01.327565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:33.195385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619322+0000","last_change":"2024-09-19T08:09:11.251682+0000","last_active":"2024-09-19T08:11:01.619322+0000","last_peered":"2024-09-19T08:11:01.619322+0000","last_clean":"2024-09-19T08:11:01.619322+0000","last_became_active":"2024-09-19T08:09:11.251037+0000","last_became_peered":"2024-09-19T08:09:11.251037+0000","last_unstale":"2024-09-19T08:11:01.619322+0000","last_undegraded":"2024-09-19T08:11:01.619322+0000","last_fullsized":"2024-09-19T08:11:01.619322+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:29.518828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'35","reported_seq":275,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619210+0000","last_change":"2024-09-19T08:09:09.119090+0000","last_active":"2024-09-19T08:11:01.619210+0000","last_peered":"2024-09-19T08:11:01.619210+0000","last_clean":"2024-09-19T08:11:01.619210+0000","last_became_active":"2024-09-19T08:09:09.118685+0000","last_became_peered":"2024-09-19T08:09:09.118685+0000","last_unstale":"2024-09-19T08:11:01.619210+0000","last_undegraded":"2024-09-19T08:11:01.619210+0000","last_fullsized":"2024-09-19T08:11:01.619210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:21.540404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69535,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":175,"num_write":35,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413753+0000","last_change":"2024-09-19T08:09:11.243200+0000","last_active":"2024-09-19T08:11:01.413753+0000","last_peered":"2024-09-19T08:11:01.413753+0000","last_clean":"2024-09-19T08:11:01.413753+0000","last_became_active":"2024-09-19T08:09:11.242873+0000","last_became_peered":"2024-09-19T08:09:11.242873+0000","last_unstale":"2024-09-19T08:11:01.413753+0000","last_undegraded":"2024-09-19T08:11:01.413753+0000","last_fullsized":"2024-09-19T08:11:01.413753+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:35.817609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619483+0000","last_change":"2024-09-19T08:09:09.117117+0000","last_active":"2024-09-19T08:11:01.619483+0000","last_peered":"2024-09-19T08:11:01.619483+0000","last_clean":"2024-09-19T08:11:01.619483+0000","last_became_active":"2024-09-19T08:09:09.116512+0000","last_became_peered":"2024-09-19T08:09:09.116512+0000","last_unstale":"2024-09-19T08:11:01.619483+0000","last_undegraded":"2024-09-19T08:11:01.619483+0000","last_fullsized":"2024-09-19T08:11:01.619483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:15.010570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323874+0000","last_change":"2024-09-19T08:09:11.246648+0000","last_active":"2024-09-19T08:11:01.323874+0000","last_peered":"2024-09-19T08:11:01.323874+0000","last_clean":"2024-09-19T08:11:01.323874+0000","last_became_active":"2024-09-19T08:09:11.246317+0000","last_became_peered":"2024-09-19T08:09:11.246317+0000","last_unstale":"2024-09-19T08:11:01.323874+0000","last_undegraded":"2024-09-19T08:11:01.323874+0000","last_fullsized":"2024-09-19T08:11:01.323874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:43.285257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327239+0000","last_change":"2024-09-19T08:09:09.112599+0000","last_active":"2024-09-19T08:11:01.327239+0000","last_peered":"2024-09-19T08:11:01.327239+0000","last_clean":"2024-09-19T08:11:01.327239+0000","last_became_active":"2024-09-19T08:09:09.112281+0000","last_became_peered":"2024-09-19T08:09:09.112281+0000","last_unstale":"2024-09-19T08:11:01.327239+0000","last_undegraded":"2024-09-19T08:11:01.327239+0000","last_fullsized":"2024-09-19T08:11:01.327239+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:47.710235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898887+0000","last_change":"2024-09-19T08:09:11.253814+0000","last_active":"2024-09-19T08:11:01.898887+0000","last_peered":"2024-09-19T08:11:01.898887+0000","last_clean":"2024-09-19T08:11:01.898887+0000","last_became_active":"2024-09-19T08:09:11.253490+0000","last_became_peered":"2024-09-19T08:09:11.253490+0000","last_unstale":"2024-09-19T08:11:01.898887+0000","last_undegraded":"2024-09-19T08:11:01.898887+0000","last_fullsized":"2024-09-19T08:11:01.898887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:09.287110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898591+0000","last_change":"2024-09-19T08:09:09.114820+0000","last_active":"2024-09-19T08:11:01.898591+0000","last_peered":"2024-09-19T08:11:01.898591+0000","last_clean":"2024-09-19T08:11:01.898591+0000","last_became_active":"2024-09-19T08:09:09.114478+0000","last_became_peered":"2024-09-19T08:09:09.114478+0000","last_unstale":"2024-09-19T08:11:01.898591+0000","last_undegraded":"2024-09-19T08:11:01.898591+0000","last_fullsized":"2024-09-19T08:11:01.898591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:24.243629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898477+0000","last_change":"2024-09-19T08:10:14.789301+0000","last_active":"2024-09-19T08:11:01.898477+0000","last_peered":"2024-09-19T08:11:01.898477+0000","last_clean":"2024-09-19T08:11:01.898477+0000","last_became_active":"2024-09-19T08:10:14.788891+0000","last_became_peered":"2024-09-19T08:10:14.788891+0000","last_unstale":"2024-09-19T08:11:01.898477+0000","last_undegraded":"2024-09-19T08:11:01.898477+0000","last_fullsized":"2024-09-19T08:11:01.898477+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:03.142177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244400+0000","last_change":"2024-09-19T08:10:14.799207+0000","last_active":"2024-09-19T08:11:02.244400+0000","last_peered":"2024-09-19T08:11:02.244400+0000","last_clean":"2024-09-19T08:11:02.244400+0000","last_became_active":"2024-09-19T08:10:14.787612+0000","last_became_peered":"2024-09-19T08:10:14.787612+0000","last_unstale":"2024-09-19T08:11:02.244400+0000","last_undegraded":"2024-09-19T08:11:02.244400+0000","last_fullsized":"2024-09-19T08:11:02.244400+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:45.997778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327130+0000","last_change":"2024-09-19T08:09:11.245399+0000","last_active":"2024-09-19T08:11:01.327130+0000","last_peered":"2024-09-19T08:11:01.327130+0000","last_clean":"2024-09-19T08:11:01.327130+0000","last_became_active":"2024-09-19T08:09:11.245055+0000","last_became_peered":"2024-09-19T08:09:11.245055+0000","last_unstale":"2024-09-19T08:11:01.327130+0000","last_undegraded":"2024-09-19T08:11:01.327130+0000","last_fullsized":"2024-09-19T08:11:01.327130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:57.639205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413806+0000","last_change":"2024-09-19T08:09:09.115252+0000","last_active":"2024-09-19T08:11:01.413806+0000","last_peered":"2024-09-19T08:11:01.413806+0000","last_clean":"2024-09-19T08:11:01.413806+0000","last_became_active":"2024-09-19T08:09:09.114908+0000","last_became_peered":"2024-09-19T08:09:09.114908+0000","last_unstale":"2024-09-19T08:11:01.413806+0000","last_undegraded":"2024-09-19T08:11:01.413806+0000","last_fullsized":"2024-09-19T08:11:01.413806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:48.326221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244581+0000","last_change":"2024-09-19T08:09:11.249189+0000","last_active":"2024-09-19T08:11:02.244581+0000","last_peered":"2024-09-19T08:11:02.244581+0000","last_clean":"2024-09-19T08:11:02.244581+0000","last_became_active":"2024-09-19T08:09:11.248797+0000","last_became_peered":"2024-09-19T08:09:11.248797+0000","last_unstale":"2024-09-19T08:11:02.244581+0000","last_undegraded":"2024-09-19T08:11:02.244581+0000","last_fullsized":"2024-09-19T08:11:02.244581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:20.915638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324421+0000","last_change":"2024-09-19T08:09:09.112973+0000","last_active":"2024-09-19T08:11:01.324421+0000","last_peered":"2024-09-19T08:11:01.324421+0000","last_clean":"2024-09-19T08:11:01.324421+0000","last_became_active":"2024-09-19T08:09:09.112616+0000","last_became_peered":"2024-09-19T08:09:09.112616+0000","last_unstale":"2024-09-19T08:11:01.324421+0000","last_undegraded":"2024-09-19T08:11:01.324421+0000","last_fullsized":"2024-09-19T08:11:01.324421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:13.791926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899227+0000","last_change":"2024-09-19T08:09:11.240739+0000","last_active":"2024-09-19T08:11:01.899227+0000","last_peered":"2024-09-19T08:11:01.899227+0000","last_clean":"2024-09-19T08:11:01.899227+0000","last_became_active":"2024-09-19T08:09:11.240340+0000","last_became_peered":"2024-09-19T08:09:11.240340+0000","last_unstale":"2024-09-19T08:11:01.899227+0000","last_undegraded":"2024-09-19T08:11:01.899227+0000","last_fullsized":"2024-09-19T08:11:01.899227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:35.450279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'39","reported_seq":71,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.551893+0000","last_change":"2024-09-19T08:09:09.112516+0000","last_active":"2024-09-19T08:11:01.551893+0000","last_peered":"2024-09-19T08:11:01.551893+0000","last_clean":"2024-09-19T08:11:01.551893+0000","last_became_active":"2024-09-19T08:09:09.112140+0000","last_became_peered":"2024-09-19T08:09:09.112140+0000","last_unstale":"2024-09-19T08:11:01.551893+0000","last_undegraded":"2024-09-19T08:11:01.551893+0000","last_fullsized":"2024-09-19T08:11:01.551893+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:05.434331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899052+0000","last_change":"2024-09-19T08:09:11.252163+0000","last_active":"2024-09-19T08:11:01.899052+0000","last_peered":"2024-09-19T08:11:01.899052+0000","last_clean":"2024-09-19T08:11:01.899052+0000","last_became_active":"2024-09-19T08:09:11.251762+0000","last_became_peered":"2024-09-19T08:09:11.251762+0000","last_unstale":"2024-09-19T08:11:01.899052+0000","last_undegraded":"2024-09-19T08:11:01.899052+0000","last_fullsized":"2024-09-19T08:11:01.899052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:33.941910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898722+0000","last_change":"2024-09-19T08:10:14.788460+0000","last_active":"2024-09-19T08:11:01.898722+0000","last_peered":"2024-09-19T08:11:01.898722+0000","last_clean":"2024-09-19T08:11:01.898722+0000","last_became_active":"2024-09-19T08:10:14.787990+0000","last_became_peered":"2024-09-19T08:10:14.787990+0000","last_unstale":"2024-09-19T08:11:01.898722+0000","last_undegraded":"2024-09-19T08:11:01.898722+0000","last_fullsized":"2024-09-19T08:11:01.898722+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:24.549994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899257+0000","last_change":"2024-09-19T08:09:11.242438+0000","last_active":"2024-09-19T08:11:01.899257+0000","last_peered":"2024-09-19T08:11:01.899257+0000","last_clean":"2024-09-19T08:11:01.899257+0000","last_became_active":"2024-09-19T08:09:11.242114+0000","last_became_peered":"2024-09-19T08:09:11.242114+0000","last_unstale":"2024-09-19T08:11:01.899257+0000","last_undegraded":"2024-09-19T08:11:01.899257+0000","last_fullsized":"2024-09-19T08:11:01.899257+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:54.183012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":348,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898629+0000","last_change":"2024-09-19T08:07:55.287566+0000","last_active":"2024-09-19T08:11:01.898629+0000","last_peered":"2024-09-19T08:11:01.898629+0000","last_clean":"2024-09-19T08:11:01.898629+0000","last_became_active":"2024-09-19T08:07:55.287037+0000","last_became_peered":"2024-09-19T08:07:55.287037+0000","last_unstale":"2024-09-19T08:11:01.898629+0000","last_undegraded":"2024-09-19T08:11:01.898629+0000","last_fullsized":"2024-09-19T08:11:01.898629+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_clean_scrub_stamp":"2024-09-19T08:04:29.468857+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:49.553882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898721+0000","last_change":"2024-09-19T08:09:09.113497+0000","last_active":"2024-09-19T08:11:01.898721+0000","last_peered":"2024-09-19T08:11:01.898721+0000","last_clean":"2024-09-19T08:11:01.898721+0000","last_became_active":"2024-09-19T08:09:09.112546+0000","last_became_peered":"2024-09-19T08:09:09.112546+0000","last_unstale":"2024-09-19T08:11:01.898721+0000","last_undegraded":"2024-09-19T08:11:01.898721+0000","last_fullsized":"2024-09-19T08:11:01.898721+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:09.906476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414661+0000","last_change":"2024-09-19T08:09:11.241478+0000","last_active":"2024-09-19T08:11:01.414661+0000","last_peered":"2024-09-19T08:11:01.414661+0000","last_clean":"2024-09-19T08:11:01.414661+0000","last_became_active":"2024-09-19T08:09:11.241138+0000","last_became_peered":"2024-09-19T08:09:11.241138+0000","last_unstale":"2024-09-19T08:11:01.414661+0000","last_undegraded":"2024-09-19T08:11:01.414661+0000","last_fullsized":"2024-09-19T08:11:01.414661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:32.884491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898598+0000","last_change":"2024-09-19T08:09:09.116571+0000","last_active":"2024-09-19T08:11:01.898598+0000","last_peered":"2024-09-19T08:11:01.898598+0000","last_clean":"2024-09-19T08:11:01.898598+0000","last_became_active":"2024-09-19T08:09:09.116180+0000","last_became_peered":"2024-09-19T08:09:09.116180+0000","last_unstale":"2024-09-19T08:11:01.898598+0000","last_undegraded":"2024-09-19T08:11:01.898598+0000","last_fullsized":"2024-09-19T08:11:01.898598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:58.577320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323834+0000","last_change":"2024-09-19T08:10:14.791196+0000","last_active":"2024-09-19T08:11:01.323834+0000","last_peered":"2024-09-19T08:11:01.323834+0000","last_clean":"2024-09-19T08:11:01.323834+0000","last_became_active":"2024-09-19T08:10:14.790873+0000","last_became_peered":"2024-09-19T08:10:14.790873+0000","last_unstale":"2024-09-19T08:11:01.323834+0000","last_undegraded":"2024-09-19T08:11:01.323834+0000","last_fullsized":"2024-09-19T08:11:01.323834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:41.725521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323966+0000","last_change":"2024-09-19T08:09:09.242166+0000","last_active":"2024-09-19T08:11:01.323966+0000","last_peered":"2024-09-19T08:11:01.323966+0000","last_clean":"2024-09-19T08:11:01.323966+0000","last_became_active":"2024-09-19T08:09:09.241270+0000","last_became_peered":"2024-09-19T08:09:09.241270+0000","last_unstale":"2024-09-19T08:11:01.323966+0000","last_undegraded":"2024-09-19T08:11:01.323966+0000","last_fullsized":"2024-09-19T08:11:01.323966+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:51.899069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327090+0000","last_change":"2024-09-19T08:10:14.793572+0000","last_active":"2024-09-19T08:11:01.327090+0000","last_peered":"2024-09-19T08:11:01.327090+0000","last_clean":"2024-09-19T08:11:01.327090+0000","last_became_active":"2024-09-19T08:10:14.793258+0000","last_became_peered":"2024-09-19T08:10:14.793258+0000","last_unstale":"2024-09-19T08:11:01.327090+0000","last_undegraded":"2024-09-19T08:11:01.327090+0000","last_fullsized":"2024-09-19T08:11:01.327090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:53.912430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899060+0000","last_change":"2024-09-19T08:09:09.118790+0000","last_active":"2024-09-19T08:11:01.899060+0000","last_peered":"2024-09-19T08:11:01.899060+0000","last_clean":"2024-09-19T08:11:01.899060+0000","last_became_active":"2024-09-19T08:09:09.117695+0000","last_became_peered":"2024-09-19T08:09:09.117695+0000","last_unstale":"2024-09-19T08:11:01.899060+0000","last_undegraded":"2024-09-19T08:11:01.899060+0000","last_fullsized":"2024-09-19T08:11:01.899060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:40.674039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325589+0000","last_change":"2024-09-19T08:09:11.249386+0000","last_active":"2024-09-19T08:11:01.325589+0000","last_peered":"2024-09-19T08:11:01.325589+0000","last_clean":"2024-09-19T08:11:01.325589+0000","last_became_active":"2024-09-19T08:09:11.249004+0000","last_became_peered":"2024-09-19T08:09:11.249004+0000","last_unstale":"2024-09-19T08:11:01.325589+0000","last_undegraded":"2024-09-19T08:11:01.325589+0000","last_fullsized":"2024-09-19T08:11:01.325589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:50.170799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.410707+0000","last_change":"2024-09-19T08:09:09.241599+0000","last_active":"2024-09-19T08:11:01.410707+0000","last_peered":"2024-09-19T08:11:01.410707+0000","last_clean":"2024-09-19T08:11:01.410707+0000","last_became_active":"2024-09-19T08:09:09.241226+0000","last_became_peered":"2024-09-19T08:09:09.241226+0000","last_unstale":"2024-09-19T08:11:01.410707+0000","last_undegraded":"2024-09-19T08:11:01.410707+0000","last_fullsized":"2024-09-19T08:11:01.410707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:19.590966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325735+0000","last_change":"2024-09-19T08:09:11.238098+0000","last_active":"2024-09-19T08:11:01.325735+0000","last_peered":"2024-09-19T08:11:01.325735+0000","last_clean":"2024-09-19T08:11:01.325735+0000","last_became_active":"2024-09-19T08:09:11.237737+0000","last_became_peered":"2024-09-19T08:09:11.237737+0000","last_unstale":"2024-09-19T08:11:01.325735+0000","last_undegraded":"2024-09-19T08:11:01.325735+0000","last_fullsized":"2024-09-19T08:11:01.325735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:00.134664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413888+0000","last_change":"2024-09-19T08:09:09.241775+0000","last_active":"2024-09-19T08:11:01.413888+0000","last_peered":"2024-09-19T08:11:01.413888+0000","last_clean":"2024-09-19T08:11:01.413888+0000","last_became_active":"2024-09-19T08:09:09.241367+0000","last_became_peered":"2024-09-19T08:09:09.241367+0000","last_unstale":"2024-09-19T08:11:01.413888+0000","last_undegraded":"2024-09-19T08:11:01.413888+0000","last_fullsized":"2024-09-19T08:11:01.413888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:11.862171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324396+0000","last_change":"2024-09-19T08:09:11.251980+0000","last_active":"2024-09-19T08:11:01.324396+0000","last_peered":"2024-09-19T08:11:01.324396+0000","last_clean":"2024-09-19T08:11:01.324396+0000","last_became_active":"2024-09-19T08:09:11.251638+0000","last_became_peered":"2024-09-19T08:09:11.251638+0000","last_unstale":"2024-09-19T08:11:01.324396+0000","last_undegraded":"2024-09-19T08:11:01.324396+0000","last_fullsized":"2024-09-19T08:11:01.324396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:35.905643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'45","reported_seq":92,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.558199+0000","last_change":"2024-09-19T08:09:09.117150+0000","last_active":"2024-09-19T08:11:01.558199+0000","last_peered":"2024-09-19T08:11:01.558199+0000","last_clean":"2024-09-19T08:11:01.558199+0000","last_became_active":"2024-09-19T08:09:09.116763+0000","last_became_peered":"2024-09-19T08:09:09.116763+0000","last_unstale":"2024-09-19T08:11:01.558199+0000","last_undegraded":"2024-09-19T08:11:01.558199+0000","last_fullsized":"2024-09-19T08:11:01.558199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:18.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":82,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.415619+0000","last_change":"2024-09-19T08:09:11.244366+0000","last_active":"2024-09-19T08:11:01.415619+0000","last_peered":"2024-09-19T08:11:01.415619+0000","last_clean":"2024-09-19T08:11:01.415619+0000","last_became_active":"2024-09-19T08:09:11.244023+0000","last_became_peered":"2024-09-19T08:09:11.244023+0000","last_unstale":"2024-09-19T08:11:01.415619+0000","last_undegraded":"2024-09-19T08:11:01.415619+0000","last_fullsized":"2024-09-19T08:11:01.415619+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:18.572377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898860+0000","last_change":"2024-09-19T08:09:09.139557+0000","last_active":"2024-09-19T08:11:01.898860+0000","last_peered":"2024-09-19T08:11:01.898860+0000","last_clean":"2024-09-19T08:11:01.898860+0000","last_became_active":"2024-09-19T08:09:09.139190+0000","last_became_peered":"2024-09-19T08:09:09.139190+0000","last_unstale":"2024-09-19T08:11:01.898860+0000","last_undegraded":"2024-09-19T08:11:01.898860+0000","last_fullsized":"2024-09-19T08:11:01.898860+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:39.270432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898761+0000","last_change":"2024-09-19T08:09:11.249637+0000","last_active":"2024-09-19T08:11:01.898761+0000","last_peered":"2024-09-19T08:11:01.898761+0000","last_clean":"2024-09-19T08:11:01.898761+0000","last_became_active":"2024-09-19T08:09:11.249323+0000","last_became_peered":"2024-09-19T08:09:11.249323+0000","last_unstale":"2024-09-19T08:11:01.898761+0000","last_undegraded":"2024-09-19T08:11:01.898761+0000","last_fullsized":"2024-09-19T08:11:01.898761+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:28.270910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619321+0000","last_change":"2024-09-19T08:09:09.242444+0000","last_active":"2024-09-19T08:11:01.619321+0000","last_peered":"2024-09-19T08:11:01.619321+0000","last_clean":"2024-09-19T08:11:01.619321+0000","last_became_active":"2024-09-19T08:09:09.242095+0000","last_became_peered":"2024-09-19T08:09:09.242095+0000","last_unstale":"2024-09-19T08:11:01.619321+0000","last_undegraded":"2024-09-19T08:11:01.619321+0000","last_fullsized":"2024-09-19T08:11:01.619321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:42.941930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413514+0000","last_change":"2024-09-19T08:09:11.241588+0000","last_active":"2024-09-19T08:11:01.413514+0000","last_peered":"2024-09-19T08:11:01.413514+0000","last_clean":"2024-09-19T08:11:01.413514+0000","last_became_active":"2024-09-19T08:09:11.241076+0000","last_became_peered":"2024-09-19T08:09:11.241076+0000","last_unstale":"2024-09-19T08:11:01.413514+0000","last_undegraded":"2024-09-19T08:11:01.413514+0000","last_fullsized":"2024-09-19T08:11:01.413514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:01.676410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414370+0000","last_change":"2024-09-19T08:09:09.112494+0000","last_active":"2024-09-19T08:11:01.414370+0000","last_peered":"2024-09-19T08:11:01.414370+0000","last_clean":"2024-09-19T08:11:01.414370+0000","last_became_active":"2024-09-19T08:09:09.112019+0000","last_became_peered":"2024-09-19T08:09:09.112019+0000","last_unstale":"2024-09-19T08:11:01.414370+0000","last_undegraded":"2024-09-19T08:11:01.414370+0000","last_fullsized":"2024-09-19T08:11:01.414370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:17.674092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244542+0000","last_change":"2024-09-19T08:09:11.251420+0000","last_active":"2024-09-19T08:11:02.244542+0000","last_peered":"2024-09-19T08:11:02.244542+0000","last_clean":"2024-09-19T08:11:02.244542+0000","last_became_active":"2024-09-19T08:09:11.251083+0000","last_became_peered":"2024-09-19T08:09:11.251083+0000","last_unstale":"2024-09-19T08:11:02.244542+0000","last_undegraded":"2024-09-19T08:11:02.244542+0000","last_fullsized":"2024-09-19T08:11:02.244542+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:38.810616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244424+0000","last_change":"2024-09-19T08:10:14.825972+0000","last_active":"2024-09-19T08:11:02.244424+0000","last_peered":"2024-09-19T08:11:02.244424+0000","last_clean":"2024-09-19T08:11:02.244424+0000","last_became_active":"2024-09-19T08:10:14.825579+0000","last_became_peered":"2024-09-19T08:10:14.825579+0000","last_unstale":"2024-09-19T08:11:02.244424+0000","last_undegraded":"2024-09-19T08:11:02.244424+0000","last_fullsized":"2024-09-19T08:11:02.244424+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:06.708622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414973+0000","last_change":"2024-09-19T08:09:11.239096+0000","last_active":"2024-09-19T08:11:01.414973+0000","last_peered":"2024-09-19T08:11:01.414973+0000","last_clean":"2024-09-19T08:11:01.414973+0000","last_became_active":"2024-09-19T08:09:11.238739+0000","last_became_peered":"2024-09-19T08:09:11.238739+0000","last_unstale":"2024-09-19T08:11:01.414973+0000","last_undegraded":"2024-09-19T08:11:01.414973+0000","last_fullsized":"2024-09-19T08:11:01.414973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:27.161174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413598+0000","last_change":"2024-09-19T08:09:09.115198+0000","last_active":"2024-09-19T08:11:01.413598+0000","last_peered":"2024-09-19T08:11:01.413598+0000","last_clean":"2024-09-19T08:11:01.413598+0000","last_became_active":"2024-09-19T08:09:09.114783+0000","last_became_peered":"2024-09-19T08:09:09.114783+0000","last_unstale":"2024-09-19T08:11:01.413598+0000","last_undegraded":"2024-09-19T08:11:01.413598+0000","last_fullsized":"2024-09-19T08:11:01.413598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:45.674774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898887+0000","last_change":"2024-09-19T08:09:11.252450+0000","last_active":"2024-09-19T08:11:01.898887+0000","last_peered":"2024-09-19T08:11:01.898887+0000","last_clean":"2024-09-19T08:11:01.898887+0000","last_became_active":"2024-09-19T08:09:11.251696+0000","last_became_peered":"2024-09-19T08:09:11.251696+0000","last_unstale":"2024-09-19T08:11:01.898887+0000","last_undegraded":"2024-09-19T08:11:01.898887+0000","last_fullsized":"2024-09-19T08:11:01.898887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:48.179795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327527+0000","last_change":"2024-09-19T08:09:11.244571+0000","last_active":"2024-09-19T08:11:01.327527+0000","last_peered":"2024-09-19T08:11:01.327527+0000","last_clean":"2024-09-19T08:11:01.327527+0000","last_became_active":"2024-09-19T08:09:11.244217+0000","last_became_peered":"2024-09-19T08:09:11.244217+0000","last_unstale":"2024-09-19T08:11:01.327527+0000","last_undegraded":"2024-09-19T08:11:01.327527+0000","last_fullsized":"2024-09-19T08:11:01.327527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:52.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413805+0000","last_change":"2024-09-19T08:09:09.117355+0000","last_active":"2024-09-19T08:11:01.413805+0000","last_peered":"2024-09-19T08:11:01.413805+0000","last_clean":"2024-09-19T08:11:01.413805+0000","last_became_active":"2024-09-19T08:09:09.116806+0000","last_became_peered":"2024-09-19T08:09:09.116806+0000","last_unstale":"2024-09-19T08:11:01.413805+0000","last_undegraded":"2024-09-19T08:11:01.413805+0000","last_fullsized":"2024-09-19T08:11:01.413805+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:42.113015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619575+0000","last_change":"2024-09-19T08:09:11.245745+0000","last_active":"2024-09-19T08:11:01.619575+0000","last_peered":"2024-09-19T08:11:01.619575+0000","last_clean":"2024-09-19T08:11:01.619575+0000","last_became_active":"2024-09-19T08:09:11.245373+0000","last_became_peered":"2024-09-19T08:09:11.245373+0000","last_unstale":"2024-09-19T08:11:01.619575+0000","last_undegraded":"2024-09-19T08:11:01.619575+0000","last_fullsized":"2024-09-19T08:11:01.619575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:56.500738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413790+0000","last_change":"2024-09-19T08:09:09.119550+0000","last_active":"2024-09-19T08:11:01.413790+0000","last_peered":"2024-09-19T08:11:01.413790+0000","last_clean":"2024-09-19T08:11:01.413790+0000","last_became_active":"2024-09-19T08:09:09.119187+0000","last_became_peered":"2024-09-19T08:09:09.119187+0000","last_unstale":"2024-09-19T08:11:01.413790+0000","last_undegraded":"2024-09-19T08:11:01.413790+0000","last_fullsized":"2024-09-19T08:11:01.413790+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:14.629824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898802+0000","last_change":"2024-09-19T08:09:11.245318+0000","last_active":"2024-09-19T08:11:01.898802+0000","last_peered":"2024-09-19T08:11:01.898802+0000","last_clean":"2024-09-19T08:11:01.898802+0000","last_became_active":"2024-09-19T08:09:11.245000+0000","last_became_peered":"2024-09-19T08:09:11.245000+0000","last_unstale":"2024-09-19T08:11:01.898802+0000","last_undegraded":"2024-09-19T08:11:01.898802+0000","last_fullsized":"2024-09-19T08:11:01.898802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:53.590453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.416088+0000","last_change":"2024-09-19T08:09:09.241552+0000","last_active":"2024-09-19T08:11:01.416088+0000","last_peered":"2024-09-19T08:11:01.416088+0000","last_clean":"2024-09-19T08:11:01.416088+0000","last_became_active":"2024-09-19T08:09:09.241201+0000","last_became_peered":"2024-09-19T08:09:09.241201+0000","last_unstale":"2024-09-19T08:11:01.416088+0000","last_undegraded":"2024-09-19T08:11:01.416088+0000","last_fullsized":"2024-09-19T08:11:01.416088+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:09.374532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.415847+0000","last_change":"2024-09-19T08:09:11.246697+0000","last_active":"2024-09-19T08:11:01.415847+0000","last_peered":"2024-09-19T08:11:01.415847+0000","last_clean":"2024-09-19T08:11:01.415847+0000","last_became_active":"2024-09-19T08:09:11.246404+0000","last_became_peered":"2024-09-19T08:09:11.246404+0000","last_unstale":"2024-09-19T08:11:01.415847+0000","last_undegraded":"2024-09-19T08:11:01.415847+0000","last_fullsized":"2024-09-19T08:11:01.415847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.008875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.410864+0000","last_change":"2024-09-19T08:09:09.113401+0000","last_active":"2024-09-19T08:11:01.410864+0000","last_peered":"2024-09-19T08:11:01.410864+0000","last_clean":"2024-09-19T08:11:01.410864+0000","last_became_active":"2024-09-19T08:09:09.113026+0000","last_became_peered":"2024-09-19T08:09:09.113026+0000","last_unstale":"2024-09-19T08:11:01.410864+0000","last_undegraded":"2024-09-19T08:11:01.410864+0000","last_fullsized":"2024-09-19T08:11:01.410864+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:54.740955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595149,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":314,"num_read_kb":260,"num_write":203,"num_write_kb":1407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1785447,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107475,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547236,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":436037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776168,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1069056,"data_stored":1236749,"data_compressed":44853,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939694,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":445517,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168627,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":937984,"data_stored":838755,"data_compressed":22018,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397560,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":1027104,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561085,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":445052,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790018,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":983040,"data_stored":1101658,"data_compressed":41784,"data_compressed_allocated":53248,"data_compressed_original":659456,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953544,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":444957,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":970089,"data_compressed":28174,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":987136,"data_stored":514504,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":514470,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":436127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":524920,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":131782,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":393820,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":393798,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":201329,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:11:04.207 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:11:04.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: [19/Sep/2024:08:11:03] ENGINE Serving on https://172.21.15.27:7150 2024-09-19T08:11:04.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: [19/Sep/2024:08:11:03] ENGINE Bus STARTED 2024-09-19T08:11:04.503 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: [19/Sep/2024:08:11:03] ENGINE Error in HTTPServer.serve 2024-09-19T08:11:04.503 INFO:journalctl@ceph.mon.a.smithi027.stdout: Traceback (most recent call last): 2024-09-19T08:11:04.503 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:11:04.503 INFO:journalctl@ceph.mon.a.smithi027.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:11:04.503 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:11:04.503 INFO:journalctl@ceph.mon.a.smithi027.stdout: self._run(expiration_interval) 2024-09-19T08:11:04.503 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:11:04.503 INFO:journalctl@ceph.mon.a.smithi027.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:11:04.503 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:11:04.503 INFO:journalctl@ceph.mon.a.smithi027.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:11:04.503 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:11:04.504 INFO:journalctl@ceph.mon.a.smithi027.stdout: s = self.context.wrap_socket( 2024-09-19T08:11:04.504 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:11:04.504 INFO:journalctl@ceph.mon.a.smithi027.stdout: return self.sslsocket_class._create( 2024-09-19T08:11:04.504 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:11:04.504 INFO:journalctl@ceph.mon.a.smithi027.stdout: self.do_handshake() 2024-09-19T08:11:04.504 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:11:04.504 INFO:journalctl@ceph.mon.a.smithi027.stdout: self._sslobj.do_handshake() 2024-09-19T08:11:04.504 INFO:journalctl@ceph.mon.a.smithi027.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:11:04.504 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:11:04.504 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.504 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.504 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.504 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.505 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='client.24845 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:11:04.505 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='client.24865 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:11:04.505 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.505 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.505 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.505 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.505 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.505 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.505 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.505 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.505 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.505 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.505 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.505 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.506 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.506 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.506 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.506 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.506 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.506 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.506 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: Adjusting osd_memory_target on smithi203 to 176.0M 2024-09-19T08:11:04.506 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.506 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.506 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: Unable to set osd_memory_target on smithi203 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-19T08:11:04.506 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: Adjusting osd_memory_target on smithi155 to 176.0M 2024-09-19T08:11:04.506 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: Unable to set osd_memory_target on smithi155 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-19T08:11:04.506 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-19T08:11:04.506 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.507 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:04 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.549 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:04.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: [19/Sep/2024:08:11:03] ENGINE Serving on https://172.21.15.27:7150 2024-09-19T08:11:04.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: [19/Sep/2024:08:11:03] ENGINE Bus STARTED 2024-09-19T08:11:04.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: [19/Sep/2024:08:11:03] ENGINE Error in HTTPServer.serve 2024-09-19T08:11:04.738 INFO:journalctl@ceph.mon.b.smithi155.stdout: Traceback (most recent call last): 2024-09-19T08:11:04.738 INFO:journalctl@ceph.mon.b.smithi155.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:11:04.738 INFO:journalctl@ceph.mon.b.smithi155.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:11:04.738 INFO:journalctl@ceph.mon.b.smithi155.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:11:04.738 INFO:journalctl@ceph.mon.b.smithi155.stdout: self._run(expiration_interval) 2024-09-19T08:11:04.738 INFO:journalctl@ceph.mon.b.smithi155.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:11:04.738 INFO:journalctl@ceph.mon.b.smithi155.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:11:04.739 INFO:journalctl@ceph.mon.b.smithi155.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:11:04.739 INFO:journalctl@ceph.mon.b.smithi155.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:11:04.739 INFO:journalctl@ceph.mon.b.smithi155.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:11:04.739 INFO:journalctl@ceph.mon.b.smithi155.stdout: s = self.context.wrap_socket( 2024-09-19T08:11:04.739 INFO:journalctl@ceph.mon.b.smithi155.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:11:04.739 INFO:journalctl@ceph.mon.b.smithi155.stdout: return self.sslsocket_class._create( 2024-09-19T08:11:04.739 INFO:journalctl@ceph.mon.b.smithi155.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:11:04.739 INFO:journalctl@ceph.mon.b.smithi155.stdout: self.do_handshake() 2024-09-19T08:11:04.739 INFO:journalctl@ceph.mon.b.smithi155.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:11:04.739 INFO:journalctl@ceph.mon.b.smithi155.stdout: self._sslobj.do_handshake() 2024-09-19T08:11:04.739 INFO:journalctl@ceph.mon.b.smithi155.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:11:04.739 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:11:04.739 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.740 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.740 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.740 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.740 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='client.24845 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:11:04.740 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='client.24865 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:11:04.740 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.740 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.740 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.740 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.740 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.740 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.740 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.740 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.741 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.741 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.741 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.741 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.741 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.741 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.741 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.741 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.741 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.742 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.742 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: Adjusting osd_memory_target on smithi203 to 176.0M 2024-09-19T08:11:04.742 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.742 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.742 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: Unable to set osd_memory_target on smithi203 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-19T08:11:04.742 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: Adjusting osd_memory_target on smithi155 to 176.0M 2024-09-19T08:11:04.742 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: Unable to set osd_memory_target on smithi155 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-19T08:11:04.742 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-19T08:11:04.742 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.742 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:04 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: [19/Sep/2024:08:11:03] ENGINE Serving on https://172.21.15.27:7150 2024-09-19T08:11:04.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: [19/Sep/2024:08:11:03] ENGINE Bus STARTED 2024-09-19T08:11:04.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: [19/Sep/2024:08:11:03] ENGINE Error in HTTPServer.serve 2024-09-19T08:11:04.758 INFO:journalctl@ceph.mon.c.smithi203.stdout: Traceback (most recent call last): 2024-09-19T08:11:04.759 INFO:journalctl@ceph.mon.c.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:11:04.759 INFO:journalctl@ceph.mon.c.smithi203.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:11:04.759 INFO:journalctl@ceph.mon.c.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:11:04.759 INFO:journalctl@ceph.mon.c.smithi203.stdout: self._run(expiration_interval) 2024-09-19T08:11:04.759 INFO:journalctl@ceph.mon.c.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:11:04.759 INFO:journalctl@ceph.mon.c.smithi203.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:11:04.759 INFO:journalctl@ceph.mon.c.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:11:04.759 INFO:journalctl@ceph.mon.c.smithi203.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:11:04.759 INFO:journalctl@ceph.mon.c.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:11:04.759 INFO:journalctl@ceph.mon.c.smithi203.stdout: s = self.context.wrap_socket( 2024-09-19T08:11:04.759 INFO:journalctl@ceph.mon.c.smithi203.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:11:04.760 INFO:journalctl@ceph.mon.c.smithi203.stdout: return self.sslsocket_class._create( 2024-09-19T08:11:04.760 INFO:journalctl@ceph.mon.c.smithi203.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:11:04.760 INFO:journalctl@ceph.mon.c.smithi203.stdout: self.do_handshake() 2024-09-19T08:11:04.760 INFO:journalctl@ceph.mon.c.smithi203.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:11:04.760 INFO:journalctl@ceph.mon.c.smithi203.stdout: self._sslobj.do_handshake() 2024-09-19T08:11:04.760 INFO:journalctl@ceph.mon.c.smithi203.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:11:04.760 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:11:04.760 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.760 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.760 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.760 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.760 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='client.24845 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:11:04.761 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='client.24865 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:11:04.761 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.761 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.761 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.761 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.761 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.762 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.762 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.762 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.762 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.762 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.762 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.762 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.762 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.762 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.762 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.762 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.762 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.762 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.763 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: Adjusting osd_memory_target on smithi203 to 176.0M 2024-09-19T08:11:04.763 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.763 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:04.763 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: Unable to set osd_memory_target on smithi203 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-19T08:11:04.763 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: Adjusting osd_memory_target on smithi155 to 176.0M 2024-09-19T08:11:04.763 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: Unable to set osd_memory_target on smithi155 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-19T08:11:04.763 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-19T08:11:04.763 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:04.763 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:04 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:05.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.047+0000 7f217d07f640 1 -- 172.21.15.27:0/3340372201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2178103fe0 msgr2=0x7f21781043c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:05.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.047+0000 7f217d07f640 1 --2- 172.21.15.27:0/3340372201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2178103fe0 0x7f21781043c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2168009900 tx=0x7f216802a410 comp rx=0 tx=0).stop 2024-09-19T08:11:05.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.047+0000 7f217d07f640 1 -- 172.21.15.27:0/3340372201 shutdown_connections 2024-09-19T08:11:05.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.047+0000 7f217d07f640 1 --2- 172.21.15.27:0/3340372201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2178109110 0x7f2178110c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:05.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.047+0000 7f217d07f640 1 --2- 172.21.15.27:0/3340372201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2178104990 0x7f21781089e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:05.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.047+0000 7f217d07f640 1 --2- 172.21.15.27:0/3340372201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2178103fe0 0x7f21781043c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:05.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.047+0000 7f217d07f640 1 -- 172.21.15.27:0/3340372201 >> 172.21.15.27:0/3340372201 conn(0x7f21780ffa60 msgr2=0x7f2178101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:05.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.047+0000 7f217d07f640 1 -- 172.21.15.27:0/3340372201 shutdown_connections 2024-09-19T08:11:05.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.047+0000 7f217d07f640 1 -- 172.21.15.27:0/3340372201 wait complete. 2024-09-19T08:11:05.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.048+0000 7f217d07f640 1 Processor -- start 2024-09-19T08:11:05.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.048+0000 7f217d07f640 1 -- start start 2024-09-19T08:11:05.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.048+0000 7f217d07f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2178103fe0 0x7f217819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:05.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.049+0000 7f217d07f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2178104990 0x7f217819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:05.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.049+0000 7f217d07f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2178109110 0x7f217819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:05.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.049+0000 7f217d07f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2178114190 con 0x7f2178109110 2024-09-19T08:11:05.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.049+0000 7f217d07f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2178114010 con 0x7f2178103fe0 2024-09-19T08:11:05.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.049+0000 7f217d07f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2178114310 con 0x7f2178104990 2024-09-19T08:11:05.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.049+0000 7f2176d9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2178103fe0 0x7f217819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:05.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.049+0000 7f217759e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2178109110 0x7f217819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:05.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.049+0000 7f217759e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2178109110 0x7f217819ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35842/0 (socket says 172.21.15.27:35842) 2024-09-19T08:11:05.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.049+0000 7f2176d9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2178103fe0 0x7f217819a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.27:35892/0 (socket says 172.21.15.27:35892) 2024-09-19T08:11:05.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.049+0000 7f217759e640 1 -- 172.21.15.27:0/3552593709 learned_addr learned my addr 172.21.15.27:0/3552593709 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:05.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.049+0000 7f217659c640 1 --2- 172.21.15.27:0/3552593709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2178104990 0x7f217819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:05.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.049+0000 7f217759e640 1 -- 172.21.15.27:0/3552593709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2178104990 msgr2=0x7f217819ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:05.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.049+0000 7f217759e640 1 --2- 172.21.15.27:0/3552593709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2178104990 0x7f217819ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:05.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.049+0000 7f217759e640 1 -- 172.21.15.27:0/3552593709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2178103fe0 msgr2=0x7f217819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:05.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.049+0000 7f217759e640 1 --2- 172.21.15.27:0/3552593709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2178103fe0 0x7f217819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:05.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.049+0000 7f217759e640 1 -- 172.21.15.27:0/3552593709 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217819f5e0 con 0x7f2178109110 2024-09-19T08:11:05.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.049+0000 7f2176d9d640 1 --2- 172.21.15.27:0/3552593709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2178103fe0 0x7f217819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:11:05.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.049+0000 7f217659c640 1 --2- 172.21.15.27:0/3552593709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2178104990 0x7f217819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:05.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.049+0000 7f217759e640 1 --2- 172.21.15.27:0/3552593709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2178109110 0x7f217819ef00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f217000b970 tx=0x7f217000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:05.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.050+0000 7f215ffff640 1 -- 172.21.15.27:0/3552593709 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2170019070 con 0x7f2178109110 2024-09-19T08:11:05.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.050+0000 7f217d07f640 1 -- 172.21.15.27:0/3552593709 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f217819f8d0 con 0x7f2178109110 2024-09-19T08:11:05.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.050+0000 7f215ffff640 1 -- 172.21.15.27:0/3552593709 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f217000cb40 con 0x7f2178109110 2024-09-19T08:11:05.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.050+0000 7f217d07f640 1 -- 172.21.15.27:0/3552593709 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21781a71b0 con 0x7f2178109110 2024-09-19T08:11:05.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.050+0000 7f215ffff640 1 -- 172.21.15.27:0/3552593709 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2170007650 con 0x7f2178109110 2024-09-19T08:11:05.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.051+0000 7f217d07f640 1 -- 172.21.15.27:0/3552593709 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21781043c0 con 0x7f2178109110 2024-09-19T08:11:05.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.053+0000 7f215ffff640 1 -- 172.21.15.27:0/3552593709 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 23) ==== 138475+0+0 (secure 0 0 0) 0x7f217001c070 con 0x7f2178109110 2024-09-19T08:11:05.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.054+0000 7f215ffff640 1 --2- 172.21.15.27:0/3552593709 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f21600a33b0 0x7f21600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:05.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.054+0000 7f215ffff640 1 -- 172.21.15.27:0/3552593709 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f21700cf630 con 0x7f2178109110 2024-09-19T08:11:05.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.054+0000 7f2176d9d640 1 --2- 172.21.15.27:0/3552593709 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f21600a33b0 0x7f21600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:05.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.055+0000 7f2176d9d640 1 --2- 172.21.15.27:0/3552593709 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f21600a33b0 0x7f21600a5870 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2168000c00 tx=0x7f21680058d0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:05.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.057+0000 7f215ffff640 1 -- 172.21.15.27:0/3552593709 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f217009bb20 con 0x7f2178109110 2024-09-19T08:11:05.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.279+0000 7f217d07f640 1 -- 172.21.15.27:0/3552593709 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f217810c350 con 0x7f2178109110 2024-09-19T08:11:05.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.279+0000 7f215ffff640 1 -- 172.21.15.27:0/3552593709 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f2170084e20 con 0x7f2178109110 2024-09-19T08:11:05.279 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:11:05.279 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:11:05.280 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:11:05.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.283+0000 7f217d07f640 1 -- 172.21.15.27:0/3552593709 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f21600a33b0 msgr2=0x7f21600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:05.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.283+0000 7f217d07f640 1 --2- 172.21.15.27:0/3552593709 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f21600a33b0 0x7f21600a5870 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2168000c00 tx=0x7f21680058d0 comp rx=0 tx=0).stop 2024-09-19T08:11:05.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.283+0000 7f217d07f640 1 -- 172.21.15.27:0/3552593709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2178109110 msgr2=0x7f217819ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:05.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.283+0000 7f217d07f640 1 --2- 172.21.15.27:0/3552593709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2178109110 0x7f217819ef00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f217000b970 tx=0x7f217000be30 comp rx=0 tx=0).stop 2024-09-19T08:11:05.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.283+0000 7f217d07f640 1 -- 172.21.15.27:0/3552593709 shutdown_connections 2024-09-19T08:11:05.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.283+0000 7f217d07f640 1 --2- 172.21.15.27:0/3552593709 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f21600a33b0 0x7f21600a5870 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:05.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.283+0000 7f217d07f640 1 --2- 172.21.15.27:0/3552593709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2178109110 0x7f217819ef00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:05.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.283+0000 7f217d07f640 1 --2- 172.21.15.27:0/3552593709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2178104990 0x7f217819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:05.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.283+0000 7f217d07f640 1 --2- 172.21.15.27:0/3552593709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2178103fe0 0x7f217819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:05.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.283+0000 7f217d07f640 1 -- 172.21.15.27:0/3552593709 >> 172.21.15.27:0/3552593709 conn(0x7f21780ffa60 msgr2=0x7f2178100dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:05.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.283+0000 7f217d07f640 1 -- 172.21.15.27:0/3552593709 shutdown_connections 2024-09-19T08:11:05.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:05.283+0000 7f217d07f640 1 -- 172.21.15.27:0/3552593709 wait complete. 2024-09-19T08:11:05.614 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:05 smithi027 ceph-mon[31209]: from='client.24871 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:11:05.614 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:05 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3552593709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:05.614 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:05 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:05.614 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:05 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:05.614 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:05 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.615 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:05 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.615 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:05 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.615 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:05 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.615 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:05 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.615 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:05 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.615 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:05 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.615 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:05 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.615 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:05 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:11:05.615 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:05 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:11:05.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:05 smithi155 ceph-mon[35362]: from='client.24871 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:11:05.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:05 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3552593709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:05.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:05 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:05.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:05 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:05.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:05 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:05 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:05 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:05 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:05 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:05 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:05 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:05 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:05 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:11:05.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:05 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:11:05.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:05 smithi203 ceph-mon[35198]: from='client.24871 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:11:05.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:05 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3552593709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:05.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:05 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:05.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:05 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:05.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:05 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:05 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:05 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:05 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:05 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:05 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:05 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:05 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:11:05.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:05 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:11:05.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:05 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:11:06.129 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:11:06.406 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:06.697 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: Adjusting osd_memory_target on smithi027 to 176.0M 2024-09-19T08:11:06.697 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: Unable to set osd_memory_target on smithi027 to 184555212: error parsing value: Value '184555212' is below minimum 939524096 2024-09-19T08:11:06.697 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-19T08:11:06.697 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-19T08:11:06.697 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-19T08:11:06.697 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:11:06.698 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: Updating smithi027:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:11:06.698 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: Updating smithi155:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:11:06.698 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: Updating smithi203:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:11:06.698 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: Updating smithi027:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:11:06.698 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:11:06.698 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:11:06.698 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: Updating smithi027:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:11:06.698 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: Updating smithi203:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:11:06.698 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: Updating smithi155:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:11:06.698 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.698 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.698 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.698 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: mgrmap e24: x(active, since 5s), standbys: y, z 2024-09-19T08:11:06.699 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.699 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.699 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.699 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:06 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: Adjusting osd_memory_target on smithi027 to 176.0M 2024-09-19T08:11:06.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: Unable to set osd_memory_target on smithi027 to 184555212: error parsing value: Value '184555212' is below minimum 939524096 2024-09-19T08:11:06.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-19T08:11:06.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-19T08:11:06.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-19T08:11:06.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:11:06.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: Updating smithi027:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:11:06.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: Updating smithi155:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:11:06.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: Updating smithi203:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:11:06.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: Updating smithi027:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:11:06.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:11:06.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:11:06.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: Updating smithi027:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:11:06.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: Updating smithi203:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:11:06.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: Updating smithi155:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:11:06.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.738 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.739 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: mgrmap e24: x(active, since 5s), standbys: y, z 2024-09-19T08:11:06.739 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.739 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.739 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.739 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:06 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: Adjusting osd_memory_target on smithi027 to 176.0M 2024-09-19T08:11:06.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: Unable to set osd_memory_target on smithi027 to 184555212: error parsing value: Value '184555212' is below minimum 939524096 2024-09-19T08:11:06.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-19T08:11:06.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-19T08:11:06.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-19T08:11:06.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:11:06.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: Updating smithi027:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:11:06.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: Updating smithi155:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:11:06.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: Updating smithi203:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:11:06.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: Updating smithi027:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:11:06.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:11:06.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:11:06.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: Updating smithi027:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:11:06.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: Updating smithi203:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:11:06.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: Updating smithi155:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:11:06.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.760 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: mgrmap e24: x(active, since 5s), standbys: y, z 2024-09-19T08:11:06.760 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.760 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.760 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.760 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:06 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:06.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.914+0000 7fe2b0155640 1 -- 172.21.15.27:0/2252521154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2a810c1a0 msgr2=0x7fe2a810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:06.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.914+0000 7fe2b0155640 1 --2- 172.21.15.27:0/2252521154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2a810c1a0 0x7fe2a810e610 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0009ca0 tx=0x7fe2a002a950 comp rx=0 tx=0).stop 2024-09-19T08:11:06.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.914+0000 7fe2b0155640 1 -- 172.21.15.27:0/2252521154 shutdown_connections 2024-09-19T08:11:06.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.914+0000 7fe2b0155640 1 --2- 172.21.15.27:0/2252521154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2a810c1a0 0x7fe2a810e610 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:06.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.914+0000 7fe2b0155640 1 --2- 172.21.15.27:0/2252521154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2a8103720 0x7fe2a810bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:06.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.914+0000 7fe2b0155640 1 --2- 172.21.15.27:0/2252521154 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2a8102e00 0x7fe2a81031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:06.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.914+0000 7fe2b0155640 1 -- 172.21.15.27:0/2252521154 >> 172.21.15.27:0/2252521154 conn(0x7fe2a80fc7a0 msgr2=0x7fe2a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:06.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.914+0000 7fe2b0155640 1 -- 172.21.15.27:0/2252521154 shutdown_connections 2024-09-19T08:11:06.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.914+0000 7fe2b0155640 1 -- 172.21.15.27:0/2252521154 wait complete. 2024-09-19T08:11:06.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.914+0000 7fe2b0155640 1 Processor -- start 2024-09-19T08:11:06.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.915+0000 7fe2b0155640 1 -- start start 2024-09-19T08:11:06.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.915+0000 7fe2b0155640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2a8102e00 0x7fe2a8198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:06.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.915+0000 7fe2b0155640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2a8103720 0x7fe2a81989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:06.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.915+0000 7fe2b0155640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2a810c1a0 0x7fe2a819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:06.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.915+0000 7fe2b0155640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a8111fd0 con 0x7fe2a810c1a0 2024-09-19T08:11:06.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.915+0000 7fe2b0155640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a8111e50 con 0x7fe2a8103720 2024-09-19T08:11:06.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.915+0000 7fe2b0155640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a8112150 con 0x7fe2a8102e00 2024-09-19T08:11:06.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.915+0000 7fe2ae6f2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2a810c1a0 0x7fe2a819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:06.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.915+0000 7fe2ae6f2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2a810c1a0 0x7fe2a819cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35858/0 (socket says 172.21.15.27:35858) 2024-09-19T08:11:06.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.915+0000 7fe2ae6f2640 1 -- 172.21.15.27:0/3738390111 learned_addr learned my addr 172.21.15.27:0/3738390111 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:06.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.915+0000 7fe2adef1640 1 --2- 172.21.15.27:0/3738390111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2a8102e00 0x7fe2a8198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:06.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.915+0000 7fe2ae6f2640 1 -- 172.21.15.27:0/3738390111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2a8102e00 msgr2=0x7fe2a8198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:06.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.915+0000 7fe2ae6f2640 1 --2- 172.21.15.27:0/3738390111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2a8102e00 0x7fe2a8198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:06.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.915+0000 7fe2ae6f2640 1 -- 172.21.15.27:0/3738390111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2a8103720 msgr2=0x7fe2a81989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:06.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.915+0000 7fe2ae6f2640 1 --2- 172.21.15.27:0/3738390111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2a8103720 0x7fe2a81989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:06.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.915+0000 7fe2ae6f2640 1 -- 172.21.15.27:0/3738390111 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a819d440 con 0x7fe2a810c1a0 2024-09-19T08:11:06.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.916+0000 7fe2ae6f2640 1 --2- 172.21.15.27:0/3738390111 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2a810c1a0 0x7fe2a819cd60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe2a002ae70 tx=0x7fe2a002f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:06.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.916+0000 7fe29effd640 1 -- 172.21.15.27:0/3738390111 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0034040 con 0x7fe2a810c1a0 2024-09-19T08:11:06.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.916+0000 7fe2b0155640 1 -- 172.21.15.27:0/3738390111 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a819d6d0 con 0x7fe2a810c1a0 2024-09-19T08:11:06.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.916+0000 7fe29effd640 1 -- 172.21.15.27:0/3738390111 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2a0030920 con 0x7fe2a810c1a0 2024-09-19T08:11:06.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.916+0000 7fe29effd640 1 -- 172.21.15.27:0/3738390111 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0045480 con 0x7fe2a810c1a0 2024-09-19T08:11:06.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.916+0000 7fe2b0155640 1 -- 172.21.15.27:0/3738390111 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a81a5010 con 0x7fe2a810c1a0 2024-09-19T08:11:06.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.917+0000 7fe2b0155640 1 -- 172.21.15.27:0/3738390111 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2a81031e0 con 0x7fe2a810c1a0 2024-09-19T08:11:06.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.918+0000 7fe29effd640 1 -- 172.21.15.27:0/3738390111 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fe2a0037020 con 0x7fe2a810c1a0 2024-09-19T08:11:06.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.919+0000 7fe29effd640 1 --2- 172.21.15.27:0/3738390111 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe2940a34c0 0x7fe2940a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:06.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.919+0000 7fe2adef1640 1 --2- 172.21.15.27:0/3738390111 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe2940a34c0 0x7fe2940a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:06.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.919+0000 7fe29effd640 1 -- 172.21.15.27:0/3738390111 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fe2a00f0ee0 con 0x7fe2a810c1a0 2024-09-19T08:11:06.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.919+0000 7fe2adef1640 1 --2- 172.21.15.27:0/3738390111 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe2940a34c0 0x7fe2940a5980 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4005fd0 tx=0x7fe2a4005850 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:06.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:06.922+0000 7fe29effd640 1 -- 172.21.15.27:0/3738390111 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe2a0081210 con 0x7fe2a810c1a0 2024-09-19T08:11:07.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.102+0000 7fe2b0155640 1 -- 172.21.15.27:0/3738390111 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2a81997f0 con 0x7fe2a810c1a0 2024-09-19T08:11:07.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.103+0000 7fe29effd640 1 -- 172.21.15.27:0/3738390111 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+23027 (secure 0 0 0) 0x7fe2a81997f0 con 0x7fe2a810c1a0 2024-09-19T08:11:07.103 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:11:07.103 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":84,"fsid":"35b531b0-765d-11ef-bceb-c7b262605968","created":"2024-09-19T08:01:20.929241+0000","modified":"2024-09-19T08:11:01.318508+0000","last_up_change":"2024-09-19T08:08:17.919001+0000","last_in_change":"2024-09-19T08:07:54.277124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:04:29.312984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:09:08.046858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:09:10.223258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66fd6732-4cac-4eda-bf06-50638995ee80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6803","nonce":3645201250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6805","nonce":3645201250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6809","nonce":3645201250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6807","nonce":3645201250}]},"public_addr":"172.21.15.27:6803/3645201250","cluster_addr":"172.21.15.27:6805/3645201250","heartbeat_back_addr":"172.21.15.27:6809/3645201250","heartbeat_front_addr":"172.21.15.27:6807/3645201250","state":["exists","up"]},{"osd":1,"uuid":"36628767-66ac-433b-938e-10e75b51a877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6801","nonce":3977510449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6803","nonce":3977510449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6807","nonce":3977510449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6805","nonce":3977510449}]},"public_addr":"172.21.15.155:6801/3977510449","cluster_addr":"172.21.15.155:6803/3977510449","heartbeat_back_addr":"172.21.15.155:6807/3977510449","heartbeat_front_addr":"172.21.15.155:6805/3977510449","state":["exists","up"]},{"osd":2,"uuid":"3dc80404-a56b-456a-af02-f01e9c6c6dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6801","nonce":3796057016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6803","nonce":3796057016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6807","nonce":3796057016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6805","nonce":3796057016}]},"public_addr":"172.21.15.203:6801/3796057016","cluster_addr":"172.21.15.203:6803/3796057016","heartbeat_back_addr":"172.21.15.203:6807/3796057016","heartbeat_front_addr":"172.21.15.203:6805/3796057016","state":["exists","up"]},{"osd":3,"uuid":"a51077d0-5e04-49b5-bb3e-91711cc45ff1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6811","nonce":1608304347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6813","nonce":1608304347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6817","nonce":1608304347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6815","nonce":1608304347}]},"public_addr":"172.21.15.27:6811/1608304347","cluster_addr":"172.21.15.27:6813/1608304347","heartbeat_back_addr":"172.21.15.27:6817/1608304347","heartbeat_front_addr":"172.21.15.27:6815/1608304347","state":["exists","up"]},{"osd":4,"uuid":"0df35548-90b4-434d-8d7e-c037072c9ae4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6809","nonce":569913150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6811","nonce":569913150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6815","nonce":569913150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6813","nonce":569913150}]},"public_addr":"172.21.15.155:6809/569913150","cluster_addr":"172.21.15.155:6811/569913150","heartbeat_back_addr":"172.21.15.155:6815/569913150","heartbeat_front_addr":"172.21.15.155:6813/569913150","state":["exists","up"]},{"osd":5,"uuid":"de193c5f-1019-43e5-9f4f-6c2aaa4330e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6809","nonce":991491203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6811","nonce":991491203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6815","nonce":991491203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6813","nonce":991491203}]},"public_addr":"172.21.15.203:6809/991491203","cluster_addr":"172.21.15.203:6811/991491203","heartbeat_back_addr":"172.21.15.203:6815/991491203","heartbeat_front_addr":"172.21.15.203:6813/991491203","state":["exists","up"]},{"osd":6,"uuid":"28938e4f-9f22-466f-8cf7-62ee56a0c926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6819","nonce":3516868131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6821","nonce":3516868131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6825","nonce":3516868131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6823","nonce":3516868131}]},"public_addr":"172.21.15.27:6819/3516868131","cluster_addr":"172.21.15.27:6821/3516868131","heartbeat_back_addr":"172.21.15.27:6825/3516868131","heartbeat_front_addr":"172.21.15.27:6823/3516868131","state":["exists","up"]},{"osd":7,"uuid":"855f1728-be52-4445-8561-a90c08f2b2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6817","nonce":2047506436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6819","nonce":2047506436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6823","nonce":2047506436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6821","nonce":2047506436}]},"public_addr":"172.21.15.155:6817/2047506436","cluster_addr":"172.21.15.155:6819/2047506436","heartbeat_back_addr":"172.21.15.155:6823/2047506436","heartbeat_front_addr":"172.21.15.155:6821/2047506436","state":["exists","up"]},{"osd":8,"uuid":"5d7a8ffd-a039-403e-8b9a-c80e19fd67ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6817","nonce":199970687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6819","nonce":199970687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6823","nonce":199970687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6821","nonce":199970687}]},"public_addr":"172.21.15.203:6817/199970687","cluster_addr":"172.21.15.203:6819/199970687","heartbeat_back_addr":"172.21.15.203:6823/199970687","heartbeat_front_addr":"172.21.15.203:6821/199970687","state":["exists","up"]},{"osd":9,"uuid":"cdb90242-80a1-4cef-b5e3-ddecb05664e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6827","nonce":118390483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6829","nonce":118390483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6833","nonce":118390483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6831","nonce":118390483}]},"public_addr":"172.21.15.27:6827/118390483","cluster_addr":"172.21.15.27:6829/118390483","heartbeat_back_addr":"172.21.15.27:6833/118390483","heartbeat_front_addr":"172.21.15.27:6831/118390483","state":["exists","up"]},{"osd":10,"uuid":"c7f4c9da-d913-47a5-8629-53de21efe8c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6825","nonce":1687418565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6827","nonce":1687418565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6831","nonce":1687418565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6829","nonce":1687418565}]},"public_addr":"172.21.15.155:6825/1687418565","cluster_addr":"172.21.15.155:6827/1687418565","heartbeat_back_addr":"172.21.15.155:6831/1687418565","heartbeat_front_addr":"172.21.15.155:6829/1687418565","state":["exists","up"]},{"osd":11,"uuid":"45c11a90-585e-46fa-a5a0-51a29e29eba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6825","nonce":224768827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6827","nonce":224768827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6831","nonce":224768827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6829","nonce":224768827}]},"public_addr":"172.21.15.203:6825/224768827","cluster_addr":"172.21.15.203:6827/224768827","heartbeat_back_addr":"172.21.15.203:6831/224768827","heartbeat_front_addr":"172.21.15.203:6829/224768827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:03:35.559549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:00.526006+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:25.809346+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:51.889445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:17.246017+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:43.515854+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:08.638182+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:34.653060+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:59.469837+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:26.122937+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:50.196159+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:08:16.245770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/4099657868":"2024-09-20T08:11:01.318464+0000","172.21.15.27:0/913696111":"2024-09-20T08:11:01.318464+0000","172.21.15.27:0/1717932879":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6800/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/1963219497":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/416476667":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/1908865720":"2024-09-20T08:02:12.808047+0000","172.21.15.27:6801/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1174736321":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/958829150":"2024-09-20T08:02:12.808047+0000","172.21.15.27:6800/4220278108":"2024-09-20T08:11:01.318464+0000","172.21.15.27:6800/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/3419400802":"2024-09-20T08:11:01.318464+0000","172.21.15.27:0/1827043850":"2024-09-20T08:11:01.318464+0000","172.21.15.27:6801/4220278108":"2024-09-20T08:11:01.318464+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:11:07.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.105+0000 7fe2b0155640 1 -- 172.21.15.27:0/3738390111 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe2940a34c0 msgr2=0x7fe2940a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:07.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.105+0000 7fe2b0155640 1 --2- 172.21.15.27:0/3738390111 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe2940a34c0 0x7fe2940a5980 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4005fd0 tx=0x7fe2a4005850 comp rx=0 tx=0).stop 2024-09-19T08:11:07.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.105+0000 7fe2b0155640 1 -- 172.21.15.27:0/3738390111 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2a810c1a0 msgr2=0x7fe2a819cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:07.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.105+0000 7fe2b0155640 1 --2- 172.21.15.27:0/3738390111 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2a810c1a0 0x7fe2a819cd60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe2a002ae70 tx=0x7fe2a002f5b0 comp rx=0 tx=0).stop 2024-09-19T08:11:07.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.105+0000 7fe2b0155640 1 -- 172.21.15.27:0/3738390111 shutdown_connections 2024-09-19T08:11:07.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.105+0000 7fe2b0155640 1 --2- 172.21.15.27:0/3738390111 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe2940a34c0 0x7fe2940a5980 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:07.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.105+0000 7fe2b0155640 1 --2- 172.21.15.27:0/3738390111 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2a810c1a0 0x7fe2a819cd60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:07.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.105+0000 7fe2b0155640 1 --2- 172.21.15.27:0/3738390111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2a8103720 0x7fe2a81989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:07.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.105+0000 7fe2b0155640 1 --2- 172.21.15.27:0/3738390111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2a8102e00 0x7fe2a8198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:07.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.105+0000 7fe2b0155640 1 -- 172.21.15.27:0/3738390111 >> 172.21.15.27:0/3738390111 conn(0x7fe2a80fc7a0 msgr2=0x7fe2a80fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:07.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.105+0000 7fe2b0155640 1 -- 172.21.15.27:0/3738390111 shutdown_connections 2024-09-19T08:11:07.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.105+0000 7fe2b0155640 1 -- 172.21.15.27:0/3738390111 wait complete. 2024-09-19T08:11:07.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:07 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:11:07.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:07 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:11:07.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:07 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:11:07.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:07 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:07.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:07 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3738390111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:11:07.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:07 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:11:07.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:07 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:11:07.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:07 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:11:07.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:07 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:07.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:07 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3738390111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:11:07.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:07 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:11:07.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:07 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:11:07.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:07 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:11:07.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:07 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:07.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:07 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3738390111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:11:07.875 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T08:11:07.875 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T08:11:07.883 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T08:11:07.884 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi027.front.sepia.ceph.com 2024-09-19T08:11:07.884 DEBUG:teuthology.orchestra.run.smithi027:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-19T08:11:07.884 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T08:11:07.884 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:11:07.884 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:11:07.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.995+0000 7f49d7178640 1 -- 172.21.15.27:0/1050462870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d0102c80 msgr2=0x7f49d0103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:07.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.995+0000 7f49d7178640 1 --2- 172.21.15.27:0/1050462870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d0102c80 0x7f49d0103060 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009900 tx=0x7f49c402a480 comp rx=0 tx=0).stop 2024-09-19T08:11:07.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.995+0000 7f49d7178640 1 -- 172.21.15.27:0/1050462870 shutdown_connections 2024-09-19T08:11:07.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.995+0000 7f49d7178640 1 --2- 172.21.15.27:0/1050462870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49d010c0d0 0x7f49d010e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:07.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.995+0000 7f49d7178640 1 --2- 172.21.15.27:0/1050462870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d01035a0 0x7f49d010ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:07.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.995+0000 7f49d7178640 1 --2- 172.21.15.27:0/1050462870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d0102c80 0x7f49d0103060 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:07.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.995+0000 7f49d7178640 1 -- 172.21.15.27:0/1050462870 >> 172.21.15.27:0/1050462870 conn(0x7f49d0077990 msgr2=0x7f49d00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:07.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.995+0000 7f49d7178640 1 -- 172.21.15.27:0/1050462870 shutdown_connections 2024-09-19T08:11:07.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.995+0000 7f49d7178640 1 -- 172.21.15.27:0/1050462870 wait complete. 2024-09-19T08:11:07.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.995+0000 7f49d7178640 1 Processor -- start 2024-09-19T08:11:07.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.995+0000 7f49d7178640 1 -- start start 2024-09-19T08:11:07.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.996+0000 7f49d7178640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49d0102c80 0x7f49d01983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:07.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.996+0000 7f49d7178640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d01035a0 0x7f49d01988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:07.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.996+0000 7f49d7178640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d010c0d0 0x7f49d019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:07.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.996+0000 7f49d7178640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f49d0111eb0 con 0x7f49d01035a0 2024-09-19T08:11:07.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.996+0000 7f49d7178640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f49d0111d30 con 0x7f49d010c0d0 2024-09-19T08:11:07.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.996+0000 7f49d7178640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f49d0112030 con 0x7f49d0102c80 2024-09-19T08:11:07.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.996+0000 7f49cffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d01035a0 0x7f49d01988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:07.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.996+0000 7f49cffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d01035a0 0x7f49d01988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35874/0 (socket says 172.21.15.27:35874) 2024-09-19T08:11:07.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.996+0000 7f49cffff640 1 -- 172.21.15.27:0/3306741299 learned_addr learned my addr 172.21.15.27:0/3306741299 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:07.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.996+0000 7f49d5715640 1 --2- 172.21.15.27:0/3306741299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d010c0d0 0x7f49d019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:07.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.996+0000 7f49d4f14640 1 --2- 172.21.15.27:0/3306741299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49d0102c80 0x7f49d01983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:07.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.996+0000 7f49cffff640 1 -- 172.21.15.27:0/3306741299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49d0102c80 msgr2=0x7f49d01983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:07.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.996+0000 7f49cffff640 1 --2- 172.21.15.27:0/3306741299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49d0102c80 0x7f49d01983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:07.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.996+0000 7f49cffff640 1 -- 172.21.15.27:0/3306741299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d010c0d0 msgr2=0x7f49d019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:07.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.996+0000 7f49cffff640 1 --2- 172.21.15.27:0/3306741299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d010c0d0 0x7f49d019cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:07.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.996+0000 7f49cffff640 1 -- 172.21.15.27:0/3306741299 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d019d390 con 0x7f49d01035a0 2024-09-19T08:11:07.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.996+0000 7f49cffff640 1 --2- 172.21.15.27:0/3306741299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d01035a0 0x7f49d01988e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00d740 tx=0x7f49bc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:07.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.996+0000 7f49cdffb640 1 -- 172.21.15.27:0/3306741299 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc017070 con 0x7f49d01035a0 2024-09-19T08:11:07.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.997+0000 7f49d7178640 1 -- 172.21.15.27:0/3306741299 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d019d680 con 0x7f49d01035a0 2024-09-19T08:11:07.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.997+0000 7f49cdffb640 1 -- 172.21.15.27:0/3306741299 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49bc00de50 con 0x7f49d01035a0 2024-09-19T08:11:07.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.997+0000 7f49cdffb640 1 -- 172.21.15.27:0/3306741299 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc00f620 con 0x7f49d01035a0 2024-09-19T08:11:07.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.997+0000 7f49d7178640 1 -- 172.21.15.27:0/3306741299 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d01a4f10 con 0x7f49d01035a0 2024-09-19T08:11:07.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.998+0000 7f49d7178640 1 -- 172.21.15.27:0/3306741299 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49d0103060 con 0x7f49d01035a0 2024-09-19T08:11:08.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:07.999+0000 7f49cdffb640 1 -- 172.21.15.27:0/3306741299 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f49bc009c30 con 0x7f49d01035a0 2024-09-19T08:11:08.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.000+0000 7f49cdffb640 1 --2- 172.21.15.27:0/3306741299 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f49c00a3500 0x7f49c00a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.000+0000 7f49d4f14640 1 --2- 172.21.15.27:0/3306741299 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f49c00a3500 0x7f49c00a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.000+0000 7f49cdffb640 1 -- 172.21.15.27:0/3306741299 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f49bc0cfa30 con 0x7f49d01035a0 2024-09-19T08:11:08.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.001+0000 7f49d4f14640 1 --2- 172.21.15.27:0/3306741299 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f49c00a3500 0x7f49c00a59c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f49c4005ab0 tx=0x7f49c4005a20 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:08.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.004+0000 7f49cdffb640 1 -- 172.21.15.27:0/3306741299 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f49bc09c2f0 con 0x7f49d01035a0 2024-09-19T08:11:08.148 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:08.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.191+0000 7f49d7178640 1 -- 172.21.15.27:0/3306741299 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f49d01a5140 con 0x7f49d01035a0 2024-09-19T08:11:08.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.195+0000 7f49cdffb640 1 -- 172.21.15.27:0/3306741299 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v28)=0 v28) ==== 129+0+0 (secure 0 0 0) 0x7f49bc09bbf0 con 0x7f49d01035a0 2024-09-19T08:11:08.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.197+0000 7f49d7178640 1 -- 172.21.15.27:0/3306741299 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f49c00a3500 msgr2=0x7f49c00a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.197+0000 7f49d7178640 1 --2- 172.21.15.27:0/3306741299 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f49c00a3500 0x7f49c00a59c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f49c4005ab0 tx=0x7f49c4005a20 comp rx=0 tx=0).stop 2024-09-19T08:11:08.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.197+0000 7f49d7178640 1 -- 172.21.15.27:0/3306741299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d01035a0 msgr2=0x7f49d01988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.197+0000 7f49d7178640 1 --2- 172.21.15.27:0/3306741299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d01035a0 0x7f49d01988e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00d740 tx=0x7f49bc00dc00 comp rx=0 tx=0).stop 2024-09-19T08:11:08.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.197+0000 7f49d7178640 1 -- 172.21.15.27:0/3306741299 shutdown_connections 2024-09-19T08:11:08.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.197+0000 7f49d7178640 1 --2- 172.21.15.27:0/3306741299 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f49c00a3500 0x7f49c00a59c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.197+0000 7f49d7178640 1 --2- 172.21.15.27:0/3306741299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d010c0d0 0x7f49d019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.197+0000 7f49d7178640 1 --2- 172.21.15.27:0/3306741299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d01035a0 0x7f49d01988e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.197+0000 7f49d7178640 1 --2- 172.21.15.27:0/3306741299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49d0102c80 0x7f49d01983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.197+0000 7f49d7178640 1 -- 172.21.15.27:0/3306741299 >> 172.21.15.27:0/3306741299 conn(0x7f49d0077990 msgr2=0x7f49d00fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:08.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.198+0000 7f49d7178640 1 -- 172.21.15.27:0/3306741299 shutdown_connections 2024-09-19T08:11:08.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.198+0000 7f49d7178640 1 -- 172.21.15.27:0/3306741299 wait complete. 2024-09-19T08:11:08.209 DEBUG:teuthology.orchestra.run.smithi027:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-19T08:11:08.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.316+0000 7f5812d23640 1 -- 172.21.15.27:0/644621942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580c10c0d0 msgr2=0x7f580c10e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.316+0000 7f5812d23640 1 --2- 172.21.15.27:0/644621942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580c10c0d0 0x7f580c10e550 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5804009ca0 tx=0x7f580402a950 comp rx=0 tx=0).stop 2024-09-19T08:11:08.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.316+0000 7f5812d23640 1 -- 172.21.15.27:0/644621942 shutdown_connections 2024-09-19T08:11:08.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.316+0000 7f5812d23640 1 --2- 172.21.15.27:0/644621942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580c10c0d0 0x7f580c10e550 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.316+0000 7f5812d23640 1 --2- 172.21.15.27:0/644621942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f580c1035a0 0x7f580c10ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.316+0000 7f5812d23640 1 --2- 172.21.15.27:0/644621942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f580c102c80 0x7f580c103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.316+0000 7f5812d23640 1 -- 172.21.15.27:0/644621942 >> 172.21.15.27:0/644621942 conn(0x7f580c077990 msgr2=0x7f580c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:08.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.316+0000 7f5812d23640 1 -- 172.21.15.27:0/644621942 shutdown_connections 2024-09-19T08:11:08.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.316+0000 7f5812d23640 1 -- 172.21.15.27:0/644621942 wait complete. 2024-09-19T08:11:08.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.317+0000 7f5812d23640 1 Processor -- start 2024-09-19T08:11:08.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.317+0000 7f5812d23640 1 -- start start 2024-09-19T08:11:08.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.317+0000 7f5812d23640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580c102c80 0x7f580c1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.317+0000 7f5812d23640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f580c1035a0 0x7f580c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.317+0000 7f5812d23640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f580c10c0d0 0x7f580c19cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.317+0000 7f5812d23640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f580c111e90 con 0x7f580c102c80 2024-09-19T08:11:08.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.317+0000 7f5812d23640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f580c111d10 con 0x7f580c1035a0 2024-09-19T08:11:08.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.317+0000 7f5812d23640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f580c112010 con 0x7f580c10c0d0 2024-09-19T08:11:08.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.317+0000 7f5810abf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580c102c80 0x7f580c1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.317+0000 7f5810abf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580c102c80 0x7f580c1982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35890/0 (socket says 172.21.15.27:35890) 2024-09-19T08:11:08.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.317+0000 7f5810abf640 1 -- 172.21.15.27:0/2960199110 learned_addr learned my addr 172.21.15.27:0/2960199110 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:08.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.317+0000 7f580bfff640 1 --2- 172.21.15.27:0/2960199110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f580c1035a0 0x7f580c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.317+0000 7f58112c0640 1 --2- 172.21.15.27:0/2960199110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f580c10c0d0 0x7f580c19cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.317+0000 7f5810abf640 1 -- 172.21.15.27:0/2960199110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f580c10c0d0 msgr2=0x7f580c19cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.317+0000 7f5810abf640 1 --2- 172.21.15.27:0/2960199110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f580c10c0d0 0x7f580c19cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.317+0000 7f5810abf640 1 -- 172.21.15.27:0/2960199110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f580c1035a0 msgr2=0x7f580c198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.317+0000 7f5810abf640 1 --2- 172.21.15.27:0/2960199110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f580c1035a0 0x7f580c198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.317+0000 7f5810abf640 1 -- 172.21.15.27:0/2960199110 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f580c19d2d0 con 0x7f580c102c80 2024-09-19T08:11:08.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.318+0000 7f5810abf640 1 --2- 172.21.15.27:0/2960199110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580c102c80 0x7f580c1982e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f57f400d950 tx=0x7f57f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:08.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.318+0000 7f5809ffb640 1 -- 172.21.15.27:0/2960199110 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f4017030 con 0x7f580c102c80 2024-09-19T08:11:08.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.318+0000 7f5809ffb640 1 -- 172.21.15.27:0/2960199110 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57f4004020 con 0x7f580c102c80 2024-09-19T08:11:08.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.318+0000 7f5812d23640 1 -- 172.21.15.27:0/2960199110 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f580c19d5c0 con 0x7f580c102c80 2024-09-19T08:11:08.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.318+0000 7f5809ffb640 1 -- 172.21.15.27:0/2960199110 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f40047a0 con 0x7f580c102c80 2024-09-19T08:11:08.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.318+0000 7f5812d23640 1 -- 172.21.15.27:0/2960199110 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f580c1a4e50 con 0x7f580c102c80 2024-09-19T08:11:08.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.319+0000 7f5812d23640 1 -- 172.21.15.27:0/2960199110 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f580c103060 con 0x7f580c102c80 2024-09-19T08:11:08.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.320+0000 7f5809ffb640 1 -- 172.21.15.27:0/2960199110 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f57f40041d0 con 0x7f580c102c80 2024-09-19T08:11:08.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.321+0000 7f5809ffb640 1 --2- 172.21.15.27:0/2960199110 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f57f80a3580 0x7f57f80a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.321+0000 7f5809ffb640 1 -- 172.21.15.27:0/2960199110 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f57f40cf720 con 0x7f580c102c80 2024-09-19T08:11:08.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.321+0000 7f580bfff640 1 --2- 172.21.15.27:0/2960199110 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f57f80a3580 0x7f57f80a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.321+0000 7f580bfff640 1 --2- 172.21.15.27:0/2960199110 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f57f80a3580 0x7f57f80a5a40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f580c0fe110 tx=0x7f57fc005f90 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:08.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.325+0000 7f5809ffb640 1 -- 172.21.15.27:0/2960199110 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f57f409bfe0 con 0x7f580c102c80 2024-09-19T08:11:08.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.515+0000 7f5812d23640 1 -- 172.21.15.27:0/2960199110 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f580c1a5190 con 0x7f580c102c80 2024-09-19T08:11:08.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.520+0000 7f5809ffb640 1 -- 172.21.15.27:0/2960199110 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) ==== 138+0+0 (secure 0 0 0) 0x7f57f409b8e0 con 0x7f580c102c80 2024-09-19T08:11:08.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.522+0000 7f5812d23640 1 -- 172.21.15.27:0/2960199110 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f57f80a3580 msgr2=0x7f57f80a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.522+0000 7f5812d23640 1 --2- 172.21.15.27:0/2960199110 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f57f80a3580 0x7f57f80a5a40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f580c0fe110 tx=0x7f57fc005f90 comp rx=0 tx=0).stop 2024-09-19T08:11:08.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.522+0000 7f5812d23640 1 -- 172.21.15.27:0/2960199110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580c102c80 msgr2=0x7f580c1982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.522+0000 7f5812d23640 1 --2- 172.21.15.27:0/2960199110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580c102c80 0x7f580c1982e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f57f400d950 tx=0x7f57f400de10 comp rx=0 tx=0).stop 2024-09-19T08:11:08.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.523+0000 7f5812d23640 1 -- 172.21.15.27:0/2960199110 shutdown_connections 2024-09-19T08:11:08.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.523+0000 7f5812d23640 1 --2- 172.21.15.27:0/2960199110 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f57f80a3580 0x7f57f80a5a40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.523+0000 7f5812d23640 1 --2- 172.21.15.27:0/2960199110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f580c10c0d0 0x7f580c19cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.523+0000 7f5812d23640 1 --2- 172.21.15.27:0/2960199110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f580c1035a0 0x7f580c198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.523+0000 7f5812d23640 1 --2- 172.21.15.27:0/2960199110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580c102c80 0x7f580c1982e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.523+0000 7f5812d23640 1 -- 172.21.15.27:0/2960199110 >> 172.21.15.27:0/2960199110 conn(0x7f580c077990 msgr2=0x7f580c0fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:08.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.523+0000 7f5812d23640 1 -- 172.21.15.27:0/2960199110 shutdown_connections 2024-09-19T08:11:08.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.523+0000 7f5812d23640 1 -- 172.21.15.27:0/2960199110 wait complete. 2024-09-19T08:11:08.534 DEBUG:teuthology.orchestra.run.smithi027:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-19T08:11:08.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.644+0000 7f9c07f31640 1 -- 172.21.15.27:0/2906377994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c00101370 msgr2=0x7f9c0010d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.644+0000 7f9c07f31640 1 --2- 172.21.15.27:0/2906377994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c00101370 0x7f9c0010d8a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8009cd0 tx=0x7f9bf802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.644+0000 7f9c07f31640 1 -- 172.21.15.27:0/2906377994 shutdown_connections 2024-09-19T08:11:08.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.644+0000 7f9c07f31640 1 --2- 172.21.15.27:0/2906377994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c00101370 0x7f9c0010d8a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.644+0000 7f9c07f31640 1 --2- 172.21.15.27:0/2906377994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c001009d0 0x7f9c00100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.644+0000 7f9c07f31640 1 --2- 172.21.15.27:0/2906377994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c001069e0 0x7f9c00106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.644+0000 7f9c07f31640 1 -- 172.21.15.27:0/2906377994 >> 172.21.15.27:0/2906377994 conn(0x7f9c000fc6f0 msgr2=0x7f9c000feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:08.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.644+0000 7f9c07f31640 1 -- 172.21.15.27:0/2906377994 shutdown_connections 2024-09-19T08:11:08.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.644+0000 7f9c07f31640 1 -- 172.21.15.27:0/2906377994 wait complete. 2024-09-19T08:11:08.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.645+0000 7f9c07f31640 1 Processor -- start 2024-09-19T08:11:08.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.645+0000 7f9c07f31640 1 -- start start 2024-09-19T08:11:08.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.645+0000 7f9c07f31640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c001009d0 0x7f9c001982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.645+0000 7f9c07f31640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c00101370 0x7f9c00198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.645+0000 7f9c07f31640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c001069e0 0x7f9c0019cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.645+0000 7f9c07f31640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9c00110e20 con 0x7f9c001009d0 2024-09-19T08:11:08.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.645+0000 7f9c07f31640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9c00110ca0 con 0x7f9c001069e0 2024-09-19T08:11:08.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.645+0000 7f9c07f31640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9c00110fa0 con 0x7f9c00101370 2024-09-19T08:11:08.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.645+0000 7f9c05ccd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c001009d0 0x7f9c001982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.645+0000 7f9c05ccd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c001009d0 0x7f9c001982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35904/0 (socket says 172.21.15.27:35904) 2024-09-19T08:11:08.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.645+0000 7f9c05ccd640 1 -- 172.21.15.27:0/1164577616 learned_addr learned my addr 172.21.15.27:0/1164577616 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:08.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.645+0000 7f9c064ce640 1 --2- 172.21.15.27:0/1164577616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c001069e0 0x7f9c0019cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.645+0000 7f9c054cc640 1 --2- 172.21.15.27:0/1164577616 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c00101370 0x7f9c00198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.645+0000 7f9c05ccd640 1 -- 172.21.15.27:0/1164577616 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c00101370 msgr2=0x7f9c00198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.645+0000 7f9c05ccd640 1 --2- 172.21.15.27:0/1164577616 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c00101370 0x7f9c00198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.645+0000 7f9c05ccd640 1 -- 172.21.15.27:0/1164577616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c001069e0 msgr2=0x7f9c0019cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.645+0000 7f9c05ccd640 1 --2- 172.21.15.27:0/1164577616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c001069e0 0x7f9c0019cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.646+0000 7f9c05ccd640 1 -- 172.21.15.27:0/1164577616 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0019d2d0 con 0x7f9c001009d0 2024-09-19T08:11:08.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.646+0000 7f9c05ccd640 1 --2- 172.21.15.27:0/1164577616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c001009d0 0x7f9c001982e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00c920 tx=0x7f9bfc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:08.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.646+0000 7f9bf6ffd640 1 -- 172.21.15.27:0/1164577616 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc007c70 con 0x7f9c001009d0 2024-09-19T08:11:08.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.646+0000 7f9bf6ffd640 1 -- 172.21.15.27:0/1164577616 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bfc007e10 con 0x7f9c001009d0 2024-09-19T08:11:08.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.646+0000 7f9c07f31640 1 -- 172.21.15.27:0/1164577616 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0019d5c0 con 0x7f9c001009d0 2024-09-19T08:11:08.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.646+0000 7f9bf6ffd640 1 -- 172.21.15.27:0/1164577616 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc018890 con 0x7f9c001009d0 2024-09-19T08:11:08.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.646+0000 7f9c07f31640 1 -- 172.21.15.27:0/1164577616 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c001a4e50 con 0x7f9c001009d0 2024-09-19T08:11:08.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.647+0000 7f9c07f31640 1 -- 172.21.15.27:0/1164577616 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c00100e30 con 0x7f9c001009d0 2024-09-19T08:11:08.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.648+0000 7f9bf6ffd640 1 -- 172.21.15.27:0/1164577616 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f9bfc018a50 con 0x7f9c001009d0 2024-09-19T08:11:08.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.649+0000 7f9bf6ffd640 1 --2- 172.21.15.27:0/1164577616 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f9bec0a3500 0x7f9bec0a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.649+0000 7f9c054cc640 1 --2- 172.21.15.27:0/1164577616 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f9bec0a3500 0x7f9bec0a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.649+0000 7f9bf6ffd640 1 -- 172.21.15.27:0/1164577616 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f9bfc0d0070 con 0x7f9c001009d0 2024-09-19T08:11:08.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.650+0000 7f9c054cc640 1 --2- 172.21.15.27:0/1164577616 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f9bec0a3500 0x7f9bec0a59c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c00105010 tx=0x7f9bf000b410 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:08.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.656+0000 7f9bf6ffd640 1 -- 172.21.15.27:0/1164577616 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9bfc014030 con 0x7f9c001009d0 2024-09-19T08:11:08.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.686+0000 7fa906a40640 1 -- 172.21.15.27:0/3742405295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa900108300 msgr2=0x7fa90010ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.686+0000 7fa906a40640 1 --2- 172.21.15.27:0/3742405295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa900108300 0x7fa90010ec70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8009cd0 tx=0x7fa8f802a8d0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.686+0000 7fa906a40640 1 -- 172.21.15.27:0/3742405295 shutdown_connections 2024-09-19T08:11:08.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.686+0000 7fa906a40640 1 --2- 172.21.15.27:0/3742405295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa900108300 0x7fa90010ec70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.686+0000 7fa906a40640 1 --2- 172.21.15.27:0/3742405295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa900103780 0x7fa900107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.686+0000 7fa906a40640 1 --2- 172.21.15.27:0/3742405295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa900102dd0 0x7fa9001031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.686+0000 7fa906a40640 1 -- 172.21.15.27:0/3742405295 >> 172.21.15.27:0/3742405295 conn(0x7fa9000fc7d0 msgr2=0x7fa9000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:08.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.686+0000 7fa906a40640 1 -- 172.21.15.27:0/3742405295 shutdown_connections 2024-09-19T08:11:08.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.686+0000 7fa906a40640 1 -- 172.21.15.27:0/3742405295 wait complete. 2024-09-19T08:11:08.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.687+0000 7fa906a40640 1 Processor -- start 2024-09-19T08:11:08.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.687+0000 7fa906a40640 1 -- start start 2024-09-19T08:11:08.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.688+0000 7fa906a40640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa900102dd0 0x7fa9001985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.688+0000 7fa906a40640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa900103780 0x7fa900198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.688+0000 7fa906a40640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa900108300 0x7fa90019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.688+0000 7fa906a40640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa9001120d0 con 0x7fa900103780 2024-09-19T08:11:08.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.688+0000 7fa906a40640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa900111f50 con 0x7fa900102dd0 2024-09-19T08:11:08.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.688+0000 7fa906a40640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa900112250 con 0x7fa900108300 2024-09-19T08:11:08.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.688+0000 7fa8ff7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa900103780 0x7fa900198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.688+0000 7fa8ff7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa900103780 0x7fa900198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35916/0 (socket says 172.21.15.27:35916) 2024-09-19T08:11:08.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.688+0000 7fa8ff7fe640 1 -- 172.21.15.27:0/1934061016 learned_addr learned my addr 172.21.15.27:0/1934061016 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:08.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.688+0000 7fa8fffff640 1 --2- 172.21.15.27:0/1934061016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa900102dd0 0x7fa9001985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.688+0000 7fa904fdd640 1 --2- 172.21.15.27:0/1934061016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa900108300 0x7fa90019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.688+0000 7fa8ff7fe640 1 -- 172.21.15.27:0/1934061016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa900108300 msgr2=0x7fa90019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.688+0000 7fa8ff7fe640 1 --2- 172.21.15.27:0/1934061016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa900108300 0x7fa90019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.688+0000 7fa8ff7fe640 1 -- 172.21.15.27:0/1934061016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa900102dd0 msgr2=0x7fa9001985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.688+0000 7fa8ff7fe640 1 --2- 172.21.15.27:0/1934061016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa900102dd0 0x7fa9001985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.688+0000 7fa8ff7fe640 1 -- 172.21.15.27:0/1934061016 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90019d560 con 0x7fa900103780 2024-09-19T08:11:08.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.689+0000 7fa8ff7fe640 1 --2- 172.21.15.27:0/1934061016 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa900103780 0x7fa900198af0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa8f400e9c0 tx=0x7fa8f400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:08.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.689+0000 7fa8fd7fa640 1 -- 172.21.15.27:0/1934061016 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f400ccc0 con 0x7fa900103780 2024-09-19T08:11:08.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.689+0000 7fa8fd7fa640 1 -- 172.21.15.27:0/1934061016 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8f4005500 con 0x7fa900103780 2024-09-19T08:11:08.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.689+0000 7fa8fd7fa640 1 -- 172.21.15.27:0/1934061016 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4010690 con 0x7fa900103780 2024-09-19T08:11:08.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.689+0000 7fa906a40640 1 -- 172.21.15.27:0/1934061016 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa90019d850 con 0x7fa900103780 2024-09-19T08:11:08.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.689+0000 7fa906a40640 1 -- 172.21.15.27:0/1934061016 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9001a5130 con 0x7fa900103780 2024-09-19T08:11:08.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.691+0000 7fa8fd7fa640 1 -- 172.21.15.27:0/1934061016 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fa8f4004e80 con 0x7fa900103780 2024-09-19T08:11:08.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.691+0000 7fa908e19740 1 Processor -- start 2024-09-19T08:11:08.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.691+0000 7fa908e19740 1 -- start start 2024-09-19T08:11:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.692+0000 7fa908e19740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f19b60 0x555ff0f19f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.692+0000 7fa908e19740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f1a480 0x555ff0f24800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.692+0000 7fa908e19740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f24d40 0x555ff0f27130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.692+0000 7fa908e19740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x555ff0e7f280 con 0x555ff0f1a480 2024-09-19T08:11:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.692+0000 7fa908e19740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x555ff0e26b10 con 0x555ff0f24d40 2024-09-19T08:11:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.692+0000 7fa908e19740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555ff0e7b240 con 0x555ff0f19b60 2024-09-19T08:11:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.692+0000 7fa8fffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f1a480 0x555ff0f24800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.692+0000 7fa8fffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f1a480 0x555ff0f24800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35932/0 (socket says 172.21.15.27:35932) 2024-09-19T08:11:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.692+0000 7fa8fffff640 1 -- 172.21.15.27:0/469296652 learned_addr learned my addr 172.21.15.27:0/469296652 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.692+0000 7fa8ff7fe640 1 --2- 172.21.15.27:0/469296652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f24d40 0x555ff0f27130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.692+0000 7fa904fdd640 1 --2- 172.21.15.27:0/469296652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f19b60 0x555ff0f19f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.692+0000 7fa8fffff640 1 -- 172.21.15.27:0/469296652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f19b60 msgr2=0x555ff0f19f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.692+0000 7fa8fffff640 1 --2- 172.21.15.27:0/469296652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f19b60 0x555ff0f19f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.692+0000 7fa8fffff640 1 -- 172.21.15.27:0/469296652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f24d40 msgr2=0x555ff0f27130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.692+0000 7fa8fffff640 1 --2- 172.21.15.27:0/469296652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f24d40 0x555ff0f27130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.692+0000 7fa8fffff640 1 -- 172.21.15.27:0/469296652 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ff0e331f0 con 0x555ff0f1a480 2024-09-19T08:11:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.692+0000 7fa8ff7fe640 1 --2- 172.21.15.27:0/469296652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f24d40 0x555ff0f27130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:11:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.692+0000 7fa8fd7fa640 1 --2- 172.21.15.27:0/1934061016 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa8e80a3440 0x7fa8e80a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.692+0000 7fa8fffff640 1 --2- 172.21.15.27:0/469296652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f1a480 0x555ff0f24800 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000bcd0 tx=0x7fa8f00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09984c17b51d4b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.693+0000 7fa904fdd640 1 --2- 172.21.15.27:0/1934061016 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa8e80a3440 0x7fa8e80a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.693+0000 7fa8e67fc640 1 -- 172.21.15.27:0/469296652 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0005220 con 0x555ff0f1a480 2024-09-19T08:11:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.693+0000 7fa8fd7fa640 1 -- 172.21.15.27:0/1934061016 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fa8f40d02e0 con 0x7fa900103780 2024-09-19T08:11:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.693+0000 7fa8e67fc640 1 -- 172.21.15.27:0/469296652 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8f0004c80 con 0x555ff0f1a480 2024-09-19T08:11:08.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.693+0000 7fa8e67fc640 1 -- 172.21.15.27:0/469296652 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f00117e0 con 0x555ff0f1a480 2024-09-19T08:11:08.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.693+0000 7fa908e19740 1 -- 172.21.15.27:0/469296652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f1a480 msgr2=0x555ff0f24800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.693+0000 7fa904fdd640 1 --2- 172.21.15.27:0/1934061016 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa8e80a3440 0x7fa8e80a5900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8006010 tx=0x7fa8f80093f0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:08.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.693+0000 7fa908e19740 1 --2- 172.21.15.27:0/469296652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f1a480 0x555ff0f24800 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000bcd0 tx=0x7fa8f00107a0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.693+0000 7fa908e19740 1 -- 172.21.15.27:0/469296652 shutdown_connections 2024-09-19T08:11:08.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.693+0000 7fa908e19740 1 --2- 172.21.15.27:0/469296652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f24d40 0x555ff0f27130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.693+0000 7fa908e19740 1 --2- 172.21.15.27:0/469296652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f1a480 0x555ff0f24800 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.693+0000 7fa908e19740 1 --2- 172.21.15.27:0/469296652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f19b60 0x555ff0f19f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.693+0000 7fa908e19740 1 -- 172.21.15.27:0/469296652 >> 172.21.15.27:0/469296652 conn(0x555ff0f160f0 msgr2=0x555ff0f164d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:08.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.694+0000 7fa908e19740 1 -- 172.21.15.27:0/469296652 shutdown_connections 2024-09-19T08:11:08.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.694+0000 7fa908e19740 1 -- 172.21.15.27:0/469296652 wait complete. 2024-09-19T08:11:08.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.694+0000 7fa908e19740 1 -- start start 2024-09-19T08:11:08.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.694+0000 7fa908e19740 1 Processor -- start 2024-09-19T08:11:08.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.694+0000 7fa908e19740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f19b60 0x555ff0f21c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.694+0000 7fa908e19740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f1a480 0x555ff0f22150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.694+0000 7fa908e19740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f24d40 0x555ff0f22690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.694+0000 7fa908e19740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x555ff0f27910 con 0x555ff0f24d40 2024-09-19T08:11:08.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.694+0000 7fa908e19740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x555ff0e39f10 con 0x555ff0f19b60 2024-09-19T08:11:08.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.694+0000 7fa908e19740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555ff0f27a90 con 0x555ff0f1a480 2024-09-19T08:11:08.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.694+0000 7fa908e19740 10 client.0 _ll_register_callbacks cb 0x555ff0e02a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:08.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.695+0000 7fa904fdd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f24d40 0x555ff0f22690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.695+0000 7fa904fdd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f24d40 0x555ff0f22690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35944/0 (socket says 172.21.15.27:35944) 2024-09-19T08:11:08.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.695+0000 7fa904fdd640 1 -- 172.21.15.27:0/775318638 learned_addr learned my addr 172.21.15.27:0/775318638 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:08.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.695+0000 7fa8fffff640 1 --2- 172.21.15.27:0/775318638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f19b60 0x555ff0f21c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.695+0000 7fa8ff7fe640 1 --2- 172.21.15.27:0/775318638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f1a480 0x555ff0f22150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.695+0000 7fa904fdd640 1 -- 172.21.15.27:0/775318638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f1a480 msgr2=0x555ff0f22150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:08.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.695+0000 7fa904fdd640 1 --2- 172.21.15.27:0/775318638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f1a480 0x555ff0f22150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.695+0000 7fa904fdd640 1 -- 172.21.15.27:0/775318638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f19b60 msgr2=0x555ff0f21c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:08.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.695+0000 7fa904fdd640 1 --2- 172.21.15.27:0/775318638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f19b60 0x555ff0f21c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.695+0000 7fa904fdd640 1 -- 172.21.15.27:0/775318638 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ff0bf06a0 con 0x555ff0f24d40 2024-09-19T08:11:08.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.695+0000 7fa904fdd640 1 --2- 172.21.15.27:0/775318638 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f24d40 0x555ff0f22690 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8032da0 tx=0x7fa8f80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be99ab73bb30e3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:08.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.695+0000 7fa8df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:08.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.695+0000 7fa8df7fe640 1 -- 172.21.15.27:0/775318638 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8003d80 con 0x555ff0f24d40 2024-09-19T08:11:08.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.695+0000 7fa8df7fe640 1 -- 172.21.15.27:0/775318638 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fa8f8004040 con 0x555ff0f24d40 2024-09-19T08:11:08.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.695+0000 7fa908e19740 1 -- 172.21.15.27:0/775318638 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8f0004c80 con 0x555ff0f24d40 2024-09-19T08:11:08.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.695+0000 7fa8df7fe640 1 -- 172.21.15.27:0/775318638 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa8f8032e90 con 0x555ff0f24d40 2024-09-19T08:11:08.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.695+0000 7fa908e19740 10 client.15231 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:08.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.695+0000 7fa908e19740 1 -- 172.21.15.27:0/775318638 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555ff0f33480 con 0x555ff0f24d40 2024-09-19T08:11:08.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.696+0000 7fa8df7fe640 1 -- 172.21.15.27:0/775318638 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8f0004c80 con 0x555ff0f24d40 2024-09-19T08:11:08.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.696+0000 7fa8df7fe640 1 -- 172.21.15.27:0/775318638 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa8f804f020 con 0x555ff0f24d40 2024-09-19T08:11:08.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.696+0000 7fa908e19740 10 client.15231 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:08.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.696+0000 7fa908e19740 10 client.15231 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:08.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.696+0000 7fa908e19740 20 client.15231 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:08.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.696+0000 7fa908e19740 1 --2- 172.21.15.27:0/775318638 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555ff0f348c0 0x555ff0f36d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.696+0000 7fa908e19740 4 client.15231 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:11:08.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.696+0000 7fa908e19740 1 -- 172.21.15.27:0/775318638 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ff0e8c7f0 con 0x555ff0f348c0 2024-09-19T08:11:08.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.697+0000 7fa8fffff640 1 --2- 172.21.15.27:0/775318638 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555ff0f348c0 0x555ff0f36d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.697+0000 7fa8fffff640 1 --2- 172.21.15.27:0/775318638 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555ff0f348c0 0x555ff0f36d30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bec7aaa0520a44c7 server_cookie=68eafb281273c56d in_seq=0 out_seq=0 2024-09-19T08:11:08.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.697+0000 7fa8df7fe640 10 client.15231 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:08.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.698+0000 7fa8df7fe640 1 -- 172.21.15.27:0/775318638 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555ff0e8c7f0 con 0x555ff0f348c0 2024-09-19T08:11:08.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.698+0000 7fa8df7fe640 10 client.15231 handle_command_reply: tid=0 2024-09-19T08:11:08.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.698+0000 7fa908e19740 1 client.15231 shutdown 2024-09-19T08:11:08.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.698+0000 7fa908e19740 1 -- 172.21.15.27:0/775318638 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f24d40 msgr2=0x555ff0f22690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.698+0000 7fa908e19740 1 --2- 172.21.15.27:0/775318638 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f24d40 0x555ff0f22690 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8032da0 tx=0x7fa8f80095c0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.698+0000 7fa908e19740 1 -- 172.21.15.27:0/775318638 shutdown_connections 2024-09-19T08:11:08.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.698+0000 7fa908e19740 1 --2- 172.21.15.27:0/775318638 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f24d40 0x555ff0f22690 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.698+0000 7fa908e19740 1 --2- 172.21.15.27:0/775318638 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555ff0f348c0 0x555ff0f36d30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.698+0000 7fa908e19740 1 --2- 172.21.15.27:0/775318638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f1a480 0x555ff0f22150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.698+0000 7fa8df7fe640 0 client.15231 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:08.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.698+0000 7fa908e19740 1 --2- 172.21.15.27:0/775318638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f19b60 0x555ff0f21c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.698+0000 7fa908e19740 1 -- 172.21.15.27:0/775318638 >> 172.21.15.27:0/775318638 conn(0x555ff0f160f0 msgr2=0x555ff0f1bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:08.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.698+0000 7fa908e19740 1 -- 172.21.15.27:0/775318638 shutdown_connections 2024-09-19T08:11:08.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.698+0000 7fa908e19740 1 -- 172.21.15.27:0/775318638 wait complete. 2024-09-19T08:11:08.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.698+0000 7fa908e19740 20 client.15231 trim_cache size 0 max 16384 2024-09-19T08:11:08.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.716+0000 7fa908e19740 1 Processor -- start 2024-09-19T08:11:08.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.716+0000 7fa908e19740 1 -- start start 2024-09-19T08:11:08.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.716+0000 7fa908e19740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f19b60 0x555ff0f1bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.716+0000 7fa908e19740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f1a480 0x555ff0f3c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.716+0000 7fa908e19740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f24d40 0x555ff0f3cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.716+0000 7fa908e19740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa9001ab890 con 0x555ff0f19b60 2024-09-19T08:11:08.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.716+0000 7fa908e19740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa9001ae110 con 0x555ff0f1a480 2024-09-19T08:11:08.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.716+0000 7fa908e19740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa9001abf00 con 0x555ff0f24d40 2024-09-19T08:11:08.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.716+0000 7fa904fdd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f24d40 0x555ff0f3cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.716+0000 7fa8fffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f19b60 0x555ff0f1bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.716+0000 7fa904fdd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f24d40 0x555ff0f3cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.27:53416/0 (socket says 172.21.15.27:53416) 2024-09-19T08:11:08.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.716+0000 7fa904fdd640 1 -- 172.21.15.27:0/6417467 learned_addr learned my addr 172.21.15.27:0/6417467 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:08.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.716+0000 7fa8ff7fe640 1 --2- 172.21.15.27:0/6417467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f1a480 0x555ff0f3c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.717+0000 7fa904fdd640 1 -- 172.21.15.27:0/6417467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f1a480 msgr2=0x555ff0f3c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:08.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.717+0000 7fa904fdd640 1 --2- 172.21.15.27:0/6417467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f1a480 0x555ff0f3c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.717+0000 7fa904fdd640 1 -- 172.21.15.27:0/6417467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f19b60 msgr2=0x555ff0f1bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:08.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.717+0000 7fa904fdd640 1 --2- 172.21.15.27:0/6417467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f19b60 0x555ff0f1bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.717+0000 7fa904fdd640 1 -- 172.21.15.27:0/6417467 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ff0f16d80 con 0x555ff0f24d40 2024-09-19T08:11:08.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.717+0000 7fa904fdd640 1 --2- 172.21.15.27:0/6417467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f24d40 0x555ff0f3cb40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa8f802fba0 tx=0x7fa8f802f2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=862f0395d86edee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:08.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.717+0000 7fa8e5ffb640 1 -- 172.21.15.27:0/6417467 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f805f070 con 0x555ff0f24d40 2024-09-19T08:11:08.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.717+0000 7fa8e5ffb640 1 -- 172.21.15.27:0/6417467 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8f8036040 con 0x555ff0f24d40 2024-09-19T08:11:08.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.717+0000 7fa8e5ffb640 1 -- 172.21.15.27:0/6417467 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f80516a0 con 0x555ff0f24d40 2024-09-19T08:11:08.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.718+0000 7fa908e19740 1 -- 172.21.15.27:0/6417467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f24d40 msgr2=0x555ff0f3cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.718+0000 7fa908e19740 1 --2- 172.21.15.27:0/6417467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f24d40 0x555ff0f3cb40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa8f802fba0 tx=0x7fa8f802f2e0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.718+0000 7fa908e19740 1 -- 172.21.15.27:0/6417467 shutdown_connections 2024-09-19T08:11:08.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.718+0000 7fa908e19740 1 --2- 172.21.15.27:0/6417467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f24d40 0x555ff0f3cb40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.718+0000 7fa908e19740 1 --2- 172.21.15.27:0/6417467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f1a480 0x555ff0f3c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.718+0000 7fa908e19740 1 --2- 172.21.15.27:0/6417467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f19b60 0x555ff0f1bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.718+0000 7fa908e19740 1 -- 172.21.15.27:0/6417467 >> 172.21.15.27:0/6417467 conn(0x555ff0f160f0 msgr2=0x555ff0f1b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:08.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.718+0000 7fa908e19740 1 -- 172.21.15.27:0/6417467 shutdown_connections 2024-09-19T08:11:08.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.718+0000 7fa908e19740 1 -- 172.21.15.27:0/6417467 wait complete. 2024-09-19T08:11:08.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.718+0000 7fa908e19740 1 -- start start 2024-09-19T08:11:08.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.719+0000 7fa908e19740 1 Processor -- start 2024-09-19T08:11:08.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.719+0000 7fa908e19740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f19b60 0x555ff0f290f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.719+0000 7fa908e19740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f1a480 0x555ff0f29630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.719+0000 7fa908e19740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f24d40 0x555ff0f9e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.719+0000 7fa908e19740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa9001ac5d0 con 0x555ff0f24d40 2024-09-19T08:11:08.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.719+0000 7fa908e19740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa9001ada40 con 0x555ff0f1a480 2024-09-19T08:11:08.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.719+0000 7fa908e19740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa9001acca0 con 0x555ff0f19b60 2024-09-19T08:11:08.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.719+0000 7fa904fdd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f24d40 0x555ff0f9e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.719+0000 7fa908e19740 10 client.0 _ll_register_callbacks cb 0x7fa8f4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:08.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.719+0000 7fa904fdd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f24d40 0x555ff0f9e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35966/0 (socket says 172.21.15.27:35966) 2024-09-19T08:11:08.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.719+0000 7fa904fdd640 1 -- 172.21.15.27:0/3145216744 learned_addr learned my addr 172.21.15.27:0/3145216744 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:08.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.719+0000 7fa8ff7fe640 1 --2- 172.21.15.27:0/3145216744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f1a480 0x555ff0f29630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.719+0000 7fa8fffff640 1 --2- 172.21.15.27:0/3145216744 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f19b60 0x555ff0f290f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.719+0000 7fa904fdd640 1 -- 172.21.15.27:0/3145216744 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f19b60 msgr2=0x555ff0f290f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:08.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.719+0000 7fa904fdd640 1 --2- 172.21.15.27:0/3145216744 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f19b60 0x555ff0f290f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.719+0000 7fa904fdd640 1 -- 172.21.15.27:0/3145216744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f1a480 msgr2=0x555ff0f29630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:08.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.719+0000 7fa904fdd640 1 --2- 172.21.15.27:0/3145216744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f1a480 0x555ff0f29630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.719+0000 7fa904fdd640 1 -- 172.21.15.27:0/3145216744 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ff0f9eb10 con 0x555ff0f24d40 2024-09-19T08:11:08.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.719+0000 7fa8fffff640 1 --2- 172.21.15.27:0/3145216744 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f19b60 0x555ff0f290f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:08.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.720+0000 7fa904fdd640 1 --2- 172.21.15.27:0/3145216744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f24d40 0x555ff0f9e5d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8005e30 tx=0x7fa8f8030840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc291db40e3963b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:08.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.720+0000 7fa8df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:08.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.720+0000 7fa8df7fe640 1 -- 172.21.15.27:0/3145216744 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f805f070 con 0x555ff0f24d40 2024-09-19T08:11:08.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.720+0000 7fa8df7fe640 1 -- 172.21.15.27:0/3145216744 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fa8f8051640 con 0x555ff0f24d40 2024-09-19T08:11:08.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.720+0000 7fa908e19740 1 -- 172.21.15.27:0/3145216744 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8f8036040 con 0x555ff0f24d40 2024-09-19T08:11:08.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.720+0000 7fa8df7fe640 1 -- 172.21.15.27:0/3145216744 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa8f802fed0 con 0x555ff0f24d40 2024-09-19T08:11:08.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.720+0000 7fa908e19740 10 client.15237 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:08.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.720+0000 7fa908e19740 1 -- 172.21.15.27:0/3145216744 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555ff0f9fdb0 con 0x555ff0f24d40 2024-09-19T08:11:08.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.720+0000 7fa8df7fe640 1 -- 172.21.15.27:0/3145216744 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8f8036040 con 0x555ff0f24d40 2024-09-19T08:11:08.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.720+0000 7fa8df7fe640 1 -- 172.21.15.27:0/3145216744 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa8f804f070 con 0x555ff0f24d40 2024-09-19T08:11:08.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.721+0000 7fa908e19740 10 client.15237 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:08.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.721+0000 7fa908e19740 10 client.15237 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:08.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.721+0000 7fa908e19740 20 client.15237 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.721+0000 7fa908e19740 1 --2- 172.21.15.27:0/3145216744 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555ff0f348c0 0x555ff0fa2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.721+0000 7fa908e19740 4 client.15237 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:11:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.721+0000 7fa908e19740 1 -- 172.21.15.27:0/3145216744 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555ff0e86d00 con 0x555ff0f348c0 2024-09-19T08:11:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.721+0000 7fa8fffff640 1 --2- 172.21.15.27:0/3145216744 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555ff0f348c0 0x555ff0fa2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.721+0000 7fa8fffff640 1 --2- 172.21.15.27:0/3145216744 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555ff0f348c0 0x555ff0fa2470 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=baee4a44f8e593e1 server_cookie=da97bf00d69e2a00 in_seq=0 out_seq=0 2024-09-19T08:11:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.721+0000 7fa8df7fe640 10 client.15237 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.722+0000 7fa8df7fe640 1 -- 172.21.15.27:0/3145216744 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555ff0e86d00 con 0x555ff0f348c0 2024-09-19T08:11:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.722+0000 7fa8df7fe640 10 client.15237 handle_command_reply: tid=0 2024-09-19T08:11:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.722+0000 7fa908e19740 1 client.15237 shutdown 2024-09-19T08:11:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.722+0000 7fa908e19740 1 -- 172.21.15.27:0/3145216744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f24d40 msgr2=0x555ff0f9e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.722+0000 7fa908e19740 1 --2- 172.21.15.27:0/3145216744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f24d40 0x555ff0f9e5d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8005e30 tx=0x7fa8f8030840 comp rx=0 tx=0).stop 2024-09-19T08:11:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.722+0000 7fa908e19740 1 -- 172.21.15.27:0/3145216744 shutdown_connections 2024-09-19T08:11:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.722+0000 7fa908e19740 1 --2- 172.21.15.27:0/3145216744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ff0f24d40 0x555ff0f9e5d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.722+0000 7fa908e19740 1 --2- 172.21.15.27:0/3145216744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ff0f1a480 0x555ff0f29630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.722+0000 7fa908e19740 1 --2- 172.21.15.27:0/3145216744 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555ff0f348c0 0x555ff0fa2470 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.722+0000 7fa908e19740 1 --2- 172.21.15.27:0/3145216744 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ff0f19b60 0x555ff0f290f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.722+0000 7fa908e19740 1 -- 172.21.15.27:0/3145216744 >> 172.21.15.27:0/3145216744 conn(0x555ff0f160f0 msgr2=0x555ff0f223f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:08.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.723+0000 7fa8df7fe640 0 client.15237 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:08.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.723+0000 7fa908e19740 1 -- 172.21.15.27:0/3145216744 shutdown_connections 2024-09-19T08:11:08.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.723+0000 7fa908e19740 1 -- 172.21.15.27:0/3145216744 wait complete. 2024-09-19T08:11:08.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.723+0000 7fa908e19740 20 client.15237 trim_cache size 0 max 16384 2024-09-19T08:11:08.729 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:11:08.729 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:11:08.730 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "684c26d0-e517-46d0-9b81-0735746bf3a5", 2024-09-19T08:11:08.730 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:11:08.730 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:11:08.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.723+0000 7fa906a40640 1 -- 172.21.15.27:0/1934061016 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa8e80a3440 msgr2=0x7fa8e80a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.723+0000 7fa906a40640 1 --2- 172.21.15.27:0/1934061016 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa8e80a3440 0x7fa8e80a5900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8006010 tx=0x7fa8f80093f0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.723+0000 7fa906a40640 1 -- 172.21.15.27:0/1934061016 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa900103780 msgr2=0x7fa900198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.723+0000 7fa906a40640 1 --2- 172.21.15.27:0/1934061016 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa900103780 0x7fa900198af0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa8f400e9c0 tx=0x7fa8f400ee80 comp rx=0 tx=0).stop 2024-09-19T08:11:08.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.724+0000 7fa906a40640 1 -- 172.21.15.27:0/1934061016 shutdown_connections 2024-09-19T08:11:08.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.724+0000 7fa906a40640 1 --2- 172.21.15.27:0/1934061016 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa8e80a3440 0x7fa8e80a5900 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.724+0000 7fa906a40640 1 --2- 172.21.15.27:0/1934061016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa900108300 0x7fa90019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.724+0000 7fa906a40640 1 --2- 172.21.15.27:0/1934061016 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa900103780 0x7fa900198af0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.724+0000 7fa906a40640 1 --2- 172.21.15.27:0/1934061016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa900102dd0 0x7fa9001985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.724+0000 7fa906a40640 1 -- 172.21.15.27:0/1934061016 >> 172.21.15.27:0/1934061016 conn(0x7fa9000fc7d0 msgr2=0x7fa900105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:08.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.724+0000 7fa906a40640 1 -- 172.21.15.27:0/1934061016 shutdown_connections 2024-09-19T08:11:08.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.724+0000 7fa906a40640 1 -- 172.21.15.27:0/1934061016 wait complete. 2024-09-19T08:11:08.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:08 smithi027 ceph-mon[31209]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:11:08.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:08 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3306741299' entity='client.admin' 2024-09-19T08:11:08.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:08 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:11:08.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:08 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:11:08.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:08 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:11:08.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:08 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:08.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:08 smithi203 ceph-mon[35198]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:11:08.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:08 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3306741299' entity='client.admin' 2024-09-19T08:11:08.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:08 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:11:08.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:08 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:11:08.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:08 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:11:08.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:08 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:08.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.845+0000 7f9c07f31640 1 -- 172.21.15.27:0/1164577616 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f9c00199630 con 0x7f9c001009d0 2024-09-19T08:11:08.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.851+0000 7f9bf6ffd640 1 -- 172.21.15.27:0/1164577616 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) ==== 133+0+0 (secure 0 0 0) 0x7f9bfc09ca60 con 0x7f9c001009d0 2024-09-19T08:11:08.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.853+0000 7f9c07f31640 1 -- 172.21.15.27:0/1164577616 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f9bec0a3500 msgr2=0x7f9bec0a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.853+0000 7f9c07f31640 1 --2- 172.21.15.27:0/1164577616 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f9bec0a3500 0x7f9bec0a59c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c00105010 tx=0x7f9bf000b410 comp rx=0 tx=0).stop 2024-09-19T08:11:08.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.853+0000 7f9c07f31640 1 -- 172.21.15.27:0/1164577616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c001009d0 msgr2=0x7f9c001982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.853+0000 7f9c07f31640 1 --2- 172.21.15.27:0/1164577616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c001009d0 0x7f9c001982e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00c920 tx=0x7f9bfc00cde0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.853+0000 7f9c07f31640 1 -- 172.21.15.27:0/1164577616 shutdown_connections 2024-09-19T08:11:08.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.853+0000 7f9c07f31640 1 --2- 172.21.15.27:0/1164577616 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f9bec0a3500 0x7f9bec0a59c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.853+0000 7f9c07f31640 1 --2- 172.21.15.27:0/1164577616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c001069e0 0x7f9c0019cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.853+0000 7f9c07f31640 1 --2- 172.21.15.27:0/1164577616 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c00101370 0x7f9c00198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.853+0000 7f9c07f31640 1 --2- 172.21.15.27:0/1164577616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c001009d0 0x7f9c001982e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.853+0000 7f9c07f31640 1 -- 172.21.15.27:0/1164577616 >> 172.21.15.27:0/1164577616 conn(0x7f9c000fc6f0 msgr2=0x7f9c0006a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:08.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.853+0000 7f9c07f31640 1 -- 172.21.15.27:0/1164577616 shutdown_connections 2024-09-19T08:11:08.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.853+0000 7f9c07f31640 1 -- 172.21.15.27:0/1164577616 wait complete. 2024-09-19T08:11:08.864 DEBUG:teuthology.orchestra.run.smithi027:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-19T08:11:08.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.974+0000 7fa9c8fe4640 1 -- 172.21.15.27:0/3143716355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9c4102470 msgr2=0x7fa9c410e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.974+0000 7fa9c8fe4640 1 --2- 172.21.15.27:0/3143716355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9c4102470 0x7fa9c410e9a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4009cd0 tx=0x7fa9b402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.974+0000 7fa9c8fe4640 1 -- 172.21.15.27:0/3143716355 shutdown_connections 2024-09-19T08:11:08.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.974+0000 7fa9c8fe4640 1 --2- 172.21.15.27:0/3143716355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9c4102470 0x7fa9c410e9a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.974+0000 7fa9c8fe4640 1 --2- 172.21.15.27:0/3143716355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9c4101ad0 0x7fa9c4101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.974+0000 7fa9c8fe4640 1 --2- 172.21.15.27:0/3143716355 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9c4107b70 0x7fa9c4107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.974+0000 7fa9c8fe4640 1 -- 172.21.15.27:0/3143716355 >> 172.21.15.27:0/3143716355 conn(0x7fa9c40fd7d0 msgr2=0x7fa9c40ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:08.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.974+0000 7fa9c8fe4640 1 -- 172.21.15.27:0/3143716355 shutdown_connections 2024-09-19T08:11:08.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.974+0000 7fa9c8fe4640 1 -- 172.21.15.27:0/3143716355 wait complete. 2024-09-19T08:11:08.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.975+0000 7fa9c8fe4640 1 Processor -- start 2024-09-19T08:11:08.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.975+0000 7fa9c8fe4640 1 -- start start 2024-09-19T08:11:08.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.975+0000 7fa9c8fe4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9c4101ad0 0x7fa9c419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.975+0000 7fa9c8fe4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9c4102470 0x7fa9c419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.975+0000 7fa9c8fe4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9c4107b70 0x7fa9c419ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.975+0000 7fa9c8fe4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c4111f20 con 0x7fa9c4107b70 2024-09-19T08:11:08.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.975+0000 7fa9c8fe4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c4111da0 con 0x7fa9c4101ad0 2024-09-19T08:11:08.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.975+0000 7fa9c8fe4640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c41120a0 con 0x7fa9c4102470 2024-09-19T08:11:08.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.975+0000 7fa9c2d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9c4107b70 0x7fa9c419ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.975+0000 7fa9c2d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9c4107b70 0x7fa9c419ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35980/0 (socket says 172.21.15.27:35980) 2024-09-19T08:11:08.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.975+0000 7fa9c2d9d640 1 -- 172.21.15.27:0/715395271 learned_addr learned my addr 172.21.15.27:0/715395271 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:08.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.975+0000 7fa9c259c640 1 --2- 172.21.15.27:0/715395271 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9c4101ad0 0x7fa9c419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.975+0000 7fa9c1d9b640 1 --2- 172.21.15.27:0/715395271 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9c4102470 0x7fa9c419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.975+0000 7fa9c2d9d640 1 -- 172.21.15.27:0/715395271 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9c4102470 msgr2=0x7fa9c419aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.975+0000 7fa9c2d9d640 1 --2- 172.21.15.27:0/715395271 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9c4102470 0x7fa9c419aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.975+0000 7fa9c2d9d640 1 -- 172.21.15.27:0/715395271 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9c4101ad0 msgr2=0x7fa9c419a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:08.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.975+0000 7fa9c2d9d640 1 --2- 172.21.15.27:0/715395271 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9c4101ad0 0x7fa9c419a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:08.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.975+0000 7fa9c2d9d640 1 -- 172.21.15.27:0/715395271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c419f5a0 con 0x7fa9c4107b70 2024-09-19T08:11:08.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.976+0000 7fa9c2d9d640 1 --2- 172.21.15.27:0/715395271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9c4107b70 0x7fa9c419ee70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4005cc0 tx=0x7fa9b4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:08.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.976+0000 7fa9bb7fe640 1 -- 172.21.15.27:0/715395271 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4004040 con 0x7fa9c4107b70 2024-09-19T08:11:08.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.976+0000 7fa9bb7fe640 1 -- 172.21.15.27:0/715395271 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9b40046c0 con 0x7fa9c4107b70 2024-09-19T08:11:08.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.976+0000 7fa9bb7fe640 1 -- 172.21.15.27:0/715395271 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4030e70 con 0x7fa9c4107b70 2024-09-19T08:11:08.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.976+0000 7fa9c8fe4640 1 -- 172.21.15.27:0/715395271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c419f830 con 0x7fa9c4107b70 2024-09-19T08:11:08.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.976+0000 7fa9c8fe4640 1 -- 172.21.15.27:0/715395271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c41a7120 con 0x7fa9c4107b70 2024-09-19T08:11:08.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.977+0000 7fa9c8fe4640 1 -- 172.21.15.27:0/715395271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9c4101f30 con 0x7fa9c4107b70 2024-09-19T08:11:08.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.978+0000 7fa9bb7fe640 1 -- 172.21.15.27:0/715395271 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fa9b40305a0 con 0x7fa9c4107b70 2024-09-19T08:11:08.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.979+0000 7fa9bb7fe640 1 --2- 172.21.15.27:0/715395271 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa9b00a3500 0x7fa9b00a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:08.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.979+0000 7fa9c259c640 1 --2- 172.21.15.27:0/715395271 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa9b00a3500 0x7fa9b00a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:08.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.979+0000 7fa9bb7fe640 1 -- 172.21.15.27:0/715395271 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fa9b402e030 con 0x7fa9c4107b70 2024-09-19T08:11:08.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.980+0000 7fa9c259c640 1 --2- 172.21.15.27:0/715395271 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa9b00a3500 0x7fa9b00a59c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc005fd0 tx=0x7fa9bc00b390 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:08.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:08.983+0000 7fa9bb7fe640 1 -- 172.21.15.27:0/715395271 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa9b40bd600 con 0x7fa9c4107b70 2024-09-19T08:11:08.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:08 smithi155 ceph-mon[35362]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:11:08.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:08 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3306741299' entity='client.admin' 2024-09-19T08:11:08.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:08 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:11:08.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:08 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:11:08.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:08 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:11:08.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:08 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:09.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.184+0000 7fa9c8fe4640 1 -- 172.21.15.27:0/715395271 --> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fa9c40fed20 con 0x7fa9b00a3500 2024-09-19T08:11:09.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.249+0000 7fa9bb7fe640 1 -- 172.21.15.27:0/715395271 <== mgr.15093 v2:172.21.15.27:6800/1578338135 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa9c40fed20 con 0x7fa9b00a3500 2024-09-19T08:11:09.249 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule set for path / 2024-09-19T08:11:09.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.251+0000 7fa9c8fe4640 1 -- 172.21.15.27:0/715395271 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa9b00a3500 msgr2=0x7fa9b00a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:09.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.251+0000 7fa9c8fe4640 1 --2- 172.21.15.27:0/715395271 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa9b00a3500 0x7fa9b00a59c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc005fd0 tx=0x7fa9bc00b390 comp rx=0 tx=0).stop 2024-09-19T08:11:09.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.251+0000 7fa9c8fe4640 1 -- 172.21.15.27:0/715395271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9c4107b70 msgr2=0x7fa9c419ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:09.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.251+0000 7fa9c8fe4640 1 --2- 172.21.15.27:0/715395271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9c4107b70 0x7fa9c419ee70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4005cc0 tx=0x7fa9b4003970 comp rx=0 tx=0).stop 2024-09-19T08:11:09.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.251+0000 7fa9c8fe4640 1 -- 172.21.15.27:0/715395271 shutdown_connections 2024-09-19T08:11:09.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.251+0000 7fa9c8fe4640 1 --2- 172.21.15.27:0/715395271 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa9b00a3500 0x7fa9b00a59c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:09.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.251+0000 7fa9c8fe4640 1 --2- 172.21.15.27:0/715395271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9c4107b70 0x7fa9c419ee70 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:09.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.251+0000 7fa9c8fe4640 1 --2- 172.21.15.27:0/715395271 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9c4102470 0x7fa9c419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:09.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.251+0000 7fa9c8fe4640 1 --2- 172.21.15.27:0/715395271 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9c4101ad0 0x7fa9c419a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:09.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.251+0000 7fa9c8fe4640 1 -- 172.21.15.27:0/715395271 >> 172.21.15.27:0/715395271 conn(0x7fa9c40fd7d0 msgr2=0x7fa9c410d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:09.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.251+0000 7fa9c8fe4640 1 -- 172.21.15.27:0/715395271 shutdown_connections 2024-09-19T08:11:09.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.251+0000 7fa9c8fe4640 1 -- 172.21.15.27:0/715395271 wait complete. 2024-09-19T08:11:09.262 DEBUG:teuthology.orchestra.run.smithi027:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-19T08:11:09.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.370+0000 7f1cc8a5c640 1 -- 172.21.15.27:0/1730151729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cc41035a0 msgr2=0x7f1cc410ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:09.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.370+0000 7f1cc8a5c640 1 --2- 172.21.15.27:0/1730151729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cc41035a0 0x7f1cc410ba80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1cac009900 tx=0x7f1cac02a480 comp rx=0 tx=0).stop 2024-09-19T08:11:09.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.370+0000 7f1cc8a5c640 1 -- 172.21.15.27:0/1730151729 shutdown_connections 2024-09-19T08:11:09.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.370+0000 7f1cc8a5c640 1 --2- 172.21.15.27:0/1730151729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cc410c0d0 0x7f1cc410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:09.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.370+0000 7f1cc8a5c640 1 --2- 172.21.15.27:0/1730151729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cc41035a0 0x7f1cc410ba80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:09.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.370+0000 7f1cc8a5c640 1 --2- 172.21.15.27:0/1730151729 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cc4102c80 0x7f1cc4103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:09.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.370+0000 7f1cc8a5c640 1 -- 172.21.15.27:0/1730151729 >> 172.21.15.27:0/1730151729 conn(0x7f1cc4077990 msgr2=0x7f1cc40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:09.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.370+0000 7f1cc8a5c640 1 -- 172.21.15.27:0/1730151729 shutdown_connections 2024-09-19T08:11:09.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.370+0000 7f1cc8a5c640 1 -- 172.21.15.27:0/1730151729 wait complete. 2024-09-19T08:11:09.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.370+0000 7f1cc8a5c640 1 Processor -- start 2024-09-19T08:11:09.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.370+0000 7f1cc8a5c640 1 -- start start 2024-09-19T08:11:09.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.371+0000 7f1cc8a5c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cc4102c80 0x7f1cc4198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:09.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.371+0000 7f1cc8a5c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cc41035a0 0x7f1cc41988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:09.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.371+0000 7f1cc8a5c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cc410c0d0 0x7f1cc419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:09.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.371+0000 7f1cc8a5c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc4111eb0 con 0x7f1cc4102c80 2024-09-19T08:11:09.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.371+0000 7f1cc8a5c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc4111d30 con 0x7f1cc41035a0 2024-09-19T08:11:09.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.371+0000 7f1cc8a5c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc4112030 con 0x7f1cc410c0d0 2024-09-19T08:11:09.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.371+0000 7f1cc259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cc4102c80 0x7f1cc4198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:09.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.371+0000 7f1cc259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cc4102c80 0x7f1cc4198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36002/0 (socket says 172.21.15.27:36002) 2024-09-19T08:11:09.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.371+0000 7f1cc259c640 1 -- 172.21.15.27:0/2273893788 learned_addr learned my addr 172.21.15.27:0/2273893788 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:09.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.371+0000 7f1cc1d9b640 1 --2- 172.21.15.27:0/2273893788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cc41035a0 0x7f1cc41988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:09.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.371+0000 7f1cc2d9d640 1 --2- 172.21.15.27:0/2273893788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cc410c0d0 0x7f1cc419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:09.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.371+0000 7f1cc259c640 1 -- 172.21.15.27:0/2273893788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cc410c0d0 msgr2=0x7f1cc419cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:09.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.371+0000 7f1cc259c640 1 --2- 172.21.15.27:0/2273893788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cc410c0d0 0x7f1cc419cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:09.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.371+0000 7f1cc259c640 1 -- 172.21.15.27:0/2273893788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cc41035a0 msgr2=0x7f1cc41988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:09.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.371+0000 7f1cc259c640 1 --2- 172.21.15.27:0/2273893788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cc41035a0 0x7f1cc41988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:09.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.371+0000 7f1cc259c640 1 -- 172.21.15.27:0/2273893788 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc419d350 con 0x7f1cc4102c80 2024-09-19T08:11:09.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.371+0000 7f1cc2d9d640 1 --2- 172.21.15.27:0/2273893788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cc410c0d0 0x7f1cc419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:11:09.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.371+0000 7f1cc259c640 1 --2- 172.21.15.27:0/2273893788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cc4102c80 0x7f1cc4198360 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00c970 tx=0x7f1cbc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:09.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.371+0000 7f1cbb7fe640 1 -- 172.21.15.27:0/2273893788 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc007bb0 con 0x7f1cc4102c80 2024-09-19T08:11:09.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.372+0000 7f1cc8a5c640 1 -- 172.21.15.27:0/2273893788 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc419d640 con 0x7f1cc4102c80 2024-09-19T08:11:09.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.372+0000 7f1cbb7fe640 1 -- 172.21.15.27:0/2273893788 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cbc007d50 con 0x7f1cc4102c80 2024-09-19T08:11:09.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.372+0000 7f1cbb7fe640 1 -- 172.21.15.27:0/2273893788 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc00f450 con 0x7f1cc4102c80 2024-09-19T08:11:09.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.372+0000 7f1cc8a5c640 1 -- 172.21.15.27:0/2273893788 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc41a4ed0 con 0x7f1cc4102c80 2024-09-19T08:11:09.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.372+0000 7f1cc8a5c640 1 -- 172.21.15.27:0/2273893788 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cc4103060 con 0x7f1cc4102c80 2024-09-19T08:11:09.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.374+0000 7f1cbb7fe640 1 -- 172.21.15.27:0/2273893788 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f1cbc004fe0 con 0x7f1cc4102c80 2024-09-19T08:11:09.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.375+0000 7f1cbb7fe640 1 --2- 172.21.15.27:0/2273893788 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1cb00a3500 0x7f1cb00a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:09.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.375+0000 7f1cbb7fe640 1 -- 172.21.15.27:0/2273893788 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f1cbc0d00a0 con 0x7f1cc4102c80 2024-09-19T08:11:09.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.375+0000 7f1cc1d9b640 1 --2- 172.21.15.27:0/2273893788 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1cb00a3500 0x7f1cb00a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:09.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.375+0000 7f1cc1d9b640 1 --2- 172.21.15.27:0/2273893788 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1cb00a3500 0x7f1cb00a59c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1cc410e4b0 tx=0x7f1cac031490 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:09.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.378+0000 7f1cbb7fe640 1 -- 172.21.15.27:0/2273893788 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1cbc014030 con 0x7f1cc4102c80 2024-09-19T08:11:09.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.574+0000 7f1cc8a5c640 1 -- 172.21.15.27:0/2273893788 --> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f1cc40fd700 con 0x7f1cb00a3500 2024-09-19T08:11:09.630 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:11:09.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.637+0000 7f1cbb7fe640 1 -- 172.21.15.27:0/2273893788 <== mgr.15093 v2:172.21.15.27:6800/1578338135 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f1cc40fd700 con 0x7f1cb00a3500 2024-09-19T08:11:09.638 INFO:teuthology.orchestra.run.smithi027.stdout:Retention added to path / 2024-09-19T08:11:09.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.639+0000 7f1cc8a5c640 1 -- 172.21.15.27:0/2273893788 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1cb00a3500 msgr2=0x7f1cb00a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:09.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.639+0000 7f1cc8a5c640 1 --2- 172.21.15.27:0/2273893788 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1cb00a3500 0x7f1cb00a59c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1cc410e4b0 tx=0x7f1cac031490 comp rx=0 tx=0).stop 2024-09-19T08:11:09.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.639+0000 7f1cc8a5c640 1 -- 172.21.15.27:0/2273893788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cc4102c80 msgr2=0x7f1cc4198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:09.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.639+0000 7f1cc8a5c640 1 --2- 172.21.15.27:0/2273893788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cc4102c80 0x7f1cc4198360 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00c970 tx=0x7f1cbc00ce30 comp rx=0 tx=0).stop 2024-09-19T08:11:09.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.639+0000 7f1cc8a5c640 1 -- 172.21.15.27:0/2273893788 shutdown_connections 2024-09-19T08:11:09.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.639+0000 7f1cc8a5c640 1 --2- 172.21.15.27:0/2273893788 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1cb00a3500 0x7f1cb00a59c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:09.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.639+0000 7f1cc8a5c640 1 --2- 172.21.15.27:0/2273893788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cc410c0d0 0x7f1cc419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:09.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.639+0000 7f1cc8a5c640 1 --2- 172.21.15.27:0/2273893788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cc41035a0 0x7f1cc41988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:09.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.639+0000 7f1cc8a5c640 1 --2- 172.21.15.27:0/2273893788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cc4102c80 0x7f1cc4198360 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:09.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.639+0000 7f1cc8a5c640 1 -- 172.21.15.27:0/2273893788 >> 172.21.15.27:0/2273893788 conn(0x7f1cc4077990 msgr2=0x7f1cc40fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:09.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.640+0000 7f1cc8a5c640 1 -- 172.21.15.27:0/2273893788 shutdown_connections 2024-09-19T08:11:09.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.640+0000 7f1cc8a5c640 1 -- 172.21.15.27:0/2273893788 wait complete. 2024-09-19T08:11:09.651 DEBUG:teuthology.orchestra.run.smithi027:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T08:11:09.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.796+0000 7f34b0786640 1 -- 172.21.15.27:0/4235720877 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34a8102ce0 msgr2=0x7f34a81030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:09.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.796+0000 7f34b0786640 1 --2- 172.21.15.27:0/4235720877 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34a8102ce0 0x7f34a81030c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f34a4009900 tx=0x7f34a402a480 comp rx=0 tx=0).stop 2024-09-19T08:11:09.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.796+0000 7f34b0786640 1 -- 172.21.15.27:0/4235720877 shutdown_connections 2024-09-19T08:11:09.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.796+0000 7f34b0786640 1 --2- 172.21.15.27:0/4235720877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34a810c0b0 0x7f34a810e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:09.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.796+0000 7f34b0786640 1 --2- 172.21.15.27:0/4235720877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34a8103600 0x7f34a810bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:09.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.796+0000 7f34b0786640 1 --2- 172.21.15.27:0/4235720877 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34a8102ce0 0x7f34a81030c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:09.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.796+0000 7f34b0786640 1 -- 172.21.15.27:0/4235720877 >> 172.21.15.27:0/4235720877 conn(0x7f34a8077990 msgr2=0x7f34a80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:09.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.797+0000 7f34b0786640 1 -- 172.21.15.27:0/4235720877 shutdown_connections 2024-09-19T08:11:09.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.797+0000 7f34b0786640 1 -- 172.21.15.27:0/4235720877 wait complete. 2024-09-19T08:11:09.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.797+0000 7f34b0786640 1 Processor -- start 2024-09-19T08:11:09.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.797+0000 7f34b0786640 1 -- start start 2024-09-19T08:11:09.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.797+0000 7f34b0786640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34a8102ce0 0x7f34a8198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:09.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.797+0000 7f34b0786640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34a8103600 0x7f34a8198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:09.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.797+0000 7f34b0786640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34a810c0b0 0x7f34a819cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:09.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.797+0000 7f34b0786640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f34a8111eb0 con 0x7f34a8102ce0 2024-09-19T08:11:09.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.797+0000 7f34b0786640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f34a8111d30 con 0x7f34a810c0b0 2024-09-19T08:11:09.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.797+0000 7f34b0786640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f34a8112030 con 0x7f34a8103600 2024-09-19T08:11:09.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.797+0000 7f34ae522640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34a8102ce0 0x7f34a8198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:09.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.798+0000 7f34ae522640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34a8102ce0 0x7f34a8198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36016/0 (socket says 172.21.15.27:36016) 2024-09-19T08:11:09.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.798+0000 7f34ae522640 1 -- 172.21.15.27:0/3708699414 learned_addr learned my addr 172.21.15.27:0/3708699414 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:09.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.798+0000 7f34add21640 1 --2- 172.21.15.27:0/3708699414 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34a8103600 0x7f34a8198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:09.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.798+0000 7f34aed23640 1 --2- 172.21.15.27:0/3708699414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34a810c0b0 0x7f34a819cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:09.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.798+0000 7f34ae522640 1 -- 172.21.15.27:0/3708699414 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34a8103600 msgr2=0x7f34a8198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:09.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.798+0000 7f34ae522640 1 --2- 172.21.15.27:0/3708699414 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34a8103600 0x7f34a8198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:09.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.798+0000 7f34ae522640 1 -- 172.21.15.27:0/3708699414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34a810c0b0 msgr2=0x7f34a819cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:09.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.798+0000 7f34ae522640 1 --2- 172.21.15.27:0/3708699414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34a810c0b0 0x7f34a819cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:09.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.798+0000 7f34ae522640 1 -- 172.21.15.27:0/3708699414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a819d2f0 con 0x7f34a8102ce0 2024-09-19T08:11:09.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.798+0000 7f34add21640 1 --2- 172.21.15.27:0/3708699414 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34a8103600 0x7f34a8198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:09.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.798+0000 7f34ae522640 1 --2- 172.21.15.27:0/3708699414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34a8102ce0 0x7f34a8198300 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f34a4006010 tx=0x7f34a4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:09.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.798+0000 7f349f7fe640 1 -- 172.21.15.27:0/3708699414 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a403f030 con 0x7f34a8102ce0 2024-09-19T08:11:09.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.798+0000 7f34b0786640 1 -- 172.21.15.27:0/3708699414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34a819d580 con 0x7f34a8102ce0 2024-09-19T08:11:09.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.798+0000 7f349f7fe640 1 -- 172.21.15.27:0/3708699414 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34a4003ad0 con 0x7f34a8102ce0 2024-09-19T08:11:09.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.798+0000 7f349f7fe640 1 -- 172.21.15.27:0/3708699414 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a4035070 con 0x7f34a8102ce0 2024-09-19T08:11:09.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.798+0000 7f34b0786640 1 -- 172.21.15.27:0/3708699414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34a81a4e70 con 0x7f34a8102ce0 2024-09-19T08:11:09.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.799+0000 7f34b0786640 1 -- 172.21.15.27:0/3708699414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34a81030c0 con 0x7f34a8102ce0 2024-09-19T08:11:09.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.801+0000 7f349f7fe640 1 -- 172.21.15.27:0/3708699414 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f34a4042030 con 0x7f34a8102ce0 2024-09-19T08:11:09.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.801+0000 7f349f7fe640 1 --2- 172.21.15.27:0/3708699414 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f34940a3500 0x7f34940a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:09.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.802+0000 7f34add21640 1 --2- 172.21.15.27:0/3708699414 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f34940a3500 0x7f34940a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:09.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.802+0000 7f349f7fe640 1 -- 172.21.15.27:0/3708699414 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f34a40f0860 con 0x7f34a8102ce0 2024-09-19T08:11:09.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.802+0000 7f34add21640 1 --2- 172.21.15.27:0/3708699414 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f34940a3500 0x7f34940a59c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f34a80ffe50 tx=0x7f3498005f90 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:09.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:09.805+0000 7f349f7fe640 1 -- 172.21.15.27:0/3708699414 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f34a40bd180 con 0x7f34a8102ce0 2024-09-19T08:11:09.899 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:09.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:09 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2960199110' entity='client.admin' 2024-09-19T08:11:09.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:09 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:11:09.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:09 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:11:09.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:09 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:11:09.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:09 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:09.989 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:09 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:11:09.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:09 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:09.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:09 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:11:09.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:09 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:09.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:09 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1164577616' entity='client.admin' 2024-09-19T08:11:09.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:09 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:11:09.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:09 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:11:09.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:09 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:11:09.991 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:09 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:10.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:09 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2960199110' entity='client.admin' 2024-09-19T08:11:10.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:09 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:11:10.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:09 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:11:10.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:09 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:11:10.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:09 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:10.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:09 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:11:10.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:09 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:10.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:09 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:11:10.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:09 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:10.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:09 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1164577616' entity='client.admin' 2024-09-19T08:11:10.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:09 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:11:10.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:09 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:11:10.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:09 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:11:10.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:09 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:10.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:09 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2960199110' entity='client.admin' 2024-09-19T08:11:10.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:09 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:11:10.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:09 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:11:10.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:09 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:11:10.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:09 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:10.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:09 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:11:10.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:09 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:10.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:09 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:11:10.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:09 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:10.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:09 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1164577616' entity='client.admin' 2024-09-19T08:11:10.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:09 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:11:10.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:09 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:11:10.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:09 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:11:10.009 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:09 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:11:10.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.028+0000 7f34b0786640 1 -- 172.21.15.27:0/3708699414 --> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f34a80fd690 con 0x7f34940a3500 2024-09-19T08:11:10.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.035+0000 7f349f7fe640 1 -- 172.21.15.27:0/3708699414 <== mgr.15093 v2:172.21.15.27:6800/1578338135 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f34a80fd690 con 0x7f34940a3500 2024-09-19T08:11:10.036 INFO:teuthology.orchestra.run.smithi027.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T08:11:09", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-19T08:11:10.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.038+0000 7f34b0786640 1 -- 172.21.15.27:0/3708699414 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f34940a3500 msgr2=0x7f34940a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:10.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.038+0000 7f34b0786640 1 --2- 172.21.15.27:0/3708699414 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f34940a3500 0x7f34940a59c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f34a80ffe50 tx=0x7f3498005f90 comp rx=0 tx=0).stop 2024-09-19T08:11:10.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.038+0000 7f34b0786640 1 -- 172.21.15.27:0/3708699414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34a8102ce0 msgr2=0x7f34a8198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:10.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.038+0000 7f34b0786640 1 --2- 172.21.15.27:0/3708699414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34a8102ce0 0x7f34a8198300 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f34a4006010 tx=0x7f34a4004270 comp rx=0 tx=0).stop 2024-09-19T08:11:10.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.038+0000 7f34b0786640 1 -- 172.21.15.27:0/3708699414 shutdown_connections 2024-09-19T08:11:10.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.038+0000 7f34b0786640 1 --2- 172.21.15.27:0/3708699414 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f34940a3500 0x7f34940a59c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.038+0000 7f34b0786640 1 --2- 172.21.15.27:0/3708699414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34a810c0b0 0x7f34a819cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.038+0000 7f34b0786640 1 --2- 172.21.15.27:0/3708699414 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34a8103600 0x7f34a8198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.038+0000 7f34b0786640 1 --2- 172.21.15.27:0/3708699414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34a8102ce0 0x7f34a8198300 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.038+0000 7f34b0786640 1 -- 172.21.15.27:0/3708699414 >> 172.21.15.27:0/3708699414 conn(0x7f34a8077990 msgr2=0x7f34a80fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:10.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.038+0000 7f34b0786640 1 -- 172.21.15.27:0/3708699414 shutdown_connections 2024-09-19T08:11:10.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.038+0000 7f34b0786640 1 -- 172.21.15.27:0/3708699414 wait complete. 2024-09-19T08:11:10.049 DEBUG:teuthology.orchestra.run.smithi027:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T08:11:10.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.154+0000 7f6d500d0640 1 -- 172.21.15.27:0/2847895699 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d481069c0 msgr2=0x7f6d48106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:10.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.154+0000 7f6d500d0640 1 --2- 172.21.15.27:0/2847895699 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d481069c0 0x7f6d48106da0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009930 tx=0x7f6d4402a420 comp rx=0 tx=0).stop 2024-09-19T08:11:10.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.154+0000 7f6d500d0640 1 -- 172.21.15.27:0/2847895699 shutdown_connections 2024-09-19T08:11:10.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.154+0000 7f6d500d0640 1 --2- 172.21.15.27:0/2847895699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d48101350 0x7f6d4810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.154+0000 7f6d500d0640 1 --2- 172.21.15.27:0/2847895699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d481009b0 0x7f6d48100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.154+0000 7f6d500d0640 1 --2- 172.21.15.27:0/2847895699 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d481069c0 0x7f6d48106da0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.154+0000 7f6d500d0640 1 -- 172.21.15.27:0/2847895699 >> 172.21.15.27:0/2847895699 conn(0x7f6d48077990 msgr2=0x7f6d480fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:10.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.154+0000 7f6d500d0640 1 -- 172.21.15.27:0/2847895699 shutdown_connections 2024-09-19T08:11:10.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.154+0000 7f6d500d0640 1 -- 172.21.15.27:0/2847895699 wait complete. 2024-09-19T08:11:10.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.155+0000 7f6d500d0640 1 Processor -- start 2024-09-19T08:11:10.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.155+0000 7f6d500d0640 1 -- start start 2024-09-19T08:11:10.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.155+0000 7f6d500d0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d481009b0 0x7f6d481991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.155+0000 7f6d500d0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d48101350 0x7f6d48199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.155+0000 7f6d500d0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d481069c0 0x7f6d481a4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.155+0000 7f6d500d0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6d48110e00 con 0x7f6d481009b0 2024-09-19T08:11:10.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.155+0000 7f6d500d0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6d48110c80 con 0x7f6d481069c0 2024-09-19T08:11:10.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.155+0000 7f6d500d0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6d48110f80 con 0x7f6d48101350 2024-09-19T08:11:10.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.155+0000 7f6d4de6c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d481009b0 0x7f6d481991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.155+0000 7f6d4de6c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d481009b0 0x7f6d481991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45076/0 (socket says 172.21.15.27:45076) 2024-09-19T08:11:10.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.155+0000 7f6d4de6c640 1 -- 172.21.15.27:0/3119151013 learned_addr learned my addr 172.21.15.27:0/3119151013 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:10.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.155+0000 7f6d4e66d640 1 --2- 172.21.15.27:0/3119151013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d481069c0 0x7f6d481a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.155+0000 7f6d4d66b640 1 --2- 172.21.15.27:0/3119151013 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d48101350 0x7f6d48199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.155+0000 7f6d4de6c640 1 -- 172.21.15.27:0/3119151013 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d48101350 msgr2=0x7f6d48199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:10.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.156+0000 7f6d4de6c640 1 --2- 172.21.15.27:0/3119151013 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d48101350 0x7f6d48199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.156+0000 7f6d4de6c640 1 -- 172.21.15.27:0/3119151013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d481069c0 msgr2=0x7f6d481a4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:10.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.156+0000 7f6d4de6c640 1 --2- 172.21.15.27:0/3119151013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d481069c0 0x7f6d481a4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.156+0000 7f6d4de6c640 1 -- 172.21.15.27:0/3119151013 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d481a47a0 con 0x7f6d481009b0 2024-09-19T08:11:10.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.156+0000 7f6d4de6c640 1 --2- 172.21.15.27:0/3119151013 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d481009b0 0x7f6d481991e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009230 tx=0x7f6d44004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:10.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.156+0000 7f6d3affd640 1 -- 172.21.15.27:0/3119151013 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4403f030 con 0x7f6d481009b0 2024-09-19T08:11:10.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.156+0000 7f6d3affd640 1 -- 172.21.15.27:0/3119151013 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d44003ad0 con 0x7f6d481009b0 2024-09-19T08:11:10.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.156+0000 7f6d500d0640 1 -- 172.21.15.27:0/3119151013 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d481a4970 con 0x7f6d481009b0 2024-09-19T08:11:10.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.156+0000 7f6d3affd640 1 -- 172.21.15.27:0/3119151013 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d44035070 con 0x7f6d481009b0 2024-09-19T08:11:10.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.156+0000 7f6d500d0640 1 -- 172.21.15.27:0/3119151013 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d481a4dd0 con 0x7f6d481009b0 2024-09-19T08:11:10.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.157+0000 7f6d500d0640 1 -- 172.21.15.27:0/3119151013 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d48100e10 con 0x7f6d481009b0 2024-09-19T08:11:10.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.158+0000 7f6d3affd640 1 -- 172.21.15.27:0/3119151013 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f6d44042030 con 0x7f6d481009b0 2024-09-19T08:11:10.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.159+0000 7f6d3affd640 1 --2- 172.21.15.27:0/3119151013 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6d340a3500 0x7f6d340a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.159+0000 7f6d4d66b640 1 --2- 172.21.15.27:0/3119151013 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6d340a3500 0x7f6d340a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.159+0000 7f6d3affd640 1 -- 172.21.15.27:0/3119151013 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f6d440f0720 con 0x7f6d481009b0 2024-09-19T08:11:10.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.160+0000 7f6d4d66b640 1 --2- 172.21.15.27:0/3119151013 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6d340a3500 0x7f6d340a59c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c005fd0 tx=0x7f6d3c005850 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:10.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.162+0000 7f6d3affd640 1 -- 172.21.15.27:0/3119151013 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6d440bcfe0 con 0x7f6d481009b0 2024-09-19T08:11:10.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.388+0000 7f6d500d0640 1 -- 172.21.15.27:0/3119151013 --> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f6d48062630 con 0x7f6d340a3500 2024-09-19T08:11:10.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.395+0000 7f6d3affd640 1 -- 172.21.15.27:0/3119151013 <== mgr.15093 v2:172.21.15.27:6800/1578338135 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f6d48062630 con 0x7f6d340a3500 2024-09-19T08:11:10.396 INFO:teuthology.orchestra.run.smithi027.stdout:/ 1m 6m3h 2024-09-19T08:11:10.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.397+0000 7f6d500d0640 1 -- 172.21.15.27:0/3119151013 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6d340a3500 msgr2=0x7f6d340a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:10.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.397+0000 7f6d500d0640 1 --2- 172.21.15.27:0/3119151013 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6d340a3500 0x7f6d340a59c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c005fd0 tx=0x7f6d3c005850 comp rx=0 tx=0).stop 2024-09-19T08:11:10.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.397+0000 7f6d500d0640 1 -- 172.21.15.27:0/3119151013 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d481009b0 msgr2=0x7f6d481991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:10.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.397+0000 7f6d500d0640 1 --2- 172.21.15.27:0/3119151013 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d481009b0 0x7f6d481991e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009230 tx=0x7f6d44004270 comp rx=0 tx=0).stop 2024-09-19T08:11:10.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.397+0000 7f6d500d0640 1 -- 172.21.15.27:0/3119151013 shutdown_connections 2024-09-19T08:11:10.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.397+0000 7f6d500d0640 1 --2- 172.21.15.27:0/3119151013 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6d340a3500 0x7f6d340a59c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.397+0000 7f6d500d0640 1 --2- 172.21.15.27:0/3119151013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d481069c0 0x7f6d481a4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.397+0000 7f6d500d0640 1 --2- 172.21.15.27:0/3119151013 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d48101350 0x7f6d48199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.397+0000 7f6d500d0640 1 --2- 172.21.15.27:0/3119151013 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d481009b0 0x7f6d481991e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.397+0000 7f6d500d0640 1 -- 172.21.15.27:0/3119151013 >> 172.21.15.27:0/3119151013 conn(0x7f6d48077990 msgr2=0x7f6d481038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:10.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.397+0000 7f6d500d0640 1 -- 172.21.15.27:0/3119151013 shutdown_connections 2024-09-19T08:11:10.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.397+0000 7f6d500d0640 1 -- 172.21.15.27:0/3119151013 wait complete. 2024-09-19T08:11:10.409 DEBUG:teuthology.orchestra.run.smithi027:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-19T08:11:10.437 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-19T08:11:10.446 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-19T08:11:10.460 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T08:11:10.461 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:11:10.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.447+0000 7f71f6c22640 1 -- 172.21.15.27:0/645943186 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71f0106a90 msgr2=0x7f71f0106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:10.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.447+0000 7f71f6c22640 1 --2- 172.21.15.27:0/645943186 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71f0106a90 0x7f71f0106e70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009930 tx=0x7f71e402a420 comp rx=0 tx=0).stop 2024-09-19T08:11:10.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.447+0000 7f71f6c22640 1 -- 172.21.15.27:0/645943186 shutdown_connections 2024-09-19T08:11:10.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.447+0000 7f71f6c22640 1 --2- 172.21.15.27:0/645943186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71f0101430 0x7f71f010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.447+0000 7f71f6c22640 1 --2- 172.21.15.27:0/645943186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71f0100a90 0x7f71f0100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.447+0000 7f71f6c22640 1 --2- 172.21.15.27:0/645943186 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71f0106a90 0x7f71f0106e70 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.447+0000 7f71f6c22640 1 -- 172.21.15.27:0/645943186 >> 172.21.15.27:0/645943186 conn(0x7f71f00fc7d0 msgr2=0x7f71f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:10.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.447+0000 7f71f6c22640 1 -- 172.21.15.27:0/645943186 shutdown_connections 2024-09-19T08:11:10.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.447+0000 7f71f6c22640 1 -- 172.21.15.27:0/645943186 wait complete. 2024-09-19T08:11:10.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.448+0000 7f71f6c22640 1 Processor -- start 2024-09-19T08:11:10.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.448+0000 7f71f6c22640 1 -- start start 2024-09-19T08:11:10.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.448+0000 7f71f6c22640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71f0100a90 0x7f71f0199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.448+0000 7f71f6c22640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71f0101430 0x7f71f0199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.448+0000 7f71f6c22640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71f0106a90 0x7f71f01a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.449+0000 7f71f6c22640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f71f0110f00 con 0x7f71f0101430 2024-09-19T08:11:10.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.449+0000 7f71f6c22640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f71f0110d80 con 0x7f71f0106a90 2024-09-19T08:11:10.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.449+0000 7f71f6c22640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f71f0111080 con 0x7f71f0100a90 2024-09-19T08:11:10.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.449+0000 7f71effff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71f0101430 0x7f71f0199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.449+0000 7f71effff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71f0101430 0x7f71f0199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45094/0 (socket says 172.21.15.27:45094) 2024-09-19T08:11:10.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.449+0000 7f71effff640 1 -- 172.21.15.27:0/1285788152 learned_addr learned my addr 172.21.15.27:0/1285788152 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:10.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.449+0000 7f71f49be640 1 --2- 172.21.15.27:0/1285788152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71f0100a90 0x7f71f0199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.449+0000 7f71f51bf640 1 --2- 172.21.15.27:0/1285788152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71f0106a90 0x7f71f01a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.449+0000 7f71effff640 1 -- 172.21.15.27:0/1285788152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71f0100a90 msgr2=0x7f71f0199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:10.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.449+0000 7f71effff640 1 --2- 172.21.15.27:0/1285788152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71f0100a90 0x7f71f0199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.449+0000 7f71effff640 1 -- 172.21.15.27:0/1285788152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71f0106a90 msgr2=0x7f71f01a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:10.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.449+0000 7f71effff640 1 --2- 172.21.15.27:0/1285788152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71f0106a90 0x7f71f01a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.449+0000 7f71effff640 1 -- 172.21.15.27:0/1285788152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f01a48f0 con 0x7f71f0101430 2024-09-19T08:11:10.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.449+0000 7f71f51bf640 1 --2- 172.21.15.27:0/1285788152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71f0106a90 0x7f71f01a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:10.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.449+0000 7f71effff640 1 --2- 172.21.15.27:0/1285788152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71f0101430 0x7f71f0199870 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f71dc00c890 tx=0x7f71dc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:10.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.449+0000 7f71edffb640 1 -- 172.21.15.27:0/1285788152 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc004220 con 0x7f71f0101430 2024-09-19T08:11:10.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.449+0000 7f71edffb640 1 -- 172.21.15.27:0/1285788152 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71dc0043c0 con 0x7f71f0101430 2024-09-19T08:11:10.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.449+0000 7f71f6c22640 1 -- 172.21.15.27:0/1285788152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f01a4ac0 con 0x7f71f0101430 2024-09-19T08:11:10.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.449+0000 7f71edffb640 1 -- 172.21.15.27:0/1285788152 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc0049e0 con 0x7f71f0101430 2024-09-19T08:11:10.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.450+0000 7f71f6c22640 1 -- 172.21.15.27:0/1285788152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f01a5000 con 0x7f71f0101430 2024-09-19T08:11:10.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.452+0000 7f71edffb640 1 -- 172.21.15.27:0/1285788152 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f71dc0079b0 con 0x7f71f0101430 2024-09-19T08:11:10.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.452+0000 7f71f8ffb740 1 Processor -- start 2024-09-19T08:11:10.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.452+0000 7f71f8ffb740 1 -- start start 2024-09-19T08:11:10.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.452+0000 7f71edffb640 1 --2- 172.21.15.27:0/1285788152 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f71e00a34c0 0x7f71e00a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.452+0000 7f71f8ffb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ae3b0933a0 0x55ae3b093780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.452+0000 7f71f8ffb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b093cc0 0x55ae3b0a2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71f8ffb740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b0a2a90 0x55ae3b0a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71f8ffb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55ae3aff92e0 con 0x55ae3b093cc0 2024-09-19T08:11:10.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71f8ffb740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ae3afa0ce0 con 0x55ae3b0a2a90 2024-09-19T08:11:10.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71f8ffb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ae3aff52a0 con 0x55ae3b0933a0 2024-09-19T08:11:10.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71f51bf640 1 --2- 172.21.15.27:0/1285788152 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f71e00a34c0 0x7f71e00a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71effff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b093cc0 0x55ae3b0a2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71edffb640 1 -- 172.21.15.27:0/1285788152 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f71dc0cfe50 con 0x7f71f0101430 2024-09-19T08:11:10.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71effff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b093cc0 0x55ae3b0a2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45106/0 (socket says 172.21.15.27:45106) 2024-09-19T08:11:10.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71effff640 1 -- 172.21.15.27:0/3025114059 learned_addr learned my addr 172.21.15.27:0/3025114059 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:10.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71f49be640 1 --2- 172.21.15.27:0/3025114059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ae3b0933a0 0x55ae3b093780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71f51bf640 1 --2- 172.21.15.27:0/3025114059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b0a2a90 0x55ae3b0a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71effff640 1 -- 172.21.15.27:0/3025114059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ae3b0933a0 msgr2=0x55ae3b093780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:10.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71effff640 1 --2- 172.21.15.27:0/3025114059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ae3b0933a0 0x55ae3b093780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71effff640 1 -- 172.21.15.27:0/3025114059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b0a2a90 msgr2=0x55ae3b0a4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:10.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71effff640 1 --2- 172.21.15.27:0/3025114059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b0a2a90 0x55ae3b0a4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71effff640 1 -- 172.21.15.27:0/3025114059 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae3af85440 con 0x55ae3b093cc0 2024-09-19T08:11:10.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71f51bf640 1 --2- 172.21.15.27:0/1285788152 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f71e00a34c0 0x7f71e00a5980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f71e800c470 tx=0x7f71e80099d0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:10.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71effff640 1 --2- 172.21.15.27:0/3025114059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b093cc0 0x55ae3b0a2550 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f71dc005fd0 tx=0x7f71dc09bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db99b19b2069aaa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:10.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71daffd640 1 -- 172.21.15.27:0/3025114059 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc01d070 con 0x55ae3b093cc0 2024-09-19T08:11:10.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71daffd640 1 -- 172.21.15.27:0/3025114059 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71dc09c710 con 0x55ae3b093cc0 2024-09-19T08:11:10.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.453+0000 7f71daffd640 1 -- 172.21.15.27:0/3025114059 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc0a4c80 con 0x55ae3b093cc0 2024-09-19T08:11:10.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.454+0000 7f71f8ffb740 1 -- 172.21.15.27:0/3025114059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b093cc0 msgr2=0x55ae3b0a2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:10.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.454+0000 7f71f8ffb740 1 --2- 172.21.15.27:0/3025114059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b093cc0 0x55ae3b0a2550 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f71dc005fd0 tx=0x7f71dc09bc10 comp rx=0 tx=0).stop 2024-09-19T08:11:10.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.454+0000 7f71f8ffb740 1 -- 172.21.15.27:0/3025114059 shutdown_connections 2024-09-19T08:11:10.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.454+0000 7f71f8ffb740 1 --2- 172.21.15.27:0/3025114059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b0a2a90 0x55ae3b0a4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.454+0000 7f71f8ffb740 1 --2- 172.21.15.27:0/3025114059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b093cc0 0x55ae3b0a2550 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.454+0000 7f71f8ffb740 1 --2- 172.21.15.27:0/3025114059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ae3b0933a0 0x55ae3b093780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.454+0000 7f71f8ffb740 1 -- 172.21.15.27:0/3025114059 >> 172.21.15.27:0/3025114059 conn(0x55ae3b08fa30 msgr2=0x55ae3b08fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:10.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.454+0000 7f71f8ffb740 1 -- 172.21.15.27:0/3025114059 shutdown_connections 2024-09-19T08:11:10.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.454+0000 7f71f8ffb740 1 -- 172.21.15.27:0/3025114059 wait complete. 2024-09-19T08:11:10.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.455+0000 7f71f8ffb740 1 -- start start 2024-09-19T08:11:10.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.455+0000 7f71f8ffb740 1 Processor -- start 2024-09-19T08:11:10.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.455+0000 7f71f8ffb740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b0933a0 0x55ae3b0a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.455+0000 7f71f8ffb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b093cc0 0x55ae3b09f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.455+0000 7f71f8ffb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ae3b0a2a90 0x55ae3b09fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.455+0000 7f71f8ffb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55ae3b0a5660 con 0x55ae3b093cc0 2024-09-19T08:11:10.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.455+0000 7f71f8ffb740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ae3afb4050 con 0x55ae3b0933a0 2024-09-19T08:11:10.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.455+0000 7f71f8ffb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ae3b0a57e0 con 0x55ae3b0a2a90 2024-09-19T08:11:10.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.455+0000 7f71f8ffb740 10 client.0 _ll_register_callbacks cb 0x55ae3aff4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:10.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.455+0000 7f71effff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b093cc0 0x55ae3b09f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.455+0000 7f71effff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b093cc0 0x55ae3b09f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45114/0 (socket says 172.21.15.27:45114) 2024-09-19T08:11:10.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.455+0000 7f71effff640 1 -- 172.21.15.27:0/2539565153 learned_addr learned my addr 172.21.15.27:0/2539565153 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:10.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.455+0000 7f71f49be640 1 --2- 172.21.15.27:0/2539565153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b0933a0 0x55ae3b0a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.455+0000 7f71f51bf640 1 --2- 172.21.15.27:0/2539565153 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ae3b0a2a90 0x55ae3b09fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.456+0000 7f71effff640 1 -- 172.21.15.27:0/2539565153 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ae3b0a2a90 msgr2=0x55ae3b09fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:10.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.456+0000 7f71effff640 1 --2- 172.21.15.27:0/2539565153 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ae3b0a2a90 0x55ae3b09fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.456+0000 7f71effff640 1 -- 172.21.15.27:0/2539565153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b0933a0 msgr2=0x55ae3b0a24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:10.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.456+0000 7f71effff640 1 --2- 172.21.15.27:0/2539565153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b0933a0 0x55ae3b0a24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.456+0000 7f71effff640 1 -- 172.21.15.27:0/2539565153 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae3ad6a3c0 con 0x55ae3b093cc0 2024-09-19T08:11:10.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.456+0000 7f71f49be640 1 --2- 172.21.15.27:0/2539565153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b0933a0 0x55ae3b0a24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:11:10.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.456+0000 7f71effff640 1 --2- 172.21.15.27:0/2539565153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b093cc0 0x55ae3b09f750 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0cdbf0 tx=0x7f71dc005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c5800cb39dbcfe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:10.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.456+0000 7f71cffff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:10.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.456+0000 7f71cffff640 1 -- 172.21.15.27:0/2539565153 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc01d070 con 0x55ae3b093cc0 2024-09-19T08:11:10.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.456+0000 7f71cffff640 1 -- 172.21.15.27:0/2539565153 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f71dc07abf0 con 0x55ae3b093cc0 2024-09-19T08:11:10.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.456+0000 7f71f8ffb740 1 -- 172.21.15.27:0/2539565153 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71dc09c710 con 0x55ae3b093cc0 2024-09-19T08:11:10.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.456+0000 7f71cffff640 1 -- 172.21.15.27:0/2539565153 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f71dc077030 con 0x55ae3b093cc0 2024-09-19T08:11:10.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.456+0000 7f71f8ffb740 10 client.15273 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:10.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.456+0000 7f71f8ffb740 1 -- 172.21.15.27:0/2539565153 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ae3b0b1130 con 0x55ae3b093cc0 2024-09-19T08:11:10.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.456+0000 7f71cffff640 1 -- 172.21.15.27:0/2539565153 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71dc09c710 con 0x55ae3b093cc0 2024-09-19T08:11:10.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.457+0000 7f71cffff640 1 -- 172.21.15.27:0/2539565153 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f71dc0cd7e0 con 0x55ae3b093cc0 2024-09-19T08:11:10.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.457+0000 7f71f8ffb740 10 client.15273 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:10.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.457+0000 7f71f8ffb740 10 client.15273 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:10.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.457+0000 7f71f8ffb740 20 client.15273 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:10.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.457+0000 7f71f8ffb740 1 --2- 172.21.15.27:0/2539565153 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ae3b0b2480 0x55ae3b0b4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.457+0000 7f71f8ffb740 4 client.15273 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:11:10.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.457+0000 7f71f8ffb740 1 -- 172.21.15.27:0/2539565153 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae3b006850 con 0x55ae3b0b2480 2024-09-19T08:11:10.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.457+0000 7f71f49be640 1 --2- 172.21.15.27:0/2539565153 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ae3b0b2480 0x55ae3b0b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.457+0000 7f71cffff640 10 client.15273 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:10.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.457+0000 7f71f49be640 1 --2- 172.21.15.27:0/2539565153 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ae3b0b2480 0x55ae3b0b4870 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b06d936b121fa37 server_cookie=716e6f79ccf963dd in_seq=0 out_seq=0 2024-09-19T08:11:10.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.458+0000 7f71cffff640 1 -- 172.21.15.27:0/2539565153 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae3b006850 con 0x55ae3b0b2480 2024-09-19T08:11:10.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.458+0000 7f71cffff640 10 client.15273 handle_command_reply: tid=0 2024-09-19T08:11:10.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.458+0000 7f71f8ffb740 1 client.15273 shutdown 2024-09-19T08:11:10.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.458+0000 7f71f8ffb740 1 -- 172.21.15.27:0/2539565153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b093cc0 msgr2=0x55ae3b09f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:10.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.458+0000 7f71f8ffb740 1 --2- 172.21.15.27:0/2539565153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b093cc0 0x55ae3b09f750 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0cdbf0 tx=0x7f71dc005300 comp rx=0 tx=0).stop 2024-09-19T08:11:10.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.458+0000 7f71f8ffb740 1 -- 172.21.15.27:0/2539565153 shutdown_connections 2024-09-19T08:11:10.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.458+0000 7f71f8ffb740 1 --2- 172.21.15.27:0/2539565153 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ae3b0b2480 0x55ae3b0b4870 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.458+0000 7f71cffff640 0 client.15273 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:10.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.458+0000 7f71f8ffb740 1 --2- 172.21.15.27:0/2539565153 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ae3b0a2a90 0x55ae3b09fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.458+0000 7f71f8ffb740 1 --2- 172.21.15.27:0/2539565153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b093cc0 0x55ae3b09f750 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.458+0000 7f71f8ffb740 1 --2- 172.21.15.27:0/2539565153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b0933a0 0x55ae3b0a24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.458+0000 7f71f8ffb740 1 -- 172.21.15.27:0/2539565153 >> 172.21.15.27:0/2539565153 conn(0x55ae3b08fa30 msgr2=0x55ae3b095790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:10.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.459+0000 7f71f8ffb740 1 -- 172.21.15.27:0/2539565153 shutdown_connections 2024-09-19T08:11:10.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.459+0000 7f71f8ffb740 1 -- 172.21.15.27:0/2539565153 wait complete. 2024-09-19T08:11:10.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.459+0000 7f71f8ffb740 20 client.15273 trim_cache size 0 max 16384 2024-09-19T08:11:10.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.476+0000 7f71f8ffb740 1 Processor -- start 2024-09-19T08:11:10.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.476+0000 7f71f8ffb740 1 -- start start 2024-09-19T08:11:10.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.476+0000 7f71f8ffb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b0933a0 0x55ae3b0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.476+0000 7f71f8ffb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ae3b093cc0 0x55ae3b09c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.476+0000 7f71f8ffb740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b0a2a90 0x55ae3b09cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.476+0000 7f71f8ffb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f71f01a95b0 con 0x55ae3b0933a0 2024-09-19T08:11:10.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.476+0000 7f71f8ffb740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f71f01abe30 con 0x55ae3b0a2a90 2024-09-19T08:11:10.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.476+0000 7f71f8ffb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f71f01a9c20 con 0x55ae3b093cc0 2024-09-19T08:11:10.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.476+0000 7f71f49be640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b0933a0 0x55ae3b0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.476+0000 7f71f49be640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b0933a0 0x55ae3b0aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45130/0 (socket says 172.21.15.27:45130) 2024-09-19T08:11:10.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.476+0000 7f71f49be640 1 -- 172.21.15.27:0/336367261 learned_addr learned my addr 172.21.15.27:0/336367261 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:10.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.477+0000 7f71effff640 1 --2- 172.21.15.27:0/336367261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ae3b093cc0 0x55ae3b09c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.477+0000 7f71f49be640 1 -- 172.21.15.27:0/336367261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ae3b093cc0 msgr2=0x55ae3b09c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:10.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.477+0000 7f71f49be640 1 --2- 172.21.15.27:0/336367261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ae3b093cc0 0x55ae3b09c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.477+0000 7f71f51bf640 1 --2- 172.21.15.27:0/336367261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b0a2a90 0x55ae3b09cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.477+0000 7f71f49be640 1 -- 172.21.15.27:0/336367261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b0a2a90 msgr2=0x55ae3b09cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:10.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.477+0000 7f71f49be640 1 --2- 172.21.15.27:0/336367261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b0a2a90 0x55ae3b09cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.477+0000 7f71f49be640 1 -- 172.21.15.27:0/336367261 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae3b0a00d0 con 0x55ae3b0933a0 2024-09-19T08:11:10.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.477+0000 7f71f51bf640 1 --2- 172.21.15.27:0/336367261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b0a2a90 0x55ae3b09cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:11:10.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.477+0000 7f71f49be640 1 --2- 172.21.15.27:0/336367261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b0933a0 0x55ae3b0aea80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f71e402a9e0 tx=0x7f71e4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1dc89a3245dc5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:10.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.477+0000 7f71da7fc640 1 -- 172.21.15.27:0/336367261 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e404a030 con 0x55ae3b0933a0 2024-09-19T08:11:10.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.477+0000 7f71da7fc640 1 -- 172.21.15.27:0/336367261 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71e4005500 con 0x55ae3b0933a0 2024-09-19T08:11:10.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.477+0000 7f71da7fc640 1 -- 172.21.15.27:0/336367261 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4035040 con 0x55ae3b0933a0 2024-09-19T08:11:10.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.478+0000 7f71f8ffb740 1 -- 172.21.15.27:0/336367261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b0933a0 msgr2=0x55ae3b0aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:10.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.478+0000 7f71f8ffb740 1 --2- 172.21.15.27:0/336367261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b0933a0 0x55ae3b0aea80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f71e402a9e0 tx=0x7f71e4000bc0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.478+0000 7f71f8ffb740 1 -- 172.21.15.27:0/336367261 shutdown_connections 2024-09-19T08:11:10.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.478+0000 7f71f8ffb740 1 --2- 172.21.15.27:0/336367261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b0a2a90 0x55ae3b09cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.478+0000 7f71f8ffb740 1 --2- 172.21.15.27:0/336367261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ae3b093cc0 0x55ae3b09c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.478+0000 7f71f8ffb740 1 --2- 172.21.15.27:0/336367261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b0933a0 0x55ae3b0aea80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.478+0000 7f71f8ffb740 1 -- 172.21.15.27:0/336367261 >> 172.21.15.27:0/336367261 conn(0x55ae3b08fa30 msgr2=0x55ae3b09e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:10.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.478+0000 7f71f8ffb740 1 -- 172.21.15.27:0/336367261 shutdown_connections 2024-09-19T08:11:10.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.478+0000 7f71f8ffb740 1 -- 172.21.15.27:0/336367261 wait complete. 2024-09-19T08:11:10.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.478+0000 7f71f8ffb740 1 -- start start 2024-09-19T08:11:10.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.478+0000 7f71f8ffb740 1 Processor -- start 2024-09-19T08:11:10.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.479+0000 7f71f8ffb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b0933a0 0x55ae3b0b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.479+0000 7f71f8ffb740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b093cc0 0x55ae3b0b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.479+0000 7f71f8ffb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ae3b0a2a90 0x55ae3b0b76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.479+0000 7f71f8ffb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f71f01aa2f0 con 0x55ae3b0933a0 2024-09-19T08:11:10.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.479+0000 7f71f8ffb740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f71f01ab760 con 0x55ae3b093cc0 2024-09-19T08:11:10.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.479+0000 7f71f8ffb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f71f01aa9c0 con 0x55ae3b0a2a90 2024-09-19T08:11:10.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.479+0000 7f71f8ffb740 10 client.0 _ll_register_callbacks cb 0x7f71e4005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:10.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.479+0000 7f71f49be640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b0933a0 0x55ae3b0b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.479+0000 7f71f49be640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b0933a0 0x55ae3b0b50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45136/0 (socket says 172.21.15.27:45136) 2024-09-19T08:11:10.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.479+0000 7f71f49be640 1 -- 172.21.15.27:0/193561089 learned_addr learned my addr 172.21.15.27:0/193561089 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:10.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.479+0000 7f71f51bf640 1 --2- 172.21.15.27:0/193561089 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ae3b0a2a90 0x55ae3b0b76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.479+0000 7f71effff640 1 --2- 172.21.15.27:0/193561089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b093cc0 0x55ae3b0b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.479+0000 7f71f49be640 1 -- 172.21.15.27:0/193561089 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ae3b0a2a90 msgr2=0x55ae3b0b76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:10.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.479+0000 7f71f49be640 1 --2- 172.21.15.27:0/193561089 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ae3b0a2a90 0x55ae3b0b76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.479+0000 7f71f49be640 1 -- 172.21.15.27:0/193561089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b093cc0 msgr2=0x55ae3b0b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:10.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.479+0000 7f71f49be640 1 --2- 172.21.15.27:0/193561089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b093cc0 0x55ae3b0b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.479+0000 7f71f49be640 1 -- 172.21.15.27:0/193561089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae3b093af0 con 0x55ae3b0933a0 2024-09-19T08:11:10.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.480+0000 7f71f49be640 1 --2- 172.21.15.27:0/193561089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b0933a0 0x55ae3b0b50b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009230 tx=0x7f71e402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637352abc2a55654 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:10.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.480+0000 7f71cffff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:10.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.480+0000 7f71cffff640 1 -- 172.21.15.27:0/193561089 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4052030 con 0x55ae3b0933a0 2024-09-19T08:11:10.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.480+0000 7f71cffff640 1 -- 172.21.15.27:0/193561089 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f71e40050e0 con 0x55ae3b0933a0 2024-09-19T08:11:10.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.480+0000 7f71f8ffb740 1 -- 172.21.15.27:0/193561089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71e4005500 con 0x55ae3b0933a0 2024-09-19T08:11:10.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.480+0000 7f71cffff640 1 -- 172.21.15.27:0/193561089 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f71e405b020 con 0x55ae3b0933a0 2024-09-19T08:11:10.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.480+0000 7f71f8ffb740 10 client.15279 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:10.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.480+0000 7f71f8ffb740 1 -- 172.21.15.27:0/193561089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ae3b11c6e0 con 0x55ae3b0933a0 2024-09-19T08:11:10.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.480+0000 7f71cffff640 1 -- 172.21.15.27:0/193561089 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71e4005500 con 0x55ae3b0933a0 2024-09-19T08:11:10.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.481+0000 7f71cffff640 1 -- 172.21.15.27:0/193561089 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f71e40035f0 con 0x55ae3b0933a0 2024-09-19T08:11:10.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.481+0000 7f71f8ffb740 10 client.15279 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:10.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.481+0000 7f71f8ffb740 10 client.15279 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:10.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.481+0000 7f71f8ffb740 20 client.15279 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:10.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.481+0000 7f71f8ffb740 1 --2- 172.21.15.27:0/193561089 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ae3b0b2480 0x55ae3b11ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:10.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.481+0000 7f71f8ffb740 4 client.15279 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:11:10.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.481+0000 7f71f8ffb740 1 -- 172.21.15.27:0/193561089 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ae3b000d60 con 0x55ae3b0b2480 2024-09-19T08:11:10.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.481+0000 7f71effff640 1 --2- 172.21.15.27:0/193561089 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ae3b0b2480 0x55ae3b11ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:10.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.482+0000 7f71effff640 1 --2- 172.21.15.27:0/193561089 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ae3b0b2480 0x55ae3b11ed70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=792ae767fad2e098 server_cookie=51393f33c5e53af2 in_seq=0 out_seq=0 2024-09-19T08:11:10.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.482+0000 7f71cffff640 10 client.15279 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:10.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.482+0000 7f71cffff640 1 -- 172.21.15.27:0/193561089 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ae3b000d60 con 0x55ae3b0b2480 2024-09-19T08:11:10.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.482+0000 7f71cffff640 10 client.15279 handle_command_reply: tid=0 2024-09-19T08:11:10.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.482+0000 7f71f8ffb740 1 client.15279 shutdown 2024-09-19T08:11:10.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.482+0000 7f71f8ffb740 1 -- 172.21.15.27:0/193561089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b0933a0 msgr2=0x55ae3b0b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:10.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.482+0000 7f71f8ffb740 1 --2- 172.21.15.27:0/193561089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b0933a0 0x55ae3b0b50b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009230 tx=0x7f71e402a420 comp rx=0 tx=0).stop 2024-09-19T08:11:10.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.482+0000 7f71f8ffb740 1 -- 172.21.15.27:0/193561089 shutdown_connections 2024-09-19T08:11:10.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.482+0000 7f71f8ffb740 1 --2- 172.21.15.27:0/193561089 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ae3b0b2480 0x55ae3b11ed70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.482+0000 7f71f8ffb740 1 --2- 172.21.15.27:0/193561089 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ae3b0a2a90 0x55ae3b0b76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.482+0000 7f71f8ffb740 1 --2- 172.21.15.27:0/193561089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ae3b093cc0 0x55ae3b0b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.482+0000 7f71f8ffb740 1 --2- 172.21.15.27:0/193561089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ae3b0933a0 0x55ae3b0b50b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.482+0000 7f71f8ffb740 1 -- 172.21.15.27:0/193561089 >> 172.21.15.27:0/193561089 conn(0x55ae3b08fa30 msgr2=0x55ae3b0a0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:10.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.482+0000 7f71cffff640 0 client.15279 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:10.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.483+0000 7f71f8ffb740 1 -- 172.21.15.27:0/193561089 shutdown_connections 2024-09-19T08:11:10.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.483+0000 7f71f8ffb740 1 -- 172.21.15.27:0/193561089 wait complete. 2024-09-19T08:11:10.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.483+0000 7f71f8ffb740 20 client.15279 trim_cache size 0 max 16384 2024-09-19T08:11:10.488 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:11:10.489 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:11:10.489 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:11:10.489 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:11:10.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.483+0000 7f71f6c22640 1 -- 172.21.15.27:0/1285788152 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f71e00a34c0 msgr2=0x7f71e00a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:10.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.483+0000 7f71f6c22640 1 --2- 172.21.15.27:0/1285788152 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f71e00a34c0 0x7f71e00a5980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f71e800c470 tx=0x7f71e80099d0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.483+0000 7f71f6c22640 1 -- 172.21.15.27:0/1285788152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71f0101430 msgr2=0x7f71f0199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:10.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.483+0000 7f71f6c22640 1 --2- 172.21.15.27:0/1285788152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71f0101430 0x7f71f0199870 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f71dc00c890 tx=0x7f71dc00cd50 comp rx=0 tx=0).stop 2024-09-19T08:11:10.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.484+0000 7f71f6c22640 1 -- 172.21.15.27:0/1285788152 shutdown_connections 2024-09-19T08:11:10.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.484+0000 7f71f6c22640 1 --2- 172.21.15.27:0/1285788152 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f71e00a34c0 0x7f71e00a5980 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.484+0000 7f71f6c22640 1 --2- 172.21.15.27:0/1285788152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71f0106a90 0x7f71f01a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.484+0000 7f71f6c22640 1 --2- 172.21.15.27:0/1285788152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71f0101430 0x7f71f0199870 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.484+0000 7f71f6c22640 1 --2- 172.21.15.27:0/1285788152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71f0100a90 0x7f71f0199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:10.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.484+0000 7f71f6c22640 1 -- 172.21.15.27:0/1285788152 >> 172.21.15.27:0/1285788152 conn(0x7f71f00fc7d0 msgr2=0x7f71f00fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:10.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.484+0000 7f71f6c22640 1 -- 172.21.15.27:0/1285788152 shutdown_connections 2024-09-19T08:11:10.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:10.484+0000 7f71f6c22640 1 -- 172.21.15.27:0/1285788152 wait complete. 2024-09-19T08:11:11.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:10 smithi155 ceph-mon[35362]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:11:11.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:10 smithi155 ceph-mon[35362]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-19T08:11:11.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:10 smithi155 ceph-mon[35362]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:11:11.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:10 smithi155 ceph-mon[35362]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:11:11.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:10 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:11:11.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:10 smithi027 ceph-mon[31209]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:11:11.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:10 smithi027 ceph-mon[31209]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-19T08:11:11.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:10 smithi027 ceph-mon[31209]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:11:11.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:10 smithi027 ceph-mon[31209]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:11:11.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:10 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:11:11.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:10 smithi203 ceph-mon[35198]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:11:11.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:10 smithi203 ceph-mon[35198]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-19T08:11:11.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:10 smithi203 ceph-mon[35198]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:11:11.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:10 smithi203 ceph-mon[35198]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:11:11.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:10 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:11:11.414 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:11:11.414 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:11:11.497 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:11.906 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:11 smithi027 ceph-mon[31209]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:11:12.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.987+0000 7f832d75f640 1 -- 172.21.15.27:0/3918575231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8328100a60 msgr2=0x7f8328100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:12.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.987+0000 7f832d75f640 1 --2- 172.21.15.27:0/3918575231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8328100a60 0x7f8328100ec0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8310009930 tx=0x7f831002a420 comp rx=0 tx=0).stop 2024-09-19T08:11:12.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.987+0000 7f832d75f640 1 -- 172.21.15.27:0/3918575231 shutdown_connections 2024-09-19T08:11:12.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.987+0000 7f832d75f640 1 --2- 172.21.15.27:0/3918575231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8328101400 0x7f832810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:12.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.987+0000 7f832d75f640 1 --2- 172.21.15.27:0/3918575231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8328100a60 0x7f8328100ec0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:12.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.987+0000 7f832d75f640 1 --2- 172.21.15.27:0/3918575231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8328106a60 0x7f8328106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:12.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.987+0000 7f832d75f640 1 -- 172.21.15.27:0/3918575231 >> 172.21.15.27:0/3918575231 conn(0x7f83280fc780 msgr2=0x7f83280feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:12.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.987+0000 7f832d75f640 1 -- 172.21.15.27:0/3918575231 shutdown_connections 2024-09-19T08:11:12.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.987+0000 7f832d75f640 1 -- 172.21.15.27:0/3918575231 wait complete. 2024-09-19T08:11:12.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.987+0000 7f832d75f640 1 Processor -- start 2024-09-19T08:11:12.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.988+0000 7f832d75f640 1 -- start start 2024-09-19T08:11:12.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.988+0000 7f832d75f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8328100a60 0x7f8328102630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:12.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.988+0000 7f832d75f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8328101400 0x7f8328102b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:12.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.988+0000 7f832d75f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8328106a60 0x7f83281030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:12.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.988+0000 7f832d75f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8328110f00 con 0x7f8328100a60 2024-09-19T08:11:12.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.988+0000 7f832d75f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8328110d80 con 0x7f8328106a60 2024-09-19T08:11:12.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.988+0000 7f832d75f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8328111080 con 0x7f8328101400 2024-09-19T08:11:12.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.988+0000 7f8326ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8328100a60 0x7f8328102630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:12.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.988+0000 7f8326ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8328100a60 0x7f8328102630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45160/0 (socket says 172.21.15.27:45160) 2024-09-19T08:11:12.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.988+0000 7f8326ffd640 1 -- 172.21.15.27:0/1499836487 learned_addr learned my addr 172.21.15.27:0/1499836487 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:12.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.988+0000 7f83277fe640 1 --2- 172.21.15.27:0/1499836487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8328106a60 0x7f83281030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:12.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.988+0000 7f83267fc640 1 --2- 172.21.15.27:0/1499836487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8328101400 0x7f8328102b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:12.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.988+0000 7f8326ffd640 1 -- 172.21.15.27:0/1499836487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8328101400 msgr2=0x7f8328102b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:12.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.988+0000 7f8326ffd640 1 --2- 172.21.15.27:0/1499836487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8328101400 0x7f8328102b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:12.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.988+0000 7f8326ffd640 1 -- 172.21.15.27:0/1499836487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8328106a60 msgr2=0x7f83281030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:12.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.988+0000 7f8326ffd640 1 --2- 172.21.15.27:0/1499836487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8328106a60 0x7f83281030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:12.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.988+0000 7f8326ffd640 1 -- 172.21.15.27:0/1499836487 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83281a6ac0 con 0x7f8328100a60 2024-09-19T08:11:12.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.988+0000 7f83277fe640 1 --2- 172.21.15.27:0/1499836487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8328106a60 0x7f83281030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:12.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.989+0000 7f8326ffd640 1 --2- 172.21.15.27:0/1499836487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8328100a60 0x7f8328102630 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f832000ba50 tx=0x7f832000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:12.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.989+0000 7f831ffff640 1 -- 172.21.15.27:0/1499836487 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8320019070 con 0x7f8328100a60 2024-09-19T08:11:12.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.989+0000 7f832d75f640 1 -- 172.21.15.27:0/1499836487 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83281a6db0 con 0x7f8328100a60 2024-09-19T08:11:12.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.989+0000 7f831ffff640 1 -- 172.21.15.27:0/1499836487 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f832000cbe0 con 0x7f8328100a60 2024-09-19T08:11:12.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.989+0000 7f831ffff640 1 -- 172.21.15.27:0/1499836487 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83200076e0 con 0x7f8328100a60 2024-09-19T08:11:12.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.989+0000 7f832d75f640 1 -- 172.21.15.27:0/1499836487 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83281a7210 con 0x7f8328100a60 2024-09-19T08:11:12.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.990+0000 7f832d75f640 1 -- 172.21.15.27:0/1499836487 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8328100f40 con 0x7f8328100a60 2024-09-19T08:11:12.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.991+0000 7f831ffff640 1 -- 172.21.15.27:0/1499836487 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f832001c070 con 0x7f8328100a60 2024-09-19T08:11:12.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.992+0000 7f831ffff640 1 --2- 172.21.15.27:0/1499836487 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f83140a3440 0x7f83140a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:12.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.992+0000 7f83267fc640 1 --2- 172.21.15.27:0/1499836487 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f83140a3440 0x7f83140a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:12.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.992+0000 7f831ffff640 1 -- 172.21.15.27:0/1499836487 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f83200cf470 con 0x7f8328100a60 2024-09-19T08:11:12.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.992+0000 7f83267fc640 1 --2- 172.21.15.27:0/1499836487 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f83140a3440 0x7f83140a5900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8310000c00 tx=0x7f8310031490 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:12.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:11.996+0000 7f831ffff640 1 -- 172.21.15.27:0/1499836487 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f832009bde0 con 0x7f8328100a60 2024-09-19T08:11:12.044 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:12.173 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:12.172+0000 7f832d75f640 1 -- 172.21.15.27:0/1499836487 --> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83280fce90 con 0x7f83140a3440 2024-09-19T08:11:12.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:12.180+0000 7f831ffff640 1 -- 172.21.15.27:0/1499836487 <== mgr.15093 v2:172.21.15.27:6800/1578338135 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257917 (secure 0 0 0) 0x7f83280fce90 con 0x7f83140a3440 2024-09-19T08:11:12.182 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:11:12.183 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-09-19T08:11:12.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:12.184+0000 7f832d75f640 1 -- 172.21.15.27:0/1499836487 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f83140a3440 msgr2=0x7f83140a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:12.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:12.184+0000 7f832d75f640 1 --2- 172.21.15.27:0/1499836487 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f83140a3440 0x7f83140a5900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8310000c00 tx=0x7f8310031490 comp rx=0 tx=0).stop 2024-09-19T08:11:12.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:12.184+0000 7f832d75f640 1 -- 172.21.15.27:0/1499836487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8328100a60 msgr2=0x7f8328102630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:12.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:12.184+0000 7f832d75f640 1 --2- 172.21.15.27:0/1499836487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8328100a60 0x7f8328102630 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f832000ba50 tx=0x7f832000bf10 comp rx=0 tx=0).stop 2024-09-19T08:11:12.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:12.184+0000 7f832d75f640 1 -- 172.21.15.27:0/1499836487 shutdown_connections 2024-09-19T08:11:12.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:12.184+0000 7f832d75f640 1 --2- 172.21.15.27:0/1499836487 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f83140a3440 0x7f83140a5900 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:12.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:12.184+0000 7f832d75f640 1 --2- 172.21.15.27:0/1499836487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8328106a60 0x7f83281030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:12.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:12.184+0000 7f832d75f640 1 --2- 172.21.15.27:0/1499836487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8328101400 0x7f8328102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:12.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:12.184+0000 7f832d75f640 1 --2- 172.21.15.27:0/1499836487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8328100a60 0x7f8328102630 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:12.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:12.184+0000 7f832d75f640 1 -- 172.21.15.27:0/1499836487 >> 172.21.15.27:0/1499836487 conn(0x7f83280fc780 msgr2=0x7f8328104910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:12.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:12.184+0000 7f832d75f640 1 -- 172.21.15.27:0/1499836487 shutdown_connections 2024-09-19T08:11:12.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:12.184+0000 7f832d75f640 1 -- 172.21.15.27:0/1499836487 wait complete. 2024-09-19T08:11:12.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:11 smithi155 ceph-mon[35362]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:11:12.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:11 smithi203 ceph-mon[35198]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:11:12.942 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:12 smithi027 ceph-mon[31209]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-19T08:11:12.973 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2024-09-19T08:11:11.337637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1185751,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":562,"num_read_kb":596,"num_write":406,"num_write_kb":4347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":800,"ondisk_log_size":800,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356324,"kb_used_data":11196,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585500,"statfs":{"total":1151940427776,"available":1151575552000,"internally_reserved":0,"allocated":11464704,"data_stored":8896473,"data_compressed":217845,"data_compressed_allocated":282624,"data_compressed_original":3416064,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":217,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.986852"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244732+0000","last_change":"2024-09-19T08:09:11.246436+0000","last_active":"2024-09-19T08:11:02.244732+0000","last_peered":"2024-09-19T08:11:02.244732+0000","last_clean":"2024-09-19T08:11:02.244732+0000","last_became_active":"2024-09-19T08:09:11.245674+0000","last_became_peered":"2024-09-19T08:09:11.245674+0000","last_unstale":"2024-09-19T08:11:02.244732+0000","last_undegraded":"2024-09-19T08:11:02.244732+0000","last_fullsized":"2024-09-19T08:11:02.244732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:46.716474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898632+0000","last_change":"2024-09-19T08:09:11.243334+0000","last_active":"2024-09-19T08:11:01.898632+0000","last_peered":"2024-09-19T08:11:01.898632+0000","last_clean":"2024-09-19T08:11:01.898632+0000","last_became_active":"2024-09-19T08:09:11.243024+0000","last_became_peered":"2024-09-19T08:09:11.243024+0000","last_unstale":"2024-09-19T08:11:01.898632+0000","last_undegraded":"2024-09-19T08:11:01.898632+0000","last_fullsized":"2024-09-19T08:11:01.898632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.060068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898635+0000","last_change":"2024-09-19T08:09:11.254655+0000","last_active":"2024-09-19T08:11:01.898635+0000","last_peered":"2024-09-19T08:11:01.898635+0000","last_clean":"2024-09-19T08:11:01.898635+0000","last_became_active":"2024-09-19T08:09:11.254292+0000","last_became_peered":"2024-09-19T08:09:11.254292+0000","last_unstale":"2024-09-19T08:11:01.898635+0000","last_undegraded":"2024-09-19T08:11:01.898635+0000","last_fullsized":"2024-09-19T08:11:01.898635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:01.977743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899014+0000","last_change":"2024-09-19T08:09:11.257029+0000","last_active":"2024-09-19T08:11:01.899014+0000","last_peered":"2024-09-19T08:11:01.899014+0000","last_clean":"2024-09-19T08:11:01.899014+0000","last_became_active":"2024-09-19T08:09:11.256669+0000","last_became_peered":"2024-09-19T08:09:11.256669+0000","last_unstale":"2024-09-19T08:11:01.899014+0000","last_undegraded":"2024-09-19T08:11:01.899014+0000","last_fullsized":"2024-09-19T08:11:01.899014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:32.831036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413590+0000","last_change":"2024-09-19T08:09:11.240341+0000","last_active":"2024-09-19T08:11:01.413590+0000","last_peered":"2024-09-19T08:11:01.413590+0000","last_clean":"2024-09-19T08:11:01.413590+0000","last_became_active":"2024-09-19T08:09:11.239996+0000","last_became_peered":"2024-09-19T08:09:11.239996+0000","last_unstale":"2024-09-19T08:11:01.413590+0000","last_undegraded":"2024-09-19T08:11:01.413590+0000","last_fullsized":"2024-09-19T08:11:01.413590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:20.331791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325570+0000","last_change":"2024-09-19T08:09:11.248089+0000","last_active":"2024-09-19T08:11:01.325570+0000","last_peered":"2024-09-19T08:11:01.325570+0000","last_clean":"2024-09-19T08:11:01.325570+0000","last_became_active":"2024-09-19T08:09:11.247802+0000","last_became_peered":"2024-09-19T08:09:11.247802+0000","last_unstale":"2024-09-19T08:11:01.325570+0000","last_undegraded":"2024-09-19T08:11:01.325570+0000","last_fullsized":"2024-09-19T08:11:01.325570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.249119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898629+0000","last_change":"2024-09-19T08:09:11.246853+0000","last_active":"2024-09-19T08:11:01.898629+0000","last_peered":"2024-09-19T08:11:01.898629+0000","last_clean":"2024-09-19T08:11:01.898629+0000","last_became_active":"2024-09-19T08:09:11.246523+0000","last_became_peered":"2024-09-19T08:09:11.246523+0000","last_unstale":"2024-09-19T08:11:01.898629+0000","last_undegraded":"2024-09-19T08:11:01.898629+0000","last_fullsized":"2024-09-19T08:11:01.898629+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:54.879087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413783+0000","last_change":"2024-09-19T08:09:11.232588+0000","last_active":"2024-09-19T08:11:01.413783+0000","last_peered":"2024-09-19T08:11:01.413783+0000","last_clean":"2024-09-19T08:11:01.413783+0000","last_became_active":"2024-09-19T08:09:11.232251+0000","last_became_peered":"2024-09-19T08:09:11.232251+0000","last_unstale":"2024-09-19T08:11:01.413783+0000","last_undegraded":"2024-09-19T08:11:01.413783+0000","last_fullsized":"2024-09-19T08:11:01.413783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:57.622086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619576+0000","last_change":"2024-09-19T08:09:11.248854+0000","last_active":"2024-09-19T08:11:01.619576+0000","last_peered":"2024-09-19T08:11:01.619576+0000","last_clean":"2024-09-19T08:11:01.619576+0000","last_became_active":"2024-09-19T08:09:11.248524+0000","last_became_peered":"2024-09-19T08:09:11.248524+0000","last_unstale":"2024-09-19T08:11:01.619576+0000","last_undegraded":"2024-09-19T08:11:01.619576+0000","last_fullsized":"2024-09-19T08:11:01.619576+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:57.978974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325967+0000","last_change":"2024-09-19T08:10:14.786848+0000","last_active":"2024-09-19T08:11:01.325967+0000","last_peered":"2024-09-19T08:11:01.325967+0000","last_clean":"2024-09-19T08:11:01.325967+0000","last_became_active":"2024-09-19T08:10:14.786460+0000","last_became_peered":"2024-09-19T08:10:14.786460+0000","last_unstale":"2024-09-19T08:11:01.325967+0000","last_undegraded":"2024-09-19T08:11:01.325967+0000","last_fullsized":"2024-09-19T08:11:01.325967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:59.430185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899200+0000","last_change":"2024-09-19T08:09:11.247604+0000","last_active":"2024-09-19T08:11:01.899200+0000","last_peered":"2024-09-19T08:11:01.899200+0000","last_clean":"2024-09-19T08:11:01.899200+0000","last_became_active":"2024-09-19T08:09:11.247264+0000","last_became_peered":"2024-09-19T08:09:11.247264+0000","last_unstale":"2024-09-19T08:11:01.899200+0000","last_undegraded":"2024-09-19T08:11:01.899200+0000","last_fullsized":"2024-09-19T08:11:01.899200+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:15.315022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899033+0000","last_change":"2024-09-19T08:09:11.253948+0000","last_active":"2024-09-19T08:11:01.899033+0000","last_peered":"2024-09-19T08:11:01.899033+0000","last_clean":"2024-09-19T08:11:01.899033+0000","last_became_active":"2024-09-19T08:09:11.253402+0000","last_became_peered":"2024-09-19T08:09:11.253402+0000","last_unstale":"2024-09-19T08:11:01.899033+0000","last_undegraded":"2024-09-19T08:11:01.899033+0000","last_fullsized":"2024-09-19T08:11:01.899033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:04.884541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324201+0000","last_change":"2024-09-19T08:09:11.241770+0000","last_active":"2024-09-19T08:11:01.324201+0000","last_peered":"2024-09-19T08:11:01.324201+0000","last_clean":"2024-09-19T08:11:01.324201+0000","last_became_active":"2024-09-19T08:09:11.241356+0000","last_became_peered":"2024-09-19T08:09:11.241356+0000","last_unstale":"2024-09-19T08:11:01.324201+0000","last_undegraded":"2024-09-19T08:11:01.324201+0000","last_fullsized":"2024-09-19T08:11:01.324201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:02.722445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898444+0000","last_change":"2024-09-19T08:09:11.242874+0000","last_active":"2024-09-19T08:11:01.898444+0000","last_peered":"2024-09-19T08:11:01.898444+0000","last_clean":"2024-09-19T08:11:01.898444+0000","last_became_active":"2024-09-19T08:09:11.242383+0000","last_became_peered":"2024-09-19T08:09:11.242383+0000","last_unstale":"2024-09-19T08:11:01.898444+0000","last_undegraded":"2024-09-19T08:11:01.898444+0000","last_fullsized":"2024-09-19T08:11:01.898444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:51.900211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898325+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:11:01.898325+0000","last_peered":"2024-09-19T08:11:01.898325+0000","last_clean":"2024-09-19T08:11:01.898325+0000","last_became_active":"2024-09-19T08:09:11.250797+0000","last_became_peered":"2024-09-19T08:09:11.250797+0000","last_unstale":"2024-09-19T08:11:01.898325+0000","last_undegraded":"2024-09-19T08:11:01.898325+0000","last_fullsized":"2024-09-19T08:11:01.898325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:46.183857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619237+0000","last_change":"2024-09-19T08:09:11.250884+0000","last_active":"2024-09-19T08:11:01.619237+0000","last_peered":"2024-09-19T08:11:01.619237+0000","last_clean":"2024-09-19T08:11:01.619237+0000","last_became_active":"2024-09-19T08:09:11.250543+0000","last_became_peered":"2024-09-19T08:09:11.250543+0000","last_unstale":"2024-09-19T08:11:01.619237+0000","last_undegraded":"2024-09-19T08:11:01.619237+0000","last_fullsized":"2024-09-19T08:11:01.619237+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.259466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244747+0000","last_change":"2024-09-19T08:09:11.246705+0000","last_active":"2024-09-19T08:11:02.244747+0000","last_peered":"2024-09-19T08:11:02.244747+0000","last_clean":"2024-09-19T08:11:02.244747+0000","last_became_active":"2024-09-19T08:09:11.246117+0000","last_became_peered":"2024-09-19T08:09:11.246117+0000","last_unstale":"2024-09-19T08:11:02.244747+0000","last_undegraded":"2024-09-19T08:11:02.244747+0000","last_fullsized":"2024-09-19T08:11:02.244747+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:07.421222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.411014+0000","last_change":"2024-09-19T08:09:11.242181+0000","last_active":"2024-09-19T08:11:01.411014+0000","last_peered":"2024-09-19T08:11:01.411014+0000","last_clean":"2024-09-19T08:11:01.411014+0000","last_became_active":"2024-09-19T08:09:11.241882+0000","last_became_peered":"2024-09-19T08:09:11.241882+0000","last_unstale":"2024-09-19T08:11:01.411014+0000","last_undegraded":"2024-09-19T08:11:01.411014+0000","last_fullsized":"2024-09-19T08:11:01.411014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:35.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619497+0000","last_change":"2024-09-19T08:09:11.246038+0000","last_active":"2024-09-19T08:11:01.619497+0000","last_peered":"2024-09-19T08:11:01.619497+0000","last_clean":"2024-09-19T08:11:01.619497+0000","last_became_active":"2024-09-19T08:09:11.245554+0000","last_became_peered":"2024-09-19T08:09:11.245554+0000","last_unstale":"2024-09-19T08:11:01.619497+0000","last_undegraded":"2024-09-19T08:11:01.619497+0000","last_fullsized":"2024-09-19T08:11:01.619497+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:14.512425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244438+0000","last_change":"2024-09-19T08:09:11.249246+0000","last_active":"2024-09-19T08:11:02.244438+0000","last_peered":"2024-09-19T08:11:02.244438+0000","last_clean":"2024-09-19T08:11:02.244438+0000","last_became_active":"2024-09-19T08:09:11.248896+0000","last_became_peered":"2024-09-19T08:09:11.248896+0000","last_unstale":"2024-09-19T08:11:02.244438+0000","last_undegraded":"2024-09-19T08:11:02.244438+0000","last_fullsized":"2024-09-19T08:11:02.244438+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:40.406924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324207+0000","last_change":"2024-09-19T08:09:11.245421+0000","last_active":"2024-09-19T08:11:01.324207+0000","last_peered":"2024-09-19T08:11:01.324207+0000","last_clean":"2024-09-19T08:11:01.324207+0000","last_became_active":"2024-09-19T08:09:11.245071+0000","last_became_peered":"2024-09-19T08:09:11.245071+0000","last_unstale":"2024-09-19T08:11:01.324207+0000","last_undegraded":"2024-09-19T08:11:01.324207+0000","last_fullsized":"2024-09-19T08:11:01.324207+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:58.594399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619396+0000","last_change":"2024-09-19T08:09:11.246097+0000","last_active":"2024-09-19T08:11:01.619396+0000","last_peered":"2024-09-19T08:11:01.619396+0000","last_clean":"2024-09-19T08:11:01.619396+0000","last_became_active":"2024-09-19T08:09:11.245741+0000","last_became_peered":"2024-09-19T08:09:11.245741+0000","last_unstale":"2024-09-19T08:11:01.619396+0000","last_undegraded":"2024-09-19T08:11:01.619396+0000","last_fullsized":"2024-09-19T08:11:01.619396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:05.731148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414178+0000","last_change":"2024-09-19T08:09:11.251485+0000","last_active":"2024-09-19T08:11:01.414178+0000","last_peered":"2024-09-19T08:11:01.414178+0000","last_clean":"2024-09-19T08:11:01.414178+0000","last_became_active":"2024-09-19T08:09:11.251151+0000","last_became_peered":"2024-09-19T08:09:11.251151+0000","last_unstale":"2024-09-19T08:11:01.414178+0000","last_undegraded":"2024-09-19T08:11:01.414178+0000","last_fullsized":"2024-09-19T08:11:01.414178+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:47.231056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327085+0000","last_change":"2024-09-19T08:09:11.234490+0000","last_active":"2024-09-19T08:11:01.327085+0000","last_peered":"2024-09-19T08:11:01.327085+0000","last_clean":"2024-09-19T08:11:01.327085+0000","last_became_active":"2024-09-19T08:09:11.234163+0000","last_became_peered":"2024-09-19T08:09:11.234163+0000","last_unstale":"2024-09-19T08:11:01.327085+0000","last_undegraded":"2024-09-19T08:11:01.327085+0000","last_fullsized":"2024-09-19T08:11:01.327085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.610165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.415513+0000","last_change":"2024-09-19T08:09:11.247189+0000","last_active":"2024-09-19T08:11:01.415513+0000","last_peered":"2024-09-19T08:11:01.415513+0000","last_clean":"2024-09-19T08:11:01.415513+0000","last_became_active":"2024-09-19T08:09:11.246844+0000","last_became_peered":"2024-09-19T08:09:11.246844+0000","last_unstale":"2024-09-19T08:11:01.415513+0000","last_undegraded":"2024-09-19T08:11:01.415513+0000","last_fullsized":"2024-09-19T08:11:01.415513+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:50.764694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619668+0000","last_change":"2024-09-19T08:09:11.251655+0000","last_active":"2024-09-19T08:11:01.619668+0000","last_peered":"2024-09-19T08:11:01.619668+0000","last_clean":"2024-09-19T08:11:01.619668+0000","last_became_active":"2024-09-19T08:09:11.250930+0000","last_became_peered":"2024-09-19T08:09:11.250930+0000","last_unstale":"2024-09-19T08:11:01.619668+0000","last_undegraded":"2024-09-19T08:11:01.619668+0000","last_fullsized":"2024-09-19T08:11:01.619668+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:17.658277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244670+0000","last_change":"2024-09-19T08:09:11.248095+0000","last_active":"2024-09-19T08:11:02.244670+0000","last_peered":"2024-09-19T08:11:02.244670+0000","last_clean":"2024-09-19T08:11:02.244670+0000","last_became_active":"2024-09-19T08:09:11.247719+0000","last_became_peered":"2024-09-19T08:09:11.247719+0000","last_unstale":"2024-09-19T08:11:02.244670+0000","last_undegraded":"2024-09-19T08:11:02.244670+0000","last_fullsized":"2024-09-19T08:11:02.244670+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:26.701140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324250+0000","last_change":"2024-09-19T08:09:11.243232+0000","last_active":"2024-09-19T08:11:01.324250+0000","last_peered":"2024-09-19T08:11:01.324250+0000","last_clean":"2024-09-19T08:11:01.324250+0000","last_became_active":"2024-09-19T08:09:11.242927+0000","last_became_peered":"2024-09-19T08:09:11.242927+0000","last_unstale":"2024-09-19T08:11:01.324250+0000","last_undegraded":"2024-09-19T08:11:01.324250+0000","last_fullsized":"2024-09-19T08:11:01.324250+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:19.877520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898534+0000","last_change":"2024-09-19T08:09:11.249588+0000","last_active":"2024-09-19T08:11:01.898534+0000","last_peered":"2024-09-19T08:11:01.898534+0000","last_clean":"2024-09-19T08:11:01.898534+0000","last_became_active":"2024-09-19T08:09:11.249266+0000","last_became_peered":"2024-09-19T08:09:11.249266+0000","last_unstale":"2024-09-19T08:11:01.898534+0000","last_undegraded":"2024-09-19T08:11:01.898534+0000","last_fullsized":"2024-09-19T08:11:01.898534+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:43.332454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619356+0000","last_change":"2024-09-19T08:09:11.245866+0000","last_active":"2024-09-19T08:11:01.619356+0000","last_peered":"2024-09-19T08:11:01.619356+0000","last_clean":"2024-09-19T08:11:01.619356+0000","last_became_active":"2024-09-19T08:09:11.245505+0000","last_became_peered":"2024-09-19T08:09:11.245505+0000","last_unstale":"2024-09-19T08:11:01.619356+0000","last_undegraded":"2024-09-19T08:11:01.619356+0000","last_fullsized":"2024-09-19T08:11:01.619356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:38.203790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619389+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:11:01.619389+0000","last_peered":"2024-09-19T08:11:01.619389+0000","last_clean":"2024-09-19T08:11:01.619389+0000","last_became_active":"2024-09-19T08:09:11.250745+0000","last_became_peered":"2024-09-19T08:09:11.250745+0000","last_unstale":"2024-09-19T08:11:01.619389+0000","last_undegraded":"2024-09-19T08:11:01.619389+0000","last_fullsized":"2024-09-19T08:11:01.619389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:16.851230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244514+0000","last_change":"2024-09-19T08:09:11.255211+0000","last_active":"2024-09-19T08:11:02.244514+0000","last_peered":"2024-09-19T08:11:02.244514+0000","last_clean":"2024-09-19T08:11:02.244514+0000","last_became_active":"2024-09-19T08:09:11.254853+0000","last_became_peered":"2024-09-19T08:09:11.254853+0000","last_unstale":"2024-09-19T08:11:02.244514+0000","last_undegraded":"2024-09-19T08:11:02.244514+0000","last_fullsized":"2024-09-19T08:11:02.244514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.497502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413533+0000","last_change":"2024-09-19T08:09:11.247201+0000","last_active":"2024-09-19T08:11:01.413533+0000","last_peered":"2024-09-19T08:11:01.413533+0000","last_clean":"2024-09-19T08:11:01.413533+0000","last_became_active":"2024-09-19T08:09:11.246854+0000","last_became_peered":"2024-09-19T08:09:11.246854+0000","last_unstale":"2024-09-19T08:11:01.413533+0000","last_undegraded":"2024-09-19T08:11:01.413533+0000","last_fullsized":"2024-09-19T08:11:01.413533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:19.262849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327350+0000","last_change":"2024-09-19T08:09:09.113754+0000","last_active":"2024-09-19T08:11:01.327350+0000","last_peered":"2024-09-19T08:11:01.327350+0000","last_clean":"2024-09-19T08:11:01.327350+0000","last_became_active":"2024-09-19T08:09:09.113389+0000","last_became_peered":"2024-09-19T08:09:09.113389+0000","last_unstale":"2024-09-19T08:11:01.327350+0000","last_undegraded":"2024-09-19T08:11:01.327350+0000","last_fullsized":"2024-09-19T08:11:01.327350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:45.325895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327320+0000","last_change":"2024-09-19T08:09:11.244625+0000","last_active":"2024-09-19T08:11:01.327320+0000","last_peered":"2024-09-19T08:11:01.327320+0000","last_clean":"2024-09-19T08:11:01.327320+0000","last_became_active":"2024-09-19T08:09:11.244277+0000","last_became_peered":"2024-09-19T08:09:11.244277+0000","last_unstale":"2024-09-19T08:11:01.327320+0000","last_undegraded":"2024-09-19T08:11:01.327320+0000","last_fullsized":"2024-09-19T08:11:01.327320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:33:34.050343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325579+0000","last_change":"2024-09-19T08:09:09.116735+0000","last_active":"2024-09-19T08:11:01.325579+0000","last_peered":"2024-09-19T08:11:01.325579+0000","last_clean":"2024-09-19T08:11:01.325579+0000","last_became_active":"2024-09-19T08:09:09.116356+0000","last_became_peered":"2024-09-19T08:09:09.116356+0000","last_unstale":"2024-09-19T08:11:01.325579+0000","last_undegraded":"2024-09-19T08:11:01.325579+0000","last_fullsized":"2024-09-19T08:11:01.325579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:50.952567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323834+0000","last_change":"2024-09-19T08:09:09.113182+0000","last_active":"2024-09-19T08:11:01.323834+0000","last_peered":"2024-09-19T08:11:01.323834+0000","last_clean":"2024-09-19T08:11:01.323834+0000","last_became_active":"2024-09-19T08:09:09.112528+0000","last_became_peered":"2024-09-19T08:09:09.112528+0000","last_unstale":"2024-09-19T08:11:01.323834+0000","last_undegraded":"2024-09-19T08:11:01.323834+0000","last_fullsized":"2024-09-19T08:11:01.323834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:07.647351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413961+0000","last_change":"2024-09-19T08:09:11.241639+0000","last_active":"2024-09-19T08:11:01.413961+0000","last_peered":"2024-09-19T08:11:01.413961+0000","last_clean":"2024-09-19T08:11:01.413961+0000","last_became_active":"2024-09-19T08:09:11.241308+0000","last_became_peered":"2024-09-19T08:09:11.241308+0000","last_unstale":"2024-09-19T08:11:01.413961+0000","last_undegraded":"2024-09-19T08:11:01.413961+0000","last_fullsized":"2024-09-19T08:11:01.413961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:57.826870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327401+0000","last_change":"2024-09-19T08:09:09.118334+0000","last_active":"2024-09-19T08:11:01.327401+0000","last_peered":"2024-09-19T08:11:01.327401+0000","last_clean":"2024-09-19T08:11:01.327401+0000","last_became_active":"2024-09-19T08:09:09.118010+0000","last_became_peered":"2024-09-19T08:09:09.118010+0000","last_unstale":"2024-09-19T08:11:01.327401+0000","last_undegraded":"2024-09-19T08:11:01.327401+0000","last_fullsized":"2024-09-19T08:11:01.327401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:51.046598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.410546+0000","last_change":"2024-09-19T08:09:11.239990+0000","last_active":"2024-09-19T08:11:01.410546+0000","last_peered":"2024-09-19T08:11:01.410546+0000","last_clean":"2024-09-19T08:11:01.410546+0000","last_became_active":"2024-09-19T08:09:11.239643+0000","last_became_peered":"2024-09-19T08:09:11.239643+0000","last_unstale":"2024-09-19T08:11:01.410546+0000","last_undegraded":"2024-09-19T08:11:01.410546+0000","last_fullsized":"2024-09-19T08:11:01.410546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:07.078244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325867+0000","last_change":"2024-09-19T08:09:09.114397+0000","last_active":"2024-09-19T08:11:01.325867+0000","last_peered":"2024-09-19T08:11:01.325867+0000","last_clean":"2024-09-19T08:11:01.325867+0000","last_became_active":"2024-09-19T08:09:09.114051+0000","last_became_peered":"2024-09-19T08:09:09.114051+0000","last_unstale":"2024-09-19T08:11:01.325867+0000","last_undegraded":"2024-09-19T08:11:01.325867+0000","last_fullsized":"2024-09-19T08:11:01.325867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:41.799442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619494+0000","last_change":"2024-09-19T08:09:11.254802+0000","last_active":"2024-09-19T08:11:01.619494+0000","last_peered":"2024-09-19T08:11:01.619494+0000","last_clean":"2024-09-19T08:11:01.619494+0000","last_became_active":"2024-09-19T08:09:11.253869+0000","last_became_peered":"2024-09-19T08:09:11.253869+0000","last_unstale":"2024-09-19T08:11:01.619494+0000","last_undegraded":"2024-09-19T08:11:01.619494+0000","last_fullsized":"2024-09-19T08:11:01.619494+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:00.164834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899209+0000","last_change":"2024-09-19T08:09:09.118585+0000","last_active":"2024-09-19T08:11:01.899209+0000","last_peered":"2024-09-19T08:11:01.899209+0000","last_clean":"2024-09-19T08:11:01.899209+0000","last_became_active":"2024-09-19T08:09:09.118216+0000","last_became_peered":"2024-09-19T08:09:09.118216+0000","last_unstale":"2024-09-19T08:11:01.899209+0000","last_undegraded":"2024-09-19T08:11:01.899209+0000","last_fullsized":"2024-09-19T08:11:01.899209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:41.905746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898880+0000","last_change":"2024-09-19T08:09:11.249835+0000","last_active":"2024-09-19T08:11:01.898880+0000","last_peered":"2024-09-19T08:11:01.898880+0000","last_clean":"2024-09-19T08:11:01.898880+0000","last_became_active":"2024-09-19T08:09:11.249443+0000","last_became_peered":"2024-09-19T08:09:11.249443+0000","last_unstale":"2024-09-19T08:11:01.898880+0000","last_undegraded":"2024-09-19T08:11:01.898880+0000","last_fullsized":"2024-09-19T08:11:01.898880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:06.373126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327565+0000","last_change":"2024-09-19T08:09:09.242565+0000","last_active":"2024-09-19T08:11:01.327565+0000","last_peered":"2024-09-19T08:11:01.327565+0000","last_clean":"2024-09-19T08:11:01.327565+0000","last_became_active":"2024-09-19T08:09:09.242199+0000","last_became_peered":"2024-09-19T08:09:09.242199+0000","last_unstale":"2024-09-19T08:11:01.327565+0000","last_undegraded":"2024-09-19T08:11:01.327565+0000","last_fullsized":"2024-09-19T08:11:01.327565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:33.195385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619322+0000","last_change":"2024-09-19T08:09:11.251682+0000","last_active":"2024-09-19T08:11:01.619322+0000","last_peered":"2024-09-19T08:11:01.619322+0000","last_clean":"2024-09-19T08:11:01.619322+0000","last_became_active":"2024-09-19T08:09:11.251037+0000","last_became_peered":"2024-09-19T08:09:11.251037+0000","last_unstale":"2024-09-19T08:11:01.619322+0000","last_undegraded":"2024-09-19T08:11:01.619322+0000","last_fullsized":"2024-09-19T08:11:01.619322+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:29.518828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'35","reported_seq":286,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:06.478982+0000","last_change":"2024-09-19T08:09:09.119090+0000","last_active":"2024-09-19T08:11:06.478982+0000","last_peered":"2024-09-19T08:11:06.478982+0000","last_clean":"2024-09-19T08:11:06.478982+0000","last_became_active":"2024-09-19T08:09:09.118685+0000","last_became_peered":"2024-09-19T08:09:09.118685+0000","last_unstale":"2024-09-19T08:11:06.478982+0000","last_undegraded":"2024-09-19T08:11:06.478982+0000","last_fullsized":"2024-09-19T08:11:06.478982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:21.540404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69535,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":227,"num_read_kb":181,"num_write":35,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413753+0000","last_change":"2024-09-19T08:09:11.243200+0000","last_active":"2024-09-19T08:11:01.413753+0000","last_peered":"2024-09-19T08:11:01.413753+0000","last_clean":"2024-09-19T08:11:01.413753+0000","last_became_active":"2024-09-19T08:09:11.242873+0000","last_became_peered":"2024-09-19T08:09:11.242873+0000","last_unstale":"2024-09-19T08:11:01.413753+0000","last_undegraded":"2024-09-19T08:11:01.413753+0000","last_fullsized":"2024-09-19T08:11:01.413753+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:35.817609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619483+0000","last_change":"2024-09-19T08:09:09.117117+0000","last_active":"2024-09-19T08:11:01.619483+0000","last_peered":"2024-09-19T08:11:01.619483+0000","last_clean":"2024-09-19T08:11:01.619483+0000","last_became_active":"2024-09-19T08:09:09.116512+0000","last_became_peered":"2024-09-19T08:09:09.116512+0000","last_unstale":"2024-09-19T08:11:01.619483+0000","last_undegraded":"2024-09-19T08:11:01.619483+0000","last_fullsized":"2024-09-19T08:11:01.619483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:15.010570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323874+0000","last_change":"2024-09-19T08:09:11.246648+0000","last_active":"2024-09-19T08:11:01.323874+0000","last_peered":"2024-09-19T08:11:01.323874+0000","last_clean":"2024-09-19T08:11:01.323874+0000","last_became_active":"2024-09-19T08:09:11.246317+0000","last_became_peered":"2024-09-19T08:09:11.246317+0000","last_unstale":"2024-09-19T08:11:01.323874+0000","last_undegraded":"2024-09-19T08:11:01.323874+0000","last_fullsized":"2024-09-19T08:11:01.323874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:43.285257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327239+0000","last_change":"2024-09-19T08:09:09.112599+0000","last_active":"2024-09-19T08:11:01.327239+0000","last_peered":"2024-09-19T08:11:01.327239+0000","last_clean":"2024-09-19T08:11:01.327239+0000","last_became_active":"2024-09-19T08:09:09.112281+0000","last_became_peered":"2024-09-19T08:09:09.112281+0000","last_unstale":"2024-09-19T08:11:01.327239+0000","last_undegraded":"2024-09-19T08:11:01.327239+0000","last_fullsized":"2024-09-19T08:11:01.327239+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:47.710235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898887+0000","last_change":"2024-09-19T08:09:11.253814+0000","last_active":"2024-09-19T08:11:01.898887+0000","last_peered":"2024-09-19T08:11:01.898887+0000","last_clean":"2024-09-19T08:11:01.898887+0000","last_became_active":"2024-09-19T08:09:11.253490+0000","last_became_peered":"2024-09-19T08:09:11.253490+0000","last_unstale":"2024-09-19T08:11:01.898887+0000","last_undegraded":"2024-09-19T08:11:01.898887+0000","last_fullsized":"2024-09-19T08:11:01.898887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:09.287110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898591+0000","last_change":"2024-09-19T08:09:09.114820+0000","last_active":"2024-09-19T08:11:01.898591+0000","last_peered":"2024-09-19T08:11:01.898591+0000","last_clean":"2024-09-19T08:11:01.898591+0000","last_became_active":"2024-09-19T08:09:09.114478+0000","last_became_peered":"2024-09-19T08:09:09.114478+0000","last_unstale":"2024-09-19T08:11:01.898591+0000","last_undegraded":"2024-09-19T08:11:01.898591+0000","last_fullsized":"2024-09-19T08:11:01.898591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:24.243629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898477+0000","last_change":"2024-09-19T08:10:14.789301+0000","last_active":"2024-09-19T08:11:01.898477+0000","last_peered":"2024-09-19T08:11:01.898477+0000","last_clean":"2024-09-19T08:11:01.898477+0000","last_became_active":"2024-09-19T08:10:14.788891+0000","last_became_peered":"2024-09-19T08:10:14.788891+0000","last_unstale":"2024-09-19T08:11:01.898477+0000","last_undegraded":"2024-09-19T08:11:01.898477+0000","last_fullsized":"2024-09-19T08:11:01.898477+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:03.142177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244400+0000","last_change":"2024-09-19T08:10:14.799207+0000","last_active":"2024-09-19T08:11:02.244400+0000","last_peered":"2024-09-19T08:11:02.244400+0000","last_clean":"2024-09-19T08:11:02.244400+0000","last_became_active":"2024-09-19T08:10:14.787612+0000","last_became_peered":"2024-09-19T08:10:14.787612+0000","last_unstale":"2024-09-19T08:11:02.244400+0000","last_undegraded":"2024-09-19T08:11:02.244400+0000","last_fullsized":"2024-09-19T08:11:02.244400+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:45.997778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327130+0000","last_change":"2024-09-19T08:09:11.245399+0000","last_active":"2024-09-19T08:11:01.327130+0000","last_peered":"2024-09-19T08:11:01.327130+0000","last_clean":"2024-09-19T08:11:01.327130+0000","last_became_active":"2024-09-19T08:09:11.245055+0000","last_became_peered":"2024-09-19T08:09:11.245055+0000","last_unstale":"2024-09-19T08:11:01.327130+0000","last_undegraded":"2024-09-19T08:11:01.327130+0000","last_fullsized":"2024-09-19T08:11:01.327130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:57.639205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413806+0000","last_change":"2024-09-19T08:09:09.115252+0000","last_active":"2024-09-19T08:11:01.413806+0000","last_peered":"2024-09-19T08:11:01.413806+0000","last_clean":"2024-09-19T08:11:01.413806+0000","last_became_active":"2024-09-19T08:09:09.114908+0000","last_became_peered":"2024-09-19T08:09:09.114908+0000","last_unstale":"2024-09-19T08:11:01.413806+0000","last_undegraded":"2024-09-19T08:11:01.413806+0000","last_fullsized":"2024-09-19T08:11:01.413806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:48.326221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244581+0000","last_change":"2024-09-19T08:09:11.249189+0000","last_active":"2024-09-19T08:11:02.244581+0000","last_peered":"2024-09-19T08:11:02.244581+0000","last_clean":"2024-09-19T08:11:02.244581+0000","last_became_active":"2024-09-19T08:09:11.248797+0000","last_became_peered":"2024-09-19T08:09:11.248797+0000","last_unstale":"2024-09-19T08:11:02.244581+0000","last_undegraded":"2024-09-19T08:11:02.244581+0000","last_fullsized":"2024-09-19T08:11:02.244581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:20.915638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324421+0000","last_change":"2024-09-19T08:09:09.112973+0000","last_active":"2024-09-19T08:11:01.324421+0000","last_peered":"2024-09-19T08:11:01.324421+0000","last_clean":"2024-09-19T08:11:01.324421+0000","last_became_active":"2024-09-19T08:09:09.112616+0000","last_became_peered":"2024-09-19T08:09:09.112616+0000","last_unstale":"2024-09-19T08:11:01.324421+0000","last_undegraded":"2024-09-19T08:11:01.324421+0000","last_fullsized":"2024-09-19T08:11:01.324421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:13.791926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899227+0000","last_change":"2024-09-19T08:09:11.240739+0000","last_active":"2024-09-19T08:11:01.899227+0000","last_peered":"2024-09-19T08:11:01.899227+0000","last_clean":"2024-09-19T08:11:01.899227+0000","last_became_active":"2024-09-19T08:09:11.240340+0000","last_became_peered":"2024-09-19T08:09:11.240340+0000","last_unstale":"2024-09-19T08:11:01.899227+0000","last_undegraded":"2024-09-19T08:11:01.899227+0000","last_fullsized":"2024-09-19T08:11:01.899227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:35.450279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'39","reported_seq":71,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.551893+0000","last_change":"2024-09-19T08:09:09.112516+0000","last_active":"2024-09-19T08:11:01.551893+0000","last_peered":"2024-09-19T08:11:01.551893+0000","last_clean":"2024-09-19T08:11:01.551893+0000","last_became_active":"2024-09-19T08:09:09.112140+0000","last_became_peered":"2024-09-19T08:09:09.112140+0000","last_unstale":"2024-09-19T08:11:01.551893+0000","last_undegraded":"2024-09-19T08:11:01.551893+0000","last_fullsized":"2024-09-19T08:11:01.551893+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:05.434331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899052+0000","last_change":"2024-09-19T08:09:11.252163+0000","last_active":"2024-09-19T08:11:01.899052+0000","last_peered":"2024-09-19T08:11:01.899052+0000","last_clean":"2024-09-19T08:11:01.899052+0000","last_became_active":"2024-09-19T08:09:11.251762+0000","last_became_peered":"2024-09-19T08:09:11.251762+0000","last_unstale":"2024-09-19T08:11:01.899052+0000","last_undegraded":"2024-09-19T08:11:01.899052+0000","last_fullsized":"2024-09-19T08:11:01.899052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:33.941910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898722+0000","last_change":"2024-09-19T08:10:14.788460+0000","last_active":"2024-09-19T08:11:01.898722+0000","last_peered":"2024-09-19T08:11:01.898722+0000","last_clean":"2024-09-19T08:11:01.898722+0000","last_became_active":"2024-09-19T08:10:14.787990+0000","last_became_peered":"2024-09-19T08:10:14.787990+0000","last_unstale":"2024-09-19T08:11:01.898722+0000","last_undegraded":"2024-09-19T08:11:01.898722+0000","last_fullsized":"2024-09-19T08:11:01.898722+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:24.549994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899257+0000","last_change":"2024-09-19T08:09:11.242438+0000","last_active":"2024-09-19T08:11:01.899257+0000","last_peered":"2024-09-19T08:11:01.899257+0000","last_clean":"2024-09-19T08:11:01.899257+0000","last_became_active":"2024-09-19T08:09:11.242114+0000","last_became_peered":"2024-09-19T08:09:11.242114+0000","last_unstale":"2024-09-19T08:11:01.899257+0000","last_undegraded":"2024-09-19T08:11:01.899257+0000","last_fullsized":"2024-09-19T08:11:01.899257+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:54.183012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"84'148","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:03.438528+0000","last_change":"2024-09-19T08:07:55.287566+0000","last_active":"2024-09-19T08:11:03.438528+0000","last_peered":"2024-09-19T08:11:03.438528+0000","last_clean":"2024-09-19T08:11:03.438528+0000","last_became_active":"2024-09-19T08:07:55.287037+0000","last_became_peered":"2024-09-19T08:07:55.287037+0000","last_unstale":"2024-09-19T08:11:03.438528+0000","last_undegraded":"2024-09-19T08:11:03.438528+0000","last_fullsized":"2024-09-19T08:11:03.438528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_clean_scrub_stamp":"2024-09-19T08:04:29.468857+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:49.553882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898721+0000","last_change":"2024-09-19T08:09:09.113497+0000","last_active":"2024-09-19T08:11:01.898721+0000","last_peered":"2024-09-19T08:11:01.898721+0000","last_clean":"2024-09-19T08:11:01.898721+0000","last_became_active":"2024-09-19T08:09:09.112546+0000","last_became_peered":"2024-09-19T08:09:09.112546+0000","last_unstale":"2024-09-19T08:11:01.898721+0000","last_undegraded":"2024-09-19T08:11:01.898721+0000","last_fullsized":"2024-09-19T08:11:01.898721+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:09.906476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414661+0000","last_change":"2024-09-19T08:09:11.241478+0000","last_active":"2024-09-19T08:11:01.414661+0000","last_peered":"2024-09-19T08:11:01.414661+0000","last_clean":"2024-09-19T08:11:01.414661+0000","last_became_active":"2024-09-19T08:09:11.241138+0000","last_became_peered":"2024-09-19T08:09:11.241138+0000","last_unstale":"2024-09-19T08:11:01.414661+0000","last_undegraded":"2024-09-19T08:11:01.414661+0000","last_fullsized":"2024-09-19T08:11:01.414661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:32.884491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898598+0000","last_change":"2024-09-19T08:09:09.116571+0000","last_active":"2024-09-19T08:11:01.898598+0000","last_peered":"2024-09-19T08:11:01.898598+0000","last_clean":"2024-09-19T08:11:01.898598+0000","last_became_active":"2024-09-19T08:09:09.116180+0000","last_became_peered":"2024-09-19T08:09:09.116180+0000","last_unstale":"2024-09-19T08:11:01.898598+0000","last_undegraded":"2024-09-19T08:11:01.898598+0000","last_fullsized":"2024-09-19T08:11:01.898598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:58.577320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323834+0000","last_change":"2024-09-19T08:10:14.791196+0000","last_active":"2024-09-19T08:11:01.323834+0000","last_peered":"2024-09-19T08:11:01.323834+0000","last_clean":"2024-09-19T08:11:01.323834+0000","last_became_active":"2024-09-19T08:10:14.790873+0000","last_became_peered":"2024-09-19T08:10:14.790873+0000","last_unstale":"2024-09-19T08:11:01.323834+0000","last_undegraded":"2024-09-19T08:11:01.323834+0000","last_fullsized":"2024-09-19T08:11:01.323834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:41.725521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323966+0000","last_change":"2024-09-19T08:09:09.242166+0000","last_active":"2024-09-19T08:11:01.323966+0000","last_peered":"2024-09-19T08:11:01.323966+0000","last_clean":"2024-09-19T08:11:01.323966+0000","last_became_active":"2024-09-19T08:09:09.241270+0000","last_became_peered":"2024-09-19T08:09:09.241270+0000","last_unstale":"2024-09-19T08:11:01.323966+0000","last_undegraded":"2024-09-19T08:11:01.323966+0000","last_fullsized":"2024-09-19T08:11:01.323966+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:51.899069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327090+0000","last_change":"2024-09-19T08:10:14.793572+0000","last_active":"2024-09-19T08:11:01.327090+0000","last_peered":"2024-09-19T08:11:01.327090+0000","last_clean":"2024-09-19T08:11:01.327090+0000","last_became_active":"2024-09-19T08:10:14.793258+0000","last_became_peered":"2024-09-19T08:10:14.793258+0000","last_unstale":"2024-09-19T08:11:01.327090+0000","last_undegraded":"2024-09-19T08:11:01.327090+0000","last_fullsized":"2024-09-19T08:11:01.327090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:53.912430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899060+0000","last_change":"2024-09-19T08:09:09.118790+0000","last_active":"2024-09-19T08:11:01.899060+0000","last_peered":"2024-09-19T08:11:01.899060+0000","last_clean":"2024-09-19T08:11:01.899060+0000","last_became_active":"2024-09-19T08:09:09.117695+0000","last_became_peered":"2024-09-19T08:09:09.117695+0000","last_unstale":"2024-09-19T08:11:01.899060+0000","last_undegraded":"2024-09-19T08:11:01.899060+0000","last_fullsized":"2024-09-19T08:11:01.899060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:40.674039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325589+0000","last_change":"2024-09-19T08:09:11.249386+0000","last_active":"2024-09-19T08:11:01.325589+0000","last_peered":"2024-09-19T08:11:01.325589+0000","last_clean":"2024-09-19T08:11:01.325589+0000","last_became_active":"2024-09-19T08:09:11.249004+0000","last_became_peered":"2024-09-19T08:09:11.249004+0000","last_unstale":"2024-09-19T08:11:01.325589+0000","last_undegraded":"2024-09-19T08:11:01.325589+0000","last_fullsized":"2024-09-19T08:11:01.325589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:50.170799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.410707+0000","last_change":"2024-09-19T08:09:09.241599+0000","last_active":"2024-09-19T08:11:01.410707+0000","last_peered":"2024-09-19T08:11:01.410707+0000","last_clean":"2024-09-19T08:11:01.410707+0000","last_became_active":"2024-09-19T08:09:09.241226+0000","last_became_peered":"2024-09-19T08:09:09.241226+0000","last_unstale":"2024-09-19T08:11:01.410707+0000","last_undegraded":"2024-09-19T08:11:01.410707+0000","last_fullsized":"2024-09-19T08:11:01.410707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:19.590966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325735+0000","last_change":"2024-09-19T08:09:11.238098+0000","last_active":"2024-09-19T08:11:01.325735+0000","last_peered":"2024-09-19T08:11:01.325735+0000","last_clean":"2024-09-19T08:11:01.325735+0000","last_became_active":"2024-09-19T08:09:11.237737+0000","last_became_peered":"2024-09-19T08:09:11.237737+0000","last_unstale":"2024-09-19T08:11:01.325735+0000","last_undegraded":"2024-09-19T08:11:01.325735+0000","last_fullsized":"2024-09-19T08:11:01.325735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:00.134664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413888+0000","last_change":"2024-09-19T08:09:09.241775+0000","last_active":"2024-09-19T08:11:01.413888+0000","last_peered":"2024-09-19T08:11:01.413888+0000","last_clean":"2024-09-19T08:11:01.413888+0000","last_became_active":"2024-09-19T08:09:09.241367+0000","last_became_peered":"2024-09-19T08:09:09.241367+0000","last_unstale":"2024-09-19T08:11:01.413888+0000","last_undegraded":"2024-09-19T08:11:01.413888+0000","last_fullsized":"2024-09-19T08:11:01.413888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:11.862171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324396+0000","last_change":"2024-09-19T08:09:11.251980+0000","last_active":"2024-09-19T08:11:01.324396+0000","last_peered":"2024-09-19T08:11:01.324396+0000","last_clean":"2024-09-19T08:11:01.324396+0000","last_became_active":"2024-09-19T08:09:11.251638+0000","last_became_peered":"2024-09-19T08:09:11.251638+0000","last_unstale":"2024-09-19T08:11:01.324396+0000","last_undegraded":"2024-09-19T08:11:01.324396+0000","last_fullsized":"2024-09-19T08:11:01.324396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:35.905643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'45","reported_seq":92,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.558199+0000","last_change":"2024-09-19T08:09:09.117150+0000","last_active":"2024-09-19T08:11:01.558199+0000","last_peered":"2024-09-19T08:11:01.558199+0000","last_clean":"2024-09-19T08:11:01.558199+0000","last_became_active":"2024-09-19T08:09:09.116763+0000","last_became_peered":"2024-09-19T08:09:09.116763+0000","last_unstale":"2024-09-19T08:11:01.558199+0000","last_undegraded":"2024-09-19T08:11:01.558199+0000","last_fullsized":"2024-09-19T08:11:01.558199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:18.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":82,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.415619+0000","last_change":"2024-09-19T08:09:11.244366+0000","last_active":"2024-09-19T08:11:01.415619+0000","last_peered":"2024-09-19T08:11:01.415619+0000","last_clean":"2024-09-19T08:11:01.415619+0000","last_became_active":"2024-09-19T08:09:11.244023+0000","last_became_peered":"2024-09-19T08:09:11.244023+0000","last_unstale":"2024-09-19T08:11:01.415619+0000","last_undegraded":"2024-09-19T08:11:01.415619+0000","last_fullsized":"2024-09-19T08:11:01.415619+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:18.572377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898860+0000","last_change":"2024-09-19T08:09:09.139557+0000","last_active":"2024-09-19T08:11:01.898860+0000","last_peered":"2024-09-19T08:11:01.898860+0000","last_clean":"2024-09-19T08:11:01.898860+0000","last_became_active":"2024-09-19T08:09:09.139190+0000","last_became_peered":"2024-09-19T08:09:09.139190+0000","last_unstale":"2024-09-19T08:11:01.898860+0000","last_undegraded":"2024-09-19T08:11:01.898860+0000","last_fullsized":"2024-09-19T08:11:01.898860+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:39.270432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898761+0000","last_change":"2024-09-19T08:09:11.249637+0000","last_active":"2024-09-19T08:11:01.898761+0000","last_peered":"2024-09-19T08:11:01.898761+0000","last_clean":"2024-09-19T08:11:01.898761+0000","last_became_active":"2024-09-19T08:09:11.249323+0000","last_became_peered":"2024-09-19T08:09:11.249323+0000","last_unstale":"2024-09-19T08:11:01.898761+0000","last_undegraded":"2024-09-19T08:11:01.898761+0000","last_fullsized":"2024-09-19T08:11:01.898761+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:28.270910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619321+0000","last_change":"2024-09-19T08:09:09.242444+0000","last_active":"2024-09-19T08:11:01.619321+0000","last_peered":"2024-09-19T08:11:01.619321+0000","last_clean":"2024-09-19T08:11:01.619321+0000","last_became_active":"2024-09-19T08:09:09.242095+0000","last_became_peered":"2024-09-19T08:09:09.242095+0000","last_unstale":"2024-09-19T08:11:01.619321+0000","last_undegraded":"2024-09-19T08:11:01.619321+0000","last_fullsized":"2024-09-19T08:11:01.619321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:42.941930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413514+0000","last_change":"2024-09-19T08:09:11.241588+0000","last_active":"2024-09-19T08:11:01.413514+0000","last_peered":"2024-09-19T08:11:01.413514+0000","last_clean":"2024-09-19T08:11:01.413514+0000","last_became_active":"2024-09-19T08:09:11.241076+0000","last_became_peered":"2024-09-19T08:09:11.241076+0000","last_unstale":"2024-09-19T08:11:01.413514+0000","last_undegraded":"2024-09-19T08:11:01.413514+0000","last_fullsized":"2024-09-19T08:11:01.413514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:01.676410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414370+0000","last_change":"2024-09-19T08:09:09.112494+0000","last_active":"2024-09-19T08:11:01.414370+0000","last_peered":"2024-09-19T08:11:01.414370+0000","last_clean":"2024-09-19T08:11:01.414370+0000","last_became_active":"2024-09-19T08:09:09.112019+0000","last_became_peered":"2024-09-19T08:09:09.112019+0000","last_unstale":"2024-09-19T08:11:01.414370+0000","last_undegraded":"2024-09-19T08:11:01.414370+0000","last_fullsized":"2024-09-19T08:11:01.414370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:17.674092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244542+0000","last_change":"2024-09-19T08:09:11.251420+0000","last_active":"2024-09-19T08:11:02.244542+0000","last_peered":"2024-09-19T08:11:02.244542+0000","last_clean":"2024-09-19T08:11:02.244542+0000","last_became_active":"2024-09-19T08:09:11.251083+0000","last_became_peered":"2024-09-19T08:09:11.251083+0000","last_unstale":"2024-09-19T08:11:02.244542+0000","last_undegraded":"2024-09-19T08:11:02.244542+0000","last_fullsized":"2024-09-19T08:11:02.244542+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:38.810616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244424+0000","last_change":"2024-09-19T08:10:14.825972+0000","last_active":"2024-09-19T08:11:02.244424+0000","last_peered":"2024-09-19T08:11:02.244424+0000","last_clean":"2024-09-19T08:11:02.244424+0000","last_became_active":"2024-09-19T08:10:14.825579+0000","last_became_peered":"2024-09-19T08:10:14.825579+0000","last_unstale":"2024-09-19T08:11:02.244424+0000","last_undegraded":"2024-09-19T08:11:02.244424+0000","last_fullsized":"2024-09-19T08:11:02.244424+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:06.708622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414973+0000","last_change":"2024-09-19T08:09:11.239096+0000","last_active":"2024-09-19T08:11:01.414973+0000","last_peered":"2024-09-19T08:11:01.414973+0000","last_clean":"2024-09-19T08:11:01.414973+0000","last_became_active":"2024-09-19T08:09:11.238739+0000","last_became_peered":"2024-09-19T08:09:11.238739+0000","last_unstale":"2024-09-19T08:11:01.414973+0000","last_undegraded":"2024-09-19T08:11:01.414973+0000","last_fullsized":"2024-09-19T08:11:01.414973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:27.161174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413598+0000","last_change":"2024-09-19T08:09:09.115198+0000","last_active":"2024-09-19T08:11:01.413598+0000","last_peered":"2024-09-19T08:11:01.413598+0000","last_clean":"2024-09-19T08:11:01.413598+0000","last_became_active":"2024-09-19T08:09:09.114783+0000","last_became_peered":"2024-09-19T08:09:09.114783+0000","last_unstale":"2024-09-19T08:11:01.413598+0000","last_undegraded":"2024-09-19T08:11:01.413598+0000","last_fullsized":"2024-09-19T08:11:01.413598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:45.674774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898887+0000","last_change":"2024-09-19T08:09:11.252450+0000","last_active":"2024-09-19T08:11:01.898887+0000","last_peered":"2024-09-19T08:11:01.898887+0000","last_clean":"2024-09-19T08:11:01.898887+0000","last_became_active":"2024-09-19T08:09:11.251696+0000","last_became_peered":"2024-09-19T08:09:11.251696+0000","last_unstale":"2024-09-19T08:11:01.898887+0000","last_undegraded":"2024-09-19T08:11:01.898887+0000","last_fullsized":"2024-09-19T08:11:01.898887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:48.179795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327527+0000","last_change":"2024-09-19T08:09:11.244571+0000","last_active":"2024-09-19T08:11:01.327527+0000","last_peered":"2024-09-19T08:11:01.327527+0000","last_clean":"2024-09-19T08:11:01.327527+0000","last_became_active":"2024-09-19T08:09:11.244217+0000","last_became_peered":"2024-09-19T08:09:11.244217+0000","last_unstale":"2024-09-19T08:11:01.327527+0000","last_undegraded":"2024-09-19T08:11:01.327527+0000","last_fullsized":"2024-09-19T08:11:01.327527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:52.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413805+0000","last_change":"2024-09-19T08:09:09.117355+0000","last_active":"2024-09-19T08:11:01.413805+0000","last_peered":"2024-09-19T08:11:01.413805+0000","last_clean":"2024-09-19T08:11:01.413805+0000","last_became_active":"2024-09-19T08:09:09.116806+0000","last_became_peered":"2024-09-19T08:09:09.116806+0000","last_unstale":"2024-09-19T08:11:01.413805+0000","last_undegraded":"2024-09-19T08:11:01.413805+0000","last_fullsized":"2024-09-19T08:11:01.413805+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:42.113015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619575+0000","last_change":"2024-09-19T08:09:11.245745+0000","last_active":"2024-09-19T08:11:01.619575+0000","last_peered":"2024-09-19T08:11:01.619575+0000","last_clean":"2024-09-19T08:11:01.619575+0000","last_became_active":"2024-09-19T08:09:11.245373+0000","last_became_peered":"2024-09-19T08:09:11.245373+0000","last_unstale":"2024-09-19T08:11:01.619575+0000","last_undegraded":"2024-09-19T08:11:01.619575+0000","last_fullsized":"2024-09-19T08:11:01.619575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:56.500738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413790+0000","last_change":"2024-09-19T08:09:09.119550+0000","last_active":"2024-09-19T08:11:01.413790+0000","last_peered":"2024-09-19T08:11:01.413790+0000","last_clean":"2024-09-19T08:11:01.413790+0000","last_became_active":"2024-09-19T08:09:09.119187+0000","last_became_peered":"2024-09-19T08:09:09.119187+0000","last_unstale":"2024-09-19T08:11:01.413790+0000","last_undegraded":"2024-09-19T08:11:01.413790+0000","last_fullsized":"2024-09-19T08:11:01.413790+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:14.629824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898802+0000","last_change":"2024-09-19T08:09:11.245318+0000","last_active":"2024-09-19T08:11:01.898802+0000","last_peered":"2024-09-19T08:11:01.898802+0000","last_clean":"2024-09-19T08:11:01.898802+0000","last_became_active":"2024-09-19T08:09:11.245000+0000","last_became_peered":"2024-09-19T08:09:11.245000+0000","last_unstale":"2024-09-19T08:11:01.898802+0000","last_undegraded":"2024-09-19T08:11:01.898802+0000","last_fullsized":"2024-09-19T08:11:01.898802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:53.590453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.416088+0000","last_change":"2024-09-19T08:09:09.241552+0000","last_active":"2024-09-19T08:11:01.416088+0000","last_peered":"2024-09-19T08:11:01.416088+0000","last_clean":"2024-09-19T08:11:01.416088+0000","last_became_active":"2024-09-19T08:09:09.241201+0000","last_became_peered":"2024-09-19T08:09:09.241201+0000","last_unstale":"2024-09-19T08:11:01.416088+0000","last_undegraded":"2024-09-19T08:11:01.416088+0000","last_fullsized":"2024-09-19T08:11:01.416088+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:09.374532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.415847+0000","last_change":"2024-09-19T08:09:11.246697+0000","last_active":"2024-09-19T08:11:01.415847+0000","last_peered":"2024-09-19T08:11:01.415847+0000","last_clean":"2024-09-19T08:11:01.415847+0000","last_became_active":"2024-09-19T08:09:11.246404+0000","last_became_peered":"2024-09-19T08:09:11.246404+0000","last_unstale":"2024-09-19T08:11:01.415847+0000","last_undegraded":"2024-09-19T08:11:01.415847+0000","last_fullsized":"2024-09-19T08:11:01.415847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.008875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.410864+0000","last_change":"2024-09-19T08:09:09.113401+0000","last_active":"2024-09-19T08:11:01.410864+0000","last_peered":"2024-09-19T08:11:01.410864+0000","last_clean":"2024-09-19T08:11:01.410864+0000","last_became_active":"2024-09-19T08:09:09.113026+0000","last_became_peered":"2024-09-19T08:09:09.113026+0000","last_unstale":"2024-09-19T08:11:01.410864+0000","last_undegraded":"2024-09-19T08:11:01.410864+0000","last_fullsized":"2024-09-19T08:11:01.410864+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:54.740955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595149,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":325,"num_read_kb":266,"num_write":203,"num_write_kb":1407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":1785447,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107475,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547237,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":444935,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776169,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1069056,"data_stored":1236749,"data_compressed":44853,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939695,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":838733,"data_compressed":22018,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168628,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":937984,"data_stored":838755,"data_compressed":22018,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397561,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":962560,"data_stored":1036002,"data_compressed":38697,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561086,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":445052,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790019,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":1167202,"data_compressed":44853,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953545,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":444957,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182478,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":970089,"data_compressed":28174,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":987136,"data_stored":514504,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":514470,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":445025,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":524920,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":131782,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":393820,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":393798,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":201329,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:11:12.978 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:11:13.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:12 smithi155 ceph-mon[35362]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-19T08:11:13.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:12 smithi203 ceph-mon[35198]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-19T08:11:13.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.205+0000 7f0b94683640 1 -- 172.21.15.27:0/1762362911 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b8c103740 msgr2=0x7f0b8c107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:13.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.205+0000 7f0b94683640 1 --2- 172.21.15.27:0/1762362911 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b8c103740 0x7f0b8c107b80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009930 tx=0x7f0b7c02a420 comp rx=0 tx=0).stop 2024-09-19T08:11:13.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.205+0000 7f0b94683640 1 -- 172.21.15.27:0/1762362911 shutdown_connections 2024-09-19T08:11:13.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.205+0000 7f0b94683640 1 --2- 172.21.15.27:0/1762362911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b8c108290 0x7f0b8c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:13.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.205+0000 7f0b94683640 1 --2- 172.21.15.27:0/1762362911 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b8c103740 0x7f0b8c107b80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:13.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.205+0000 7f0b94683640 1 --2- 172.21.15.27:0/1762362911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b8c102d90 0x7f0b8c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:13.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.205+0000 7f0b94683640 1 -- 172.21.15.27:0/1762362911 >> 172.21.15.27:0/1762362911 conn(0x7f0b8c0fc7d0 msgr2=0x7f0b8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:13.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.205+0000 7f0b94683640 1 -- 172.21.15.27:0/1762362911 shutdown_connections 2024-09-19T08:11:13.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.205+0000 7f0b94683640 1 -- 172.21.15.27:0/1762362911 wait complete. 2024-09-19T08:11:13.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.205+0000 7f0b94683640 1 Processor -- start 2024-09-19T08:11:13.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.205+0000 7f0b94683640 1 -- start start 2024-09-19T08:11:13.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.206+0000 7f0b94683640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b8c102d90 0x7f0b8c1a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:13.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.206+0000 7f0b94683640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b8c103740 0x7f0b8c1a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:13.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.206+0000 7f0b94683640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b8c108290 0x7f0b8c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:13.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.206+0000 7f0b94683640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8c112090 con 0x7f0b8c103740 2024-09-19T08:11:13.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.206+0000 7f0b94683640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8c111f10 con 0x7f0b8c102d90 2024-09-19T08:11:13.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.206+0000 7f0b94683640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8c112210 con 0x7f0b8c108290 2024-09-19T08:11:13.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.206+0000 7f0b91c1e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b8c103740 0x7f0b8c1a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:13.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.206+0000 7f0b91c1e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b8c103740 0x7f0b8c1a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45190/0 (socket says 172.21.15.27:45190) 2024-09-19T08:11:13.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.206+0000 7f0b91c1e640 1 -- 172.21.15.27:0/3558594598 learned_addr learned my addr 172.21.15.27:0/3558594598 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:13.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.206+0000 7f0b92c20640 1 --2- 172.21.15.27:0/3558594598 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b8c108290 0x7f0b8c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:13.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.206+0000 7f0b9241f640 1 --2- 172.21.15.27:0/3558594598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b8c102d90 0x7f0b8c1a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:13.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.206+0000 7f0b91c1e640 1 -- 172.21.15.27:0/3558594598 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b8c108290 msgr2=0x7f0b8c19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:13.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.206+0000 7f0b91c1e640 1 --2- 172.21.15.27:0/3558594598 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b8c108290 0x7f0b8c19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:13.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.206+0000 7f0b91c1e640 1 -- 172.21.15.27:0/3558594598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b8c102d90 msgr2=0x7f0b8c1a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:13.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.206+0000 7f0b91c1e640 1 --2- 172.21.15.27:0/3558594598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b8c102d90 0x7f0b8c1a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:13.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.206+0000 7f0b91c1e640 1 -- 172.21.15.27:0/3558594598 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b8c19ad50 con 0x7f0b8c103740 2024-09-19T08:11:13.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.206+0000 7f0b92c20640 1 --2- 172.21.15.27:0/3558594598 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b8c108290 0x7f0b8c19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:13.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.206+0000 7f0b9241f640 1 --2- 172.21.15.27:0/3558594598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b8c102d90 0x7f0b8c1a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:11:13.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.206+0000 7f0b91c1e640 1 --2- 172.21.15.27:0/3558594598 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b8c103740 0x7f0b8c1a09a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c005940 tx=0x7f0b7c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:13.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.207+0000 7f0b837fe640 1 -- 172.21.15.27:0/3558594598 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c03f030 con 0x7f0b8c103740 2024-09-19T08:11:13.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.207+0000 7f0b837fe640 1 -- 172.21.15.27:0/3558594598 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b7c003ce0 con 0x7f0b8c103740 2024-09-19T08:11:13.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.207+0000 7f0b94683640 1 -- 172.21.15.27:0/3558594598 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b8c19afe0 con 0x7f0b8c103740 2024-09-19T08:11:13.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.207+0000 7f0b837fe640 1 -- 172.21.15.27:0/3558594598 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c035070 con 0x7f0b8c103740 2024-09-19T08:11:13.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.207+0000 7f0b94683640 1 -- 172.21.15.27:0/3558594598 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b8c1a7330 con 0x7f0b8c103740 2024-09-19T08:11:13.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.208+0000 7f0b94683640 1 -- 172.21.15.27:0/3558594598 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b8c06a7f0 con 0x7f0b8c103740 2024-09-19T08:11:13.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.209+0000 7f0b837fe640 1 -- 172.21.15.27:0/3558594598 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f0b7c042030 con 0x7f0b8c103740 2024-09-19T08:11:13.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.210+0000 7f0b837fe640 1 --2- 172.21.15.27:0/3558594598 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f0b780a34c0 0x7f0b780a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:13.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.210+0000 7f0b9241f640 1 --2- 172.21.15.27:0/3558594598 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f0b780a34c0 0x7f0b780a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:13.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.210+0000 7f0b837fe640 1 -- 172.21.15.27:0/3558594598 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f0b7c0f0630 con 0x7f0b8c103740 2024-09-19T08:11:13.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.210+0000 7f0b9241f640 1 --2- 172.21.15.27:0/3558594598 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f0b780a34c0 0x7f0b780a5980 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0b88009b40 tx=0x7f0b88005e50 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:13.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.213+0000 7f0b837fe640 1 -- 172.21.15.27:0/3558594598 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0b7c0bcef0 con 0x7f0b8c103740 2024-09-19T08:11:13.352 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:13.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.437+0000 7f0b94683640 1 -- 172.21.15.27:0/3558594598 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b8c103170 con 0x7f0b8c103740 2024-09-19T08:11:13.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.438+0000 7f0b837fe640 1 -- 172.21.15.27:0/3558594598 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f0b8c103170 con 0x7f0b8c103740 2024-09-19T08:11:13.439 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:11:13.439 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:11:13.439 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:11:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.440+0000 7f0b94683640 1 -- 172.21.15.27:0/3558594598 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f0b780a34c0 msgr2=0x7f0b780a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.440+0000 7f0b94683640 1 --2- 172.21.15.27:0/3558594598 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f0b780a34c0 0x7f0b780a5980 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0b88009b40 tx=0x7f0b88005e50 comp rx=0 tx=0).stop 2024-09-19T08:11:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.440+0000 7f0b94683640 1 -- 172.21.15.27:0/3558594598 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b8c103740 msgr2=0x7f0b8c1a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.440+0000 7f0b94683640 1 --2- 172.21.15.27:0/3558594598 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b8c103740 0x7f0b8c1a09a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c005940 tx=0x7f0b7c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:11:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.440+0000 7f0b94683640 1 -- 172.21.15.27:0/3558594598 shutdown_connections 2024-09-19T08:11:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.440+0000 7f0b94683640 1 --2- 172.21.15.27:0/3558594598 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f0b780a34c0 0x7f0b780a5980 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.440+0000 7f0b94683640 1 --2- 172.21.15.27:0/3558594598 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b8c108290 0x7f0b8c19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.440+0000 7f0b94683640 1 --2- 172.21.15.27:0/3558594598 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b8c103740 0x7f0b8c1a09a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:13.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.440+0000 7f0b94683640 1 --2- 172.21.15.27:0/3558594598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b8c102d90 0x7f0b8c1a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:13.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.440+0000 7f0b94683640 1 -- 172.21.15.27:0/3558594598 >> 172.21.15.27:0/3558594598 conn(0x7f0b8c0fc7d0 msgr2=0x7f0b8c100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:13.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.440+0000 7f0b94683640 1 -- 172.21.15.27:0/3558594598 shutdown_connections 2024-09-19T08:11:13.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:13.440+0000 7f0b94683640 1 -- 172.21.15.27:0/3558594598 wait complete. 2024-09-19T08:11:14.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.069+0000 7f8d744fc640 1 -- 172.21.15.27:0/4028007712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d6c102790 msgr2=0x7f8d6c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:14.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.069+0000 7f8d744fc640 1 --2- 172.21.15.27:0/4028007712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d6c102790 0x7f8d6c1067e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009900 tx=0x7f8d6002a410 comp rx=0 tx=0).stop 2024-09-19T08:11:14.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.069+0000 7f8d744fc640 1 -- 172.21.15.27:0/4028007712 shutdown_connections 2024-09-19T08:11:14.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.069+0000 7f8d744fc640 1 --2- 172.21.15.27:0/4028007712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c106f10 0x7f8d6c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:14.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.069+0000 7f8d744fc640 1 --2- 172.21.15.27:0/4028007712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d6c102790 0x7f8d6c1067e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:14.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.069+0000 7f8d744fc640 1 --2- 172.21.15.27:0/4028007712 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d6c101de0 0x7f8d6c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:14.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.069+0000 7f8d744fc640 1 -- 172.21.15.27:0/4028007712 >> 172.21.15.27:0/4028007712 conn(0x7f8d6c0fd8c0 msgr2=0x7f8d6c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:14.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.069+0000 7f8d744fc640 1 -- 172.21.15.27:0/4028007712 shutdown_connections 2024-09-19T08:11:14.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.069+0000 7f8d744fc640 1 -- 172.21.15.27:0/4028007712 wait complete. 2024-09-19T08:11:14.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.070+0000 7f8d744fc640 1 Processor -- start 2024-09-19T08:11:14.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.070+0000 7f8d744fc640 1 -- start start 2024-09-19T08:11:14.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.070+0000 7f8d744fc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d6c101de0 0x7f8d6c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:14.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.070+0000 7f8d744fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d6c102790 0x7f8d6c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:14.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.070+0000 7f8d744fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c106f10 0x7f8d6c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:14.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.070+0000 7f8d744fc640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c111f70 con 0x7f8d6c102790 2024-09-19T08:11:14.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.070+0000 7f8d744fc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c111df0 con 0x7f8d6c106f10 2024-09-19T08:11:14.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.070+0000 7f8d744fc640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c1120f0 con 0x7f8d6c101de0 2024-09-19T08:11:14.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.070+0000 7f8d71a97640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d6c102790 0x7f8d6c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:14.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.070+0000 7f8d71a97640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d6c102790 0x7f8d6c198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45204/0 (socket says 172.21.15.27:45204) 2024-09-19T08:11:14.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.070+0000 7f8d71a97640 1 -- 172.21.15.27:0/3737912942 learned_addr learned my addr 172.21.15.27:0/3737912942 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:14.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.070+0000 7f8d72298640 1 --2- 172.21.15.27:0/3737912942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d6c101de0 0x7f8d6c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:14.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.071+0000 7f8d72a99640 1 --2- 172.21.15.27:0/3737912942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c106f10 0x7f8d6c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:14.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.071+0000 7f8d71a97640 1 -- 172.21.15.27:0/3737912942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d6c101de0 msgr2=0x7f8d6c198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:14.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.071+0000 7f8d71a97640 1 --2- 172.21.15.27:0/3737912942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d6c101de0 0x7f8d6c198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:14.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.071+0000 7f8d71a97640 1 -- 172.21.15.27:0/3737912942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c106f10 msgr2=0x7f8d6c19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:14.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.071+0000 7f8d71a97640 1 --2- 172.21.15.27:0/3737912942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c106f10 0x7f8d6c19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:14.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.071+0000 7f8d71a97640 1 -- 172.21.15.27:0/3737912942 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6c19d3e0 con 0x7f8d6c102790 2024-09-19T08:11:14.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.071+0000 7f8d71a97640 1 --2- 172.21.15.27:0/3737912942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d6c102790 0x7f8d6c198970 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8d60006010 tx=0x7f8d600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:14.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.071+0000 7f8d5f7fe640 1 -- 172.21.15.27:0/3737912942 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6003f030 con 0x7f8d6c102790 2024-09-19T08:11:14.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.071+0000 7f8d5f7fe640 1 -- 172.21.15.27:0/3737912942 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d60003ce0 con 0x7f8d6c102790 2024-09-19T08:11:14.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.071+0000 7f8d744fc640 1 -- 172.21.15.27:0/3737912942 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6c19d670 con 0x7f8d6c102790 2024-09-19T08:11:14.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.071+0000 7f8d5f7fe640 1 -- 172.21.15.27:0/3737912942 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d60035070 con 0x7f8d6c102790 2024-09-19T08:11:14.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.071+0000 7f8d744fc640 1 -- 172.21.15.27:0/3737912942 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d6c1a4fb0 con 0x7f8d6c102790 2024-09-19T08:11:14.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.072+0000 7f8d744fc640 1 -- 172.21.15.27:0/3737912942 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d6c1021c0 con 0x7f8d6c102790 2024-09-19T08:11:14.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.073+0000 7f8d5f7fe640 1 -- 172.21.15.27:0/3737912942 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f8d60042030 con 0x7f8d6c102790 2024-09-19T08:11:14.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.074+0000 7f8d5f7fe640 1 --2- 172.21.15.27:0/3737912942 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8d580a34c0 0x7f8d580a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:14.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.074+0000 7f8d72298640 1 --2- 172.21.15.27:0/3737912942 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8d580a34c0 0x7f8d580a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:14.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.074+0000 7f8d5f7fe640 1 -- 172.21.15.27:0/3737912942 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f8d600f0350 con 0x7f8d6c102790 2024-09-19T08:11:14.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.075+0000 7f8d72298640 1 --2- 172.21.15.27:0/3737912942 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8d580a34c0 0x7f8d580a5980 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8d680058c0 tx=0x7f8d6800a250 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:14.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.078+0000 7f8d5f7fe640 1 -- 172.21.15.27:0/3737912942 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8d600bc680 con 0x7f8d6c102790 2024-09-19T08:11:14.206 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:13 smithi027 ceph-mon[31209]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:11:14.206 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:13 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3558594598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:14.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:13 smithi155 ceph-mon[35362]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:11:14.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:13 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3558594598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:14.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.256+0000 7f8d744fc640 1 -- 172.21.15.27:0/3737912942 --> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8d6c10a120 con 0x7f8d580a34c0 2024-09-19T08:11:14.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:13 smithi203 ceph-mon[35198]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:11:14.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:13 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3558594598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:14.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.263+0000 7f8d5f7fe640 1 -- 172.21.15.27:0/3737912942 <== mgr.15093 v2:172.21.15.27:6800/1578338135 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257940 (secure 0 0 0) 0x7f8d6c10a120 con 0x7f8d580a34c0 2024-09-19T08:11:14.266 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:11:14.267 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-09-19T08:11:14.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.266+0000 7f8d744fc640 1 -- 172.21.15.27:0/3737912942 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8d580a34c0 msgr2=0x7f8d580a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:14.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.266+0000 7f8d744fc640 1 --2- 172.21.15.27:0/3737912942 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8d580a34c0 0x7f8d580a5980 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8d680058c0 tx=0x7f8d6800a250 comp rx=0 tx=0).stop 2024-09-19T08:11:14.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.266+0000 7f8d744fc640 1 -- 172.21.15.27:0/3737912942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d6c102790 msgr2=0x7f8d6c198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:14.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.266+0000 7f8d744fc640 1 --2- 172.21.15.27:0/3737912942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d6c102790 0x7f8d6c198970 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8d60006010 tx=0x7f8d600042f0 comp rx=0 tx=0).stop 2024-09-19T08:11:14.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.266+0000 7f8d744fc640 1 -- 172.21.15.27:0/3737912942 shutdown_connections 2024-09-19T08:11:14.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.266+0000 7f8d744fc640 1 --2- 172.21.15.27:0/3737912942 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8d580a34c0 0x7f8d580a5980 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:14.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.266+0000 7f8d744fc640 1 --2- 172.21.15.27:0/3737912942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c106f10 0x7f8d6c19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:14.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.266+0000 7f8d744fc640 1 --2- 172.21.15.27:0/3737912942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d6c102790 0x7f8d6c198970 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:14.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.266+0000 7f8d744fc640 1 --2- 172.21.15.27:0/3737912942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d6c101de0 0x7f8d6c198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:14.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.266+0000 7f8d744fc640 1 -- 172.21.15.27:0/3737912942 >> 172.21.15.27:0/3737912942 conn(0x7f8d6c0fd8c0 msgr2=0x7f8d6c0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:14.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.266+0000 7f8d744fc640 1 -- 172.21.15.27:0/3737912942 shutdown_connections 2024-09-19T08:11:14.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:14.266+0000 7f8d744fc640 1 -- 172.21.15.27:0/3737912942 wait complete. 2024-09-19T08:11:14.559 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:11:15.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:14 smithi155 ceph-mon[35362]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 83 KiB/s wr, 47 op/s 2024-09-19T08:11:15.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:14 smithi027 ceph-mon[31209]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 83 KiB/s wr, 47 op/s 2024-09-19T08:11:15.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:14 smithi203 ceph-mon[35198]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 83 KiB/s wr, 47 op/s 2024-09-19T08:11:15.367 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2024-09-19T08:11:13.338182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1382383,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":827,"num_read_kb":833,"num_write":532,"num_write_kb":5261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":879,"ondisk_log_size":879,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356408,"kb_used_data":11268,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585416,"statfs":{"total":1151940427776,"available":1151575465984,"internally_reserved":0,"allocated":11538432,"data_stored":9486369,"data_compressed":245412,"data_compressed_allocated":319488,"data_compressed_original":3969024,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":377,"num_read_kb":454,"num_write":146,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.987397"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244732+0000","last_change":"2024-09-19T08:09:11.246436+0000","last_active":"2024-09-19T08:11:02.244732+0000","last_peered":"2024-09-19T08:11:02.244732+0000","last_clean":"2024-09-19T08:11:02.244732+0000","last_became_active":"2024-09-19T08:09:11.245674+0000","last_became_peered":"2024-09-19T08:09:11.245674+0000","last_unstale":"2024-09-19T08:11:02.244732+0000","last_undegraded":"2024-09-19T08:11:02.244732+0000","last_fullsized":"2024-09-19T08:11:02.244732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:46.716474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898632+0000","last_change":"2024-09-19T08:09:11.243334+0000","last_active":"2024-09-19T08:11:01.898632+0000","last_peered":"2024-09-19T08:11:01.898632+0000","last_clean":"2024-09-19T08:11:01.898632+0000","last_became_active":"2024-09-19T08:09:11.243024+0000","last_became_peered":"2024-09-19T08:09:11.243024+0000","last_unstale":"2024-09-19T08:11:01.898632+0000","last_undegraded":"2024-09-19T08:11:01.898632+0000","last_fullsized":"2024-09-19T08:11:01.898632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.060068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898635+0000","last_change":"2024-09-19T08:09:11.254655+0000","last_active":"2024-09-19T08:11:01.898635+0000","last_peered":"2024-09-19T08:11:01.898635+0000","last_clean":"2024-09-19T08:11:01.898635+0000","last_became_active":"2024-09-19T08:09:11.254292+0000","last_became_peered":"2024-09-19T08:09:11.254292+0000","last_unstale":"2024-09-19T08:11:01.898635+0000","last_undegraded":"2024-09-19T08:11:01.898635+0000","last_fullsized":"2024-09-19T08:11:01.898635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:01.977743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899014+0000","last_change":"2024-09-19T08:09:11.257029+0000","last_active":"2024-09-19T08:11:01.899014+0000","last_peered":"2024-09-19T08:11:01.899014+0000","last_clean":"2024-09-19T08:11:01.899014+0000","last_became_active":"2024-09-19T08:09:11.256669+0000","last_became_peered":"2024-09-19T08:09:11.256669+0000","last_unstale":"2024-09-19T08:11:01.899014+0000","last_undegraded":"2024-09-19T08:11:01.899014+0000","last_fullsized":"2024-09-19T08:11:01.899014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:32.831036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413590+0000","last_change":"2024-09-19T08:09:11.240341+0000","last_active":"2024-09-19T08:11:01.413590+0000","last_peered":"2024-09-19T08:11:01.413590+0000","last_clean":"2024-09-19T08:11:01.413590+0000","last_became_active":"2024-09-19T08:09:11.239996+0000","last_became_peered":"2024-09-19T08:09:11.239996+0000","last_unstale":"2024-09-19T08:11:01.413590+0000","last_undegraded":"2024-09-19T08:11:01.413590+0000","last_fullsized":"2024-09-19T08:11:01.413590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:20.331791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325570+0000","last_change":"2024-09-19T08:09:11.248089+0000","last_active":"2024-09-19T08:11:01.325570+0000","last_peered":"2024-09-19T08:11:01.325570+0000","last_clean":"2024-09-19T08:11:01.325570+0000","last_became_active":"2024-09-19T08:09:11.247802+0000","last_became_peered":"2024-09-19T08:09:11.247802+0000","last_unstale":"2024-09-19T08:11:01.325570+0000","last_undegraded":"2024-09-19T08:11:01.325570+0000","last_fullsized":"2024-09-19T08:11:01.325570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.249119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898629+0000","last_change":"2024-09-19T08:09:11.246853+0000","last_active":"2024-09-19T08:11:01.898629+0000","last_peered":"2024-09-19T08:11:01.898629+0000","last_clean":"2024-09-19T08:11:01.898629+0000","last_became_active":"2024-09-19T08:09:11.246523+0000","last_became_peered":"2024-09-19T08:09:11.246523+0000","last_unstale":"2024-09-19T08:11:01.898629+0000","last_undegraded":"2024-09-19T08:11:01.898629+0000","last_fullsized":"2024-09-19T08:11:01.898629+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:54.879087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413783+0000","last_change":"2024-09-19T08:09:11.232588+0000","last_active":"2024-09-19T08:11:01.413783+0000","last_peered":"2024-09-19T08:11:01.413783+0000","last_clean":"2024-09-19T08:11:01.413783+0000","last_became_active":"2024-09-19T08:09:11.232251+0000","last_became_peered":"2024-09-19T08:09:11.232251+0000","last_unstale":"2024-09-19T08:11:01.413783+0000","last_undegraded":"2024-09-19T08:11:01.413783+0000","last_fullsized":"2024-09-19T08:11:01.413783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:57.622086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619576+0000","last_change":"2024-09-19T08:09:11.248854+0000","last_active":"2024-09-19T08:11:01.619576+0000","last_peered":"2024-09-19T08:11:01.619576+0000","last_clean":"2024-09-19T08:11:01.619576+0000","last_became_active":"2024-09-19T08:09:11.248524+0000","last_became_peered":"2024-09-19T08:09:11.248524+0000","last_unstale":"2024-09-19T08:11:01.619576+0000","last_undegraded":"2024-09-19T08:11:01.619576+0000","last_fullsized":"2024-09-19T08:11:01.619576+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:57.978974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325967+0000","last_change":"2024-09-19T08:10:14.786848+0000","last_active":"2024-09-19T08:11:01.325967+0000","last_peered":"2024-09-19T08:11:01.325967+0000","last_clean":"2024-09-19T08:11:01.325967+0000","last_became_active":"2024-09-19T08:10:14.786460+0000","last_became_peered":"2024-09-19T08:10:14.786460+0000","last_unstale":"2024-09-19T08:11:01.325967+0000","last_undegraded":"2024-09-19T08:11:01.325967+0000","last_fullsized":"2024-09-19T08:11:01.325967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:59.430185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899200+0000","last_change":"2024-09-19T08:09:11.247604+0000","last_active":"2024-09-19T08:11:01.899200+0000","last_peered":"2024-09-19T08:11:01.899200+0000","last_clean":"2024-09-19T08:11:01.899200+0000","last_became_active":"2024-09-19T08:09:11.247264+0000","last_became_peered":"2024-09-19T08:09:11.247264+0000","last_unstale":"2024-09-19T08:11:01.899200+0000","last_undegraded":"2024-09-19T08:11:01.899200+0000","last_fullsized":"2024-09-19T08:11:01.899200+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:15.315022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899033+0000","last_change":"2024-09-19T08:09:11.253948+0000","last_active":"2024-09-19T08:11:01.899033+0000","last_peered":"2024-09-19T08:11:01.899033+0000","last_clean":"2024-09-19T08:11:01.899033+0000","last_became_active":"2024-09-19T08:09:11.253402+0000","last_became_peered":"2024-09-19T08:09:11.253402+0000","last_unstale":"2024-09-19T08:11:01.899033+0000","last_undegraded":"2024-09-19T08:11:01.899033+0000","last_fullsized":"2024-09-19T08:11:01.899033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:04.884541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324201+0000","last_change":"2024-09-19T08:09:11.241770+0000","last_active":"2024-09-19T08:11:01.324201+0000","last_peered":"2024-09-19T08:11:01.324201+0000","last_clean":"2024-09-19T08:11:01.324201+0000","last_became_active":"2024-09-19T08:09:11.241356+0000","last_became_peered":"2024-09-19T08:09:11.241356+0000","last_unstale":"2024-09-19T08:11:01.324201+0000","last_undegraded":"2024-09-19T08:11:01.324201+0000","last_fullsized":"2024-09-19T08:11:01.324201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:02.722445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898444+0000","last_change":"2024-09-19T08:09:11.242874+0000","last_active":"2024-09-19T08:11:01.898444+0000","last_peered":"2024-09-19T08:11:01.898444+0000","last_clean":"2024-09-19T08:11:01.898444+0000","last_became_active":"2024-09-19T08:09:11.242383+0000","last_became_peered":"2024-09-19T08:09:11.242383+0000","last_unstale":"2024-09-19T08:11:01.898444+0000","last_undegraded":"2024-09-19T08:11:01.898444+0000","last_fullsized":"2024-09-19T08:11:01.898444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:51.900211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898325+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:11:01.898325+0000","last_peered":"2024-09-19T08:11:01.898325+0000","last_clean":"2024-09-19T08:11:01.898325+0000","last_became_active":"2024-09-19T08:09:11.250797+0000","last_became_peered":"2024-09-19T08:09:11.250797+0000","last_unstale":"2024-09-19T08:11:01.898325+0000","last_undegraded":"2024-09-19T08:11:01.898325+0000","last_fullsized":"2024-09-19T08:11:01.898325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:46.183857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619237+0000","last_change":"2024-09-19T08:09:11.250884+0000","last_active":"2024-09-19T08:11:01.619237+0000","last_peered":"2024-09-19T08:11:01.619237+0000","last_clean":"2024-09-19T08:11:01.619237+0000","last_became_active":"2024-09-19T08:09:11.250543+0000","last_became_peered":"2024-09-19T08:09:11.250543+0000","last_unstale":"2024-09-19T08:11:01.619237+0000","last_undegraded":"2024-09-19T08:11:01.619237+0000","last_fullsized":"2024-09-19T08:11:01.619237+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.259466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244747+0000","last_change":"2024-09-19T08:09:11.246705+0000","last_active":"2024-09-19T08:11:02.244747+0000","last_peered":"2024-09-19T08:11:02.244747+0000","last_clean":"2024-09-19T08:11:02.244747+0000","last_became_active":"2024-09-19T08:09:11.246117+0000","last_became_peered":"2024-09-19T08:09:11.246117+0000","last_unstale":"2024-09-19T08:11:02.244747+0000","last_undegraded":"2024-09-19T08:11:02.244747+0000","last_fullsized":"2024-09-19T08:11:02.244747+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:07.421222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.411014+0000","last_change":"2024-09-19T08:09:11.242181+0000","last_active":"2024-09-19T08:11:01.411014+0000","last_peered":"2024-09-19T08:11:01.411014+0000","last_clean":"2024-09-19T08:11:01.411014+0000","last_became_active":"2024-09-19T08:09:11.241882+0000","last_became_peered":"2024-09-19T08:09:11.241882+0000","last_unstale":"2024-09-19T08:11:01.411014+0000","last_undegraded":"2024-09-19T08:11:01.411014+0000","last_fullsized":"2024-09-19T08:11:01.411014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:35.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619497+0000","last_change":"2024-09-19T08:09:11.246038+0000","last_active":"2024-09-19T08:11:01.619497+0000","last_peered":"2024-09-19T08:11:01.619497+0000","last_clean":"2024-09-19T08:11:01.619497+0000","last_became_active":"2024-09-19T08:09:11.245554+0000","last_became_peered":"2024-09-19T08:09:11.245554+0000","last_unstale":"2024-09-19T08:11:01.619497+0000","last_undegraded":"2024-09-19T08:11:01.619497+0000","last_fullsized":"2024-09-19T08:11:01.619497+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:14.512425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244438+0000","last_change":"2024-09-19T08:09:11.249246+0000","last_active":"2024-09-19T08:11:02.244438+0000","last_peered":"2024-09-19T08:11:02.244438+0000","last_clean":"2024-09-19T08:11:02.244438+0000","last_became_active":"2024-09-19T08:09:11.248896+0000","last_became_peered":"2024-09-19T08:09:11.248896+0000","last_unstale":"2024-09-19T08:11:02.244438+0000","last_undegraded":"2024-09-19T08:11:02.244438+0000","last_fullsized":"2024-09-19T08:11:02.244438+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:40.406924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324207+0000","last_change":"2024-09-19T08:09:11.245421+0000","last_active":"2024-09-19T08:11:01.324207+0000","last_peered":"2024-09-19T08:11:01.324207+0000","last_clean":"2024-09-19T08:11:01.324207+0000","last_became_active":"2024-09-19T08:09:11.245071+0000","last_became_peered":"2024-09-19T08:09:11.245071+0000","last_unstale":"2024-09-19T08:11:01.324207+0000","last_undegraded":"2024-09-19T08:11:01.324207+0000","last_fullsized":"2024-09-19T08:11:01.324207+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:58.594399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619396+0000","last_change":"2024-09-19T08:09:11.246097+0000","last_active":"2024-09-19T08:11:01.619396+0000","last_peered":"2024-09-19T08:11:01.619396+0000","last_clean":"2024-09-19T08:11:01.619396+0000","last_became_active":"2024-09-19T08:09:11.245741+0000","last_became_peered":"2024-09-19T08:09:11.245741+0000","last_unstale":"2024-09-19T08:11:01.619396+0000","last_undegraded":"2024-09-19T08:11:01.619396+0000","last_fullsized":"2024-09-19T08:11:01.619396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:05.731148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414178+0000","last_change":"2024-09-19T08:09:11.251485+0000","last_active":"2024-09-19T08:11:01.414178+0000","last_peered":"2024-09-19T08:11:01.414178+0000","last_clean":"2024-09-19T08:11:01.414178+0000","last_became_active":"2024-09-19T08:09:11.251151+0000","last_became_peered":"2024-09-19T08:09:11.251151+0000","last_unstale":"2024-09-19T08:11:01.414178+0000","last_undegraded":"2024-09-19T08:11:01.414178+0000","last_fullsized":"2024-09-19T08:11:01.414178+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:47.231056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327085+0000","last_change":"2024-09-19T08:09:11.234490+0000","last_active":"2024-09-19T08:11:01.327085+0000","last_peered":"2024-09-19T08:11:01.327085+0000","last_clean":"2024-09-19T08:11:01.327085+0000","last_became_active":"2024-09-19T08:09:11.234163+0000","last_became_peered":"2024-09-19T08:09:11.234163+0000","last_unstale":"2024-09-19T08:11:01.327085+0000","last_undegraded":"2024-09-19T08:11:01.327085+0000","last_fullsized":"2024-09-19T08:11:01.327085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.610165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.415513+0000","last_change":"2024-09-19T08:09:11.247189+0000","last_active":"2024-09-19T08:11:01.415513+0000","last_peered":"2024-09-19T08:11:01.415513+0000","last_clean":"2024-09-19T08:11:01.415513+0000","last_became_active":"2024-09-19T08:09:11.246844+0000","last_became_peered":"2024-09-19T08:09:11.246844+0000","last_unstale":"2024-09-19T08:11:01.415513+0000","last_undegraded":"2024-09-19T08:11:01.415513+0000","last_fullsized":"2024-09-19T08:11:01.415513+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:50.764694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619668+0000","last_change":"2024-09-19T08:09:11.251655+0000","last_active":"2024-09-19T08:11:01.619668+0000","last_peered":"2024-09-19T08:11:01.619668+0000","last_clean":"2024-09-19T08:11:01.619668+0000","last_became_active":"2024-09-19T08:09:11.250930+0000","last_became_peered":"2024-09-19T08:09:11.250930+0000","last_unstale":"2024-09-19T08:11:01.619668+0000","last_undegraded":"2024-09-19T08:11:01.619668+0000","last_fullsized":"2024-09-19T08:11:01.619668+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:17.658277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244670+0000","last_change":"2024-09-19T08:09:11.248095+0000","last_active":"2024-09-19T08:11:02.244670+0000","last_peered":"2024-09-19T08:11:02.244670+0000","last_clean":"2024-09-19T08:11:02.244670+0000","last_became_active":"2024-09-19T08:09:11.247719+0000","last_became_peered":"2024-09-19T08:09:11.247719+0000","last_unstale":"2024-09-19T08:11:02.244670+0000","last_undegraded":"2024-09-19T08:11:02.244670+0000","last_fullsized":"2024-09-19T08:11:02.244670+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:26.701140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324250+0000","last_change":"2024-09-19T08:09:11.243232+0000","last_active":"2024-09-19T08:11:01.324250+0000","last_peered":"2024-09-19T08:11:01.324250+0000","last_clean":"2024-09-19T08:11:01.324250+0000","last_became_active":"2024-09-19T08:09:11.242927+0000","last_became_peered":"2024-09-19T08:09:11.242927+0000","last_unstale":"2024-09-19T08:11:01.324250+0000","last_undegraded":"2024-09-19T08:11:01.324250+0000","last_fullsized":"2024-09-19T08:11:01.324250+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:19.877520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898534+0000","last_change":"2024-09-19T08:09:11.249588+0000","last_active":"2024-09-19T08:11:01.898534+0000","last_peered":"2024-09-19T08:11:01.898534+0000","last_clean":"2024-09-19T08:11:01.898534+0000","last_became_active":"2024-09-19T08:09:11.249266+0000","last_became_peered":"2024-09-19T08:09:11.249266+0000","last_unstale":"2024-09-19T08:11:01.898534+0000","last_undegraded":"2024-09-19T08:11:01.898534+0000","last_fullsized":"2024-09-19T08:11:01.898534+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:43.332454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619356+0000","last_change":"2024-09-19T08:09:11.245866+0000","last_active":"2024-09-19T08:11:01.619356+0000","last_peered":"2024-09-19T08:11:01.619356+0000","last_clean":"2024-09-19T08:11:01.619356+0000","last_became_active":"2024-09-19T08:09:11.245505+0000","last_became_peered":"2024-09-19T08:09:11.245505+0000","last_unstale":"2024-09-19T08:11:01.619356+0000","last_undegraded":"2024-09-19T08:11:01.619356+0000","last_fullsized":"2024-09-19T08:11:01.619356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:38.203790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619389+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:11:01.619389+0000","last_peered":"2024-09-19T08:11:01.619389+0000","last_clean":"2024-09-19T08:11:01.619389+0000","last_became_active":"2024-09-19T08:09:11.250745+0000","last_became_peered":"2024-09-19T08:09:11.250745+0000","last_unstale":"2024-09-19T08:11:01.619389+0000","last_undegraded":"2024-09-19T08:11:01.619389+0000","last_fullsized":"2024-09-19T08:11:01.619389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:16.851230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244514+0000","last_change":"2024-09-19T08:09:11.255211+0000","last_active":"2024-09-19T08:11:02.244514+0000","last_peered":"2024-09-19T08:11:02.244514+0000","last_clean":"2024-09-19T08:11:02.244514+0000","last_became_active":"2024-09-19T08:09:11.254853+0000","last_became_peered":"2024-09-19T08:09:11.254853+0000","last_unstale":"2024-09-19T08:11:02.244514+0000","last_undegraded":"2024-09-19T08:11:02.244514+0000","last_fullsized":"2024-09-19T08:11:02.244514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.497502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413533+0000","last_change":"2024-09-19T08:09:11.247201+0000","last_active":"2024-09-19T08:11:01.413533+0000","last_peered":"2024-09-19T08:11:01.413533+0000","last_clean":"2024-09-19T08:11:01.413533+0000","last_became_active":"2024-09-19T08:09:11.246854+0000","last_became_peered":"2024-09-19T08:09:11.246854+0000","last_unstale":"2024-09-19T08:11:01.413533+0000","last_undegraded":"2024-09-19T08:11:01.413533+0000","last_fullsized":"2024-09-19T08:11:01.413533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:19.262849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327350+0000","last_change":"2024-09-19T08:09:09.113754+0000","last_active":"2024-09-19T08:11:01.327350+0000","last_peered":"2024-09-19T08:11:01.327350+0000","last_clean":"2024-09-19T08:11:01.327350+0000","last_became_active":"2024-09-19T08:09:09.113389+0000","last_became_peered":"2024-09-19T08:09:09.113389+0000","last_unstale":"2024-09-19T08:11:01.327350+0000","last_undegraded":"2024-09-19T08:11:01.327350+0000","last_fullsized":"2024-09-19T08:11:01.327350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:45.325895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327320+0000","last_change":"2024-09-19T08:09:11.244625+0000","last_active":"2024-09-19T08:11:01.327320+0000","last_peered":"2024-09-19T08:11:01.327320+0000","last_clean":"2024-09-19T08:11:01.327320+0000","last_became_active":"2024-09-19T08:09:11.244277+0000","last_became_peered":"2024-09-19T08:09:11.244277+0000","last_unstale":"2024-09-19T08:11:01.327320+0000","last_undegraded":"2024-09-19T08:11:01.327320+0000","last_fullsized":"2024-09-19T08:11:01.327320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:33:34.050343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325579+0000","last_change":"2024-09-19T08:09:09.116735+0000","last_active":"2024-09-19T08:11:01.325579+0000","last_peered":"2024-09-19T08:11:01.325579+0000","last_clean":"2024-09-19T08:11:01.325579+0000","last_became_active":"2024-09-19T08:09:09.116356+0000","last_became_peered":"2024-09-19T08:09:09.116356+0000","last_unstale":"2024-09-19T08:11:01.325579+0000","last_undegraded":"2024-09-19T08:11:01.325579+0000","last_fullsized":"2024-09-19T08:11:01.325579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:50.952567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323834+0000","last_change":"2024-09-19T08:09:09.113182+0000","last_active":"2024-09-19T08:11:01.323834+0000","last_peered":"2024-09-19T08:11:01.323834+0000","last_clean":"2024-09-19T08:11:01.323834+0000","last_became_active":"2024-09-19T08:09:09.112528+0000","last_became_peered":"2024-09-19T08:09:09.112528+0000","last_unstale":"2024-09-19T08:11:01.323834+0000","last_undegraded":"2024-09-19T08:11:01.323834+0000","last_fullsized":"2024-09-19T08:11:01.323834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:07.647351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413961+0000","last_change":"2024-09-19T08:09:11.241639+0000","last_active":"2024-09-19T08:11:01.413961+0000","last_peered":"2024-09-19T08:11:01.413961+0000","last_clean":"2024-09-19T08:11:01.413961+0000","last_became_active":"2024-09-19T08:09:11.241308+0000","last_became_peered":"2024-09-19T08:09:11.241308+0000","last_unstale":"2024-09-19T08:11:01.413961+0000","last_undegraded":"2024-09-19T08:11:01.413961+0000","last_fullsized":"2024-09-19T08:11:01.413961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:57.826870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327401+0000","last_change":"2024-09-19T08:09:09.118334+0000","last_active":"2024-09-19T08:11:01.327401+0000","last_peered":"2024-09-19T08:11:01.327401+0000","last_clean":"2024-09-19T08:11:01.327401+0000","last_became_active":"2024-09-19T08:09:09.118010+0000","last_became_peered":"2024-09-19T08:09:09.118010+0000","last_unstale":"2024-09-19T08:11:01.327401+0000","last_undegraded":"2024-09-19T08:11:01.327401+0000","last_fullsized":"2024-09-19T08:11:01.327401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:51.046598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.410546+0000","last_change":"2024-09-19T08:09:11.239990+0000","last_active":"2024-09-19T08:11:01.410546+0000","last_peered":"2024-09-19T08:11:01.410546+0000","last_clean":"2024-09-19T08:11:01.410546+0000","last_became_active":"2024-09-19T08:09:11.239643+0000","last_became_peered":"2024-09-19T08:09:11.239643+0000","last_unstale":"2024-09-19T08:11:01.410546+0000","last_undegraded":"2024-09-19T08:11:01.410546+0000","last_fullsized":"2024-09-19T08:11:01.410546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:07.078244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325867+0000","last_change":"2024-09-19T08:09:09.114397+0000","last_active":"2024-09-19T08:11:01.325867+0000","last_peered":"2024-09-19T08:11:01.325867+0000","last_clean":"2024-09-19T08:11:01.325867+0000","last_became_active":"2024-09-19T08:09:09.114051+0000","last_became_peered":"2024-09-19T08:09:09.114051+0000","last_unstale":"2024-09-19T08:11:01.325867+0000","last_undegraded":"2024-09-19T08:11:01.325867+0000","last_fullsized":"2024-09-19T08:11:01.325867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:41.799442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619494+0000","last_change":"2024-09-19T08:09:11.254802+0000","last_active":"2024-09-19T08:11:01.619494+0000","last_peered":"2024-09-19T08:11:01.619494+0000","last_clean":"2024-09-19T08:11:01.619494+0000","last_became_active":"2024-09-19T08:09:11.253869+0000","last_became_peered":"2024-09-19T08:09:11.253869+0000","last_unstale":"2024-09-19T08:11:01.619494+0000","last_undegraded":"2024-09-19T08:11:01.619494+0000","last_fullsized":"2024-09-19T08:11:01.619494+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:00.164834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899209+0000","last_change":"2024-09-19T08:09:09.118585+0000","last_active":"2024-09-19T08:11:01.899209+0000","last_peered":"2024-09-19T08:11:01.899209+0000","last_clean":"2024-09-19T08:11:01.899209+0000","last_became_active":"2024-09-19T08:09:09.118216+0000","last_became_peered":"2024-09-19T08:09:09.118216+0000","last_unstale":"2024-09-19T08:11:01.899209+0000","last_undegraded":"2024-09-19T08:11:01.899209+0000","last_fullsized":"2024-09-19T08:11:01.899209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:41.905746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898880+0000","last_change":"2024-09-19T08:09:11.249835+0000","last_active":"2024-09-19T08:11:01.898880+0000","last_peered":"2024-09-19T08:11:01.898880+0000","last_clean":"2024-09-19T08:11:01.898880+0000","last_became_active":"2024-09-19T08:09:11.249443+0000","last_became_peered":"2024-09-19T08:09:11.249443+0000","last_unstale":"2024-09-19T08:11:01.898880+0000","last_undegraded":"2024-09-19T08:11:01.898880+0000","last_fullsized":"2024-09-19T08:11:01.898880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:06.373126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327565+0000","last_change":"2024-09-19T08:09:09.242565+0000","last_active":"2024-09-19T08:11:01.327565+0000","last_peered":"2024-09-19T08:11:01.327565+0000","last_clean":"2024-09-19T08:11:01.327565+0000","last_became_active":"2024-09-19T08:09:09.242199+0000","last_became_peered":"2024-09-19T08:09:09.242199+0000","last_unstale":"2024-09-19T08:11:01.327565+0000","last_undegraded":"2024-09-19T08:11:01.327565+0000","last_fullsized":"2024-09-19T08:11:01.327565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:33.195385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619322+0000","last_change":"2024-09-19T08:09:11.251682+0000","last_active":"2024-09-19T08:11:01.619322+0000","last_peered":"2024-09-19T08:11:01.619322+0000","last_clean":"2024-09-19T08:11:01.619322+0000","last_became_active":"2024-09-19T08:09:11.251037+0000","last_became_peered":"2024-09-19T08:09:11.251037+0000","last_unstale":"2024-09-19T08:11:01.619322+0000","last_undegraded":"2024-09-19T08:11:01.619322+0000","last_fullsized":"2024-09-19T08:11:01.619322+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:29.518828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'35","reported_seq":297,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:11.486108+0000","last_change":"2024-09-19T08:09:09.119090+0000","last_active":"2024-09-19T08:11:11.486108+0000","last_peered":"2024-09-19T08:11:11.486108+0000","last_clean":"2024-09-19T08:11:11.486108+0000","last_became_active":"2024-09-19T08:09:09.118685+0000","last_became_peered":"2024-09-19T08:09:09.118685+0000","last_unstale":"2024-09-19T08:11:11.486108+0000","last_undegraded":"2024-09-19T08:11:11.486108+0000","last_fullsized":"2024-09-19T08:11:11.486108+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:21.540404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69535,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":238,"num_read_kb":187,"num_write":35,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413753+0000","last_change":"2024-09-19T08:09:11.243200+0000","last_active":"2024-09-19T08:11:01.413753+0000","last_peered":"2024-09-19T08:11:01.413753+0000","last_clean":"2024-09-19T08:11:01.413753+0000","last_became_active":"2024-09-19T08:09:11.242873+0000","last_became_peered":"2024-09-19T08:09:11.242873+0000","last_unstale":"2024-09-19T08:11:01.413753+0000","last_undegraded":"2024-09-19T08:11:01.413753+0000","last_fullsized":"2024-09-19T08:11:01.413753+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:35.817609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619483+0000","last_change":"2024-09-19T08:09:09.117117+0000","last_active":"2024-09-19T08:11:01.619483+0000","last_peered":"2024-09-19T08:11:01.619483+0000","last_clean":"2024-09-19T08:11:01.619483+0000","last_became_active":"2024-09-19T08:09:09.116512+0000","last_became_peered":"2024-09-19T08:09:09.116512+0000","last_unstale":"2024-09-19T08:11:01.619483+0000","last_undegraded":"2024-09-19T08:11:01.619483+0000","last_fullsized":"2024-09-19T08:11:01.619483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:15.010570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323874+0000","last_change":"2024-09-19T08:09:11.246648+0000","last_active":"2024-09-19T08:11:01.323874+0000","last_peered":"2024-09-19T08:11:01.323874+0000","last_clean":"2024-09-19T08:11:01.323874+0000","last_became_active":"2024-09-19T08:09:11.246317+0000","last_became_peered":"2024-09-19T08:09:11.246317+0000","last_unstale":"2024-09-19T08:11:01.323874+0000","last_undegraded":"2024-09-19T08:11:01.323874+0000","last_fullsized":"2024-09-19T08:11:01.323874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:43.285257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327239+0000","last_change":"2024-09-19T08:09:09.112599+0000","last_active":"2024-09-19T08:11:01.327239+0000","last_peered":"2024-09-19T08:11:01.327239+0000","last_clean":"2024-09-19T08:11:01.327239+0000","last_became_active":"2024-09-19T08:09:09.112281+0000","last_became_peered":"2024-09-19T08:09:09.112281+0000","last_unstale":"2024-09-19T08:11:01.327239+0000","last_undegraded":"2024-09-19T08:11:01.327239+0000","last_fullsized":"2024-09-19T08:11:01.327239+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:47.710235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898887+0000","last_change":"2024-09-19T08:09:11.253814+0000","last_active":"2024-09-19T08:11:01.898887+0000","last_peered":"2024-09-19T08:11:01.898887+0000","last_clean":"2024-09-19T08:11:01.898887+0000","last_became_active":"2024-09-19T08:09:11.253490+0000","last_became_peered":"2024-09-19T08:09:11.253490+0000","last_unstale":"2024-09-19T08:11:01.898887+0000","last_undegraded":"2024-09-19T08:11:01.898887+0000","last_fullsized":"2024-09-19T08:11:01.898887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:09.287110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898591+0000","last_change":"2024-09-19T08:09:09.114820+0000","last_active":"2024-09-19T08:11:01.898591+0000","last_peered":"2024-09-19T08:11:01.898591+0000","last_clean":"2024-09-19T08:11:01.898591+0000","last_became_active":"2024-09-19T08:09:09.114478+0000","last_became_peered":"2024-09-19T08:09:09.114478+0000","last_unstale":"2024-09-19T08:11:01.898591+0000","last_undegraded":"2024-09-19T08:11:01.898591+0000","last_fullsized":"2024-09-19T08:11:01.898591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:24.243629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898477+0000","last_change":"2024-09-19T08:10:14.789301+0000","last_active":"2024-09-19T08:11:01.898477+0000","last_peered":"2024-09-19T08:11:01.898477+0000","last_clean":"2024-09-19T08:11:01.898477+0000","last_became_active":"2024-09-19T08:10:14.788891+0000","last_became_peered":"2024-09-19T08:10:14.788891+0000","last_unstale":"2024-09-19T08:11:01.898477+0000","last_undegraded":"2024-09-19T08:11:01.898477+0000","last_fullsized":"2024-09-19T08:11:01.898477+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:03.142177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244400+0000","last_change":"2024-09-19T08:10:14.799207+0000","last_active":"2024-09-19T08:11:02.244400+0000","last_peered":"2024-09-19T08:11:02.244400+0000","last_clean":"2024-09-19T08:11:02.244400+0000","last_became_active":"2024-09-19T08:10:14.787612+0000","last_became_peered":"2024-09-19T08:10:14.787612+0000","last_unstale":"2024-09-19T08:11:02.244400+0000","last_undegraded":"2024-09-19T08:11:02.244400+0000","last_fullsized":"2024-09-19T08:11:02.244400+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:45.997778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327130+0000","last_change":"2024-09-19T08:09:11.245399+0000","last_active":"2024-09-19T08:11:01.327130+0000","last_peered":"2024-09-19T08:11:01.327130+0000","last_clean":"2024-09-19T08:11:01.327130+0000","last_became_active":"2024-09-19T08:09:11.245055+0000","last_became_peered":"2024-09-19T08:09:11.245055+0000","last_unstale":"2024-09-19T08:11:01.327130+0000","last_undegraded":"2024-09-19T08:11:01.327130+0000","last_fullsized":"2024-09-19T08:11:01.327130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:57.639205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413806+0000","last_change":"2024-09-19T08:09:09.115252+0000","last_active":"2024-09-19T08:11:01.413806+0000","last_peered":"2024-09-19T08:11:01.413806+0000","last_clean":"2024-09-19T08:11:01.413806+0000","last_became_active":"2024-09-19T08:09:09.114908+0000","last_became_peered":"2024-09-19T08:09:09.114908+0000","last_unstale":"2024-09-19T08:11:01.413806+0000","last_undegraded":"2024-09-19T08:11:01.413806+0000","last_fullsized":"2024-09-19T08:11:01.413806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:48.326221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244581+0000","last_change":"2024-09-19T08:09:11.249189+0000","last_active":"2024-09-19T08:11:02.244581+0000","last_peered":"2024-09-19T08:11:02.244581+0000","last_clean":"2024-09-19T08:11:02.244581+0000","last_became_active":"2024-09-19T08:09:11.248797+0000","last_became_peered":"2024-09-19T08:09:11.248797+0000","last_unstale":"2024-09-19T08:11:02.244581+0000","last_undegraded":"2024-09-19T08:11:02.244581+0000","last_fullsized":"2024-09-19T08:11:02.244581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:20.915638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324421+0000","last_change":"2024-09-19T08:09:09.112973+0000","last_active":"2024-09-19T08:11:01.324421+0000","last_peered":"2024-09-19T08:11:01.324421+0000","last_clean":"2024-09-19T08:11:01.324421+0000","last_became_active":"2024-09-19T08:09:09.112616+0000","last_became_peered":"2024-09-19T08:09:09.112616+0000","last_unstale":"2024-09-19T08:11:01.324421+0000","last_undegraded":"2024-09-19T08:11:01.324421+0000","last_fullsized":"2024-09-19T08:11:01.324421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:13.791926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899227+0000","last_change":"2024-09-19T08:09:11.240739+0000","last_active":"2024-09-19T08:11:01.899227+0000","last_peered":"2024-09-19T08:11:01.899227+0000","last_clean":"2024-09-19T08:11:01.899227+0000","last_became_active":"2024-09-19T08:09:11.240340+0000","last_became_peered":"2024-09-19T08:09:11.240340+0000","last_unstale":"2024-09-19T08:11:01.899227+0000","last_undegraded":"2024-09-19T08:11:01.899227+0000","last_fullsized":"2024-09-19T08:11:01.899227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:35.450279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'65","reported_seq":120,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:10.034377+0000","last_change":"2024-09-19T08:09:09.112516+0000","last_active":"2024-09-19T08:11:10.034377+0000","last_peered":"2024-09-19T08:11:10.034377+0000","last_clean":"2024-09-19T08:11:10.034377+0000","last_became_active":"2024-09-19T08:09:09.112140+0000","last_became_peered":"2024-09-19T08:09:09.112140+0000","last_unstale":"2024-09-19T08:11:10.034377+0000","last_undegraded":"2024-09-19T08:11:10.034377+0000","last_fullsized":"2024-09-19T08:11:10.034377+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:05.434331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899052+0000","last_change":"2024-09-19T08:09:11.252163+0000","last_active":"2024-09-19T08:11:01.899052+0000","last_peered":"2024-09-19T08:11:01.899052+0000","last_clean":"2024-09-19T08:11:01.899052+0000","last_became_active":"2024-09-19T08:09:11.251762+0000","last_became_peered":"2024-09-19T08:09:11.251762+0000","last_unstale":"2024-09-19T08:11:01.899052+0000","last_undegraded":"2024-09-19T08:11:01.899052+0000","last_fullsized":"2024-09-19T08:11:01.899052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:33.941910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898722+0000","last_change":"2024-09-19T08:10:14.788460+0000","last_active":"2024-09-19T08:11:01.898722+0000","last_peered":"2024-09-19T08:11:01.898722+0000","last_clean":"2024-09-19T08:11:01.898722+0000","last_became_active":"2024-09-19T08:10:14.787990+0000","last_became_peered":"2024-09-19T08:10:14.787990+0000","last_unstale":"2024-09-19T08:11:01.898722+0000","last_undegraded":"2024-09-19T08:11:01.898722+0000","last_fullsized":"2024-09-19T08:11:01.898722+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:24.549994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899257+0000","last_change":"2024-09-19T08:09:11.242438+0000","last_active":"2024-09-19T08:11:01.899257+0000","last_peered":"2024-09-19T08:11:01.899257+0000","last_clean":"2024-09-19T08:11:01.899257+0000","last_became_active":"2024-09-19T08:09:11.242114+0000","last_became_peered":"2024-09-19T08:09:11.242114+0000","last_unstale":"2024-09-19T08:11:01.899257+0000","last_undegraded":"2024-09-19T08:11:01.899257+0000","last_fullsized":"2024-09-19T08:11:01.899257+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:54.183012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"84'148","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:03.438528+0000","last_change":"2024-09-19T08:07:55.287566+0000","last_active":"2024-09-19T08:11:03.438528+0000","last_peered":"2024-09-19T08:11:03.438528+0000","last_clean":"2024-09-19T08:11:03.438528+0000","last_became_active":"2024-09-19T08:07:55.287037+0000","last_became_peered":"2024-09-19T08:07:55.287037+0000","last_unstale":"2024-09-19T08:11:03.438528+0000","last_undegraded":"2024-09-19T08:11:03.438528+0000","last_fullsized":"2024-09-19T08:11:03.438528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_clean_scrub_stamp":"2024-09-19T08:04:29.468857+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:49.553882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898721+0000","last_change":"2024-09-19T08:09:09.113497+0000","last_active":"2024-09-19T08:11:01.898721+0000","last_peered":"2024-09-19T08:11:01.898721+0000","last_clean":"2024-09-19T08:11:01.898721+0000","last_became_active":"2024-09-19T08:09:09.112546+0000","last_became_peered":"2024-09-19T08:09:09.112546+0000","last_unstale":"2024-09-19T08:11:01.898721+0000","last_undegraded":"2024-09-19T08:11:01.898721+0000","last_fullsized":"2024-09-19T08:11:01.898721+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:09.906476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414661+0000","last_change":"2024-09-19T08:09:11.241478+0000","last_active":"2024-09-19T08:11:01.414661+0000","last_peered":"2024-09-19T08:11:01.414661+0000","last_clean":"2024-09-19T08:11:01.414661+0000","last_became_active":"2024-09-19T08:09:11.241138+0000","last_became_peered":"2024-09-19T08:09:11.241138+0000","last_unstale":"2024-09-19T08:11:01.414661+0000","last_undegraded":"2024-09-19T08:11:01.414661+0000","last_fullsized":"2024-09-19T08:11:01.414661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:32.884491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898642+0000","last_change":"2024-09-19T08:09:09.116571+0000","last_active":"2024-09-19T08:11:01.898642+0000","last_peered":"2024-09-19T08:11:01.898642+0000","last_clean":"2024-09-19T08:11:01.898642+0000","last_became_active":"2024-09-19T08:09:09.116180+0000","last_became_peered":"2024-09-19T08:09:09.116180+0000","last_unstale":"2024-09-19T08:11:01.898642+0000","last_undegraded":"2024-09-19T08:11:01.898642+0000","last_fullsized":"2024-09-19T08:11:01.898642+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:58.577320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323898+0000","last_change":"2024-09-19T08:10:14.791196+0000","last_active":"2024-09-19T08:11:01.323898+0000","last_peered":"2024-09-19T08:11:01.323898+0000","last_clean":"2024-09-19T08:11:01.323898+0000","last_became_active":"2024-09-19T08:10:14.790873+0000","last_became_peered":"2024-09-19T08:10:14.790873+0000","last_unstale":"2024-09-19T08:11:01.323898+0000","last_undegraded":"2024-09-19T08:11:01.323898+0000","last_fullsized":"2024-09-19T08:11:01.323898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:41.725521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323997+0000","last_change":"2024-09-19T08:09:09.242166+0000","last_active":"2024-09-19T08:11:01.323997+0000","last_peered":"2024-09-19T08:11:01.323997+0000","last_clean":"2024-09-19T08:11:01.323997+0000","last_became_active":"2024-09-19T08:09:09.241270+0000","last_became_peered":"2024-09-19T08:09:09.241270+0000","last_unstale":"2024-09-19T08:11:01.323997+0000","last_undegraded":"2024-09-19T08:11:01.323997+0000","last_fullsized":"2024-09-19T08:11:01.323997+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:51.899069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327090+0000","last_change":"2024-09-19T08:10:14.793572+0000","last_active":"2024-09-19T08:11:01.327090+0000","last_peered":"2024-09-19T08:11:01.327090+0000","last_clean":"2024-09-19T08:11:01.327090+0000","last_became_active":"2024-09-19T08:10:14.793258+0000","last_became_peered":"2024-09-19T08:10:14.793258+0000","last_unstale":"2024-09-19T08:11:01.327090+0000","last_undegraded":"2024-09-19T08:11:01.327090+0000","last_fullsized":"2024-09-19T08:11:01.327090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:53.912430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899060+0000","last_change":"2024-09-19T08:09:09.118790+0000","last_active":"2024-09-19T08:11:01.899060+0000","last_peered":"2024-09-19T08:11:01.899060+0000","last_clean":"2024-09-19T08:11:01.899060+0000","last_became_active":"2024-09-19T08:09:09.117695+0000","last_became_peered":"2024-09-19T08:09:09.117695+0000","last_unstale":"2024-09-19T08:11:01.899060+0000","last_undegraded":"2024-09-19T08:11:01.899060+0000","last_fullsized":"2024-09-19T08:11:01.899060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:40.674039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325589+0000","last_change":"2024-09-19T08:09:11.249386+0000","last_active":"2024-09-19T08:11:01.325589+0000","last_peered":"2024-09-19T08:11:01.325589+0000","last_clean":"2024-09-19T08:11:01.325589+0000","last_became_active":"2024-09-19T08:09:11.249004+0000","last_became_peered":"2024-09-19T08:09:11.249004+0000","last_unstale":"2024-09-19T08:11:01.325589+0000","last_undegraded":"2024-09-19T08:11:01.325589+0000","last_fullsized":"2024-09-19T08:11:01.325589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:50.170799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.410707+0000","last_change":"2024-09-19T08:09:09.241599+0000","last_active":"2024-09-19T08:11:01.410707+0000","last_peered":"2024-09-19T08:11:01.410707+0000","last_clean":"2024-09-19T08:11:01.410707+0000","last_became_active":"2024-09-19T08:09:09.241226+0000","last_became_peered":"2024-09-19T08:09:09.241226+0000","last_unstale":"2024-09-19T08:11:01.410707+0000","last_undegraded":"2024-09-19T08:11:01.410707+0000","last_fullsized":"2024-09-19T08:11:01.410707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:19.590966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325735+0000","last_change":"2024-09-19T08:09:11.238098+0000","last_active":"2024-09-19T08:11:01.325735+0000","last_peered":"2024-09-19T08:11:01.325735+0000","last_clean":"2024-09-19T08:11:01.325735+0000","last_became_active":"2024-09-19T08:09:11.237737+0000","last_became_peered":"2024-09-19T08:09:11.237737+0000","last_unstale":"2024-09-19T08:11:01.325735+0000","last_undegraded":"2024-09-19T08:11:01.325735+0000","last_fullsized":"2024-09-19T08:11:01.325735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:00.134664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413888+0000","last_change":"2024-09-19T08:09:09.241775+0000","last_active":"2024-09-19T08:11:01.413888+0000","last_peered":"2024-09-19T08:11:01.413888+0000","last_clean":"2024-09-19T08:11:01.413888+0000","last_became_active":"2024-09-19T08:09:09.241367+0000","last_became_peered":"2024-09-19T08:09:09.241367+0000","last_unstale":"2024-09-19T08:11:01.413888+0000","last_undegraded":"2024-09-19T08:11:01.413888+0000","last_fullsized":"2024-09-19T08:11:01.413888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:11.862171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324396+0000","last_change":"2024-09-19T08:09:11.251980+0000","last_active":"2024-09-19T08:11:01.324396+0000","last_peered":"2024-09-19T08:11:01.324396+0000","last_clean":"2024-09-19T08:11:01.324396+0000","last_became_active":"2024-09-19T08:09:11.251638+0000","last_became_peered":"2024-09-19T08:09:11.251638+0000","last_unstale":"2024-09-19T08:11:01.324396+0000","last_undegraded":"2024-09-19T08:11:01.324396+0000","last_fullsized":"2024-09-19T08:11:01.324396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:35.905643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'98","reported_seq":214,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:10.394631+0000","last_change":"2024-09-19T08:09:09.117150+0000","last_active":"2024-09-19T08:11:10.394631+0000","last_peered":"2024-09-19T08:11:10.394631+0000","last_clean":"2024-09-19T08:11:10.394631+0000","last_became_active":"2024-09-19T08:09:09.116763+0000","last_became_peered":"2024-09-19T08:09:09.116763+0000","last_unstale":"2024-09-19T08:11:10.394631+0000","last_undegraded":"2024-09-19T08:11:10.394631+0000","last_fullsized":"2024-09-19T08:11:10.394631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:18.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":181,"num_write_kb":1286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.415619+0000","last_change":"2024-09-19T08:09:11.244366+0000","last_active":"2024-09-19T08:11:01.415619+0000","last_peered":"2024-09-19T08:11:01.415619+0000","last_clean":"2024-09-19T08:11:01.415619+0000","last_became_active":"2024-09-19T08:09:11.244023+0000","last_became_peered":"2024-09-19T08:09:11.244023+0000","last_unstale":"2024-09-19T08:11:01.415619+0000","last_undegraded":"2024-09-19T08:11:01.415619+0000","last_fullsized":"2024-09-19T08:11:01.415619+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:18.572377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898860+0000","last_change":"2024-09-19T08:09:09.139557+0000","last_active":"2024-09-19T08:11:01.898860+0000","last_peered":"2024-09-19T08:11:01.898860+0000","last_clean":"2024-09-19T08:11:01.898860+0000","last_became_active":"2024-09-19T08:09:09.139190+0000","last_became_peered":"2024-09-19T08:09:09.139190+0000","last_unstale":"2024-09-19T08:11:01.898860+0000","last_undegraded":"2024-09-19T08:11:01.898860+0000","last_fullsized":"2024-09-19T08:11:01.898860+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:39.270432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898761+0000","last_change":"2024-09-19T08:09:11.249637+0000","last_active":"2024-09-19T08:11:01.898761+0000","last_peered":"2024-09-19T08:11:01.898761+0000","last_clean":"2024-09-19T08:11:01.898761+0000","last_became_active":"2024-09-19T08:09:11.249323+0000","last_became_peered":"2024-09-19T08:09:11.249323+0000","last_unstale":"2024-09-19T08:11:01.898761+0000","last_undegraded":"2024-09-19T08:11:01.898761+0000","last_fullsized":"2024-09-19T08:11:01.898761+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:28.270910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619321+0000","last_change":"2024-09-19T08:09:09.242444+0000","last_active":"2024-09-19T08:11:01.619321+0000","last_peered":"2024-09-19T08:11:01.619321+0000","last_clean":"2024-09-19T08:11:01.619321+0000","last_became_active":"2024-09-19T08:09:09.242095+0000","last_became_peered":"2024-09-19T08:09:09.242095+0000","last_unstale":"2024-09-19T08:11:01.619321+0000","last_undegraded":"2024-09-19T08:11:01.619321+0000","last_fullsized":"2024-09-19T08:11:01.619321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:42.941930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413514+0000","last_change":"2024-09-19T08:09:11.241588+0000","last_active":"2024-09-19T08:11:01.413514+0000","last_peered":"2024-09-19T08:11:01.413514+0000","last_clean":"2024-09-19T08:11:01.413514+0000","last_became_active":"2024-09-19T08:09:11.241076+0000","last_became_peered":"2024-09-19T08:09:11.241076+0000","last_unstale":"2024-09-19T08:11:01.413514+0000","last_undegraded":"2024-09-19T08:11:01.413514+0000","last_fullsized":"2024-09-19T08:11:01.413514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:01.676410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414370+0000","last_change":"2024-09-19T08:09:09.112494+0000","last_active":"2024-09-19T08:11:01.414370+0000","last_peered":"2024-09-19T08:11:01.414370+0000","last_clean":"2024-09-19T08:11:01.414370+0000","last_became_active":"2024-09-19T08:09:09.112019+0000","last_became_peered":"2024-09-19T08:09:09.112019+0000","last_unstale":"2024-09-19T08:11:01.414370+0000","last_undegraded":"2024-09-19T08:11:01.414370+0000","last_fullsized":"2024-09-19T08:11:01.414370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:17.674092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244542+0000","last_change":"2024-09-19T08:09:11.251420+0000","last_active":"2024-09-19T08:11:02.244542+0000","last_peered":"2024-09-19T08:11:02.244542+0000","last_clean":"2024-09-19T08:11:02.244542+0000","last_became_active":"2024-09-19T08:09:11.251083+0000","last_became_peered":"2024-09-19T08:09:11.251083+0000","last_unstale":"2024-09-19T08:11:02.244542+0000","last_undegraded":"2024-09-19T08:11:02.244542+0000","last_fullsized":"2024-09-19T08:11:02.244542+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:38.810616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244424+0000","last_change":"2024-09-19T08:10:14.825972+0000","last_active":"2024-09-19T08:11:02.244424+0000","last_peered":"2024-09-19T08:11:02.244424+0000","last_clean":"2024-09-19T08:11:02.244424+0000","last_became_active":"2024-09-19T08:10:14.825579+0000","last_became_peered":"2024-09-19T08:10:14.825579+0000","last_unstale":"2024-09-19T08:11:02.244424+0000","last_undegraded":"2024-09-19T08:11:02.244424+0000","last_fullsized":"2024-09-19T08:11:02.244424+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:06.708622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414973+0000","last_change":"2024-09-19T08:09:11.239096+0000","last_active":"2024-09-19T08:11:01.414973+0000","last_peered":"2024-09-19T08:11:01.414973+0000","last_clean":"2024-09-19T08:11:01.414973+0000","last_became_active":"2024-09-19T08:09:11.238739+0000","last_became_peered":"2024-09-19T08:09:11.238739+0000","last_unstale":"2024-09-19T08:11:01.414973+0000","last_undegraded":"2024-09-19T08:11:01.414973+0000","last_fullsized":"2024-09-19T08:11:01.414973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:27.161174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413598+0000","last_change":"2024-09-19T08:09:09.115198+0000","last_active":"2024-09-19T08:11:01.413598+0000","last_peered":"2024-09-19T08:11:01.413598+0000","last_clean":"2024-09-19T08:11:01.413598+0000","last_became_active":"2024-09-19T08:09:09.114783+0000","last_became_peered":"2024-09-19T08:09:09.114783+0000","last_unstale":"2024-09-19T08:11:01.413598+0000","last_undegraded":"2024-09-19T08:11:01.413598+0000","last_fullsized":"2024-09-19T08:11:01.413598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:45.674774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898887+0000","last_change":"2024-09-19T08:09:11.252450+0000","last_active":"2024-09-19T08:11:01.898887+0000","last_peered":"2024-09-19T08:11:01.898887+0000","last_clean":"2024-09-19T08:11:01.898887+0000","last_became_active":"2024-09-19T08:09:11.251696+0000","last_became_peered":"2024-09-19T08:09:11.251696+0000","last_unstale":"2024-09-19T08:11:01.898887+0000","last_undegraded":"2024-09-19T08:11:01.898887+0000","last_fullsized":"2024-09-19T08:11:01.898887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:48.179795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327527+0000","last_change":"2024-09-19T08:09:11.244571+0000","last_active":"2024-09-19T08:11:01.327527+0000","last_peered":"2024-09-19T08:11:01.327527+0000","last_clean":"2024-09-19T08:11:01.327527+0000","last_became_active":"2024-09-19T08:09:11.244217+0000","last_became_peered":"2024-09-19T08:09:11.244217+0000","last_unstale":"2024-09-19T08:11:01.327527+0000","last_undegraded":"2024-09-19T08:11:01.327527+0000","last_fullsized":"2024-09-19T08:11:01.327527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:52.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413805+0000","last_change":"2024-09-19T08:09:09.117355+0000","last_active":"2024-09-19T08:11:01.413805+0000","last_peered":"2024-09-19T08:11:01.413805+0000","last_clean":"2024-09-19T08:11:01.413805+0000","last_became_active":"2024-09-19T08:09:09.116806+0000","last_became_peered":"2024-09-19T08:09:09.116806+0000","last_unstale":"2024-09-19T08:11:01.413805+0000","last_undegraded":"2024-09-19T08:11:01.413805+0000","last_fullsized":"2024-09-19T08:11:01.413805+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:42.113015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619575+0000","last_change":"2024-09-19T08:09:11.245745+0000","last_active":"2024-09-19T08:11:01.619575+0000","last_peered":"2024-09-19T08:11:01.619575+0000","last_clean":"2024-09-19T08:11:01.619575+0000","last_became_active":"2024-09-19T08:09:11.245373+0000","last_became_peered":"2024-09-19T08:09:11.245373+0000","last_unstale":"2024-09-19T08:11:01.619575+0000","last_undegraded":"2024-09-19T08:11:01.619575+0000","last_fullsized":"2024-09-19T08:11:01.619575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:56.500738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413790+0000","last_change":"2024-09-19T08:09:09.119550+0000","last_active":"2024-09-19T08:11:01.413790+0000","last_peered":"2024-09-19T08:11:01.413790+0000","last_clean":"2024-09-19T08:11:01.413790+0000","last_became_active":"2024-09-19T08:09:09.119187+0000","last_became_peered":"2024-09-19T08:09:09.119187+0000","last_unstale":"2024-09-19T08:11:01.413790+0000","last_undegraded":"2024-09-19T08:11:01.413790+0000","last_fullsized":"2024-09-19T08:11:01.413790+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:14.629824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898802+0000","last_change":"2024-09-19T08:09:11.245318+0000","last_active":"2024-09-19T08:11:01.898802+0000","last_peered":"2024-09-19T08:11:01.898802+0000","last_clean":"2024-09-19T08:11:01.898802+0000","last_became_active":"2024-09-19T08:09:11.245000+0000","last_became_peered":"2024-09-19T08:09:11.245000+0000","last_unstale":"2024-09-19T08:11:01.898802+0000","last_undegraded":"2024-09-19T08:11:01.898802+0000","last_fullsized":"2024-09-19T08:11:01.898802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:53.590453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.416131+0000","last_change":"2024-09-19T08:09:09.241552+0000","last_active":"2024-09-19T08:11:01.416131+0000","last_peered":"2024-09-19T08:11:01.416131+0000","last_clean":"2024-09-19T08:11:01.416131+0000","last_became_active":"2024-09-19T08:09:09.241201+0000","last_became_peered":"2024-09-19T08:09:09.241201+0000","last_unstale":"2024-09-19T08:11:01.416131+0000","last_undegraded":"2024-09-19T08:11:01.416131+0000","last_fullsized":"2024-09-19T08:11:01.416131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:09.374532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.415847+0000","last_change":"2024-09-19T08:09:11.246697+0000","last_active":"2024-09-19T08:11:01.415847+0000","last_peered":"2024-09-19T08:11:01.415847+0000","last_clean":"2024-09-19T08:11:01.415847+0000","last_became_active":"2024-09-19T08:09:11.246404+0000","last_became_peered":"2024-09-19T08:09:11.246404+0000","last_unstale":"2024-09-19T08:11:01.415847+0000","last_undegraded":"2024-09-19T08:11:01.415847+0000","last_fullsized":"2024-09-19T08:11:01.415847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.008875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:08.722748+0000","last_change":"2024-09-19T08:09:09.113401+0000","last_active":"2024-09-19T08:11:08.722748+0000","last_peered":"2024-09-19T08:11:08.722748+0000","last_clean":"2024-09-19T08:11:08.722748+0000","last_became_active":"2024-09-19T08:09:09.113026+0000","last_became_peered":"2024-09-19T08:09:09.113026+0000","last_unstale":"2024-09-19T08:11:08.722748+0000","last_undegraded":"2024-09-19T08:11:08.722748+0000","last_fullsized":"2024-09-19T08:11:08.722748+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:54.740955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":791781,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":590,"num_read_kb":503,"num_write":329,"num_write_kb":2321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":503808,"data_stored":2375343,"data_compressed":103473,"data_compressed_allocated":135168,"data_compressed_original":2101248,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107475,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547238,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":444935,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776170,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1093632,"data_stored":1433381,"data_compressed":53899,"data_compressed_allocated":69632,"data_compressed_original":905216,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939696,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":838733,"data_compressed":22161,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168629,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":838755,"data_compressed":22161,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397562,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":962560,"data_stored":1036002,"data_compressed":38697,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561087,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":445052,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790020,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1015808,"data_stored":1363834,"data_compressed":53899,"data_compressed_allocated":69632,"data_compressed_original":905216,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953546,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":444957,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":991232,"data_stored":1166721,"data_compressed":37363,"data_compressed_allocated":49152,"data_compressed_original":708608,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":987136,"data_stored":514504,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":514470,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":445025,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":721552,"data_compressed":34491,"data_compressed_allocated":45056,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":328414,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":393820,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":393798,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":397961,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:11:15.372 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T08:11:15.372 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:11:15.376 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:15.902 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:15 smithi027 ceph-mon[31209]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:11:15.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.902+0000 7f6c4d2b0640 1 -- 172.21.15.27:0/4087720617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c48102790 msgr2=0x7f6c481067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:15.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.902+0000 7f6c4d2b0640 1 --2- 172.21.15.27:0/4087720617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c48102790 0x7f6c481067e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009900 tx=0x7f6c3002a410 comp rx=0 tx=0).stop 2024-09-19T08:11:15.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.902+0000 7f6c4d2b0640 1 -- 172.21.15.27:0/4087720617 shutdown_connections 2024-09-19T08:11:15.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.902+0000 7f6c4d2b0640 1 --2- 172.21.15.27:0/4087720617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c48106f10 0x7f6c4810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.902+0000 7f6c4d2b0640 1 --2- 172.21.15.27:0/4087720617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c48102790 0x7f6c481067e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.902+0000 7f6c4d2b0640 1 --2- 172.21.15.27:0/4087720617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c48101de0 0x7f6c481021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.902+0000 7f6c4d2b0640 1 -- 172.21.15.27:0/4087720617 >> 172.21.15.27:0/4087720617 conn(0x7f6c480fd8e0 msgr2=0x7f6c480ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:15.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.902+0000 7f6c4d2b0640 1 -- 172.21.15.27:0/4087720617 shutdown_connections 2024-09-19T08:11:15.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.902+0000 7f6c4d2b0640 1 -- 172.21.15.27:0/4087720617 wait complete. 2024-09-19T08:11:15.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.902+0000 7f6c4d2b0640 1 Processor -- start 2024-09-19T08:11:15.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.903+0000 7f6c4d2b0640 1 -- start start 2024-09-19T08:11:15.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.903+0000 7f6c4d2b0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c48101de0 0x7f6c481984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:15.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.903+0000 7f6c4d2b0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c48102790 0x7f6c48198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:15.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.903+0000 7f6c4d2b0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c48106f10 0x7f6c4819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:15.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.903+0000 7f6c4d2b0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6c48111f70 con 0x7f6c48106f10 2024-09-19T08:11:15.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.903+0000 7f6c4d2b0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c48111df0 con 0x7f6c48101de0 2024-09-19T08:11:15.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.903+0000 7f6c4d2b0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c481120f0 con 0x7f6c48102790 2024-09-19T08:11:15.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.903+0000 7f6c477fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c48106f10 0x7f6c4819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:15.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.903+0000 7f6c477fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c48106f10 0x7f6c4819cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45226/0 (socket says 172.21.15.27:45226) 2024-09-19T08:11:15.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.903+0000 7f6c477fe640 1 -- 172.21.15.27:0/3879906899 learned_addr learned my addr 172.21.15.27:0/3879906899 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:15.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.903+0000 7f6c46ffd640 1 --2- 172.21.15.27:0/3879906899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c48101de0 0x7f6c481984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:15.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.903+0000 7f6c467fc640 1 --2- 172.21.15.27:0/3879906899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c48102790 0x7f6c48198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:15.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.904+0000 7f6c477fe640 1 -- 172.21.15.27:0/3879906899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c48102790 msgr2=0x7f6c48198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:15.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.904+0000 7f6c477fe640 1 --2- 172.21.15.27:0/3879906899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c48102790 0x7f6c48198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.904+0000 7f6c477fe640 1 -- 172.21.15.27:0/3879906899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c48101de0 msgr2=0x7f6c481984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:15.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.904+0000 7f6c477fe640 1 --2- 172.21.15.27:0/3879906899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c48101de0 0x7f6c481984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.904+0000 7f6c477fe640 1 -- 172.21.15.27:0/3879906899 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4819d480 con 0x7f6c48106f10 2024-09-19T08:11:15.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.904+0000 7f6c477fe640 1 --2- 172.21.15.27:0/3879906899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c48106f10 0x7f6c4819cda0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000d950 tx=0x7f6c4000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:15.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.904+0000 7f6c3ffff640 1 -- 172.21.15.27:0/3879906899 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c40017030 con 0x7f6c48106f10 2024-09-19T08:11:15.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.904+0000 7f6c3ffff640 1 -- 172.21.15.27:0/3879906899 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c40004020 con 0x7f6c48106f10 2024-09-19T08:11:15.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.904+0000 7f6c4d2b0640 1 -- 172.21.15.27:0/3879906899 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c4819d770 con 0x7f6c48106f10 2024-09-19T08:11:15.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.904+0000 7f6c3ffff640 1 -- 172.21.15.27:0/3879906899 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c40003c00 con 0x7f6c48106f10 2024-09-19T08:11:15.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.904+0000 7f6c4d2b0640 1 -- 172.21.15.27:0/3879906899 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c481a5050 con 0x7f6c48106f10 2024-09-19T08:11:15.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.907+0000 7f6c3ffff640 1 -- 172.21.15.27:0/3879906899 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f6c4001a070 con 0x7f6c48106f10 2024-09-19T08:11:15.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.907+0000 7f6c4f689740 1 Processor -- start 2024-09-19T08:11:15.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.907+0000 7f6c4f689740 1 -- start start 2024-09-19T08:11:15.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.907+0000 7f6c4f689740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5eafbfb40 0x55c5eafbe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:15.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.907+0000 7f6c4f689740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafbe5d0 0x55c5eafbea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:15.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.907+0000 7f6c4f689740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafc9370 0x55c5eafcb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:15.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.907+0000 7f6c4f689740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c5eaf242f0 con 0x55c5eafbe5d0 2024-09-19T08:11:15.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.907+0000 7f6c4f689740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c5eaecbcf0 con 0x55c5eafc9370 2024-09-19T08:11:15.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.907+0000 7f6c4f689740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c5eaf202b0 con 0x55c5eafbfb40 2024-09-19T08:11:15.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.907+0000 7f6c46ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafbe5d0 0x55c5eafbea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:15.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.907+0000 7f6c46ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafbe5d0 0x55c5eafbea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45242/0 (socket says 172.21.15.27:45242) 2024-09-19T08:11:15.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.907+0000 7f6c46ffd640 1 -- 172.21.15.27:0/3933074175 learned_addr learned my addr 172.21.15.27:0/3933074175 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:15.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.908+0000 7f6c467fc640 1 --2- 172.21.15.27:0/3933074175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5eafbfb40 0x55c5eafbe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:15.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.908+0000 7f6c46ffd640 1 -- 172.21.15.27:0/3933074175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5eafbfb40 msgr2=0x55c5eafbe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:15.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.908+0000 7f6c46ffd640 1 --2- 172.21.15.27:0/3933074175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5eafbfb40 0x55c5eafbe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.908+0000 7f6c467fc640 1 --2- 172.21.15.27:0/3933074175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafc9370 0x55c5eafcb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:15.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.908+0000 7f6c46ffd640 1 -- 172.21.15.27:0/3933074175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafc9370 msgr2=0x55c5eafcb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:15.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.908+0000 7f6c46ffd640 1 --2- 172.21.15.27:0/3933074175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafc9370 0x55c5eafcb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.908+0000 7f6c46ffd640 1 -- 172.21.15.27:0/3933074175 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5eaeb03a0 con 0x55c5eafbe5d0 2024-09-19T08:11:15.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.908+0000 7f6c3ffff640 1 --2- 172.21.15.27:0/3879906899 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6c340a3440 0x7f6c340a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:15.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.908+0000 7f6c467fc640 1 --2- 172.21.15.27:0/3933074175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafc9370 0x55c5eafcb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:11:15.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.908+0000 7f6c46ffd640 1 --2- 172.21.15.27:0/3933074175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafbe5d0 0x55c5eafbea10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6c380114f0 tx=0x7f6c380119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d41c9991f6282e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:15.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.908+0000 7f6c467fc640 1 --2- 172.21.15.27:0/3879906899 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6c340a3440 0x7f6c340a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:15.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.908+0000 7f6c3ffff640 1 -- 172.21.15.27:0/3879906899 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f6c400cf6c0 con 0x7f6c48106f10 2024-09-19T08:11:15.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.908+0000 7f6c3d7fa640 1 -- 172.21.15.27:0/3933074175 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3801e070 con 0x55c5eafbe5d0 2024-09-19T08:11:15.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.908+0000 7f6c3d7fa640 1 -- 172.21.15.27:0/3933074175 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c3800fb00 con 0x55c5eafbe5d0 2024-09-19T08:11:15.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.908+0000 7f6c3d7fa640 1 -- 172.21.15.27:0/3933074175 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38019bf0 con 0x55c5eafbe5d0 2024-09-19T08:11:15.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.909+0000 7f6c4f689740 1 -- 172.21.15.27:0/3933074175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafbe5d0 msgr2=0x55c5eafbea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:15.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.909+0000 7f6c4f689740 1 --2- 172.21.15.27:0/3933074175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafbe5d0 0x55c5eafbea10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6c380114f0 tx=0x7f6c380119b0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.909+0000 7f6c467fc640 1 --2- 172.21.15.27:0/3879906899 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6c340a3440 0x7f6c340a5900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6c480fdd90 tx=0x7f6c30009260 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:15.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.909+0000 7f6c4f689740 1 -- 172.21.15.27:0/3933074175 shutdown_connections 2024-09-19T08:11:15.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.909+0000 7f6c4f689740 1 --2- 172.21.15.27:0/3933074175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafc9370 0x55c5eafcb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.909+0000 7f6c4f689740 1 --2- 172.21.15.27:0/3933074175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafbe5d0 0x55c5eafbea10 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.909+0000 7f6c4f689740 1 --2- 172.21.15.27:0/3933074175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5eafbfb40 0x55c5eafbe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.909+0000 7f6c4f689740 1 -- 172.21.15.27:0/3933074175 >> 172.21.15.27:0/3933074175 conn(0x55c5eaf87310 msgr2=0x55c5eafbac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:15.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.909+0000 7f6c4f689740 1 -- 172.21.15.27:0/3933074175 shutdown_connections 2024-09-19T08:11:15.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.909+0000 7f6c4f689740 1 -- 172.21.15.27:0/3933074175 wait complete. 2024-09-19T08:11:15.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.909+0000 7f6c4f689740 1 -- start start 2024-09-19T08:11:15.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.910+0000 7f6c4f689740 1 Processor -- start 2024-09-19T08:11:15.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.910+0000 7f6c4f689740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5eafbe5d0 0x55c5eafc8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:15.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.910+0000 7f6c4f689740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafbfb40 0x55c5eafc5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:15.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.910+0000 7f6c4f689740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafc9370 0x55c5eafc65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:15.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.910+0000 7f6c4f689740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c5eafcc070 con 0x55c5eafc9370 2024-09-19T08:11:15.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.910+0000 7f6c4f689740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c5eaedf060 con 0x55c5eafbfb40 2024-09-19T08:11:15.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.910+0000 7f6c4f689740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c5eafcc1f0 con 0x55c5eafbe5d0 2024-09-19T08:11:15.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.910+0000 7f6c4f689740 10 client.0 _ll_register_callbacks cb 0x55c5eac328c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:15.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.910+0000 7f6c477fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafc9370 0x55c5eafc65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:15.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.910+0000 7f6c477fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafc9370 0x55c5eafc65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45254/0 (socket says 172.21.15.27:45254) 2024-09-19T08:11:15.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.910+0000 7f6c477fe640 1 -- 172.21.15.27:0/4141227655 learned_addr learned my addr 172.21.15.27:0/4141227655 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:15.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.910+0000 7f6c46ffd640 1 --2- 172.21.15.27:0/4141227655 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5eafbe5d0 0x55c5eafc8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:15.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.910+0000 7f6c467fc640 1 --2- 172.21.15.27:0/4141227655 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafbfb40 0x55c5eafc5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:15.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.910+0000 7f6c477fe640 1 -- 172.21.15.27:0/4141227655 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5eafbe5d0 msgr2=0x55c5eafc8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:15.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.910+0000 7f6c477fe640 1 --2- 172.21.15.27:0/4141227655 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5eafbe5d0 0x55c5eafc8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.910+0000 7f6c477fe640 1 -- 172.21.15.27:0/4141227655 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafbfb40 msgr2=0x55c5eafc5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:15.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.910+0000 7f6c477fe640 1 --2- 172.21.15.27:0/4141227655 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafbfb40 0x55c5eafc5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.910+0000 7f6c477fe640 1 -- 172.21.15.27:0/4141227655 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5eac953c0 con 0x55c5eafc9370 2024-09-19T08:11:15.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.911+0000 7f6c477fe640 1 --2- 172.21.15.27:0/4141227655 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafc9370 0x55c5eafc65e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009610 tx=0x7f6c4009b2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c394c2a7ab430c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:15.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.911+0000 7f6c2e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:15.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.911+0000 7f6c2e7fc640 1 -- 172.21.15.27:0/4141227655 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c400b4060 con 0x55c5eafc9370 2024-09-19T08:11:15.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.911+0000 7f6c2e7fc640 1 -- 172.21.15.27:0/4141227655 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f6c400041d0 con 0x55c5eafc9370 2024-09-19T08:11:15.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.911+0000 7f6c4f689740 1 -- 172.21.15.27:0/4141227655 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c3800fb00 con 0x55c5eafc9370 2024-09-19T08:11:15.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.911+0000 7f6c2e7fc640 1 -- 172.21.15.27:0/4141227655 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6c4009fc30 con 0x55c5eafc9370 2024-09-19T08:11:15.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.911+0000 7f6c4f689740 10 client.15309 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:15.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.911+0000 7f6c4f689740 1 -- 172.21.15.27:0/4141227655 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c5eafd7a50 con 0x55c5eafc9370 2024-09-19T08:11:15.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.911+0000 7f6c2e7fc640 1 -- 172.21.15.27:0/4141227655 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c3800fb00 con 0x55c5eafc9370 2024-09-19T08:11:15.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.911+0000 7f6c2e7fc640 1 -- 172.21.15.27:0/4141227655 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6c400cd050 con 0x55c5eafc9370 2024-09-19T08:11:15.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.911+0000 7f6c4f689740 10 client.15309 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:15.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.911+0000 7f6c4f689740 10 client.15309 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:15.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.911+0000 7f6c4f689740 20 client.15309 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:15.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.911+0000 7f6c4f689740 1 --2- 172.21.15.27:0/4141227655 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c5eafd8e60 0x55c5eafdb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:15.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.911+0000 7f6c4f689740 4 client.15309 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:11:15.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.911+0000 7f6c4f689740 1 -- 172.21.15.27:0/4141227655 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5eaf31860 con 0x55c5eafd8e60 2024-09-19T08:11:15.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.912+0000 7f6c46ffd640 1 --2- 172.21.15.27:0/4141227655 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c5eafd8e60 0x55c5eafdb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:15.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.912+0000 7f6c2e7fc640 10 client.15309 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:15.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.912+0000 7f6c46ffd640 1 --2- 172.21.15.27:0/4141227655 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c5eafd8e60 0x55c5eafdb2b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b096263560f72e4a server_cookie=fcf859ae35b20d90 in_seq=0 out_seq=0 2024-09-19T08:11:15.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.913+0000 7f6c2e7fc640 1 -- 172.21.15.27:0/4141227655 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c5eaf31860 con 0x55c5eafd8e60 2024-09-19T08:11:15.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.913+0000 7f6c2e7fc640 10 client.15309 handle_command_reply: tid=0 2024-09-19T08:11:15.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.913+0000 7f6c4f689740 1 client.15309 shutdown 2024-09-19T08:11:15.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.913+0000 7f6c4f689740 1 -- 172.21.15.27:0/4141227655 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafc9370 msgr2=0x55c5eafc65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:15.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.913+0000 7f6c4f689740 1 --2- 172.21.15.27:0/4141227655 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafc9370 0x55c5eafc65e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009610 tx=0x7f6c4009b2a0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.913+0000 7f6c4f689740 1 -- 172.21.15.27:0/4141227655 shutdown_connections 2024-09-19T08:11:15.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.913+0000 7f6c4f689740 1 --2- 172.21.15.27:0/4141227655 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafc9370 0x55c5eafc65e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.913+0000 7f6c4f689740 1 --2- 172.21.15.27:0/4141227655 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafbfb40 0x55c5eafc5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.913+0000 7f6c4f689740 1 --2- 172.21.15.27:0/4141227655 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c5eafd8e60 0x55c5eafdb2b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.913+0000 7f6c4f689740 1 --2- 172.21.15.27:0/4141227655 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5eafbe5d0 0x55c5eafc8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.913+0000 7f6c2e7fc640 0 client.15309 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:15.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.913+0000 7f6c4f689740 1 -- 172.21.15.27:0/4141227655 >> 172.21.15.27:0/4141227655 conn(0x55c5eaf87310 msgr2=0x55c5eafc0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:15.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.913+0000 7f6c4f689740 1 -- 172.21.15.27:0/4141227655 shutdown_connections 2024-09-19T08:11:15.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.913+0000 7f6c4f689740 1 -- 172.21.15.27:0/4141227655 wait complete. 2024-09-19T08:11:15.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.913+0000 7f6c4f689740 20 client.15309 trim_cache size 0 max 16384 2024-09-19T08:11:15.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.926+0000 7f6c4f689740 1 Processor -- start 2024-09-19T08:11:15.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.927+0000 7f6c4f689740 1 -- start start 2024-09-19T08:11:15.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.927+0000 7f6c4f689740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5eafbe5d0 0x55c5eafc58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:15.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.927+0000 7f6c4f689740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafbfb40 0x55c5eafc7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:15.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.927+0000 7f6c4f689740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafc9370 0x55c5eafc1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:15.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.927+0000 7f6c4f689740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6c481ab760 con 0x55c5eafc9370 2024-09-19T08:11:15.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.927+0000 7f6c4f689740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c481adfe0 con 0x55c5eafbfb40 2024-09-19T08:11:15.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.927+0000 7f6c4f689740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c481abdd0 con 0x55c5eafbe5d0 2024-09-19T08:11:15.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.927+0000 7f6c477fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafc9370 0x55c5eafc1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:15.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.927+0000 7f6c477fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafc9370 0x55c5eafc1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45260/0 (socket says 172.21.15.27:45260) 2024-09-19T08:11:15.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.927+0000 7f6c477fe640 1 -- 172.21.15.27:0/1061746684 learned_addr learned my addr 172.21.15.27:0/1061746684 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:15.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.927+0000 7f6c46ffd640 1 --2- 172.21.15.27:0/1061746684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5eafbe5d0 0x55c5eafc58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:15.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.928+0000 7f6c467fc640 1 --2- 172.21.15.27:0/1061746684 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafbfb40 0x55c5eafc7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:15.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.928+0000 7f6c477fe640 1 -- 172.21.15.27:0/1061746684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5eafbe5d0 msgr2=0x55c5eafc58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:15.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.928+0000 7f6c477fe640 1 --2- 172.21.15.27:0/1061746684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5eafbe5d0 0x55c5eafc58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.928+0000 7f6c477fe640 1 -- 172.21.15.27:0/1061746684 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafbfb40 msgr2=0x55c5eafc7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:15.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.928+0000 7f6c477fe640 1 --2- 172.21.15.27:0/1061746684 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafbfb40 0x55c5eafc7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.928+0000 7f6c477fe640 1 -- 172.21.15.27:0/1061746684 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5eafc4fa0 con 0x55c5eafc9370 2024-09-19T08:11:15.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.928+0000 7f6c467fc640 1 --2- 172.21.15.27:0/1061746684 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafbfb40 0x55c5eafc7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:15.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.928+0000 7f6c477fe640 1 --2- 172.21.15.27:0/1061746684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafc9370 0x55c5eafc1120 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6c40098250 tx=0x7f6c40086130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17e364aa4473869 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:15.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.928+0000 7f6c3cff9640 1 -- 172.21.15.27:0/1061746684 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c400b4070 con 0x55c5eafc9370 2024-09-19T08:11:15.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.928+0000 7f6c3cff9640 1 -- 172.21.15.27:0/1061746684 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c400a44f0 con 0x55c5eafc9370 2024-09-19T08:11:15.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.928+0000 7f6c3cff9640 1 -- 172.21.15.27:0/1061746684 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c40097040 con 0x55c5eafc9370 2024-09-19T08:11:15.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.929+0000 7f6c4f689740 1 -- 172.21.15.27:0/1061746684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafc9370 msgr2=0x55c5eafc1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:15.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.929+0000 7f6c4f689740 1 --2- 172.21.15.27:0/1061746684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafc9370 0x55c5eafc1120 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6c40098250 tx=0x7f6c40086130 comp rx=0 tx=0).stop 2024-09-19T08:11:15.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.929+0000 7f6c4f689740 1 -- 172.21.15.27:0/1061746684 shutdown_connections 2024-09-19T08:11:15.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.929+0000 7f6c4f689740 1 --2- 172.21.15.27:0/1061746684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafc9370 0x55c5eafc1120 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.929+0000 7f6c4f689740 1 --2- 172.21.15.27:0/1061746684 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafbfb40 0x55c5eafc7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.929+0000 7f6c4f689740 1 --2- 172.21.15.27:0/1061746684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5eafbe5d0 0x55c5eafc58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.929+0000 7f6c4f689740 1 -- 172.21.15.27:0/1061746684 >> 172.21.15.27:0/1061746684 conn(0x55c5eaf87310 msgr2=0x55c5eafc7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:15.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.929+0000 7f6c4f689740 1 -- 172.21.15.27:0/1061746684 shutdown_connections 2024-09-19T08:11:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.929+0000 7f6c4f689740 1 -- 172.21.15.27:0/1061746684 wait complete. 2024-09-19T08:11:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.929+0000 7f6c4f689740 1 -- start start 2024-09-19T08:11:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.930+0000 7f6c4f689740 1 Processor -- start 2024-09-19T08:11:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.930+0000 7f6c4f689740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafbe5d0 0x55c5eb03f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.930+0000 7f6c4f689740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafbfb40 0x55c5eafd1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.930+0000 7f6c4f689740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5eafc9370 0x55c5eafd19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.930+0000 7f6c4f689740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6c481ac4a0 con 0x55c5eafbfb40 2024-09-19T08:11:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.930+0000 7f6c4f689740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c481ad910 con 0x55c5eafbe5d0 2024-09-19T08:11:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.930+0000 7f6c4f689740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c481acb70 con 0x55c5eafc9370 2024-09-19T08:11:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.930+0000 7f6c4f689740 10 client.0 _ll_register_callbacks cb 0x7f6c400ccc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.930+0000 7f6c467fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafbfb40 0x55c5eafd1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.930+0000 7f6c467fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafbfb40 0x55c5eafd1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45268/0 (socket says 172.21.15.27:45268) 2024-09-19T08:11:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.930+0000 7f6c467fc640 1 -- 172.21.15.27:0/4266002389 learned_addr learned my addr 172.21.15.27:0/4266002389 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.930+0000 7f6c46ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafbe5d0 0x55c5eb03f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.930+0000 7f6c477fe640 1 --2- 172.21.15.27:0/4266002389 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5eafc9370 0x55c5eafd19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.930+0000 7f6c467fc640 1 -- 172.21.15.27:0/4266002389 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5eafc9370 msgr2=0x55c5eafd19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.930+0000 7f6c467fc640 1 --2- 172.21.15.27:0/4266002389 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5eafc9370 0x55c5eafd19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.930+0000 7f6c467fc640 1 -- 172.21.15.27:0/4266002389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafbe5d0 msgr2=0x55c5eb03f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.930+0000 7f6c467fc640 1 --2- 172.21.15.27:0/4266002389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafbe5d0 0x55c5eb03f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.930+0000 7f6c467fc640 1 -- 172.21.15.27:0/4266002389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5eafc90b0 con 0x55c5eafbfb40 2024-09-19T08:11:15.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.931+0000 7f6c467fc640 1 --2- 172.21.15.27:0/4266002389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafbfb40 0x55c5eafd1480 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009900 tx=0x7f6c3002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176e423531c0dda7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:15.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.931+0000 7f6c2e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:15.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.931+0000 7f6c2e7fc640 1 -- 172.21.15.27:0/4266002389 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30035040 con 0x55c5eafbfb40 2024-09-19T08:11:15.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.931+0000 7f6c2e7fc640 1 -- 172.21.15.27:0/4266002389 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f6c30005240 con 0x55c5eafbfb40 2024-09-19T08:11:15.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.931+0000 7f6c4f689740 1 -- 172.21.15.27:0/4266002389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c400a44f0 con 0x55c5eafbfb40 2024-09-19T08:11:15.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.931+0000 7f6c2e7fc640 1 -- 172.21.15.27:0/4266002389 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6c30005440 con 0x55c5eafbfb40 2024-09-19T08:11:15.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.931+0000 7f6c4f689740 10 client.15315 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:15.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.931+0000 7f6c4f689740 1 -- 172.21.15.27:0/4266002389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c5eb04c750 con 0x55c5eafbfb40 2024-09-19T08:11:15.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.931+0000 7f6c2e7fc640 1 -- 172.21.15.27:0/4266002389 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c400a44f0 con 0x55c5eafbfb40 2024-09-19T08:11:15.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.931+0000 7f6c2e7fc640 1 -- 172.21.15.27:0/4266002389 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6c3003a040 con 0x55c5eafbfb40 2024-09-19T08:11:15.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.932+0000 7f6c4f689740 10 client.15315 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:15.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.932+0000 7f6c4f689740 10 client.15315 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:15.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.932+0000 7f6c4f689740 20 client.15315 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:15.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.932+0000 7f6c4f689740 1 --2- 172.21.15.27:0/4266002389 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c5eb04cdc0 0x55c5eb04f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:15.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.932+0000 7f6c4f689740 4 client.15315 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:11:15.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.932+0000 7f6c4f689740 1 -- 172.21.15.27:0/4266002389 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c5eaf2bd70 con 0x55c5eb04cdc0 2024-09-19T08:11:15.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.932+0000 7f6c46ffd640 1 --2- 172.21.15.27:0/4266002389 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c5eb04cdc0 0x55c5eb04f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:15.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.932+0000 7f6c2e7fc640 10 client.15315 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:15.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.932+0000 7f6c46ffd640 1 --2- 172.21.15.27:0/4266002389 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c5eb04cdc0 0x55c5eb04f1e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e027d1652bc029f server_cookie=299a3d85f41208b5 in_seq=0 out_seq=0 2024-09-19T08:11:15.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.932+0000 7f6c2e7fc640 1 -- 172.21.15.27:0/4266002389 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c5eaf2bd70 con 0x55c5eb04cdc0 2024-09-19T08:11:15.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.932+0000 7f6c2e7fc640 10 client.15315 handle_command_reply: tid=0 2024-09-19T08:11:15.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.932+0000 7f6c4f689740 1 client.15315 shutdown 2024-09-19T08:11:15.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.933+0000 7f6c4f689740 1 -- 172.21.15.27:0/4266002389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafbfb40 msgr2=0x55c5eafd1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:15.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.933+0000 7f6c4f689740 1 --2- 172.21.15.27:0/4266002389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafbfb40 0x55c5eafd1480 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009900 tx=0x7f6c3002a410 comp rx=0 tx=0).stop 2024-09-19T08:11:15.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.933+0000 7f6c4f689740 1 -- 172.21.15.27:0/4266002389 shutdown_connections 2024-09-19T08:11:15.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.933+0000 7f6c4f689740 1 --2- 172.21.15.27:0/4266002389 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c5eb04cdc0 0x55c5eb04f1e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.933+0000 7f6c4f689740 1 --2- 172.21.15.27:0/4266002389 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5eafc9370 0x55c5eafd19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.933+0000 7f6c4f689740 1 --2- 172.21.15.27:0/4266002389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c5eafbfb40 0x55c5eafd1480 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.933+0000 7f6c4f689740 1 --2- 172.21.15.27:0/4266002389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5eafbe5d0 0x55c5eb03f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.933+0000 7f6c4f689740 1 -- 172.21.15.27:0/4266002389 >> 172.21.15.27:0/4266002389 conn(0x55c5eaf87310 msgr2=0x55c5eafc8070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:15.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.933+0000 7f6c2e7fc640 0 client.15315 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:15.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.933+0000 7f6c4f689740 1 -- 172.21.15.27:0/4266002389 shutdown_connections 2024-09-19T08:11:15.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.933+0000 7f6c4f689740 1 -- 172.21.15.27:0/4266002389 wait complete. 2024-09-19T08:11:15.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.933+0000 7f6c4f689740 20 client.15315 trim_cache size 0 max 16384 2024-09-19T08:11:15.951 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:11:15.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.933+0000 7f6c4d2b0640 1 -- 172.21.15.27:0/3879906899 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6c340a3440 msgr2=0x7f6c340a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:15.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.933+0000 7f6c4d2b0640 1 --2- 172.21.15.27:0/3879906899 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6c340a3440 0x7f6c340a5900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6c480fdd90 tx=0x7f6c30009260 comp rx=0 tx=0).stop 2024-09-19T08:11:15.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.933+0000 7f6c4d2b0640 1 -- 172.21.15.27:0/3879906899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c48106f10 msgr2=0x7f6c4819cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:15.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.933+0000 7f6c4d2b0640 1 --2- 172.21.15.27:0/3879906899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c48106f10 0x7f6c4819cda0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000d950 tx=0x7f6c4000de10 comp rx=0 tx=0).stop 2024-09-19T08:11:15.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.934+0000 7f6c4d2b0640 1 -- 172.21.15.27:0/3879906899 shutdown_connections 2024-09-19T08:11:15.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.934+0000 7f6c4d2b0640 1 --2- 172.21.15.27:0/3879906899 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6c340a3440 0x7f6c340a5900 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.934+0000 7f6c4d2b0640 1 --2- 172.21.15.27:0/3879906899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c48106f10 0x7f6c4819cda0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.934+0000 7f6c4d2b0640 1 --2- 172.21.15.27:0/3879906899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c48102790 0x7f6c48198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.934+0000 7f6c4d2b0640 1 --2- 172.21.15.27:0/3879906899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c48101de0 0x7f6c481984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:15.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.934+0000 7f6c4d2b0640 1 -- 172.21.15.27:0/3879906899 >> 172.21.15.27:0/3879906899 conn(0x7f6c480fd8e0 msgr2=0x7f6c480fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:15.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.934+0000 7f6c4d2b0640 1 -- 172.21.15.27:0/3879906899 shutdown_connections 2024-09-19T08:11:15.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:15.934+0000 7f6c4d2b0640 1 -- 172.21.15.27:0/3879906899 wait complete. 2024-09-19T08:11:16.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:15 smithi155 ceph-mon[35362]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:11:16.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:15 smithi203 ceph-mon[35198]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:11:16.658 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:17.199 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:16 smithi027 ceph-mon[31209]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 43 op/s 2024-09-19T08:11:17.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.198+0000 7f91aac78640 1 -- 172.21.15.27:0/3877646911 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91a410c2f0 msgr2=0x7f91a410e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:17.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.198+0000 7f91aac78640 1 --2- 172.21.15.27:0/3877646911 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91a410c2f0 0x7f91a410e790 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f919c009ca0 tx=0x7f919c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:11:17.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.198+0000 7f91aac78640 1 -- 172.21.15.27:0/3877646911 shutdown_connections 2024-09-19T08:11:17.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.198+0000 7f91aac78640 1 --2- 172.21.15.27:0/3877646911 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91a410c2f0 0x7f91a410e790 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:17.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.198+0000 7f91aac78640 1 --2- 172.21.15.27:0/3877646911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91a41037a0 0x7f91a410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:17.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.198+0000 7f91aac78640 1 --2- 172.21.15.27:0/3877646911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91a4102df0 0x7f91a41031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:17.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.198+0000 7f91aac78640 1 -- 172.21.15.27:0/3877646911 >> 172.21.15.27:0/3877646911 conn(0x7f91a40fc7d0 msgr2=0x7f91a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:17.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.198+0000 7f91aac78640 1 -- 172.21.15.27:0/3877646911 shutdown_connections 2024-09-19T08:11:17.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.198+0000 7f91aac78640 1 -- 172.21.15.27:0/3877646911 wait complete. 2024-09-19T08:11:17.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.199+0000 7f91aac78640 1 Processor -- start 2024-09-19T08:11:17.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.199+0000 7f91aac78640 1 -- start start 2024-09-19T08:11:17.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.199+0000 7f91aac78640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91a4102df0 0x7f91a41a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:17.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.199+0000 7f91aac78640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91a41037a0 0x7f91a41a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:17.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.199+0000 7f91aac78640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91a410c2f0 0x7f91a419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:17.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.199+0000 7f91aac78640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f91a4112110 con 0x7f91a4102df0 2024-09-19T08:11:17.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.199+0000 7f91aac78640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f91a4111f90 con 0x7f91a410c2f0 2024-09-19T08:11:17.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.199+0000 7f91aac78640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f91a4112290 con 0x7f91a41037a0 2024-09-19T08:11:17.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.200+0000 7f91a8a14640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91a4102df0 0x7f91a41a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:17.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.200+0000 7f91a8a14640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91a4102df0 0x7f91a41a0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45290/0 (socket says 172.21.15.27:45290) 2024-09-19T08:11:17.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.200+0000 7f91a8a14640 1 -- 172.21.15.27:0/596816567 learned_addr learned my addr 172.21.15.27:0/596816567 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:17.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.200+0000 7f91a3fff640 1 --2- 172.21.15.27:0/596816567 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91a41037a0 0x7f91a41a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:17.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.200+0000 7f91a9215640 1 --2- 172.21.15.27:0/596816567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91a410c2f0 0x7f91a419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:17.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.200+0000 7f91a8a14640 1 -- 172.21.15.27:0/596816567 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91a41037a0 msgr2=0x7f91a41a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:17.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.200+0000 7f91a8a14640 1 --2- 172.21.15.27:0/596816567 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91a41037a0 0x7f91a41a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:17.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.200+0000 7f91a8a14640 1 -- 172.21.15.27:0/596816567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91a410c2f0 msgr2=0x7f91a419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:17.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.200+0000 7f91a8a14640 1 --2- 172.21.15.27:0/596816567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91a410c2f0 0x7f91a419a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:17.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.200+0000 7f91a8a14640 1 -- 172.21.15.27:0/596816567 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a419ad40 con 0x7f91a4102df0 2024-09-19T08:11:17.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.200+0000 7f91a8a14640 1 --2- 172.21.15.27:0/596816567 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91a4102df0 0x7f91a41a0450 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f919800e9f0 tx=0x7f919800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:17.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.200+0000 7f91a1ffb640 1 -- 172.21.15.27:0/596816567 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919800cd80 con 0x7f91a4102df0 2024-09-19T08:11:17.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.201+0000 7f91aac78640 1 -- 172.21.15.27:0/596816567 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a419b030 con 0x7f91a4102df0 2024-09-19T08:11:17.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.201+0000 7f91a1ffb640 1 -- 172.21.15.27:0/596816567 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9198010910 con 0x7f91a4102df0 2024-09-19T08:11:17.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.201+0000 7f91a1ffb640 1 -- 172.21.15.27:0/596816567 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91980188f0 con 0x7f91a4102df0 2024-09-19T08:11:17.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.201+0000 7f91aac78640 1 -- 172.21.15.27:0/596816567 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a41a7320 con 0x7f91a4102df0 2024-09-19T08:11:17.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.202+0000 7f91aac78640 1 -- 172.21.15.27:0/596816567 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91a41031d0 con 0x7f91a4102df0 2024-09-19T08:11:17.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.203+0000 7f91a1ffb640 1 -- 172.21.15.27:0/596816567 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f9198010ac0 con 0x7f91a4102df0 2024-09-19T08:11:17.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.204+0000 7f91a1ffb640 1 --2- 172.21.15.27:0/596816567 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f91940a3440 0x7f91940a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:17.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.204+0000 7f91a1ffb640 1 -- 172.21.15.27:0/596816567 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f91980d0230 con 0x7f91a4102df0 2024-09-19T08:11:17.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.204+0000 7f91a3fff640 1 --2- 172.21.15.27:0/596816567 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f91940a3440 0x7f91940a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:17.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.204+0000 7f91a3fff640 1 --2- 172.21.15.27:0/596816567 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f91940a3440 0x7f91940a5900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f91a410ec70 tx=0x7f919000b390 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:17.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.212+0000 7f91a1ffb640 1 -- 172.21.15.27:0/596816567 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f919809c4a0 con 0x7f91a4102df0 2024-09-19T08:11:17.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:16 smithi155 ceph-mon[35362]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 43 op/s 2024-09-19T08:11:17.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:16 smithi203 ceph-mon[35198]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 43 op/s 2024-09-19T08:11:17.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.389+0000 7f91aac78640 1 -- 172.21.15.27:0/596816567 --> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f91a41021b0 con 0x7f91940a3440 2024-09-19T08:11:17.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.395+0000 7f91a1ffb640 1 -- 172.21.15.27:0/596816567 <== mgr.15093 v2:172.21.15.27:6800/1578338135 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257941 (secure 0 0 0) 0x7f91a41021b0 con 0x7f91940a3440 2024-09-19T08:11:17.398 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:11:17.399 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-09-19T08:11:17.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.399+0000 7f91aac78640 1 -- 172.21.15.27:0/596816567 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f91940a3440 msgr2=0x7f91940a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:17.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.399+0000 7f91aac78640 1 --2- 172.21.15.27:0/596816567 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f91940a3440 0x7f91940a5900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f91a410ec70 tx=0x7f919000b390 comp rx=0 tx=0).stop 2024-09-19T08:11:17.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.399+0000 7f91aac78640 1 -- 172.21.15.27:0/596816567 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91a4102df0 msgr2=0x7f91a41a0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:17.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.399+0000 7f91aac78640 1 --2- 172.21.15.27:0/596816567 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91a4102df0 0x7f91a41a0450 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f919800e9f0 tx=0x7f919800eeb0 comp rx=0 tx=0).stop 2024-09-19T08:11:17.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.399+0000 7f91aac78640 1 -- 172.21.15.27:0/596816567 shutdown_connections 2024-09-19T08:11:17.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.399+0000 7f91aac78640 1 --2- 172.21.15.27:0/596816567 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f91940a3440 0x7f91940a5900 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:17.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.399+0000 7f91aac78640 1 --2- 172.21.15.27:0/596816567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91a410c2f0 0x7f91a419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:17.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.399+0000 7f91aac78640 1 --2- 172.21.15.27:0/596816567 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91a41037a0 0x7f91a41a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:17.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.399+0000 7f91aac78640 1 --2- 172.21.15.27:0/596816567 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91a4102df0 0x7f91a41a0450 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:17.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.399+0000 7f91aac78640 1 -- 172.21.15.27:0/596816567 >> 172.21.15.27:0/596816567 conn(0x7f91a40fc7d0 msgr2=0x7f91a410d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:17.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.399+0000 7f91aac78640 1 -- 172.21.15.27:0/596816567 shutdown_connections 2024-09-19T08:11:17.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:17.399+0000 7f91aac78640 1 -- 172.21.15.27:0/596816567 wait complete. 2024-09-19T08:11:17.629 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:11:17.629 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:11:18.126 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-19T08:11:17.339025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1382383,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":827,"num_read_kb":833,"num_write":532,"num_write_kb":5261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":879,"ondisk_log_size":879,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356408,"kb_used_data":11268,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585416,"statfs":{"total":1151940427776,"available":1151575465984,"internally_reserved":0,"allocated":11538432,"data_stored":9486369,"data_compressed":245412,"data_compressed_allocated":319488,"data_compressed_original":3969024,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":377,"num_read_kb":454,"num_write":146,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002590"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244732+0000","last_change":"2024-09-19T08:09:11.246436+0000","last_active":"2024-09-19T08:11:02.244732+0000","last_peered":"2024-09-19T08:11:02.244732+0000","last_clean":"2024-09-19T08:11:02.244732+0000","last_became_active":"2024-09-19T08:09:11.245674+0000","last_became_peered":"2024-09-19T08:09:11.245674+0000","last_unstale":"2024-09-19T08:11:02.244732+0000","last_undegraded":"2024-09-19T08:11:02.244732+0000","last_fullsized":"2024-09-19T08:11:02.244732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:46.716474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898632+0000","last_change":"2024-09-19T08:09:11.243334+0000","last_active":"2024-09-19T08:11:01.898632+0000","last_peered":"2024-09-19T08:11:01.898632+0000","last_clean":"2024-09-19T08:11:01.898632+0000","last_became_active":"2024-09-19T08:09:11.243024+0000","last_became_peered":"2024-09-19T08:09:11.243024+0000","last_unstale":"2024-09-19T08:11:01.898632+0000","last_undegraded":"2024-09-19T08:11:01.898632+0000","last_fullsized":"2024-09-19T08:11:01.898632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.060068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898635+0000","last_change":"2024-09-19T08:09:11.254655+0000","last_active":"2024-09-19T08:11:01.898635+0000","last_peered":"2024-09-19T08:11:01.898635+0000","last_clean":"2024-09-19T08:11:01.898635+0000","last_became_active":"2024-09-19T08:09:11.254292+0000","last_became_peered":"2024-09-19T08:09:11.254292+0000","last_unstale":"2024-09-19T08:11:01.898635+0000","last_undegraded":"2024-09-19T08:11:01.898635+0000","last_fullsized":"2024-09-19T08:11:01.898635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:01.977743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899014+0000","last_change":"2024-09-19T08:09:11.257029+0000","last_active":"2024-09-19T08:11:01.899014+0000","last_peered":"2024-09-19T08:11:01.899014+0000","last_clean":"2024-09-19T08:11:01.899014+0000","last_became_active":"2024-09-19T08:09:11.256669+0000","last_became_peered":"2024-09-19T08:09:11.256669+0000","last_unstale":"2024-09-19T08:11:01.899014+0000","last_undegraded":"2024-09-19T08:11:01.899014+0000","last_fullsized":"2024-09-19T08:11:01.899014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:32.831036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413590+0000","last_change":"2024-09-19T08:09:11.240341+0000","last_active":"2024-09-19T08:11:01.413590+0000","last_peered":"2024-09-19T08:11:01.413590+0000","last_clean":"2024-09-19T08:11:01.413590+0000","last_became_active":"2024-09-19T08:09:11.239996+0000","last_became_peered":"2024-09-19T08:09:11.239996+0000","last_unstale":"2024-09-19T08:11:01.413590+0000","last_undegraded":"2024-09-19T08:11:01.413590+0000","last_fullsized":"2024-09-19T08:11:01.413590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:20.331791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325570+0000","last_change":"2024-09-19T08:09:11.248089+0000","last_active":"2024-09-19T08:11:01.325570+0000","last_peered":"2024-09-19T08:11:01.325570+0000","last_clean":"2024-09-19T08:11:01.325570+0000","last_became_active":"2024-09-19T08:09:11.247802+0000","last_became_peered":"2024-09-19T08:09:11.247802+0000","last_unstale":"2024-09-19T08:11:01.325570+0000","last_undegraded":"2024-09-19T08:11:01.325570+0000","last_fullsized":"2024-09-19T08:11:01.325570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.249119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898629+0000","last_change":"2024-09-19T08:09:11.246853+0000","last_active":"2024-09-19T08:11:01.898629+0000","last_peered":"2024-09-19T08:11:01.898629+0000","last_clean":"2024-09-19T08:11:01.898629+0000","last_became_active":"2024-09-19T08:09:11.246523+0000","last_became_peered":"2024-09-19T08:09:11.246523+0000","last_unstale":"2024-09-19T08:11:01.898629+0000","last_undegraded":"2024-09-19T08:11:01.898629+0000","last_fullsized":"2024-09-19T08:11:01.898629+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:54.879087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413783+0000","last_change":"2024-09-19T08:09:11.232588+0000","last_active":"2024-09-19T08:11:01.413783+0000","last_peered":"2024-09-19T08:11:01.413783+0000","last_clean":"2024-09-19T08:11:01.413783+0000","last_became_active":"2024-09-19T08:09:11.232251+0000","last_became_peered":"2024-09-19T08:09:11.232251+0000","last_unstale":"2024-09-19T08:11:01.413783+0000","last_undegraded":"2024-09-19T08:11:01.413783+0000","last_fullsized":"2024-09-19T08:11:01.413783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:57.622086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619576+0000","last_change":"2024-09-19T08:09:11.248854+0000","last_active":"2024-09-19T08:11:01.619576+0000","last_peered":"2024-09-19T08:11:01.619576+0000","last_clean":"2024-09-19T08:11:01.619576+0000","last_became_active":"2024-09-19T08:09:11.248524+0000","last_became_peered":"2024-09-19T08:09:11.248524+0000","last_unstale":"2024-09-19T08:11:01.619576+0000","last_undegraded":"2024-09-19T08:11:01.619576+0000","last_fullsized":"2024-09-19T08:11:01.619576+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:57.978974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325967+0000","last_change":"2024-09-19T08:10:14.786848+0000","last_active":"2024-09-19T08:11:01.325967+0000","last_peered":"2024-09-19T08:11:01.325967+0000","last_clean":"2024-09-19T08:11:01.325967+0000","last_became_active":"2024-09-19T08:10:14.786460+0000","last_became_peered":"2024-09-19T08:10:14.786460+0000","last_unstale":"2024-09-19T08:11:01.325967+0000","last_undegraded":"2024-09-19T08:11:01.325967+0000","last_fullsized":"2024-09-19T08:11:01.325967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:59.430185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899200+0000","last_change":"2024-09-19T08:09:11.247604+0000","last_active":"2024-09-19T08:11:01.899200+0000","last_peered":"2024-09-19T08:11:01.899200+0000","last_clean":"2024-09-19T08:11:01.899200+0000","last_became_active":"2024-09-19T08:09:11.247264+0000","last_became_peered":"2024-09-19T08:09:11.247264+0000","last_unstale":"2024-09-19T08:11:01.899200+0000","last_undegraded":"2024-09-19T08:11:01.899200+0000","last_fullsized":"2024-09-19T08:11:01.899200+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:15.315022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899033+0000","last_change":"2024-09-19T08:09:11.253948+0000","last_active":"2024-09-19T08:11:01.899033+0000","last_peered":"2024-09-19T08:11:01.899033+0000","last_clean":"2024-09-19T08:11:01.899033+0000","last_became_active":"2024-09-19T08:09:11.253402+0000","last_became_peered":"2024-09-19T08:09:11.253402+0000","last_unstale":"2024-09-19T08:11:01.899033+0000","last_undegraded":"2024-09-19T08:11:01.899033+0000","last_fullsized":"2024-09-19T08:11:01.899033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:04.884541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324201+0000","last_change":"2024-09-19T08:09:11.241770+0000","last_active":"2024-09-19T08:11:01.324201+0000","last_peered":"2024-09-19T08:11:01.324201+0000","last_clean":"2024-09-19T08:11:01.324201+0000","last_became_active":"2024-09-19T08:09:11.241356+0000","last_became_peered":"2024-09-19T08:09:11.241356+0000","last_unstale":"2024-09-19T08:11:01.324201+0000","last_undegraded":"2024-09-19T08:11:01.324201+0000","last_fullsized":"2024-09-19T08:11:01.324201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:02.722445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898444+0000","last_change":"2024-09-19T08:09:11.242874+0000","last_active":"2024-09-19T08:11:01.898444+0000","last_peered":"2024-09-19T08:11:01.898444+0000","last_clean":"2024-09-19T08:11:01.898444+0000","last_became_active":"2024-09-19T08:09:11.242383+0000","last_became_peered":"2024-09-19T08:09:11.242383+0000","last_unstale":"2024-09-19T08:11:01.898444+0000","last_undegraded":"2024-09-19T08:11:01.898444+0000","last_fullsized":"2024-09-19T08:11:01.898444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:51.900211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898325+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:11:01.898325+0000","last_peered":"2024-09-19T08:11:01.898325+0000","last_clean":"2024-09-19T08:11:01.898325+0000","last_became_active":"2024-09-19T08:09:11.250797+0000","last_became_peered":"2024-09-19T08:09:11.250797+0000","last_unstale":"2024-09-19T08:11:01.898325+0000","last_undegraded":"2024-09-19T08:11:01.898325+0000","last_fullsized":"2024-09-19T08:11:01.898325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:46.183857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619237+0000","last_change":"2024-09-19T08:09:11.250884+0000","last_active":"2024-09-19T08:11:01.619237+0000","last_peered":"2024-09-19T08:11:01.619237+0000","last_clean":"2024-09-19T08:11:01.619237+0000","last_became_active":"2024-09-19T08:09:11.250543+0000","last_became_peered":"2024-09-19T08:09:11.250543+0000","last_unstale":"2024-09-19T08:11:01.619237+0000","last_undegraded":"2024-09-19T08:11:01.619237+0000","last_fullsized":"2024-09-19T08:11:01.619237+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.259466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244747+0000","last_change":"2024-09-19T08:09:11.246705+0000","last_active":"2024-09-19T08:11:02.244747+0000","last_peered":"2024-09-19T08:11:02.244747+0000","last_clean":"2024-09-19T08:11:02.244747+0000","last_became_active":"2024-09-19T08:09:11.246117+0000","last_became_peered":"2024-09-19T08:09:11.246117+0000","last_unstale":"2024-09-19T08:11:02.244747+0000","last_undegraded":"2024-09-19T08:11:02.244747+0000","last_fullsized":"2024-09-19T08:11:02.244747+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:07.421222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.411014+0000","last_change":"2024-09-19T08:09:11.242181+0000","last_active":"2024-09-19T08:11:01.411014+0000","last_peered":"2024-09-19T08:11:01.411014+0000","last_clean":"2024-09-19T08:11:01.411014+0000","last_became_active":"2024-09-19T08:09:11.241882+0000","last_became_peered":"2024-09-19T08:09:11.241882+0000","last_unstale":"2024-09-19T08:11:01.411014+0000","last_undegraded":"2024-09-19T08:11:01.411014+0000","last_fullsized":"2024-09-19T08:11:01.411014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:35.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619497+0000","last_change":"2024-09-19T08:09:11.246038+0000","last_active":"2024-09-19T08:11:01.619497+0000","last_peered":"2024-09-19T08:11:01.619497+0000","last_clean":"2024-09-19T08:11:01.619497+0000","last_became_active":"2024-09-19T08:09:11.245554+0000","last_became_peered":"2024-09-19T08:09:11.245554+0000","last_unstale":"2024-09-19T08:11:01.619497+0000","last_undegraded":"2024-09-19T08:11:01.619497+0000","last_fullsized":"2024-09-19T08:11:01.619497+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:14.512425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244438+0000","last_change":"2024-09-19T08:09:11.249246+0000","last_active":"2024-09-19T08:11:02.244438+0000","last_peered":"2024-09-19T08:11:02.244438+0000","last_clean":"2024-09-19T08:11:02.244438+0000","last_became_active":"2024-09-19T08:09:11.248896+0000","last_became_peered":"2024-09-19T08:09:11.248896+0000","last_unstale":"2024-09-19T08:11:02.244438+0000","last_undegraded":"2024-09-19T08:11:02.244438+0000","last_fullsized":"2024-09-19T08:11:02.244438+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:40.406924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324207+0000","last_change":"2024-09-19T08:09:11.245421+0000","last_active":"2024-09-19T08:11:01.324207+0000","last_peered":"2024-09-19T08:11:01.324207+0000","last_clean":"2024-09-19T08:11:01.324207+0000","last_became_active":"2024-09-19T08:09:11.245071+0000","last_became_peered":"2024-09-19T08:09:11.245071+0000","last_unstale":"2024-09-19T08:11:01.324207+0000","last_undegraded":"2024-09-19T08:11:01.324207+0000","last_fullsized":"2024-09-19T08:11:01.324207+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:58.594399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619396+0000","last_change":"2024-09-19T08:09:11.246097+0000","last_active":"2024-09-19T08:11:01.619396+0000","last_peered":"2024-09-19T08:11:01.619396+0000","last_clean":"2024-09-19T08:11:01.619396+0000","last_became_active":"2024-09-19T08:09:11.245741+0000","last_became_peered":"2024-09-19T08:09:11.245741+0000","last_unstale":"2024-09-19T08:11:01.619396+0000","last_undegraded":"2024-09-19T08:11:01.619396+0000","last_fullsized":"2024-09-19T08:11:01.619396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:05.731148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414178+0000","last_change":"2024-09-19T08:09:11.251485+0000","last_active":"2024-09-19T08:11:01.414178+0000","last_peered":"2024-09-19T08:11:01.414178+0000","last_clean":"2024-09-19T08:11:01.414178+0000","last_became_active":"2024-09-19T08:09:11.251151+0000","last_became_peered":"2024-09-19T08:09:11.251151+0000","last_unstale":"2024-09-19T08:11:01.414178+0000","last_undegraded":"2024-09-19T08:11:01.414178+0000","last_fullsized":"2024-09-19T08:11:01.414178+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:47.231056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327085+0000","last_change":"2024-09-19T08:09:11.234490+0000","last_active":"2024-09-19T08:11:01.327085+0000","last_peered":"2024-09-19T08:11:01.327085+0000","last_clean":"2024-09-19T08:11:01.327085+0000","last_became_active":"2024-09-19T08:09:11.234163+0000","last_became_peered":"2024-09-19T08:09:11.234163+0000","last_unstale":"2024-09-19T08:11:01.327085+0000","last_undegraded":"2024-09-19T08:11:01.327085+0000","last_fullsized":"2024-09-19T08:11:01.327085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.610165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.415513+0000","last_change":"2024-09-19T08:09:11.247189+0000","last_active":"2024-09-19T08:11:01.415513+0000","last_peered":"2024-09-19T08:11:01.415513+0000","last_clean":"2024-09-19T08:11:01.415513+0000","last_became_active":"2024-09-19T08:09:11.246844+0000","last_became_peered":"2024-09-19T08:09:11.246844+0000","last_unstale":"2024-09-19T08:11:01.415513+0000","last_undegraded":"2024-09-19T08:11:01.415513+0000","last_fullsized":"2024-09-19T08:11:01.415513+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:50.764694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619668+0000","last_change":"2024-09-19T08:09:11.251655+0000","last_active":"2024-09-19T08:11:01.619668+0000","last_peered":"2024-09-19T08:11:01.619668+0000","last_clean":"2024-09-19T08:11:01.619668+0000","last_became_active":"2024-09-19T08:09:11.250930+0000","last_became_peered":"2024-09-19T08:09:11.250930+0000","last_unstale":"2024-09-19T08:11:01.619668+0000","last_undegraded":"2024-09-19T08:11:01.619668+0000","last_fullsized":"2024-09-19T08:11:01.619668+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:17.658277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244670+0000","last_change":"2024-09-19T08:09:11.248095+0000","last_active":"2024-09-19T08:11:02.244670+0000","last_peered":"2024-09-19T08:11:02.244670+0000","last_clean":"2024-09-19T08:11:02.244670+0000","last_became_active":"2024-09-19T08:09:11.247719+0000","last_became_peered":"2024-09-19T08:09:11.247719+0000","last_unstale":"2024-09-19T08:11:02.244670+0000","last_undegraded":"2024-09-19T08:11:02.244670+0000","last_fullsized":"2024-09-19T08:11:02.244670+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:26.701140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324250+0000","last_change":"2024-09-19T08:09:11.243232+0000","last_active":"2024-09-19T08:11:01.324250+0000","last_peered":"2024-09-19T08:11:01.324250+0000","last_clean":"2024-09-19T08:11:01.324250+0000","last_became_active":"2024-09-19T08:09:11.242927+0000","last_became_peered":"2024-09-19T08:09:11.242927+0000","last_unstale":"2024-09-19T08:11:01.324250+0000","last_undegraded":"2024-09-19T08:11:01.324250+0000","last_fullsized":"2024-09-19T08:11:01.324250+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:19.877520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898534+0000","last_change":"2024-09-19T08:09:11.249588+0000","last_active":"2024-09-19T08:11:01.898534+0000","last_peered":"2024-09-19T08:11:01.898534+0000","last_clean":"2024-09-19T08:11:01.898534+0000","last_became_active":"2024-09-19T08:09:11.249266+0000","last_became_peered":"2024-09-19T08:09:11.249266+0000","last_unstale":"2024-09-19T08:11:01.898534+0000","last_undegraded":"2024-09-19T08:11:01.898534+0000","last_fullsized":"2024-09-19T08:11:01.898534+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:43.332454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619356+0000","last_change":"2024-09-19T08:09:11.245866+0000","last_active":"2024-09-19T08:11:01.619356+0000","last_peered":"2024-09-19T08:11:01.619356+0000","last_clean":"2024-09-19T08:11:01.619356+0000","last_became_active":"2024-09-19T08:09:11.245505+0000","last_became_peered":"2024-09-19T08:09:11.245505+0000","last_unstale":"2024-09-19T08:11:01.619356+0000","last_undegraded":"2024-09-19T08:11:01.619356+0000","last_fullsized":"2024-09-19T08:11:01.619356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:38.203790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619389+0000","last_change":"2024-09-19T08:09:11.251095+0000","last_active":"2024-09-19T08:11:01.619389+0000","last_peered":"2024-09-19T08:11:01.619389+0000","last_clean":"2024-09-19T08:11:01.619389+0000","last_became_active":"2024-09-19T08:09:11.250745+0000","last_became_peered":"2024-09-19T08:09:11.250745+0000","last_unstale":"2024-09-19T08:11:01.619389+0000","last_undegraded":"2024-09-19T08:11:01.619389+0000","last_fullsized":"2024-09-19T08:11:01.619389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:16.851230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244514+0000","last_change":"2024-09-19T08:09:11.255211+0000","last_active":"2024-09-19T08:11:02.244514+0000","last_peered":"2024-09-19T08:11:02.244514+0000","last_clean":"2024-09-19T08:11:02.244514+0000","last_became_active":"2024-09-19T08:09:11.254853+0000","last_became_peered":"2024-09-19T08:09:11.254853+0000","last_unstale":"2024-09-19T08:11:02.244514+0000","last_undegraded":"2024-09-19T08:11:02.244514+0000","last_fullsized":"2024-09-19T08:11:02.244514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.497502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413533+0000","last_change":"2024-09-19T08:09:11.247201+0000","last_active":"2024-09-19T08:11:01.413533+0000","last_peered":"2024-09-19T08:11:01.413533+0000","last_clean":"2024-09-19T08:11:01.413533+0000","last_became_active":"2024-09-19T08:09:11.246854+0000","last_became_peered":"2024-09-19T08:09:11.246854+0000","last_unstale":"2024-09-19T08:11:01.413533+0000","last_undegraded":"2024-09-19T08:11:01.413533+0000","last_fullsized":"2024-09-19T08:11:01.413533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:19.262849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327350+0000","last_change":"2024-09-19T08:09:09.113754+0000","last_active":"2024-09-19T08:11:01.327350+0000","last_peered":"2024-09-19T08:11:01.327350+0000","last_clean":"2024-09-19T08:11:01.327350+0000","last_became_active":"2024-09-19T08:09:09.113389+0000","last_became_peered":"2024-09-19T08:09:09.113389+0000","last_unstale":"2024-09-19T08:11:01.327350+0000","last_undegraded":"2024-09-19T08:11:01.327350+0000","last_fullsized":"2024-09-19T08:11:01.327350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:45.325895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327320+0000","last_change":"2024-09-19T08:09:11.244625+0000","last_active":"2024-09-19T08:11:01.327320+0000","last_peered":"2024-09-19T08:11:01.327320+0000","last_clean":"2024-09-19T08:11:01.327320+0000","last_became_active":"2024-09-19T08:09:11.244277+0000","last_became_peered":"2024-09-19T08:09:11.244277+0000","last_unstale":"2024-09-19T08:11:01.327320+0000","last_undegraded":"2024-09-19T08:11:01.327320+0000","last_fullsized":"2024-09-19T08:11:01.327320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:33:34.050343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325579+0000","last_change":"2024-09-19T08:09:09.116735+0000","last_active":"2024-09-19T08:11:01.325579+0000","last_peered":"2024-09-19T08:11:01.325579+0000","last_clean":"2024-09-19T08:11:01.325579+0000","last_became_active":"2024-09-19T08:09:09.116356+0000","last_became_peered":"2024-09-19T08:09:09.116356+0000","last_unstale":"2024-09-19T08:11:01.325579+0000","last_undegraded":"2024-09-19T08:11:01.325579+0000","last_fullsized":"2024-09-19T08:11:01.325579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:50.952567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323834+0000","last_change":"2024-09-19T08:09:09.113182+0000","last_active":"2024-09-19T08:11:01.323834+0000","last_peered":"2024-09-19T08:11:01.323834+0000","last_clean":"2024-09-19T08:11:01.323834+0000","last_became_active":"2024-09-19T08:09:09.112528+0000","last_became_peered":"2024-09-19T08:09:09.112528+0000","last_unstale":"2024-09-19T08:11:01.323834+0000","last_undegraded":"2024-09-19T08:11:01.323834+0000","last_fullsized":"2024-09-19T08:11:01.323834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:07.647351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413961+0000","last_change":"2024-09-19T08:09:11.241639+0000","last_active":"2024-09-19T08:11:01.413961+0000","last_peered":"2024-09-19T08:11:01.413961+0000","last_clean":"2024-09-19T08:11:01.413961+0000","last_became_active":"2024-09-19T08:09:11.241308+0000","last_became_peered":"2024-09-19T08:09:11.241308+0000","last_unstale":"2024-09-19T08:11:01.413961+0000","last_undegraded":"2024-09-19T08:11:01.413961+0000","last_fullsized":"2024-09-19T08:11:01.413961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:57.826870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327401+0000","last_change":"2024-09-19T08:09:09.118334+0000","last_active":"2024-09-19T08:11:01.327401+0000","last_peered":"2024-09-19T08:11:01.327401+0000","last_clean":"2024-09-19T08:11:01.327401+0000","last_became_active":"2024-09-19T08:09:09.118010+0000","last_became_peered":"2024-09-19T08:09:09.118010+0000","last_unstale":"2024-09-19T08:11:01.327401+0000","last_undegraded":"2024-09-19T08:11:01.327401+0000","last_fullsized":"2024-09-19T08:11:01.327401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:51.046598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.410546+0000","last_change":"2024-09-19T08:09:11.239990+0000","last_active":"2024-09-19T08:11:01.410546+0000","last_peered":"2024-09-19T08:11:01.410546+0000","last_clean":"2024-09-19T08:11:01.410546+0000","last_became_active":"2024-09-19T08:09:11.239643+0000","last_became_peered":"2024-09-19T08:09:11.239643+0000","last_unstale":"2024-09-19T08:11:01.410546+0000","last_undegraded":"2024-09-19T08:11:01.410546+0000","last_fullsized":"2024-09-19T08:11:01.410546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:07.078244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325867+0000","last_change":"2024-09-19T08:09:09.114397+0000","last_active":"2024-09-19T08:11:01.325867+0000","last_peered":"2024-09-19T08:11:01.325867+0000","last_clean":"2024-09-19T08:11:01.325867+0000","last_became_active":"2024-09-19T08:09:09.114051+0000","last_became_peered":"2024-09-19T08:09:09.114051+0000","last_unstale":"2024-09-19T08:11:01.325867+0000","last_undegraded":"2024-09-19T08:11:01.325867+0000","last_fullsized":"2024-09-19T08:11:01.325867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:41.799442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619494+0000","last_change":"2024-09-19T08:09:11.254802+0000","last_active":"2024-09-19T08:11:01.619494+0000","last_peered":"2024-09-19T08:11:01.619494+0000","last_clean":"2024-09-19T08:11:01.619494+0000","last_became_active":"2024-09-19T08:09:11.253869+0000","last_became_peered":"2024-09-19T08:09:11.253869+0000","last_unstale":"2024-09-19T08:11:01.619494+0000","last_undegraded":"2024-09-19T08:11:01.619494+0000","last_fullsized":"2024-09-19T08:11:01.619494+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:00.164834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899209+0000","last_change":"2024-09-19T08:09:09.118585+0000","last_active":"2024-09-19T08:11:01.899209+0000","last_peered":"2024-09-19T08:11:01.899209+0000","last_clean":"2024-09-19T08:11:01.899209+0000","last_became_active":"2024-09-19T08:09:09.118216+0000","last_became_peered":"2024-09-19T08:09:09.118216+0000","last_unstale":"2024-09-19T08:11:01.899209+0000","last_undegraded":"2024-09-19T08:11:01.899209+0000","last_fullsized":"2024-09-19T08:11:01.899209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:41.905746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898880+0000","last_change":"2024-09-19T08:09:11.249835+0000","last_active":"2024-09-19T08:11:01.898880+0000","last_peered":"2024-09-19T08:11:01.898880+0000","last_clean":"2024-09-19T08:11:01.898880+0000","last_became_active":"2024-09-19T08:09:11.249443+0000","last_became_peered":"2024-09-19T08:09:11.249443+0000","last_unstale":"2024-09-19T08:11:01.898880+0000","last_undegraded":"2024-09-19T08:11:01.898880+0000","last_fullsized":"2024-09-19T08:11:01.898880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:06.373126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327565+0000","last_change":"2024-09-19T08:09:09.242565+0000","last_active":"2024-09-19T08:11:01.327565+0000","last_peered":"2024-09-19T08:11:01.327565+0000","last_clean":"2024-09-19T08:11:01.327565+0000","last_became_active":"2024-09-19T08:09:09.242199+0000","last_became_peered":"2024-09-19T08:09:09.242199+0000","last_unstale":"2024-09-19T08:11:01.327565+0000","last_undegraded":"2024-09-19T08:11:01.327565+0000","last_fullsized":"2024-09-19T08:11:01.327565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:33.195385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619322+0000","last_change":"2024-09-19T08:09:11.251682+0000","last_active":"2024-09-19T08:11:01.619322+0000","last_peered":"2024-09-19T08:11:01.619322+0000","last_clean":"2024-09-19T08:11:01.619322+0000","last_became_active":"2024-09-19T08:09:11.251037+0000","last_became_peered":"2024-09-19T08:09:11.251037+0000","last_unstale":"2024-09-19T08:11:01.619322+0000","last_undegraded":"2024-09-19T08:11:01.619322+0000","last_fullsized":"2024-09-19T08:11:01.619322+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:29.518828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'35","reported_seq":297,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:11.486108+0000","last_change":"2024-09-19T08:09:09.119090+0000","last_active":"2024-09-19T08:11:11.486108+0000","last_peered":"2024-09-19T08:11:11.486108+0000","last_clean":"2024-09-19T08:11:11.486108+0000","last_became_active":"2024-09-19T08:09:09.118685+0000","last_became_peered":"2024-09-19T08:09:09.118685+0000","last_unstale":"2024-09-19T08:11:11.486108+0000","last_undegraded":"2024-09-19T08:11:11.486108+0000","last_fullsized":"2024-09-19T08:11:11.486108+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:21.540404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69535,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":238,"num_read_kb":187,"num_write":35,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413753+0000","last_change":"2024-09-19T08:09:11.243200+0000","last_active":"2024-09-19T08:11:01.413753+0000","last_peered":"2024-09-19T08:11:01.413753+0000","last_clean":"2024-09-19T08:11:01.413753+0000","last_became_active":"2024-09-19T08:09:11.242873+0000","last_became_peered":"2024-09-19T08:09:11.242873+0000","last_unstale":"2024-09-19T08:11:01.413753+0000","last_undegraded":"2024-09-19T08:11:01.413753+0000","last_fullsized":"2024-09-19T08:11:01.413753+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:35.817609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619483+0000","last_change":"2024-09-19T08:09:09.117117+0000","last_active":"2024-09-19T08:11:01.619483+0000","last_peered":"2024-09-19T08:11:01.619483+0000","last_clean":"2024-09-19T08:11:01.619483+0000","last_became_active":"2024-09-19T08:09:09.116512+0000","last_became_peered":"2024-09-19T08:09:09.116512+0000","last_unstale":"2024-09-19T08:11:01.619483+0000","last_undegraded":"2024-09-19T08:11:01.619483+0000","last_fullsized":"2024-09-19T08:11:01.619483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:15.010570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323874+0000","last_change":"2024-09-19T08:09:11.246648+0000","last_active":"2024-09-19T08:11:01.323874+0000","last_peered":"2024-09-19T08:11:01.323874+0000","last_clean":"2024-09-19T08:11:01.323874+0000","last_became_active":"2024-09-19T08:09:11.246317+0000","last_became_peered":"2024-09-19T08:09:11.246317+0000","last_unstale":"2024-09-19T08:11:01.323874+0000","last_undegraded":"2024-09-19T08:11:01.323874+0000","last_fullsized":"2024-09-19T08:11:01.323874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:43.285257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327239+0000","last_change":"2024-09-19T08:09:09.112599+0000","last_active":"2024-09-19T08:11:01.327239+0000","last_peered":"2024-09-19T08:11:01.327239+0000","last_clean":"2024-09-19T08:11:01.327239+0000","last_became_active":"2024-09-19T08:09:09.112281+0000","last_became_peered":"2024-09-19T08:09:09.112281+0000","last_unstale":"2024-09-19T08:11:01.327239+0000","last_undegraded":"2024-09-19T08:11:01.327239+0000","last_fullsized":"2024-09-19T08:11:01.327239+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:47.710235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898887+0000","last_change":"2024-09-19T08:09:11.253814+0000","last_active":"2024-09-19T08:11:01.898887+0000","last_peered":"2024-09-19T08:11:01.898887+0000","last_clean":"2024-09-19T08:11:01.898887+0000","last_became_active":"2024-09-19T08:09:11.253490+0000","last_became_peered":"2024-09-19T08:09:11.253490+0000","last_unstale":"2024-09-19T08:11:01.898887+0000","last_undegraded":"2024-09-19T08:11:01.898887+0000","last_fullsized":"2024-09-19T08:11:01.898887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:09.287110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898591+0000","last_change":"2024-09-19T08:09:09.114820+0000","last_active":"2024-09-19T08:11:01.898591+0000","last_peered":"2024-09-19T08:11:01.898591+0000","last_clean":"2024-09-19T08:11:01.898591+0000","last_became_active":"2024-09-19T08:09:09.114478+0000","last_became_peered":"2024-09-19T08:09:09.114478+0000","last_unstale":"2024-09-19T08:11:01.898591+0000","last_undegraded":"2024-09-19T08:11:01.898591+0000","last_fullsized":"2024-09-19T08:11:01.898591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:24.243629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898477+0000","last_change":"2024-09-19T08:10:14.789301+0000","last_active":"2024-09-19T08:11:01.898477+0000","last_peered":"2024-09-19T08:11:01.898477+0000","last_clean":"2024-09-19T08:11:01.898477+0000","last_became_active":"2024-09-19T08:10:14.788891+0000","last_became_peered":"2024-09-19T08:10:14.788891+0000","last_unstale":"2024-09-19T08:11:01.898477+0000","last_undegraded":"2024-09-19T08:11:01.898477+0000","last_fullsized":"2024-09-19T08:11:01.898477+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:03.142177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244400+0000","last_change":"2024-09-19T08:10:14.799207+0000","last_active":"2024-09-19T08:11:02.244400+0000","last_peered":"2024-09-19T08:11:02.244400+0000","last_clean":"2024-09-19T08:11:02.244400+0000","last_became_active":"2024-09-19T08:10:14.787612+0000","last_became_peered":"2024-09-19T08:10:14.787612+0000","last_unstale":"2024-09-19T08:11:02.244400+0000","last_undegraded":"2024-09-19T08:11:02.244400+0000","last_fullsized":"2024-09-19T08:11:02.244400+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:45.997778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327130+0000","last_change":"2024-09-19T08:09:11.245399+0000","last_active":"2024-09-19T08:11:01.327130+0000","last_peered":"2024-09-19T08:11:01.327130+0000","last_clean":"2024-09-19T08:11:01.327130+0000","last_became_active":"2024-09-19T08:09:11.245055+0000","last_became_peered":"2024-09-19T08:09:11.245055+0000","last_unstale":"2024-09-19T08:11:01.327130+0000","last_undegraded":"2024-09-19T08:11:01.327130+0000","last_fullsized":"2024-09-19T08:11:01.327130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:57.639205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413806+0000","last_change":"2024-09-19T08:09:09.115252+0000","last_active":"2024-09-19T08:11:01.413806+0000","last_peered":"2024-09-19T08:11:01.413806+0000","last_clean":"2024-09-19T08:11:01.413806+0000","last_became_active":"2024-09-19T08:09:09.114908+0000","last_became_peered":"2024-09-19T08:09:09.114908+0000","last_unstale":"2024-09-19T08:11:01.413806+0000","last_undegraded":"2024-09-19T08:11:01.413806+0000","last_fullsized":"2024-09-19T08:11:01.413806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:48.326221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244581+0000","last_change":"2024-09-19T08:09:11.249189+0000","last_active":"2024-09-19T08:11:02.244581+0000","last_peered":"2024-09-19T08:11:02.244581+0000","last_clean":"2024-09-19T08:11:02.244581+0000","last_became_active":"2024-09-19T08:09:11.248797+0000","last_became_peered":"2024-09-19T08:09:11.248797+0000","last_unstale":"2024-09-19T08:11:02.244581+0000","last_undegraded":"2024-09-19T08:11:02.244581+0000","last_fullsized":"2024-09-19T08:11:02.244581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:20.915638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324421+0000","last_change":"2024-09-19T08:09:09.112973+0000","last_active":"2024-09-19T08:11:01.324421+0000","last_peered":"2024-09-19T08:11:01.324421+0000","last_clean":"2024-09-19T08:11:01.324421+0000","last_became_active":"2024-09-19T08:09:09.112616+0000","last_became_peered":"2024-09-19T08:09:09.112616+0000","last_unstale":"2024-09-19T08:11:01.324421+0000","last_undegraded":"2024-09-19T08:11:01.324421+0000","last_fullsized":"2024-09-19T08:11:01.324421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:13.791926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899227+0000","last_change":"2024-09-19T08:09:11.240739+0000","last_active":"2024-09-19T08:11:01.899227+0000","last_peered":"2024-09-19T08:11:01.899227+0000","last_clean":"2024-09-19T08:11:01.899227+0000","last_became_active":"2024-09-19T08:09:11.240340+0000","last_became_peered":"2024-09-19T08:09:11.240340+0000","last_unstale":"2024-09-19T08:11:01.899227+0000","last_undegraded":"2024-09-19T08:11:01.899227+0000","last_fullsized":"2024-09-19T08:11:01.899227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:35.450279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'65","reported_seq":120,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:10.034377+0000","last_change":"2024-09-19T08:09:09.112516+0000","last_active":"2024-09-19T08:11:10.034377+0000","last_peered":"2024-09-19T08:11:10.034377+0000","last_clean":"2024-09-19T08:11:10.034377+0000","last_became_active":"2024-09-19T08:09:09.112140+0000","last_became_peered":"2024-09-19T08:09:09.112140+0000","last_unstale":"2024-09-19T08:11:10.034377+0000","last_undegraded":"2024-09-19T08:11:10.034377+0000","last_fullsized":"2024-09-19T08:11:10.034377+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:05.434331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899052+0000","last_change":"2024-09-19T08:09:11.252163+0000","last_active":"2024-09-19T08:11:01.899052+0000","last_peered":"2024-09-19T08:11:01.899052+0000","last_clean":"2024-09-19T08:11:01.899052+0000","last_became_active":"2024-09-19T08:09:11.251762+0000","last_became_peered":"2024-09-19T08:09:11.251762+0000","last_unstale":"2024-09-19T08:11:01.899052+0000","last_undegraded":"2024-09-19T08:11:01.899052+0000","last_fullsized":"2024-09-19T08:11:01.899052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:33.941910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898722+0000","last_change":"2024-09-19T08:10:14.788460+0000","last_active":"2024-09-19T08:11:01.898722+0000","last_peered":"2024-09-19T08:11:01.898722+0000","last_clean":"2024-09-19T08:11:01.898722+0000","last_became_active":"2024-09-19T08:10:14.787990+0000","last_became_peered":"2024-09-19T08:10:14.787990+0000","last_unstale":"2024-09-19T08:11:01.898722+0000","last_undegraded":"2024-09-19T08:11:01.898722+0000","last_fullsized":"2024-09-19T08:11:01.898722+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:24.549994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899257+0000","last_change":"2024-09-19T08:09:11.242438+0000","last_active":"2024-09-19T08:11:01.899257+0000","last_peered":"2024-09-19T08:11:01.899257+0000","last_clean":"2024-09-19T08:11:01.899257+0000","last_became_active":"2024-09-19T08:09:11.242114+0000","last_became_peered":"2024-09-19T08:09:11.242114+0000","last_unstale":"2024-09-19T08:11:01.899257+0000","last_undegraded":"2024-09-19T08:11:01.899257+0000","last_fullsized":"2024-09-19T08:11:01.899257+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:54.183012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"84'148","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:03.438528+0000","last_change":"2024-09-19T08:07:55.287566+0000","last_active":"2024-09-19T08:11:03.438528+0000","last_peered":"2024-09-19T08:11:03.438528+0000","last_clean":"2024-09-19T08:11:03.438528+0000","last_became_active":"2024-09-19T08:07:55.287037+0000","last_became_peered":"2024-09-19T08:07:55.287037+0000","last_unstale":"2024-09-19T08:11:03.438528+0000","last_undegraded":"2024-09-19T08:11:03.438528+0000","last_fullsized":"2024-09-19T08:11:03.438528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:04:29.468857+0000","last_clean_scrub_stamp":"2024-09-19T08:04:29.468857+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:49.553882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898721+0000","last_change":"2024-09-19T08:09:09.113497+0000","last_active":"2024-09-19T08:11:01.898721+0000","last_peered":"2024-09-19T08:11:01.898721+0000","last_clean":"2024-09-19T08:11:01.898721+0000","last_became_active":"2024-09-19T08:09:09.112546+0000","last_became_peered":"2024-09-19T08:09:09.112546+0000","last_unstale":"2024-09-19T08:11:01.898721+0000","last_undegraded":"2024-09-19T08:11:01.898721+0000","last_fullsized":"2024-09-19T08:11:01.898721+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:09.906476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414661+0000","last_change":"2024-09-19T08:09:11.241478+0000","last_active":"2024-09-19T08:11:01.414661+0000","last_peered":"2024-09-19T08:11:01.414661+0000","last_clean":"2024-09-19T08:11:01.414661+0000","last_became_active":"2024-09-19T08:09:11.241138+0000","last_became_peered":"2024-09-19T08:09:11.241138+0000","last_unstale":"2024-09-19T08:11:01.414661+0000","last_undegraded":"2024-09-19T08:11:01.414661+0000","last_fullsized":"2024-09-19T08:11:01.414661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:32.884491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898642+0000","last_change":"2024-09-19T08:09:09.116571+0000","last_active":"2024-09-19T08:11:01.898642+0000","last_peered":"2024-09-19T08:11:01.898642+0000","last_clean":"2024-09-19T08:11:01.898642+0000","last_became_active":"2024-09-19T08:09:09.116180+0000","last_became_peered":"2024-09-19T08:09:09.116180+0000","last_unstale":"2024-09-19T08:11:01.898642+0000","last_undegraded":"2024-09-19T08:11:01.898642+0000","last_fullsized":"2024-09-19T08:11:01.898642+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:58.577320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323898+0000","last_change":"2024-09-19T08:10:14.791196+0000","last_active":"2024-09-19T08:11:01.323898+0000","last_peered":"2024-09-19T08:11:01.323898+0000","last_clean":"2024-09-19T08:11:01.323898+0000","last_became_active":"2024-09-19T08:10:14.790873+0000","last_became_peered":"2024-09-19T08:10:14.790873+0000","last_unstale":"2024-09-19T08:11:01.323898+0000","last_undegraded":"2024-09-19T08:11:01.323898+0000","last_fullsized":"2024-09-19T08:11:01.323898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:41.725521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.323997+0000","last_change":"2024-09-19T08:09:09.242166+0000","last_active":"2024-09-19T08:11:01.323997+0000","last_peered":"2024-09-19T08:11:01.323997+0000","last_clean":"2024-09-19T08:11:01.323997+0000","last_became_active":"2024-09-19T08:09:09.241270+0000","last_became_peered":"2024-09-19T08:09:09.241270+0000","last_unstale":"2024-09-19T08:11:01.323997+0000","last_undegraded":"2024-09-19T08:11:01.323997+0000","last_fullsized":"2024-09-19T08:11:01.323997+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:51.899069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327090+0000","last_change":"2024-09-19T08:10:14.793572+0000","last_active":"2024-09-19T08:11:01.327090+0000","last_peered":"2024-09-19T08:11:01.327090+0000","last_clean":"2024-09-19T08:11:01.327090+0000","last_became_active":"2024-09-19T08:10:14.793258+0000","last_became_peered":"2024-09-19T08:10:14.793258+0000","last_unstale":"2024-09-19T08:11:01.327090+0000","last_undegraded":"2024-09-19T08:11:01.327090+0000","last_fullsized":"2024-09-19T08:11:01.327090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:53.912430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.899060+0000","last_change":"2024-09-19T08:09:09.118790+0000","last_active":"2024-09-19T08:11:01.899060+0000","last_peered":"2024-09-19T08:11:01.899060+0000","last_clean":"2024-09-19T08:11:01.899060+0000","last_became_active":"2024-09-19T08:09:09.117695+0000","last_became_peered":"2024-09-19T08:09:09.117695+0000","last_unstale":"2024-09-19T08:11:01.899060+0000","last_undegraded":"2024-09-19T08:11:01.899060+0000","last_fullsized":"2024-09-19T08:11:01.899060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:40.674039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325589+0000","last_change":"2024-09-19T08:09:11.249386+0000","last_active":"2024-09-19T08:11:01.325589+0000","last_peered":"2024-09-19T08:11:01.325589+0000","last_clean":"2024-09-19T08:11:01.325589+0000","last_became_active":"2024-09-19T08:09:11.249004+0000","last_became_peered":"2024-09-19T08:09:11.249004+0000","last_unstale":"2024-09-19T08:11:01.325589+0000","last_undegraded":"2024-09-19T08:11:01.325589+0000","last_fullsized":"2024-09-19T08:11:01.325589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:50.170799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.410707+0000","last_change":"2024-09-19T08:09:09.241599+0000","last_active":"2024-09-19T08:11:01.410707+0000","last_peered":"2024-09-19T08:11:01.410707+0000","last_clean":"2024-09-19T08:11:01.410707+0000","last_became_active":"2024-09-19T08:09:09.241226+0000","last_became_peered":"2024-09-19T08:09:09.241226+0000","last_unstale":"2024-09-19T08:11:01.410707+0000","last_undegraded":"2024-09-19T08:11:01.410707+0000","last_fullsized":"2024-09-19T08:11:01.410707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:19.590966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.325735+0000","last_change":"2024-09-19T08:09:11.238098+0000","last_active":"2024-09-19T08:11:01.325735+0000","last_peered":"2024-09-19T08:11:01.325735+0000","last_clean":"2024-09-19T08:11:01.325735+0000","last_became_active":"2024-09-19T08:09:11.237737+0000","last_became_peered":"2024-09-19T08:09:11.237737+0000","last_unstale":"2024-09-19T08:11:01.325735+0000","last_undegraded":"2024-09-19T08:11:01.325735+0000","last_fullsized":"2024-09-19T08:11:01.325735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:00.134664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413888+0000","last_change":"2024-09-19T08:09:09.241775+0000","last_active":"2024-09-19T08:11:01.413888+0000","last_peered":"2024-09-19T08:11:01.413888+0000","last_clean":"2024-09-19T08:11:01.413888+0000","last_became_active":"2024-09-19T08:09:09.241367+0000","last_became_peered":"2024-09-19T08:09:09.241367+0000","last_unstale":"2024-09-19T08:11:01.413888+0000","last_undegraded":"2024-09-19T08:11:01.413888+0000","last_fullsized":"2024-09-19T08:11:01.413888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:11.862171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.324396+0000","last_change":"2024-09-19T08:09:11.251980+0000","last_active":"2024-09-19T08:11:01.324396+0000","last_peered":"2024-09-19T08:11:01.324396+0000","last_clean":"2024-09-19T08:11:01.324396+0000","last_became_active":"2024-09-19T08:09:11.251638+0000","last_became_peered":"2024-09-19T08:09:11.251638+0000","last_unstale":"2024-09-19T08:11:01.324396+0000","last_undegraded":"2024-09-19T08:11:01.324396+0000","last_fullsized":"2024-09-19T08:11:01.324396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:35.905643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'98","reported_seq":214,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:10.394631+0000","last_change":"2024-09-19T08:09:09.117150+0000","last_active":"2024-09-19T08:11:10.394631+0000","last_peered":"2024-09-19T08:11:10.394631+0000","last_clean":"2024-09-19T08:11:10.394631+0000","last_became_active":"2024-09-19T08:09:09.116763+0000","last_became_peered":"2024-09-19T08:09:09.116763+0000","last_unstale":"2024-09-19T08:11:10.394631+0000","last_undegraded":"2024-09-19T08:11:10.394631+0000","last_fullsized":"2024-09-19T08:11:10.394631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:18.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":181,"num_write_kb":1286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.415619+0000","last_change":"2024-09-19T08:09:11.244366+0000","last_active":"2024-09-19T08:11:01.415619+0000","last_peered":"2024-09-19T08:11:01.415619+0000","last_clean":"2024-09-19T08:11:01.415619+0000","last_became_active":"2024-09-19T08:09:11.244023+0000","last_became_peered":"2024-09-19T08:09:11.244023+0000","last_unstale":"2024-09-19T08:11:01.415619+0000","last_undegraded":"2024-09-19T08:11:01.415619+0000","last_fullsized":"2024-09-19T08:11:01.415619+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:18.572377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898860+0000","last_change":"2024-09-19T08:09:09.139557+0000","last_active":"2024-09-19T08:11:01.898860+0000","last_peered":"2024-09-19T08:11:01.898860+0000","last_clean":"2024-09-19T08:11:01.898860+0000","last_became_active":"2024-09-19T08:09:09.139190+0000","last_became_peered":"2024-09-19T08:09:09.139190+0000","last_unstale":"2024-09-19T08:11:01.898860+0000","last_undegraded":"2024-09-19T08:11:01.898860+0000","last_fullsized":"2024-09-19T08:11:01.898860+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:39.270432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898761+0000","last_change":"2024-09-19T08:09:11.249637+0000","last_active":"2024-09-19T08:11:01.898761+0000","last_peered":"2024-09-19T08:11:01.898761+0000","last_clean":"2024-09-19T08:11:01.898761+0000","last_became_active":"2024-09-19T08:09:11.249323+0000","last_became_peered":"2024-09-19T08:09:11.249323+0000","last_unstale":"2024-09-19T08:11:01.898761+0000","last_undegraded":"2024-09-19T08:11:01.898761+0000","last_fullsized":"2024-09-19T08:11:01.898761+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:28.270910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619321+0000","last_change":"2024-09-19T08:09:09.242444+0000","last_active":"2024-09-19T08:11:01.619321+0000","last_peered":"2024-09-19T08:11:01.619321+0000","last_clean":"2024-09-19T08:11:01.619321+0000","last_became_active":"2024-09-19T08:09:09.242095+0000","last_became_peered":"2024-09-19T08:09:09.242095+0000","last_unstale":"2024-09-19T08:11:01.619321+0000","last_undegraded":"2024-09-19T08:11:01.619321+0000","last_fullsized":"2024-09-19T08:11:01.619321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:42.941930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413514+0000","last_change":"2024-09-19T08:09:11.241588+0000","last_active":"2024-09-19T08:11:01.413514+0000","last_peered":"2024-09-19T08:11:01.413514+0000","last_clean":"2024-09-19T08:11:01.413514+0000","last_became_active":"2024-09-19T08:09:11.241076+0000","last_became_peered":"2024-09-19T08:09:11.241076+0000","last_unstale":"2024-09-19T08:11:01.413514+0000","last_undegraded":"2024-09-19T08:11:01.413514+0000","last_fullsized":"2024-09-19T08:11:01.413514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:01.676410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414370+0000","last_change":"2024-09-19T08:09:09.112494+0000","last_active":"2024-09-19T08:11:01.414370+0000","last_peered":"2024-09-19T08:11:01.414370+0000","last_clean":"2024-09-19T08:11:01.414370+0000","last_became_active":"2024-09-19T08:09:09.112019+0000","last_became_peered":"2024-09-19T08:09:09.112019+0000","last_unstale":"2024-09-19T08:11:01.414370+0000","last_undegraded":"2024-09-19T08:11:01.414370+0000","last_fullsized":"2024-09-19T08:11:01.414370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:17.674092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244542+0000","last_change":"2024-09-19T08:09:11.251420+0000","last_active":"2024-09-19T08:11:02.244542+0000","last_peered":"2024-09-19T08:11:02.244542+0000","last_clean":"2024-09-19T08:11:02.244542+0000","last_became_active":"2024-09-19T08:09:11.251083+0000","last_became_peered":"2024-09-19T08:09:11.251083+0000","last_unstale":"2024-09-19T08:11:02.244542+0000","last_undegraded":"2024-09-19T08:11:02.244542+0000","last_fullsized":"2024-09-19T08:11:02.244542+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:38.810616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:02.244424+0000","last_change":"2024-09-19T08:10:14.825972+0000","last_active":"2024-09-19T08:11:02.244424+0000","last_peered":"2024-09-19T08:11:02.244424+0000","last_clean":"2024-09-19T08:11:02.244424+0000","last_became_active":"2024-09-19T08:10:14.825579+0000","last_became_peered":"2024-09-19T08:10:14.825579+0000","last_unstale":"2024-09-19T08:11:02.244424+0000","last_undegraded":"2024-09-19T08:11:02.244424+0000","last_fullsized":"2024-09-19T08:11:02.244424+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:06.708622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.414973+0000","last_change":"2024-09-19T08:09:11.239096+0000","last_active":"2024-09-19T08:11:01.414973+0000","last_peered":"2024-09-19T08:11:01.414973+0000","last_clean":"2024-09-19T08:11:01.414973+0000","last_became_active":"2024-09-19T08:09:11.238739+0000","last_became_peered":"2024-09-19T08:09:11.238739+0000","last_unstale":"2024-09-19T08:11:01.414973+0000","last_undegraded":"2024-09-19T08:11:01.414973+0000","last_fullsized":"2024-09-19T08:11:01.414973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:27.161174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413598+0000","last_change":"2024-09-19T08:09:09.115198+0000","last_active":"2024-09-19T08:11:01.413598+0000","last_peered":"2024-09-19T08:11:01.413598+0000","last_clean":"2024-09-19T08:11:01.413598+0000","last_became_active":"2024-09-19T08:09:09.114783+0000","last_became_peered":"2024-09-19T08:09:09.114783+0000","last_unstale":"2024-09-19T08:11:01.413598+0000","last_undegraded":"2024-09-19T08:11:01.413598+0000","last_fullsized":"2024-09-19T08:11:01.413598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:45.674774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898887+0000","last_change":"2024-09-19T08:09:11.252450+0000","last_active":"2024-09-19T08:11:01.898887+0000","last_peered":"2024-09-19T08:11:01.898887+0000","last_clean":"2024-09-19T08:11:01.898887+0000","last_became_active":"2024-09-19T08:09:11.251696+0000","last_became_peered":"2024-09-19T08:09:11.251696+0000","last_unstale":"2024-09-19T08:11:01.898887+0000","last_undegraded":"2024-09-19T08:11:01.898887+0000","last_fullsized":"2024-09-19T08:11:01.898887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:48.179795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.327527+0000","last_change":"2024-09-19T08:09:11.244571+0000","last_active":"2024-09-19T08:11:01.327527+0000","last_peered":"2024-09-19T08:11:01.327527+0000","last_clean":"2024-09-19T08:11:01.327527+0000","last_became_active":"2024-09-19T08:09:11.244217+0000","last_became_peered":"2024-09-19T08:09:11.244217+0000","last_unstale":"2024-09-19T08:11:01.327527+0000","last_undegraded":"2024-09-19T08:11:01.327527+0000","last_fullsized":"2024-09-19T08:11:01.327527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:52.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413805+0000","last_change":"2024-09-19T08:09:09.117355+0000","last_active":"2024-09-19T08:11:01.413805+0000","last_peered":"2024-09-19T08:11:01.413805+0000","last_clean":"2024-09-19T08:11:01.413805+0000","last_became_active":"2024-09-19T08:09:09.116806+0000","last_became_peered":"2024-09-19T08:09:09.116806+0000","last_unstale":"2024-09-19T08:11:01.413805+0000","last_undegraded":"2024-09-19T08:11:01.413805+0000","last_fullsized":"2024-09-19T08:11:01.413805+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:42.113015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.619575+0000","last_change":"2024-09-19T08:09:11.245745+0000","last_active":"2024-09-19T08:11:01.619575+0000","last_peered":"2024-09-19T08:11:01.619575+0000","last_clean":"2024-09-19T08:11:01.619575+0000","last_became_active":"2024-09-19T08:09:11.245373+0000","last_became_peered":"2024-09-19T08:09:11.245373+0000","last_unstale":"2024-09-19T08:11:01.619575+0000","last_undegraded":"2024-09-19T08:11:01.619575+0000","last_fullsized":"2024-09-19T08:11:01.619575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:56.500738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.413790+0000","last_change":"2024-09-19T08:09:09.119550+0000","last_active":"2024-09-19T08:11:01.413790+0000","last_peered":"2024-09-19T08:11:01.413790+0000","last_clean":"2024-09-19T08:11:01.413790+0000","last_became_active":"2024-09-19T08:09:09.119187+0000","last_became_peered":"2024-09-19T08:09:09.119187+0000","last_unstale":"2024-09-19T08:11:01.413790+0000","last_undegraded":"2024-09-19T08:11:01.413790+0000","last_fullsized":"2024-09-19T08:11:01.413790+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:14.629824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.898802+0000","last_change":"2024-09-19T08:09:11.245318+0000","last_active":"2024-09-19T08:11:01.898802+0000","last_peered":"2024-09-19T08:11:01.898802+0000","last_clean":"2024-09-19T08:11:01.898802+0000","last_became_active":"2024-09-19T08:09:11.245000+0000","last_became_peered":"2024-09-19T08:09:11.245000+0000","last_unstale":"2024-09-19T08:11:01.898802+0000","last_undegraded":"2024-09-19T08:11:01.898802+0000","last_fullsized":"2024-09-19T08:11:01.898802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:53.590453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.416131+0000","last_change":"2024-09-19T08:09:09.241552+0000","last_active":"2024-09-19T08:11:01.416131+0000","last_peered":"2024-09-19T08:11:01.416131+0000","last_clean":"2024-09-19T08:11:01.416131+0000","last_became_active":"2024-09-19T08:09:09.241201+0000","last_became_peered":"2024-09-19T08:09:09.241201+0000","last_unstale":"2024-09-19T08:11:01.416131+0000","last_undegraded":"2024-09-19T08:11:01.416131+0000","last_fullsized":"2024-09-19T08:11:01.416131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:09.374532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:01.415847+0000","last_change":"2024-09-19T08:09:11.246697+0000","last_active":"2024-09-19T08:11:01.415847+0000","last_peered":"2024-09-19T08:11:01.415847+0000","last_clean":"2024-09-19T08:11:01.415847+0000","last_became_active":"2024-09-19T08:09:11.246404+0000","last_became_peered":"2024-09-19T08:09:11.246404+0000","last_unstale":"2024-09-19T08:11:01.415847+0000","last_undegraded":"2024-09-19T08:11:01.415847+0000","last_fullsized":"2024-09-19T08:11:01.415847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:10.223380+0000","last_clean_scrub_stamp":"2024-09-19T08:09:10.223380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.008875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T08:11:08.722748+0000","last_change":"2024-09-19T08:09:09.113401+0000","last_active":"2024-09-19T08:11:08.722748+0000","last_peered":"2024-09-19T08:11:08.722748+0000","last_clean":"2024-09-19T08:11:08.722748+0000","last_became_active":"2024-09-19T08:09:09.113026+0000","last_became_peered":"2024-09-19T08:09:09.113026+0000","last_unstale":"2024-09-19T08:11:08.722748+0000","last_undegraded":"2024-09-19T08:11:08.722748+0000","last_fullsized":"2024-09-19T08:11:08.722748+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:09:08.097056+0000","last_clean_scrub_stamp":"2024-09-19T08:09:08.097056+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:54.740955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":791781,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":590,"num_read_kb":503,"num_write":329,"num_write_kb":2321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":503808,"data_stored":2375343,"data_compressed":103473,"data_compressed_allocated":135168,"data_compressed_original":2101248,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107475,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547238,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":444935,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776170,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1093632,"data_stored":1433381,"data_compressed":53899,"data_compressed_allocated":69632,"data_compressed_original":905216,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939696,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":838733,"data_compressed":22161,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168629,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":838755,"data_compressed":22161,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397562,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":962560,"data_stored":1036002,"data_compressed":38697,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561087,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":445052,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790020,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1015808,"data_stored":1363834,"data_compressed":53899,"data_compressed_allocated":69632,"data_compressed_original":905216,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953546,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":444957,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":991232,"data_stored":1166721,"data_compressed":37363,"data_compressed_allocated":49152,"data_compressed_original":708608,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":987136,"data_stored":514504,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":514470,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":445025,"data_compressed":2872,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35825,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":721552,"data_compressed":34491,"data_compressed_allocated":45056,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":328414,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":393820,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":393798,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":397961,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:11:18.184 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:11:18.223 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:18.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.716+0000 7f986ab73640 1 -- 172.21.15.27:0/4062084854 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9864100a80 msgr2=0x7f9864100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:18.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.716+0000 7f986ab73640 1 --2- 172.21.15.27:0/4062084854 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9864100a80 0x7f9864100ee0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9850009930 tx=0x7f985002a420 comp rx=0 tx=0).stop 2024-09-19T08:11:18.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.716+0000 7f986ab73640 1 -- 172.21.15.27:0/4062084854 shutdown_connections 2024-09-19T08:11:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.716+0000 7f986ab73640 1 --2- 172.21.15.27:0/4062084854 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9864101420 0x7f986410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.716+0000 7f986ab73640 1 --2- 172.21.15.27:0/4062084854 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9864100a80 0x7f9864100ee0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.716+0000 7f986ab73640 1 --2- 172.21.15.27:0/4062084854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9864106a80 0x7f9864106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.716+0000 7f986ab73640 1 -- 172.21.15.27:0/4062084854 >> 172.21.15.27:0/4062084854 conn(0x7f98640fc7a0 msgr2=0x7f98640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.716+0000 7f986ab73640 1 -- 172.21.15.27:0/4062084854 shutdown_connections 2024-09-19T08:11:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.717+0000 7f986ab73640 1 -- 172.21.15.27:0/4062084854 wait complete. 2024-09-19T08:11:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.717+0000 7f986ab73640 1 Processor -- start 2024-09-19T08:11:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.717+0000 7f986ab73640 1 -- start start 2024-09-19T08:11:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.717+0000 7f986ab73640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9864100a80 0x7f98641983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.717+0000 7f986ab73640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9864101420 0x7f9864198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.717+0000 7f986ab73640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9864106a80 0x7f986419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.717+0000 7f986ab73640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9864110e40 con 0x7f9864100a80 2024-09-19T08:11:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.717+0000 7f986ab73640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9864110cc0 con 0x7f9864106a80 2024-09-19T08:11:18.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.717+0000 7f986ab73640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9864110fc0 con 0x7f9864101420 2024-09-19T08:11:18.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.717+0000 7f986890f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9864100a80 0x7f98641983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:18.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.717+0000 7f986890f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9864100a80 0x7f98641983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45316/0 (socket says 172.21.15.27:45316) 2024-09-19T08:11:18.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.717+0000 7f986890f640 1 -- 172.21.15.27:0/3486264772 learned_addr learned my addr 172.21.15.27:0/3486264772 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:18.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.718+0000 7f9869110640 1 --2- 172.21.15.27:0/3486264772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9864106a80 0x7f986419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:18.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.718+0000 7f9863fff640 1 --2- 172.21.15.27:0/3486264772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9864101420 0x7f9864198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:18.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.718+0000 7f986890f640 1 -- 172.21.15.27:0/3486264772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9864101420 msgr2=0x7f9864198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:18.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.718+0000 7f986890f640 1 --2- 172.21.15.27:0/3486264772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9864101420 0x7f9864198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.718+0000 7f986890f640 1 -- 172.21.15.27:0/3486264772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9864106a80 msgr2=0x7f986419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:18.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.718+0000 7f986890f640 1 --2- 172.21.15.27:0/3486264772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9864106a80 0x7f986419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.718+0000 7f986890f640 1 -- 172.21.15.27:0/3486264772 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986419d3a0 con 0x7f9864100a80 2024-09-19T08:11:18.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.718+0000 7f9863fff640 1 --2- 172.21.15.27:0/3486264772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9864101420 0x7f9864198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:11:18.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.718+0000 7f986890f640 1 --2- 172.21.15.27:0/3486264772 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9864100a80 0x7f98641983f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f985800c920 tx=0x7f985800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:18.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.718+0000 7f9861ffb640 1 -- 172.21.15.27:0/3486264772 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9858007c70 con 0x7f9864100a80 2024-09-19T08:11:18.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.718+0000 7f9861ffb640 1 -- 172.21.15.27:0/3486264772 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9858007e10 con 0x7f9864100a80 2024-09-19T08:11:18.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.718+0000 7f986ab73640 1 -- 172.21.15.27:0/3486264772 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f986419d690 con 0x7f9864100a80 2024-09-19T08:11:18.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.718+0000 7f9861ffb640 1 -- 172.21.15.27:0/3486264772 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9858018890 con 0x7f9864100a80 2024-09-19T08:11:18.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.718+0000 7f986ab73640 1 -- 172.21.15.27:0/3486264772 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98641a4f70 con 0x7f9864100a80 2024-09-19T08:11:18.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.720+0000 7f9861ffb640 1 -- 172.21.15.27:0/3486264772 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f9858018a70 con 0x7f9864100a80 2024-09-19T08:11:18.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.721+0000 7f986cf4c740 1 Processor -- start 2024-09-19T08:11:18.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.721+0000 7f986cf4c740 1 -- start start 2024-09-19T08:11:18.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.721+0000 7f9861ffb640 1 --2- 172.21.15.27:0/3486264772 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f98540a34c0 0x7f98540a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:18.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.721+0000 7f986cf4c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427d6b60 0x55fc427d6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:18.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.721+0000 7f986cf4c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d7480 0x55fc427e1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:18.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.721+0000 7f986cf4c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427e1d40 0x55fc427e4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:18.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.721+0000 7f986cf4c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55fc4273c280 con 0x55fc427d6b60 2024-09-19T08:11:18.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.721+0000 7f986cf4c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55fc426e3b10 con 0x55fc427d7480 2024-09-19T08:11:18.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.721+0000 7f986cf4c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55fc42738240 con 0x55fc427e1d40 2024-09-19T08:11:18.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.721+0000 7f9869110640 1 --2- 172.21.15.27:0/3486264772 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f98540a34c0 0x7f98540a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:18.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.722+0000 7f9861ffb640 1 -- 172.21.15.27:0/3486264772 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f98580cffc0 con 0x7f9864100a80 2024-09-19T08:11:18.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.722+0000 7f9869110640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427e1d40 0x55fc427e4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:18.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.722+0000 7f9869110640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427e1d40 0x55fc427e4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.27:56624/0 (socket says 172.21.15.27:56624) 2024-09-19T08:11:18.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.722+0000 7f9869110640 1 -- 172.21.15.27:0/1366783373 learned_addr learned my addr 172.21.15.27:0/1366783373 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:18.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.722+0000 7f986890f640 1 --2- 172.21.15.27:0/1366783373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427d6b60 0x55fc427d6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:18.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.722+0000 7f9863fff640 1 --2- 172.21.15.27:0/1366783373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d7480 0x55fc427e1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:18.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.722+0000 7f9869110640 1 --2- 172.21.15.27:0/3486264772 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f98540a34c0 0x7f98540a5980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f985c0126a0 tx=0x7f985c012aa0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:18.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.722+0000 7f986890f640 1 -- 172.21.15.27:0/1366783373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427e1d40 msgr2=0x55fc427e4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:18.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.722+0000 7f986890f640 1 --2- 172.21.15.27:0/1366783373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427e1d40 0x55fc427e4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.722+0000 7f986890f640 1 -- 172.21.15.27:0/1366783373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d7480 msgr2=0x55fc427e1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:18.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.722+0000 7f986890f640 1 --2- 172.21.15.27:0/1366783373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d7480 0x55fc427e1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.722+0000 7f986890f640 1 -- 172.21.15.27:0/1366783373 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc426f01f0 con 0x55fc427d6b60 2024-09-19T08:11:18.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.722+0000 7f9869110640 1 --2- 172.21.15.27:0/1366783373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427e1d40 0x55fc427e4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:11:18.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.723+0000 7f986890f640 1 --2- 172.21.15.27:0/1366783373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427d6b60 0x55fc427d6f40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f98580cd640 tx=0x7f985809c020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6524fd8e2a72a50a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:18.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.723+0000 7f984effd640 1 -- 172.21.15.27:0/1366783373 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985806da40 con 0x55fc427d6b60 2024-09-19T08:11:18.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.723+0000 7f984effd640 1 -- 172.21.15.27:0/1366783373 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98580cde50 con 0x55fc427d6b60 2024-09-19T08:11:18.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.723+0000 7f984effd640 1 -- 172.21.15.27:0/1366783373 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98580bc110 con 0x55fc427d6b60 2024-09-19T08:11:18.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.724+0000 7f986cf4c740 1 -- 172.21.15.27:0/1366783373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427d6b60 msgr2=0x55fc427d6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:18.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.724+0000 7f986cf4c740 1 --2- 172.21.15.27:0/1366783373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427d6b60 0x55fc427d6f40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f98580cd640 tx=0x7f985809c020 comp rx=0 tx=0).stop 2024-09-19T08:11:18.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.724+0000 7f986cf4c740 1 -- 172.21.15.27:0/1366783373 shutdown_connections 2024-09-19T08:11:18.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.724+0000 7f986cf4c740 1 --2- 172.21.15.27:0/1366783373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427e1d40 0x55fc427e4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.724+0000 7f986cf4c740 1 --2- 172.21.15.27:0/1366783373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d7480 0x55fc427e1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.724+0000 7f986cf4c740 1 --2- 172.21.15.27:0/1366783373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427d6b60 0x55fc427d6f40 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.724+0000 7f986cf4c740 1 -- 172.21.15.27:0/1366783373 >> 172.21.15.27:0/1366783373 conn(0x55fc427d30f0 msgr2=0x55fc427d34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:18.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.724+0000 7f986cf4c740 1 -- 172.21.15.27:0/1366783373 shutdown_connections 2024-09-19T08:11:18.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.724+0000 7f986cf4c740 1 -- 172.21.15.27:0/1366783373 wait complete. 2024-09-19T08:11:18.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.724+0000 7f986cf4c740 1 -- start start 2024-09-19T08:11:18.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.724+0000 7f986cf4c740 1 Processor -- start 2024-09-19T08:11:18.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.725+0000 7f986cf4c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d6b60 0x55fc427dec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:18.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.725+0000 7f986cf4c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427d7480 0x55fc427df1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:18.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.725+0000 7f986cf4c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427e1d40 0x55fc427df6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:18.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.725+0000 7f986cf4c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55fc427e4910 con 0x55fc427d7480 2024-09-19T08:11:18.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.725+0000 7f986cf4c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55fc426f6f10 con 0x55fc427d6b60 2024-09-19T08:11:18.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.725+0000 7f986cf4c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55fc427e4a90 con 0x55fc427e1d40 2024-09-19T08:11:18.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.725+0000 7f986cf4c740 10 client.0 _ll_register_callbacks cb 0x55fc426bfa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:18.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.725+0000 7f9863fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427d7480 0x55fc427df1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:18.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.725+0000 7f9863fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427d7480 0x55fc427df1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45330/0 (socket says 172.21.15.27:45330) 2024-09-19T08:11:18.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.725+0000 7f9863fff640 1 -- 172.21.15.27:0/747334558 learned_addr learned my addr 172.21.15.27:0/747334558 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:18.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.725+0000 7f9869110640 1 --2- 172.21.15.27:0/747334558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427e1d40 0x55fc427df6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:18.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.725+0000 7f986890f640 1 --2- 172.21.15.27:0/747334558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d6b60 0x55fc427dec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:18.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.725+0000 7f9863fff640 1 -- 172.21.15.27:0/747334558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427e1d40 msgr2=0x55fc427df6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:18.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.725+0000 7f9863fff640 1 --2- 172.21.15.27:0/747334558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427e1d40 0x55fc427df6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.725+0000 7f9863fff640 1 -- 172.21.15.27:0/747334558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d6b60 msgr2=0x55fc427dec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:18.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.725+0000 7f9863fff640 1 --2- 172.21.15.27:0/747334558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d6b60 0x55fc427dec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.725+0000 7f9863fff640 1 -- 172.21.15.27:0/747334558 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc424ad6a0 con 0x55fc427d7480 2024-09-19T08:11:18.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.726+0000 7f9863fff640 1 --2- 172.21.15.27:0/747334558 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427d7480 0x55fc427df1a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9850009900 tx=0x7f98500317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1722f88315473840 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:18.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.726+0000 7f9843fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:18.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.726+0000 7f9843fff640 1 -- 172.21.15.27:0/747334558 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9850035040 con 0x55fc427d7480 2024-09-19T08:11:18.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.726+0000 7f9843fff640 1 -- 172.21.15.27:0/747334558 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f9850004260 con 0x55fc427d7480 2024-09-19T08:11:18.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.726+0000 7f986cf4c740 1 -- 172.21.15.27:0/747334558 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98580cde50 con 0x55fc427d7480 2024-09-19T08:11:18.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.726+0000 7f9843fff640 1 -- 172.21.15.27:0/747334558 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9850048020 con 0x55fc427d7480 2024-09-19T08:11:18.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.726+0000 7f986cf4c740 10 client.15333 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:18.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.726+0000 7f986cf4c740 1 -- 172.21.15.27:0/747334558 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55fc427f0550 con 0x55fc427d7480 2024-09-19T08:11:18.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.726+0000 7f9843fff640 1 -- 172.21.15.27:0/747334558 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98580cde50 con 0x55fc427d7480 2024-09-19T08:11:18.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.727+0000 7f9843fff640 1 -- 172.21.15.27:0/747334558 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9850004a00 con 0x55fc427d7480 2024-09-19T08:11:18.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.727+0000 7f986cf4c740 10 client.15333 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:18.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.727+0000 7f986cf4c740 10 client.15333 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:18.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.727+0000 7f986cf4c740 20 client.15333 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:18.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.727+0000 7f986cf4c740 1 --2- 172.21.15.27:0/747334558 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55fc427f19b0 0x55fc427f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:18.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.727+0000 7f986cf4c740 4 client.15333 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:11:18.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.727+0000 7f986cf4c740 1 -- 172.21.15.27:0/747334558 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc427497f0 con 0x55fc427f19b0 2024-09-19T08:11:18.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.727+0000 7f986890f640 1 --2- 172.21.15.27:0/747334558 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55fc427f19b0 0x55fc427f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:18.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.727+0000 7f9843fff640 10 client.15333 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:18.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.727+0000 7f986890f640 1 --2- 172.21.15.27:0/747334558 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55fc427f19b0 0x55fc427f3dd0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da5ba7f20572d26c server_cookie=20053c456f5b5f16 in_seq=0 out_seq=0 2024-09-19T08:11:18.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.728+0000 7f9843fff640 1 -- 172.21.15.27:0/747334558 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fc427497f0 con 0x55fc427f19b0 2024-09-19T08:11:18.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.728+0000 7f9843fff640 10 client.15333 handle_command_reply: tid=0 2024-09-19T08:11:18.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.728+0000 7f986cf4c740 1 client.15333 shutdown 2024-09-19T08:11:18.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.728+0000 7f986cf4c740 1 -- 172.21.15.27:0/747334558 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427d7480 msgr2=0x55fc427df1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:18.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.728+0000 7f986cf4c740 1 --2- 172.21.15.27:0/747334558 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427d7480 0x55fc427df1a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9850009900 tx=0x7f98500317e0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.728+0000 7f986cf4c740 1 -- 172.21.15.27:0/747334558 shutdown_connections 2024-09-19T08:11:18.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.728+0000 7f986cf4c740 1 --2- 172.21.15.27:0/747334558 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55fc427f19b0 0x55fc427f3dd0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.728+0000 7f986cf4c740 1 --2- 172.21.15.27:0/747334558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427e1d40 0x55fc427df6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.728+0000 7f986cf4c740 1 --2- 172.21.15.27:0/747334558 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427d7480 0x55fc427df1a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.728+0000 7f986cf4c740 1 --2- 172.21.15.27:0/747334558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d6b60 0x55fc427dec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.728+0000 7f9843fff640 0 client.15333 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:18.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.728+0000 7f986cf4c740 1 -- 172.21.15.27:0/747334558 >> 172.21.15.27:0/747334558 conn(0x55fc427d30f0 msgr2=0x55fc427d8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:18.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.729+0000 7f986cf4c740 1 -- 172.21.15.27:0/747334558 shutdown_connections 2024-09-19T08:11:18.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.729+0000 7f986cf4c740 1 -- 172.21.15.27:0/747334558 wait complete. 2024-09-19T08:11:18.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.729+0000 7f986cf4c740 20 client.15333 trim_cache size 0 max 16384 2024-09-19T08:11:18.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.747+0000 7f986cf4c740 1 Processor -- start 2024-09-19T08:11:18.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.747+0000 7f986cf4c740 1 -- start start 2024-09-19T08:11:18.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.747+0000 7f986cf4c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d6b60 0x55fc427df530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:18.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.747+0000 7f986cf4c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427d7480 0x55fc427d2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:18.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.747+0000 7f986cf4c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427e1d40 0x55fc427f96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:18.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.747+0000 7f9869110640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427e1d40 0x55fc427f96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:18.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.748+0000 7f986890f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d6b60 0x55fc427df530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:18.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.748+0000 7f9869110640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427e1d40 0x55fc427f96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45342/0 (socket says 172.21.15.27:45342) 2024-09-19T08:11:18.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.748+0000 7f9869110640 1 -- 172.21.15.27:0/372404169 learned_addr learned my addr 172.21.15.27:0/372404169 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:18.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.748+0000 7f986cf4c740 1 -- 172.21.15.27:0/372404169 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f98641ab7f0 con 0x55fc427e1d40 2024-09-19T08:11:18.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.748+0000 7f986cf4c740 1 -- 172.21.15.27:0/372404169 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f98641ae070 con 0x55fc427d6b60 2024-09-19T08:11:18.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.748+0000 7f986cf4c740 1 -- 172.21.15.27:0/372404169 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f98641abe60 con 0x55fc427d7480 2024-09-19T08:11:18.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.748+0000 7f9863fff640 1 --2- 172.21.15.27:0/372404169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427d7480 0x55fc427d2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:18.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.748+0000 7f9869110640 1 -- 172.21.15.27:0/372404169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427d7480 msgr2=0x55fc427d2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:18.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.748+0000 7f9869110640 1 --2- 172.21.15.27:0/372404169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427d7480 0x55fc427d2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.748+0000 7f9869110640 1 -- 172.21.15.27:0/372404169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d6b60 msgr2=0x55fc427df530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:18.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.748+0000 7f9869110640 1 --2- 172.21.15.27:0/372404169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d6b60 0x55fc427df530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.748+0000 7f9869110640 1 -- 172.21.15.27:0/372404169 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc427d2b90 con 0x55fc427e1d40 2024-09-19T08:11:18.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.748+0000 7f9863fff640 1 --2- 172.21.15.27:0/372404169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427d7480 0x55fc427d2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:11:18.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.748+0000 7f986890f640 1 --2- 172.21.15.27:0/372404169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d6b60 0x55fc427df530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:11:18.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.748+0000 7f9869110640 1 --2- 172.21.15.27:0/372404169 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427e1d40 0x55fc427f96a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f985c012fa0 tx=0x7f985c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1464b669ee754f36 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:18.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.749+0000 7f984e7fc640 1 -- 172.21.15.27:0/372404169 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985c01f990 con 0x55fc427e1d40 2024-09-19T08:11:18.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.749+0000 7f984e7fc640 1 -- 172.21.15.27:0/372404169 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f985c003e50 con 0x55fc427e1d40 2024-09-19T08:11:18.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.749+0000 7f984e7fc640 1 -- 172.21.15.27:0/372404169 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985c0046e0 con 0x55fc427e1d40 2024-09-19T08:11:18.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.749+0000 7f986cf4c740 1 -- 172.21.15.27:0/372404169 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427e1d40 msgr2=0x55fc427f96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:18.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.749+0000 7f986cf4c740 1 --2- 172.21.15.27:0/372404169 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427e1d40 0x55fc427f96a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f985c012fa0 tx=0x7f985c01b000 comp rx=0 tx=0).stop 2024-09-19T08:11:18.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.750+0000 7f986cf4c740 1 -- 172.21.15.27:0/372404169 shutdown_connections 2024-09-19T08:11:18.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.750+0000 7f986cf4c740 1 --2- 172.21.15.27:0/372404169 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427e1d40 0x55fc427f96a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.750+0000 7f986cf4c740 1 --2- 172.21.15.27:0/372404169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427d7480 0x55fc427d2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.750+0000 7f986cf4c740 1 --2- 172.21.15.27:0/372404169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d6b60 0x55fc427df530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.750+0000 7f986cf4c740 1 -- 172.21.15.27:0/372404169 >> 172.21.15.27:0/372404169 conn(0x55fc427d30f0 msgr2=0x55fc427d1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:18.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.750+0000 7f986cf4c740 1 -- 172.21.15.27:0/372404169 shutdown_connections 2024-09-19T08:11:18.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.750+0000 7f986cf4c740 1 -- 172.21.15.27:0/372404169 wait complete. 2024-09-19T08:11:18.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.750+0000 7f986cf4c740 1 -- start start 2024-09-19T08:11:18.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.750+0000 7f986cf4c740 1 Processor -- start 2024-09-19T08:11:18.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.751+0000 7f986cf4c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d6b60 0x55fc427e5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:18.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.751+0000 7f986cf4c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427d7480 0x55fc427e6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:18.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.751+0000 7f986cf4c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427e1d40 0x55fc427e6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:18.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.751+0000 7f986890f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d6b60 0x55fc427e5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:18.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.751+0000 7f986890f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d6b60 0x55fc427e5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.27:37396/0 (socket says 172.21.15.27:37396) 2024-09-19T08:11:18.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.751+0000 7f986890f640 1 -- 172.21.15.27:0/3554232335 learned_addr learned my addr 172.21.15.27:0/3554232335 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:18.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.751+0000 7f9869110640 1 --2- 172.21.15.27:0/3554232335 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427e1d40 0x55fc427e6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:18.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.751+0000 7f986cf4c740 1 -- 172.21.15.27:0/3554232335 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f98641ac530 con 0x55fc427e1d40 2024-09-19T08:11:18.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.751+0000 7f986cf4c740 1 -- 172.21.15.27:0/3554232335 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f98641ad9a0 con 0x55fc427d6b60 2024-09-19T08:11:18.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.751+0000 7f986cf4c740 1 -- 172.21.15.27:0/3554232335 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f98641acc00 con 0x55fc427d7480 2024-09-19T08:11:18.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.751+0000 7f9863fff640 1 --2- 172.21.15.27:0/3554232335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427d7480 0x55fc427e6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:18.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.751+0000 7f986cf4c740 10 client.0 _ll_register_callbacks cb 0x7f9850032e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:18.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.752+0000 7f986890f640 1 -- 172.21.15.27:0/3554232335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427d7480 msgr2=0x55fc427e6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:18.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.752+0000 7f986890f640 1 --2- 172.21.15.27:0/3554232335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427d7480 0x55fc427e6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.752+0000 7f986890f640 1 -- 172.21.15.27:0/3554232335 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427e1d40 msgr2=0x55fc427e6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:18.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.752+0000 7f986890f640 1 --2- 172.21.15.27:0/3554232335 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427e1d40 0x55fc427e6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.752+0000 7f986890f640 1 -- 172.21.15.27:0/3554232335 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc4285b910 con 0x55fc427d6b60 2024-09-19T08:11:18.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.752+0000 7f9869110640 1 --2- 172.21.15.27:0/3554232335 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427e1d40 0x55fc427e6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:11:18.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.752+0000 7f9863fff640 1 --2- 172.21.15.27:0/3554232335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427d7480 0x55fc427e6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:11:18.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.752+0000 7f986890f640 1 --2- 172.21.15.27:0/3554232335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d6b60 0x55fc427e5cd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9858098af0 tx=0x7f98580984f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f79cbe194899cfff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:18.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.752+0000 7f9843fff640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:11:18.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.752+0000 7f9843fff640 1 -- 172.21.15.27:0/3554232335 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98580cde50 con 0x55fc427d6b60 2024-09-19T08:11:18.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.752+0000 7f986cf4c740 1 -- 172.21.15.27:0/3554232335 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f985c003e50 con 0x55fc427d6b60 2024-09-19T08:11:18.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.753+0000 7f9843fff640 1 -- 172.21.15.27:0/3554232335 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f98580bc110 con 0x55fc427d6b60 2024-09-19T08:11:18.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.753+0000 7f9843fff640 1 -- 172.21.15.27:0/3554232335 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f98580a4d90 con 0x55fc427d6b60 2024-09-19T08:11:18.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.753+0000 7f986cf4c740 10 client.24971 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:18.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.753+0000 7f986cf4c740 1 -- 172.21.15.27:0/3554232335 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55fc4285cc10 con 0x55fc427d6b60 2024-09-19T08:11:18.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.753+0000 7f9843fff640 1 -- 172.21.15.27:0/3554232335 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f985c003e50 con 0x55fc427d6b60 2024-09-19T08:11:18.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.753+0000 7f9843fff640 1 -- 172.21.15.27:0/3554232335 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9858098790 con 0x55fc427d6b60 2024-09-19T08:11:18.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.753+0000 7f986cf4c740 10 client.24971 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:18.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.753+0000 7f986cf4c740 10 client.24971 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:18.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.753+0000 7f986cf4c740 20 client.24971 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:18.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.753+0000 7f986cf4c740 1 --2- 172.21.15.27:0/3554232335 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55fc4285cf00 0x55fc4285f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:18.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.753+0000 7f986cf4c740 4 client.24971 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:11:18.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.753+0000 7f986cf4c740 1 -- 172.21.15.27:0/3554232335 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fc42743d00 con 0x55fc4285cf00 2024-09-19T08:11:18.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.754+0000 7f9863fff640 1 --2- 172.21.15.27:0/3554232335 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55fc4285cf00 0x55fc4285f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:18.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.754+0000 7f9863fff640 1 --2- 172.21.15.27:0/3554232335 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55fc4285cf00 0x55fc4285f2f0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cffe1ac7a72b3a01 server_cookie=972aff3f330dad76 in_seq=0 out_seq=0 2024-09-19T08:11:18.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.754+0000 7f9843fff640 10 client.24971 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:18.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.755+0000 7f9843fff640 1 -- 172.21.15.27:0/3554232335 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fc42743d00 con 0x55fc4285cf00 2024-09-19T08:11:18.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.755+0000 7f9843fff640 10 client.24971 handle_command_reply: tid=0 2024-09-19T08:11:18.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.755+0000 7f986cf4c740 1 client.24971 shutdown 2024-09-19T08:11:18.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.755+0000 7f986cf4c740 1 -- 172.21.15.27:0/3554232335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d6b60 msgr2=0x55fc427e5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:18.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.755+0000 7f986cf4c740 1 --2- 172.21.15.27:0/3554232335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d6b60 0x55fc427e5cd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9858098af0 tx=0x7f98580984f0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.756+0000 7f986cf4c740 1 -- 172.21.15.27:0/3554232335 shutdown_connections 2024-09-19T08:11:18.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.756+0000 7f986cf4c740 1 --2- 172.21.15.27:0/3554232335 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fc427e1d40 0x55fc427e6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.756+0000 7f986cf4c740 1 --2- 172.21.15.27:0/3554232335 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55fc4285cf00 0x55fc4285f2f0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.756+0000 7f9843fff640 0 client.24971 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:18.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.756+0000 7f986cf4c740 1 --2- 172.21.15.27:0/3554232335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc427d7480 0x55fc427e6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.756+0000 7f986cf4c740 1 --2- 172.21.15.27:0/3554232335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc427d6b60 0x55fc427e5cd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.756+0000 7f986cf4c740 1 -- 172.21.15.27:0/3554232335 >> 172.21.15.27:0/3554232335 conn(0x55fc427d30f0 msgr2=0x55fc427d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:18.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.756+0000 7f986cf4c740 1 -- 172.21.15.27:0/3554232335 shutdown_connections 2024-09-19T08:11:18.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.756+0000 7f986cf4c740 1 -- 172.21.15.27:0/3554232335 wait complete. 2024-09-19T08:11:18.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.757+0000 7f986cf4c740 20 client.24971 trim_cache size 0 max 16384 2024-09-19T08:11:18.761 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:11:18.761 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:11:18.761 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "a9e29e9e-1b1e-4e5f-9325-c9407352c154", 2024-09-19T08:11:18.761 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:11:18.761 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:11:18.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.757+0000 7f986ab73640 1 -- 172.21.15.27:0/3486264772 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f98540a34c0 msgr2=0x7f98540a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:18.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.757+0000 7f986ab73640 1 --2- 172.21.15.27:0/3486264772 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f98540a34c0 0x7f98540a5980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f985c0126a0 tx=0x7f985c012aa0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.757+0000 7f986ab73640 1 -- 172.21.15.27:0/3486264772 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9864100a80 msgr2=0x7f98641983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:18.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.757+0000 7f986ab73640 1 --2- 172.21.15.27:0/3486264772 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9864100a80 0x7f98641983f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f985800c920 tx=0x7f985800cde0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.758+0000 7f986ab73640 1 -- 172.21.15.27:0/3486264772 shutdown_connections 2024-09-19T08:11:18.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.758+0000 7f986ab73640 1 --2- 172.21.15.27:0/3486264772 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f98540a34c0 0x7f98540a5980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.758+0000 7f986ab73640 1 --2- 172.21.15.27:0/3486264772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9864106a80 0x7f986419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.758+0000 7f986ab73640 1 --2- 172.21.15.27:0/3486264772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9864101420 0x7f9864198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.758+0000 7f986ab73640 1 --2- 172.21.15.27:0/3486264772 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9864100a80 0x7f98641983f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:18.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.758+0000 7f986ab73640 1 -- 172.21.15.27:0/3486264772 >> 172.21.15.27:0/3486264772 conn(0x7f98640fc7a0 msgr2=0x7f98641047f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:18.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.758+0000 7f986ab73640 1 -- 172.21.15.27:0/3486264772 shutdown_connections 2024-09-19T08:11:18.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:18.758+0000 7f986ab73640 1 -- 172.21.15.27:0/3486264772 wait complete. 2024-09-19T08:11:18.763 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:19.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:18 smithi027 ceph-mon[31209]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 43 op/s 2024-09-19T08:11:19.029 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:18 smithi027 ceph-mon[31209]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:11:19.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:18 smithi155 ceph-mon[35362]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 43 op/s 2024-09-19T08:11:19.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:18 smithi155 ceph-mon[35362]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:11:19.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:18 smithi203 ceph-mon[35198]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 43 op/s 2024-09-19T08:11:19.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:18 smithi203 ceph-mon[35198]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:11:19.717 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:11:19.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.927+0000 7ff526d4f640 1 -- 172.21.15.27:0/1149193538 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff520102d90 msgr2=0x7ff520103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:19.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.927+0000 7ff526d4f640 1 --2- 172.21.15.27:0/1149193538 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff520102d90 0x7ff520103170 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff514009930 tx=0x7ff51402a420 comp rx=0 tx=0).stop 2024-09-19T08:11:19.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.927+0000 7ff526d4f640 1 -- 172.21.15.27:0/1149193538 shutdown_connections 2024-09-19T08:11:19.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.927+0000 7ff526d4f640 1 --2- 172.21.15.27:0/1149193538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff520108290 0x7ff52010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:19.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.927+0000 7ff526d4f640 1 --2- 172.21.15.27:0/1149193538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff520103740 0x7ff520107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:19.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.927+0000 7ff526d4f640 1 --2- 172.21.15.27:0/1149193538 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff520102d90 0x7ff520103170 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:19.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.927+0000 7ff526d4f640 1 -- 172.21.15.27:0/1149193538 >> 172.21.15.27:0/1149193538 conn(0x7ff5200fc7d0 msgr2=0x7ff5200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:19.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.927+0000 7ff526d4f640 1 -- 172.21.15.27:0/1149193538 shutdown_connections 2024-09-19T08:11:19.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.927+0000 7ff526d4f640 1 -- 172.21.15.27:0/1149193538 wait complete. 2024-09-19T08:11:19.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.928+0000 7ff526d4f640 1 Processor -- start 2024-09-19T08:11:19.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.928+0000 7ff526d4f640 1 -- start start 2024-09-19T08:11:19.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.928+0000 7ff526d4f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff520102d90 0x7ff5201985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:19.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.928+0000 7ff526d4f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff520103740 0x7ff520198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:19.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.928+0000 7ff526d4f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff520108290 0x7ff52019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:19.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.928+0000 7ff526d4f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff5201120d0 con 0x7ff520103740 2024-09-19T08:11:19.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.928+0000 7ff526d4f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff520111f50 con 0x7ff520108290 2024-09-19T08:11:19.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.928+0000 7ff526d4f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff520112250 con 0x7ff520102d90 2024-09-19T08:11:19.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.928+0000 7ff51ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff520103740 0x7ff520198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:19.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.928+0000 7ff51ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff520103740 0x7ff520198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45378/0 (socket says 172.21.15.27:45378) 2024-09-19T08:11:19.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.928+0000 7ff51ffff640 1 -- 172.21.15.27:0/2877193154 learned_addr learned my addr 172.21.15.27:0/2877193154 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:19.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.928+0000 7ff5252ec640 1 --2- 172.21.15.27:0/2877193154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff520108290 0x7ff52019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:19.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.928+0000 7ff524aeb640 1 --2- 172.21.15.27:0/2877193154 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff520102d90 0x7ff5201985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:19.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.928+0000 7ff51ffff640 1 -- 172.21.15.27:0/2877193154 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff520102d90 msgr2=0x7ff5201985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:19.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.928+0000 7ff51ffff640 1 --2- 172.21.15.27:0/2877193154 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff520102d90 0x7ff5201985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:19.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.929+0000 7ff51ffff640 1 -- 172.21.15.27:0/2877193154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff520108290 msgr2=0x7ff52019cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:19.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.929+0000 7ff51ffff640 1 --2- 172.21.15.27:0/2877193154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff520108290 0x7ff52019cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:19.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.929+0000 7ff51ffff640 1 -- 172.21.15.27:0/2877193154 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52019d580 con 0x7ff520103740 2024-09-19T08:11:19.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.929+0000 7ff524aeb640 1 --2- 172.21.15.27:0/2877193154 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff520102d90 0x7ff5201985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:19.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.929+0000 7ff51ffff640 1 --2- 172.21.15.27:0/2877193154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff520103740 0x7ff520198b10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff50c00c970 tx=0x7ff50c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:19.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.929+0000 7ff51dffb640 1 -- 172.21.15.27:0/2877193154 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c007bb0 con 0x7ff520103740 2024-09-19T08:11:19.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.929+0000 7ff526d4f640 1 -- 172.21.15.27:0/2877193154 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff52019d870 con 0x7ff520103740 2024-09-19T08:11:19.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.929+0000 7ff51dffb640 1 -- 172.21.15.27:0/2877193154 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff50c007d50 con 0x7ff520103740 2024-09-19T08:11:19.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.929+0000 7ff51dffb640 1 -- 172.21.15.27:0/2877193154 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c00f450 con 0x7ff520103740 2024-09-19T08:11:19.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.929+0000 7ff526d4f640 1 -- 172.21.15.27:0/2877193154 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5201a5150 con 0x7ff520103740 2024-09-19T08:11:19.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.930+0000 7ff526d4f640 1 -- 172.21.15.27:0/2877193154 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff52006a7f0 con 0x7ff520103740 2024-09-19T08:11:19.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.931+0000 7ff51dffb640 1 -- 172.21.15.27:0/2877193154 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7ff50c0046c0 con 0x7ff520103740 2024-09-19T08:11:19.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.932+0000 7ff51dffb640 1 --2- 172.21.15.27:0/2877193154 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff5100a34c0 0x7ff5100a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:19.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.932+0000 7ff524aeb640 1 --2- 172.21.15.27:0/2877193154 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff5100a34c0 0x7ff5100a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:19.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.932+0000 7ff51dffb640 1 -- 172.21.15.27:0/2877193154 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff50c0cfe20 con 0x7ff520103740 2024-09-19T08:11:19.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.933+0000 7ff524aeb640 1 --2- 172.21.15.27:0/2877193154 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff5100a34c0 0x7ff5100a5980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff514000c00 tx=0x7ff514005a20 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:19.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:19.939+0000 7ff51dffb640 1 -- 172.21.15.27:0/2877193154 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff50c014030 con 0x7ff520103740 2024-09-19T08:11:19.940 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:19 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:11:19.940 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:19 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:19.940 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:19 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:11:19.940 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:19 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:20.025 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:20.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:20.165+0000 7ff526d4f640 1 -- 172.21.15.27:0/2877193154 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff520103170 con 0x7ff520103740 2024-09-19T08:11:20.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:20.166+0000 7ff51dffb640 1 -- 172.21.15.27:0/2877193154 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7ff520103170 con 0x7ff520103740 2024-09-19T08:11:20.166 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:11:20.167 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:11:20.167 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:11:20.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:20.168+0000 7ff526d4f640 1 -- 172.21.15.27:0/2877193154 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff5100a34c0 msgr2=0x7ff5100a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:20.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:20.168+0000 7ff526d4f640 1 --2- 172.21.15.27:0/2877193154 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff5100a34c0 0x7ff5100a5980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff514000c00 tx=0x7ff514005a20 comp rx=0 tx=0).stop 2024-09-19T08:11:20.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:20.168+0000 7ff526d4f640 1 -- 172.21.15.27:0/2877193154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff520103740 msgr2=0x7ff520198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:20.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:20.168+0000 7ff526d4f640 1 --2- 172.21.15.27:0/2877193154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff520103740 0x7ff520198b10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff50c00c970 tx=0x7ff50c00ce30 comp rx=0 tx=0).stop 2024-09-19T08:11:20.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:20.168+0000 7ff526d4f640 1 -- 172.21.15.27:0/2877193154 shutdown_connections 2024-09-19T08:11:20.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:20.168+0000 7ff526d4f640 1 --2- 172.21.15.27:0/2877193154 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff5100a34c0 0x7ff5100a5980 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:20.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:20.168+0000 7ff526d4f640 1 --2- 172.21.15.27:0/2877193154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff520108290 0x7ff52019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:20.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:20.168+0000 7ff526d4f640 1 --2- 172.21.15.27:0/2877193154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff520103740 0x7ff520198b10 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:20.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:20.168+0000 7ff526d4f640 1 --2- 172.21.15.27:0/2877193154 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff520102d90 0x7ff5201985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:20.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:20.168+0000 7ff526d4f640 1 -- 172.21.15.27:0/2877193154 >> 172.21.15.27:0/2877193154 conn(0x7ff5200fc7d0 msgr2=0x7ff520105d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:20.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:20.168+0000 7ff526d4f640 1 -- 172.21.15.27:0/2877193154 shutdown_connections 2024-09-19T08:11:20.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:20.168+0000 7ff526d4f640 1 -- 172.21.15.27:0/2877193154 wait complete. 2024-09-19T08:11:20.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:19 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:11:20.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:19 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:20.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:19 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:11:20.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:19 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:20.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:19 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:11:20.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:19 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:20.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:19 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:11:20.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:19 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:20.986 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:11:21.175 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:20 smithi027 ceph-mon[31209]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-19T08:11:21.175 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:20 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2877193154' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:21.175 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:20 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:11:21.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:20 smithi155 ceph-mon[35362]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-19T08:11:21.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:20 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2877193154' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:21.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:20 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:11:21.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:20 smithi203 ceph-mon[35198]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-19T08:11:21.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:20 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2877193154' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:21.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:20 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:11:21.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.258+0000 7fca2efb7640 1 -- 172.21.15.27:0/3314347808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca28102df0 msgr2=0x7fca281031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:21.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.258+0000 7fca2efb7640 1 --2- 172.21.15.27:0/3314347808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca28102df0 0x7fca281031d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009900 tx=0x7fca1c02a410 comp rx=0 tx=0).stop 2024-09-19T08:11:21.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.258+0000 7fca2efb7640 1 -- 172.21.15.27:0/3314347808 shutdown_connections 2024-09-19T08:11:21.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.258+0000 7fca2efb7640 1 --2- 172.21.15.27:0/3314347808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca2810c2f0 0x7fca2810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.258+0000 7fca2efb7640 1 --2- 172.21.15.27:0/3314347808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca281037a0 0x7fca2810bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.258+0000 7fca2efb7640 1 --2- 172.21.15.27:0/3314347808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca28102df0 0x7fca281031d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.258+0000 7fca2efb7640 1 -- 172.21.15.27:0/3314347808 >> 172.21.15.27:0/3314347808 conn(0x7fca280fc7d0 msgr2=0x7fca280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:21.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.258+0000 7fca2efb7640 1 -- 172.21.15.27:0/3314347808 shutdown_connections 2024-09-19T08:11:21.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.258+0000 7fca2efb7640 1 -- 172.21.15.27:0/3314347808 wait complete. 2024-09-19T08:11:21.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.259+0000 7fca2efb7640 1 Processor -- start 2024-09-19T08:11:21.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.259+0000 7fca2efb7640 1 -- start start 2024-09-19T08:11:21.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.259+0000 7fca2efb7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca28102df0 0x7fca281986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:21.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.259+0000 7fca2efb7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca281037a0 0x7fca28198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:21.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.259+0000 7fca2efb7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca2810c2f0 0x7fca2819cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:21.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.259+0000 7fca2efb7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fca281121d0 con 0x7fca28102df0 2024-09-19T08:11:21.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.259+0000 7fca2efb7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fca28112050 con 0x7fca2810c2f0 2024-09-19T08:11:21.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.259+0000 7fca2efb7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fca28112350 con 0x7fca281037a0 2024-09-19T08:11:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.259+0000 7fca2cd53640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca28102df0 0x7fca281986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.259+0000 7fca2cd53640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca28102df0 0x7fca281986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46016/0 (socket says 172.21.15.27:46016) 2024-09-19T08:11:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.260+0000 7fca2cd53640 1 -- 172.21.15.27:0/3810041664 learned_addr learned my addr 172.21.15.27:0/3810041664 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.260+0000 7fca27fff640 1 --2- 172.21.15.27:0/3810041664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca281037a0 0x7fca28198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.260+0000 7fca2cd53640 1 -- 172.21.15.27:0/3810041664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca281037a0 msgr2=0x7fca28198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.260+0000 7fca2d554640 1 --2- 172.21.15.27:0/3810041664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca2810c2f0 0x7fca2819cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.260+0000 7fca2cd53640 1 --2- 172.21.15.27:0/3810041664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca281037a0 0x7fca28198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.260+0000 7fca2cd53640 1 -- 172.21.15.27:0/3810041664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca2810c2f0 msgr2=0x7fca2819cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.260+0000 7fca2cd53640 1 --2- 172.21.15.27:0/3810041664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca2810c2f0 0x7fca2819cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.260+0000 7fca2cd53640 1 -- 172.21.15.27:0/3810041664 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2819d680 con 0x7fca28102df0 2024-09-19T08:11:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.260+0000 7fca2d554640 1 --2- 172.21.15.27:0/3810041664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca2810c2f0 0x7fca2819cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:11:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.260+0000 7fca2cd53640 1 --2- 172.21.15.27:0/3810041664 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca28102df0 0x7fca281986d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fca1c005ab0 tx=0x7fca1c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:21.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.260+0000 7fca25ffb640 1 -- 172.21.15.27:0/3810041664 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c03f030 con 0x7fca28102df0 2024-09-19T08:11:21.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.260+0000 7fca25ffb640 1 -- 172.21.15.27:0/3810041664 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca1c003ce0 con 0x7fca28102df0 2024-09-19T08:11:21.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.260+0000 7fca2efb7640 1 -- 172.21.15.27:0/3810041664 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca2819d910 con 0x7fca28102df0 2024-09-19T08:11:21.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.260+0000 7fca25ffb640 1 -- 172.21.15.27:0/3810041664 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c035070 con 0x7fca28102df0 2024-09-19T08:11:21.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.261+0000 7fca2efb7640 1 -- 172.21.15.27:0/3810041664 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca281a5250 con 0x7fca28102df0 2024-09-19T08:11:21.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.263+0000 7fca25ffb640 1 -- 172.21.15.27:0/3810041664 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fca1c042030 con 0x7fca28102df0 2024-09-19T08:11:21.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.263+0000 7fca31390740 1 Processor -- start 2024-09-19T08:11:21.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.263+0000 7fca31390740 1 -- start start 2024-09-19T08:11:21.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.263+0000 7fca31390740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf0334a0 0x55efdf033880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:21.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.263+0000 7fca31390740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efdf033dc0 0x55efdf03e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:21.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.263+0000 7fca31390740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf03e680 0x55efdf040a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:21.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.263+0000 7fca31390740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55efdef992e0 con 0x55efdf0334a0 2024-09-19T08:11:21.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.263+0000 7fca31390740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55efdef40ce0 con 0x55efdf03e680 2024-09-19T08:11:21.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.263+0000 7fca31390740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55efdef952a0 con 0x55efdf033dc0 2024-09-19T08:11:21.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.263+0000 7fca25ffb640 1 --2- 172.21.15.27:0/3810041664 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fca180a34c0 0x7fca180a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:21.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.263+0000 7fca2d554640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf0334a0 0x55efdf033880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:21.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.264+0000 7fca2d554640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf0334a0 0x55efdf033880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46028/0 (socket says 172.21.15.27:46028) 2024-09-19T08:11:21.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.264+0000 7fca2d554640 1 -- 172.21.15.27:0/106781972 learned_addr learned my addr 172.21.15.27:0/106781972 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:21.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.264+0000 7fca2d554640 1 --2- 172.21.15.27:0/3810041664 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fca180a34c0 0x7fca180a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:21.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.264+0000 7fca2cd53640 1 --2- 172.21.15.27:0/106781972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efdf033dc0 0x55efdf03e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:21.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.264+0000 7fca27fff640 1 --2- 172.21.15.27:0/106781972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf03e680 0x55efdf040a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:21.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.264+0000 7fca25ffb640 1 -- 172.21.15.27:0/3810041664 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fca1c0f0750 con 0x7fca28102df0 2024-09-19T08:11:21.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.264+0000 7fca2d554640 1 -- 172.21.15.27:0/106781972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efdf033dc0 msgr2=0x55efdf03e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:21.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.264+0000 7fca2d554640 1 --2- 172.21.15.27:0/106781972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efdf033dc0 0x55efdf03e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.264+0000 7fca2d554640 1 -- 172.21.15.27:0/106781972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf03e680 msgr2=0x55efdf040a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.264+0000 7fca2d554640 1 --2- 172.21.15.27:0/106781972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf03e680 0x55efdf040a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.264+0000 7fca2d554640 1 -- 172.21.15.27:0/106781972 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efdef25440 con 0x55efdf0334a0 2024-09-19T08:11:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.264+0000 7fca2d554640 1 --2- 172.21.15.27:0/106781972 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf0334a0 0x55efdf033880 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fca2000ed30 tx=0x7fca2000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7500f52d4ff64c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.264+0000 7fca2d554640 1 --2- 172.21.15.27:0/3810041664 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fca180a34c0 0x7fca180a5980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fca2000cc40 tx=0x7fca2001d000 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.264+0000 7fca12ffd640 1 -- 172.21.15.27:0/106781972 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca20023610 con 0x55efdf0334a0 2024-09-19T08:11:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.264+0000 7fca12ffd640 1 -- 172.21.15.27:0/106781972 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca20028070 con 0x55efdf0334a0 2024-09-19T08:11:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.264+0000 7fca12ffd640 1 -- 172.21.15.27:0/106781972 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2000a680 con 0x55efdf0334a0 2024-09-19T08:11:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.265+0000 7fca31390740 1 -- 172.21.15.27:0/106781972 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf0334a0 msgr2=0x55efdf033880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.265+0000 7fca31390740 1 --2- 172.21.15.27:0/106781972 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf0334a0 0x55efdf033880 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fca2000ed30 tx=0x7fca2000c740 comp rx=0 tx=0).stop 2024-09-19T08:11:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.265+0000 7fca31390740 1 -- 172.21.15.27:0/106781972 shutdown_connections 2024-09-19T08:11:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.265+0000 7fca31390740 1 --2- 172.21.15.27:0/106781972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf03e680 0x55efdf040a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.265+0000 7fca31390740 1 --2- 172.21.15.27:0/106781972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efdf033dc0 0x55efdf03e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.265+0000 7fca31390740 1 --2- 172.21.15.27:0/106781972 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf0334a0 0x55efdf033880 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.265+0000 7fca31390740 1 -- 172.21.15.27:0/106781972 >> 172.21.15.27:0/106781972 conn(0x55efdf02fa30 msgr2=0x55efdf02fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:21.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.265+0000 7fca31390740 1 -- 172.21.15.27:0/106781972 shutdown_connections 2024-09-19T08:11:21.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.265+0000 7fca31390740 1 -- 172.21.15.27:0/106781972 wait complete. 2024-09-19T08:11:21.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.266+0000 7fca31390740 1 -- start start 2024-09-19T08:11:21.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.266+0000 7fca31390740 1 Processor -- start 2024-09-19T08:11:21.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.266+0000 7fca31390740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf0334a0 0x55efdf03e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:21.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.266+0000 7fca31390740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efdf033dc0 0x55efdf03b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:21.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.266+0000 7fca31390740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf03e680 0x55efdf03b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:21.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.266+0000 7fca31390740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55efdf041250 con 0x55efdf03e680 2024-09-19T08:11:21.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.266+0000 7fca31390740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55efdef54050 con 0x55efdf0334a0 2024-09-19T08:11:21.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.266+0000 7fca31390740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55efdf0413d0 con 0x55efdf033dc0 2024-09-19T08:11:21.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.266+0000 7fca31390740 10 client.0 _ll_register_callbacks cb 0x55efdef94160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:21.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.266+0000 7fca2d554640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf03e680 0x55efdf03b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:21.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.266+0000 7fca2d554640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf03e680 0x55efdf03b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46030/0 (socket says 172.21.15.27:46030) 2024-09-19T08:11:21.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.266+0000 7fca2d554640 1 -- 172.21.15.27:0/1292947722 learned_addr learned my addr 172.21.15.27:0/1292947722 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:21.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.266+0000 7fca2cd53640 1 --2- 172.21.15.27:0/1292947722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf0334a0 0x55efdf03e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:21.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.266+0000 7fca27fff640 1 --2- 172.21.15.27:0/1292947722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efdf033dc0 0x55efdf03b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:21.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.267+0000 7fca2d554640 1 -- 172.21.15.27:0/1292947722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efdf033dc0 msgr2=0x55efdf03b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:21.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.267+0000 7fca2d554640 1 --2- 172.21.15.27:0/1292947722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efdf033dc0 0x55efdf03b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.267+0000 7fca2d554640 1 -- 172.21.15.27:0/1292947722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf0334a0 msgr2=0x55efdf03e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.267+0000 7fca2d554640 1 --2- 172.21.15.27:0/1292947722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf0334a0 0x55efdf03e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.267+0000 7fca2d554640 1 -- 172.21.15.27:0/1292947722 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efded0a3c0 con 0x55efdf03e680 2024-09-19T08:11:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.267+0000 7fca2d554640 1 --2- 172.21.15.27:0/1292947722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf03e680 0x55efdf03b830 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fca20009e60 tx=0x7fca2000ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f382b328481a35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.267+0000 7fca07fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.267+0000 7fca07fff640 1 -- 172.21.15.27:0/1292947722 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca20030070 con 0x55efdf03e680 2024-09-19T08:11:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.267+0000 7fca31390740 1 -- 172.21.15.27:0/1292947722 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca20028070 con 0x55efdf03e680 2024-09-19T08:11:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.267+0000 7fca07fff640 1 -- 172.21.15.27:0/1292947722 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fca20023820 con 0x55efdf03e680 2024-09-19T08:11:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.267+0000 7fca07fff640 1 -- 172.21.15.27:0/1292947722 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fca2000a730 con 0x55efdf03e680 2024-09-19T08:11:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.267+0000 7fca31390740 10 client.15357 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.267+0000 7fca31390740 1 -- 172.21.15.27:0/1292947722 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55efdf04cc40 con 0x55efdf03e680 2024-09-19T08:11:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.267+0000 7fca07fff640 1 -- 172.21.15.27:0/1292947722 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca20028070 con 0x55efdf03e680 2024-09-19T08:11:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.267+0000 7fca07fff640 1 -- 172.21.15.27:0/1292947722 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fca2002c900 con 0x55efdf03e680 2024-09-19T08:11:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.268+0000 7fca31390740 10 client.15357 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.268+0000 7fca31390740 10 client.15357 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.268+0000 7fca31390740 20 client.15357 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.268+0000 7fca31390740 1 --2- 172.21.15.27:0/1292947722 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55efdf04e050 0x55efdf050440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.268+0000 7fca31390740 4 client.15357 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:11:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.268+0000 7fca31390740 1 -- 172.21.15.27:0/1292947722 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efdefa6850 con 0x55efdf04e050 2024-09-19T08:11:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.268+0000 7fca2cd53640 1 --2- 172.21.15.27:0/1292947722 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55efdf04e050 0x55efdf050440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.268+0000 7fca2cd53640 1 --2- 172.21.15.27:0/1292947722 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55efdf04e050 0x55efdf050440 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1d89fa982554b3c server_cookie=fb4a1ed8913987fa in_seq=0 out_seq=0 2024-09-19T08:11:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.268+0000 7fca07fff640 10 client.15357 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.269+0000 7fca07fff640 1 -- 172.21.15.27:0/1292947722 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55efdefa6850 con 0x55efdf04e050 2024-09-19T08:11:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.269+0000 7fca07fff640 10 client.15357 handle_command_reply: tid=0 2024-09-19T08:11:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.269+0000 7fca31390740 1 client.15357 shutdown 2024-09-19T08:11:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.269+0000 7fca31390740 1 -- 172.21.15.27:0/1292947722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf03e680 msgr2=0x55efdf03b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.269+0000 7fca31390740 1 --2- 172.21.15.27:0/1292947722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf03e680 0x55efdf03b830 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fca20009e60 tx=0x7fca2000ac30 comp rx=0 tx=0).stop 2024-09-19T08:11:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.269+0000 7fca31390740 1 -- 172.21.15.27:0/1292947722 shutdown_connections 2024-09-19T08:11:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.269+0000 7fca31390740 1 --2- 172.21.15.27:0/1292947722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf03e680 0x55efdf03b830 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.269+0000 7fca31390740 1 --2- 172.21.15.27:0/1292947722 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55efdf04e050 0x55efdf050440 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.269+0000 7fca31390740 1 --2- 172.21.15.27:0/1292947722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efdf033dc0 0x55efdf03b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.269+0000 7fca31390740 1 --2- 172.21.15.27:0/1292947722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf0334a0 0x55efdf03e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.269+0000 7fca31390740 1 -- 172.21.15.27:0/1292947722 >> 172.21.15.27:0/1292947722 conn(0x55efdf02fa30 msgr2=0x55efdf035710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.269+0000 7fca07fff640 0 client.15357 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.269+0000 7fca31390740 1 -- 172.21.15.27:0/1292947722 shutdown_connections 2024-09-19T08:11:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.269+0000 7fca31390740 1 -- 172.21.15.27:0/1292947722 wait complete. 2024-09-19T08:11:21.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.270+0000 7fca31390740 20 client.15357 trim_cache size 0 max 16384 2024-09-19T08:11:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.287+0000 7fca31390740 1 Processor -- start 2024-09-19T08:11:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.287+0000 7fca31390740 1 -- start start 2024-09-19T08:11:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.288+0000 7fca31390740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf0334a0 0x55efdf055af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.288+0000 7fca31390740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efdf033dc0 0x55efdf056030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.288+0000 7fca31390740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf03e680 0x55efdf038510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.288+0000 7fca31390740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fca281a9670 con 0x55efdf03e680 2024-09-19T08:11:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.288+0000 7fca31390740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fca281abef0 con 0x55efdf0334a0 2024-09-19T08:11:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.288+0000 7fca31390740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fca281a9ce0 con 0x55efdf033dc0 2024-09-19T08:11:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.288+0000 7fca2d554640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf03e680 0x55efdf038510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.288+0000 7fca2d554640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf03e680 0x55efdf038510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46036/0 (socket says 172.21.15.27:46036) 2024-09-19T08:11:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.288+0000 7fca2d554640 1 -- 172.21.15.27:0/1040820351 learned_addr learned my addr 172.21.15.27:0/1040820351 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:21.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.288+0000 7fca27fff640 1 --2- 172.21.15.27:0/1040820351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efdf033dc0 0x55efdf056030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:21.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.288+0000 7fca2cd53640 1 --2- 172.21.15.27:0/1040820351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf0334a0 0x55efdf055af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:21.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.288+0000 7fca2d554640 1 -- 172.21.15.27:0/1040820351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efdf033dc0 msgr2=0x55efdf056030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:21.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.288+0000 7fca2d554640 1 --2- 172.21.15.27:0/1040820351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efdf033dc0 0x55efdf056030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.288+0000 7fca2d554640 1 -- 172.21.15.27:0/1040820351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf0334a0 msgr2=0x55efdf055af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:21.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.288+0000 7fca2d554640 1 --2- 172.21.15.27:0/1040820351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf0334a0 0x55efdf055af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.288+0000 7fca2d554640 1 -- 172.21.15.27:0/1040820351 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efdf033bf0 con 0x55efdf03e680 2024-09-19T08:11:21.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.288+0000 7fca2cd53640 1 --2- 172.21.15.27:0/1040820351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf0334a0 0x55efdf055af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:11:21.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.288+0000 7fca2d554640 1 --2- 172.21.15.27:0/1040820351 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf03e680 0x55efdf038510 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fca20004a80 tx=0x7fca2000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9e38091c6a22ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:21.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.289+0000 7fca127fc640 1 -- 172.21.15.27:0/1040820351 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca20009e90 con 0x55efdf03e680 2024-09-19T08:11:21.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.289+0000 7fca127fc640 1 -- 172.21.15.27:0/1040820351 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca20028070 con 0x55efdf03e680 2024-09-19T08:11:21.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.289+0000 7fca127fc640 1 -- 172.21.15.27:0/1040820351 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2000a5d0 con 0x55efdf03e680 2024-09-19T08:11:21.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.289+0000 7fca31390740 1 -- 172.21.15.27:0/1040820351 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf03e680 msgr2=0x55efdf038510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:21.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.289+0000 7fca31390740 1 --2- 172.21.15.27:0/1040820351 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf03e680 0x55efdf038510 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fca20004a80 tx=0x7fca2000c740 comp rx=0 tx=0).stop 2024-09-19T08:11:21.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.289+0000 7fca31390740 1 -- 172.21.15.27:0/1040820351 shutdown_connections 2024-09-19T08:11:21.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.289+0000 7fca31390740 1 --2- 172.21.15.27:0/1040820351 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf03e680 0x55efdf038510 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.289+0000 7fca31390740 1 --2- 172.21.15.27:0/1040820351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efdf033dc0 0x55efdf056030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.289+0000 7fca31390740 1 --2- 172.21.15.27:0/1040820351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf0334a0 0x55efdf055af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.289+0000 7fca31390740 1 -- 172.21.15.27:0/1040820351 >> 172.21.15.27:0/1040820351 conn(0x55efdf02fa30 msgr2=0x55efdf03d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:21.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.289+0000 7fca31390740 1 -- 172.21.15.27:0/1040820351 shutdown_connections 2024-09-19T08:11:21.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.290+0000 7fca31390740 1 -- 172.21.15.27:0/1040820351 wait complete. 2024-09-19T08:11:21.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.290+0000 7fca31390740 1 -- start start 2024-09-19T08:11:21.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.290+0000 7fca31390740 1 Processor -- start 2024-09-19T08:11:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.290+0000 7fca31390740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf0334a0 0x55efdf046a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.290+0000 7fca31390740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efdf033dc0 0x55efdf043d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.290+0000 7fca31390740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf03e680 0x55efdf0442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.290+0000 7fca31390740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fca281aa3b0 con 0x55efdf0334a0 2024-09-19T08:11:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.290+0000 7fca31390740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fca281ab820 con 0x55efdf03e680 2024-09-19T08:11:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.290+0000 7fca31390740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fca281aaa80 con 0x55efdf033dc0 2024-09-19T08:11:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.291+0000 7fca31390740 10 client.0 _ll_register_callbacks cb 0x7fca2000eb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.291+0000 7fca2cd53640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf0334a0 0x55efdf046a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.291+0000 7fca2cd53640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf0334a0 0x55efdf046a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46040/0 (socket says 172.21.15.27:46040) 2024-09-19T08:11:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.291+0000 7fca2cd53640 1 -- 172.21.15.27:0/3200986690 learned_addr learned my addr 172.21.15.27:0/3200986690 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.291+0000 7fca27fff640 1 --2- 172.21.15.27:0/3200986690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efdf033dc0 0x55efdf043d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.291+0000 7fca2d554640 1 --2- 172.21.15.27:0/3200986690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf03e680 0x55efdf0442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.291+0000 7fca2cd53640 1 -- 172.21.15.27:0/3200986690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efdf033dc0 msgr2=0x55efdf043d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:21.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.291+0000 7fca2cd53640 1 --2- 172.21.15.27:0/3200986690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efdf033dc0 0x55efdf043d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.291+0000 7fca2cd53640 1 -- 172.21.15.27:0/3200986690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf03e680 msgr2=0x55efdf0442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:21.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.291+0000 7fca2cd53640 1 --2- 172.21.15.27:0/3200986690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf03e680 0x55efdf0442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.291+0000 7fca2cd53640 1 -- 172.21.15.27:0/3200986690 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efdf0447f0 con 0x55efdf0334a0 2024-09-19T08:11:21.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.291+0000 7fca2d554640 1 --2- 172.21.15.27:0/3200986690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf03e680 0x55efdf0442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:11:21.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.291+0000 7fca2cd53640 1 --2- 172.21.15.27:0/3200986690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf0334a0 0x55efdf046a20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009320 tx=0x7fca1c03b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b40f915c03eb061 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:21.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.291+0000 7fca07fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:21.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.291+0000 7fca07fff640 1 -- 172.21.15.27:0/3200986690 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c049040 con 0x55efdf0334a0 2024-09-19T08:11:21.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.292+0000 7fca07fff640 1 -- 172.21.15.27:0/3200986690 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fca1c0b8f80 con 0x55efdf0334a0 2024-09-19T08:11:21.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.292+0000 7fca31390740 1 -- 172.21.15.27:0/3200986690 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca20028070 con 0x55efdf0334a0 2024-09-19T08:11:21.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.292+0000 7fca07fff640 1 -- 172.21.15.27:0/3200986690 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fca1c0a70b0 con 0x55efdf0334a0 2024-09-19T08:11:21.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.292+0000 7fca31390740 10 client.15363 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:21.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.292+0000 7fca31390740 1 -- 172.21.15.27:0/3200986690 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55efdf0c0f70 con 0x55efdf0334a0 2024-09-19T08:11:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.292+0000 7fca07fff640 1 -- 172.21.15.27:0/3200986690 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca20028070 con 0x55efdf0334a0 2024-09-19T08:11:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.292+0000 7fca07fff640 1 -- 172.21.15.27:0/3200986690 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fca1c03b460 con 0x55efdf0334a0 2024-09-19T08:11:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.292+0000 7fca31390740 10 client.15363 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.292+0000 7fca31390740 10 client.15363 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.292+0000 7fca31390740 20 client.15363 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.292+0000 7fca31390740 1 --2- 172.21.15.27:0/3200986690 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55efdf0c1690 0x55efdf0c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.292+0000 7fca31390740 4 client.15363 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:11:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.292+0000 7fca31390740 1 -- 172.21.15.27:0/3200986690 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55efdefa0d60 con 0x55efdf0c1690 2024-09-19T08:11:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.293+0000 7fca27fff640 1 --2- 172.21.15.27:0/3200986690 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55efdf0c1690 0x55efdf0c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:21.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.293+0000 7fca27fff640 1 --2- 172.21.15.27:0/3200986690 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55efdf0c1690 0x55efdf0c3a80 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e311382372b79c9 server_cookie=dd23809c9716f7b5 in_seq=0 out_seq=0 2024-09-19T08:11:21.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.293+0000 7fca07fff640 10 client.15363 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.294+0000 7fca07fff640 1 -- 172.21.15.27:0/3200986690 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55efdefa0d60 con 0x55efdf0c1690 2024-09-19T08:11:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.294+0000 7fca07fff640 10 client.15363 handle_command_reply: tid=0 2024-09-19T08:11:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.294+0000 7fca31390740 1 client.15363 shutdown 2024-09-19T08:11:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.294+0000 7fca31390740 1 -- 172.21.15.27:0/3200986690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf0334a0 msgr2=0x55efdf046a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.294+0000 7fca31390740 1 --2- 172.21.15.27:0/3200986690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf0334a0 0x55efdf046a20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009320 tx=0x7fca1c03b800 comp rx=0 tx=0).stop 2024-09-19T08:11:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.294+0000 7fca31390740 1 -- 172.21.15.27:0/3200986690 shutdown_connections 2024-09-19T08:11:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.294+0000 7fca31390740 1 --2- 172.21.15.27:0/3200986690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55efdf03e680 0x55efdf0442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.294+0000 7fca31390740 1 --2- 172.21.15.27:0/3200986690 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55efdf0c1690 0x55efdf0c3a80 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.294+0000 7fca31390740 1 --2- 172.21.15.27:0/3200986690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efdf033dc0 0x55efdf043d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.294+0000 7fca31390740 1 --2- 172.21.15.27:0/3200986690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efdf0334a0 0x55efdf046a20 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.294+0000 7fca07fff640 0 client.15363 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.294+0000 7fca31390740 1 -- 172.21.15.27:0/3200986690 >> 172.21.15.27:0/3200986690 conn(0x55efdf02fa30 msgr2=0x55efdf02e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.294+0000 7fca31390740 1 -- 172.21.15.27:0/3200986690 shutdown_connections 2024-09-19T08:11:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.294+0000 7fca31390740 1 -- 172.21.15.27:0/3200986690 wait complete. 2024-09-19T08:11:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.294+0000 7fca31390740 20 client.15363 trim_cache size 0 max 16384 2024-09-19T08:11:21.300 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:11:21.300 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:11:21.300 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:11:21.300 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:11:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.295+0000 7fca2efb7640 1 -- 172.21.15.27:0/3810041664 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fca180a34c0 msgr2=0x7fca180a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.295+0000 7fca2efb7640 1 --2- 172.21.15.27:0/3810041664 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fca180a34c0 0x7fca180a5980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fca2000cc40 tx=0x7fca2001d000 comp rx=0 tx=0).stop 2024-09-19T08:11:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.295+0000 7fca2efb7640 1 -- 172.21.15.27:0/3810041664 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca28102df0 msgr2=0x7fca281986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.295+0000 7fca2efb7640 1 --2- 172.21.15.27:0/3810041664 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca28102df0 0x7fca281986d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fca1c005ab0 tx=0x7fca1c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.295+0000 7fca2efb7640 1 -- 172.21.15.27:0/3810041664 shutdown_connections 2024-09-19T08:11:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.295+0000 7fca2efb7640 1 --2- 172.21.15.27:0/3810041664 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fca180a34c0 0x7fca180a5980 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.295+0000 7fca2efb7640 1 --2- 172.21.15.27:0/3810041664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca2810c2f0 0x7fca2819cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.295+0000 7fca2efb7640 1 --2- 172.21.15.27:0/3810041664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca281037a0 0x7fca28198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.295+0000 7fca2efb7640 1 --2- 172.21.15.27:0/3810041664 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca28102df0 0x7fca281986d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.295+0000 7fca2efb7640 1 -- 172.21.15.27:0/3810041664 >> 172.21.15.27:0/3810041664 conn(0x7fca280fc7d0 msgr2=0x7fca280fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.295+0000 7fca2efb7640 1 -- 172.21.15.27:0/3810041664 shutdown_connections 2024-09-19T08:11:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:21.295+0000 7fca2efb7640 1 -- 172.21.15.27:0/3810041664 wait complete. 2024-09-19T08:11:21.999 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:11:22.000 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:11:22.015 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:22.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.557+0000 7f2d7a534640 1 -- 172.21.15.27:0/1149707984 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d74101de0 msgr2=0x7f2d741021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:22.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.557+0000 7f2d7a534640 1 --2- 172.21.15.27:0/1149707984 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d74101de0 0x7f2d741021c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009900 tx=0x7f2d6402a410 comp rx=0 tx=0).stop 2024-09-19T08:11:22.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.557+0000 7f2d7a534640 1 -- 172.21.15.27:0/1149707984 shutdown_connections 2024-09-19T08:11:22.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.557+0000 7f2d7a534640 1 --2- 172.21.15.27:0/1149707984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d74106f10 0x7f2d7410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:22.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.557+0000 7f2d7a534640 1 --2- 172.21.15.27:0/1149707984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d74102790 0x7f2d741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:22.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.557+0000 7f2d7a534640 1 --2- 172.21.15.27:0/1149707984 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d74101de0 0x7f2d741021c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:22.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.557+0000 7f2d7a534640 1 -- 172.21.15.27:0/1149707984 >> 172.21.15.27:0/1149707984 conn(0x7f2d740fd8c0 msgr2=0x7f2d740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:22.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.557+0000 7f2d7a534640 1 -- 172.21.15.27:0/1149707984 shutdown_connections 2024-09-19T08:11:22.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.557+0000 7f2d7a534640 1 -- 172.21.15.27:0/1149707984 wait complete. 2024-09-19T08:11:22.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.558+0000 7f2d7a534640 1 Processor -- start 2024-09-19T08:11:22.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.558+0000 7f2d7a534640 1 -- start start 2024-09-19T08:11:22.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.558+0000 7f2d7a534640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d74101de0 0x7f2d741985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:22.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.558+0000 7f2d7a534640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d74102790 0x7f2d74198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:22.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.558+0000 7f2d7a534640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d74106f10 0x7f2d7419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:22.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.558+0000 7f2d7a534640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2d74112010 con 0x7f2d74102790 2024-09-19T08:11:22.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.558+0000 7f2d7a534640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2d74111e90 con 0x7f2d74101de0 2024-09-19T08:11:22.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.558+0000 7f2d7a534640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2d74112190 con 0x7f2d74106f10 2024-09-19T08:11:22.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.558+0000 7f2d737fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d74102790 0x7f2d74198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:22.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.558+0000 7f2d737fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d74102790 0x7f2d74198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46056/0 (socket says 172.21.15.27:46056) 2024-09-19T08:11:22.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.558+0000 7f2d737fe640 1 -- 172.21.15.27:0/2939612119 learned_addr learned my addr 172.21.15.27:0/2939612119 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:22.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.559+0000 7f2d73fff640 1 --2- 172.21.15.27:0/2939612119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d74101de0 0x7f2d741985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:22.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.559+0000 7f2d78ad1640 1 --2- 172.21.15.27:0/2939612119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d74106f10 0x7f2d7419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:22.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.559+0000 7f2d737fe640 1 -- 172.21.15.27:0/2939612119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d74106f10 msgr2=0x7f2d7419ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:22.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.559+0000 7f2d737fe640 1 --2- 172.21.15.27:0/2939612119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d74106f10 0x7f2d7419ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:22.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.559+0000 7f2d737fe640 1 -- 172.21.15.27:0/2939612119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d74101de0 msgr2=0x7f2d741985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:22.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.559+0000 7f2d737fe640 1 --2- 172.21.15.27:0/2939612119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d74101de0 0x7f2d741985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:22.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.559+0000 7f2d737fe640 1 -- 172.21.15.27:0/2939612119 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7419d560 con 0x7f2d74102790 2024-09-19T08:11:22.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.559+0000 7f2d737fe640 1 --2- 172.21.15.27:0/2939612119 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d74102790 0x7f2d74198af0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800b4a0 tx=0x7f2d6800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:22.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.560+0000 7f2d717fa640 1 -- 172.21.15.27:0/2939612119 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68014070 con 0x7f2d74102790 2024-09-19T08:11:22.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.560+0000 7f2d7a534640 1 -- 172.21.15.27:0/2939612119 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d7419d850 con 0x7f2d74102790 2024-09-19T08:11:22.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.560+0000 7f2d717fa640 1 -- 172.21.15.27:0/2939612119 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d68010af0 con 0x7f2d74102790 2024-09-19T08:11:22.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.560+0000 7f2d717fa640 1 -- 172.21.15.27:0/2939612119 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68017d10 con 0x7f2d74102790 2024-09-19T08:11:22.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.560+0000 7f2d7a534640 1 -- 172.21.15.27:0/2939612119 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d741a5130 con 0x7f2d74102790 2024-09-19T08:11:22.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.561+0000 7f2d7a534640 1 -- 172.21.15.27:0/2939612119 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d74102240 con 0x7f2d74102790 2024-09-19T08:11:22.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.563+0000 7f2d717fa640 1 -- 172.21.15.27:0/2939612119 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f2d68017070 con 0x7f2d74102790 2024-09-19T08:11:22.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.563+0000 7f2d717fa640 1 --2- 172.21.15.27:0/2939612119 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2d5c0a3440 0x7f2d5c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:22.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.563+0000 7f2d73fff640 1 --2- 172.21.15.27:0/2939612119 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2d5c0a3440 0x7f2d5c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:22.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.563+0000 7f2d717fa640 1 -- 172.21.15.27:0/2939612119 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f2d680cf570 con 0x7f2d74102790 2024-09-19T08:11:22.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.564+0000 7f2d73fff640 1 --2- 172.21.15.27:0/2939612119 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2d5c0a3440 0x7f2d5c0a5900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2d640096c0 tx=0x7f2d64031490 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:22.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.567+0000 7f2d717fa640 1 -- 172.21.15.27:0/2939612119 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2d6809bf40 con 0x7f2d74102790 2024-09-19T08:11:22.699 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:22.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.793+0000 7f2d7a534640 1 -- 172.21.15.27:0/2939612119 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d74199910 con 0x7f2d74102790 2024-09-19T08:11:22.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.793+0000 7f2d717fa640 1 -- 172.21.15.27:0/2939612119 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f2d74199910 con 0x7f2d74102790 2024-09-19T08:11:22.794 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:11:22.794 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:11:22.794 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:11:22.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.796+0000 7f2d7a534640 1 -- 172.21.15.27:0/2939612119 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2d5c0a3440 msgr2=0x7f2d5c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:22.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.796+0000 7f2d7a534640 1 --2- 172.21.15.27:0/2939612119 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2d5c0a3440 0x7f2d5c0a5900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2d640096c0 tx=0x7f2d64031490 comp rx=0 tx=0).stop 2024-09-19T08:11:22.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.796+0000 7f2d7a534640 1 -- 172.21.15.27:0/2939612119 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d74102790 msgr2=0x7f2d74198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:22.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.796+0000 7f2d7a534640 1 --2- 172.21.15.27:0/2939612119 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d74102790 0x7f2d74198af0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800b4a0 tx=0x7f2d6800b960 comp rx=0 tx=0).stop 2024-09-19T08:11:22.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.796+0000 7f2d7a534640 1 -- 172.21.15.27:0/2939612119 shutdown_connections 2024-09-19T08:11:22.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.796+0000 7f2d7a534640 1 --2- 172.21.15.27:0/2939612119 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2d5c0a3440 0x7f2d5c0a5900 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:22.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.796+0000 7f2d7a534640 1 --2- 172.21.15.27:0/2939612119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d74106f10 0x7f2d7419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:22.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.796+0000 7f2d7a534640 1 --2- 172.21.15.27:0/2939612119 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d74102790 0x7f2d74198af0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:22.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.796+0000 7f2d7a534640 1 --2- 172.21.15.27:0/2939612119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d74101de0 0x7f2d741985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:22.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.796+0000 7f2d7a534640 1 -- 172.21.15.27:0/2939612119 >> 172.21.15.27:0/2939612119 conn(0x7f2d740fd8c0 msgr2=0x7f2d740fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:22.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.796+0000 7f2d7a534640 1 -- 172.21.15.27:0/2939612119 shutdown_connections 2024-09-19T08:11:22.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:22.796+0000 7f2d7a534640 1 -- 172.21.15.27:0/2939612119 wait complete. 2024-09-19T08:11:23.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:22 smithi155 ceph-mon[35362]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 76 KiB/s wr, 33 op/s 2024-09-19T08:11:23.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:22 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2939612119' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:23.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:22 smithi027 ceph-mon[31209]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 76 KiB/s wr, 33 op/s 2024-09-19T08:11:23.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:22 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2939612119' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:23.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:22 smithi203 ceph-mon[35198]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 76 KiB/s wr, 33 op/s 2024-09-19T08:11:23.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:22 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2939612119' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:23.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.423+0000 7f707623d640 1 -- 172.21.15.27:0/4105093490 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f707010c180 msgr2=0x7f707010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:23.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.423+0000 7f707623d640 1 --2- 172.21.15.27:0/4105093490 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f707010c180 0x7f707010e610 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7068009ca0 tx=0x7f706802a950 comp rx=0 tx=0).stop 2024-09-19T08:11:23.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.423+0000 7f707623d640 1 -- 172.21.15.27:0/4105093490 shutdown_connections 2024-09-19T08:11:23.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.423+0000 7f707623d640 1 --2- 172.21.15.27:0/4105093490 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f707010c180 0x7f707010e610 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:23.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.423+0000 7f707623d640 1 --2- 172.21.15.27:0/4105093490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7070103700 0x7f707010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:23.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.423+0000 7f707623d640 1 --2- 172.21.15.27:0/4105093490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7070102de0 0x7f70701031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:23.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.423+0000 7f707623d640 1 -- 172.21.15.27:0/4105093490 >> 172.21.15.27:0/4105093490 conn(0x7f70700fc7a0 msgr2=0x7f70700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:23.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.423+0000 7f707623d640 1 -- 172.21.15.27:0/4105093490 shutdown_connections 2024-09-19T08:11:23.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.424+0000 7f707623d640 1 -- 172.21.15.27:0/4105093490 wait complete. 2024-09-19T08:11:23.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.424+0000 7f707623d640 1 Processor -- start 2024-09-19T08:11:23.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.424+0000 7f707623d640 1 -- start start 2024-09-19T08:11:23.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.425+0000 7f707623d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7070102de0 0x7f7070198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:23.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.425+0000 7f707623d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7070103700 0x7f7070198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:23.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.425+0000 7f707623d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f707010c180 0x7f707019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:23.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.425+0000 7f707623d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7070112030 con 0x7f7070103700 2024-09-19T08:11:23.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.425+0000 7f707623d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7070111eb0 con 0x7f707010c180 2024-09-19T08:11:23.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.425+0000 7f707623d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f70701121b0 con 0x7f7070102de0 2024-09-19T08:11:23.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.425+0000 7f706effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7070103700 0x7f7070198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:23.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.425+0000 7f706effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7070103700 0x7f7070198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46084/0 (socket says 172.21.15.27:46084) 2024-09-19T08:11:23.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.425+0000 7f706effd640 1 -- 172.21.15.27:0/3952497070 learned_addr learned my addr 172.21.15.27:0/3952497070 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:23.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.425+0000 7f706f7fe640 1 --2- 172.21.15.27:0/3952497070 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7070102de0 0x7f7070198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:23.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.425+0000 7f706ffff640 1 --2- 172.21.15.27:0/3952497070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f707010c180 0x7f707019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:23.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.425+0000 7f706effd640 1 -- 172.21.15.27:0/3952497070 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7070102de0 msgr2=0x7f7070198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:23.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.425+0000 7f706effd640 1 --2- 172.21.15.27:0/3952497070 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7070102de0 0x7f7070198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:23.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.425+0000 7f706effd640 1 -- 172.21.15.27:0/3952497070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f707010c180 msgr2=0x7f707019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:23.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.425+0000 7f706effd640 1 --2- 172.21.15.27:0/3952497070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f707010c180 0x7f707019ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:23.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.425+0000 7f706effd640 1 -- 172.21.15.27:0/3952497070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f707019d4f0 con 0x7f7070103700 2024-09-19T08:11:23.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.425+0000 7f706effd640 1 --2- 172.21.15.27:0/3952497070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7070103700 0x7f7070198a80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f706400b4a0 tx=0x7f706400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:23.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.425+0000 7f706cff9640 1 -- 172.21.15.27:0/3952497070 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7064015020 con 0x7f7070103700 2024-09-19T08:11:23.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.426+0000 7f706cff9640 1 -- 172.21.15.27:0/3952497070 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7064011d10 con 0x7f7070103700 2024-09-19T08:11:23.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.426+0000 7f707623d640 1 -- 172.21.15.27:0/3952497070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f707019d7e0 con 0x7f7070103700 2024-09-19T08:11:23.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.426+0000 7f706cff9640 1 -- 172.21.15.27:0/3952497070 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706400f2e0 con 0x7f7070103700 2024-09-19T08:11:23.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.426+0000 7f707623d640 1 -- 172.21.15.27:0/3952497070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70701a50c0 con 0x7f7070103700 2024-09-19T08:11:23.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.427+0000 7f707623d640 1 -- 172.21.15.27:0/3952497070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7070103240 con 0x7f7070103700 2024-09-19T08:11:23.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.428+0000 7f706cff9640 1 -- 172.21.15.27:0/3952497070 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f7064018020 con 0x7f7070103700 2024-09-19T08:11:23.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.428+0000 7f706cff9640 1 --2- 172.21.15.27:0/3952497070 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f70580a3440 0x7f70580a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:23.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.429+0000 7f706f7fe640 1 --2- 172.21.15.27:0/3952497070 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f70580a3440 0x7f70580a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:23.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.429+0000 7f706cff9640 1 -- 172.21.15.27:0/3952497070 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f70640cfa70 con 0x7f7070103700 2024-09-19T08:11:23.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.429+0000 7f706f7fe640 1 --2- 172.21.15.27:0/3952497070 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f70580a3440 0x7f70580a5900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7060009990 tx=0x7f7060009110 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:23.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.432+0000 7f706cff9640 1 -- 172.21.15.27:0/3952497070 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f706401f020 con 0x7f7070103700 2024-09-19T08:11:23.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.645+0000 7f707623d640 1 -- 172.21.15.27:0/3952497070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70701998a0 con 0x7f7070103700 2024-09-19T08:11:23.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.646+0000 7f706cff9640 1 -- 172.21.15.27:0/3952497070 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f70701998a0 con 0x7f7070103700 2024-09-19T08:11:23.647 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:11:23.647 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:11:23.647 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:11:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.648+0000 7f707623d640 1 -- 172.21.15.27:0/3952497070 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f70580a3440 msgr2=0x7f70580a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.648+0000 7f707623d640 1 --2- 172.21.15.27:0/3952497070 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f70580a3440 0x7f70580a5900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7060009990 tx=0x7f7060009110 comp rx=0 tx=0).stop 2024-09-19T08:11:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.648+0000 7f707623d640 1 -- 172.21.15.27:0/3952497070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7070103700 msgr2=0x7f7070198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.648+0000 7f707623d640 1 --2- 172.21.15.27:0/3952497070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7070103700 0x7f7070198a80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f706400b4a0 tx=0x7f706400b8a0 comp rx=0 tx=0).stop 2024-09-19T08:11:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.648+0000 7f707623d640 1 -- 172.21.15.27:0/3952497070 shutdown_connections 2024-09-19T08:11:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.648+0000 7f707623d640 1 --2- 172.21.15.27:0/3952497070 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f70580a3440 0x7f70580a5900 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.648+0000 7f707623d640 1 --2- 172.21.15.27:0/3952497070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f707010c180 0x7f707019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.648+0000 7f707623d640 1 --2- 172.21.15.27:0/3952497070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7070103700 0x7f7070198a80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.648+0000 7f707623d640 1 --2- 172.21.15.27:0/3952497070 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7070102de0 0x7f7070198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:23.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.648+0000 7f707623d640 1 -- 172.21.15.27:0/3952497070 >> 172.21.15.27:0/3952497070 conn(0x7f70700fc7a0 msgr2=0x7f70700fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:23.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.648+0000 7f707623d640 1 -- 172.21.15.27:0/3952497070 shutdown_connections 2024-09-19T08:11:23.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:23.648+0000 7f707623d640 1 -- 172.21.15.27:0/3952497070 wait complete. 2024-09-19T08:11:23.914 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:11:24.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:23 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3952497070' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:24.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:23 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3952497070' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:24.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:23 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3952497070' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:24.562 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:11:24.643 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:25.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.145+0000 7f1e4c110640 1 -- 172.21.15.27:0/3420870518 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e44101420 msgr2=0x7f1e4410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:25.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.145+0000 7f1e4c110640 1 --2- 172.21.15.27:0/3420870518 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e44101420 0x7f1e4410d950 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009cd0 tx=0x7f1e3c02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.145+0000 7f1e4c110640 1 -- 172.21.15.27:0/3420870518 shutdown_connections 2024-09-19T08:11:25.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.145+0000 7f1e4c110640 1 --2- 172.21.15.27:0/3420870518 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e44101420 0x7f1e4410d950 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.145+0000 7f1e4c110640 1 --2- 172.21.15.27:0/3420870518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e44100a80 0x7f1e44100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.145+0000 7f1e4c110640 1 --2- 172.21.15.27:0/3420870518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44106a80 0x7f1e44106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.145+0000 7f1e4c110640 1 -- 172.21.15.27:0/3420870518 >> 172.21.15.27:0/3420870518 conn(0x7f1e440fc7a0 msgr2=0x7f1e440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:25.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.145+0000 7f1e4c110640 1 -- 172.21.15.27:0/3420870518 shutdown_connections 2024-09-19T08:11:25.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.145+0000 7f1e4c110640 1 -- 172.21.15.27:0/3420870518 wait complete. 2024-09-19T08:11:25.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.146+0000 7f1e4c110640 1 Processor -- start 2024-09-19T08:11:25.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.146+0000 7f1e4c110640 1 -- start start 2024-09-19T08:11:25.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.146+0000 7f1e4c110640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44100a80 0x7f1e44102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.146+0000 7f1e4c110640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e44101420 0x7f1e44102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.146+0000 7f1e4c110640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e44106a80 0x7f1e441030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.146+0000 7f1e4c110640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1e44110e80 con 0x7f1e44106a80 2024-09-19T08:11:25.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.146+0000 7f1e4c110640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1e44110d00 con 0x7f1e44100a80 2024-09-19T08:11:25.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.146+0000 7f1e4c110640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1e44111000 con 0x7f1e44101420 2024-09-19T08:11:25.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.146+0000 7f1e4a6ad640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e44106a80 0x7f1e441030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.146+0000 7f1e49eac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44100a80 0x7f1e44102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.146+0000 7f1e4a6ad640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e44106a80 0x7f1e441030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46106/0 (socket says 172.21.15.27:46106) 2024-09-19T08:11:25.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.146+0000 7f1e4a6ad640 1 -- 172.21.15.27:0/3070192029 learned_addr learned my addr 172.21.15.27:0/3070192029 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:25.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.146+0000 7f1e496ab640 1 --2- 172.21.15.27:0/3070192029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e44101420 0x7f1e44102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.147+0000 7f1e4a6ad640 1 -- 172.21.15.27:0/3070192029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e44101420 msgr2=0x7f1e44102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:25.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.147+0000 7f1e4a6ad640 1 --2- 172.21.15.27:0/3070192029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e44101420 0x7f1e44102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.147+0000 7f1e4a6ad640 1 -- 172.21.15.27:0/3070192029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44100a80 msgr2=0x7f1e44102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:25.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.147+0000 7f1e4a6ad640 1 --2- 172.21.15.27:0/3070192029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44100a80 0x7f1e44102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.147+0000 7f1e4a6ad640 1 -- 172.21.15.27:0/3070192029 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e441a68c0 con 0x7f1e44106a80 2024-09-19T08:11:25.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.147+0000 7f1e49eac640 1 --2- 172.21.15.27:0/3070192029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44100a80 0x7f1e44102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:11:25.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.147+0000 7f1e4a6ad640 1 --2- 172.21.15.27:0/3070192029 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e44106a80 0x7f1e441030d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c005cc0 tx=0x7f1e3c0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:25.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.147+0000 7f1e36ffd640 1 -- 172.21.15.27:0/3070192029 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c003e00 con 0x7f1e44106a80 2024-09-19T08:11:25.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.147+0000 7f1e36ffd640 1 -- 172.21.15.27:0/3070192029 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e3c004520 con 0x7f1e44106a80 2024-09-19T08:11:25.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.147+0000 7f1e4c110640 1 -- 172.21.15.27:0/3070192029 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e441a6b50 con 0x7f1e44106a80 2024-09-19T08:11:25.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.147+0000 7f1e36ffd640 1 -- 172.21.15.27:0/3070192029 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c030db0 con 0x7f1e44106a80 2024-09-19T08:11:25.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.147+0000 7f1e4c110640 1 -- 172.21.15.27:0/3070192029 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e441a70e0 con 0x7f1e44106a80 2024-09-19T08:11:25.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.148+0000 7f1e4c110640 1 -- 172.21.15.27:0/3070192029 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e44100ee0 con 0x7f1e44106a80 2024-09-19T08:11:25.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.149+0000 7f1e36ffd640 1 -- 172.21.15.27:0/3070192029 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f1e3c0046d0 con 0x7f1e44106a80 2024-09-19T08:11:25.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.150+0000 7f1e36ffd640 1 --2- 172.21.15.27:0/3070192029 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1e300a34c0 0x7f1e300a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.150+0000 7f1e49eac640 1 --2- 172.21.15.27:0/3070192029 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1e300a34c0 0x7f1e300a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.150+0000 7f1e36ffd640 1 -- 172.21.15.27:0/3070192029 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f1e3c02e030 con 0x7f1e44106a80 2024-09-19T08:11:25.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.150+0000 7f1e49eac640 1 --2- 172.21.15.27:0/3070192029 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1e300a34c0 0x7f1e300a5980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009f40 tx=0x7f1e40005f90 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:25.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.153+0000 7f1e36ffd640 1 -- 172.21.15.27:0/3070192029 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1e3c04b060 con 0x7f1e44106a80 2024-09-19T08:11:25.165 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:24 smithi155 ceph-mon[35362]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 76 KiB/s wr, 34 op/s 2024-09-19T08:11:25.212 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:25.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:24 smithi027 ceph-mon[31209]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 76 KiB/s wr, 34 op/s 2024-09-19T08:11:25.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:24 smithi203 ceph-mon[35198]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 76 KiB/s wr, 34 op/s 2024-09-19T08:11:25.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.338+0000 7f1e4c110640 1 -- 172.21.15.27:0/3070192029 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e44103b80 con 0x7f1e44106a80 2024-09-19T08:11:25.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.339+0000 7f1e36ffd640 1 -- 172.21.15.27:0/3070192029 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+23027 (secure 0 0 0) 0x7f1e44103b80 con 0x7f1e44106a80 2024-09-19T08:11:25.340 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:11:25.340 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":84,"fsid":"35b531b0-765d-11ef-bceb-c7b262605968","created":"2024-09-19T08:01:20.929241+0000","modified":"2024-09-19T08:11:01.318508+0000","last_up_change":"2024-09-19T08:08:17.919001+0000","last_in_change":"2024-09-19T08:07:54.277124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:04:29.312984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:09:08.046858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:09:10.223258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66fd6732-4cac-4eda-bf06-50638995ee80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6803","nonce":3645201250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6805","nonce":3645201250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6809","nonce":3645201250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6807","nonce":3645201250}]},"public_addr":"172.21.15.27:6803/3645201250","cluster_addr":"172.21.15.27:6805/3645201250","heartbeat_back_addr":"172.21.15.27:6809/3645201250","heartbeat_front_addr":"172.21.15.27:6807/3645201250","state":["exists","up"]},{"osd":1,"uuid":"36628767-66ac-433b-938e-10e75b51a877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6801","nonce":3977510449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6803","nonce":3977510449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6807","nonce":3977510449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6805","nonce":3977510449}]},"public_addr":"172.21.15.155:6801/3977510449","cluster_addr":"172.21.15.155:6803/3977510449","heartbeat_back_addr":"172.21.15.155:6807/3977510449","heartbeat_front_addr":"172.21.15.155:6805/3977510449","state":["exists","up"]},{"osd":2,"uuid":"3dc80404-a56b-456a-af02-f01e9c6c6dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6801","nonce":3796057016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6803","nonce":3796057016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6807","nonce":3796057016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6805","nonce":3796057016}]},"public_addr":"172.21.15.203:6801/3796057016","cluster_addr":"172.21.15.203:6803/3796057016","heartbeat_back_addr":"172.21.15.203:6807/3796057016","heartbeat_front_addr":"172.21.15.203:6805/3796057016","state":["exists","up"]},{"osd":3,"uuid":"a51077d0-5e04-49b5-bb3e-91711cc45ff1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6811","nonce":1608304347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6813","nonce":1608304347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6817","nonce":1608304347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6815","nonce":1608304347}]},"public_addr":"172.21.15.27:6811/1608304347","cluster_addr":"172.21.15.27:6813/1608304347","heartbeat_back_addr":"172.21.15.27:6817/1608304347","heartbeat_front_addr":"172.21.15.27:6815/1608304347","state":["exists","up"]},{"osd":4,"uuid":"0df35548-90b4-434d-8d7e-c037072c9ae4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6809","nonce":569913150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6811","nonce":569913150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6815","nonce":569913150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6813","nonce":569913150}]},"public_addr":"172.21.15.155:6809/569913150","cluster_addr":"172.21.15.155:6811/569913150","heartbeat_back_addr":"172.21.15.155:6815/569913150","heartbeat_front_addr":"172.21.15.155:6813/569913150","state":["exists","up"]},{"osd":5,"uuid":"de193c5f-1019-43e5-9f4f-6c2aaa4330e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6809","nonce":991491203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6811","nonce":991491203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6815","nonce":991491203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6813","nonce":991491203}]},"public_addr":"172.21.15.203:6809/991491203","cluster_addr":"172.21.15.203:6811/991491203","heartbeat_back_addr":"172.21.15.203:6815/991491203","heartbeat_front_addr":"172.21.15.203:6813/991491203","state":["exists","up"]},{"osd":6,"uuid":"28938e4f-9f22-466f-8cf7-62ee56a0c926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6819","nonce":3516868131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6821","nonce":3516868131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6825","nonce":3516868131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6823","nonce":3516868131}]},"public_addr":"172.21.15.27:6819/3516868131","cluster_addr":"172.21.15.27:6821/3516868131","heartbeat_back_addr":"172.21.15.27:6825/3516868131","heartbeat_front_addr":"172.21.15.27:6823/3516868131","state":["exists","up"]},{"osd":7,"uuid":"855f1728-be52-4445-8561-a90c08f2b2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6817","nonce":2047506436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6819","nonce":2047506436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6823","nonce":2047506436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6821","nonce":2047506436}]},"public_addr":"172.21.15.155:6817/2047506436","cluster_addr":"172.21.15.155:6819/2047506436","heartbeat_back_addr":"172.21.15.155:6823/2047506436","heartbeat_front_addr":"172.21.15.155:6821/2047506436","state":["exists","up"]},{"osd":8,"uuid":"5d7a8ffd-a039-403e-8b9a-c80e19fd67ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6817","nonce":199970687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6819","nonce":199970687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6823","nonce":199970687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6821","nonce":199970687}]},"public_addr":"172.21.15.203:6817/199970687","cluster_addr":"172.21.15.203:6819/199970687","heartbeat_back_addr":"172.21.15.203:6823/199970687","heartbeat_front_addr":"172.21.15.203:6821/199970687","state":["exists","up"]},{"osd":9,"uuid":"cdb90242-80a1-4cef-b5e3-ddecb05664e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6827","nonce":118390483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6829","nonce":118390483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6833","nonce":118390483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6831","nonce":118390483}]},"public_addr":"172.21.15.27:6827/118390483","cluster_addr":"172.21.15.27:6829/118390483","heartbeat_back_addr":"172.21.15.27:6833/118390483","heartbeat_front_addr":"172.21.15.27:6831/118390483","state":["exists","up"]},{"osd":10,"uuid":"c7f4c9da-d913-47a5-8629-53de21efe8c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6825","nonce":1687418565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6827","nonce":1687418565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6831","nonce":1687418565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6829","nonce":1687418565}]},"public_addr":"172.21.15.155:6825/1687418565","cluster_addr":"172.21.15.155:6827/1687418565","heartbeat_back_addr":"172.21.15.155:6831/1687418565","heartbeat_front_addr":"172.21.15.155:6829/1687418565","state":["exists","up"]},{"osd":11,"uuid":"45c11a90-585e-46fa-a5a0-51a29e29eba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6825","nonce":224768827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6827","nonce":224768827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6831","nonce":224768827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6829","nonce":224768827}]},"public_addr":"172.21.15.203:6825/224768827","cluster_addr":"172.21.15.203:6827/224768827","heartbeat_back_addr":"172.21.15.203:6831/224768827","heartbeat_front_addr":"172.21.15.203:6829/224768827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:03:35.559549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:00.526006+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:25.809346+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:51.889445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:17.246017+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:43.515854+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:08.638182+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:34.653060+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:59.469837+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:26.122937+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:50.196159+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:08:16.245770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/4099657868":"2024-09-20T08:11:01.318464+0000","172.21.15.27:0/913696111":"2024-09-20T08:11:01.318464+0000","172.21.15.27:0/1717932879":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6800/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/1963219497":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/416476667":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/1908865720":"2024-09-20T08:02:12.808047+0000","172.21.15.27:6801/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1174736321":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/958829150":"2024-09-20T08:02:12.808047+0000","172.21.15.27:6800/4220278108":"2024-09-20T08:11:01.318464+0000","172.21.15.27:6800/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/3419400802":"2024-09-20T08:11:01.318464+0000","172.21.15.27:0/1827043850":"2024-09-20T08:11:01.318464+0000","172.21.15.27:6801/4220278108":"2024-09-20T08:11:01.318464+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:11:25.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.342+0000 7f1e4c110640 1 -- 172.21.15.27:0/3070192029 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1e300a34c0 msgr2=0x7f1e300a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:25.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.342+0000 7f1e4c110640 1 --2- 172.21.15.27:0/3070192029 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1e300a34c0 0x7f1e300a5980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009f40 tx=0x7f1e40005f90 comp rx=0 tx=0).stop 2024-09-19T08:11:25.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.342+0000 7f1e4c110640 1 -- 172.21.15.27:0/3070192029 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e44106a80 msgr2=0x7f1e441030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:25.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.342+0000 7f1e4c110640 1 --2- 172.21.15.27:0/3070192029 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e44106a80 0x7f1e441030d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c005cc0 tx=0x7f1e3c0093d0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.342+0000 7f1e4c110640 1 -- 172.21.15.27:0/3070192029 shutdown_connections 2024-09-19T08:11:25.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.342+0000 7f1e4c110640 1 --2- 172.21.15.27:0/3070192029 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1e300a34c0 0x7f1e300a5980 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.342+0000 7f1e4c110640 1 --2- 172.21.15.27:0/3070192029 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e44106a80 0x7f1e441030d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.342+0000 7f1e4c110640 1 --2- 172.21.15.27:0/3070192029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e44101420 0x7f1e44102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.342+0000 7f1e4c110640 1 --2- 172.21.15.27:0/3070192029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44100a80 0x7f1e44102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.342+0000 7f1e4c110640 1 -- 172.21.15.27:0/3070192029 >> 172.21.15.27:0/3070192029 conn(0x7f1e440fc7a0 msgr2=0x7f1e44104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:25.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.342+0000 7f1e4c110640 1 -- 172.21.15.27:0/3070192029 shutdown_connections 2024-09-19T08:11:25.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.342+0000 7f1e4c110640 1 -- 172.21.15.27:0/3070192029 wait complete. 2024-09-19T08:11:25.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.892+0000 7fca7d61e640 1 -- 172.21.15.27:0/550798178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca78102ef0 msgr2=0x7fca7810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:25.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.892+0000 7fca7d61e640 1 --2- 172.21.15.27:0/550798178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca78102ef0 0x7fca7810da40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fca68009900 tx=0x7fca6802a480 comp rx=0 tx=0).stop 2024-09-19T08:11:25.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.893+0000 7fca7d61e640 1 -- 172.21.15.27:0/550798178 shutdown_connections 2024-09-19T08:11:25.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.893+0000 7fca7d61e640 1 --2- 172.21.15.27:0/550798178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca78102ef0 0x7fca7810da40 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.893+0000 7fca7d61e640 1 --2- 172.21.15.27:0/550798178 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca78102570 0x7fca781029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.893+0000 7fca7d61e640 1 --2- 172.21.15.27:0/550798178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca78100e20 0x7fca78101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.893+0000 7fca7d61e640 1 -- 172.21.15.27:0/550798178 >> 172.21.15.27:0/550798178 conn(0x7fca780fc7d0 msgr2=0x7fca780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:25.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.893+0000 7fca7d61e640 1 -- 172.21.15.27:0/550798178 shutdown_connections 2024-09-19T08:11:25.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.893+0000 7fca7d61e640 1 -- 172.21.15.27:0/550798178 wait complete. 2024-09-19T08:11:25.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.893+0000 7fca7d61e640 1 Processor -- start 2024-09-19T08:11:25.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.893+0000 7fca7d61e640 1 -- start start 2024-09-19T08:11:25.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.894+0000 7fca7d61e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca78100e20 0x7fca7810e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.894+0000 7fca7d61e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca78102570 0x7fca7810ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.894+0000 7fca7d61e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca78102ef0 0x7fca7810ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.894+0000 7fca7d61e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fca781120a0 con 0x7fca78102ef0 2024-09-19T08:11:25.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.894+0000 7fca7d61e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fca78111f20 con 0x7fca78100e20 2024-09-19T08:11:25.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.894+0000 7fca7d61e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fca78112220 con 0x7fca78102570 2024-09-19T08:11:25.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.894+0000 7fca777fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca78102ef0 0x7fca7810ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.894+0000 7fca777fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca78102ef0 0x7fca7810ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46130/0 (socket says 172.21.15.27:46130) 2024-09-19T08:11:25.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.894+0000 7fca777fe640 1 -- 172.21.15.27:0/2520400106 learned_addr learned my addr 172.21.15.27:0/2520400106 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:25.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.894+0000 7fca76ffd640 1 --2- 172.21.15.27:0/2520400106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca78100e20 0x7fca7810e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.894+0000 7fca767fc640 1 --2- 172.21.15.27:0/2520400106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca78102570 0x7fca7810ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.894+0000 7fca777fe640 1 -- 172.21.15.27:0/2520400106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca78102570 msgr2=0x7fca7810ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:25.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.894+0000 7fca777fe640 1 --2- 172.21.15.27:0/2520400106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca78102570 0x7fca7810ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.894+0000 7fca777fe640 1 -- 172.21.15.27:0/2520400106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca78100e20 msgr2=0x7fca7810e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:25.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.894+0000 7fca777fe640 1 --2- 172.21.15.27:0/2520400106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca78100e20 0x7fca7810e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.894+0000 7fca777fe640 1 -- 172.21.15.27:0/2520400106 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca781a68e0 con 0x7fca78102ef0 2024-09-19T08:11:25.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.894+0000 7fca767fc640 1 --2- 172.21.15.27:0/2520400106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca78102570 0x7fca7810ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:11:25.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.894+0000 7fca777fe640 1 --2- 172.21.15.27:0/2520400106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca78102ef0 0x7fca7810ef50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fca68004770 tx=0x7fca68003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:25.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.894+0000 7fca6ffff640 1 -- 172.21.15.27:0/2520400106 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6803f070 con 0x7fca78102ef0 2024-09-19T08:11:25.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.894+0000 7fca6ffff640 1 -- 172.21.15.27:0/2520400106 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca68031c30 con 0x7fca78102ef0 2024-09-19T08:11:25.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.895+0000 7fca7d61e640 1 -- 172.21.15.27:0/2520400106 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca781a6b70 con 0x7fca78102ef0 2024-09-19T08:11:25.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.895+0000 7fca6ffff640 1 -- 172.21.15.27:0/2520400106 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca68035030 con 0x7fca78102ef0 2024-09-19T08:11:25.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.895+0000 7fca7d61e640 1 -- 172.21.15.27:0/2520400106 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca781a7050 con 0x7fca78102ef0 2024-09-19T08:11:25.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.897+0000 7fca6ffff640 1 -- 172.21.15.27:0/2520400106 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fca68042070 con 0x7fca78102ef0 2024-09-19T08:11:25.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.897+0000 7fca7f9f7740 1 Processor -- start 2024-09-19T08:11:25.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.897+0000 7fca7f9f7740 1 -- start start 2024-09-19T08:11:25.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca7f9f7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae46b40 0x55ff2ae45090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca7f9f7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae455d0 0x55ff2ae45a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca7f9f7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae50370 0x55ff2ae52760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca7f9f7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55ff2adab2f0 con 0x55ff2ae455d0 2024-09-19T08:11:25.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca7f9f7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ff2ad52cf0 con 0x55ff2ae46b40 2024-09-19T08:11:25.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca7f9f7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ff2ada72b0 con 0x55ff2ae50370 2024-09-19T08:11:25.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca76ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae455d0 0x55ff2ae45a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca76ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae455d0 0x55ff2ae45a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46144/0 (socket says 172.21.15.27:46144) 2024-09-19T08:11:25.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca767fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae46b40 0x55ff2ae45090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca76ffd640 1 -- 172.21.15.27:0/3682975224 learned_addr learned my addr 172.21.15.27:0/3682975224 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:25.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca6ffff640 1 --2- 172.21.15.27:0/2520400106 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fca640a3440 0x7fca640a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca767fc640 1 --2- 172.21.15.27:0/3682975224 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae50370 0x55ff2ae52760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca777fe640 1 --2- 172.21.15.27:0/2520400106 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fca640a3440 0x7fca640a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca76ffd640 1 -- 172.21.15.27:0/3682975224 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae50370 msgr2=0x55ff2ae52760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:25.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca76ffd640 1 --2- 172.21.15.27:0/3682975224 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae50370 0x55ff2ae52760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca76ffd640 1 -- 172.21.15.27:0/3682975224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae46b40 msgr2=0x55ff2ae45090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:25.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca76ffd640 1 --2- 172.21.15.27:0/3682975224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae46b40 0x55ff2ae45090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca76ffd640 1 -- 172.21.15.27:0/3682975224 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff2ad373a0 con 0x55ff2ae455d0 2024-09-19T08:11:25.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca767fc640 1 --2- 172.21.15.27:0/3682975224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae46b40 0x55ff2ae45090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:11:25.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca6ffff640 1 -- 172.21.15.27:0/2520400106 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fca680f0660 con 0x7fca78102ef0 2024-09-19T08:11:25.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.898+0000 7fca76ffd640 1 --2- 172.21.15.27:0/3682975224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae455d0 0x55ff2ae45a10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fca70003a20 tx=0x7fca70003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c98f40e6936bd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:25.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.899+0000 7fca777fe640 1 --2- 172.21.15.27:0/2520400106 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fca640a3440 0x7fca640a5900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fca680edda0 tx=0x7fca680e75f0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:25.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.899+0000 7fca6d7fa640 1 -- 172.21.15.27:0/3682975224 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca70004860 con 0x55ff2ae455d0 2024-09-19T08:11:25.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.899+0000 7fca6d7fa640 1 -- 172.21.15.27:0/3682975224 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca70015030 con 0x55ff2ae455d0 2024-09-19T08:11:25.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.899+0000 7fca6d7fa640 1 -- 172.21.15.27:0/3682975224 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca70010a50 con 0x55ff2ae455d0 2024-09-19T08:11:25.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.899+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3682975224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae455d0 msgr2=0x55ff2ae45a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.899+0000 7fca7f9f7740 1 --2- 172.21.15.27:0/3682975224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae455d0 0x55ff2ae45a10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fca70003a20 tx=0x7fca70003ee0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.899+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3682975224 shutdown_connections 2024-09-19T08:11:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.899+0000 7fca7f9f7740 1 --2- 172.21.15.27:0/3682975224 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae50370 0x55ff2ae52760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.899+0000 7fca7f9f7740 1 --2- 172.21.15.27:0/3682975224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae455d0 0x55ff2ae45a10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.900+0000 7fca7f9f7740 1 --2- 172.21.15.27:0/3682975224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae46b40 0x55ff2ae45090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.900+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3682975224 >> 172.21.15.27:0/3682975224 conn(0x55ff2ae0e310 msgr2=0x55ff2ae41c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.900+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3682975224 shutdown_connections 2024-09-19T08:11:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.900+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3682975224 wait complete. 2024-09-19T08:11:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.900+0000 7fca7f9f7740 1 -- start start 2024-09-19T08:11:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.900+0000 7fca7f9f7740 1 Processor -- start 2024-09-19T08:11:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.900+0000 7fca7f9f7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae455d0 0x55ff2ae4fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.900+0000 7fca7f9f7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae46b40 0x55ff2ae4cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.900+0000 7fca7f9f7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae50370 0x55ff2ae4d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.900+0000 7fca7f9f7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55ff2ae53070 con 0x55ff2ae50370 2024-09-19T08:11:25.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.900+0000 7fca7f9f7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ff2ad66060 con 0x55ff2ae46b40 2024-09-19T08:11:25.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.900+0000 7fca7f9f7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ff2ae531f0 con 0x55ff2ae455d0 2024-09-19T08:11:25.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.900+0000 7fca7f9f7740 10 client.0 _ll_register_callbacks cb 0x55ff2aab98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:25.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.900+0000 7fca767fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae50370 0x55ff2ae4d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.900+0000 7fca767fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae50370 0x55ff2ae4d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46160/0 (socket says 172.21.15.27:46160) 2024-09-19T08:11:25.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.900+0000 7fca767fc640 1 -- 172.21.15.27:0/3746120699 learned_addr learned my addr 172.21.15.27:0/3746120699 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:25.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.900+0000 7fca76ffd640 1 --2- 172.21.15.27:0/3746120699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae46b40 0x55ff2ae4cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.901+0000 7fca767fc640 1 --2- 172.21.15.27:0/3746120699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae455d0 0x55ff2ae4fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.901+0000 7fca767fc640 1 -- 172.21.15.27:0/3746120699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae455d0 msgr2=0x55ff2ae4fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:25.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.901+0000 7fca767fc640 1 --2- 172.21.15.27:0/3746120699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae455d0 0x55ff2ae4fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.901+0000 7fca767fc640 1 -- 172.21.15.27:0/3746120699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae46b40 msgr2=0x55ff2ae4cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:25.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.901+0000 7fca767fc640 1 --2- 172.21.15.27:0/3746120699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae46b40 0x55ff2ae4cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.901+0000 7fca767fc640 1 -- 172.21.15.27:0/3746120699 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff2ab1c3c0 con 0x55ff2ae50370 2024-09-19T08:11:25.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.901+0000 7fca767fc640 1 --2- 172.21.15.27:0/3746120699 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae50370 0x55ff2ae4d480 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fca60012a70 tx=0x7fca60004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a984b8026a89334c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:25.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.901+0000 7fca5e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:25.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.901+0000 7fca5e7fc640 1 -- 172.21.15.27:0/3746120699 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca60011e10 con 0x55ff2ae50370 2024-09-19T08:11:25.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.901+0000 7fca5e7fc640 1 -- 172.21.15.27:0/3746120699 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fca60005020 con 0x55ff2ae50370 2024-09-19T08:11:25.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.901+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3746120699 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca70015030 con 0x55ff2ae50370 2024-09-19T08:11:25.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.901+0000 7fca5e7fc640 1 -- 172.21.15.27:0/3746120699 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fca60027050 con 0x55ff2ae50370 2024-09-19T08:11:25.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.901+0000 7fca7f9f7740 10 client.15393 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:25.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.901+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3746120699 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ff2ae5eaf0 con 0x55ff2ae50370 2024-09-19T08:11:25.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.902+0000 7fca5e7fc640 1 -- 172.21.15.27:0/3746120699 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca70015030 con 0x55ff2ae50370 2024-09-19T08:11:25.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.902+0000 7fca5e7fc640 1 -- 172.21.15.27:0/3746120699 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fca600103d0 con 0x55ff2ae50370 2024-09-19T08:11:25.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.902+0000 7fca7f9f7740 10 client.15393 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:25.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.902+0000 7fca7f9f7740 10 client.15393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:25.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.902+0000 7fca7f9f7740 20 client.15393 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:25.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.902+0000 7fca7f9f7740 1 --2- 172.21.15.27:0/3746120699 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ff2ae5ff00 0x55ff2ae62350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.902+0000 7fca7f9f7740 4 client.15393 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:11:25.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.902+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3746120699 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff2adb8860 con 0x55ff2ae5ff00 2024-09-19T08:11:25.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.902+0000 7fca76ffd640 1 --2- 172.21.15.27:0/3746120699 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ff2ae5ff00 0x55ff2ae62350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.903+0000 7fca5e7fc640 10 client.15393 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:25.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.903+0000 7fca76ffd640 1 --2- 172.21.15.27:0/3746120699 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ff2ae5ff00 0x55ff2ae62350 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bc42eaa6a971aeb server_cookie=e0dfa8dc74131c64 in_seq=0 out_seq=0 2024-09-19T08:11:25.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.904+0000 7fca5e7fc640 1 -- 172.21.15.27:0/3746120699 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff2adb8860 con 0x55ff2ae5ff00 2024-09-19T08:11:25.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.904+0000 7fca5e7fc640 10 client.15393 handle_command_reply: tid=0 2024-09-19T08:11:25.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.904+0000 7fca7f9f7740 1 client.15393 shutdown 2024-09-19T08:11:25.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.904+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3746120699 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae50370 msgr2=0x55ff2ae4d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:25.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.904+0000 7fca7f9f7740 1 --2- 172.21.15.27:0/3746120699 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae50370 0x55ff2ae4d480 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fca60012a70 tx=0x7fca60004730 comp rx=0 tx=0).stop 2024-09-19T08:11:25.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.904+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3746120699 shutdown_connections 2024-09-19T08:11:25.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.904+0000 7fca7f9f7740 1 --2- 172.21.15.27:0/3746120699 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae50370 0x55ff2ae4d480 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.904+0000 7fca7f9f7740 1 --2- 172.21.15.27:0/3746120699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae46b40 0x55ff2ae4cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.904+0000 7fca7f9f7740 1 --2- 172.21.15.27:0/3746120699 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ff2ae5ff00 0x55ff2ae62350 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.904+0000 7fca7f9f7740 1 --2- 172.21.15.27:0/3746120699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae455d0 0x55ff2ae4fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.904+0000 7fca5e7fc640 0 client.15393 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:25.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.904+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3746120699 >> 172.21.15.27:0/3746120699 conn(0x55ff2ae0e310 msgr2=0x55ff2ae47930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:25.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.904+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3746120699 shutdown_connections 2024-09-19T08:11:25.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.904+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3746120699 wait complete. 2024-09-19T08:11:25.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.904+0000 7fca7f9f7740 20 client.15393 trim_cache size 0 max 16384 2024-09-19T08:11:25.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.918+0000 7fca7f9f7740 1 Processor -- start 2024-09-19T08:11:25.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.918+0000 7fca7f9f7740 1 -- start start 2024-09-19T08:11:25.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.918+0000 7fca7f9f7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae455d0 0x55ff2ae5c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.918+0000 7fca7f9f7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae46b40 0x55ff2ae4eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.918+0000 7fca7f9f7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae50370 0x55ff2ae51760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.918+0000 7fca7f9f7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fca781ad8f0 con 0x55ff2ae455d0 2024-09-19T08:11:25.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.918+0000 7fca7f9f7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fca781b0170 con 0x55ff2ae50370 2024-09-19T08:11:25.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.918+0000 7fca7f9f7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fca781adf60 con 0x55ff2ae46b40 2024-09-19T08:11:25.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.918+0000 7fca767fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae455d0 0x55ff2ae5c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.919+0000 7fca767fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae455d0 0x55ff2ae5c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46172/0 (socket says 172.21.15.27:46172) 2024-09-19T08:11:25.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.919+0000 7fca767fc640 1 -- 172.21.15.27:0/939995575 learned_addr learned my addr 172.21.15.27:0/939995575 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:25.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.919+0000 7fca76ffd640 1 --2- 172.21.15.27:0/939995575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae46b40 0x55ff2ae4eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.919+0000 7fca767fc640 1 --2- 172.21.15.27:0/939995575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae50370 0x55ff2ae51760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.919+0000 7fca767fc640 1 -- 172.21.15.27:0/939995575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae46b40 msgr2=0x55ff2ae4eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:25.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.919+0000 7fca767fc640 1 --2- 172.21.15.27:0/939995575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae46b40 0x55ff2ae4eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.919+0000 7fca767fc640 1 -- 172.21.15.27:0/939995575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae50370 msgr2=0x55ff2ae51760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:25.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.919+0000 7fca767fc640 1 --2- 172.21.15.27:0/939995575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae50370 0x55ff2ae51760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.919+0000 7fca767fc640 1 -- 172.21.15.27:0/939995575 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff2ae4da80 con 0x55ff2ae455d0 2024-09-19T08:11:25.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.919+0000 7fca767fc640 1 --2- 172.21.15.27:0/939995575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae455d0 0x55ff2ae5c370 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fca60004700 tx=0x7fca6000df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4422db33083fc23b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:25.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.919+0000 7fca6cff9640 1 -- 172.21.15.27:0/939995575 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca600105d0 con 0x55ff2ae455d0 2024-09-19T08:11:25.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.919+0000 7fca6cff9640 1 -- 172.21.15.27:0/939995575 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca60004c80 con 0x55ff2ae455d0 2024-09-19T08:11:25.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.920+0000 7fca6cff9640 1 -- 172.21.15.27:0/939995575 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca60005020 con 0x55ff2ae455d0 2024-09-19T08:11:25.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.920+0000 7fca7f9f7740 1 -- 172.21.15.27:0/939995575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae455d0 msgr2=0x55ff2ae5c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:25.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.920+0000 7fca7f9f7740 1 --2- 172.21.15.27:0/939995575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae455d0 0x55ff2ae5c370 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fca60004700 tx=0x7fca6000df20 comp rx=0 tx=0).stop 2024-09-19T08:11:25.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.920+0000 7fca7f9f7740 1 -- 172.21.15.27:0/939995575 shutdown_connections 2024-09-19T08:11:25.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.920+0000 7fca7f9f7740 1 --2- 172.21.15.27:0/939995575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae50370 0x55ff2ae51760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.920+0000 7fca7f9f7740 1 --2- 172.21.15.27:0/939995575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae46b40 0x55ff2ae4eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.920+0000 7fca7f9f7740 1 --2- 172.21.15.27:0/939995575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae455d0 0x55ff2ae5c370 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.920+0000 7fca7f9f7740 1 -- 172.21.15.27:0/939995575 >> 172.21.15.27:0/939995575 conn(0x55ff2ae0e310 msgr2=0x55ff2ae4e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:25.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.920+0000 7fca7f9f7740 1 -- 172.21.15.27:0/939995575 shutdown_connections 2024-09-19T08:11:25.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.920+0000 7fca7f9f7740 1 -- 172.21.15.27:0/939995575 wait complete. 2024-09-19T08:11:25.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.921+0000 7fca7f9f7740 1 -- start start 2024-09-19T08:11:25.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.921+0000 7fca7f9f7740 1 Processor -- start 2024-09-19T08:11:25.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.921+0000 7fca7f9f7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae455d0 0x55ff2ae67810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.921+0000 7fca7f9f7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae46b40 0x55ff2ae67d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.921+0000 7fca7f9f7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae50370 0x55ff2ae68290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.921+0000 7fca7f9f7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fca781ae630 con 0x55ff2ae46b40 2024-09-19T08:11:25.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.921+0000 7fca7f9f7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fca781afaa0 con 0x55ff2ae455d0 2024-09-19T08:11:25.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.921+0000 7fca7f9f7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fca781aed00 con 0x55ff2ae50370 2024-09-19T08:11:25.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.921+0000 7fca7f9f7740 10 client.0 _ll_register_callbacks cb 0x7fca6000dad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:25.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.921+0000 7fca76ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae46b40 0x55ff2ae67d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.921+0000 7fca76ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae46b40 0x55ff2ae67d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46178/0 (socket says 172.21.15.27:46178) 2024-09-19T08:11:25.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.921+0000 7fca76ffd640 1 -- 172.21.15.27:0/3717951359 learned_addr learned my addr 172.21.15.27:0/3717951359 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:25.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.921+0000 7fca767fc640 1 --2- 172.21.15.27:0/3717951359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae455d0 0x55ff2ae67810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.921+0000 7fca767fc640 1 --2- 172.21.15.27:0/3717951359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae50370 0x55ff2ae68290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.921+0000 7fca76ffd640 1 -- 172.21.15.27:0/3717951359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae50370 msgr2=0x55ff2ae68290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:25.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.921+0000 7fca76ffd640 1 --2- 172.21.15.27:0/3717951359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae50370 0x55ff2ae68290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.921+0000 7fca76ffd640 1 -- 172.21.15.27:0/3717951359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae455d0 msgr2=0x55ff2ae67810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:25.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.921+0000 7fca76ffd640 1 --2- 172.21.15.27:0/3717951359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae455d0 0x55ff2ae67810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.921+0000 7fca76ffd640 1 -- 172.21.15.27:0/3717951359 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff2ae56a90 con 0x55ff2ae46b40 2024-09-19T08:11:25.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.921+0000 7fca767fc640 1 --2- 172.21.15.27:0/3717951359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae50370 0x55ff2ae68290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:25.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.922+0000 7fca76ffd640 1 --2- 172.21.15.27:0/3717951359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae46b40 0x55ff2ae67d50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fca70004010 tx=0x7fca70010530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0893e3162826325 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:25.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.922+0000 7fca5e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:25.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.922+0000 7fca5e7fc640 1 -- 172.21.15.27:0/3717951359 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca70010a10 con 0x55ff2ae46b40 2024-09-19T08:11:25.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.922+0000 7fca5e7fc640 1 -- 172.21.15.27:0/3717951359 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fca70010bb0 con 0x55ff2ae46b40 2024-09-19T08:11:25.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.922+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3717951359 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca60004c80 con 0x55ff2ae46b40 2024-09-19T08:11:25.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.922+0000 7fca5e7fc640 1 -- 172.21.15.27:0/3717951359 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fca70009c80 con 0x55ff2ae46b40 2024-09-19T08:11:25.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.922+0000 7fca7f9f7740 10 client.15399 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:25.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.922+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3717951359 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ff2aecaeb0 con 0x55ff2ae46b40 2024-09-19T08:11:25.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.922+0000 7fca5e7fc640 1 -- 172.21.15.27:0/3717951359 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca60004c80 con 0x55ff2ae46b40 2024-09-19T08:11:25.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.922+0000 7fca5e7fc640 1 -- 172.21.15.27:0/3717951359 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fca700304d0 con 0x55ff2ae46b40 2024-09-19T08:11:25.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.922+0000 7fca7f9f7740 10 client.15399 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:25.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.922+0000 7fca7f9f7740 10 client.15399 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:25.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.922+0000 7fca7f9f7740 20 client.15399 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:25.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.923+0000 7fca7f9f7740 1 --2- 172.21.15.27:0/3717951359 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ff2aecb2a0 0x55ff2aecd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:25.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.923+0000 7fca7f9f7740 4 client.15399 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:11:25.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.923+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3717951359 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ff2adb2d70 con 0x55ff2aecb2a0 2024-09-19T08:11:25.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.923+0000 7fca767fc640 1 --2- 172.21.15.27:0/3717951359 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ff2aecb2a0 0x55ff2aecd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:25.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.923+0000 7fca5e7fc640 10 client.15399 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:25.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.923+0000 7fca767fc640 1 --2- 172.21.15.27:0/3717951359 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ff2aecb2a0 0x55ff2aecd6c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e80fa96c983d3f09 server_cookie=162a973c33b40561 in_seq=0 out_seq=0 2024-09-19T08:11:25.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.923+0000 7fca5e7fc640 1 -- 172.21.15.27:0/3717951359 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ff2adb2d70 con 0x55ff2aecb2a0 2024-09-19T08:11:25.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.923+0000 7fca5e7fc640 10 client.15399 handle_command_reply: tid=0 2024-09-19T08:11:25.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.923+0000 7fca7f9f7740 1 client.15399 shutdown 2024-09-19T08:11:25.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.923+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3717951359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae46b40 msgr2=0x55ff2ae67d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:25.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.923+0000 7fca7f9f7740 1 --2- 172.21.15.27:0/3717951359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae46b40 0x55ff2ae67d50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fca70004010 tx=0x7fca70010530 comp rx=0 tx=0).stop 2024-09-19T08:11:25.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.923+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3717951359 shutdown_connections 2024-09-19T08:11:25.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.923+0000 7fca7f9f7740 1 --2- 172.21.15.27:0/3717951359 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ff2aecb2a0 0x55ff2aecd6c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.923+0000 7fca7f9f7740 1 --2- 172.21.15.27:0/3717951359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff2ae50370 0x55ff2ae68290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.923+0000 7fca7f9f7740 1 --2- 172.21.15.27:0/3717951359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ff2ae46b40 0x55ff2ae67d50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.924+0000 7fca7f9f7740 1 --2- 172.21.15.27:0/3717951359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff2ae455d0 0x55ff2ae67810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.924+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3717951359 >> 172.21.15.27:0/3717951359 conn(0x55ff2ae0e310 msgr2=0x55ff2ae4efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:25.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.924+0000 7fca5e7fc640 0 client.15399 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:25.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.924+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3717951359 shutdown_connections 2024-09-19T08:11:25.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.924+0000 7fca7f9f7740 1 -- 172.21.15.27:0/3717951359 wait complete. 2024-09-19T08:11:25.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.924+0000 7fca7f9f7740 20 client.15399 trim_cache size 0 max 16384 2024-09-19T08:11:25.930 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:11:25.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.924+0000 7fca7d61e640 1 -- 172.21.15.27:0/2520400106 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fca640a3440 msgr2=0x7fca640a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:25.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.924+0000 7fca7d61e640 1 --2- 172.21.15.27:0/2520400106 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fca640a3440 0x7fca640a5900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fca680edda0 tx=0x7fca680e75f0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.924+0000 7fca7d61e640 1 -- 172.21.15.27:0/2520400106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca78102ef0 msgr2=0x7fca7810ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:25.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.924+0000 7fca7d61e640 1 --2- 172.21.15.27:0/2520400106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca78102ef0 0x7fca7810ef50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fca68004770 tx=0x7fca68003c10 comp rx=0 tx=0).stop 2024-09-19T08:11:25.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.924+0000 7fca7d61e640 1 -- 172.21.15.27:0/2520400106 shutdown_connections 2024-09-19T08:11:25.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.924+0000 7fca7d61e640 1 --2- 172.21.15.27:0/2520400106 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fca640a3440 0x7fca640a5900 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.924+0000 7fca7d61e640 1 --2- 172.21.15.27:0/2520400106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca78102ef0 0x7fca7810ef50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.924+0000 7fca7d61e640 1 --2- 172.21.15.27:0/2520400106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca78102570 0x7fca7810ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.924+0000 7fca7d61e640 1 --2- 172.21.15.27:0/2520400106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca78100e20 0x7fca7810e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:25.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.924+0000 7fca7d61e640 1 -- 172.21.15.27:0/2520400106 >> 172.21.15.27:0/2520400106 conn(0x7fca780fc7d0 msgr2=0x7fca781067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:25.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.924+0000 7fca7d61e640 1 -- 172.21.15.27:0/2520400106 shutdown_connections 2024-09-19T08:11:25.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:25.925+0000 7fca7d61e640 1 -- 172.21.15.27:0/2520400106 wait complete. 2024-09-19T08:11:26.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:25 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3070192029' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:11:26.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:25 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3070192029' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:11:26.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:25 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3070192029' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:11:26.352 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-19T08:11:26.689 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:27.119 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:26 smithi027 ceph-mon[31209]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:11:27.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:26 smithi155 ceph-mon[35362]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:11:27.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:26 smithi203 ceph-mon[35198]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:11:28.148 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:11:28.149 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:11:28.275 INFO:teuthology.orchestra.run.smithi027.stdout:{"run_dir":"/var/run/ceph"} 2024-09-19T08:11:28.275 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-19T08:11:28.276 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1747 2024-09-19T08:11:28.276 DEBUG:tasks.quiescer:Yielding 2024-09-19T08:11:28.276 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T08:11:28.290 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T08:11:28.290 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T08:11:28.290 INFO:tasks.workunit:timeout=3h 2024-09-19T08:11:28.290 INFO:tasks.workunit:cleanup=True 2024-09-19T08:11:28.291 DEBUG:teuthology.orchestra.run.smithi027:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T08:11:28.291 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:11:28.308 INFO:teuthology.orchestra.run.smithi027.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T08:11:28.308 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-19T08:11:28.308 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 60h/96d Inode: 1099511628283 Links: 2 2024-09-19T08:11:28.308 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:11:28.308 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T08:11:28.308 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-09-19 08:09:28.018950196 +0000 2024-09-19T08:11:28.308 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-09-19 08:09:28.018950196 +0000 2024-09-19T08:11:28.308 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-09-19 08:10:59.503245780 +0000 2024-09-19T08:11:28.308 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-09-19 08:09:28.018950196 +0000 2024-09-19T08:11:28.308 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T08:11:28.309 DEBUG:teuthology.orchestra.run.smithi027:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T08:11:28.384 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T08:11:28.419 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:28.436 INFO:tasks.workunit.client.0.smithi027.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T08:11:28.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.947+0000 7f40349b2640 1 -- 172.21.15.27:0/2935898299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4030103660 msgr2=0x7f403010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:28.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.947+0000 7f40349b2640 1 --2- 172.21.15.27:0/2935898299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4030103660 0x7f403010bb50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4024009900 tx=0x7f402402a480 comp rx=0 tx=0).stop 2024-09-19T08:11:28.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.947+0000 7f40349b2640 1 -- 172.21.15.27:0/2935898299 shutdown_connections 2024-09-19T08:11:28.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.947+0000 7f40349b2640 1 --2- 172.21.15.27:0/2935898299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f403010c170 0x7f403010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.947+0000 7f40349b2640 1 --2- 172.21.15.27:0/2935898299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4030103660 0x7f403010bb50 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.947+0000 7f40349b2640 1 --2- 172.21.15.27:0/2935898299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4030102d40 0x7f4030103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.947+0000 7f40349b2640 1 -- 172.21.15.27:0/2935898299 >> 172.21.15.27:0/2935898299 conn(0x7f40300fc7a0 msgr2=0x7f40300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:28.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.947+0000 7f40349b2640 1 -- 172.21.15.27:0/2935898299 shutdown_connections 2024-09-19T08:11:28.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.947+0000 7f40349b2640 1 -- 172.21.15.27:0/2935898299 wait complete. 2024-09-19T08:11:28.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.948+0000 7f40349b2640 1 Processor -- start 2024-09-19T08:11:28.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.948+0000 7f40349b2640 1 -- start start 2024-09-19T08:11:28.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.948+0000 7f40349b2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4030102d40 0x7f40301009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:28.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.948+0000 7f40349b2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4030103660 0x7f4030100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:28.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.948+0000 7f40349b2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f403010c170 0x7f4030101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:28.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.948+0000 7f40349b2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4030111f70 con 0x7f4030103660 2024-09-19T08:11:28.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.948+0000 7f40349b2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4030111df0 con 0x7f4030102d40 2024-09-19T08:11:28.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.948+0000 7f40349b2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f40301120f0 con 0x7f403010c170 2024-09-19T08:11:28.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.948+0000 7f402dd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4030103660 0x7f4030100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:28.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.948+0000 7f402dd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4030103660 0x7f4030100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46206/0 (socket says 172.21.15.27:46206) 2024-09-19T08:11:28.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.948+0000 7f402dd9b640 1 -- 172.21.15.27:0/3418132068 learned_addr learned my addr 172.21.15.27:0/3418132068 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:28.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.948+0000 7f402e59c640 1 --2- 172.21.15.27:0/3418132068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4030102d40 0x7f40301009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:28.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.948+0000 7f402ed9d640 1 --2- 172.21.15.27:0/3418132068 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f403010c170 0x7f4030101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:28.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.949+0000 7f402dd9b640 1 -- 172.21.15.27:0/3418132068 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f403010c170 msgr2=0x7f4030101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:28.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.949+0000 7f402dd9b640 1 --2- 172.21.15.27:0/3418132068 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f403010c170 0x7f4030101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.949+0000 7f402dd9b640 1 -- 172.21.15.27:0/3418132068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4030102d40 msgr2=0x7f40301009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:28.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.949+0000 7f402dd9b640 1 --2- 172.21.15.27:0/3418132068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4030102d40 0x7f40301009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.949+0000 7f402dd9b640 1 -- 172.21.15.27:0/3418132068 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40301a6980 con 0x7f4030103660 2024-09-19T08:11:28.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.949+0000 7f402e59c640 1 --2- 172.21.15.27:0/3418132068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4030102d40 0x7f40301009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:11:28.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.949+0000 7f402dd9b640 1 --2- 172.21.15.27:0/3418132068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4030103660 0x7f4030100ee0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4024006010 tx=0x7f4024004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:28.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.949+0000 7f401f7fe640 1 -- 172.21.15.27:0/3418132068 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402403f030 con 0x7f4030103660 2024-09-19T08:11:28.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.949+0000 7f401f7fe640 1 -- 172.21.15.27:0/3418132068 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4024004440 con 0x7f4030103660 2024-09-19T08:11:28.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.949+0000 7f40349b2640 1 -- 172.21.15.27:0/3418132068 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40301a6c10 con 0x7f4030103660 2024-09-19T08:11:28.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.949+0000 7f401f7fe640 1 -- 172.21.15.27:0/3418132068 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4024035070 con 0x7f4030103660 2024-09-19T08:11:28.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.949+0000 7f40349b2640 1 -- 172.21.15.27:0/3418132068 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40301a7140 con 0x7f4030103660 2024-09-19T08:11:28.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.952+0000 7f401f7fe640 1 -- 172.21.15.27:0/3418132068 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f4024042030 con 0x7f4030103660 2024-09-19T08:11:28.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.952+0000 7f4036d8b740 1 Processor -- start 2024-09-19T08:11:28.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.953+0000 7f4036d8b740 1 -- start start 2024-09-19T08:11:28.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.953+0000 7f4036d8b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e57fb60 0x56091e57ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:28.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.953+0000 7f4036d8b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e580480 0x56091e58a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:28.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.953+0000 7f4036d8b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e58ad40 0x56091e58d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:28.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.953+0000 7f4036d8b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56091e4e5280 con 0x56091e580480 2024-09-19T08:11:28.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.953+0000 7f4036d8b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56091e48cb10 con 0x56091e57fb60 2024-09-19T08:11:28.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.953+0000 7f4036d8b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56091e4e1240 con 0x56091e58ad40 2024-09-19T08:11:28.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.953+0000 7f401f7fe640 1 --2- 172.21.15.27:0/3418132068 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f40180a34c0 0x7f40180a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:28.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.953+0000 7f402e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e580480 0x56091e58a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:28.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.953+0000 7f402e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e580480 0x56091e58a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46220/0 (socket says 172.21.15.27:46220) 2024-09-19T08:11:28.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.953+0000 7f402e59c640 1 -- 172.21.15.27:0/3398435078 learned_addr learned my addr 172.21.15.27:0/3398435078 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:28.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.953+0000 7f402ed9d640 1 --2- 172.21.15.27:0/3398435078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e57fb60 0x56091e57ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:28.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.953+0000 7f401f7fe640 1 -- 172.21.15.27:0/3418132068 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f40240f0090 con 0x7f4030103660 2024-09-19T08:11:28.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.953+0000 7f402ed9d640 1 --2- 172.21.15.27:0/3418132068 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f40180a34c0 0x7f40180a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:28.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.953+0000 7f402dd9b640 1 --2- 172.21.15.27:0/3398435078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e58ad40 0x56091e58d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:28.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.953+0000 7f402e59c640 1 -- 172.21.15.27:0/3398435078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e58ad40 msgr2=0x56091e58d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:28.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.954+0000 7f402e59c640 1 --2- 172.21.15.27:0/3398435078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e58ad40 0x56091e58d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.954+0000 7f402e59c640 1 -- 172.21.15.27:0/3398435078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e57fb60 msgr2=0x56091e57ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:28.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.954+0000 7f402e59c640 1 --2- 172.21.15.27:0/3398435078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e57fb60 0x56091e57ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.954+0000 7f402e59c640 1 -- 172.21.15.27:0/3398435078 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56091e4991f0 con 0x56091e580480 2024-09-19T08:11:28.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.954+0000 7f402e59c640 1 --2- 172.21.15.27:0/3398435078 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e580480 0x56091e58a800 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f40200115f0 tx=0x7f4020011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5563188a643555b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:28.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.954+0000 7f402ed9d640 1 --2- 172.21.15.27:0/3418132068 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f40180a34c0 0x7f40180a5980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4028009fd0 tx=0x7f4028009600 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:28.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.954+0000 7f401cff9640 1 -- 172.21.15.27:0/3398435078 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402001e070 con 0x56091e580480 2024-09-19T08:11:28.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.954+0000 7f401cff9640 1 -- 172.21.15.27:0/3398435078 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f402000fb20 con 0x56091e580480 2024-09-19T08:11:28.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.954+0000 7f401cff9640 1 -- 172.21.15.27:0/3398435078 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4020019bd0 con 0x56091e580480 2024-09-19T08:11:28.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.955+0000 7f4036d8b740 1 -- 172.21.15.27:0/3398435078 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e580480 msgr2=0x56091e58a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:28.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.955+0000 7f4036d8b740 1 --2- 172.21.15.27:0/3398435078 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e580480 0x56091e58a800 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f40200115f0 tx=0x7f4020011ab0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.955+0000 7f4036d8b740 1 -- 172.21.15.27:0/3398435078 shutdown_connections 2024-09-19T08:11:28.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.955+0000 7f4036d8b740 1 --2- 172.21.15.27:0/3398435078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e58ad40 0x56091e58d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.955+0000 7f4036d8b740 1 --2- 172.21.15.27:0/3398435078 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e580480 0x56091e58a800 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.955+0000 7f4036d8b740 1 --2- 172.21.15.27:0/3398435078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e57fb60 0x56091e57ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.955+0000 7f4036d8b740 1 -- 172.21.15.27:0/3398435078 >> 172.21.15.27:0/3398435078 conn(0x56091e57c0f0 msgr2=0x56091e57c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:28.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.955+0000 7f4036d8b740 1 -- 172.21.15.27:0/3398435078 shutdown_connections 2024-09-19T08:11:28.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.955+0000 7f4036d8b740 1 -- 172.21.15.27:0/3398435078 wait complete. 2024-09-19T08:11:28.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.955+0000 7f4036d8b740 1 -- start start 2024-09-19T08:11:28.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.955+0000 7f4036d8b740 1 Processor -- start 2024-09-19T08:11:28.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f4036d8b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 0x56091e587ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:28.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f4036d8b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e580480 0x56091e5881e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:28.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f4036d8b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e58ad40 0x56091e588720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:28.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f4036d8b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56091e58d910 con 0x56091e57fb60 2024-09-19T08:11:28.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f4036d8b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56091e49ff10 con 0x56091e580480 2024-09-19T08:11:28.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f4036d8b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56091e58da90 con 0x56091e58ad40 2024-09-19T08:11:28.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f4036d8b740 10 client.0 _ll_register_callbacks cb 0x56091e468a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:28.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f402e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 0x56091e587ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:28.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f402e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 0x56091e587ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46226/0 (socket says 172.21.15.27:46226) 2024-09-19T08:11:28.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f402e59c640 1 -- 172.21.15.27:0/3874655161 learned_addr learned my addr 172.21.15.27:0/3874655161 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:28.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f402ed9d640 1 --2- 172.21.15.27:0/3874655161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e58ad40 0x56091e588720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:28.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f402e59c640 1 -- 172.21.15.27:0/3874655161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e58ad40 msgr2=0x56091e588720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:28.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f402dd9b640 1 --2- 172.21.15.27:0/3874655161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e580480 0x56091e5881e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:28.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f402e59c640 1 --2- 172.21.15.27:0/3874655161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e58ad40 0x56091e588720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f402e59c640 1 -- 172.21.15.27:0/3874655161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e580480 msgr2=0x56091e5881e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:28.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f402e59c640 1 --2- 172.21.15.27:0/3874655161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e580480 0x56091e5881e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f402e59c640 1 -- 172.21.15.27:0/3874655161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56091e2566a0 con 0x56091e57fb60 2024-09-19T08:11:28.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f402ed9d640 1 --2- 172.21.15.27:0/3874655161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e58ad40 0x56091e588720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:11:28.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f402dd9b640 1 --2- 172.21.15.27:0/3874655161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e580480 0x56091e5881e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:11:28.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f402e59c640 1 --2- 172.21.15.27:0/3874655161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 0x56091e587ca0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f402000f850 tx=0x7f402000f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5012b528bab4d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:28.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f4015ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:28.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.956+0000 7f4015ffb640 1 -- 172.21.15.27:0/3874655161 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4020027060 con 0x56091e57fb60 2024-09-19T08:11:28.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.957+0000 7f4015ffb640 1 -- 172.21.15.27:0/3874655161 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f4020004030 con 0x56091e57fb60 2024-09-19T08:11:28.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.957+0000 7f4036d8b740 1 -- 172.21.15.27:0/3874655161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f402000fb20 con 0x56091e57fb60 2024-09-19T08:11:28.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.957+0000 7f4015ffb640 1 -- 172.21.15.27:0/3874655161 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f402001e040 con 0x56091e57fb60 2024-09-19T08:11:28.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.957+0000 7f4036d8b740 10 client.15411 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:28.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.957+0000 7f4036d8b740 1 -- 172.21.15.27:0/3874655161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56091e599500 con 0x56091e57fb60 2024-09-19T08:11:28.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.957+0000 7f4015ffb640 1 -- 172.21.15.27:0/3874655161 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f402000fb20 con 0x56091e57fb60 2024-09-19T08:11:28.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.957+0000 7f4015ffb640 1 -- 172.21.15.27:0/3874655161 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f40200035f0 con 0x56091e57fb60 2024-09-19T08:11:28.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.957+0000 7f4036d8b740 10 client.15411 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:28.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.957+0000 7f4036d8b740 10 client.15411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:28.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.957+0000 7f4036d8b740 20 client.15411 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:28.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.957+0000 7f4036d8b740 1 --2- 172.21.15.27:0/3874655161 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56091e59a9c0 0x56091e59cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:28.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.957+0000 7f4036d8b740 4 client.15411 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:11:28.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.957+0000 7f4036d8b740 1 -- 172.21.15.27:0/3874655161 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56091e4f27f0 con 0x56091e59a9c0 2024-09-19T08:11:28.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.958+0000 7f402dd9b640 1 --2- 172.21.15.27:0/3874655161 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56091e59a9c0 0x56091e59cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:28.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.958+0000 7f402dd9b640 1 --2- 172.21.15.27:0/3874655161 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56091e59a9c0 0x56091e59cdb0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=768f2c948934a248 server_cookie=3511eef48476e9e9 in_seq=0 out_seq=0 2024-09-19T08:11:28.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.958+0000 7f4015ffb640 10 client.15411 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:28.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.959+0000 7f4015ffb640 1 -- 172.21.15.27:0/3874655161 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56091e4f27f0 con 0x56091e59a9c0 2024-09-19T08:11:28.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.959+0000 7f4015ffb640 10 client.15411 handle_command_reply: tid=0 2024-09-19T08:11:28.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.959+0000 7f4036d8b740 1 client.15411 shutdown 2024-09-19T08:11:28.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.959+0000 7f4036d8b740 1 -- 172.21.15.27:0/3874655161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 msgr2=0x56091e587ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:28.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.959+0000 7f4036d8b740 1 --2- 172.21.15.27:0/3874655161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 0x56091e587ca0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f402000f850 tx=0x7f402000f880 comp rx=0 tx=0).stop 2024-09-19T08:11:28.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.959+0000 7f4036d8b740 1 -- 172.21.15.27:0/3874655161 shutdown_connections 2024-09-19T08:11:28.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.959+0000 7f4036d8b740 1 --2- 172.21.15.27:0/3874655161 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56091e59a9c0 0x56091e59cdb0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.959+0000 7f4036d8b740 1 --2- 172.21.15.27:0/3874655161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e58ad40 0x56091e588720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.959+0000 7f4036d8b740 1 --2- 172.21.15.27:0/3874655161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e580480 0x56091e5881e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.959+0000 7f4036d8b740 1 --2- 172.21.15.27:0/3874655161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 0x56091e587ca0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.959+0000 7f4036d8b740 1 -- 172.21.15.27:0/3874655161 >> 172.21.15.27:0/3874655161 conn(0x56091e57c0f0 msgr2=0x56091e57b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:28.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.959+0000 7f4015ffb640 0 client.15411 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:28.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.959+0000 7f4036d8b740 1 -- 172.21.15.27:0/3874655161 shutdown_connections 2024-09-19T08:11:28.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.959+0000 7f4036d8b740 1 -- 172.21.15.27:0/3874655161 wait complete. 2024-09-19T08:11:28.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.959+0000 7f4036d8b740 20 client.15411 trim_cache size 0 max 16384 2024-09-19T08:11:28.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.977+0000 7f4036d8b740 1 Processor -- start 2024-09-19T08:11:28.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.977+0000 7f4036d8b740 1 -- start start 2024-09-19T08:11:28.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.977+0000 7f4036d8b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e57c0f0 0x56091e5825e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:28.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.978+0000 7f4036d8b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 0x56091e5a24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:28.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.978+0000 7f4036d8b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e580480 0x56091e5a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:28.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.978+0000 7f4036d8b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f40301ad980 con 0x56091e57fb60 2024-09-19T08:11:28.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.978+0000 7f4036d8b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f40301b0200 con 0x56091e57c0f0 2024-09-19T08:11:28.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.978+0000 7f4036d8b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f40301adff0 con 0x56091e580480 2024-09-19T08:11:28.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.978+0000 7f402dd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 0x56091e5a24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:28.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.978+0000 7f402dd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 0x56091e5a24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46242/0 (socket says 172.21.15.27:46242) 2024-09-19T08:11:28.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.978+0000 7f402dd9b640 1 -- 172.21.15.27:0/3888755085 learned_addr learned my addr 172.21.15.27:0/3888755085 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:28.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.978+0000 7f402ed9d640 1 --2- 172.21.15.27:0/3888755085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e580480 0x56091e5a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:28.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.978+0000 7f402e59c640 1 --2- 172.21.15.27:0/3888755085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e57c0f0 0x56091e5825e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:28.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.978+0000 7f402dd9b640 1 -- 172.21.15.27:0/3888755085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e580480 msgr2=0x56091e5a2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:28.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.978+0000 7f402dd9b640 1 --2- 172.21.15.27:0/3888755085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e580480 0x56091e5a2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.978+0000 7f402dd9b640 1 -- 172.21.15.27:0/3888755085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e57c0f0 msgr2=0x56091e5825e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:28.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.978+0000 7f402dd9b640 1 --2- 172.21.15.27:0/3888755085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e57c0f0 0x56091e5825e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.978+0000 7f402dd9b640 1 -- 172.21.15.27:0/3888755085 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56091e57bb90 con 0x56091e57fb60 2024-09-19T08:11:28.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.978+0000 7f402ed9d640 1 --2- 172.21.15.27:0/3888755085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e580480 0x56091e5a2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:28.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.978+0000 7f402e59c640 1 --2- 172.21.15.27:0/3888755085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e57c0f0 0x56091e5825e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:28.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.978+0000 7f402dd9b640 1 --2- 172.21.15.27:0/3888755085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 0x56091e5a24f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4024005ab0 tx=0x7f402402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f553170ceed41e89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:28.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.979+0000 7f4017fff640 1 -- 172.21.15.27:0/3888755085 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4024049040 con 0x56091e57fb60 2024-09-19T08:11:28.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.979+0000 7f4017fff640 1 -- 172.21.15.27:0/3888755085 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40240c06a0 con 0x56091e57fb60 2024-09-19T08:11:28.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.979+0000 7f4017fff640 1 -- 172.21.15.27:0/3888755085 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40240b8a10 con 0x56091e57fb60 2024-09-19T08:11:28.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.979+0000 7f4036d8b740 1 -- 172.21.15.27:0/3888755085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 msgr2=0x56091e5a24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:28.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.979+0000 7f4036d8b740 1 --2- 172.21.15.27:0/3888755085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 0x56091e5a24f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4024005ab0 tx=0x7f402402a480 comp rx=0 tx=0).stop 2024-09-19T08:11:28.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.980+0000 7f4036d8b740 1 -- 172.21.15.27:0/3888755085 shutdown_connections 2024-09-19T08:11:28.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.980+0000 7f4036d8b740 1 --2- 172.21.15.27:0/3888755085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e580480 0x56091e5a2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.980+0000 7f4036d8b740 1 --2- 172.21.15.27:0/3888755085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 0x56091e5a24f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.980+0000 7f4036d8b740 1 --2- 172.21.15.27:0/3888755085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e57c0f0 0x56091e5825e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.980+0000 7f4036d8b740 1 -- 172.21.15.27:0/3888755085 >> 172.21.15.27:0/3888755085 conn(0x56091e59d0b0 msgr2=0x56091e586d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:28.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.980+0000 7f4036d8b740 1 -- 172.21.15.27:0/3888755085 shutdown_connections 2024-09-19T08:11:28.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.980+0000 7f4036d8b740 1 -- 172.21.15.27:0/3888755085 wait complete. 2024-09-19T08:11:28.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.980+0000 7f4036d8b740 1 -- start start 2024-09-19T08:11:28.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.980+0000 7f4036d8b740 1 Processor -- start 2024-09-19T08:11:28.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.981+0000 7f4036d8b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e57c0f0 0x56091e5fd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:28.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.981+0000 7f4036d8b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 0x56091e5fdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:28.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.981+0000 7f4036d8b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e580480 0x56091e58e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:28.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.981+0000 7f4036d8b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f40301ae6c0 con 0x56091e57fb60 2024-09-19T08:11:28.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.981+0000 7f4036d8b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f40301afb30 con 0x56091e57c0f0 2024-09-19T08:11:28.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.981+0000 7f4036d8b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f40301aed90 con 0x56091e580480 2024-09-19T08:11:28.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.981+0000 7f4036d8b740 10 client.0 _ll_register_callbacks cb 0x7f402001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:28.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.981+0000 7f402dd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 0x56091e5fdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:28.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.981+0000 7f402dd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 0x56091e5fdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46256/0 (socket says 172.21.15.27:46256) 2024-09-19T08:11:28.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.981+0000 7f402dd9b640 1 -- 172.21.15.27:0/1024148597 learned_addr learned my addr 172.21.15.27:0/1024148597 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:28.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.981+0000 7f402e59c640 1 --2- 172.21.15.27:0/1024148597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e57c0f0 0x56091e5fd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:28.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.981+0000 7f402ed9d640 1 --2- 172.21.15.27:0/1024148597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e580480 0x56091e58e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:28.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.981+0000 7f402dd9b640 1 -- 172.21.15.27:0/1024148597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e580480 msgr2=0x56091e58e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:28.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.981+0000 7f402dd9b640 1 --2- 172.21.15.27:0/1024148597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e580480 0x56091e58e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.981+0000 7f402dd9b640 1 -- 172.21.15.27:0/1024148597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e57c0f0 msgr2=0x56091e5fd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:28.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.981+0000 7f402dd9b640 1 --2- 172.21.15.27:0/1024148597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e57c0f0 0x56091e5fd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.981+0000 7f402dd9b640 1 -- 172.21.15.27:0/1024148597 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56091e58e950 con 0x56091e57fb60 2024-09-19T08:11:28.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.982+0000 7f402dd9b640 1 --2- 172.21.15.27:0/1024148597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 0x56091e5fdcf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f40240b8800 tx=0x7f40240ed7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b617b2c2c52e9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:28.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.982+0000 7f4015ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:28.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.982+0000 7f4015ffb640 1 -- 172.21.15.27:0/1024148597 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4024049050 con 0x56091e57fb60 2024-09-19T08:11:28.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.982+0000 7f4015ffb640 1 -- 172.21.15.27:0/1024148597 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f4024003cd0 con 0x56091e57fb60 2024-09-19T08:11:28.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.982+0000 7f4036d8b740 1 -- 172.21.15.27:0/1024148597 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40240c06a0 con 0x56091e57fb60 2024-09-19T08:11:28.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.982+0000 7f4015ffb640 1 -- 172.21.15.27:0/1024148597 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f40240ba440 con 0x56091e57fb60 2024-09-19T08:11:28.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.982+0000 7f4036d8b740 10 client.15417 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:28.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.982+0000 7f4036d8b740 1 -- 172.21.15.27:0/1024148597 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56091e604ff0 con 0x56091e57fb60 2024-09-19T08:11:28.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.982+0000 7f4015ffb640 1 -- 172.21.15.27:0/1024148597 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40240c06a0 con 0x56091e57fb60 2024-09-19T08:11:28.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.982+0000 7f4015ffb640 1 -- 172.21.15.27:0/1024148597 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f40240c4ad0 con 0x56091e57fb60 2024-09-19T08:11:28.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.982+0000 7f4036d8b740 10 client.15417 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:28.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.983+0000 7f4036d8b740 10 client.15417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:28.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.983+0000 7f4036d8b740 20 client.15417 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:28.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.983+0000 7f4036d8b740 1 --2- 172.21.15.27:0/1024148597 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56091e58ad40 0x56091e607620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:28.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.983+0000 7f4036d8b740 4 client.15417 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:11:28.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.983+0000 7f4036d8b740 1 -- 172.21.15.27:0/1024148597 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56091e4ecd00 con 0x56091e58ad40 2024-09-19T08:11:28.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.983+0000 7f402e59c640 1 --2- 172.21.15.27:0/1024148597 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56091e58ad40 0x56091e607620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:28.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.983+0000 7f4015ffb640 10 client.15417 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:28.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.983+0000 7f402e59c640 1 --2- 172.21.15.27:0/1024148597 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56091e58ad40 0x56091e607620 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd100d871d93b2ea server_cookie=92589a9b24bc6376 in_seq=0 out_seq=0 2024-09-19T08:11:28.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.984+0000 7f4015ffb640 1 -- 172.21.15.27:0/1024148597 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56091e4ecd00 con 0x56091e58ad40 2024-09-19T08:11:28.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.984+0000 7f4015ffb640 10 client.15417 handle_command_reply: tid=0 2024-09-19T08:11:28.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.984+0000 7f4036d8b740 1 client.15417 shutdown 2024-09-19T08:11:28.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.985+0000 7f4036d8b740 1 -- 172.21.15.27:0/1024148597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 msgr2=0x56091e5fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:28.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.985+0000 7f4036d8b740 1 --2- 172.21.15.27:0/1024148597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 0x56091e5fdcf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f40240b8800 tx=0x7f40240ed7e0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.985+0000 7f4036d8b740 1 -- 172.21.15.27:0/1024148597 shutdown_connections 2024-09-19T08:11:28.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.985+0000 7f4036d8b740 1 --2- 172.21.15.27:0/1024148597 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56091e58ad40 0x56091e607620 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.985+0000 7f4015ffb640 0 client.15417 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:28.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.985+0000 7f4036d8b740 1 --2- 172.21.15.27:0/1024148597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56091e580480 0x56091e58e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.985+0000 7f4036d8b740 1 --2- 172.21.15.27:0/1024148597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56091e57fb60 0x56091e5fdcf0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.985+0000 7f4036d8b740 1 --2- 172.21.15.27:0/1024148597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56091e57c0f0 0x56091e5fd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.985+0000 7f4036d8b740 1 -- 172.21.15.27:0/1024148597 >> 172.21.15.27:0/1024148597 conn(0x56091e59d0b0 msgr2=0x56091e587c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:28.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.985+0000 7f4036d8b740 1 -- 172.21.15.27:0/1024148597 shutdown_connections 2024-09-19T08:11:28.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.985+0000 7f4036d8b740 1 -- 172.21.15.27:0/1024148597 wait complete. 2024-09-19T08:11:28.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.985+0000 7f4036d8b740 20 client.15417 trim_cache size 0 max 16384 2024-09-19T08:11:28.989 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:11:28.989 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:11:28.990 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "c6937192-b025-4697-9c5c-bfc4759b10c3", 2024-09-19T08:11:28.990 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:11:28.990 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:11:28.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.986+0000 7f40349b2640 1 -- 172.21.15.27:0/3418132068 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f40180a34c0 msgr2=0x7f40180a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:28.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.986+0000 7f40349b2640 1 --2- 172.21.15.27:0/3418132068 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f40180a34c0 0x7f40180a5980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4028009fd0 tx=0x7f4028009600 comp rx=0 tx=0).stop 2024-09-19T08:11:28.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.986+0000 7f40349b2640 1 -- 172.21.15.27:0/3418132068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4030103660 msgr2=0x7f4030100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:28.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.986+0000 7f40349b2640 1 --2- 172.21.15.27:0/3418132068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4030103660 0x7f4030100ee0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4024006010 tx=0x7f4024004040 comp rx=0 tx=0).stop 2024-09-19T08:11:28.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.986+0000 7f40349b2640 1 -- 172.21.15.27:0/3418132068 shutdown_connections 2024-09-19T08:11:28.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.986+0000 7f40349b2640 1 --2- 172.21.15.27:0/3418132068 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f40180a34c0 0x7f40180a5980 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.986+0000 7f40349b2640 1 --2- 172.21.15.27:0/3418132068 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f403010c170 0x7f4030101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.986+0000 7f40349b2640 1 --2- 172.21.15.27:0/3418132068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4030103660 0x7f4030100ee0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.986+0000 7f40349b2640 1 --2- 172.21.15.27:0/3418132068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4030102d40 0x7f40301009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:28.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.986+0000 7f40349b2640 1 -- 172.21.15.27:0/3418132068 >> 172.21.15.27:0/3418132068 conn(0x7f40300fc7a0 msgr2=0x7f40300fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:28.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.987+0000 7f40349b2640 1 -- 172.21.15.27:0/3418132068 shutdown_connections 2024-09-19T08:11:28.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:28.987+0000 7f40349b2640 1 -- 172.21.15.27:0/3418132068 wait complete. 2024-09-19T08:11:29.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:28 smithi155 ceph-mon[35362]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:11:29.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:28 smithi027 ceph-mon[31209]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:11:29.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:28 smithi203 ceph-mon[35198]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:11:29.701 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:11:29.763 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:30.210 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:29 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:11:30.210 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:29 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:30.211 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:29 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:11:30.211 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:29 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:30.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:29 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:11:30.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:29 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:30.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:29 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:11:30.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:29 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:30.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:29 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:11:30.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:29 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:30.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:29 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:11:30.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:29 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:30.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.292+0000 7f2f1234e640 1 -- 172.21.15.27:0/4036144998 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f0c106f10 msgr2=0x7f2f0c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:30.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.292+0000 7f2f1234e640 1 --2- 172.21.15.27:0/4036144998 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f0c106f10 0x7f2f0c10ea90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009ca0 tx=0x7f2f0402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:11:30.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.292+0000 7f2f1234e640 1 -- 172.21.15.27:0/4036144998 shutdown_connections 2024-09-19T08:11:30.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.292+0000 7f2f1234e640 1 --2- 172.21.15.27:0/4036144998 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f0c106f10 0x7f2f0c10ea90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:30.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.292+0000 7f2f1234e640 1 --2- 172.21.15.27:0/4036144998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f0c102790 0x7f2f0c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:30.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.292+0000 7f2f1234e640 1 --2- 172.21.15.27:0/4036144998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f0c101de0 0x7f2f0c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:30.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.292+0000 7f2f1234e640 1 -- 172.21.15.27:0/4036144998 >> 172.21.15.27:0/4036144998 conn(0x7f2f0c0fd8c0 msgr2=0x7f2f0c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:30.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.292+0000 7f2f1234e640 1 -- 172.21.15.27:0/4036144998 shutdown_connections 2024-09-19T08:11:30.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.292+0000 7f2f1234e640 1 -- 172.21.15.27:0/4036144998 wait complete. 2024-09-19T08:11:30.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.293+0000 7f2f1234e640 1 Processor -- start 2024-09-19T08:11:30.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.293+0000 7f2f1234e640 1 -- start start 2024-09-19T08:11:30.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.293+0000 7f2f1234e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f0c101de0 0x7f2f0c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:30.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.293+0000 7f2f1234e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f0c102790 0x7f2f0c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:30.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.293+0000 7f2f1234e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f0c106f10 0x7f2f0c19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:30.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.293+0000 7f2f1234e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c111f70 con 0x7f2f0c106f10 2024-09-19T08:11:30.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.293+0000 7f2f1234e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c111df0 con 0x7f2f0c101de0 2024-09-19T08:11:30.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.293+0000 7f2f1234e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c1120f0 con 0x7f2f0c102790 2024-09-19T08:11:30.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.293+0000 7f2f108eb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f0c106f10 0x7f2f0c19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:30.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.293+0000 7f2f108eb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f0c106f10 0x7f2f0c19eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46930/0 (socket says 172.21.15.27:46930) 2024-09-19T08:11:30.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.293+0000 7f2f108eb640 1 -- 172.21.15.27:0/3328549386 learned_addr learned my addr 172.21.15.27:0/3328549386 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:30.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.294+0000 7f2f0b7fe640 1 --2- 172.21.15.27:0/3328549386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f0c102790 0x7f2f0c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:30.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.294+0000 7f2f0bfff640 1 --2- 172.21.15.27:0/3328549386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f0c101de0 0x7f2f0c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:30.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.294+0000 7f2f108eb640 1 -- 172.21.15.27:0/3328549386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f0c102790 msgr2=0x7f2f0c19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:30.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.294+0000 7f2f108eb640 1 --2- 172.21.15.27:0/3328549386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f0c102790 0x7f2f0c19ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:30.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.294+0000 7f2f108eb640 1 -- 172.21.15.27:0/3328549386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f0c101de0 msgr2=0x7f2f0c19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:30.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.294+0000 7f2f108eb640 1 --2- 172.21.15.27:0/3328549386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f0c101de0 0x7f2f0c19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:30.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.294+0000 7f2f108eb640 1 -- 172.21.15.27:0/3328549386 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f0c19f5c0 con 0x7f2f0c106f10 2024-09-19T08:11:30.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.294+0000 7f2f0bfff640 1 --2- 172.21.15.27:0/3328549386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f0c101de0 0x7f2f0c19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:30.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.294+0000 7f2f108eb640 1 --2- 172.21.15.27:0/3328549386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f0c106f10 0x7f2f0c19eee0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2f04031a20 tx=0x7f2f04031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:30.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.294+0000 7f2f097fa640 1 -- 172.21.15.27:0/3328549386 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04003c30 con 0x7f2f0c106f10 2024-09-19T08:11:30.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.294+0000 7f2f097fa640 1 -- 172.21.15.27:0/3328549386 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f04003dd0 con 0x7f2f0c106f10 2024-09-19T08:11:30.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.294+0000 7f2f1234e640 1 -- 172.21.15.27:0/3328549386 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f0c19f850 con 0x7f2f0c106f10 2024-09-19T08:11:30.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.294+0000 7f2f097fa640 1 -- 172.21.15.27:0/3328549386 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0402fc40 con 0x7f2f0c106f10 2024-09-19T08:11:30.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.294+0000 7f2f1234e640 1 -- 172.21.15.27:0/3328549386 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f0c1a7190 con 0x7f2f0c106f10 2024-09-19T08:11:30.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.295+0000 7f2f1234e640 1 -- 172.21.15.27:0/3328549386 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f0c1021c0 con 0x7f2f0c106f10 2024-09-19T08:11:30.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.297+0000 7f2f097fa640 1 -- 172.21.15.27:0/3328549386 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f2f04004050 con 0x7f2f0c106f10 2024-09-19T08:11:30.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.297+0000 7f2f097fa640 1 --2- 172.21.15.27:0/3328549386 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2ef40a34c0 0x7f2ef40a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:30.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.297+0000 7f2f0bfff640 1 --2- 172.21.15.27:0/3328549386 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2ef40a34c0 0x7f2ef40a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:30.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.297+0000 7f2f097fa640 1 -- 172.21.15.27:0/3328549386 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f2f040f10e0 con 0x7f2f0c106f10 2024-09-19T08:11:30.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.298+0000 7f2f0bfff640 1 --2- 172.21.15.27:0/3328549386 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2ef40a34c0 0x7f2ef40a5980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0058c0 tx=0x7f2efc005850 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:30.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.300+0000 7f2f097fa640 1 -- 172.21.15.27:0/3328549386 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2f040bdb40 con 0x7f2f0c106f10 2024-09-19T08:11:30.340 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:30.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.526+0000 7f2f1234e640 1 -- 172.21.15.27:0/3328549386 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f0c19b970 con 0x7f2f0c106f10 2024-09-19T08:11:30.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.526+0000 7f2f097fa640 1 -- 172.21.15.27:0/3328549386 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f2f0c19b970 con 0x7f2f0c106f10 2024-09-19T08:11:30.527 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:11:30.528 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:11:30.528 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:11:30.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.528+0000 7f2f1234e640 1 -- 172.21.15.27:0/3328549386 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2ef40a34c0 msgr2=0x7f2ef40a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:30.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.528+0000 7f2f1234e640 1 --2- 172.21.15.27:0/3328549386 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2ef40a34c0 0x7f2ef40a5980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0058c0 tx=0x7f2efc005850 comp rx=0 tx=0).stop 2024-09-19T08:11:30.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.528+0000 7f2f1234e640 1 -- 172.21.15.27:0/3328549386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f0c106f10 msgr2=0x7f2f0c19eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:30.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.528+0000 7f2f1234e640 1 --2- 172.21.15.27:0/3328549386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f0c106f10 0x7f2f0c19eee0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2f04031a20 tx=0x7f2f04031a50 comp rx=0 tx=0).stop 2024-09-19T08:11:30.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.528+0000 7f2f1234e640 1 -- 172.21.15.27:0/3328549386 shutdown_connections 2024-09-19T08:11:30.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.528+0000 7f2f1234e640 1 --2- 172.21.15.27:0/3328549386 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2ef40a34c0 0x7f2ef40a5980 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:30.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.528+0000 7f2f1234e640 1 --2- 172.21.15.27:0/3328549386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f0c106f10 0x7f2f0c19eee0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:30.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.528+0000 7f2f1234e640 1 --2- 172.21.15.27:0/3328549386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f0c102790 0x7f2f0c19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:30.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.528+0000 7f2f1234e640 1 --2- 172.21.15.27:0/3328549386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f0c101de0 0x7f2f0c19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:30.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.528+0000 7f2f1234e640 1 -- 172.21.15.27:0/3328549386 >> 172.21.15.27:0/3328549386 conn(0x7f2f0c0fd8c0 msgr2=0x7f2f0c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:30.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.529+0000 7f2f1234e640 1 -- 172.21.15.27:0/3328549386 shutdown_connections 2024-09-19T08:11:30.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:30.529+0000 7f2f1234e640 1 -- 172.21.15.27:0/3328549386 wait complete. 2024-09-19T08:11:31.017 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:30 smithi027 ceph-mon[31209]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:11:31.017 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:30 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:11:31.017 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:30 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3328549386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:31.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.016+0000 7ff195e2e640 1 -- 172.21.15.27:0/2858576933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff190101420 msgr2=0x7ff19010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:31.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.016+0000 7ff195e2e640 1 --2- 172.21.15.27:0/2858576933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff190101420 0x7ff19010d950 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff188009cd0 tx=0x7ff18802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.016+0000 7ff195e2e640 1 -- 172.21.15.27:0/2858576933 shutdown_connections 2024-09-19T08:11:31.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.016+0000 7ff195e2e640 1 --2- 172.21.15.27:0/2858576933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff190101420 0x7ff19010d950 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.016+0000 7ff195e2e640 1 --2- 172.21.15.27:0/2858576933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff190100a80 0x7ff190100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.016+0000 7ff195e2e640 1 --2- 172.21.15.27:0/2858576933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff190106a80 0x7ff190106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.016+0000 7ff195e2e640 1 -- 172.21.15.27:0/2858576933 >> 172.21.15.27:0/2858576933 conn(0x7ff1900fc7a0 msgr2=0x7ff1900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:31.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.016+0000 7ff195e2e640 1 -- 172.21.15.27:0/2858576933 shutdown_connections 2024-09-19T08:11:31.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.016+0000 7ff195e2e640 1 -- 172.21.15.27:0/2858576933 wait complete. 2024-09-19T08:11:31.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.017+0000 7ff195e2e640 1 Processor -- start 2024-09-19T08:11:31.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.017+0000 7ff195e2e640 1 -- start start 2024-09-19T08:11:31.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.017+0000 7ff195e2e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff190100a80 0x7ff19019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:31.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.017+0000 7ff195e2e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff190101420 0x7ff19019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:31.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.017+0000 7ff195e2e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff190106a80 0x7ff19019eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:31.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.017+0000 7ff195e2e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff190110e80 con 0x7ff190101420 2024-09-19T08:11:31.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.017+0000 7ff195e2e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff190110d00 con 0x7ff190106a80 2024-09-19T08:11:31.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.017+0000 7ff195e2e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff190111000 con 0x7ff190100a80 2024-09-19T08:11:31.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.017+0000 7ff187fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff190101420 0x7ff19019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:31.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.017+0000 7ff187fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff190101420 0x7ff19019ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46940/0 (socket says 172.21.15.27:46940) 2024-09-19T08:11:31.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.017+0000 7ff187fff640 1 -- 172.21.15.27:0/845018922 learned_addr learned my addr 172.21.15.27:0/845018922 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:31.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.017+0000 7ff18f7fe640 1 --2- 172.21.15.27:0/845018922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff190100a80 0x7ff19019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:31.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.018+0000 7ff18ffff640 1 --2- 172.21.15.27:0/845018922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff190106a80 0x7ff19019eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:31.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.018+0000 7ff187fff640 1 -- 172.21.15.27:0/845018922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff190100a80 msgr2=0x7ff19019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:31.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.018+0000 7ff187fff640 1 --2- 172.21.15.27:0/845018922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff190100a80 0x7ff19019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.018+0000 7ff187fff640 1 -- 172.21.15.27:0/845018922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff190106a80 msgr2=0x7ff19019eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:31.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.018+0000 7ff187fff640 1 --2- 172.21.15.27:0/845018922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff190106a80 0x7ff19019eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.018+0000 7ff187fff640 1 -- 172.21.15.27:0/845018922 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff19019f580 con 0x7ff190101420 2024-09-19T08:11:31.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.018+0000 7ff18f7fe640 1 --2- 172.21.15.27:0/845018922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff190100a80 0x7ff19019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:31.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.018+0000 7ff187fff640 1 --2- 172.21.15.27:0/845018922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff190101420 0x7ff19019ab10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff17800d950 tx=0x7ff17800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:31.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.018+0000 7ff18d7fa640 1 -- 172.21.15.27:0/845018922 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff178017070 con 0x7ff190101420 2024-09-19T08:11:31.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.018+0000 7ff18d7fa640 1 -- 172.21.15.27:0/845018922 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff178009c30 con 0x7ff190101420 2024-09-19T08:11:31.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.018+0000 7ff195e2e640 1 -- 172.21.15.27:0/845018922 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff19019f870 con 0x7ff190101420 2024-09-19T08:11:31.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.018+0000 7ff18d7fa640 1 -- 172.21.15.27:0/845018922 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17800f6b0 con 0x7ff190101420 2024-09-19T08:11:31.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.018+0000 7ff195e2e640 1 -- 172.21.15.27:0/845018922 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1901a7150 con 0x7ff190101420 2024-09-19T08:11:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.020+0000 7ff18d7fa640 1 -- 172.21.15.27:0/845018922 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7ff1780109d0 con 0x7ff190101420 2024-09-19T08:11:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.020+0000 7ff198207740 1 Processor -- start 2024-09-19T08:11:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff198207740 1 -- start start 2024-09-19T08:11:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff198207740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f670634a0 0x559f67063880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff198207740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f67063dc0 0x559f6706e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff198207740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f6706e680 0x559f67070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff198207740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559f66fc92e0 con 0x559f67063dc0 2024-09-19T08:11:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff198207740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559f66f70ce0 con 0x559f670634a0 2024-09-19T08:11:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff198207740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559f66fc52a0 con 0x559f6706e680 2024-09-19T08:11:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff18f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f67063dc0 0x559f6706e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff18f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f67063dc0 0x559f6706e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46956/0 (socket says 172.21.15.27:46956) 2024-09-19T08:11:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff18f7fe640 1 -- 172.21.15.27:0/1453948648 learned_addr learned my addr 172.21.15.27:0/1453948648 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff18d7fa640 1 --2- 172.21.15.27:0/845018922 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff17c0a34c0 0x7ff17c0a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff187fff640 1 --2- 172.21.15.27:0/1453948648 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f6706e680 0x559f67070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff18ffff640 1 --2- 172.21.15.27:0/1453948648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f670634a0 0x559f67063880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff18ffff640 1 --2- 172.21.15.27:0/845018922 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff17c0a34c0 0x7ff17c0a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff18f7fe640 1 -- 172.21.15.27:0/1453948648 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f6706e680 msgr2=0x559f67070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff18f7fe640 1 --2- 172.21.15.27:0/1453948648 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f6706e680 0x559f67070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff18f7fe640 1 -- 172.21.15.27:0/1453948648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f670634a0 msgr2=0x559f67063880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff18f7fe640 1 --2- 172.21.15.27:0/1453948648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f670634a0 0x559f67063880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff18f7fe640 1 -- 172.21.15.27:0/1453948648 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f66f55440 con 0x559f67063dc0 2024-09-19T08:11:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff187fff640 1 --2- 172.21.15.27:0/1453948648 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f6706e680 0x559f67070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.021+0000 7ff18d7fa640 1 -- 172.21.15.27:0/845018922 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff1780cfb10 con 0x7ff190101420 2024-09-19T08:11:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.022+0000 7ff18f7fe640 1 --2- 172.21.15.27:0/1453948648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f67063dc0 0x559f6706e140 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff18000bcc0 tx=0x7ff18000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20dd97ea64cb4ca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.022+0000 7ff18ffff640 1 --2- 172.21.15.27:0/845018922 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff17c0a34c0 0x7ff17c0a5980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff188009a60 tx=0x7ff1880095c0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.022+0000 7ff185ffb640 1 -- 172.21.15.27:0/1453948648 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff180015070 con 0x559f67063dc0 2024-09-19T08:11:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.022+0000 7ff185ffb640 1 -- 172.21.15.27:0/1453948648 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff180005500 con 0x559f67063dc0 2024-09-19T08:11:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.022+0000 7ff185ffb640 1 -- 172.21.15.27:0/1453948648 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff180011730 con 0x559f67063dc0 2024-09-19T08:11:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.022+0000 7ff198207740 1 -- 172.21.15.27:0/1453948648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f67063dc0 msgr2=0x559f6706e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.023+0000 7ff198207740 1 --2- 172.21.15.27:0/1453948648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f67063dc0 0x559f6706e140 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff18000bcc0 tx=0x7ff18000f730 comp rx=0 tx=0).stop 2024-09-19T08:11:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.023+0000 7ff198207740 1 -- 172.21.15.27:0/1453948648 shutdown_connections 2024-09-19T08:11:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.023+0000 7ff198207740 1 --2- 172.21.15.27:0/1453948648 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f6706e680 0x559f67070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.023+0000 7ff198207740 1 --2- 172.21.15.27:0/1453948648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f67063dc0 0x559f6706e140 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.023+0000 7ff198207740 1 --2- 172.21.15.27:0/1453948648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f670634a0 0x559f67063880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.023+0000 7ff198207740 1 -- 172.21.15.27:0/1453948648 >> 172.21.15.27:0/1453948648 conn(0x559f6705fa30 msgr2=0x559f6705fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:31.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.023+0000 7ff198207740 1 -- 172.21.15.27:0/1453948648 shutdown_connections 2024-09-19T08:11:31.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.023+0000 7ff198207740 1 -- 172.21.15.27:0/1453948648 wait complete. 2024-09-19T08:11:31.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.023+0000 7ff198207740 1 -- start start 2024-09-19T08:11:31.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.023+0000 7ff198207740 1 Processor -- start 2024-09-19T08:11:31.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.023+0000 7ff198207740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f670634a0 0x559f6706dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:31.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.023+0000 7ff198207740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f67063dc0 0x559f6706b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:31.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.023+0000 7ff198207740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f6706e680 0x559f6706b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:31.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.023+0000 7ff198207740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559f67071250 con 0x559f6706e680 2024-09-19T08:11:31.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.023+0000 7ff198207740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559f66f84050 con 0x559f67063dc0 2024-09-19T08:11:31.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.023+0000 7ff198207740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559f670713d0 con 0x559f670634a0 2024-09-19T08:11:31.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.024+0000 7ff198207740 10 client.0 _ll_register_callbacks cb 0x559f66fc4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:31.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.024+0000 7ff18ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f6706e680 0x559f6706b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:31.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.024+0000 7ff18ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f6706e680 0x559f6706b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46970/0 (socket says 172.21.15.27:46970) 2024-09-19T08:11:31.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.024+0000 7ff18ffff640 1 -- 172.21.15.27:0/773645993 learned_addr learned my addr 172.21.15.27:0/773645993 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:31.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.024+0000 7ff18f7fe640 1 --2- 172.21.15.27:0/773645993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f670634a0 0x559f6706dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:31.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.024+0000 7ff187fff640 1 --2- 172.21.15.27:0/773645993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f67063dc0 0x559f6706b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:31.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.024+0000 7ff18ffff640 1 -- 172.21.15.27:0/773645993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f670634a0 msgr2=0x559f6706dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:31.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.024+0000 7ff18ffff640 1 --2- 172.21.15.27:0/773645993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f670634a0 0x559f6706dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.024+0000 7ff18ffff640 1 -- 172.21.15.27:0/773645993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f67063dc0 msgr2=0x559f6706b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:31.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.024+0000 7ff18ffff640 1 --2- 172.21.15.27:0/773645993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f67063dc0 0x559f6706b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.024+0000 7ff18ffff640 1 -- 172.21.15.27:0/773645993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f66d3a3c0 con 0x559f6706e680 2024-09-19T08:11:31.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.024+0000 7ff18ffff640 1 --2- 172.21.15.27:0/773645993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f6706e680 0x559f6706b7a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff188035000 tx=0x7ff188003bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32868fe476883cad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:31.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.024+0000 7ff16effd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:31.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.024+0000 7ff16effd640 1 -- 172.21.15.27:0/773645993 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff188043070 con 0x559f6706e680 2024-09-19T08:11:31.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.024+0000 7ff198207740 1 -- 172.21.15.27:0/773645993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff180005500 con 0x559f6706e680 2024-09-19T08:11:31.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.024+0000 7ff16effd640 1 -- 172.21.15.27:0/773645993 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff1880047c0 con 0x559f6706e680 2024-09-19T08:11:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.025+0000 7ff16effd640 1 -- 172.21.15.27:0/773645993 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff1880316a0 con 0x559f6706e680 2024-09-19T08:11:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.025+0000 7ff198207740 10 client.15435 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.025+0000 7ff198207740 1 -- 172.21.15.27:0/773645993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559f6707cc50 con 0x559f6706e680 2024-09-19T08:11:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.025+0000 7ff16effd640 1 -- 172.21.15.27:0/773645993 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff180005500 con 0x559f6706e680 2024-09-19T08:11:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.025+0000 7ff16effd640 1 -- 172.21.15.27:0/773645993 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff188030070 con 0x559f6706e680 2024-09-19T08:11:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.025+0000 7ff198207740 10 client.15435 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.025+0000 7ff198207740 10 client.15435 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.025+0000 7ff198207740 20 client.15435 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.025+0000 7ff198207740 1 --2- 172.21.15.27:0/773645993 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559f6707e060 0x559f67080450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.025+0000 7ff198207740 4 client.15435 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:11:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.025+0000 7ff198207740 1 -- 172.21.15.27:0/773645993 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f66fd6850 con 0x559f6707e060 2024-09-19T08:11:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.025+0000 7ff18f7fe640 1 --2- 172.21.15.27:0/773645993 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559f6707e060 0x559f67080450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.026+0000 7ff18f7fe640 1 --2- 172.21.15.27:0/773645993 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559f6707e060 0x559f67080450 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb31095c13fa8bfa server_cookie=7adf829ae472d816 in_seq=0 out_seq=0 2024-09-19T08:11:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.026+0000 7ff16effd640 10 client.15435 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.027+0000 7ff16effd640 1 -- 172.21.15.27:0/773645993 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f66fd6850 con 0x559f6707e060 2024-09-19T08:11:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.027+0000 7ff16effd640 10 client.15435 handle_command_reply: tid=0 2024-09-19T08:11:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.027+0000 7ff198207740 1 client.15435 shutdown 2024-09-19T08:11:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.027+0000 7ff198207740 1 -- 172.21.15.27:0/773645993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f6706e680 msgr2=0x559f6706b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.027+0000 7ff198207740 1 --2- 172.21.15.27:0/773645993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f6706e680 0x559f6706b7a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff188035000 tx=0x7ff188003bf0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.027+0000 7ff198207740 1 -- 172.21.15.27:0/773645993 shutdown_connections 2024-09-19T08:11:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.027+0000 7ff198207740 1 --2- 172.21.15.27:0/773645993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f6706e680 0x559f6706b7a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.027+0000 7ff198207740 1 --2- 172.21.15.27:0/773645993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f67063dc0 0x559f6706b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.027+0000 7ff198207740 1 --2- 172.21.15.27:0/773645993 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559f6707e060 0x559f67080450 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.027+0000 7ff198207740 1 --2- 172.21.15.27:0/773645993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f670634a0 0x559f6706dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.027+0000 7ff198207740 1 -- 172.21.15.27:0/773645993 >> 172.21.15.27:0/773645993 conn(0x559f6705fa30 msgr2=0x559f67065760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.027+0000 7ff16effd640 0 client.15435 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.027+0000 7ff198207740 1 -- 172.21.15.27:0/773645993 shutdown_connections 2024-09-19T08:11:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.027+0000 7ff198207740 1 -- 172.21.15.27:0/773645993 wait complete. 2024-09-19T08:11:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.027+0000 7ff198207740 20 client.15435 trim_cache size 0 max 16384 2024-09-19T08:11:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.044+0000 7ff198207740 1 Processor -- start 2024-09-19T08:11:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.044+0000 7ff198207740 1 -- start start 2024-09-19T08:11:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.045+0000 7ff198207740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f6705fa30 0x559f6707a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.045+0000 7ff198207740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f670634a0 0x559f6706b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.045+0000 7ff198207740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f67063dc0 0x559f67066740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.045+0000 7ff198207740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff1901ad9a0 con 0x559f670634a0 2024-09-19T08:11:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.045+0000 7ff198207740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff1901b0220 con 0x559f6705fa30 2024-09-19T08:11:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.045+0000 7ff198207740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff1901ae010 con 0x559f67063dc0 2024-09-19T08:11:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.045+0000 7ff187fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f670634a0 0x559f6706b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.045+0000 7ff187fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f670634a0 0x559f6706b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46982/0 (socket says 172.21.15.27:46982) 2024-09-19T08:11:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.045+0000 7ff187fff640 1 -- 172.21.15.27:0/2731662537 learned_addr learned my addr 172.21.15.27:0/2731662537 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.045+0000 7ff18f7fe640 1 --2- 172.21.15.27:0/2731662537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f6705fa30 0x559f6707a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.045+0000 7ff187fff640 1 -- 172.21.15.27:0/2731662537 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f67063dc0 msgr2=0x559f67066740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.045+0000 7ff187fff640 1 --2- 172.21.15.27:0/2731662537 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f67063dc0 0x559f67066740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.045+0000 7ff187fff640 1 -- 172.21.15.27:0/2731662537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f6705fa30 msgr2=0x559f6707a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.045+0000 7ff187fff640 1 --2- 172.21.15.27:0/2731662537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f6705fa30 0x559f6707a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.045+0000 7ff187fff640 1 -- 172.21.15.27:0/2731662537 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f67063bf0 con 0x559f670634a0 2024-09-19T08:11:31.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.045+0000 7ff187fff640 1 --2- 172.21.15.27:0/2731662537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f670634a0 0x559f6706b220 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff178009610 tx=0x7ff1780980a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c9ceaa8f17a9ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:31.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.046+0000 7ff1857fa640 1 -- 172.21.15.27:0/2731662537 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff178020040 con 0x559f670634a0 2024-09-19T08:11:31.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.046+0000 7ff1857fa640 1 -- 172.21.15.27:0/2731662537 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1780a4940 con 0x559f670634a0 2024-09-19T08:11:31.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.046+0000 7ff1857fa640 1 -- 172.21.15.27:0/2731662537 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17809b380 con 0x559f670634a0 2024-09-19T08:11:31.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.046+0000 7ff198207740 1 -- 172.21.15.27:0/2731662537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f670634a0 msgr2=0x559f6706b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:31.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.046+0000 7ff198207740 1 --2- 172.21.15.27:0/2731662537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f670634a0 0x559f6706b220 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff178009610 tx=0x7ff1780980a0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.046+0000 7ff198207740 1 -- 172.21.15.27:0/2731662537 shutdown_connections 2024-09-19T08:11:31.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.046+0000 7ff198207740 1 --2- 172.21.15.27:0/2731662537 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f67063dc0 0x559f67066740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.046+0000 7ff198207740 1 --2- 172.21.15.27:0/2731662537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f670634a0 0x559f6706b220 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.046+0000 7ff198207740 1 --2- 172.21.15.27:0/2731662537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f6705fa30 0x559f6707a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.046+0000 7ff198207740 1 -- 172.21.15.27:0/2731662537 >> 172.21.15.27:0/2731662537 conn(0x559f6706b900 msgr2=0x559f67066030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:31.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.046+0000 7ff198207740 1 -- 172.21.15.27:0/2731662537 shutdown_connections 2024-09-19T08:11:31.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.046+0000 7ff198207740 1 -- 172.21.15.27:0/2731662537 wait complete. 2024-09-19T08:11:31.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.047+0000 7ff198207740 1 -- start start 2024-09-19T08:11:31.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.047+0000 7ff198207740 1 Processor -- start 2024-09-19T08:11:31.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.047+0000 7ff198207740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f6705fa30 0x559f67076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:31.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.047+0000 7ff198207740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f670634a0 0x559f67072220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:31.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.047+0000 7ff198207740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f67063dc0 0x559f670729b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:31.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.047+0000 7ff198207740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff1901ae6e0 con 0x559f6705fa30 2024-09-19T08:11:31.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.047+0000 7ff198207740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff1901afb50 con 0x559f670634a0 2024-09-19T08:11:31.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.047+0000 7ff198207740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff1901aedb0 con 0x559f67063dc0 2024-09-19T08:11:31.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.047+0000 7ff198207740 10 client.0 _ll_register_callbacks cb 0x7ff188009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:31.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.047+0000 7ff18f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f6705fa30 0x559f67076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:31.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.047+0000 7ff18f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f6705fa30 0x559f67076ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46990/0 (socket says 172.21.15.27:46990) 2024-09-19T08:11:31.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.047+0000 7ff18f7fe640 1 -- 172.21.15.27:0/3907373062 learned_addr learned my addr 172.21.15.27:0/3907373062 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:31.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.047+0000 7ff187fff640 1 --2- 172.21.15.27:0/3907373062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f670634a0 0x559f67072220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:31.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.048+0000 7ff18ffff640 1 --2- 172.21.15.27:0/3907373062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f67063dc0 0x559f670729b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:31.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.048+0000 7ff18f7fe640 1 -- 172.21.15.27:0/3907373062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f67063dc0 msgr2=0x559f670729b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:31.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.048+0000 7ff18f7fe640 1 --2- 172.21.15.27:0/3907373062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f67063dc0 0x559f670729b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.048+0000 7ff18f7fe640 1 -- 172.21.15.27:0/3907373062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f670634a0 msgr2=0x559f67072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:31.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.048+0000 7ff18f7fe640 1 --2- 172.21.15.27:0/3907373062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f670634a0 0x559f67072220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.048+0000 7ff18f7fe640 1 -- 172.21.15.27:0/3907373062 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f670e7cf0 con 0x559f6705fa30 2024-09-19T08:11:31.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.048+0000 7ff18f7fe640 1 --2- 172.21.15.27:0/3907373062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f6705fa30 0x559f67076ef0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff18000bcc0 tx=0x7ff180004e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d614ad7e76c54e26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:31.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.048+0000 7ff16effd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:31.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.048+0000 7ff16effd640 1 -- 172.21.15.27:0/3907373062 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff180015040 con 0x559f6705fa30 2024-09-19T08:11:31.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.048+0000 7ff16effd640 1 -- 172.21.15.27:0/3907373062 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff180004880 con 0x559f6705fa30 2024-09-19T08:11:31.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.048+0000 7ff198207740 1 -- 172.21.15.27:0/3907373062 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1780a4940 con 0x559f6705fa30 2024-09-19T08:11:31.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.048+0000 7ff16effd640 1 -- 172.21.15.27:0/3907373062 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff180004a80 con 0x559f6705fa30 2024-09-19T08:11:31.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.048+0000 7ff198207740 10 client.15441 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:31.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.048+0000 7ff198207740 1 -- 172.21.15.27:0/3907373062 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559f670e8e90 con 0x559f6705fa30 2024-09-19T08:11:31.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.049+0000 7ff16effd640 1 -- 172.21.15.27:0/3907373062 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1780a4940 con 0x559f6705fa30 2024-09-19T08:11:31.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.049+0000 7ff16effd640 1 -- 172.21.15.27:0/3907373062 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff180026850 con 0x559f6705fa30 2024-09-19T08:11:31.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.049+0000 7ff198207740 10 client.15441 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:31.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.049+0000 7ff198207740 10 client.15441 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:31.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.049+0000 7ff198207740 20 client.15441 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:31.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.049+0000 7ff198207740 1 --2- 172.21.15.27:0/3907373062 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559f6706e680 0x559f670eb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:31.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.049+0000 7ff198207740 4 client.15441 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:11:31.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.049+0000 7ff198207740 1 -- 172.21.15.27:0/3907373062 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559f66fd0d60 con 0x559f6706e680 2024-09-19T08:11:31.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.049+0000 7ff187fff640 1 --2- 172.21.15.27:0/3907373062 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559f6706e680 0x559f670eb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:31.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.050+0000 7ff187fff640 1 --2- 172.21.15.27:0/3907373062 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559f6706e680 0x559f670eb340 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da9ad557ebf12429 server_cookie=dea5fceacc6ad1cd in_seq=0 out_seq=0 2024-09-19T08:11:31.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.050+0000 7ff16effd640 10 client.15441 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:31.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.050+0000 7ff16effd640 1 -- 172.21.15.27:0/3907373062 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559f66fd0d60 con 0x559f6706e680 2024-09-19T08:11:31.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.050+0000 7ff16effd640 10 client.15441 handle_command_reply: tid=0 2024-09-19T08:11:31.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.050+0000 7ff198207740 1 client.15441 shutdown 2024-09-19T08:11:31.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.050+0000 7ff198207740 1 -- 172.21.15.27:0/3907373062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f6705fa30 msgr2=0x559f67076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:31.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.050+0000 7ff198207740 1 --2- 172.21.15.27:0/3907373062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f6705fa30 0x559f67076ef0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff18000bcc0 tx=0x7ff180004e70 comp rx=0 tx=0).stop 2024-09-19T08:11:31.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.050+0000 7ff198207740 1 -- 172.21.15.27:0/3907373062 shutdown_connections 2024-09-19T08:11:31.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.050+0000 7ff198207740 1 --2- 172.21.15.27:0/3907373062 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559f6706e680 0x559f670eb340 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.050+0000 7ff198207740 1 --2- 172.21.15.27:0/3907373062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f67063dc0 0x559f670729b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.050+0000 7ff198207740 1 --2- 172.21.15.27:0/3907373062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559f670634a0 0x559f67072220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.050+0000 7ff198207740 1 --2- 172.21.15.27:0/3907373062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559f6705fa30 0x559f67076ef0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.050+0000 7ff198207740 1 -- 172.21.15.27:0/3907373062 >> 172.21.15.27:0/3907373062 conn(0x559f6706b900 msgr2=0x559f6706d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:31.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.050+0000 7ff16effd640 0 client.15441 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:31.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.050+0000 7ff198207740 1 -- 172.21.15.27:0/3907373062 shutdown_connections 2024-09-19T08:11:31.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.050+0000 7ff198207740 1 -- 172.21.15.27:0/3907373062 wait complete. 2024-09-19T08:11:31.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.050+0000 7ff198207740 20 client.15441 trim_cache size 0 max 16384 2024-09-19T08:11:31.068 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:11:31.068 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:11:31.068 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:11:31.068 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:11:31.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.051+0000 7ff195e2e640 1 -- 172.21.15.27:0/845018922 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff17c0a34c0 msgr2=0x7ff17c0a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:31.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.051+0000 7ff195e2e640 1 --2- 172.21.15.27:0/845018922 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff17c0a34c0 0x7ff17c0a5980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff188009a60 tx=0x7ff1880095c0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.051+0000 7ff195e2e640 1 -- 172.21.15.27:0/845018922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff190101420 msgr2=0x7ff19019ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:31.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.051+0000 7ff195e2e640 1 --2- 172.21.15.27:0/845018922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff190101420 0x7ff19019ab10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff17800d950 tx=0x7ff17800de10 comp rx=0 tx=0).stop 2024-09-19T08:11:31.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.051+0000 7ff195e2e640 1 -- 172.21.15.27:0/845018922 shutdown_connections 2024-09-19T08:11:31.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.051+0000 7ff195e2e640 1 --2- 172.21.15.27:0/845018922 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff17c0a34c0 0x7ff17c0a5980 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.051+0000 7ff195e2e640 1 --2- 172.21.15.27:0/845018922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff190106a80 0x7ff19019eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.051+0000 7ff195e2e640 1 --2- 172.21.15.27:0/845018922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff190101420 0x7ff19019ab10 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.051+0000 7ff195e2e640 1 --2- 172.21.15.27:0/845018922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff190100a80 0x7ff19019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:31.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.051+0000 7ff195e2e640 1 -- 172.21.15.27:0/845018922 >> 172.21.15.27:0/845018922 conn(0x7ff1900fc7a0 msgr2=0x7ff19006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:31.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.051+0000 7ff195e2e640 1 -- 172.21.15.27:0/845018922 shutdown_connections 2024-09-19T08:11:31.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:31.051+0000 7ff195e2e640 1 -- 172.21.15.27:0/845018922 wait complete. 2024-09-19T08:11:31.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:30 smithi155 ceph-mon[35362]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:11:31.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:30 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:11:31.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:30 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3328549386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:31.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:30 smithi203 ceph-mon[35198]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:11:31.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:30 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:11:31.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:30 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3328549386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:31.730 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T08:09:11.930032+0000', 'modified': '2024-09-19T08:09:20.890507+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24482}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24466': {'gid': 24466, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.203:6839/1481040099', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6838', 'nonce': 1481040099}, {'type': 'v1', 'addr': '172.21.15.203:6839', 'nonce': 1481040099}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.155:6839/1929184836', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6838', 'nonce': 1929184836}, {'type': 'v1', 'addr': '172.21.15.155:6839', 'nonce': 1929184836}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24482, 'qdb_cluster': [24482]} 2024-09-19T08:11:31.730 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T08:11:31.731 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T08:11:32.173 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:11:32.173 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:11:32.263 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:32.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.774+0000 7f167d5bd640 1 -- 172.21.15.27:0/273083593 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1678103660 msgr2=0x7f167810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:32.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.774+0000 7f167d5bd640 1 --2- 172.21.15.27:0/273083593 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1678103660 0x7f167810bb50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1660009900 tx=0x7f166002a480 comp rx=0 tx=0).stop 2024-09-19T08:11:32.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.774+0000 7f167d5bd640 1 -- 172.21.15.27:0/273083593 shutdown_connections 2024-09-19T08:11:32.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.774+0000 7f167d5bd640 1 --2- 172.21.15.27:0/273083593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f167810c170 0x7f167810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.774+0000 7f167d5bd640 1 --2- 172.21.15.27:0/273083593 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1678103660 0x7f167810bb50 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.774+0000 7f167d5bd640 1 --2- 172.21.15.27:0/273083593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1678102d40 0x7f1678103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.774+0000 7f167d5bd640 1 -- 172.21.15.27:0/273083593 >> 172.21.15.27:0/273083593 conn(0x7f16780fc7a0 msgr2=0x7f16780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:32.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.774+0000 7f167d5bd640 1 -- 172.21.15.27:0/273083593 shutdown_connections 2024-09-19T08:11:32.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.774+0000 7f167d5bd640 1 -- 172.21.15.27:0/273083593 wait complete. 2024-09-19T08:11:32.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.775+0000 7f167d5bd640 1 Processor -- start 2024-09-19T08:11:32.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.775+0000 7f167d5bd640 1 -- start start 2024-09-19T08:11:32.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.775+0000 7f167d5bd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1678102d40 0x7f16781009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:32.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.775+0000 7f167d5bd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1678103660 0x7f1678100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:32.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.775+0000 7f167d5bd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f167810c170 0x7f1678101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:32.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.775+0000 7f167d5bd640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1678111f70 con 0x7f1678103660 2024-09-19T08:11:32.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.775+0000 7f167d5bd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1678111df0 con 0x7f1678102d40 2024-09-19T08:11:32.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.775+0000 7f167d5bd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f16781120f0 con 0x7f167810c170 2024-09-19T08:11:32.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.775+0000 7f16767fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1678103660 0x7f1678100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:32.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.775+0000 7f16767fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1678103660 0x7f1678100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46998/0 (socket says 172.21.15.27:46998) 2024-09-19T08:11:32.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.775+0000 7f16767fc640 1 -- 172.21.15.27:0/3118303320 learned_addr learned my addr 172.21.15.27:0/3118303320 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:32.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.775+0000 7f1676ffd640 1 --2- 172.21.15.27:0/3118303320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1678102d40 0x7f16781009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:32.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.775+0000 7f16777fe640 1 --2- 172.21.15.27:0/3118303320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f167810c170 0x7f1678101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:32.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.775+0000 7f16767fc640 1 -- 172.21.15.27:0/3118303320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f167810c170 msgr2=0x7f1678101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:32.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.775+0000 7f16767fc640 1 --2- 172.21.15.27:0/3118303320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f167810c170 0x7f1678101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.775+0000 7f16767fc640 1 -- 172.21.15.27:0/3118303320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1678102d40 msgr2=0x7f16781009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:32.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.775+0000 7f16767fc640 1 --2- 172.21.15.27:0/3118303320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1678102d40 0x7f16781009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.775+0000 7f16767fc640 1 -- 172.21.15.27:0/3118303320 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16781a69f0 con 0x7f1678103660 2024-09-19T08:11:32.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.775+0000 7f1676ffd640 1 --2- 172.21.15.27:0/3118303320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1678102d40 0x7f16781009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:32.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.776+0000 7f16767fc640 1 --2- 172.21.15.27:0/3118303320 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1678103660 0x7f1678100ee0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1660006010 tx=0x7f16600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:32.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.776+0000 7f166ffff640 1 -- 172.21.15.27:0/3118303320 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166003f030 con 0x7f1678103660 2024-09-19T08:11:32.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.776+0000 7f166ffff640 1 -- 172.21.15.27:0/3118303320 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1660003ce0 con 0x7f1678103660 2024-09-19T08:11:32.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.776+0000 7f167d5bd640 1 -- 172.21.15.27:0/3118303320 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16781a6c80 con 0x7f1678103660 2024-09-19T08:11:32.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.776+0000 7f166ffff640 1 -- 172.21.15.27:0/3118303320 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1660035070 con 0x7f1678103660 2024-09-19T08:11:32.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.776+0000 7f167d5bd640 1 -- 172.21.15.27:0/3118303320 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16781a7160 con 0x7f1678103660 2024-09-19T08:11:32.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.779+0000 7f166ffff640 1 -- 172.21.15.27:0/3118303320 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f1660042030 con 0x7f1678103660 2024-09-19T08:11:32.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.779+0000 7f167f996740 1 Processor -- start 2024-09-19T08:11:32.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.779+0000 7f167f996740 1 -- start start 2024-09-19T08:11:32.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.779+0000 7f167f996740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600badfd9d0 0x5600badfddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:32.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.779+0000 7f167f996740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600badfe2f0 0x5600bae08670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:32.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.779+0000 7f167f996740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 0x5600bae0afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:32.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.779+0000 7f167f996740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5600bad64090 con 0x5600bae08bb0 2024-09-19T08:11:32.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.779+0000 7f167f996740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5600bad0ba70 con 0x5600badfd9d0 2024-09-19T08:11:32.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.779+0000 7f167f996740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5600bad60050 con 0x5600badfe2f0 2024-09-19T08:11:32.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.780+0000 7f16767fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 0x5600bae0afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:32.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.780+0000 7f16767fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 0x5600bae0afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47002/0 (socket says 172.21.15.27:47002) 2024-09-19T08:11:32.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.780+0000 7f16767fc640 1 -- 172.21.15.27:0/3939405007 learned_addr learned my addr 172.21.15.27:0/3939405007 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:32.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.780+0000 7f16777fe640 1 --2- 172.21.15.27:0/3939405007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600badfd9d0 0x5600badfddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:32.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.780+0000 7f1676ffd640 1 --2- 172.21.15.27:0/3939405007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600badfe2f0 0x5600bae08670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:32.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.780+0000 7f166ffff640 1 --2- 172.21.15.27:0/3118303320 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f16640a3440 0x7f16640a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:32.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.780+0000 7f16767fc640 1 -- 172.21.15.27:0/3939405007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600badfe2f0 msgr2=0x5600bae08670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:32.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.780+0000 7f16767fc640 1 --2- 172.21.15.27:0/3939405007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600badfe2f0 0x5600bae08670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.780+0000 7f16767fc640 1 -- 172.21.15.27:0/3939405007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600badfd9d0 msgr2=0x5600badfddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:32.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.780+0000 7f16767fc640 1 --2- 172.21.15.27:0/3939405007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600badfd9d0 0x5600badfddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.780+0000 7f16767fc640 1 -- 172.21.15.27:0/3939405007 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600bad18130 con 0x5600bae08bb0 2024-09-19T08:11:32.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.780+0000 7f16777fe640 1 --2- 172.21.15.27:0/3118303320 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f16640a3440 0x7f16640a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:32.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.780+0000 7f166ffff640 1 -- 172.21.15.27:0/3118303320 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f16600f0500 con 0x7f1678103660 2024-09-19T08:11:32.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.780+0000 7f16767fc640 1 --2- 172.21.15.27:0/3939405007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 0x5600bae0afa0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f16600edb80 tx=0x7f16600b8a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b414bd3aaad66851 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:32.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.780+0000 7f166d7fa640 1 -- 172.21.15.27:0/3939405007 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16600bc550 con 0x5600bae08bb0 2024-09-19T08:11:32.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.781+0000 7f166d7fa640 1 -- 172.21.15.27:0/3939405007 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16600bce80 con 0x5600bae08bb0 2024-09-19T08:11:32.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.781+0000 7f166d7fa640 1 -- 172.21.15.27:0/3939405007 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16600044e0 con 0x5600bae08bb0 2024-09-19T08:11:32.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.781+0000 7f167f996740 1 -- 172.21.15.27:0/3939405007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 msgr2=0x5600bae0afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:32.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.781+0000 7f16777fe640 1 --2- 172.21.15.27:0/3118303320 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f16640a3440 0x7f16640a5900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f166800cba0 tx=0x7f16680046c0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:32.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.781+0000 7f167f996740 1 --2- 172.21.15.27:0/3939405007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 0x5600bae0afa0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f16600edb80 tx=0x7f16600b8a20 comp rx=0 tx=0).stop 2024-09-19T08:11:32.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.781+0000 7f167f996740 1 -- 172.21.15.27:0/3939405007 shutdown_connections 2024-09-19T08:11:32.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.781+0000 7f167f996740 1 --2- 172.21.15.27:0/3939405007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 0x5600bae0afa0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.781+0000 7f167f996740 1 --2- 172.21.15.27:0/3939405007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600badfe2f0 0x5600bae08670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.781+0000 7f167f996740 1 --2- 172.21.15.27:0/3939405007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600badfd9d0 0x5600badfddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.781+0000 7f167f996740 1 -- 172.21.15.27:0/3939405007 >> 172.21.15.27:0/3939405007 conn(0x5600badf9f60 msgr2=0x5600badfa340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:32.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.781+0000 7f167f996740 1 -- 172.21.15.27:0/3939405007 shutdown_connections 2024-09-19T08:11:32.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.781+0000 7f167f996740 1 -- 172.21.15.27:0/3939405007 wait complete. 2024-09-19T08:11:32.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.782+0000 7f167f996740 1 -- start start 2024-09-19T08:11:32.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.782+0000 7f167f996740 1 Processor -- start 2024-09-19T08:11:32.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.782+0000 7f167f996740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600badfd9d0 0x5600bae08400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:32.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.782+0000 7f167f996740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600badfe2f0 0x5600bae05750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:32.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.782+0000 7f167f996740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 0x5600bae05c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:32.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.782+0000 7f167f996740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5600bae0b540 con 0x5600bae08bb0 2024-09-19T08:11:32.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.782+0000 7f167f996740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5600bad1ef20 con 0x5600badfe2f0 2024-09-19T08:11:32.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.782+0000 7f167f996740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5600bae0b6c0 con 0x5600badfd9d0 2024-09-19T08:11:32.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.782+0000 7f167f996740 10 client.0 _ll_register_callbacks cb 0x5600bace8030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:32.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.782+0000 7f16777fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 0x5600bae05c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:32.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.782+0000 7f16777fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 0x5600bae05c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47012/0 (socket says 172.21.15.27:47012) 2024-09-19T08:11:32.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.782+0000 7f16777fe640 1 -- 172.21.15.27:0/3181018086 learned_addr learned my addr 172.21.15.27:0/3181018086 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:32.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.782+0000 7f1676ffd640 1 --2- 172.21.15.27:0/3181018086 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600badfd9d0 0x5600bae08400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:32.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.782+0000 7f16767fc640 1 --2- 172.21.15.27:0/3181018086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600badfe2f0 0x5600bae05750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:32.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.783+0000 7f16777fe640 1 -- 172.21.15.27:0/3181018086 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600badfd9d0 msgr2=0x5600bae08400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:32.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.783+0000 7f16777fe640 1 --2- 172.21.15.27:0/3181018086 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600badfd9d0 0x5600bae08400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.783+0000 7f16777fe640 1 -- 172.21.15.27:0/3181018086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600badfe2f0 msgr2=0x5600bae05750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:32.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.783+0000 7f16777fe640 1 --2- 172.21.15.27:0/3181018086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600badfe2f0 0x5600bae05750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.783+0000 7f16777fe640 1 -- 172.21.15.27:0/3181018086 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600baad52b0 con 0x5600bae08bb0 2024-09-19T08:11:32.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.783+0000 7f16777fe640 1 --2- 172.21.15.27:0/3181018086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 0x5600bae05c90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1668012aa0 tx=0x7f1668004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d926794f753900e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:32.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.783+0000 7f165e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:32.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.783+0000 7f165e7fc640 1 -- 172.21.15.27:0/3181018086 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166801dd70 con 0x5600bae08bb0 2024-09-19T08:11:32.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.783+0000 7f167f996740 1 -- 172.21.15.27:0/3181018086 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16600bce80 con 0x5600bae08bb0 2024-09-19T08:11:32.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.783+0000 7f165e7fc640 1 -- 172.21.15.27:0/3181018086 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f1668027470 con 0x5600bae08bb0 2024-09-19T08:11:32.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.783+0000 7f165e7fc640 1 -- 172.21.15.27:0/3181018086 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1668027670 con 0x5600bae08bb0 2024-09-19T08:11:32.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.783+0000 7f167f996740 10 client.15453 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:32.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.783+0000 7f167f996740 1 -- 172.21.15.27:0/3181018086 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5600bae16e30 con 0x5600bae08bb0 2024-09-19T08:11:32.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.783+0000 7f165e7fc640 1 -- 172.21.15.27:0/3181018086 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16600bce80 con 0x5600bae08bb0 2024-09-19T08:11:32.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.784+0000 7f165e7fc640 1 -- 172.21.15.27:0/3181018086 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1668031970 con 0x5600bae08bb0 2024-09-19T08:11:32.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.784+0000 7f167f996740 10 client.15453 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:32.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.784+0000 7f167f996740 10 client.15453 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:11:32.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.784+0000 7f167f996740 20 client.15453 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:32.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.784+0000 7f167f996740 1 --2- 172.21.15.27:0/3181018086 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5600bae19420 0x5600bae1a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:32.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.784+0000 7f167f996740 4 client.15453 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:11:32.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.784+0000 7f167f996740 1 -- 172.21.15.27:0/3181018086 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600bad71600 con 0x5600bae19420 2024-09-19T08:11:32.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.784+0000 7f1676ffd640 1 --2- 172.21.15.27:0/3181018086 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5600bae19420 0x5600bae1a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:32.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.784+0000 7f165e7fc640 10 client.15453 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:32.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.784+0000 7f1676ffd640 1 --2- 172.21.15.27:0/3181018086 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5600bae19420 0x5600bae1a890 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5d4256bfe7bcc82 server_cookie=3870a31bf4073749 in_seq=0 out_seq=0 2024-09-19T08:11:32.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.785+0000 7f165e7fc640 1 -- 172.21.15.27:0/3181018086 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5600bad71600 con 0x5600bae19420 2024-09-19T08:11:32.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.785+0000 7f165e7fc640 10 client.15453 handle_command_reply: tid=0 2024-09-19T08:11:32.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.785+0000 7f167f996740 1 client.15453 shutdown 2024-09-19T08:11:32.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.785+0000 7f167f996740 1 -- 172.21.15.27:0/3181018086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 msgr2=0x5600bae05c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:32.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.785+0000 7f167f996740 1 --2- 172.21.15.27:0/3181018086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 0x5600bae05c90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1668012aa0 tx=0x7f1668004730 comp rx=0 tx=0).stop 2024-09-19T08:11:32.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.785+0000 7f167f996740 1 -- 172.21.15.27:0/3181018086 shutdown_connections 2024-09-19T08:11:32.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.785+0000 7f167f996740 1 --2- 172.21.15.27:0/3181018086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 0x5600bae05c90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.785+0000 7f167f996740 1 --2- 172.21.15.27:0/3181018086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600badfe2f0 0x5600bae05750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.785+0000 7f167f996740 1 --2- 172.21.15.27:0/3181018086 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5600bae19420 0x5600bae1a890 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.785+0000 7f165e7fc640 0 client.15453 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:32.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.785+0000 7f167f996740 1 --2- 172.21.15.27:0/3181018086 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600badfd9d0 0x5600bae08400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.785+0000 7f167f996740 1 -- 172.21.15.27:0/3181018086 >> 172.21.15.27:0/3181018086 conn(0x5600badf9f60 msgr2=0x5600badffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:32.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.785+0000 7f167f996740 1 -- 172.21.15.27:0/3181018086 shutdown_connections 2024-09-19T08:11:32.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.786+0000 7f167f996740 1 -- 172.21.15.27:0/3181018086 wait complete. 2024-09-19T08:11:32.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.786+0000 7f167f996740 20 client.15453 trim_cache size 0 max 16384 2024-09-19T08:11:32.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.804+0000 7f167f996740 1 Processor -- start 2024-09-19T08:11:32.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.804+0000 7f167f996740 1 -- start start 2024-09-19T08:11:32.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.804+0000 7f167f996740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600badfd9d0 0x5600bae04020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:32.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.804+0000 7f167f996740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600badfe2f0 0x5600bae04560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:32.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.804+0000 7f167f996740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 0x5600bae22b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:32.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.804+0000 7f167f996740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5600bae18bd0 con 0x5600bae08bb0 2024-09-19T08:11:32.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.804+0000 7f167f996740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5600bae192a0 con 0x5600badfd9d0 2024-09-19T08:11:32.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.804+0000 7f167f996740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5600bae19970 con 0x5600badfe2f0 2024-09-19T08:11:32.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.804+0000 7f16777fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 0x5600bae22b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:32.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.804+0000 7f16777fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 0x5600bae22b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47020/0 (socket says 172.21.15.27:47020) 2024-09-19T08:11:32.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.804+0000 7f16777fe640 1 -- 172.21.15.27:0/3105643790 learned_addr learned my addr 172.21.15.27:0/3105643790 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:32.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.804+0000 7f16767fc640 1 --2- 172.21.15.27:0/3105643790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600badfe2f0 0x5600bae04560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:32.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.804+0000 7f1676ffd640 1 --2- 172.21.15.27:0/3105643790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600badfd9d0 0x5600bae04020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:32.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.805+0000 7f16777fe640 1 -- 172.21.15.27:0/3105643790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600badfe2f0 msgr2=0x5600bae04560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:32.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.805+0000 7f16777fe640 1 --2- 172.21.15.27:0/3105643790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600badfe2f0 0x5600bae04560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.805+0000 7f16777fe640 1 -- 172.21.15.27:0/3105643790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600badfd9d0 msgr2=0x5600bae04020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:32.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.805+0000 7f16777fe640 1 --2- 172.21.15.27:0/3105643790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600badfd9d0 0x5600bae04020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.805+0000 7f16777fe640 1 -- 172.21.15.27:0/3105643790 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600badfb0d0 con 0x5600bae08bb0 2024-09-19T08:11:32.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.805+0000 7f16777fe640 1 --2- 172.21.15.27:0/3105643790 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 0x5600bae22b70 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1668031d40 tx=0x7f166800ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b5cfa2b1d1f791 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:32.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.805+0000 7f166cff9640 1 -- 172.21.15.27:0/3105643790 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166801dd70 con 0x5600bae08bb0 2024-09-19T08:11:32.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.805+0000 7f166cff9640 1 -- 172.21.15.27:0/3105643790 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1668022070 con 0x5600bae08bb0 2024-09-19T08:11:32.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.805+0000 7f166cff9640 1 -- 172.21.15.27:0/3105643790 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668031a30 con 0x5600bae08bb0 2024-09-19T08:11:32.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.806+0000 7f167f996740 1 -- 172.21.15.27:0/3105643790 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 msgr2=0x5600bae22b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:32.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.806+0000 7f167f996740 1 --2- 172.21.15.27:0/3105643790 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 0x5600bae22b70 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1668031d40 tx=0x7f166800ca70 comp rx=0 tx=0).stop 2024-09-19T08:11:32.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.806+0000 7f167f996740 1 -- 172.21.15.27:0/3105643790 shutdown_connections 2024-09-19T08:11:32.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.806+0000 7f167f996740 1 --2- 172.21.15.27:0/3105643790 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600bae08bb0 0x5600bae22b70 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.806+0000 7f167f996740 1 --2- 172.21.15.27:0/3105643790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600badfe2f0 0x5600bae04560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.806+0000 7f167f996740 1 --2- 172.21.15.27:0/3105643790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600badfd9d0 0x5600bae04020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.806+0000 7f167f996740 1 -- 172.21.15.27:0/3105643790 >> 172.21.15.27:0/3105643790 conn(0x5600badf9f60 msgr2=0x5600badf4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:32.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.806+0000 7f167f996740 1 -- 172.21.15.27:0/3105643790 shutdown_connections 2024-09-19T08:11:32.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.806+0000 7f167f996740 1 -- 172.21.15.27:0/3105643790 wait complete. 2024-09-19T08:11:32.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.806+0000 7f167f996740 1 -- start start 2024-09-19T08:11:32.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.807+0000 7f167f996740 1 Processor -- start 2024-09-19T08:11:32.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.807+0000 7f167f996740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600badfd9d0 0x5600bae1c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:32.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.807+0000 7f167f996740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600badfe2f0 0x5600bae1cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:32.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.807+0000 7f167f996740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600bae08bb0 0x5600bae1d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:32.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.807+0000 7f167f996740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5600bae1a710 con 0x5600badfd9d0 2024-09-19T08:11:32.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.807+0000 7f167f996740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5600bae1a040 con 0x5600bae08bb0 2024-09-19T08:11:32.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.807+0000 7f167f996740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5600bae1ade0 con 0x5600badfe2f0 2024-09-19T08:11:32.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.807+0000 7f167f996740 10 client.0 _ll_register_callbacks cb 0x7f166800c8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:32.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.807+0000 7f1676ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600badfd9d0 0x5600bae1c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:32.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.807+0000 7f1676ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600badfd9d0 0x5600bae1c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47026/0 (socket says 172.21.15.27:47026) 2024-09-19T08:11:32.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.807+0000 7f1676ffd640 1 -- 172.21.15.27:0/3266562145 learned_addr learned my addr 172.21.15.27:0/3266562145 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:32.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.807+0000 7f16767fc640 1 --2- 172.21.15.27:0/3266562145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600badfe2f0 0x5600bae1cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:32.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.807+0000 7f16777fe640 1 --2- 172.21.15.27:0/3266562145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600bae08bb0 0x5600bae1d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:32.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.807+0000 7f1676ffd640 1 -- 172.21.15.27:0/3266562145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600badfe2f0 msgr2=0x5600bae1cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:32.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.807+0000 7f1676ffd640 1 --2- 172.21.15.27:0/3266562145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600badfe2f0 0x5600bae1cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.807+0000 7f1676ffd640 1 -- 172.21.15.27:0/3266562145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600bae08bb0 msgr2=0x5600bae1d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:32.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.807+0000 7f1676ffd640 1 --2- 172.21.15.27:0/3266562145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600bae08bb0 0x5600bae1d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.807+0000 7f1676ffd640 1 -- 172.21.15.27:0/3266562145 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600bae21070 con 0x5600badfd9d0 2024-09-19T08:11:32.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.808+0000 7f1676ffd640 1 --2- 172.21.15.27:0/3266562145 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600badfd9d0 0x5600bae1c880 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1670005fd0 tx=0x7f1670013eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335af37062dda7ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:32.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.808+0000 7f165e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:32.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.808+0000 7f165e7fc640 1 -- 172.21.15.27:0/3266562145 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1670024030 con 0x5600badfd9d0 2024-09-19T08:11:32.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.808+0000 7f167f996740 1 -- 172.21.15.27:0/3266562145 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1668022070 con 0x5600badfd9d0 2024-09-19T08:11:32.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.808+0000 7f165e7fc640 1 -- 172.21.15.27:0/3266562145 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f1670011cd0 con 0x5600badfd9d0 2024-09-19T08:11:32.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.808+0000 7f165e7fc640 1 -- 172.21.15.27:0/3266562145 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1670004b20 con 0x5600badfd9d0 2024-09-19T08:11:32.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.808+0000 7f167f996740 10 client.15459 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:32.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.808+0000 7f167f996740 1 -- 172.21.15.27:0/3266562145 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5600bae83e80 con 0x5600badfd9d0 2024-09-19T08:11:32.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.808+0000 7f165e7fc640 1 -- 172.21.15.27:0/3266562145 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1668022070 con 0x5600badfd9d0 2024-09-19T08:11:32.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.809+0000 7f165e7fc640 1 -- 172.21.15.27:0/3266562145 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f167000f040 con 0x5600badfd9d0 2024-09-19T08:11:32.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.809+0000 7f167f996740 10 client.15459 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:32.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.809+0000 7f167f996740 10 client.15459 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:11:32.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.809+0000 7f167f996740 20 client.15459 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:32.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.809+0000 7f167f996740 1 --2- 172.21.15.27:0/3266562145 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5600bae19420 0x5600bae87760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:32.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.809+0000 7f167f996740 4 client.15459 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:11:32.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.809+0000 7f167f996740 1 -- 172.21.15.27:0/3266562145 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "status"}) -- 0x5600bad6bb10 con 0x5600bae19420 2024-09-19T08:11:32.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.809+0000 7f16767fc640 1 --2- 172.21.15.27:0/3266562145 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5600bae19420 0x5600bae87760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:32.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.810+0000 7f165e7fc640 10 client.15459 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:32.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.810+0000 7f16767fc640 1 --2- 172.21.15.27:0/3266562145 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5600bae19420 0x5600bae87760 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cecb5569537f119b server_cookie=69723727ed3f1df8 in_seq=0 out_seq=0 2024-09-19T08:11:32.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.810+0000 7f165e7fc640 1 -- 172.21.15.27:0/3266562145 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x5600bad6bb10 con 0x5600bae19420 2024-09-19T08:11:32.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.810+0000 7f165e7fc640 10 client.15459 handle_command_reply: tid=0 2024-09-19T08:11:32.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.810+0000 7f167f996740 1 client.15459 shutdown 2024-09-19T08:11:32.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.810+0000 7f167f996740 1 -- 172.21.15.27:0/3266562145 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600badfd9d0 msgr2=0x5600bae1c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:32.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.810+0000 7f167f996740 1 --2- 172.21.15.27:0/3266562145 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600badfd9d0 0x5600bae1c880 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1670005fd0 tx=0x7f1670013eb0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.810+0000 7f167f996740 1 -- 172.21.15.27:0/3266562145 shutdown_connections 2024-09-19T08:11:32.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.810+0000 7f167f996740 1 --2- 172.21.15.27:0/3266562145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5600bae08bb0 0x5600bae1d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.810+0000 7f167f996740 1 --2- 172.21.15.27:0/3266562145 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5600bae19420 0x5600bae87760 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.810+0000 7f167f996740 1 --2- 172.21.15.27:0/3266562145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600badfe2f0 0x5600bae1cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.810+0000 7f167f996740 1 --2- 172.21.15.27:0/3266562145 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600badfd9d0 0x5600bae1c880 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.810+0000 7f165e7fc640 0 client.15459 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:32.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.810+0000 7f167f996740 1 -- 172.21.15.27:0/3266562145 >> 172.21.15.27:0/3266562145 conn(0x5600badf9f60 msgr2=0x5600bae00580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:32.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.810+0000 7f167f996740 1 -- 172.21.15.27:0/3266562145 shutdown_connections 2024-09-19T08:11:32.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.810+0000 7f167f996740 1 -- 172.21.15.27:0/3266562145 wait complete. 2024-09-19T08:11:32.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.810+0000 7f167f996740 20 client.15459 trim_cache size 0 max 16384 2024-09-19T08:11:32.820 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:11:32.821 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "35b531b0-765d-11ef-bceb-c7b262605968", 2024-09-19T08:11:32.821 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2024-09-19T08:11:32.821 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 24482, 2024-09-19T08:11:32.821 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2024-09-19T08:11:32.821 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2024-09-19T08:11:32.821 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2024-09-19T08:11:32.821 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 140.551037237, 2024-09-19T08:11:32.821 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 20, 2024-09-19T08:11:32.821 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 84, 2024-09-19T08:11:32.821 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T08:11:32.821 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 152.553186665 2024-09-19T08:11:32.821 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:11:32.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.811+0000 7f167d5bd640 1 -- 172.21.15.27:0/3118303320 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f16640a3440 msgr2=0x7f16640a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:32.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.811+0000 7f167d5bd640 1 --2- 172.21.15.27:0/3118303320 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f16640a3440 0x7f16640a5900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f166800cba0 tx=0x7f16680046c0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.811+0000 7f167d5bd640 1 -- 172.21.15.27:0/3118303320 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1678103660 msgr2=0x7f1678100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:32.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.811+0000 7f167d5bd640 1 --2- 172.21.15.27:0/3118303320 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1678103660 0x7f1678100ee0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1660006010 tx=0x7f16600042f0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.811+0000 7f167d5bd640 1 -- 172.21.15.27:0/3118303320 shutdown_connections 2024-09-19T08:11:32.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.811+0000 7f167d5bd640 1 --2- 172.21.15.27:0/3118303320 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f16640a3440 0x7f16640a5900 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.811+0000 7f167d5bd640 1 --2- 172.21.15.27:0/3118303320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f167810c170 0x7f1678101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.811+0000 7f167d5bd640 1 --2- 172.21.15.27:0/3118303320 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1678103660 0x7f1678100ee0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.811+0000 7f167d5bd640 1 --2- 172.21.15.27:0/3118303320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1678102d40 0x7f16781009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:32.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.811+0000 7f167d5bd640 1 -- 172.21.15.27:0/3118303320 >> 172.21.15.27:0/3118303320 conn(0x7f16780fc7a0 msgr2=0x7f16780fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:32.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.811+0000 7f167d5bd640 1 -- 172.21.15.27:0/3118303320 shutdown_connections 2024-09-19T08:11:32.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:32.811+0000 7f167d5bd640 1 -- 172.21.15.27:0/3118303320 wait complete. 2024-09-19T08:11:33.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:32 smithi027 ceph-mon[31209]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:11:33.069 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:33.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:32 smithi155 ceph-mon[35362]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:11:33.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:32 smithi203 ceph-mon[35198]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:11:33.543 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-19T08:11:34.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.981+0000 7f6a712da640 1 -- 172.21.15.27:0/638754403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a6c100e20 msgr2=0x7f6a6c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:34.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.981+0000 7f6a712da640 1 --2- 172.21.15.27:0/638754403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a6c100e20 0x7f6a6c101200 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c009900 tx=0x7f6a5c02a480 comp rx=0 tx=0).stop 2024-09-19T08:11:34.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.981+0000 7f6a712da640 1 -- 172.21.15.27:0/638754403 shutdown_connections 2024-09-19T08:11:34.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.981+0000 7f6a712da640 1 --2- 172.21.15.27:0/638754403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a6c102ef0 0x7f6a6c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:34.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.981+0000 7f6a712da640 1 --2- 172.21.15.27:0/638754403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a6c102570 0x7f6a6c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:34.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.981+0000 7f6a712da640 1 --2- 172.21.15.27:0/638754403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a6c100e20 0x7f6a6c101200 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:34.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.981+0000 7f6a712da640 1 -- 172.21.15.27:0/638754403 >> 172.21.15.27:0/638754403 conn(0x7f6a6c0fc7d0 msgr2=0x7f6a6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:34.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.981+0000 7f6a712da640 1 -- 172.21.15.27:0/638754403 shutdown_connections 2024-09-19T08:11:34.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.981+0000 7f6a712da640 1 -- 172.21.15.27:0/638754403 wait complete. 2024-09-19T08:11:34.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.981+0000 7f6a712da640 1 Processor -- start 2024-09-19T08:11:34.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.981+0000 7f6a712da640 1 -- start start 2024-09-19T08:11:34.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a712da640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a6c100e20 0x7f6a6c1a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:34.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a712da640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a6c102570 0x7f6a6c1a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:34.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a712da640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a6c102ef0 0x7f6a6c19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:34.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a712da640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c111020 con 0x7f6a6c100e20 2024-09-19T08:11:34.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a712da640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c110ea0 con 0x7f6a6c102ef0 2024-09-19T08:11:34.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a712da640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c1111a0 con 0x7f6a6c102570 2024-09-19T08:11:34.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a6affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a6c100e20 0x7f6a6c1a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:34.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a6affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a6c100e20 0x7f6a6c1a05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47044/0 (socket says 172.21.15.27:47044) 2024-09-19T08:11:34.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a6affd640 1 -- 172.21.15.27:0/1019122720 learned_addr learned my addr 172.21.15.27:0/1019122720 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:34.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a6b7fe640 1 --2- 172.21.15.27:0/1019122720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a6c102ef0 0x7f6a6c19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:34.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a6affd640 1 -- 172.21.15.27:0/1019122720 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a6c102570 msgr2=0x7f6a6c1a0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:34.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a6affd640 1 --2- 172.21.15.27:0/1019122720 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a6c102570 0x7f6a6c1a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:34.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a6affd640 1 -- 172.21.15.27:0/1019122720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a6c102ef0 msgr2=0x7f6a6c19a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:34.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a6affd640 1 --2- 172.21.15.27:0/1019122720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a6c102ef0 0x7f6a6c19a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:34.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a6affd640 1 -- 172.21.15.27:0/1019122720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6c19af80 con 0x7f6a6c100e20 2024-09-19T08:11:34.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a6b7fe640 1 --2- 172.21.15.27:0/1019122720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a6c102ef0 0x7f6a6c19a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:11:34.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a6affd640 1 --2- 172.21.15.27:0/1019122720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a6c100e20 0x7f6a6c1a05f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c006010 tx=0x7f6a5c003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:34.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a68ff9640 1 -- 172.21.15.27:0/1019122720 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c03f070 con 0x7f6a6c100e20 2024-09-19T08:11:34.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a68ff9640 1 -- 172.21.15.27:0/1019122720 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a5c031e30 con 0x7f6a6c100e20 2024-09-19T08:11:34.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a712da640 1 -- 172.21.15.27:0/1019122720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6c19b210 con 0x7f6a6c100e20 2024-09-19T08:11:34.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.982+0000 7f6a68ff9640 1 -- 172.21.15.27:0/1019122720 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c035030 con 0x7f6a6c100e20 2024-09-19T08:11:34.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.983+0000 7f6a712da640 1 -- 172.21.15.27:0/1019122720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6c1a7410 con 0x7f6a6c100e20 2024-09-19T08:11:34.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.983+0000 7f6a712da640 1 -- 172.21.15.27:0/1019122720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a6c101280 con 0x7f6a6c100e20 2024-09-19T08:11:34.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.985+0000 7f6a68ff9640 1 -- 172.21.15.27:0/1019122720 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f6a5c042070 con 0x7f6a6c100e20 2024-09-19T08:11:34.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.985+0000 7f6a68ff9640 1 --2- 172.21.15.27:0/1019122720 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6a580a3440 0x7f6a580a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:34.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.985+0000 7f6a63fff640 1 --2- 172.21.15.27:0/1019122720 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6a580a3440 0x7f6a580a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:34.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.986+0000 7f6a68ff9640 1 -- 172.21.15.27:0/1019122720 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f6a5c0f0870 con 0x7f6a6c100e20 2024-09-19T08:11:34.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.986+0000 7f6a63fff640 1 --2- 172.21.15.27:0/1019122720 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6a580a3440 0x7f6a580a5900 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c105420 tx=0x7f6a54006c90 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:34.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:33.990+0000 7f6a68ff9640 1 -- 172.21.15.27:0/1019122720 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6a5c0bd130 con 0x7f6a6c100e20 2024-09-19T08:11:34.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:34.203+0000 7f6a712da640 1 -- 172.21.15.27:0/1019122720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a6c1a75e0 con 0x7f6a6c100e20 2024-09-19T08:11:34.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:34.203+0000 7f6a68ff9640 1 -- 172.21.15.27:0/1019122720 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f6a5c0bca30 con 0x7f6a6c100e20 2024-09-19T08:11:34.203 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:11:34.204 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:11:34.204 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:11:34.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:34.205+0000 7f6a712da640 1 -- 172.21.15.27:0/1019122720 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6a580a3440 msgr2=0x7f6a580a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:34.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:34.205+0000 7f6a712da640 1 --2- 172.21.15.27:0/1019122720 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6a580a3440 0x7f6a580a5900 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c105420 tx=0x7f6a54006c90 comp rx=0 tx=0).stop 2024-09-19T08:11:34.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:34.205+0000 7f6a712da640 1 -- 172.21.15.27:0/1019122720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a6c100e20 msgr2=0x7f6a6c1a05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:34.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:34.205+0000 7f6a712da640 1 --2- 172.21.15.27:0/1019122720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a6c100e20 0x7f6a6c1a05f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c006010 tx=0x7f6a5c003c80 comp rx=0 tx=0).stop 2024-09-19T08:11:34.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:34.206+0000 7f6a712da640 1 -- 172.21.15.27:0/1019122720 shutdown_connections 2024-09-19T08:11:34.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:34.206+0000 7f6a712da640 1 --2- 172.21.15.27:0/1019122720 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6a580a3440 0x7f6a580a5900 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:34.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:34.206+0000 7f6a712da640 1 --2- 172.21.15.27:0/1019122720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a6c102ef0 0x7f6a6c19a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:34.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:34.206+0000 7f6a712da640 1 --2- 172.21.15.27:0/1019122720 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a6c102570 0x7f6a6c1a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:34.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:34.206+0000 7f6a712da640 1 --2- 172.21.15.27:0/1019122720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a6c100e20 0x7f6a6c1a05f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:34.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:34.206+0000 7f6a712da640 1 -- 172.21.15.27:0/1019122720 >> 172.21.15.27:0/1019122720 conn(0x7f6a6c0fc7d0 msgr2=0x7f6a6c06a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:34.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:34.206+0000 7f6a712da640 1 -- 172.21.15.27:0/1019122720 shutdown_connections 2024-09-19T08:11:34.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:34.206+0000 7f6a712da640 1 -- 172.21.15.27:0/1019122720 wait complete. 2024-09-19T08:11:35.050 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:11:35.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:34 smithi155 ceph-mon[35362]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-19T08:11:35.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:34 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1019122720' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:35.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:34 smithi027 ceph-mon[31209]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-19T08:11:35.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:34 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1019122720' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:35.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:34 smithi203 ceph-mon[35198]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-19T08:11:35.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:34 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1019122720' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:35.314 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:35.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.820+0000 7f5b5c27f640 1 -- 172.21.15.27:0/1927684002 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b54100a80 msgr2=0x7f5b54100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:35.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.820+0000 7f5b5c27f640 1 --2- 172.21.15.27:0/1927684002 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b54100a80 0x7f5b54100ee0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5b44009930 tx=0x7f5b4402a420 comp rx=0 tx=0).stop 2024-09-19T08:11:35.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.820+0000 7f5b5c27f640 1 -- 172.21.15.27:0/1927684002 shutdown_connections 2024-09-19T08:11:35.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.820+0000 7f5b5c27f640 1 --2- 172.21.15.27:0/1927684002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b54101420 0x7f5b5410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.820+0000 7f5b5c27f640 1 --2- 172.21.15.27:0/1927684002 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b54100a80 0x7f5b54100ee0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.820+0000 7f5b5c27f640 1 --2- 172.21.15.27:0/1927684002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b54106a80 0x7f5b54106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.820+0000 7f5b5c27f640 1 -- 172.21.15.27:0/1927684002 >> 172.21.15.27:0/1927684002 conn(0x7f5b540fc7a0 msgr2=0x7f5b540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:35.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.820+0000 7f5b5c27f640 1 -- 172.21.15.27:0/1927684002 shutdown_connections 2024-09-19T08:11:35.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.820+0000 7f5b5c27f640 1 -- 172.21.15.27:0/1927684002 wait complete. 2024-09-19T08:11:35.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.821+0000 7f5b5c27f640 1 Processor -- start 2024-09-19T08:11:35.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.821+0000 7f5b5c27f640 1 -- start start 2024-09-19T08:11:35.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.821+0000 7f5b5c27f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b54100a80 0x7f5b54199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:35.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.821+0000 7f5b5c27f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b54101420 0x7f5b54199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:35.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.821+0000 7f5b5c27f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b54106a80 0x7f5b541a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:35.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.821+0000 7f5b5c27f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5b54110f20 con 0x7f5b54100a80 2024-09-19T08:11:35.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.821+0000 7f5b5c27f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5b54110da0 con 0x7f5b54106a80 2024-09-19T08:11:35.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.821+0000 7f5b5c27f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5b541110a0 con 0x7f5b54101420 2024-09-19T08:11:35.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.821+0000 7f5b5a01b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b54100a80 0x7f5b54199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:35.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.822+0000 7f5b5a01b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b54100a80 0x7f5b54199450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47068/0 (socket says 172.21.15.27:47068) 2024-09-19T08:11:35.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.822+0000 7f5b5a01b640 1 -- 172.21.15.27:0/2335047552 learned_addr learned my addr 172.21.15.27:0/2335047552 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:35.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.822+0000 7f5b5981a640 1 --2- 172.21.15.27:0/2335047552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b54101420 0x7f5b54199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:35.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.822+0000 7f5b5a81c640 1 --2- 172.21.15.27:0/2335047552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b54106a80 0x7f5b541a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:35.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.822+0000 7f5b5a01b640 1 -- 172.21.15.27:0/2335047552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b54101420 msgr2=0x7f5b54199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:35.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.822+0000 7f5b5a01b640 1 --2- 172.21.15.27:0/2335047552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b54101420 0x7f5b54199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.822+0000 7f5b5a01b640 1 -- 172.21.15.27:0/2335047552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b54106a80 msgr2=0x7f5b541a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:35.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.822+0000 7f5b5a01b640 1 --2- 172.21.15.27:0/2335047552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b54106a80 0x7f5b541a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.822+0000 7f5b5a01b640 1 -- 172.21.15.27:0/2335047552 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b541a4a10 con 0x7f5b54100a80 2024-09-19T08:11:35.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.822+0000 7f5b5a01b640 1 --2- 172.21.15.27:0/2335047552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b54100a80 0x7f5b54199450 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000b4a0 tx=0x7f5b5000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:35.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.822+0000 7f5b4b7fe640 1 -- 172.21.15.27:0/2335047552 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50014070 con 0x7f5b54100a80 2024-09-19T08:11:35.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.822+0000 7f5b5c27f640 1 -- 172.21.15.27:0/2335047552 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b541a4be0 con 0x7f5b54100a80 2024-09-19T08:11:35.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.822+0000 7f5b4b7fe640 1 -- 172.21.15.27:0/2335047552 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b50010af0 con 0x7f5b54100a80 2024-09-19T08:11:35.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.822+0000 7f5b4b7fe640 1 -- 172.21.15.27:0/2335047552 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50017d10 con 0x7f5b54100a80 2024-09-19T08:11:35.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.822+0000 7f5b5c27f640 1 -- 172.21.15.27:0/2335047552 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b541a50a0 con 0x7f5b54100a80 2024-09-19T08:11:35.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.824+0000 7f5b4b7fe640 1 -- 172.21.15.27:0/2335047552 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f5b50017070 con 0x7f5b54100a80 2024-09-19T08:11:35.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.825+0000 7f5b5e658740 1 Processor -- start 2024-09-19T08:11:35.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.825+0000 7f5b5e658740 1 -- start start 2024-09-19T08:11:35.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.825+0000 7f5b5e658740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a55b40 0x55f1a1a54090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:35.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.825+0000 7f5b5e658740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1a1a545d0 0x55f1a1a54a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:35.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.825+0000 7f5b5e658740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a5f370 0x55f1a1a61760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:35.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.825+0000 7f5b5e658740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f1a19ba2f0 con 0x55f1a1a5f370 2024-09-19T08:11:35.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.825+0000 7f5b5e658740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f1a1961cf0 con 0x55f1a1a545d0 2024-09-19T08:11:35.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.825+0000 7f5b5e658740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f1a19b62b0 con 0x55f1a1a55b40 2024-09-19T08:11:35.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.826+0000 7f5b5981a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a5f370 0x55f1a1a61760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:35.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.826+0000 7f5b5981a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a5f370 0x55f1a1a61760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47070/0 (socket says 172.21.15.27:47070) 2024-09-19T08:11:35.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.826+0000 7f5b4b7fe640 1 --2- 172.21.15.27:0/2335047552 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f5b400a3440 0x7f5b400a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:35.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.826+0000 7f5b5981a640 1 -- 172.21.15.27:0/507785541 learned_addr learned my addr 172.21.15.27:0/507785541 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:35.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.826+0000 7f5b5a81c640 1 --2- 172.21.15.27:0/507785541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a55b40 0x55f1a1a54090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:35.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.826+0000 7f5b5a01b640 1 --2- 172.21.15.27:0/507785541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1a1a545d0 0x55f1a1a54a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:35.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.826+0000 7f5b5a81c640 1 --2- 172.21.15.27:0/2335047552 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f5b400a3440 0x7f5b400a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:35.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.826+0000 7f5b5981a640 1 -- 172.21.15.27:0/507785541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a55b40 msgr2=0x55f1a1a54090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:35.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.826+0000 7f5b5981a640 1 --2- 172.21.15.27:0/507785541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a55b40 0x55f1a1a54090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.826+0000 7f5b5981a640 1 -- 172.21.15.27:0/507785541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1a1a545d0 msgr2=0x55f1a1a54a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:35.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.826+0000 7f5b5981a640 1 --2- 172.21.15.27:0/507785541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1a1a545d0 0x55f1a1a54a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.826+0000 7f5b5981a640 1 -- 172.21.15.27:0/507785541 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1a19463a0 con 0x55f1a1a5f370 2024-09-19T08:11:35.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.826+0000 7f5b4b7fe640 1 -- 172.21.15.27:0/2335047552 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f5b500cf0e0 con 0x7f5b54100a80 2024-09-19T08:11:35.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.826+0000 7f5b5a81c640 1 --2- 172.21.15.27:0/507785541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a55b40 0x55f1a1a54090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:35.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.826+0000 7f5b5a01b640 1 --2- 172.21.15.27:0/507785541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1a1a545d0 0x55f1a1a54a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:11:35.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.826+0000 7f5b5981a640 1 --2- 172.21.15.27:0/507785541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a5f370 0x55f1a1a61760 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5b4402a940 tx=0x7f5b440316e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da1732f9e9ce1a76 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:35.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.826+0000 7f5b5a81c640 1 --2- 172.21.15.27:0/2335047552 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f5b400a3440 0x7f5b400a5900 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009900 tx=0x7f5b4c009650 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:35.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.826+0000 7f5b48dea640 1 -- 172.21.15.27:0/507785541 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b44040070 con 0x55f1a1a5f370 2024-09-19T08:11:35.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.827+0000 7f5b48dea640 1 -- 172.21.15.27:0/507785541 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b44005020 con 0x55f1a1a5f370 2024-09-19T08:11:35.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.827+0000 7f5b48dea640 1 -- 172.21.15.27:0/507785541 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b44035040 con 0x55f1a1a5f370 2024-09-19T08:11:35.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.827+0000 7f5b5e658740 1 -- 172.21.15.27:0/507785541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a5f370 msgr2=0x55f1a1a61760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:35.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.827+0000 7f5b5e658740 1 --2- 172.21.15.27:0/507785541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a5f370 0x55f1a1a61760 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5b4402a940 tx=0x7f5b440316e0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.827+0000 7f5b5e658740 1 -- 172.21.15.27:0/507785541 shutdown_connections 2024-09-19T08:11:35.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.827+0000 7f5b5e658740 1 --2- 172.21.15.27:0/507785541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a5f370 0x55f1a1a61760 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.827+0000 7f5b5e658740 1 --2- 172.21.15.27:0/507785541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1a1a545d0 0x55f1a1a54a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.827+0000 7f5b5e658740 1 --2- 172.21.15.27:0/507785541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a55b40 0x55f1a1a54090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.827+0000 7f5b5e658740 1 -- 172.21.15.27:0/507785541 >> 172.21.15.27:0/507785541 conn(0x55f1a1a1d310 msgr2=0x55f1a1a50c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:35.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.827+0000 7f5b5e658740 1 -- 172.21.15.27:0/507785541 shutdown_connections 2024-09-19T08:11:35.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.827+0000 7f5b5e658740 1 -- 172.21.15.27:0/507785541 wait complete. 2024-09-19T08:11:35.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.828+0000 7f5b5e658740 1 -- start start 2024-09-19T08:11:35.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.828+0000 7f5b5e658740 1 Processor -- start 2024-09-19T08:11:35.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.828+0000 7f5b5e658740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a545d0 0x55f1a1a5ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:35.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.828+0000 7f5b5e658740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a55b40 0x55f1a1a5bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:35.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.828+0000 7f5b5e658740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1a1a5f370 0x55f1a1a5c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:35.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.828+0000 7f5b5e658740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f1a1a62010 con 0x55f1a1a55b40 2024-09-19T08:11:35.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.828+0000 7f5b5e658740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f1a1975060 con 0x55f1a1a5f370 2024-09-19T08:11:35.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.828+0000 7f5b5e658740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f1a1a62190 con 0x55f1a1a545d0 2024-09-19T08:11:35.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.828+0000 7f5b5e658740 10 client.0 _ll_register_callbacks cb 0x55f1a16c88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:35.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.828+0000 7f5b5981a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a55b40 0x55f1a1a5bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:35.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.828+0000 7f5b5981a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a55b40 0x55f1a1a5bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47082/0 (socket says 172.21.15.27:47082) 2024-09-19T08:11:35.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.828+0000 7f5b5981a640 1 -- 172.21.15.27:0/3869923621 learned_addr learned my addr 172.21.15.27:0/3869923621 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:35.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.828+0000 7f5b5a01b640 1 --2- 172.21.15.27:0/3869923621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a545d0 0x55f1a1a5ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:35.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.828+0000 7f5b5a81c640 1 --2- 172.21.15.27:0/3869923621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1a1a5f370 0x55f1a1a5c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:35.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.828+0000 7f5b5981a640 1 -- 172.21.15.27:0/3869923621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a545d0 msgr2=0x55f1a1a5ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:35.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.828+0000 7f5b5981a640 1 --2- 172.21.15.27:0/3869923621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a545d0 0x55f1a1a5ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.828+0000 7f5b5981a640 1 -- 172.21.15.27:0/3869923621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1a1a5f370 msgr2=0x55f1a1a5c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:35.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.828+0000 7f5b5981a640 1 --2- 172.21.15.27:0/3869923621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1a1a5f370 0x55f1a1a5c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.829+0000 7f5b5981a640 1 -- 172.21.15.27:0/3869923621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1a172b3c0 con 0x55f1a1a55b40 2024-09-19T08:11:35.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.829+0000 7f5b5981a640 1 --2- 172.21.15.27:0/3869923621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a55b40 0x55f1a1a5bee0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5b44009670 tx=0x7f5b440314b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff864c9b9629df7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:35.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.829+0000 7f5b3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:35.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.829+0000 7f5b3dffb640 1 -- 172.21.15.27:0/3869923621 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4404d060 con 0x55f1a1a55b40 2024-09-19T08:11:35.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.829+0000 7f5b3dffb640 1 -- 172.21.15.27:0/3869923621 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f5b44004250 con 0x55f1a1a55b40 2024-09-19T08:11:35.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.829+0000 7f5b5e658740 1 -- 172.21.15.27:0/3869923621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b44005020 con 0x55f1a1a55b40 2024-09-19T08:11:35.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.829+0000 7f5b3dffb640 1 -- 172.21.15.27:0/3869923621 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5b44040030 con 0x55f1a1a55b40 2024-09-19T08:11:35.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.829+0000 7f5b5e658740 10 client.15477 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:35.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.829+0000 7f5b5e658740 1 -- 172.21.15.27:0/3869923621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f1a1a6d910 con 0x55f1a1a55b40 2024-09-19T08:11:35.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.829+0000 7f5b3dffb640 1 -- 172.21.15.27:0/3869923621 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b44005020 con 0x55f1a1a55b40 2024-09-19T08:11:35.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.829+0000 7f5b3dffb640 1 -- 172.21.15.27:0/3869923621 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5b440039e0 con 0x55f1a1a55b40 2024-09-19T08:11:35.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.829+0000 7f5b5e658740 10 client.15477 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:35.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.829+0000 7f5b5e658740 10 client.15477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:35.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.829+0000 7f5b5e658740 20 client.15477 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:35.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.830+0000 7f5b5e658740 1 --2- 172.21.15.27:0/3869923621 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f1a1a6ec60 0x55f1a1a71050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:35.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.830+0000 7f5b5e658740 4 client.15477 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:11:35.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.830+0000 7f5b5e658740 1 -- 172.21.15.27:0/3869923621 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1a19c7860 con 0x55f1a1a6ec60 2024-09-19T08:11:35.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.830+0000 7f5b5a01b640 1 --2- 172.21.15.27:0/3869923621 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f1a1a6ec60 0x55f1a1a71050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:35.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.830+0000 7f5b5a01b640 1 --2- 172.21.15.27:0/3869923621 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f1a1a6ec60 0x55f1a1a71050 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a448bb2e34d15b00 server_cookie=eac28d8d6ab01658 in_seq=0 out_seq=0 2024-09-19T08:11:35.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.830+0000 7f5b3dffb640 10 client.15477 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:35.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.831+0000 7f5b3dffb640 1 -- 172.21.15.27:0/3869923621 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f1a19c7860 con 0x55f1a1a6ec60 2024-09-19T08:11:35.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.831+0000 7f5b3dffb640 10 client.15477 handle_command_reply: tid=0 2024-09-19T08:11:35.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.831+0000 7f5b5e658740 1 client.15477 shutdown 2024-09-19T08:11:35.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.831+0000 7f5b5e658740 1 -- 172.21.15.27:0/3869923621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a55b40 msgr2=0x55f1a1a5bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:35.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.831+0000 7f5b5e658740 1 --2- 172.21.15.27:0/3869923621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a55b40 0x55f1a1a5bee0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5b44009670 tx=0x7f5b440314b0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.831+0000 7f5b5e658740 1 -- 172.21.15.27:0/3869923621 shutdown_connections 2024-09-19T08:11:35.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.831+0000 7f5b5e658740 1 --2- 172.21.15.27:0/3869923621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1a1a5f370 0x55f1a1a5c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.831+0000 7f5b5e658740 1 --2- 172.21.15.27:0/3869923621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a55b40 0x55f1a1a5bee0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.831+0000 7f5b5e658740 1 --2- 172.21.15.27:0/3869923621 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f1a1a6ec60 0x55f1a1a71050 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.831+0000 7f5b5e658740 1 --2- 172.21.15.27:0/3869923621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a545d0 0x55f1a1a5ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.831+0000 7f5b3dffb640 0 client.15477 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:35.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.831+0000 7f5b5e658740 1 -- 172.21.15.27:0/3869923621 >> 172.21.15.27:0/3869923621 conn(0x55f1a1a1d310 msgr2=0x55f1a1a56960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:35.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.831+0000 7f5b5e658740 1 -- 172.21.15.27:0/3869923621 shutdown_connections 2024-09-19T08:11:35.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.831+0000 7f5b5e658740 1 -- 172.21.15.27:0/3869923621 wait complete. 2024-09-19T08:11:35.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.831+0000 7f5b5e658740 20 client.15477 trim_cache size 0 max 16384 2024-09-19T08:11:35.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.844+0000 7f5b5e658740 1 Processor -- start 2024-09-19T08:11:35.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.844+0000 7f5b5e658740 1 -- start start 2024-09-19T08:11:35.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.845+0000 7f5b5e658740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a545d0 0x55f1a1a6b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:35.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.845+0000 7f5b5e658740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a55b40 0x55f1a1a60760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:35.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.845+0000 7f5b5e658740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1a1a5f370 0x55f1a1a60ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:35.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.845+0000 7f5b5e658740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5b541ab7c0 con 0x55f1a1a545d0 2024-09-19T08:11:35.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.845+0000 7f5b5e658740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5b541ae040 con 0x55f1a1a5f370 2024-09-19T08:11:35.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.845+0000 7f5b5e658740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5b541abe30 con 0x55f1a1a55b40 2024-09-19T08:11:35.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.845+0000 7f5b5a01b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a545d0 0x55f1a1a6b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:35.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.845+0000 7f5b5a01b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a545d0 0x55f1a1a6b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47098/0 (socket says 172.21.15.27:47098) 2024-09-19T08:11:35.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.845+0000 7f5b5a01b640 1 -- 172.21.15.27:0/963384337 learned_addr learned my addr 172.21.15.27:0/963384337 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:35.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.845+0000 7f5b5981a640 1 --2- 172.21.15.27:0/963384337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a55b40 0x55f1a1a60760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:35.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.845+0000 7f5b5a01b640 1 -- 172.21.15.27:0/963384337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a55b40 msgr2=0x55f1a1a60760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:35.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.845+0000 7f5b5a01b640 1 --2- 172.21.15.27:0/963384337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a55b40 0x55f1a1a60760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.845+0000 7f5b5a01b640 1 -- 172.21.15.27:0/963384337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1a1a5f370 msgr2=0x55f1a1a60ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:35.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.845+0000 7f5b5a01b640 1 --2- 172.21.15.27:0/963384337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1a1a5f370 0x55f1a1a60ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.845+0000 7f5b5a01b640 1 -- 172.21.15.27:0/963384337 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1a1a51960 con 0x55f1a1a545d0 2024-09-19T08:11:35.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.845+0000 7f5b5a01b640 1 --2- 172.21.15.27:0/963384337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a545d0 0x55f1a1a6b2b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000be60 tx=0x7f5b500bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875f88340452516f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:35.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.845+0000 7f5b3ffff640 1 -- 172.21.15.27:0/963384337 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5009f700 con 0x55f1a1a545d0 2024-09-19T08:11:35.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.845+0000 7f5b3ffff640 1 -- 172.21.15.27:0/963384337 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b500a3fc0 con 0x55f1a1a545d0 2024-09-19T08:11:35.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.845+0000 7f5b3ffff640 1 -- 172.21.15.27:0/963384337 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50010ca0 con 0x55f1a1a545d0 2024-09-19T08:11:35.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.846+0000 7f5b5e658740 1 -- 172.21.15.27:0/963384337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a545d0 msgr2=0x55f1a1a6b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:35.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.846+0000 7f5b5e658740 1 --2- 172.21.15.27:0/963384337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a545d0 0x55f1a1a6b2b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000be60 tx=0x7f5b500bb040 comp rx=0 tx=0).stop 2024-09-19T08:11:35.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.846+0000 7f5b5e658740 1 -- 172.21.15.27:0/963384337 shutdown_connections 2024-09-19T08:11:35.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.846+0000 7f5b5e658740 1 --2- 172.21.15.27:0/963384337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1a1a5f370 0x55f1a1a60ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.846+0000 7f5b5e658740 1 --2- 172.21.15.27:0/963384337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a55b40 0x55f1a1a60760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.846+0000 7f5b5e658740 1 --2- 172.21.15.27:0/963384337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a545d0 0x55f1a1a6b2b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.846+0000 7f5b5e658740 1 -- 172.21.15.27:0/963384337 >> 172.21.15.27:0/963384337 conn(0x55f1a1a1d310 msgr2=0x55f1a1a5a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:35.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.846+0000 7f5b5e658740 1 -- 172.21.15.27:0/963384337 shutdown_connections 2024-09-19T08:11:35.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.846+0000 7f5b5e658740 1 -- 172.21.15.27:0/963384337 wait complete. 2024-09-19T08:11:35.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.846+0000 7f5b5e658740 1 -- start start 2024-09-19T08:11:35.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.846+0000 7f5b5e658740 1 Processor -- start 2024-09-19T08:11:35.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.847+0000 7f5b5e658740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1a1a545d0 0x55f1a1a763e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:35.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.847+0000 7f5b5e658740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a55b40 0x55f1a1a76920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:35.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.847+0000 7f5b5e658740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a5f370 0x55f1a1a76e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:35.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.847+0000 7f5b5e658740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5b541ac500 con 0x55f1a1a55b40 2024-09-19T08:11:35.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.847+0000 7f5b5e658740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5b541ad970 con 0x55f1a1a545d0 2024-09-19T08:11:35.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.847+0000 7f5b5e658740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5b541acbd0 con 0x55f1a1a5f370 2024-09-19T08:11:35.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.847+0000 7f5b5e658740 10 client.0 _ll_register_callbacks cb 0x7f5b440315b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:35.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.847+0000 7f5b5981a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a55b40 0x55f1a1a76920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:35.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.847+0000 7f5b5981a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a55b40 0x55f1a1a76920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47102/0 (socket says 172.21.15.27:47102) 2024-09-19T08:11:35.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.847+0000 7f5b5981a640 1 -- 172.21.15.27:0/1242334035 learned_addr learned my addr 172.21.15.27:0/1242334035 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:35.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.847+0000 7f5b5a81c640 1 --2- 172.21.15.27:0/1242334035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a5f370 0x55f1a1a76e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:35.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.847+0000 7f5b5981a640 1 -- 172.21.15.27:0/1242334035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a5f370 msgr2=0x55f1a1a76e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:35.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.847+0000 7f5b5981a640 1 --2- 172.21.15.27:0/1242334035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a5f370 0x55f1a1a76e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.847+0000 7f5b5981a640 1 -- 172.21.15.27:0/1242334035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1a1a545d0 msgr2=0x55f1a1a763e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:35.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.847+0000 7f5b5a01b640 1 --2- 172.21.15.27:0/1242334035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1a1a545d0 0x55f1a1a763e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:35.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.847+0000 7f5b5981a640 1 --2- 172.21.15.27:0/1242334035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1a1a545d0 0x55f1a1a763e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.847+0000 7f5b5981a640 1 -- 172.21.15.27:0/1242334035 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1a1a65d50 con 0x55f1a1a55b40 2024-09-19T08:11:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.847+0000 7f5b5981a640 1 --2- 172.21.15.27:0/1242334035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a55b40 0x55f1a1a76920 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5b44003f50 tx=0x7f5b440058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2d5485615c87bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.847+0000 7f5b3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.848+0000 7f5b3dffb640 1 -- 172.21.15.27:0/1242334035 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4404d040 con 0x55f1a1a55b40 2024-09-19T08:11:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.848+0000 7f5b3dffb640 1 -- 172.21.15.27:0/1242334035 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f5b440043e0 con 0x55f1a1a55b40 2024-09-19T08:11:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.848+0000 7f5b5e658740 1 -- 172.21.15.27:0/1242334035 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b500a3fc0 con 0x55f1a1a55b40 2024-09-19T08:11:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.848+0000 7f5b3dffb640 1 -- 172.21.15.27:0/1242334035 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5b44060050 con 0x55f1a1a55b40 2024-09-19T08:11:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.848+0000 7f5b5e658740 10 client.15483 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.848+0000 7f5b5e658740 1 -- 172.21.15.27:0/1242334035 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f1a1ad9ac0 con 0x55f1a1a55b40 2024-09-19T08:11:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.848+0000 7f5b3dffb640 1 -- 172.21.15.27:0/1242334035 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b500a3fc0 con 0x55f1a1a55b40 2024-09-19T08:11:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.848+0000 7f5b3dffb640 1 -- 172.21.15.27:0/1242334035 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5b440529c0 con 0x55f1a1a55b40 2024-09-19T08:11:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.848+0000 7f5b5e658740 10 client.15483 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.848+0000 7f5b5e658740 10 client.15483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.848+0000 7f5b5e658740 20 client.15483 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:35.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.848+0000 7f5b5e658740 1 --2- 172.21.15.27:0/1242334035 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f1a1ada180 0x55f1a1adc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:35.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.848+0000 7f5b5e658740 4 client.15483 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:11:35.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.848+0000 7f5b5e658740 1 -- 172.21.15.27:0/1242334035 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f1a19c1d70 con 0x55f1a1ada180 2024-09-19T08:11:35.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.848+0000 7f5b5a01b640 1 --2- 172.21.15.27:0/1242334035 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f1a1ada180 0x55f1a1adc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:35.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.849+0000 7f5b5a01b640 1 --2- 172.21.15.27:0/1242334035 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f1a1ada180 0x55f1a1adc5a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61a1adb0749ef143 server_cookie=ff994e38d55b9fcb in_seq=0 out_seq=0 2024-09-19T08:11:35.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.849+0000 7f5b3dffb640 10 client.15483 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:35.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.849+0000 7f5b3dffb640 1 -- 172.21.15.27:0/1242334035 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f1a19c1d70 con 0x55f1a1ada180 2024-09-19T08:11:35.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.849+0000 7f5b3dffb640 10 client.15483 handle_command_reply: tid=0 2024-09-19T08:11:35.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.849+0000 7f5b5e658740 1 client.15483 shutdown 2024-09-19T08:11:35.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.849+0000 7f5b5e658740 1 -- 172.21.15.27:0/1242334035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a55b40 msgr2=0x55f1a1a76920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:35.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.849+0000 7f5b5e658740 1 --2- 172.21.15.27:0/1242334035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a55b40 0x55f1a1a76920 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5b44003f50 tx=0x7f5b440058d0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.849+0000 7f5b5e658740 1 -- 172.21.15.27:0/1242334035 shutdown_connections 2024-09-19T08:11:35.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.849+0000 7f5b5e658740 1 --2- 172.21.15.27:0/1242334035 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f1a1ada180 0x55f1a1adc5a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.849+0000 7f5b5e658740 1 --2- 172.21.15.27:0/1242334035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f1a1a5f370 0x55f1a1a76e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.849+0000 7f5b5e658740 1 --2- 172.21.15.27:0/1242334035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1a1a55b40 0x55f1a1a76920 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.849+0000 7f5b3dffb640 0 client.15483 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:35.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.849+0000 7f5b5e658740 1 --2- 172.21.15.27:0/1242334035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1a1a545d0 0x55f1a1a763e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.849+0000 7f5b5e658740 1 -- 172.21.15.27:0/1242334035 >> 172.21.15.27:0/1242334035 conn(0x55f1a1a1d310 msgr2=0x55f1a1a5d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:35.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.849+0000 7f5b5e658740 1 -- 172.21.15.27:0/1242334035 shutdown_connections 2024-09-19T08:11:35.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.849+0000 7f5b5e658740 1 -- 172.21.15.27:0/1242334035 wait complete. 2024-09-19T08:11:35.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.849+0000 7f5b5e658740 20 client.15483 trim_cache size 0 max 16384 2024-09-19T08:11:35.867 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:11:35.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.850+0000 7f5b5c27f640 1 -- 172.21.15.27:0/2335047552 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f5b400a3440 msgr2=0x7f5b400a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:35.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.850+0000 7f5b5c27f640 1 --2- 172.21.15.27:0/2335047552 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f5b400a3440 0x7f5b400a5900 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009900 tx=0x7f5b4c009650 comp rx=0 tx=0).stop 2024-09-19T08:11:35.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.850+0000 7f5b5c27f640 1 -- 172.21.15.27:0/2335047552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b54100a80 msgr2=0x7f5b54199450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:35.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.850+0000 7f5b5c27f640 1 --2- 172.21.15.27:0/2335047552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b54100a80 0x7f5b54199450 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000b4a0 tx=0x7f5b5000b960 comp rx=0 tx=0).stop 2024-09-19T08:11:35.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.850+0000 7f5b5c27f640 1 -- 172.21.15.27:0/2335047552 shutdown_connections 2024-09-19T08:11:35.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.850+0000 7f5b5c27f640 1 --2- 172.21.15.27:0/2335047552 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f5b400a3440 0x7f5b400a5900 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.850+0000 7f5b5c27f640 1 --2- 172.21.15.27:0/2335047552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b54106a80 0x7f5b541a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.850+0000 7f5b5c27f640 1 --2- 172.21.15.27:0/2335047552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b54101420 0x7f5b54199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.850+0000 7f5b5c27f640 1 --2- 172.21.15.27:0/2335047552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b54100a80 0x7f5b54199450 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:35.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.850+0000 7f5b5c27f640 1 -- 172.21.15.27:0/2335047552 >> 172.21.15.27:0/2335047552 conn(0x7f5b540fc7a0 msgr2=0x7f5b540fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:35.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.850+0000 7f5b5c27f640 1 -- 172.21.15.27:0/2335047552 shutdown_connections 2024-09-19T08:11:35.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:35.850+0000 7f5b5c27f640 1 -- 172.21.15.27:0/2335047552 wait complete. 2024-09-19T08:11:37.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:36 smithi155 ceph-mon[35362]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T08:11:37.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:36 smithi027 ceph-mon[31209]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T08:11:37.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:36 smithi203 ceph-mon[35198]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T08:11:37.552 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:11:37.552 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:11:37.827 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:38.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.297+0000 7fd7078c1640 1 -- 172.21.15.27:0/1445763507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd700101de0 msgr2=0x7fd7001021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:38.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.297+0000 7fd7078c1640 1 --2- 172.21.15.27:0/1445763507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd700101de0 0x7fd7001021c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc009900 tx=0x7fd6fc02a410 comp rx=0 tx=0).stop 2024-09-19T08:11:38.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.297+0000 7fd7078c1640 1 -- 172.21.15.27:0/1445763507 shutdown_connections 2024-09-19T08:11:38.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.297+0000 7fd7078c1640 1 --2- 172.21.15.27:0/1445763507 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd700106f10 0x7fd70010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.297+0000 7fd7078c1640 1 --2- 172.21.15.27:0/1445763507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd700102790 0x7fd7001067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.297+0000 7fd7078c1640 1 --2- 172.21.15.27:0/1445763507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd700101de0 0x7fd7001021c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.297+0000 7fd7078c1640 1 -- 172.21.15.27:0/1445763507 >> 172.21.15.27:0/1445763507 conn(0x7fd7000fd8c0 msgr2=0x7fd7000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:38.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.297+0000 7fd7078c1640 1 -- 172.21.15.27:0/1445763507 shutdown_connections 2024-09-19T08:11:38.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.297+0000 7fd7078c1640 1 -- 172.21.15.27:0/1445763507 wait complete. 2024-09-19T08:11:38.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.298+0000 7fd7078c1640 1 Processor -- start 2024-09-19T08:11:38.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.298+0000 7fd7078c1640 1 -- start start 2024-09-19T08:11:38.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.298+0000 7fd7078c1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd700101de0 0x7fd7001984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:38.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.298+0000 7fd7078c1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd700102790 0x7fd700198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:38.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.298+0000 7fd7078c1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd700106f10 0x7fd70019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:38.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.298+0000 7fd7078c1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd700111f70 con 0x7fd700101de0 2024-09-19T08:11:38.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.298+0000 7fd7078c1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd700111df0 con 0x7fd700102790 2024-09-19T08:11:38.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.298+0000 7fd7078c1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd7001120f0 con 0x7fd700106f10 2024-09-19T08:11:38.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.298+0000 7fd70565d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd700101de0 0x7fd7001984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:38.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.298+0000 7fd70565d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd700101de0 0x7fd7001984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47112/0 (socket says 172.21.15.27:47112) 2024-09-19T08:11:38.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.298+0000 7fd70565d640 1 -- 172.21.15.27:0/2680160540 learned_addr learned my addr 172.21.15.27:0/2680160540 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:38.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.298+0000 7fd704e5c640 1 --2- 172.21.15.27:0/2680160540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd700102790 0x7fd700198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:38.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.298+0000 7fd705e5e640 1 --2- 172.21.15.27:0/2680160540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd700106f10 0x7fd70019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:38.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.299+0000 7fd70565d640 1 -- 172.21.15.27:0/2680160540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd700106f10 msgr2=0x7fd70019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:38.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.299+0000 7fd70565d640 1 --2- 172.21.15.27:0/2680160540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd700106f10 0x7fd70019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.299+0000 7fd70565d640 1 -- 172.21.15.27:0/2680160540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd700102790 msgr2=0x7fd700198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:38.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.299+0000 7fd70565d640 1 --2- 172.21.15.27:0/2680160540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd700102790 0x7fd700198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.299+0000 7fd70565d640 1 -- 172.21.15.27:0/2680160540 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70019d480 con 0x7fd700101de0 2024-09-19T08:11:38.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.299+0000 7fd70565d640 1 --2- 172.21.15.27:0/2680160540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd700101de0 0x7fd7001984d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc006010 tx=0x7fd6fc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:38.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.299+0000 7fd6f67fc640 1 -- 172.21.15.27:0/2680160540 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc03f030 con 0x7fd700101de0 2024-09-19T08:11:38.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.299+0000 7fd6f67fc640 1 -- 172.21.15.27:0/2680160540 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6fc003ce0 con 0x7fd700101de0 2024-09-19T08:11:38.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.299+0000 7fd7078c1640 1 -- 172.21.15.27:0/2680160540 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd70019d710 con 0x7fd700101de0 2024-09-19T08:11:38.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.299+0000 7fd6f67fc640 1 -- 172.21.15.27:0/2680160540 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc035070 con 0x7fd700101de0 2024-09-19T08:11:38.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.299+0000 7fd7078c1640 1 -- 172.21.15.27:0/2680160540 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7001a5050 con 0x7fd700101de0 2024-09-19T08:11:38.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.302+0000 7fd6f67fc640 1 -- 172.21.15.27:0/2680160540 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fd6fc042030 con 0x7fd700101de0 2024-09-19T08:11:38.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.302+0000 7fd709c9a740 1 Processor -- start 2024-09-19T08:11:38.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.302+0000 7fd709c9a740 1 -- start start 2024-09-19T08:11:38.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.302+0000 7fd709c9a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838da60 0x5599b838de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:38.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.302+0000 7fd709c9a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838e380 0x5599b839cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:38.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.302+0000 7fd709c9a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599b839d150 0x5599b839f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:38.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.302+0000 7fd709c9a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5599b82f3280 con 0x5599b838da60 2024-09-19T08:11:38.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.302+0000 7fd709c9a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5599b829ab10 con 0x5599b838e380 2024-09-19T08:11:38.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.302+0000 7fd709c9a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5599b82ef240 con 0x5599b839d150 2024-09-19T08:11:38.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.302+0000 7fd705e5e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838da60 0x5599b838de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:38.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.302+0000 7fd705e5e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838da60 0x5599b838de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47124/0 (socket says 172.21.15.27:47124) 2024-09-19T08:11:38.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.302+0000 7fd705e5e640 1 -- 172.21.15.27:0/3493000170 learned_addr learned my addr 172.21.15.27:0/3493000170 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:38.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.302+0000 7fd70565d640 1 --2- 172.21.15.27:0/3493000170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838e380 0x5599b839cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:38.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.302+0000 7fd704e5c640 1 --2- 172.21.15.27:0/3493000170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599b839d150 0x5599b839f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:38.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.302+0000 7fd705e5e640 1 -- 172.21.15.27:0/3493000170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599b839d150 msgr2=0x5599b839f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:38.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.302+0000 7fd705e5e640 1 --2- 172.21.15.27:0/3493000170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599b839d150 0x5599b839f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.302+0000 7fd705e5e640 1 -- 172.21.15.27:0/3493000170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838e380 msgr2=0x5599b839cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:38.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.302+0000 7fd705e5e640 1 --2- 172.21.15.27:0/3493000170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838e380 0x5599b839cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.302+0000 7fd705e5e640 1 -- 172.21.15.27:0/3493000170 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599b82a71f0 con 0x5599b838da60 2024-09-19T08:11:38.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.302+0000 7fd70565d640 1 --2- 172.21.15.27:0/3493000170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838e380 0x5599b839cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:38.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.303+0000 7fd705e5e640 1 --2- 172.21.15.27:0/3493000170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838da60 0x5599b838de40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8009f70 tx=0x7fd6f8010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feab06faa2064ceb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:38.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.303+0000 7fd6f67fc640 1 --2- 172.21.15.27:0/2680160540 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd6ec0a3440 0x7fd6ec0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:38.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.303+0000 7fd6eb7fe640 1 -- 172.21.15.27:0/3493000170 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8016070 con 0x5599b838da60 2024-09-19T08:11:38.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.303+0000 7fd6eb7fe640 1 -- 172.21.15.27:0/3493000170 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6f8004d20 con 0x5599b838da60 2024-09-19T08:11:38.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.303+0000 7fd70565d640 1 --2- 172.21.15.27:0/2680160540 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd6ec0a3440 0x7fd6ec0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:38.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.303+0000 7fd6eb7fe640 1 -- 172.21.15.27:0/3493000170 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8012850 con 0x5599b838da60 2024-09-19T08:11:38.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.303+0000 7fd6f67fc640 1 -- 172.21.15.27:0/2680160540 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fd6fc0effa0 con 0x7fd700101de0 2024-09-19T08:11:38.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.303+0000 7fd709c9a740 1 -- 172.21.15.27:0/3493000170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838da60 msgr2=0x5599b838de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:38.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.303+0000 7fd70565d640 1 --2- 172.21.15.27:0/2680160540 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd6ec0a3440 0x7fd6ec0a5900 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0ed6e0 tx=0x7fd6fc02a410 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:38.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.303+0000 7fd709c9a740 1 --2- 172.21.15.27:0/3493000170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838da60 0x5599b838de40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8009f70 tx=0x7fd6f8010800 comp rx=0 tx=0).stop 2024-09-19T08:11:38.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.304+0000 7fd709c9a740 1 -- 172.21.15.27:0/3493000170 shutdown_connections 2024-09-19T08:11:38.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.304+0000 7fd709c9a740 1 --2- 172.21.15.27:0/3493000170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599b839d150 0x5599b839f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.304+0000 7fd709c9a740 1 --2- 172.21.15.27:0/3493000170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838e380 0x5599b839cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.304+0000 7fd709c9a740 1 --2- 172.21.15.27:0/3493000170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838da60 0x5599b838de40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.304+0000 7fd709c9a740 1 -- 172.21.15.27:0/3493000170 >> 172.21.15.27:0/3493000170 conn(0x5599b838a0f0 msgr2=0x5599b838a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:38.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.304+0000 7fd709c9a740 1 -- 172.21.15.27:0/3493000170 shutdown_connections 2024-09-19T08:11:38.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.304+0000 7fd709c9a740 1 -- 172.21.15.27:0/3493000170 wait complete. 2024-09-19T08:11:38.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.304+0000 7fd709c9a740 1 -- start start 2024-09-19T08:11:38.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.304+0000 7fd709c9a740 1 Processor -- start 2024-09-19T08:11:38.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.304+0000 7fd709c9a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838da60 0x5599b839a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:38.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.304+0000 7fd709c9a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838e380 0x5599b839a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:38.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.304+0000 7fd709c9a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599b839d150 0x5599b839aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:38.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.304+0000 7fd709c9a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5599b839fd80 con 0x5599b838da60 2024-09-19T08:11:38.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.304+0000 7fd709c9a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5599b82adf10 con 0x5599b838e380 2024-09-19T08:11:38.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.304+0000 7fd709c9a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5599b839ff00 con 0x5599b839d150 2024-09-19T08:11:38.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.305+0000 7fd709c9a740 10 client.0 _ll_register_callbacks cb 0x5599b8276a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:38.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.305+0000 7fd705e5e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838da60 0x5599b839a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:38.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.305+0000 7fd705e5e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838da60 0x5599b839a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47134/0 (socket says 172.21.15.27:47134) 2024-09-19T08:11:38.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.305+0000 7fd705e5e640 1 -- 172.21.15.27:0/1841970926 learned_addr learned my addr 172.21.15.27:0/1841970926 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:38.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.305+0000 7fd704e5c640 1 --2- 172.21.15.27:0/1841970926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838e380 0x5599b839a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:38.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.305+0000 7fd705e5e640 1 --2- 172.21.15.27:0/1841970926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599b839d150 0x5599b839aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:38.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.305+0000 7fd705e5e640 1 -- 172.21.15.27:0/1841970926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599b839d150 msgr2=0x5599b839aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:38.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.305+0000 7fd705e5e640 1 --2- 172.21.15.27:0/1841970926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599b839d150 0x5599b839aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.305+0000 7fd705e5e640 1 -- 172.21.15.27:0/1841970926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838e380 msgr2=0x5599b839a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:38.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.305+0000 7fd705e5e640 1 --2- 172.21.15.27:0/1841970926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838e380 0x5599b839a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.305+0000 7fd705e5e640 1 -- 172.21.15.27:0/1841970926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599b80646a0 con 0x5599b838da60 2024-09-19T08:11:38.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.305+0000 7fd704e5c640 1 --2- 172.21.15.27:0/1841970926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838e380 0x5599b839a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:38.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.305+0000 7fd705e5e640 1 --2- 172.21.15.27:0/1841970926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838da60 0x5599b839a060 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8012490 tx=0x7fd6f8009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4959f237baf3bc61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:38.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.305+0000 7fd6e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:38.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.305+0000 7fd6e8ff9640 1 -- 172.21.15.27:0/1841970926 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8016030 con 0x5599b838da60 2024-09-19T08:11:38.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.305+0000 7fd6e8ff9640 1 -- 172.21.15.27:0/1841970926 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fd6f8005720 con 0x5599b838da60 2024-09-19T08:11:38.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.305+0000 7fd709c9a740 1 -- 172.21.15.27:0/1841970926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6f8004d20 con 0x5599b838da60 2024-09-19T08:11:38.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.305+0000 7fd6e8ff9640 1 -- 172.21.15.27:0/1841970926 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd6f8003970 con 0x5599b838da60 2024-09-19T08:11:38.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.305+0000 7fd709c9a740 10 client.15495 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:38.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.305+0000 7fd709c9a740 1 -- 172.21.15.27:0/1841970926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5599b83ab9f0 con 0x5599b838da60 2024-09-19T08:11:38.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.306+0000 7fd6e8ff9640 1 -- 172.21.15.27:0/1841970926 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6f8004d20 con 0x5599b838da60 2024-09-19T08:11:38.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.306+0000 7fd6e8ff9640 1 -- 172.21.15.27:0/1841970926 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd6f800f040 con 0x5599b838da60 2024-09-19T08:11:38.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.306+0000 7fd709c9a740 10 client.15495 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:38.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.306+0000 7fd709c9a740 10 client.15495 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:38.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.306+0000 7fd709c9a740 20 client.15495 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:38.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.306+0000 7fd709c9a740 1 --2- 172.21.15.27:0/1841970926 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5599b83acdf0 0x5599b83af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:38.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.306+0000 7fd709c9a740 4 client.15495 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:11:38.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.306+0000 7fd709c9a740 1 -- 172.21.15.27:0/1841970926 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599b83007f0 con 0x5599b83acdf0 2024-09-19T08:11:38.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.306+0000 7fd704e5c640 1 --2- 172.21.15.27:0/1841970926 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5599b83acdf0 0x5599b83af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:38.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.307+0000 7fd704e5c640 1 --2- 172.21.15.27:0/1841970926 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5599b83acdf0 0x5599b83af1e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dbafdc3c7ea0d66 server_cookie=495491fd79283d98 in_seq=0 out_seq=0 2024-09-19T08:11:38.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.307+0000 7fd6e8ff9640 10 client.15495 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:38.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.307+0000 7fd6e8ff9640 1 -- 172.21.15.27:0/1841970926 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5599b83007f0 con 0x5599b83acdf0 2024-09-19T08:11:38.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.307+0000 7fd6e8ff9640 10 client.15495 handle_command_reply: tid=0 2024-09-19T08:11:38.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.307+0000 7fd709c9a740 1 client.15495 shutdown 2024-09-19T08:11:38.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.307+0000 7fd709c9a740 1 -- 172.21.15.27:0/1841970926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838da60 msgr2=0x5599b839a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:38.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.307+0000 7fd709c9a740 1 --2- 172.21.15.27:0/1841970926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838da60 0x5599b839a060 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8012490 tx=0x7fd6f8009800 comp rx=0 tx=0).stop 2024-09-19T08:11:38.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.308+0000 7fd709c9a740 1 -- 172.21.15.27:0/1841970926 shutdown_connections 2024-09-19T08:11:38.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.308+0000 7fd709c9a740 1 --2- 172.21.15.27:0/1841970926 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5599b83acdf0 0x5599b83af1e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.308+0000 7fd709c9a740 1 --2- 172.21.15.27:0/1841970926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599b839d150 0x5599b839aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.308+0000 7fd709c9a740 1 --2- 172.21.15.27:0/1841970926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838e380 0x5599b839a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.308+0000 7fd6e8ff9640 0 client.15495 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:38.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.308+0000 7fd709c9a740 1 --2- 172.21.15.27:0/1841970926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838da60 0x5599b839a060 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.308+0000 7fd709c9a740 1 -- 172.21.15.27:0/1841970926 >> 172.21.15.27:0/1841970926 conn(0x5599b838a0f0 msgr2=0x5599b838fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:38.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.308+0000 7fd709c9a740 1 -- 172.21.15.27:0/1841970926 shutdown_connections 2024-09-19T08:11:38.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.308+0000 7fd709c9a740 1 -- 172.21.15.27:0/1841970926 wait complete. 2024-09-19T08:11:38.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.308+0000 7fd709c9a740 20 client.15495 trim_cache size 0 max 16384 2024-09-19T08:11:38.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.325+0000 7fd709c9a740 1 Processor -- start 2024-09-19T08:11:38.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.325+0000 7fd709c9a740 1 -- start start 2024-09-19T08:11:38.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.325+0000 7fd709c9a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599b838da60 0x5599b839bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:38.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.325+0000 7fd709c9a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838e380 0x5599b83b4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:38.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.325+0000 7fd709c9a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b839d150 0x5599b83b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:38.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.325+0000 7fd709c9a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd7001a9590 con 0x5599b839d150 2024-09-19T08:11:38.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.325+0000 7fd709c9a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd7001abe10 con 0x5599b838e380 2024-09-19T08:11:38.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.325+0000 7fd709c9a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd7001a9c00 con 0x5599b838da60 2024-09-19T08:11:38.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.325+0000 7fd705e5e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b839d150 0x5599b83b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:38.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.325+0000 7fd705e5e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b839d150 0x5599b83b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47142/0 (socket says 172.21.15.27:47142) 2024-09-19T08:11:38.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.325+0000 7fd705e5e640 1 -- 172.21.15.27:0/1530256254 learned_addr learned my addr 172.21.15.27:0/1530256254 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:38.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.326+0000 7fd705e5e640 1 -- 172.21.15.27:0/1530256254 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599b838da60 msgr2=0x5599b839bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:38.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.326+0000 7fd705e5e640 1 --2- 172.21.15.27:0/1530256254 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599b838da60 0x5599b839bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.326+0000 7fd705e5e640 1 -- 172.21.15.27:0/1530256254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838e380 msgr2=0x5599b83b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:38.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.326+0000 7fd705e5e640 1 --2- 172.21.15.27:0/1530256254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838e380 0x5599b83b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.326+0000 7fd705e5e640 1 -- 172.21.15.27:0/1530256254 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599b8399010 con 0x5599b839d150 2024-09-19T08:11:38.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.326+0000 7fd705e5e640 1 --2- 172.21.15.27:0/1530256254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b839d150 0x5599b83b4cc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8002230 tx=0x7fd6f8000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df2ce7c87db1e83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:38.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.326+0000 7fd6eaffd640 1 -- 172.21.15.27:0/1530256254 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8016070 con 0x5599b839d150 2024-09-19T08:11:38.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.326+0000 7fd6eaffd640 1 -- 172.21.15.27:0/1530256254 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6f8025040 con 0x5599b839d150 2024-09-19T08:11:38.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.326+0000 7fd6eaffd640 1 -- 172.21.15.27:0/1530256254 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f802a900 con 0x5599b839d150 2024-09-19T08:11:38.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.326+0000 7fd709c9a740 1 -- 172.21.15.27:0/1530256254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b839d150 msgr2=0x5599b83b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:38.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.326+0000 7fd709c9a740 1 --2- 172.21.15.27:0/1530256254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b839d150 0x5599b83b4cc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8002230 tx=0x7fd6f8000f40 comp rx=0 tx=0).stop 2024-09-19T08:11:38.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.326+0000 7fd709c9a740 1 -- 172.21.15.27:0/1530256254 shutdown_connections 2024-09-19T08:11:38.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.326+0000 7fd709c9a740 1 --2- 172.21.15.27:0/1530256254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b839d150 0x5599b83b4cc0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.326+0000 7fd709c9a740 1 --2- 172.21.15.27:0/1530256254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838e380 0x5599b83b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.326+0000 7fd709c9a740 1 --2- 172.21.15.27:0/1530256254 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599b838da60 0x5599b839bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.326+0000 7fd709c9a740 1 -- 172.21.15.27:0/1530256254 >> 172.21.15.27:0/1530256254 conn(0x5599b838a0f0 msgr2=0x5599b839b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:38.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.327+0000 7fd709c9a740 1 -- 172.21.15.27:0/1530256254 shutdown_connections 2024-09-19T08:11:38.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.327+0000 7fd709c9a740 1 -- 172.21.15.27:0/1530256254 wait complete. 2024-09-19T08:11:38.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.327+0000 7fd709c9a740 1 -- start start 2024-09-19T08:11:38.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.327+0000 7fd709c9a740 1 Processor -- start 2024-09-19T08:11:38.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.327+0000 7fd709c9a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838da60 0x5599b83a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:38.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.327+0000 7fd709c9a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838e380 0x5599b83a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:38.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.327+0000 7fd709c9a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599b839d150 0x5599b83a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:38.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.327+0000 7fd709c9a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd7001aa2d0 con 0x5599b838e380 2024-09-19T08:11:38.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.327+0000 7fd709c9a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd7001ab740 con 0x5599b838da60 2024-09-19T08:11:38.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.327+0000 7fd709c9a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd7001aa9a0 con 0x5599b839d150 2024-09-19T08:11:38.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.327+0000 7fd709c9a740 10 client.0 _ll_register_callbacks cb 0x7fd6f8009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:38.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.327+0000 7fd704e5c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838e380 0x5599b83a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:38.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.327+0000 7fd704e5c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838e380 0x5599b83a13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47156/0 (socket says 172.21.15.27:47156) 2024-09-19T08:11:38.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.327+0000 7fd704e5c640 1 -- 172.21.15.27:0/2863506151 learned_addr learned my addr 172.21.15.27:0/2863506151 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:38.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.328+0000 7fd705e5e640 1 --2- 172.21.15.27:0/2863506151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838da60 0x5599b83a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:38.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.328+0000 7fd705e5e640 1 --2- 172.21.15.27:0/2863506151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599b839d150 0x5599b83a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:38.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.328+0000 7fd704e5c640 1 -- 172.21.15.27:0/2863506151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599b839d150 msgr2=0x5599b83a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:38.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.328+0000 7fd704e5c640 1 --2- 172.21.15.27:0/2863506151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599b839d150 0x5599b83a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.328+0000 7fd704e5c640 1 -- 172.21.15.27:0/2863506151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838da60 msgr2=0x5599b83a0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:38.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.328+0000 7fd704e5c640 1 --2- 172.21.15.27:0/2863506151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838da60 0x5599b83a0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.328+0000 7fd704e5c640 1 -- 172.21.15.27:0/2863506151 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599b8416750 con 0x5599b838e380 2024-09-19T08:11:38.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.328+0000 7fd704e5c640 1 --2- 172.21.15.27:0/2863506151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838e380 0x5599b83a13b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x5599b83998f0 tx=0x7fd6f000bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55acb2742366513 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:38.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.328+0000 7fd6e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:38.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.328+0000 7fd6e8ff9640 1 -- 172.21.15.27:0/2863506151 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0011440 con 0x5599b838e380 2024-09-19T08:11:38.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.328+0000 7fd6e8ff9640 1 -- 172.21.15.27:0/2863506151 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fd6f00115e0 con 0x5599b838e380 2024-09-19T08:11:38.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.328+0000 7fd709c9a740 1 -- 172.21.15.27:0/2863506151 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6f8025040 con 0x5599b838e380 2024-09-19T08:11:38.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.328+0000 7fd6e8ff9640 1 -- 172.21.15.27:0/2863506151 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd6f002c050 con 0x5599b838e380 2024-09-19T08:11:38.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.328+0000 7fd709c9a740 10 client.15501 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:38.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.328+0000 7fd709c9a740 1 -- 172.21.15.27:0/2863506151 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5599b8417a80 con 0x5599b838e380 2024-09-19T08:11:38.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.329+0000 7fd6e8ff9640 1 -- 172.21.15.27:0/2863506151 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6f8025040 con 0x5599b838e380 2024-09-19T08:11:38.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.329+0000 7fd6e8ff9640 1 -- 172.21.15.27:0/2863506151 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd6f00278b0 con 0x5599b838e380 2024-09-19T08:11:38.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.329+0000 7fd709c9a740 10 client.15501 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:38.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.329+0000 7fd709c9a740 10 client.15501 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:38.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.329+0000 7fd709c9a740 20 client.15501 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:38.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.329+0000 7fd709c9a740 1 --2- 172.21.15.27:0/2863506151 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5599b8418230 0x5599b841a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:38.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.329+0000 7fd709c9a740 4 client.15501 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:11:38.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.329+0000 7fd709c9a740 1 -- 172.21.15.27:0/2863506151 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5599b82fad00 con 0x5599b8418230 2024-09-19T08:11:38.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.329+0000 7fd705e5e640 1 --2- 172.21.15.27:0/2863506151 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5599b8418230 0x5599b841a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:38.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.329+0000 7fd705e5e640 1 --2- 172.21.15.27:0/2863506151 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5599b8418230 0x5599b841a650 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc9679ad83c5c349 server_cookie=9446c21291c5f47c in_seq=0 out_seq=0 2024-09-19T08:11:38.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.329+0000 7fd6e8ff9640 10 client.15501 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:38.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.330+0000 7fd6e8ff9640 1 -- 172.21.15.27:0/2863506151 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5599b82fad00 con 0x5599b8418230 2024-09-19T08:11:38.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.330+0000 7fd6e8ff9640 10 client.15501 handle_command_reply: tid=0 2024-09-19T08:11:38.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.330+0000 7fd709c9a740 1 client.15501 shutdown 2024-09-19T08:11:38.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd709c9a740 1 -- 172.21.15.27:0/2863506151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838e380 msgr2=0x5599b83a13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:38.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd709c9a740 1 --2- 172.21.15.27:0/2863506151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838e380 0x5599b83a13b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x5599b83998f0 tx=0x7fd6f000bdc0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd709c9a740 1 -- 172.21.15.27:0/2863506151 shutdown_connections 2024-09-19T08:11:38.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd709c9a740 1 --2- 172.21.15.27:0/2863506151 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5599b8418230 0x5599b841a650 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd709c9a740 1 --2- 172.21.15.27:0/2863506151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599b839d150 0x5599b83a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd709c9a740 1 --2- 172.21.15.27:0/2863506151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599b838e380 0x5599b83a13b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd6e8ff9640 0 client.15501 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:38.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd709c9a740 1 --2- 172.21.15.27:0/2863506151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599b838da60 0x5599b83a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd709c9a740 1 -- 172.21.15.27:0/2863506151 >> 172.21.15.27:0/2863506151 conn(0x5599b838a0f0 msgr2=0x5599b838fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:38.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd709c9a740 1 -- 172.21.15.27:0/2863506151 shutdown_connections 2024-09-19T08:11:38.364 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:11:38.364 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:11:38.364 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "7eb12722-bcaf-408e-bf57-407f3584f6a9", 2024-09-19T08:11:38.364 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:11:38.364 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:11:38.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd709c9a740 1 -- 172.21.15.27:0/2863506151 wait complete. 2024-09-19T08:11:38.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd709c9a740 20 client.15501 trim_cache size 0 max 16384 2024-09-19T08:11:38.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd7078c1640 1 -- 172.21.15.27:0/2680160540 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd6ec0a3440 msgr2=0x7fd6ec0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:38.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd7078c1640 1 --2- 172.21.15.27:0/2680160540 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd6ec0a3440 0x7fd6ec0a5900 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0ed6e0 tx=0x7fd6fc02a410 comp rx=0 tx=0).stop 2024-09-19T08:11:38.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd7078c1640 1 -- 172.21.15.27:0/2680160540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd700101de0 msgr2=0x7fd7001984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:38.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd7078c1640 1 --2- 172.21.15.27:0/2680160540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd700101de0 0x7fd7001984d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc006010 tx=0x7fd6fc0042f0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd7078c1640 1 -- 172.21.15.27:0/2680160540 shutdown_connections 2024-09-19T08:11:38.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd7078c1640 1 --2- 172.21.15.27:0/2680160540 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd6ec0a3440 0x7fd6ec0a5900 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd7078c1640 1 --2- 172.21.15.27:0/2680160540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd700106f10 0x7fd70019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd7078c1640 1 --2- 172.21.15.27:0/2680160540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd700102790 0x7fd700198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd7078c1640 1 --2- 172.21.15.27:0/2680160540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd700101de0 0x7fd7001984d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:38.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.331+0000 7fd7078c1640 1 -- 172.21.15.27:0/2680160540 >> 172.21.15.27:0/2680160540 conn(0x7fd7000fd8c0 msgr2=0x7fd7000fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:38.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.332+0000 7fd7078c1640 1 -- 172.21.15.27:0/2680160540 shutdown_connections 2024-09-19T08:11:38.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:38.332+0000 7fd7078c1640 1 -- 172.21.15.27:0/2680160540 wait complete. 2024-09-19T08:11:39.064 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:11:39.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:38 smithi155 ceph-mon[35362]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T08:11:39.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:38 smithi027 ceph-mon[31209]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T08:11:39.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:38 smithi203 ceph-mon[35198]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T08:11:39.324 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:39.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.787+0000 7f67583da640 1 -- 172.21.15.27:0/1510953458 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6750102ef0 msgr2=0x7f675010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:39.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.787+0000 7f67583da640 1 --2- 172.21.15.27:0/1510953458 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6750102ef0 0x7f675010da40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6748009900 tx=0x7f674802a480 comp rx=0 tx=0).stop 2024-09-19T08:11:39.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.787+0000 7f67583da640 1 -- 172.21.15.27:0/1510953458 shutdown_connections 2024-09-19T08:11:39.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.787+0000 7f67583da640 1 --2- 172.21.15.27:0/1510953458 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6750102ef0 0x7f675010da40 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.787+0000 7f67583da640 1 --2- 172.21.15.27:0/1510953458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6750102570 0x7f67501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.787+0000 7f67583da640 1 --2- 172.21.15.27:0/1510953458 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6750100e20 0x7f6750101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.787+0000 7f67583da640 1 -- 172.21.15.27:0/1510953458 >> 172.21.15.27:0/1510953458 conn(0x7f67500fc7d0 msgr2=0x7f67500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:39.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.787+0000 7f67583da640 1 -- 172.21.15.27:0/1510953458 shutdown_connections 2024-09-19T08:11:39.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.787+0000 7f67583da640 1 -- 172.21.15.27:0/1510953458 wait complete. 2024-09-19T08:11:39.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.788+0000 7f67583da640 1 Processor -- start 2024-09-19T08:11:39.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.788+0000 7f67583da640 1 -- start start 2024-09-19T08:11:39.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.788+0000 7f67583da640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6750100e20 0x7f6750198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:39.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.788+0000 7f67583da640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6750102570 0x7f6750198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:39.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.788+0000 7f67583da640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6750102ef0 0x7f675019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:39.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.788+0000 7f67583da640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6750110fd0 con 0x7f6750102570 2024-09-19T08:11:39.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.788+0000 7f67583da640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6750110e50 con 0x7f6750102ef0 2024-09-19T08:11:39.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.788+0000 7f67583da640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6750111150 con 0x7f6750100e20 2024-09-19T08:11:39.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.788+0000 7f6755975640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6750102570 0x7f6750198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:39.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.788+0000 7f6755975640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6750102570 0x7f6750198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47168/0 (socket says 172.21.15.27:47168) 2024-09-19T08:11:39.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.788+0000 7f6755975640 1 -- 172.21.15.27:0/3598673641 learned_addr learned my addr 172.21.15.27:0/3598673641 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:39.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.788+0000 7f6756176640 1 --2- 172.21.15.27:0/3598673641 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6750100e20 0x7f6750198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:39.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.788+0000 7f6756977640 1 --2- 172.21.15.27:0/3598673641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6750102ef0 0x7f675019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:39.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.788+0000 7f6755975640 1 -- 172.21.15.27:0/3598673641 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6750100e20 msgr2=0x7f6750198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:39.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.788+0000 7f6755975640 1 --2- 172.21.15.27:0/3598673641 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6750100e20 0x7f6750198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.788+0000 7f6755975640 1 -- 172.21.15.27:0/3598673641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6750102ef0 msgr2=0x7f675019cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:39.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.788+0000 7f6755975640 1 --2- 172.21.15.27:0/3598673641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6750102ef0 0x7f675019cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.788+0000 7f6755975640 1 -- 172.21.15.27:0/3598673641 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f675019d4b0 con 0x7f6750102570 2024-09-19T08:11:39.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.789+0000 7f6755975640 1 --2- 172.21.15.27:0/3598673641 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6750102570 0x7f6750198a40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f674400cce0 tx=0x7f674400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:39.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.789+0000 7f674f7fe640 1 -- 172.21.15.27:0/3598673641 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6744004b20 con 0x7f6750102570 2024-09-19T08:11:39.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.789+0000 7f674f7fe640 1 -- 172.21.15.27:0/3598673641 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6744004cc0 con 0x7f6750102570 2024-09-19T08:11:39.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.789+0000 7f67583da640 1 -- 172.21.15.27:0/3598673641 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f675019d7a0 con 0x7f6750102570 2024-09-19T08:11:39.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.789+0000 7f674f7fe640 1 -- 172.21.15.27:0/3598673641 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674400f7d0 con 0x7f6750102570 2024-09-19T08:11:39.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.789+0000 7f67583da640 1 -- 172.21.15.27:0/3598673641 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67501a5080 con 0x7f6750102570 2024-09-19T08:11:39.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.791+0000 7f674f7fe640 1 -- 172.21.15.27:0/3598673641 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f674400f970 con 0x7f6750102570 2024-09-19T08:11:39.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.791+0000 7f675a7b3740 1 Processor -- start 2024-09-19T08:11:39.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.791+0000 7f675a7b3740 1 -- start start 2024-09-19T08:11:39.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.792+0000 7f675a7b3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a0324d9380 0x55a0324d9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:39.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.792+0000 7f675a7b3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0324d9ca0 0x55a0324e8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:39.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.792+0000 7f675a7b3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324e8a90 0x55a0324eae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:39.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.792+0000 7f675a7b3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55a03243f2e0 con 0x55a0324e8a90 2024-09-19T08:11:39.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.792+0000 7f675a7b3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a0323e6ce0 con 0x55a0324d9380 2024-09-19T08:11:39.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.792+0000 7f675a7b3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a03243b2a0 con 0x55a0324d9ca0 2024-09-19T08:11:39.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.792+0000 7f6755975640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324e8a90 0x55a0324eae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:39.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.792+0000 7f674f7fe640 1 --2- 172.21.15.27:0/3598673641 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f67380a3440 0x7f67380a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:39.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.792+0000 7f6755975640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324e8a90 0x55a0324eae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47182/0 (socket says 172.21.15.27:47182) 2024-09-19T08:11:39.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.792+0000 7f6755975640 1 -- 172.21.15.27:0/712427919 learned_addr learned my addr 172.21.15.27:0/712427919 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:39.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.792+0000 7f6756977640 1 --2- 172.21.15.27:0/712427919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a0324d9380 0x55a0324d9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:39.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.792+0000 7f6756176640 1 --2- 172.21.15.27:0/712427919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0324d9ca0 0x55a0324e8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:39.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.792+0000 7f6756977640 1 --2- 172.21.15.27:0/3598673641 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f67380a3440 0x7f67380a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:39.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.792+0000 7f674f7fe640 1 -- 172.21.15.27:0/3598673641 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f67440cfe30 con 0x7f6750102570 2024-09-19T08:11:39.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.792+0000 7f6756176640 1 -- 172.21.15.27:0/712427919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a0324d9380 msgr2=0x55a0324d9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:39.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.792+0000 7f6756176640 1 --2- 172.21.15.27:0/712427919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a0324d9380 0x55a0324d9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.792+0000 7f6756176640 1 -- 172.21.15.27:0/712427919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324e8a90 msgr2=0x55a0324eae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:39.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.792+0000 7f6756176640 1 --2- 172.21.15.27:0/712427919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324e8a90 0x55a0324eae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.792+0000 7f6756176640 1 -- 172.21.15.27:0/712427919 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0323cb440 con 0x55a0324d9ca0 2024-09-19T08:11:39.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.792+0000 7f6755975640 1 --2- 172.21.15.27:0/712427919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324e8a90 0x55a0324eae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:11:39.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.793+0000 7f6756176640 1 --2- 172.21.15.27:0/712427919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0324d9ca0 0x55a0324e8550 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6740004630 tx=0x7f674000bb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1727c8cf0d42523d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:39.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.793+0000 7f6756977640 1 --2- 172.21.15.27:0/3598673641 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f67380a3440 0x7f67380a5900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6748006010 tx=0x7f67480046c0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:39.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.793+0000 7f674cdea640 1 -- 172.21.15.27:0/712427919 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6740003bd0 con 0x55a0324d9ca0 2024-09-19T08:11:39.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.793+0000 7f674cdea640 1 -- 172.21.15.27:0/712427919 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6740015070 con 0x55a0324d9ca0 2024-09-19T08:11:39.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.793+0000 7f674cdea640 1 -- 172.21.15.27:0/712427919 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6740004d20 con 0x55a0324d9ca0 2024-09-19T08:11:39.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.794+0000 7f675a7b3740 1 -- 172.21.15.27:0/712427919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0324d9ca0 msgr2=0x55a0324e8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:39.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.794+0000 7f675a7b3740 1 --2- 172.21.15.27:0/712427919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0324d9ca0 0x55a0324e8550 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6740004630 tx=0x7f674000bb20 comp rx=0 tx=0).stop 2024-09-19T08:11:39.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.794+0000 7f675a7b3740 1 -- 172.21.15.27:0/712427919 shutdown_connections 2024-09-19T08:11:39.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.794+0000 7f675a7b3740 1 --2- 172.21.15.27:0/712427919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324e8a90 0x55a0324eae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.794+0000 7f675a7b3740 1 --2- 172.21.15.27:0/712427919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0324d9ca0 0x55a0324e8550 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.794+0000 7f675a7b3740 1 --2- 172.21.15.27:0/712427919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a0324d9380 0x55a0324d9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.794+0000 7f675a7b3740 1 -- 172.21.15.27:0/712427919 >> 172.21.15.27:0/712427919 conn(0x55a0324d5a30 msgr2=0x55a0324d5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:39.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.794+0000 7f675a7b3740 1 -- 172.21.15.27:0/712427919 shutdown_connections 2024-09-19T08:11:39.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.794+0000 7f675a7b3740 1 -- 172.21.15.27:0/712427919 wait complete. 2024-09-19T08:11:39.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.794+0000 7f675a7b3740 1 -- start start 2024-09-19T08:11:39.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.794+0000 7f675a7b3740 1 Processor -- start 2024-09-19T08:11:39.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.794+0000 7f675a7b3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0324d9380 0x55a0324e8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:39.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.794+0000 7f675a7b3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9ca0 0x55a0324e5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:39.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.794+0000 7f675a7b3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a0324e8a90 0x55a0324e5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:39.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.794+0000 7f675a7b3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55a0324eb660 con 0x55a0324d9ca0 2024-09-19T08:11:39.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.794+0000 7f675a7b3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a0323fa050 con 0x55a0324e8a90 2024-09-19T08:11:39.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.794+0000 7f675a7b3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a0324eb7e0 con 0x55a0324d9380 2024-09-19T08:11:39.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.795+0000 7f675a7b3740 10 client.0 _ll_register_callbacks cb 0x55a03243a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:39.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.795+0000 7f6755975640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9ca0 0x55a0324e5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:39.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.795+0000 7f6755975640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9ca0 0x55a0324e5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47184/0 (socket says 172.21.15.27:47184) 2024-09-19T08:11:39.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.795+0000 7f6755975640 1 -- 172.21.15.27:0/3695129615 learned_addr learned my addr 172.21.15.27:0/3695129615 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:39.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.795+0000 7f6756977640 1 --2- 172.21.15.27:0/3695129615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a0324e8a90 0x55a0324e5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:39.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.795+0000 7f6756176640 1 --2- 172.21.15.27:0/3695129615 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0324d9380 0x55a0324e8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:39.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.795+0000 7f6755975640 1 -- 172.21.15.27:0/3695129615 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0324d9380 msgr2=0x55a0324e8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:39.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.795+0000 7f6755975640 1 --2- 172.21.15.27:0/3695129615 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0324d9380 0x55a0324e8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.795+0000 7f6755975640 1 -- 172.21.15.27:0/3695129615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a0324e8a90 msgr2=0x55a0324e5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:39.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.795+0000 7f6755975640 1 --2- 172.21.15.27:0/3695129615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a0324e8a90 0x55a0324e5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.795+0000 7f6755975640 1 -- 172.21.15.27:0/3695129615 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0321b03c0 con 0x55a0324d9ca0 2024-09-19T08:11:39.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.795+0000 7f6756176640 1 --2- 172.21.15.27:0/3695129615 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0324d9380 0x55a0324e8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:39.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.795+0000 7f6755975640 1 --2- 172.21.15.27:0/3695129615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9ca0 0x55a0324e5690 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f674400ab20 tx=0x7f674409bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47072dcd348473b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:39.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.795+0000 7f6735ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:39.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.795+0000 7f6735ffb640 1 -- 172.21.15.27:0/3695129615 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674401d070 con 0x55a0324d9ca0 2024-09-19T08:11:39.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.795+0000 7f6735ffb640 1 -- 172.21.15.27:0/3695129615 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f67440cd7c0 con 0x55a0324d9ca0 2024-09-19T08:11:39.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.795+0000 7f675a7b3740 1 -- 172.21.15.27:0/3695129615 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6740015070 con 0x55a0324d9ca0 2024-09-19T08:11:39.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.796+0000 7f6735ffb640 1 -- 172.21.15.27:0/3695129615 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f67440b4030 con 0x55a0324d9ca0 2024-09-19T08:11:39.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.796+0000 7f675a7b3740 10 client.15513 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:39.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.796+0000 7f675a7b3740 1 -- 172.21.15.27:0/3695129615 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a0324f70d0 con 0x55a0324d9ca0 2024-09-19T08:11:39.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.796+0000 7f6735ffb640 1 -- 172.21.15.27:0/3695129615 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6740015070 con 0x55a0324d9ca0 2024-09-19T08:11:39.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.796+0000 7f6735ffb640 1 -- 172.21.15.27:0/3695129615 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f674409b4f0 con 0x55a0324d9ca0 2024-09-19T08:11:39.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.796+0000 7f675a7b3740 10 client.15513 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:39.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.796+0000 7f675a7b3740 10 client.15513 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:39.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.796+0000 7f675a7b3740 20 client.15513 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:39.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.796+0000 7f675a7b3740 1 --2- 172.21.15.27:0/3695129615 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55a0324f8590 0x55a0324fa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:39.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.796+0000 7f675a7b3740 4 client.15513 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:11:39.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.796+0000 7f675a7b3740 1 -- 172.21.15.27:0/3695129615 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a03244c850 con 0x55a0324f8590 2024-09-19T08:11:39.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.796+0000 7f6756176640 1 --2- 172.21.15.27:0/3695129615 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55a0324f8590 0x55a0324fa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:39.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.797+0000 7f6735ffb640 10 client.15513 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:39.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.797+0000 7f6756176640 1 --2- 172.21.15.27:0/3695129615 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55a0324f8590 0x55a0324fa9c0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c978329ebea91c76 server_cookie=682523981bf4c502 in_seq=0 out_seq=0 2024-09-19T08:11:39.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.798+0000 7f6735ffb640 1 -- 172.21.15.27:0/3695129615 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a03244c850 con 0x55a0324f8590 2024-09-19T08:11:39.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.798+0000 7f6735ffb640 10 client.15513 handle_command_reply: tid=0 2024-09-19T08:11:39.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.798+0000 7f675a7b3740 1 client.15513 shutdown 2024-09-19T08:11:39.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.798+0000 7f675a7b3740 1 -- 172.21.15.27:0/3695129615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9ca0 msgr2=0x55a0324e5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:39.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.798+0000 7f675a7b3740 1 --2- 172.21.15.27:0/3695129615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9ca0 0x55a0324e5690 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f674400ab20 tx=0x7f674409bf70 comp rx=0 tx=0).stop 2024-09-19T08:11:39.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.798+0000 7f675a7b3740 1 -- 172.21.15.27:0/3695129615 shutdown_connections 2024-09-19T08:11:39.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.798+0000 7f675a7b3740 1 --2- 172.21.15.27:0/3695129615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a0324e8a90 0x55a0324e5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.798+0000 7f675a7b3740 1 --2- 172.21.15.27:0/3695129615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9ca0 0x55a0324e5690 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.798+0000 7f675a7b3740 1 --2- 172.21.15.27:0/3695129615 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55a0324f8590 0x55a0324fa9c0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.798+0000 7f675a7b3740 1 --2- 172.21.15.27:0/3695129615 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0324d9380 0x55a0324e8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.798+0000 7f675a7b3740 1 -- 172.21.15.27:0/3695129615 >> 172.21.15.27:0/3695129615 conn(0x55a0324d5a30 msgr2=0x55a0324db790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:39.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.798+0000 7f6735ffb640 0 client.15513 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:39.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.798+0000 7f675a7b3740 1 -- 172.21.15.27:0/3695129615 shutdown_connections 2024-09-19T08:11:39.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.798+0000 7f675a7b3740 1 -- 172.21.15.27:0/3695129615 wait complete. 2024-09-19T08:11:39.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.798+0000 7f675a7b3740 20 client.15513 trim_cache size 0 max 16384 2024-09-19T08:11:39.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.815+0000 7f675a7b3740 1 Processor -- start 2024-09-19T08:11:39.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.815+0000 7f675a7b3740 1 -- start start 2024-09-19T08:11:39.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.815+0000 7f675a7b3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9380 0x55a0324f4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:39.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.815+0000 7f675a7b3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0324d9ca0 0x55a0324e4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:39.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.815+0000 7f675a7b3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a0324e8a90 0x55a032500290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:39.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.815+0000 7f675a7b3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f67501a95a0 con 0x55a0324d9380 2024-09-19T08:11:39.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.815+0000 7f675a7b3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f67501abe00 con 0x55a0324e8a90 2024-09-19T08:11:39.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.815+0000 7f675a7b3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f67501a9bf0 con 0x55a0324d9ca0 2024-09-19T08:11:39.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.815+0000 7f6756176640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9380 0x55a0324f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:39.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.816+0000 7f6756176640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9380 0x55a0324f4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47186/0 (socket says 172.21.15.27:47186) 2024-09-19T08:11:39.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.816+0000 7f6756176640 1 -- 172.21.15.27:0/584250417 learned_addr learned my addr 172.21.15.27:0/584250417 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:39.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.816+0000 7f6756176640 1 -- 172.21.15.27:0/584250417 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0324d9ca0 msgr2=0x55a0324e4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:39.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.816+0000 7f6756176640 1 --2- 172.21.15.27:0/584250417 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0324d9ca0 0x55a0324e4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.816+0000 7f6756977640 1 --2- 172.21.15.27:0/584250417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a0324e8a90 0x55a032500290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:39.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.816+0000 7f6756176640 1 -- 172.21.15.27:0/584250417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a0324e8a90 msgr2=0x55a032500290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:39.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.816+0000 7f6756176640 1 --2- 172.21.15.27:0/584250417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a0324e8a90 0x55a032500290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.816+0000 7f6756176640 1 -- 172.21.15.27:0/584250417 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0324dbea0 con 0x55a0324d9380 2024-09-19T08:11:39.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.816+0000 7f6756176640 1 --2- 172.21.15.27:0/584250417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9380 0x55a0324f4900 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x55a0324dc090 tx=0x7f674000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef8dfcc0e771a82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:39.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.816+0000 7f6737fff640 1 -- 172.21.15.27:0/584250417 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6740005e50 con 0x55a0324d9380 2024-09-19T08:11:39.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.816+0000 7f6737fff640 1 -- 172.21.15.27:0/584250417 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6740015040 con 0x55a0324d9380 2024-09-19T08:11:39.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.816+0000 7f6737fff640 1 -- 172.21.15.27:0/584250417 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6740027cd0 con 0x55a0324d9380 2024-09-19T08:11:39.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.817+0000 7f675a7b3740 1 -- 172.21.15.27:0/584250417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9380 msgr2=0x55a0324f4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:39.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.817+0000 7f675a7b3740 1 --2- 172.21.15.27:0/584250417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9380 0x55a0324f4900 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x55a0324dc090 tx=0x7f674000b390 comp rx=0 tx=0).stop 2024-09-19T08:11:39.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.817+0000 7f675a7b3740 1 -- 172.21.15.27:0/584250417 shutdown_connections 2024-09-19T08:11:39.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.817+0000 7f675a7b3740 1 --2- 172.21.15.27:0/584250417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a0324e8a90 0x55a032500290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.817+0000 7f675a7b3740 1 --2- 172.21.15.27:0/584250417 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0324d9ca0 0x55a0324e4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.817+0000 7f675a7b3740 1 --2- 172.21.15.27:0/584250417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9380 0x55a0324f4900 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.817+0000 7f675a7b3740 1 -- 172.21.15.27:0/584250417 >> 172.21.15.27:0/584250417 conn(0x55a0324d5a30 msgr2=0x55a0324e3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:39.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.817+0000 7f675a7b3740 1 -- 172.21.15.27:0/584250417 shutdown_connections 2024-09-19T08:11:39.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.817+0000 7f675a7b3740 1 -- 172.21.15.27:0/584250417 wait complete. 2024-09-19T08:11:39.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.817+0000 7f675a7b3740 1 -- start start 2024-09-19T08:11:39.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.817+0000 7f675a7b3740 1 Processor -- start 2024-09-19T08:11:39.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f675a7b3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a0324d9380 0x55a0324f1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:39.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f675a7b3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9ca0 0x55a0324ec3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:39.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f675a7b3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0324e8a90 0x55a0324ec8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:39.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f675a7b3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f67501aa2c0 con 0x55a0324d9ca0 2024-09-19T08:11:39.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f675a7b3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f67501ab730 con 0x55a0324d9380 2024-09-19T08:11:39.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f675a7b3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f67501aa990 con 0x55a0324e8a90 2024-09-19T08:11:39.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f675a7b3740 10 client.0 _ll_register_callbacks cb 0x7f6744005c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:39.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f6755975640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9ca0 0x55a0324ec3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:39.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f6755975640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9ca0 0x55a0324ec3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47202/0 (socket says 172.21.15.27:47202) 2024-09-19T08:11:39.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f6755975640 1 -- 172.21.15.27:0/2150475119 learned_addr learned my addr 172.21.15.27:0/2150475119 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:39.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f6756176640 1 --2- 172.21.15.27:0/2150475119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a0324d9380 0x55a0324f1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:39.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f6755975640 1 -- 172.21.15.27:0/2150475119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0324e8a90 msgr2=0x55a0324ec8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:39.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f6755975640 1 --2- 172.21.15.27:0/2150475119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0324e8a90 0x55a0324ec8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f6755975640 1 -- 172.21.15.27:0/2150475119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a0324d9380 msgr2=0x55a0324f1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:39.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f6755975640 1 --2- 172.21.15.27:0/2150475119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a0324d9380 0x55a0324f1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f6755975640 1 -- 172.21.15.27:0/2150475119 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0324ecfe0 con 0x55a0324d9ca0 2024-09-19T08:11:39.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f6755975640 1 --2- 172.21.15.27:0/2150475119 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9ca0 0x55a0324ec3b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f67440cd5f0 tx=0x7f674409b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1056f75d39e0ad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:39.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f6735ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:39.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f6735ffb640 1 -- 172.21.15.27:0/2150475119 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674401d070 con 0x55a0324d9ca0 2024-09-19T08:11:39.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f6735ffb640 1 -- 172.21.15.27:0/2150475119 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f6744097ff0 con 0x55a0324d9ca0 2024-09-19T08:11:39.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.818+0000 7f675a7b3740 1 -- 172.21.15.27:0/2150475119 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6740015040 con 0x55a0324d9ca0 2024-09-19T08:11:39.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.819+0000 7f6735ffb640 1 -- 172.21.15.27:0/2150475119 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6744081050 con 0x55a0324d9ca0 2024-09-19T08:11:39.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.819+0000 7f675a7b3740 10 client.15519 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:39.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.819+0000 7f675a7b3740 1 -- 172.21.15.27:0/2150475119 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a032563130 con 0x55a0324d9ca0 2024-09-19T08:11:39.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.819+0000 7f6735ffb640 1 -- 172.21.15.27:0/2150475119 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6740015040 con 0x55a0324d9ca0 2024-09-19T08:11:39.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.819+0000 7f6735ffb640 1 -- 172.21.15.27:0/2150475119 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f67440a1530 con 0x55a0324d9ca0 2024-09-19T08:11:39.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.819+0000 7f675a7b3740 10 client.15519 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:39.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.819+0000 7f675a7b3740 10 client.15519 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:11:39.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.819+0000 7f675a7b3740 20 client.15519 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:39.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.819+0000 7f675a7b3740 1 --2- 172.21.15.27:0/2150475119 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55a032563760 0x55a032565b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:39.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.819+0000 7f675a7b3740 4 client.15519 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:11:39.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.819+0000 7f675a7b3740 1 -- 172.21.15.27:0/2150475119 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a032446d60 con 0x55a032563760 2024-09-19T08:11:39.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.819+0000 7f6756176640 1 --2- 172.21.15.27:0/2150475119 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55a032563760 0x55a032565b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:39.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.820+0000 7f6735ffb640 10 client.15519 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:39.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.820+0000 7f6756176640 1 --2- 172.21.15.27:0/2150475119 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55a032563760 0x55a032565b80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e79ea7c6a3bad299 server_cookie=ed89c85f2b604e40 in_seq=0 out_seq=0 2024-09-19T08:11:39.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.820+0000 7f6735ffb640 1 -- 172.21.15.27:0/2150475119 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a032446d60 con 0x55a032563760 2024-09-19T08:11:39.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.820+0000 7f6735ffb640 10 client.15519 handle_command_reply: tid=0 2024-09-19T08:11:39.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.820+0000 7f675a7b3740 1 client.15519 shutdown 2024-09-19T08:11:39.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.820+0000 7f675a7b3740 1 -- 172.21.15.27:0/2150475119 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9ca0 msgr2=0x55a0324ec3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:39.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.820+0000 7f675a7b3740 1 --2- 172.21.15.27:0/2150475119 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9ca0 0x55a0324ec3b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f67440cd5f0 tx=0x7f674409b7a0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.820+0000 7f675a7b3740 1 -- 172.21.15.27:0/2150475119 shutdown_connections 2024-09-19T08:11:39.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.820+0000 7f675a7b3740 1 --2- 172.21.15.27:0/2150475119 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55a032563760 0x55a032565b80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.820+0000 7f675a7b3740 1 --2- 172.21.15.27:0/2150475119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0324e8a90 0x55a0324ec8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.820+0000 7f675a7b3740 1 --2- 172.21.15.27:0/2150475119 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a0324d9ca0 0x55a0324ec3b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.820+0000 7f675a7b3740 1 --2- 172.21.15.27:0/2150475119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a0324d9380 0x55a0324f1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.820+0000 7f675a7b3740 1 -- 172.21.15.27:0/2150475119 >> 172.21.15.27:0/2150475119 conn(0x55a0324d5a30 msgr2=0x55a0324e4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:39.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.820+0000 7f6735ffb640 0 client.15519 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:39.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.820+0000 7f675a7b3740 1 -- 172.21.15.27:0/2150475119 shutdown_connections 2024-09-19T08:11:39.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.820+0000 7f675a7b3740 1 -- 172.21.15.27:0/2150475119 wait complete. 2024-09-19T08:11:39.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.820+0000 7f675a7b3740 20 client.15519 trim_cache size 0 max 16384 2024-09-19T08:11:39.828 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:11:39.828 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:11:39.828 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": { 2024-09-19T08:11:39.828 INFO:teuthology.orchestra.run.smithi027.stdout: "7eb12722-bcaf-408e-bf57-407f3584f6a9": { 2024-09-19T08:11:39.829 INFO:teuthology.orchestra.run.smithi027.stdout: "path": "/", 2024-09-19T08:11:39.829 INFO:teuthology.orchestra.run.smithi027.stdout: "tag": "7eb12722-bcaf-408e-bf57-407f3584f6a9", 2024-09-19T08:11:39.829 INFO:teuthology.orchestra.run.smithi027.stdout: "options": "recursive,force" 2024-09-19T08:11:39.829 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:11:39.829 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:11:39.829 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:11:39.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.821+0000 7f67583da640 1 -- 172.21.15.27:0/3598673641 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f67380a3440 msgr2=0x7f67380a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:39.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.821+0000 7f67583da640 1 --2- 172.21.15.27:0/3598673641 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f67380a3440 0x7f67380a5900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6748006010 tx=0x7f67480046c0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.821+0000 7f67583da640 1 -- 172.21.15.27:0/3598673641 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6750102570 msgr2=0x7f6750198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:39.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.821+0000 7f67583da640 1 --2- 172.21.15.27:0/3598673641 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6750102570 0x7f6750198a40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f674400cce0 tx=0x7f674400a620 comp rx=0 tx=0).stop 2024-09-19T08:11:39.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.821+0000 7f67583da640 1 -- 172.21.15.27:0/3598673641 shutdown_connections 2024-09-19T08:11:39.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.821+0000 7f67583da640 1 --2- 172.21.15.27:0/3598673641 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f67380a3440 0x7f67380a5900 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.821+0000 7f67583da640 1 --2- 172.21.15.27:0/3598673641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6750102ef0 0x7f675019cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.821+0000 7f67583da640 1 --2- 172.21.15.27:0/3598673641 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6750102570 0x7f6750198a40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.821+0000 7f67583da640 1 --2- 172.21.15.27:0/3598673641 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6750100e20 0x7f6750198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:39.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.821+0000 7f67583da640 1 -- 172.21.15.27:0/3598673641 >> 172.21.15.27:0/3598673641 conn(0x7f67500fc7d0 msgr2=0x7f675006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:39.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.821+0000 7f67583da640 1 -- 172.21.15.27:0/3598673641 shutdown_connections 2024-09-19T08:11:39.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:39.821+0000 7f67583da640 1 -- 172.21.15.27:0/3598673641 wait complete. 2024-09-19T08:11:40.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:39 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:11:40.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:39 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:40.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:39 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:11:40.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:39 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:40.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:39 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:11:40.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:39 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:40.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:39 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:11:40.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:39 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:40.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:39 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:11:40.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:39 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:40.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:39 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:11:40.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:39 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:11:40.491 INFO:tasks.cephfs.filesystem:scrub status for tag:7eb12722-bcaf-408e-bf57-407f3584f6a9 - {'path': '/', 'tag': '7eb12722-bcaf-408e-bf57-407f3584f6a9', 'options': 'recursive,force'} 2024-09-19T08:11:41.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:40 smithi155 ceph-mon[35362]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-19T08:11:41.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:40 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:11:41.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:40 smithi027 ceph-mon[31209]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-19T08:11:41.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:40 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:11:41.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:40 smithi203 ceph-mon[35198]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-19T08:11:41.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:40 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:11:43.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:42 smithi155 ceph-mon[35362]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T08:11:43.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:42 smithi027 ceph-mon[31209]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T08:11:43.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:42 smithi203 ceph-mon[35198]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T08:11:45.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:44 smithi155 ceph-mon[35362]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-19T08:11:45.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:44 smithi027 ceph-mon[31209]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-19T08:11:45.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:44 smithi203 ceph-mon[35198]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-19T08:11:47.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:46 smithi155 ceph-mon[35362]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:11:47.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:46 smithi027 ceph-mon[31209]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:11:47.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:46 smithi203 ceph-mon[35198]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:11:48.544 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.2 2024-09-19T08:11:48.545 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:11:48.818 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:49.237 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:48 smithi027 ceph-mon[31209]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:11:49.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:48 smithi155 ceph-mon[35362]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:11:49.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:48 smithi203 ceph-mon[35198]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:11:49.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.326+0000 7fcf63c24640 1 -- 172.21.15.27:0/181123698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf5c101df0 msgr2=0x7fcf5c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:49.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.326+0000 7fcf63c24640 1 --2- 172.21.15.27:0/181123698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf5c101df0 0x7fcf5c1021d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009900 tx=0x7fcf5802a410 comp rx=0 tx=0).stop 2024-09-19T08:11:49.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.326+0000 7fcf63c24640 1 -- 172.21.15.27:0/181123698 shutdown_connections 2024-09-19T08:11:49.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.326+0000 7fcf63c24640 1 --2- 172.21.15.27:0/181123698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf5c106f20 0x7fcf5c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:49.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.326+0000 7fcf63c24640 1 --2- 172.21.15.27:0/181123698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf5c1027a0 0x7fcf5c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:49.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.326+0000 7fcf63c24640 1 --2- 172.21.15.27:0/181123698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf5c101df0 0x7fcf5c1021d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:49.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.326+0000 7fcf63c24640 1 -- 172.21.15.27:0/181123698 >> 172.21.15.27:0/181123698 conn(0x7fcf5c0fd8f0 msgr2=0x7fcf5c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:49.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.327+0000 7fcf63c24640 1 -- 172.21.15.27:0/181123698 shutdown_connections 2024-09-19T08:11:49.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.327+0000 7fcf63c24640 1 -- 172.21.15.27:0/181123698 wait complete. 2024-09-19T08:11:49.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.327+0000 7fcf63c24640 1 Processor -- start 2024-09-19T08:11:49.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.328+0000 7fcf63c24640 1 -- start start 2024-09-19T08:11:49.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.328+0000 7fcf63c24640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf5c101df0 0x7fcf5c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:49.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.328+0000 7fcf63c24640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf5c1027a0 0x7fcf5c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:49.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.328+0000 7fcf63c24640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf5c106f20 0x7fcf5c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:49.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.328+0000 7fcf63c24640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c111f40 con 0x7fcf5c101df0 2024-09-19T08:11:49.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.328+0000 7fcf63c24640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c111dc0 con 0x7fcf5c106f20 2024-09-19T08:11:49.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.328+0000 7fcf63c24640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c1120c0 con 0x7fcf5c1027a0 2024-09-19T08:11:49.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.328+0000 7fcf619c0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf5c101df0 0x7fcf5c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:49.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.328+0000 7fcf619c0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf5c101df0 0x7fcf5c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58242/0 (socket says 172.21.15.27:58242) 2024-09-19T08:11:49.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.328+0000 7fcf619c0640 1 -- 172.21.15.27:0/872778768 learned_addr learned my addr 172.21.15.27:0/872778768 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:49.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.328+0000 7fcf611bf640 1 --2- 172.21.15.27:0/872778768 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf5c1027a0 0x7fcf5c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:49.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.328+0000 7fcf621c1640 1 --2- 172.21.15.27:0/872778768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf5c106f20 0x7fcf5c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:49.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.328+0000 7fcf619c0640 1 -- 172.21.15.27:0/872778768 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf5c1027a0 msgr2=0x7fcf5c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:49.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.328+0000 7fcf619c0640 1 --2- 172.21.15.27:0/872778768 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf5c1027a0 0x7fcf5c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:49.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.328+0000 7fcf619c0640 1 -- 172.21.15.27:0/872778768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf5c106f20 msgr2=0x7fcf5c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:49.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.328+0000 7fcf619c0640 1 --2- 172.21.15.27:0/872778768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf5c106f20 0x7fcf5c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:49.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.328+0000 7fcf619c0640 1 -- 172.21.15.27:0/872778768 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5c1a6920 con 0x7fcf5c101df0 2024-09-19T08:11:49.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.329+0000 7fcf619c0640 1 --2- 172.21.15.27:0/872778768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf5c101df0 0x7fcf5c0744f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fcf58006010 tx=0x7fcf580040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:49.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.329+0000 7fcf52ffd640 1 -- 172.21.15.27:0/872778768 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58035070 con 0x7fcf5c101df0 2024-09-19T08:11:49.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.329+0000 7fcf52ffd640 1 -- 172.21.15.27:0/872778768 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf58041b60 con 0x7fcf5c101df0 2024-09-19T08:11:49.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.329+0000 7fcf63c24640 1 -- 172.21.15.27:0/872778768 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf5c1981c0 con 0x7fcf5c101df0 2024-09-19T08:11:49.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.329+0000 7fcf52ffd640 1 -- 172.21.15.27:0/872778768 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58049630 con 0x7fcf5c101df0 2024-09-19T08:11:49.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.329+0000 7fcf63c24640 1 -- 172.21.15.27:0/872778768 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf5c1986f0 con 0x7fcf5c101df0 2024-09-19T08:11:49.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.330+0000 7fcf63c24640 1 -- 172.21.15.27:0/872778768 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf5c1021d0 con 0x7fcf5c101df0 2024-09-19T08:11:49.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.332+0000 7fcf52ffd640 1 -- 172.21.15.27:0/872778768 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fcf580035f0 con 0x7fcf5c101df0 2024-09-19T08:11:49.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.333+0000 7fcf52ffd640 1 --2- 172.21.15.27:0/872778768 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fcf480a34c0 0x7fcf480a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:49.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.333+0000 7fcf611bf640 1 --2- 172.21.15.27:0/872778768 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fcf480a34c0 0x7fcf480a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:49.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.333+0000 7fcf52ffd640 1 -- 172.21.15.27:0/872778768 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fcf580f8920 con 0x7fcf5c101df0 2024-09-19T08:11:49.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.333+0000 7fcf611bf640 1 --2- 172.21.15.27:0/872778768 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fcf480a34c0 0x7fcf480a5980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c075f80 tx=0x7fcf4c005f90 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:49.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.338+0000 7fcf52ffd640 1 -- 172.21.15.27:0/872778768 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcf580c52f0 con 0x7fcf5c101df0 2024-09-19T08:11:49.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.570+0000 7fcf63c24640 1 -- 172.21.15.27:0/872778768 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf5c075a20 con 0x7fcf5c101df0 2024-09-19T08:11:49.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.571+0000 7fcf52ffd640 1 -- 172.21.15.27:0/872778768 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7fcf580c4bf0 con 0x7fcf5c101df0 2024-09-19T08:11:49.571 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:11:49.571 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:11:49.571 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:11:49.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.573+0000 7fcf63c24640 1 -- 172.21.15.27:0/872778768 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fcf480a34c0 msgr2=0x7fcf480a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:49.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.573+0000 7fcf63c24640 1 --2- 172.21.15.27:0/872778768 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fcf480a34c0 0x7fcf480a5980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c075f80 tx=0x7fcf4c005f90 comp rx=0 tx=0).stop 2024-09-19T08:11:49.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.573+0000 7fcf63c24640 1 -- 172.21.15.27:0/872778768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf5c101df0 msgr2=0x7fcf5c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:49.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.573+0000 7fcf63c24640 1 --2- 172.21.15.27:0/872778768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf5c101df0 0x7fcf5c0744f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fcf58006010 tx=0x7fcf580040c0 comp rx=0 tx=0).stop 2024-09-19T08:11:49.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.573+0000 7fcf63c24640 1 -- 172.21.15.27:0/872778768 shutdown_connections 2024-09-19T08:11:49.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.573+0000 7fcf63c24640 1 --2- 172.21.15.27:0/872778768 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fcf480a34c0 0x7fcf480a5980 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:49.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.573+0000 7fcf63c24640 1 --2- 172.21.15.27:0/872778768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf5c106f20 0x7fcf5c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:49.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.573+0000 7fcf63c24640 1 --2- 172.21.15.27:0/872778768 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf5c1027a0 0x7fcf5c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:49.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.573+0000 7fcf63c24640 1 --2- 172.21.15.27:0/872778768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf5c101df0 0x7fcf5c0744f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:49.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.573+0000 7fcf63c24640 1 -- 172.21.15.27:0/872778768 >> 172.21.15.27:0/872778768 conn(0x7fcf5c0fd8f0 msgr2=0x7fcf5c0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:49.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.574+0000 7fcf63c24640 1 -- 172.21.15.27:0/872778768 shutdown_connections 2024-09-19T08:11:49.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:49.574+0000 7fcf63c24640 1 -- 172.21.15.27:0/872778768 wait complete. 2024-09-19T08:11:50.202 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:49 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/872778768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:50.234 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24482 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0' 2024-09-19T08:11:50.234 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24482 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0 2024-09-19T08:11:50.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:49 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/872778768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:50.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:49 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/872778768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:11:50.515 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:11:51.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.020+0000 7f1d12356640 1 -- 172.21.15.27:0/1109650368 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d0c101df0 msgr2=0x7f1d0c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:51.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.020+0000 7f1d12356640 1 --2- 172.21.15.27:0/1109650368 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d0c101df0 0x7f1d0c1021d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009900 tx=0x7f1cfc02a410 comp rx=0 tx=0).stop 2024-09-19T08:11:51.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.020+0000 7f1d12356640 1 -- 172.21.15.27:0/1109650368 shutdown_connections 2024-09-19T08:11:51.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.020+0000 7f1d12356640 1 --2- 172.21.15.27:0/1109650368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d0c106f20 0x7f1d0c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.020+0000 7f1d12356640 1 --2- 172.21.15.27:0/1109650368 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d0c1027a0 0x7f1d0c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.020+0000 7f1d12356640 1 --2- 172.21.15.27:0/1109650368 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d0c101df0 0x7f1d0c1021d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.020+0000 7f1d12356640 1 -- 172.21.15.27:0/1109650368 >> 172.21.15.27:0/1109650368 conn(0x7f1d0c0fd8f0 msgr2=0x7f1d0c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:51.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.020+0000 7f1d12356640 1 -- 172.21.15.27:0/1109650368 shutdown_connections 2024-09-19T08:11:51.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.020+0000 7f1d12356640 1 -- 172.21.15.27:0/1109650368 wait complete. 2024-09-19T08:11:51.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.020+0000 7f1d12356640 1 Processor -- start 2024-09-19T08:11:51.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.021+0000 7f1d12356640 1 -- start start 2024-09-19T08:11:51.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.021+0000 7f1d12356640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d0c101df0 0x7f1d0c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:51.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.021+0000 7f1d12356640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d0c1027a0 0x7f1d0c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:51.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.021+0000 7f1d12356640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d0c106f20 0x7f1d0c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:51.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.021+0000 7f1d12356640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c111fd0 con 0x7f1d0c1027a0 2024-09-19T08:11:51.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.021+0000 7f1d12356640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c111e50 con 0x7f1d0c106f20 2024-09-19T08:11:51.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.021+0000 7f1d12356640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c112150 con 0x7f1d0c101df0 2024-09-19T08:11:51.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.021+0000 7f1d03fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d0c1027a0 0x7f1d0c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:51.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.021+0000 7f1d03fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d0c1027a0 0x7f1d0c1989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59696/0 (socket says 172.21.15.27:59696) 2024-09-19T08:11:51.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.021+0000 7f1d03fff640 1 -- 172.21.15.27:0/1838575695 learned_addr learned my addr 172.21.15.27:0/1838575695 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:51.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.021+0000 7f1d108f3640 1 --2- 172.21.15.27:0/1838575695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d0c106f20 0x7f1d0c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:51.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.021+0000 7f1d0bfff640 1 --2- 172.21.15.27:0/1838575695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d0c101df0 0x7f1d0c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:51.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.021+0000 7f1d03fff640 1 -- 172.21.15.27:0/1838575695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d0c101df0 msgr2=0x7f1d0c198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:51.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.021+0000 7f1d03fff640 1 --2- 172.21.15.27:0/1838575695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d0c101df0 0x7f1d0c198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.021+0000 7f1d03fff640 1 -- 172.21.15.27:0/1838575695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d0c106f20 msgr2=0x7f1d0c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:51.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.021+0000 7f1d03fff640 1 --2- 172.21.15.27:0/1838575695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d0c106f20 0x7f1d0c19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.021+0000 7f1d03fff640 1 -- 172.21.15.27:0/1838575695 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0c19d440 con 0x7f1d0c1027a0 2024-09-19T08:11:51.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.021+0000 7f1d108f3640 1 --2- 172.21.15.27:0/1838575695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d0c106f20 0x7f1d0c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:51.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.021+0000 7f1d03fff640 1 --2- 172.21.15.27:0/1838575695 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d0c1027a0 0x7f1d0c1989d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400d770 tx=0x7f1cf400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:51.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.022+0000 7f1d09ffb640 1 -- 172.21.15.27:0/1838575695 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4017070 con 0x7f1d0c1027a0 2024-09-19T08:11:51.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.022+0000 7f1d09ffb640 1 -- 172.21.15.27:0/1838575695 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cf4005500 con 0x7f1d0c1027a0 2024-09-19T08:11:51.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.022+0000 7f1d12356640 1 -- 172.21.15.27:0/1838575695 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d0c19d730 con 0x7f1d0c1027a0 2024-09-19T08:11:51.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.022+0000 7f1d09ffb640 1 -- 172.21.15.27:0/1838575695 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4004e00 con 0x7f1d0c1027a0 2024-09-19T08:11:51.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.022+0000 7f1d12356640 1 -- 172.21.15.27:0/1838575695 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d0c1a5010 con 0x7f1d0c1027a0 2024-09-19T08:11:51.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.025+0000 7f1d1472f740 1 Processor -- start 2024-09-19T08:11:51.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.025+0000 7f1d1472f740 1 -- start start 2024-09-19T08:11:51.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.025+0000 7f1d1472f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564878ed760 0x5564878edb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:51.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.025+0000 7f1d1472f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878ee080 0x5564878f8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:51.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.025+0000 7f1d1472f740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878f8940 0x5564878fad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:51.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.025+0000 7f1d1472f740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5564878532a0 con 0x5564878f8940 2024-09-19T08:11:51.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.025+0000 7f1d1472f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5564877fab10 con 0x5564878ee080 2024-09-19T08:11:51.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.025+0000 7f1d1472f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55648784f260 con 0x5564878ed760 2024-09-19T08:11:51.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.025+0000 7f1d09ffb640 1 -- 172.21.15.27:0/1838575695 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f1cf4004fa0 con 0x7f1d0c1027a0 2024-09-19T08:11:51.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.025+0000 7f1d108f3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564878ed760 0x5564878edb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:51.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.025+0000 7f1d108f3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564878ed760 0x5564878edb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.27:44888/0 (socket says 172.21.15.27:44888) 2024-09-19T08:11:51.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.025+0000 7f1d108f3640 1 -- 172.21.15.27:0/3839314723 learned_addr learned my addr 172.21.15.27:0/3839314723 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:51.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.025+0000 7f1d0bfff640 1 --2- 172.21.15.27:0/3839314723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878ee080 0x5564878f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:51.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.025+0000 7f1d03fff640 1 --2- 172.21.15.27:0/3839314723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878f8940 0x5564878fad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:51.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.026+0000 7f1d03fff640 1 -- 172.21.15.27:0/3839314723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564878ed760 msgr2=0x5564878edb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:51.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.026+0000 7f1d03fff640 1 --2- 172.21.15.27:0/3839314723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564878ed760 0x5564878edb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.026+0000 7f1d03fff640 1 -- 172.21.15.27:0/3839314723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878ee080 msgr2=0x5564878f8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:51.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.026+0000 7f1d03fff640 1 --2- 172.21.15.27:0/3839314723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878ee080 0x5564878f8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.026+0000 7f1d03fff640 1 -- 172.21.15.27:0/3839314723 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564875c4b90 con 0x5564878f8940 2024-09-19T08:11:51.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.026+0000 7f1d0bfff640 1 --2- 172.21.15.27:0/3839314723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878ee080 0x5564878f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:11:51.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.026+0000 7f1d03fff640 1 --2- 172.21.15.27:0/3839314723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878f8940 0x5564878fad30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40ccfd0 tx=0x7f1cf40d72a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1fd20773ad4eaa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:51.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.026+0000 7f1d027fc640 1 -- 172.21.15.27:0/3839314723 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40de070 con 0x5564878f8940 2024-09-19T08:11:51.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.027+0000 7f1d027fc640 1 -- 172.21.15.27:0/3839314723 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cf40da900 con 0x5564878f8940 2024-09-19T08:11:51.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.027+0000 7f1d09ffb640 1 --2- 172.21.15.27:0/1838575695 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1cf80a34c0 0x7f1cf80a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:51.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.027+0000 7f1d027fc640 1 -- 172.21.15.27:0/3839314723 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40d9930 con 0x5564878f8940 2024-09-19T08:11:51.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.027+0000 7f1d108f3640 1 --2- 172.21.15.27:0/1838575695 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1cf80a34c0 0x7f1cf80a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:51.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.027+0000 7f1d09ffb640 1 -- 172.21.15.27:0/1838575695 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f1cf40cf950 con 0x7f1d0c1027a0 2024-09-19T08:11:51.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.027+0000 7f1d1472f740 1 -- 172.21.15.27:0/3839314723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878f8940 msgr2=0x5564878fad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:51.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.027+0000 7f1d108f3640 1 --2- 172.21.15.27:0/1838575695 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1cf80a34c0 0x7f1cf80a5980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d04013570 tx=0x7f1d04009820 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:51.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.027+0000 7f1d1472f740 1 --2- 172.21.15.27:0/3839314723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878f8940 0x5564878fad30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40ccfd0 tx=0x7f1cf40d72a0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.027+0000 7f1d1472f740 1 -- 172.21.15.27:0/3839314723 shutdown_connections 2024-09-19T08:11:51.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.027+0000 7f1d1472f740 1 --2- 172.21.15.27:0/3839314723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878f8940 0x5564878fad30 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.027+0000 7f1d1472f740 1 --2- 172.21.15.27:0/3839314723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878ee080 0x5564878f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.027+0000 7f1d1472f740 1 --2- 172.21.15.27:0/3839314723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564878ed760 0x5564878edb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.027+0000 7f1d1472f740 1 -- 172.21.15.27:0/3839314723 >> 172.21.15.27:0/3839314723 conn(0x5564878e9cf0 msgr2=0x5564878ea0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:51.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.027+0000 7f1d1472f740 1 -- 172.21.15.27:0/3839314723 shutdown_connections 2024-09-19T08:11:51.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.027+0000 7f1d1472f740 1 -- 172.21.15.27:0/3839314723 wait complete. 2024-09-19T08:11:51.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.028+0000 7f1d1472f740 1 -- start start 2024-09-19T08:11:51.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.028+0000 7f1d1472f740 1 Processor -- start 2024-09-19T08:11:51.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.028+0000 7f1d1472f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564878ed760 0x5564878f5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:51.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.028+0000 7f1d1472f740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878ee080 0x5564878f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:51.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.029+0000 7f1d1472f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878f8940 0x5564878f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:51.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.029+0000 7f1d1472f740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5564878ff920 con 0x5564878ee080 2024-09-19T08:11:51.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.029+0000 7f1d1472f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5564877db6e0 con 0x5564878f8940 2024-09-19T08:11:51.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.029+0000 7f1d03fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878ee080 0x5564878f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:51.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.029+0000 7f1d1472f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5564878ffaa0 con 0x5564878ed760 2024-09-19T08:11:51.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.029+0000 7f1d03fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878ee080 0x5564878f5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59722/0 (socket says 172.21.15.27:59722) 2024-09-19T08:11:51.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.029+0000 7f1d03fff640 1 -- 172.21.15.27:0/458027946 learned_addr learned my addr 172.21.15.27:0/458027946 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:51.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.029+0000 7f1d1472f740 10 client.0 _ll_register_callbacks cb 0x5564877ffa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:51.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.029+0000 7f1d0bfff640 1 --2- 172.21.15.27:0/458027946 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564878ed760 0x5564878f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:51.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.029+0000 7f1d108f3640 1 --2- 172.21.15.27:0/458027946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878f8940 0x5564878f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:51.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.029+0000 7f1d03fff640 1 -- 172.21.15.27:0/458027946 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564878ed760 msgr2=0x5564878f5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:51.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.029+0000 7f1d03fff640 1 --2- 172.21.15.27:0/458027946 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564878ed760 0x5564878f5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.029+0000 7f1d03fff640 1 -- 172.21.15.27:0/458027946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878f8940 msgr2=0x5564878f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:51.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.029+0000 7f1d03fff640 1 --2- 172.21.15.27:0/458027946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878f8940 0x5564878f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.029+0000 7f1d03fff640 1 -- 172.21.15.27:0/458027946 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556487908e40 con 0x5564878ee080 2024-09-19T08:11:51.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.029+0000 7f1d03fff640 1 --2- 172.21.15.27:0/458027946 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878ee080 0x5564878f5d90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4097f10 tx=0x7f1cf40048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814c8f890d96e8c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:51.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.029+0000 7f1ceb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:51.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.029+0000 7f1ceb7fe640 1 -- 172.21.15.27:0/458027946 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40de030 con 0x5564878ee080 2024-09-19T08:11:51.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.029+0000 7f1ceb7fe640 1 -- 172.21.15.27:0/458027946 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f1cf4099db0 con 0x5564878ee080 2024-09-19T08:11:51.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.029+0000 7f1d1472f740 1 -- 172.21.15.27:0/458027946 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cf40da900 con 0x5564878ee080 2024-09-19T08:11:51.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.030+0000 7f1ceb7fe640 1 -- 172.21.15.27:0/458027946 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1cf4020070 con 0x5564878ee080 2024-09-19T08:11:51.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.030+0000 7f1d1472f740 10 client.15537 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:51.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.030+0000 7f1d1472f740 1 -- 172.21.15.27:0/458027946 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55648790b7b0 con 0x5564878ee080 2024-09-19T08:11:51.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.030+0000 7f1ceb7fe640 1 -- 172.21.15.27:0/458027946 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cf40da900 con 0x5564878ee080 2024-09-19T08:11:51.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.030+0000 7f1ceb7fe640 1 -- 172.21.15.27:0/458027946 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1cf4098120 con 0x5564878ee080 2024-09-19T08:11:51.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.030+0000 7f1d1472f740 10 client.15537 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:51.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.030+0000 7f1d1472f740 10 client.15537 resolve_mds: validated gid 24482 aka daemon mds.b 2024-09-19T08:11:51.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.030+0000 7f1d1472f740 20 client.15537 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:51.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.030+0000 7f1d1472f740 1 --2- 172.21.15.27:0/458027946 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55648790cb00 0x55648790eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:51.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.030+0000 7f1d1472f740 4 client.15537 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:11:51.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.030+0000 7f1d1472f740 1 -- 172.21.15.27:0/458027946 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564878609d0 con 0x55648790cb00 2024-09-19T08:11:51.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.030+0000 7f1d0bfff640 1 --2- 172.21.15.27:0/458027946 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55648790cb00 0x55648790eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:51.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.031+0000 7f1d0bfff640 1 --2- 172.21.15.27:0/458027946 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55648790cb00 0x55648790eef0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cc532c719fdd7de server_cookie=fc2153cdef8ac73 in_seq=0 out_seq=0 2024-09-19T08:11:51.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.031+0000 7f1ceb7fe640 10 client.15537 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:51.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.031+0000 7f1ceb7fe640 1 -- 172.21.15.27:0/458027946 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5564878609d0 con 0x55648790cb00 2024-09-19T08:11:51.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.031+0000 7f1ceb7fe640 10 client.15537 handle_command_reply: tid=0 2024-09-19T08:11:51.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.032+0000 7f1d1472f740 1 client.15537 shutdown 2024-09-19T08:11:51.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.032+0000 7f1d1472f740 1 -- 172.21.15.27:0/458027946 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878ee080 msgr2=0x5564878f5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:51.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.032+0000 7f1d1472f740 1 --2- 172.21.15.27:0/458027946 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878ee080 0x5564878f5d90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4097f10 tx=0x7f1cf40048a0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.032+0000 7f1d1472f740 1 -- 172.21.15.27:0/458027946 shutdown_connections 2024-09-19T08:11:51.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.032+0000 7f1d1472f740 1 --2- 172.21.15.27:0/458027946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878f8940 0x5564878f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.032+0000 7f1d1472f740 1 --2- 172.21.15.27:0/458027946 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878ee080 0x5564878f5d90 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.032+0000 7f1d1472f740 1 --2- 172.21.15.27:0/458027946 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55648790cb00 0x55648790eef0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.032+0000 7f1d1472f740 1 --2- 172.21.15.27:0/458027946 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564878ed760 0x5564878f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.032+0000 7f1d1472f740 1 -- 172.21.15.27:0/458027946 >> 172.21.15.27:0/458027946 conn(0x5564878e9cf0 msgr2=0x5564878e8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:51.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.032+0000 7f1ceb7fe640 0 client.15537 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:51.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.032+0000 7f1d1472f740 1 -- 172.21.15.27:0/458027946 shutdown_connections 2024-09-19T08:11:51.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.032+0000 7f1d1472f740 1 -- 172.21.15.27:0/458027946 wait complete. 2024-09-19T08:11:51.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.032+0000 7f1d1472f740 20 client.15537 trim_cache size 0 max 16384 2024-09-19T08:11:51.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.050+0000 7f1d1472f740 1 Processor -- start 2024-09-19T08:11:51.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.050+0000 7f1d1472f740 1 -- start start 2024-09-19T08:11:51.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.050+0000 7f1d1472f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878ed760 0x5564878f7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:51.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.050+0000 7f1d1472f740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878ee080 0x5564878f6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:51.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.050+0000 7f1d1472f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564878f8940 0x5564878f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:51.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.050+0000 7f1d1472f740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c1a95e0 con 0x5564878ee080 2024-09-19T08:11:51.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.050+0000 7f1d1472f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c1abe40 con 0x5564878ed760 2024-09-19T08:11:51.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.050+0000 7f1d1472f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c1a9c30 con 0x5564878f8940 2024-09-19T08:11:51.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.050+0000 7f1d03fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878ee080 0x5564878f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:51.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.050+0000 7f1d03fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878ee080 0x5564878f6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59730/0 (socket says 172.21.15.27:59730) 2024-09-19T08:11:51.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.050+0000 7f1d03fff640 1 -- 172.21.15.27:0/382310823 learned_addr learned my addr 172.21.15.27:0/382310823 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:51.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.050+0000 7f1d0bfff640 1 --2- 172.21.15.27:0/382310823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878ed760 0x5564878f7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:51.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.050+0000 7f1d03fff640 1 -- 172.21.15.27:0/382310823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564878f8940 msgr2=0x5564878f2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:51.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.050+0000 7f1d03fff640 1 --2- 172.21.15.27:0/382310823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564878f8940 0x5564878f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.050+0000 7f1d03fff640 1 -- 172.21.15.27:0/382310823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878ed760 msgr2=0x5564878f7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:51.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.050+0000 7f1d03fff640 1 --2- 172.21.15.27:0/382310823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878ed760 0x5564878f7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.050+0000 7f1d03fff640 1 -- 172.21.15.27:0/382310823 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564878e5260 con 0x5564878ee080 2024-09-19T08:11:51.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.050+0000 7f1d0bfff640 1 --2- 172.21.15.27:0/382310823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878ed760 0x5564878f7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:11:51.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.051+0000 7f1d03fff640 1 --2- 172.21.15.27:0/382310823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878ee080 0x5564878f6120 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40d5a90 tx=0x7f1cf400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee77ab63ab4f3c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:51.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.051+0000 7f1d01ffb640 1 -- 172.21.15.27:0/382310823 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40de070 con 0x5564878ee080 2024-09-19T08:11:51.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.051+0000 7f1d01ffb640 1 -- 172.21.15.27:0/382310823 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cf409fe60 con 0x5564878ee080 2024-09-19T08:11:51.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.051+0000 7f1d01ffb640 1 -- 172.21.15.27:0/382310823 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40d5300 con 0x5564878ee080 2024-09-19T08:11:51.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.051+0000 7f1d1472f740 1 -- 172.21.15.27:0/382310823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878ee080 msgr2=0x5564878f6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:51.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.051+0000 7f1d1472f740 1 --2- 172.21.15.27:0/382310823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878ee080 0x5564878f6120 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40d5a90 tx=0x7f1cf400b480 comp rx=0 tx=0).stop 2024-09-19T08:11:51.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.051+0000 7f1d1472f740 1 -- 172.21.15.27:0/382310823 shutdown_connections 2024-09-19T08:11:51.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.052+0000 7f1d1472f740 1 --2- 172.21.15.27:0/382310823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564878f8940 0x5564878f2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.052+0000 7f1d1472f740 1 --2- 172.21.15.27:0/382310823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878ee080 0x5564878f6120 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.052+0000 7f1d1472f740 1 --2- 172.21.15.27:0/382310823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878ed760 0x5564878f7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.052+0000 7f1d1472f740 1 -- 172.21.15.27:0/382310823 >> 172.21.15.27:0/382310823 conn(0x5564878e9cf0 msgr2=0x5564878e8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:51.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.052+0000 7f1d1472f740 1 -- 172.21.15.27:0/382310823 shutdown_connections 2024-09-19T08:11:51.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.052+0000 7f1d1472f740 1 -- 172.21.15.27:0/382310823 wait complete. 2024-09-19T08:11:51.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.052+0000 7f1d1472f740 1 -- start start 2024-09-19T08:11:51.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.052+0000 7f1d1472f740 1 Processor -- start 2024-09-19T08:11:51.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.052+0000 7f1d1472f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564878ed760 0x556487910000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:51.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.052+0000 7f1d1472f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878ee080 0x556487910540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:51.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.052+0000 7f1d1472f740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878f8940 0x556487976440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:51.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.052+0000 7f1d1472f740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c1aa300 con 0x5564878f8940 2024-09-19T08:11:51.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.052+0000 7f1d1472f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c1ab770 con 0x5564878ee080 2024-09-19T08:11:51.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.052+0000 7f1d1472f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c1aa9d0 con 0x5564878ed760 2024-09-19T08:11:51.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.053+0000 7f1d1472f740 10 client.0 _ll_register_callbacks cb 0x7f1cf40d59c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:11:51.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.053+0000 7f1d108f3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878f8940 0x556487976440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:51.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.053+0000 7f1d108f3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878f8940 0x556487976440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59744/0 (socket says 172.21.15.27:59744) 2024-09-19T08:11:51.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.053+0000 7f1d108f3640 1 -- 172.21.15.27:0/124406711 learned_addr learned my addr 172.21.15.27:0/124406711 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:11:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.053+0000 7f1d03fff640 1 --2- 172.21.15.27:0/124406711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878ee080 0x556487910540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.053+0000 7f1d0bfff640 1 --2- 172.21.15.27:0/124406711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564878ed760 0x556487910000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.053+0000 7f1d108f3640 1 -- 172.21.15.27:0/124406711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564878ed760 msgr2=0x556487910000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.053+0000 7f1d108f3640 1 --2- 172.21.15.27:0/124406711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564878ed760 0x556487910000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.053+0000 7f1d108f3640 1 -- 172.21.15.27:0/124406711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878ee080 msgr2=0x556487910540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:11:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.053+0000 7f1d108f3640 1 --2- 172.21.15.27:0/124406711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878ee080 0x556487910540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.053+0000 7f1d108f3640 1 -- 172.21.15.27:0/124406711 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556487976980 con 0x5564878f8940 2024-09-19T08:11:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.053+0000 7f1d03fff640 1 --2- 172.21.15.27:0/124406711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878ee080 0x556487910540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:11:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.053+0000 7f1d108f3640 1 --2- 172.21.15.27:0/124406711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878f8940 0x556487976440 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1d04011f50 tx=0x7f1d04004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79a5bda8fa2262e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:11:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.053+0000 7f1ceb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:11:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.054+0000 7f1ceb7fe640 1 -- 172.21.15.27:0/124406711 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0402d060 con 0x5564878f8940 2024-09-19T08:11:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.054+0000 7f1ceb7fe640 1 -- 172.21.15.27:0/124406711 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f1d04020ba0 con 0x5564878f8940 2024-09-19T08:11:51.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.054+0000 7f1d1472f740 1 -- 172.21.15.27:0/124406711 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cf409fe60 con 0x5564878f8940 2024-09-19T08:11:51.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.054+0000 7f1ceb7fe640 1 -- 172.21.15.27:0/124406711 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1d04009d80 con 0x5564878f8940 2024-09-19T08:11:51.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.054+0000 7f1d1472f740 10 client.15543 fetch_fsmap learned FSMap version 20 2024-09-19T08:11:51.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.054+0000 7f1d1472f740 1 -- 172.21.15.27:0/124406711 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556487977cc0 con 0x5564878f8940 2024-09-19T08:11:51.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.054+0000 7f1ceb7fe640 1 -- 172.21.15.27:0/124406711 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cf409fe60 con 0x5564878f8940 2024-09-19T08:11:51.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.054+0000 7f1ceb7fe640 1 -- 172.21.15.27:0/124406711 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1d04027030 con 0x5564878f8940 2024-09-19T08:11:51.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.054+0000 7f1d1472f740 10 client.15543 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:11:51.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.054+0000 7f1d1472f740 10 client.15543 resolve_mds: validated gid 24482 aka daemon mds.b 2024-09-19T08:11:51.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.054+0000 7f1d1472f740 20 client.15543 populate_metadata read hostname 'smithi027' 2024-09-19T08:11:51.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.055+0000 7f1d1472f740 1 --2- 172.21.15.27:0/124406711 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556487978430 0x55648797a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:11:51.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.055+0000 7f1d1472f740 4 client.15543 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}] 2024-09-19T08:11:51.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.055+0000 7f1d1472f740 1 -- 172.21.15.27:0/124406711 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}) -- 0x55648785ad20 con 0x556487978430 2024-09-19T08:11:51.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.055+0000 7f1d0bfff640 1 --2- 172.21.15.27:0/124406711 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556487978430 0x55648797a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:11:51.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.055+0000 7f1ceb7fe640 10 client.15543 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:51.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.055+0000 7f1d0bfff640 1 --2- 172.21.15.27:0/124406711 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556487978430 0x55648797a850 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=825c51546c4fcf8a server_cookie=cca7ffcb20783418 in_seq=0 out_seq=0 2024-09-19T08:11:51.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.064+0000 7f1ceb7fe640 1 -- 172.21.15.27:0/124406711 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55648785ad20 con 0x556487978430 2024-09-19T08:11:51.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.064+0000 7f1ceb7fe640 10 client.15543 handle_command_reply: tid=0 2024-09-19T08:11:51.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.065+0000 7f1d1472f740 1 client.15543 shutdown 2024-09-19T08:11:51.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.065+0000 7f1d1472f740 1 -- 172.21.15.27:0/124406711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878f8940 msgr2=0x556487976440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:51.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.065+0000 7f1d1472f740 1 --2- 172.21.15.27:0/124406711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878f8940 0x556487976440 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1d04011f50 tx=0x7f1d04004ab0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.065+0000 7f1d1472f740 1 -- 172.21.15.27:0/124406711 shutdown_connections 2024-09-19T08:11:51.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.065+0000 7f1d1472f740 1 --2- 172.21.15.27:0/124406711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5564878f8940 0x556487976440 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.065+0000 7f1d1472f740 1 --2- 172.21.15.27:0/124406711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564878ee080 0x556487910540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.065+0000 7f1d1472f740 1 --2- 172.21.15.27:0/124406711 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556487978430 0x55648797a850 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.065+0000 7f1d1472f740 1 --2- 172.21.15.27:0/124406711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564878ed760 0x556487910000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.065+0000 7f1ceb7fe640 0 client.15543 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:11:51.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.065+0000 7f1d1472f740 1 -- 172.21.15.27:0/124406711 >> 172.21.15.27:0/124406711 conn(0x5564878e9cf0 msgr2=0x5564878ef1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:51.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.065+0000 7f1d1472f740 1 -- 172.21.15.27:0/124406711 shutdown_connections 2024-09-19T08:11:51.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.065+0000 7f1d1472f740 1 -- 172.21.15.27:0/124406711 wait complete. 2024-09-19T08:11:51.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.065+0000 7f1d1472f740 20 client.15543 trim_cache size 0 max 16384 2024-09-19T08:11:51.067 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:11:51.067 INFO:teuthology.orchestra.run.smithi027.stdout: "epoch": 20, 2024-09-19T08:11:51.067 INFO:teuthology.orchestra.run.smithi027.stdout: "leader": 24482, 2024-09-19T08:11:51.067 INFO:teuthology.orchestra.run.smithi027.stdout: "set_version": 2, 2024-09-19T08:11:51.067 INFO:teuthology.orchestra.run.smithi027.stdout: "sets": { 2024-09-19T08:11:51.067 INFO:teuthology.orchestra.run.smithi027.stdout: "3e540564": { 2024-09-19T08:11:51.067 INFO:teuthology.orchestra.run.smithi027.stdout: "version": 2, 2024-09-19T08:11:51.067 INFO:teuthology.orchestra.run.smithi027.stdout: "age_ref": 0.0, 2024-09-19T08:11:51.067 INFO:teuthology.orchestra.run.smithi027.stdout: "state": { 2024-09-19T08:11:51.067 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "QUIESCED", 2024-09-19T08:11:51.068 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0 2024-09-19T08:11:51.068 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:11:51.068 INFO:teuthology.orchestra.run.smithi027.stdout: "timeout": 90.0, 2024-09-19T08:11:51.068 INFO:teuthology.orchestra.run.smithi027.stdout: "expiration": 131.2, 2024-09-19T08:11:51.068 INFO:teuthology.orchestra.run.smithi027.stdout: "members": { 2024-09-19T08:11:51.068 INFO:teuthology.orchestra.run.smithi027.stdout: "file:/": { 2024-09-19T08:11:51.068 INFO:teuthology.orchestra.run.smithi027.stdout: "excluded": false, 2024-09-19T08:11:51.068 INFO:teuthology.orchestra.run.smithi027.stdout: "state": { 2024-09-19T08:11:51.069 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "QUIESCED", 2024-09-19T08:11:51.069 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0 2024-09-19T08:11:51.069 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:11:51.069 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:11:51.069 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:11:51.069 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:11:51.069 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:11:51.069 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:11:51.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.066+0000 7f1d12356640 1 -- 172.21.15.27:0/1838575695 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1cf80a34c0 msgr2=0x7f1cf80a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:51.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.066+0000 7f1d12356640 1 --2- 172.21.15.27:0/1838575695 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1cf80a34c0 0x7f1cf80a5980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d04013570 tx=0x7f1d04009820 comp rx=0 tx=0).stop 2024-09-19T08:11:51.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.066+0000 7f1d12356640 1 -- 172.21.15.27:0/1838575695 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d0c1027a0 msgr2=0x7f1d0c1989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:11:51.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.066+0000 7f1d12356640 1 --2- 172.21.15.27:0/1838575695 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d0c1027a0 0x7f1d0c1989d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400d770 tx=0x7f1cf400dc30 comp rx=0 tx=0).stop 2024-09-19T08:11:51.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.066+0000 7f1d12356640 1 -- 172.21.15.27:0/1838575695 shutdown_connections 2024-09-19T08:11:51.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.066+0000 7f1d12356640 1 --2- 172.21.15.27:0/1838575695 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1cf80a34c0 0x7f1cf80a5980 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.066+0000 7f1d12356640 1 --2- 172.21.15.27:0/1838575695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d0c106f20 0x7f1d0c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.066+0000 7f1d12356640 1 --2- 172.21.15.27:0/1838575695 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d0c1027a0 0x7f1d0c1989d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.066+0000 7f1d12356640 1 --2- 172.21.15.27:0/1838575695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d0c101df0 0x7f1d0c198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:11:51.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.066+0000 7f1d12356640 1 -- 172.21.15.27:0/1838575695 >> 172.21.15.27:0/1838575695 conn(0x7f1d0c0fd8f0 msgr2=0x7f1d0c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:11:51.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.066+0000 7f1d12356640 1 -- 172.21.15.27:0/1838575695 shutdown_connections 2024-09-19T08:11:51.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:11:51.066+0000 7f1d12356640 1 -- 172.21.15.27:0/1838575695 wait complete. 2024-09-19T08:11:51.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:50 smithi155 ceph-mon[35362]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:11:51.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:50 smithi027 ceph-mon[31209]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:11:51.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:50 smithi203 ceph-mon[35198]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:11:51.798 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3e540564', quiesce took 3.3 seconds. Will release after: 7.8999999999999995 2024-09-19T08:11:53.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:52 smithi155 ceph-mon[35362]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:11:53.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:52 smithi027 ceph-mon[31209]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:11:53.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:52 smithi203 ceph-mon[35198]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:11:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:54 smithi155 ceph-mon[35362]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T08:11:55.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:54 smithi027 ceph-mon[31209]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T08:11:55.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:54 smithi203 ceph-mon[35198]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T08:11:57.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:56 smithi155 ceph-mon[35362]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T08:11:57.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:56 smithi027 ceph-mon[31209]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T08:11:57.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:56 smithi203 ceph-mon[35198]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T08:11:59.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:11:58 smithi155 ceph-mon[35362]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T08:11:59.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:11:58 smithi027 ceph-mon[31209]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T08:11:59.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:11:58 smithi203 ceph-mon[35198]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T08:11:59.699 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:11:59.984 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:12:00.977 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:12:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:12:00.647+0000 7f1a6bd74640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:12:00.977 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:12:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:12:00.647+0000 7f1a6bd74640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:12:00.977 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:12:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:12:00.647+0000 7f1a6bd74640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:12:00.977 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:12:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:12:00.647+0000 7f1a6bd74640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:12:00.977 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:12:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:12:00.647+0000 7f1a6bd74640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:12:01.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:00 smithi155 ceph-mon[35362]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T08:12:01.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:00 smithi027 ceph-mon[31209]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T08:12:01.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:00 smithi203 ceph-mon[35198]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T08:12:02.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.267+0000 7fc4e766d640 1 -- 172.21.15.27:0/2285895692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4e0102d90 msgr2=0x7fc4e0103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:02.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.267+0000 7fc4e766d640 1 --2- 172.21.15.27:0/2285895692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4e0102d90 0x7fc4e0103170 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009930 tx=0x7fc4dc02a420 comp rx=0 tx=0).stop 2024-09-19T08:12:02.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.268+0000 7fc4e766d640 1 -- 172.21.15.27:0/2285895692 shutdown_connections 2024-09-19T08:12:02.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.268+0000 7fc4e766d640 1 --2- 172.21.15.27:0/2285895692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4e0108290 0x7fc4e010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:02.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.268+0000 7fc4e766d640 1 --2- 172.21.15.27:0/2285895692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4e0103740 0x7fc4e0107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:02.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.268+0000 7fc4e766d640 1 --2- 172.21.15.27:0/2285895692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4e0102d90 0x7fc4e0103170 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:02.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.268+0000 7fc4e766d640 1 -- 172.21.15.27:0/2285895692 >> 172.21.15.27:0/2285895692 conn(0x7fc4e00fc7d0 msgr2=0x7fc4e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.268+0000 7fc4e766d640 1 -- 172.21.15.27:0/2285895692 shutdown_connections 2024-09-19T08:12:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.268+0000 7fc4e766d640 1 -- 172.21.15.27:0/2285895692 wait complete. 2024-09-19T08:12:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.268+0000 7fc4e766d640 1 Processor -- start 2024-09-19T08:12:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.269+0000 7fc4e766d640 1 -- start start 2024-09-19T08:12:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.269+0000 7fc4e766d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4e0102d90 0x7fc4e01985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.269+0000 7fc4e766d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4e0103740 0x7fc4e0198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.269+0000 7fc4e4c08640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4e0103740 0x7fc4e0198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.269+0000 7fc4e4c08640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4e0103740 0x7fc4e0198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33044/0 (socket says 172.21.15.27:33044) 2024-09-19T08:12:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.269+0000 7fc4e766d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4e0108290 0x7fc4e019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.269+0000 7fc4e766d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e0112090 con 0x7fc4e0103740 2024-09-19T08:12:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.269+0000 7fc4e766d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e0111f10 con 0x7fc4e0102d90 2024-09-19T08:12:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.269+0000 7fc4e766d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e0112210 con 0x7fc4e0108290 2024-09-19T08:12:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.269+0000 7fc4e4c08640 1 -- 172.21.15.27:0/4032679146 learned_addr learned my addr 172.21.15.27:0/4032679146 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:02.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.269+0000 7fc4e5409640 1 --2- 172.21.15.27:0/4032679146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4e0102d90 0x7fc4e01985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:02.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.269+0000 7fc4e5c0a640 1 --2- 172.21.15.27:0/4032679146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4e0108290 0x7fc4e019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:02.120 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:12:02.120 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:12:02.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.269+0000 7fc4e4c08640 1 -- 172.21.15.27:0/4032679146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4e0108290 msgr2=0x7fc4e019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:02.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.269+0000 7fc4e4c08640 1 --2- 172.21.15.27:0/4032679146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4e0108290 0x7fc4e019ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:02.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.269+0000 7fc4e4c08640 1 -- 172.21.15.27:0/4032679146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4e0102d90 msgr2=0x7fc4e01985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:02.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.269+0000 7fc4e4c08640 1 --2- 172.21.15.27:0/4032679146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4e0102d90 0x7fc4e01985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:02.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.270+0000 7fc4e4c08640 1 -- 172.21.15.27:0/4032679146 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e019d550 con 0x7fc4e0103740 2024-09-19T08:12:02.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.270+0000 7fc4e4c08640 1 --2- 172.21.15.27:0/4032679146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4e0103740 0x7fc4e0198ae0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0005fd0 tx=0x7fc4d000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:02.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.270+0000 7fc4d67fc640 1 -- 172.21.15.27:0/4032679146 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0017070 con 0x7fc4e0103740 2024-09-19T08:12:02.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.270+0000 7fc4d67fc640 1 -- 172.21.15.27:0/4032679146 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4d0009c30 con 0x7fc4e0103740 2024-09-19T08:12:02.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.270+0000 7fc4e766d640 1 -- 172.21.15.27:0/4032679146 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e019d840 con 0x7fc4e0103740 2024-09-19T08:12:02.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.270+0000 7fc4d67fc640 1 -- 172.21.15.27:0/4032679146 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0010460 con 0x7fc4e0103740 2024-09-19T08:12:02.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.270+0000 7fc4e766d640 1 -- 172.21.15.27:0/4032679146 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e01a5120 con 0x7fc4e0103740 2024-09-19T08:12:02.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.271+0000 7fc4e766d640 1 -- 172.21.15.27:0/4032679146 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4e006a7f0 con 0x7fc4e0103740 2024-09-19T08:12:02.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.273+0000 7fc4d67fc640 1 -- 172.21.15.27:0/4032679146 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fc4d0003e70 con 0x7fc4e0103740 2024-09-19T08:12:02.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.273+0000 7fc4d67fc640 1 --2- 172.21.15.27:0/4032679146 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc4cc0a3540 0x7fc4cc0a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:02.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.273+0000 7fc4d67fc640 1 -- 172.21.15.27:0/4032679146 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fc4d00d0260 con 0x7fc4e0103740 2024-09-19T08:12:02.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.274+0000 7fc4e5409640 1 --2- 172.21.15.27:0/4032679146 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc4cc0a3540 0x7fc4cc0a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:02.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.274+0000 7fc4e5409640 1 --2- 172.21.15.27:0/4032679146 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc4cc0a3540 0x7fc4cc0a5a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009900 tx=0x7fc4dc0058d0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:02.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.281+0000 7fc4d67fc640 1 -- 172.21.15.27:0/4032679146 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc4d0020030 con 0x7fc4e0103740 2024-09-19T08:12:02.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.543+0000 7fc4e766d640 1 -- 172.21.15.27:0/4032679146 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4e010a2a0 con 0x7fc4e0103740 2024-09-19T08:12:02.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.544+0000 7fc4d67fc640 1 -- 172.21.15.27:0/4032679146 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7fc4d009cb40 con 0x7fc4e0103740 2024-09-19T08:12:02.122 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:12:02.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.547+0000 7fc4e766d640 1 -- 172.21.15.27:0/4032679146 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc4cc0a3540 msgr2=0x7fc4cc0a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.547+0000 7fc4e766d640 1 --2- 172.21.15.27:0/4032679146 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc4cc0a3540 0x7fc4cc0a5a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009900 tx=0x7fc4dc0058d0 comp rx=0 tx=0).stop 2024-09-19T08:12:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.547+0000 7fc4e766d640 1 -- 172.21.15.27:0/4032679146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4e0103740 msgr2=0x7fc4e0198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.547+0000 7fc4e766d640 1 --2- 172.21.15.27:0/4032679146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4e0103740 0x7fc4e0198ae0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0005fd0 tx=0x7fc4d000dde0 comp rx=0 tx=0).stop 2024-09-19T08:12:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.548+0000 7fc4e766d640 1 -- 172.21.15.27:0/4032679146 shutdown_connections 2024-09-19T08:12:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.548+0000 7fc4e766d640 1 --2- 172.21.15.27:0/4032679146 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc4cc0a3540 0x7fc4cc0a5a00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.548+0000 7fc4e766d640 1 --2- 172.21.15.27:0/4032679146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4e0108290 0x7fc4e019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.548+0000 7fc4e766d640 1 --2- 172.21.15.27:0/4032679146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4e0103740 0x7fc4e0198ae0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.548+0000 7fc4e766d640 1 --2- 172.21.15.27:0/4032679146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4e0102d90 0x7fc4e01985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.548+0000 7fc4e766d640 1 -- 172.21.15.27:0/4032679146 >> 172.21.15.27:0/4032679146 conn(0x7fc4e00fc7d0 msgr2=0x7fc4e0105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.548+0000 7fc4e766d640 1 -- 172.21.15.27:0/4032679146 shutdown_connections 2024-09-19T08:12:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:01.548+0000 7fc4e766d640 1 -- 172.21.15.27:0/4032679146 wait complete. 2024-09-19T08:12:02.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:01 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/4032679146' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:12:02.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:01 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/4032679146' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:12:02.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:01 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/4032679146' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:12:03.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:02 smithi155 ceph-mon[35362]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T08:12:03.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:02 smithi155 ceph-mon[35362]: mgrmap e25: x(active, since 60s), standbys: y, z 2024-09-19T08:12:03.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:02 smithi027 ceph-mon[31209]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T08:12:03.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:02 smithi027 ceph-mon[31209]: mgrmap e25: x(active, since 60s), standbys: y, z 2024-09-19T08:12:03.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:02 smithi203 ceph-mon[35198]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T08:12:03.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:02 smithi203 ceph-mon[35198]: mgrmap e25: x(active, since 60s), standbys: y, z 2024-09-19T08:12:05.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:04 smithi027 ceph-mon[31209]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-19T08:12:05.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:04 smithi203 ceph-mon[35198]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-19T08:12:05.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:04 smithi155 ceph-mon[35362]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-19T08:12:05.655 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24482 quiesce db --set-id 3e540564 --release --await' 2024-09-19T08:12:05.655 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24482 quiesce db --set-id 3e540564 --release --await 2024-09-19T08:12:05.966 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:12:06.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.707+0000 7f6019f9e640 1 -- 172.21.15.27:0/951497627 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60141019c0 msgr2=0x7f6014101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.707+0000 7f6019f9e640 1 --2- 172.21.15.27:0/951497627 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60141019c0 0x7f6014101e20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6000009930 tx=0x7f600002a420 comp rx=0 tx=0).stop 2024-09-19T08:12:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.707+0000 7f6019f9e640 1 -- 172.21.15.27:0/951497627 shutdown_connections 2024-09-19T08:12:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.707+0000 7f6019f9e640 1 --2- 172.21.15.27:0/951497627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6014102360 0x7f601410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.707+0000 7f6019f9e640 1 --2- 172.21.15.27:0/951497627 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60141019c0 0x7f6014101e20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.707+0000 7f6019f9e640 1 --2- 172.21.15.27:0/951497627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60141079c0 0x7f6014107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.707+0000 7f6019f9e640 1 -- 172.21.15.27:0/951497627 >> 172.21.15.27:0/951497627 conn(0x7f60140fd700 msgr2=0x7f60140ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.707+0000 7f6019f9e640 1 -- 172.21.15.27:0/951497627 shutdown_connections 2024-09-19T08:12:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.707+0000 7f6019f9e640 1 -- 172.21.15.27:0/951497627 wait complete. 2024-09-19T08:12:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.708+0000 7f6019f9e640 1 Processor -- start 2024-09-19T08:12:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.708+0000 7f6019f9e640 1 -- start start 2024-09-19T08:12:06.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.709+0000 7f6019f9e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60141019c0 0x7f60140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:06.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.709+0000 7f6019f9e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6014102360 0x7f6014074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:06.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.709+0000 7f6019f9e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60141079c0 0x7f6014074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:06.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.709+0000 7f6019f9e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6014111dd0 con 0x7f6014102360 2024-09-19T08:12:06.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.709+0000 7f6019f9e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6014111c50 con 0x7f60141019c0 2024-09-19T08:12:06.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.709+0000 7f6019f9e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6014111f50 con 0x7f60141079c0 2024-09-19T08:12:06.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.709+0000 7f6013fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6014102360 0x7f6014074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:06.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.709+0000 7f6013fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6014102360 0x7f6014074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33068/0 (socket says 172.21.15.27:33068) 2024-09-19T08:12:06.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.709+0000 7f6013fff640 1 -- 172.21.15.27:0/2309597540 learned_addr learned my addr 172.21.15.27:0/2309597540 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:06.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.709+0000 7f6018f9c640 1 --2- 172.21.15.27:0/2309597540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60141019c0 0x7f60140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:06.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.709+0000 7f601979d640 1 --2- 172.21.15.27:0/2309597540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60141079c0 0x7f6014074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:06.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.710+0000 7f6018f9c640 1 -- 172.21.15.27:0/2309597540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60141079c0 msgr2=0x7f6014074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:06.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.710+0000 7f6018f9c640 1 --2- 172.21.15.27:0/2309597540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60141079c0 0x7f6014074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.710+0000 7f6018f9c640 1 -- 172.21.15.27:0/2309597540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6014102360 msgr2=0x7f6014074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:06.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.710+0000 7f6018f9c640 1 --2- 172.21.15.27:0/2309597540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6014102360 0x7f6014074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.710+0000 7f6018f9c640 1 -- 172.21.15.27:0/2309597540 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60141a66b0 con 0x7f60141019c0 2024-09-19T08:12:06.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.710+0000 7f6013fff640 1 --2- 172.21.15.27:0/2309597540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6014102360 0x7f6014074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:12:06.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.710+0000 7f6018f9c640 1 --2- 172.21.15.27:0/2309597540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60141019c0 0x7f60140744f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f600800c970 tx=0x7f600800ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:06.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.710+0000 7f6011ffb640 1 -- 172.21.15.27:0/2309597540 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6008007bb0 con 0x7f60141019c0 2024-09-19T08:12:06.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.710+0000 7f6011ffb640 1 -- 172.21.15.27:0/2309597540 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6008007d50 con 0x7f60141019c0 2024-09-19T08:12:06.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.710+0000 7f6011ffb640 1 -- 172.21.15.27:0/2309597540 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6008018820 con 0x7f60141019c0 2024-09-19T08:12:06.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.711+0000 7f6019f9e640 1 -- 172.21.15.27:0/2309597540 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60141a69a0 con 0x7f60141019c0 2024-09-19T08:12:06.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.711+0000 7f6019f9e640 1 -- 172.21.15.27:0/2309597540 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60141a6e60 con 0x7f60141019c0 2024-09-19T08:12:06.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.715+0000 7f6011ffb640 1 -- 172.21.15.27:0/2309597540 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7f60080189c0 con 0x7f60141019c0 2024-09-19T08:12:06.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.715+0000 7f601d5d9740 1 Processor -- start 2024-09-19T08:12:06.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.715+0000 7f601d5d9740 1 -- start start 2024-09-19T08:12:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.716+0000 7f601d5d9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b01a50 0x560612b01e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.716+0000 7f601d5d9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b02370 0x560612b0c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.716+0000 7f601d5d9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b0cc30 0x560612b0f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.716+0000 7f601d5d9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560612a5e620 con 0x560612b01a50 2024-09-19T08:12:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.716+0000 7f601d5d9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x560612a05e50 con 0x560612b02370 2024-09-19T08:12:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.716+0000 7f601d5d9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560612a5a5e0 con 0x560612b0cc30 2024-09-19T08:12:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.716+0000 7f6013fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b0cc30 0x560612b0f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.716+0000 7f6013fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b0cc30 0x560612b0f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.27:51498/0 (socket says 172.21.15.27:51498) 2024-09-19T08:12:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.716+0000 7f6013fff640 1 -- 172.21.15.27:0/4041794594 learned_addr learned my addr 172.21.15.27:0/4041794594 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.716+0000 7f6011ffb640 1 --2- 172.21.15.27:0/2309597540 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f60040a3550 0x7f60040a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.717+0000 7f6013fff640 1 -- 172.21.15.27:0/4041794594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b02370 msgr2=0x560612b0c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.717+0000 7f6018f9c640 1 --2- 172.21.15.27:0/4041794594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b02370 0x560612b0c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.717+0000 7f6013fff640 1 --2- 172.21.15.27:0/4041794594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b02370 0x560612b0c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.717+0000 7f601979d640 1 --2- 172.21.15.27:0/4041794594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b01a50 0x560612b01e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.717+0000 7f6013fff640 1 -- 172.21.15.27:0/4041794594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b01a50 msgr2=0x560612b01e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.717+0000 7f6011ffb640 1 -- 172.21.15.27:0/2309597540 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f60080cfd30 con 0x7f60141019c0 2024-09-19T08:12:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.717+0000 7f6013fff640 1 --2- 172.21.15.27:0/4041794594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b01a50 0x560612b01e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.717+0000 7f6013fff640 1 -- 172.21.15.27:0/4041794594 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606129f6d40 con 0x560612b0cc30 2024-09-19T08:12:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.717+0000 7f6018f9c640 1 --2- 172.21.15.27:0/4041794594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b02370 0x560612b0c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:12:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.717+0000 7f601979d640 1 --2- 172.21.15.27:0/4041794594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b01a50 0x560612b01e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:12:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.717+0000 7f6013fff640 1 --2- 172.21.15.27:0/4041794594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b0cc30 0x560612b0f020 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6000004530 tx=0x7f6000004560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6359d65db0e1db3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.717+0000 7f601979d640 1 --2- 172.21.15.27:0/2309597540 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f60040a3550 0x7f60040a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.718+0000 7f5ffeffd640 1 -- 172.21.15.27:0/4041794594 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000035040 con 0x560612b0cc30 2024-09-19T08:12:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.718+0000 7f5ffeffd640 1 -- 172.21.15.27:0/4041794594 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6000004c40 con 0x560612b0cc30 2024-09-19T08:12:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.718+0000 7f5ffeffd640 1 -- 172.21.15.27:0/4041794594 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000003c10 con 0x560612b0cc30 2024-09-19T08:12:06.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.719+0000 7f601d5d9740 1 -- 172.21.15.27:0/4041794594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b0cc30 msgr2=0x560612b0f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:06.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.719+0000 7f601d5d9740 1 --2- 172.21.15.27:0/4041794594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b0cc30 0x560612b0f020 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6000004530 tx=0x7f6000004560 comp rx=0 tx=0).stop 2024-09-19T08:12:06.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.719+0000 7f601979d640 1 --2- 172.21.15.27:0/2309597540 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f60040a3550 0x7f60040a5a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f600c005fd0 tx=0x7f600c009a20 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:06.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.719+0000 7f601d5d9740 1 -- 172.21.15.27:0/4041794594 shutdown_connections 2024-09-19T08:12:06.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.719+0000 7f601d5d9740 1 --2- 172.21.15.27:0/4041794594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b0cc30 0x560612b0f020 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.719+0000 7f601d5d9740 1 --2- 172.21.15.27:0/4041794594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b02370 0x560612b0c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.719+0000 7f601d5d9740 1 --2- 172.21.15.27:0/4041794594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b01a50 0x560612b01e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.719+0000 7f601d5d9740 1 -- 172.21.15.27:0/4041794594 >> 172.21.15.27:0/4041794594 conn(0x560612afdfe0 msgr2=0x560612afe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:06.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.719+0000 7f601d5d9740 1 -- 172.21.15.27:0/4041794594 shutdown_connections 2024-09-19T08:12:06.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.719+0000 7f601d5d9740 1 -- 172.21.15.27:0/4041794594 wait complete. 2024-09-19T08:12:06.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.719+0000 7f601d5d9740 1 -- start start 2024-09-19T08:12:06.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.719+0000 7f601d5d9740 1 Processor -- start 2024-09-19T08:12:06.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.720+0000 7f601d5d9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b01a50 0x560612b09a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:06.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.720+0000 7f601d5d9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b02370 0x560612b09fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:06.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.720+0000 7f601d5d9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b0cc30 0x560612b0a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:06.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.720+0000 7f601d5d9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560612b0f800 con 0x560612b02370 2024-09-19T08:12:06.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.720+0000 7f601d5d9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5606129e6f10 con 0x560612b0cc30 2024-09-19T08:12:06.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.720+0000 7f601d5d9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560612b0f980 con 0x560612b01a50 2024-09-19T08:12:06.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.720+0000 7f601d5d9740 10 client.0 _ll_register_callbacks cb 0x560612a0adb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:12:06.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.720+0000 7f6018f9c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b01a50 0x560612b09a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:06.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.720+0000 7f601979d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b0cc30 0x560612b0a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:06.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.720+0000 7f6013fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b02370 0x560612b09fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:06.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.720+0000 7f6013fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b02370 0x560612b09fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33074/0 (socket says 172.21.15.27:33074) 2024-09-19T08:12:06.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.720+0000 7f6013fff640 1 -- 172.21.15.27:0/764135590 learned_addr learned my addr 172.21.15.27:0/764135590 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:06.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.721+0000 7f601979d640 1 -- 172.21.15.27:0/764135590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b01a50 msgr2=0x560612b09a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:06.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.721+0000 7f601979d640 1 --2- 172.21.15.27:0/764135590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b01a50 0x560612b09a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.721+0000 7f601979d640 1 -- 172.21.15.27:0/764135590 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b02370 msgr2=0x560612b09fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:06.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.721+0000 7f601979d640 1 --2- 172.21.15.27:0/764135590 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b02370 0x560612b09fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.721+0000 7f601979d640 1 -- 172.21.15.27:0/764135590 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56061276d580 con 0x560612b0cc30 2024-09-19T08:12:06.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.721+0000 7f6013fff640 1 --2- 172.21.15.27:0/764135590 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b02370 0x560612b09fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:12:06.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.721+0000 7f601979d640 1 --2- 172.21.15.27:0/764135590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b0cc30 0x560612b0a4e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f600c00fb70 tx=0x7f600c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b30910826414520f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:06.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.721+0000 7f5ff3fff640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:12:06.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.721+0000 7f5ff3fff640 1 -- 172.21.15.27:0/764135590 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c011cb0 con 0x560612b0cc30 2024-09-19T08:12:06.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.721+0000 7f5ff3fff640 1 -- 172.21.15.27:0/764135590 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f600c027470 con 0x560612b0cc30 2024-09-19T08:12:06.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.721+0000 7f601d5d9740 1 -- 172.21.15.27:0/764135590 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6000004c40 con 0x560612b0cc30 2024-09-19T08:12:06.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.722+0000 7f5ff3fff640 1 -- 172.21.15.27:0/764135590 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f600c011e50 con 0x560612b0cc30 2024-09-19T08:12:06.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.722+0000 7f601d5d9740 10 client.25133 fetch_fsmap learned FSMap version 20 2024-09-19T08:12:06.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.722+0000 7f601d5d9740 1 -- 172.21.15.27:0/764135590 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560612837960 con 0x560612b0cc30 2024-09-19T08:12:06.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.722+0000 7f5ff3fff640 1 -- 172.21.15.27:0/764135590 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6000004c40 con 0x560612b0cc30 2024-09-19T08:12:06.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.723+0000 7f5ff3fff640 1 -- 172.21.15.27:0/764135590 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f600c00f040 con 0x560612b0cc30 2024-09-19T08:12:06.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.723+0000 7f601d5d9740 10 client.25133 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:12:06.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.723+0000 7f601d5d9740 10 client.25133 resolve_mds: validated gid 24482 aka daemon mds.b 2024-09-19T08:12:06.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.723+0000 7f601d5d9740 20 client.25133 populate_metadata read hostname 'smithi027' 2024-09-19T08:12:06.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.723+0000 7f601d5d9740 1 --2- 172.21.15.27:0/764135590 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560612b1c610 0x560612b1ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:06.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.723+0000 7f601d5d9740 4 client.25133 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:12:06.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.723+0000 7f601d5d9740 1 -- 172.21.15.27:0/764135590 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560612a6bb90 con 0x560612b1c610 2024-09-19T08:12:06.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.723+0000 7f6018f9c640 1 --2- 172.21.15.27:0/764135590 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560612b1c610 0x560612b1ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.724+0000 7f6018f9c640 1 --2- 172.21.15.27:0/764135590 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560612b1c610 0x560612b1ea70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e4678e2f03bcd62 server_cookie=dd11c6217f89dd6f in_seq=0 out_seq=0 2024-09-19T08:12:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.724+0000 7f5ff3fff640 10 client.25133 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.724+0000 7f5ff3fff640 1 -- 172.21.15.27:0/764135590 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560612a6bb90 con 0x560612b1c610 2024-09-19T08:12:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.724+0000 7f5ff3fff640 10 client.25133 handle_command_reply: tid=0 2024-09-19T08:12:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.725+0000 7f601d5d9740 1 client.25133 shutdown 2024-09-19T08:12:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.725+0000 7f601d5d9740 1 -- 172.21.15.27:0/764135590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b0cc30 msgr2=0x560612b0a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.725+0000 7f601d5d9740 1 --2- 172.21.15.27:0/764135590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b0cc30 0x560612b0a4e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f600c00fb70 tx=0x7f600c017000 comp rx=0 tx=0).stop 2024-09-19T08:12:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.725+0000 7f601d5d9740 1 -- 172.21.15.27:0/764135590 shutdown_connections 2024-09-19T08:12:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.725+0000 7f601d5d9740 1 --2- 172.21.15.27:0/764135590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b0cc30 0x560612b0a4e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.725+0000 7f601d5d9740 1 --2- 172.21.15.27:0/764135590 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b02370 0x560612b09fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.725+0000 7f601d5d9740 1 --2- 172.21.15.27:0/764135590 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560612b1c610 0x560612b1ea70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.725+0000 7f601d5d9740 1 --2- 172.21.15.27:0/764135590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b01a50 0x560612b09a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.725+0000 7f5ff3fff640 0 client.25133 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.725+0000 7f601d5d9740 1 -- 172.21.15.27:0/764135590 >> 172.21.15.27:0/764135590 conn(0x560612afdfe0 msgr2=0x560612af4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:06.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.725+0000 7f601d5d9740 1 -- 172.21.15.27:0/764135590 shutdown_connections 2024-09-19T08:12:06.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.725+0000 7f601d5d9740 1 -- 172.21.15.27:0/764135590 wait complete. 2024-09-19T08:12:06.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.726+0000 7f601d5d9740 20 client.25133 trim_cache size 0 max 16384 2024-09-19T08:12:06.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.760+0000 7f601d5d9740 1 Processor -- start 2024-09-19T08:12:06.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.760+0000 7f601d5d9740 1 -- start start 2024-09-19T08:12:06.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.760+0000 7f601d5d9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b01a50 0x560612af4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:06.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.760+0000 7f601d5d9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b02370 0x560612b24340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:06.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.760+0000 7f601d5d9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b0cc30 0x560612b24880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:06.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.760+0000 7f6018f9c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b01a50 0x560612af4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:06.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.760+0000 7f6013fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b02370 0x560612b24340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:06.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.760+0000 7f6018f9c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b01a50 0x560612af4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.27:43466/0 (socket says 172.21.15.27:43466) 2024-09-19T08:12:06.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.760+0000 7f6013fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b02370 0x560612b24340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.27:51522/0 (socket says 172.21.15.27:51522) 2024-09-19T08:12:06.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.760+0000 7f601979d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b0cc30 0x560612b24880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:06.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.760+0000 7f601979d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b0cc30 0x560612b24880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33084/0 (socket says 172.21.15.27:33084) 2024-09-19T08:12:06.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.760+0000 7f6018f9c640 1 -- 172.21.15.27:0/223697582 learned_addr learned my addr 172.21.15.27:0/223697582 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:06.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.760+0000 7f601d5d9740 1 -- 172.21.15.27:0/223697582 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f60141a9450 con 0x560612b0cc30 2024-09-19T08:12:06.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.760+0000 7f601d5d9740 1 -- 172.21.15.27:0/223697582 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f60141abc70 con 0x560612b01a50 2024-09-19T08:12:06.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.760+0000 7f601d5d9740 1 -- 172.21.15.27:0/223697582 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f60141a9aa0 con 0x560612b02370 2024-09-19T08:12:06.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.761+0000 7f6013fff640 1 -- 172.21.15.27:0/223697582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b01a50 msgr2=0x560612af4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:06.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.761+0000 7f6013fff640 1 --2- 172.21.15.27:0/223697582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b01a50 0x560612af4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.761+0000 7f6013fff640 1 -- 172.21.15.27:0/223697582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b0cc30 msgr2=0x560612b24880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:06.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.761+0000 7f6013fff640 1 --2- 172.21.15.27:0/223697582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b0cc30 0x560612b24880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.761+0000 7f6013fff640 1 -- 172.21.15.27:0/223697582 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560612b021a0 con 0x560612b02370 2024-09-19T08:12:06.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.761+0000 7f601979d640 1 --2- 172.21.15.27:0/223697582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b0cc30 0x560612b24880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:12:06.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.761+0000 7f6013fff640 1 --2- 172.21.15.27:0/223697582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b02370 0x560612b24340 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x560612b0b0a0 tx=0x7f6000003770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99a5565c04fe73bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:06.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.761+0000 7f5ffe7fc640 1 -- 172.21.15.27:0/223697582 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000035040 con 0x560612b02370 2024-09-19T08:12:06.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.762+0000 7f5ffe7fc640 1 -- 172.21.15.27:0/223697582 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6000004760 con 0x560612b02370 2024-09-19T08:12:06.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.762+0000 7f5ffe7fc640 1 -- 172.21.15.27:0/223697582 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000031810 con 0x560612b02370 2024-09-19T08:12:06.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.762+0000 7f601d5d9740 1 -- 172.21.15.27:0/223697582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b02370 msgr2=0x560612b24340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:06.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.762+0000 7f601d5d9740 1 --2- 172.21.15.27:0/223697582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b02370 0x560612b24340 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x560612b0b0a0 tx=0x7f6000003770 comp rx=0 tx=0).stop 2024-09-19T08:12:06.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.763+0000 7f601d5d9740 1 -- 172.21.15.27:0/223697582 shutdown_connections 2024-09-19T08:12:06.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.763+0000 7f601d5d9740 1 --2- 172.21.15.27:0/223697582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b0cc30 0x560612b24880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.763+0000 7f601d5d9740 1 --2- 172.21.15.27:0/223697582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b02370 0x560612b24340 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.763+0000 7f601d5d9740 1 --2- 172.21.15.27:0/223697582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b01a50 0x560612af4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.763+0000 7f601d5d9740 1 -- 172.21.15.27:0/223697582 >> 172.21.15.27:0/223697582 conn(0x560612afdfe0 msgr2=0x560612af4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:06.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.763+0000 7f601d5d9740 1 -- 172.21.15.27:0/223697582 shutdown_connections 2024-09-19T08:12:06.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.763+0000 7f601d5d9740 1 -- 172.21.15.27:0/223697582 wait complete. 2024-09-19T08:12:06.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.763+0000 7f601d5d9740 1 -- start start 2024-09-19T08:12:06.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.763+0000 7f601d5d9740 1 Processor -- start 2024-09-19T08:12:06.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.764+0000 7f601d5d9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b01a50 0x560612b14dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:06.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.764+0000 7f601d5d9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b02370 0x560612b15300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:06.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.764+0000 7f601d5d9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b0cc30 0x560612b0fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:06.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.764+0000 7f601d5d9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f60141aa130 con 0x560612b02370 2024-09-19T08:12:06.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.764+0000 7f601d5d9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f60141ab5a0 con 0x560612b01a50 2024-09-19T08:12:06.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.764+0000 7f601d5d9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f60141aa800 con 0x560612b0cc30 2024-09-19T08:12:06.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.764+0000 7f601d5d9740 10 client.0 _ll_register_callbacks cb 0x7f600c012f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:12:06.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.764+0000 7f6018f9c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b01a50 0x560612b14dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:06.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.764+0000 7f6013fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b02370 0x560612b15300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:06.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.764+0000 7f6013fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b02370 0x560612b15300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33090/0 (socket says 172.21.15.27:33090) 2024-09-19T08:12:06.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.764+0000 7f6013fff640 1 -- 172.21.15.27:0/2072980234 learned_addr learned my addr 172.21.15.27:0/2072980234 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:06.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.764+0000 7f601979d640 1 --2- 172.21.15.27:0/2072980234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b0cc30 0x560612b0fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:06.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.765+0000 7f6013fff640 1 -- 172.21.15.27:0/2072980234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b0cc30 msgr2=0x560612b0fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.765+0000 7f6013fff640 1 --2- 172.21.15.27:0/2072980234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b0cc30 0x560612b0fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.765+0000 7f6013fff640 1 -- 172.21.15.27:0/2072980234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b01a50 msgr2=0x560612b14dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.765+0000 7f6013fff640 1 --2- 172.21.15.27:0/2072980234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b01a50 0x560612b14dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.765+0000 7f6013fff640 1 -- 172.21.15.27:0/2072980234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560612b10220 con 0x560612b02370 2024-09-19T08:12:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.765+0000 7f6013fff640 1 --2- 172.21.15.27:0/2072980234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b02370 0x560612b15300 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f600003f040 tx=0x7f6000005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9a32d7609abfad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.765+0000 7f5ff3fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:12:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.765+0000 7f5ff3fff640 1 -- 172.21.15.27:0/2072980234 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000035070 con 0x560612b02370 2024-09-19T08:12:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.766+0000 7f5ff3fff640 1 -- 172.21.15.27:0/2072980234 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f6000003a80 con 0x560612b02370 2024-09-19T08:12:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.766+0000 7f601d5d9740 1 -- 172.21.15.27:0/2072980234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6000004760 con 0x560612b02370 2024-09-19T08:12:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.766+0000 7f5ff3fff640 1 -- 172.21.15.27:0/2072980234 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6000003c80 con 0x560612b02370 2024-09-19T08:12:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.766+0000 7f601d5d9740 10 client.15570 fetch_fsmap learned FSMap version 20 2024-09-19T08:12:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.766+0000 7f601d5d9740 1 -- 172.21.15.27:0/2072980234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560612afbb70 con 0x560612b02370 2024-09-19T08:12:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.766+0000 7f5ff3fff640 1 -- 172.21.15.27:0/2072980234 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6000004760 con 0x560612b02370 2024-09-19T08:12:06.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.767+0000 7f5ff3fff640 1 -- 172.21.15.27:0/2072980234 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6000067510 con 0x560612b02370 2024-09-19T08:12:06.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.767+0000 7f601d5d9740 10 client.15570 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:12:06.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.767+0000 7f601d5d9740 10 client.15570 resolve_mds: validated gid 24482 aka daemon mds.b 2024-09-19T08:12:06.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.767+0000 7f601d5d9740 20 client.15570 populate_metadata read hostname 'smithi027' 2024-09-19T08:12:06.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.767+0000 7f601d5d9740 1 --2- 172.21.15.27:0/2072980234 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560612afbe00 0x560612afc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:06.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.767+0000 7f601d5d9740 4 client.15570 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3e540564", "release": true, "await": true}] 2024-09-19T08:12:06.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.767+0000 7f601d5d9740 1 -- 172.21.15.27:0/2072980234 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3e540564", "release": true, "await": true}) -- 0x560612a660a0 con 0x560612afbe00 2024-09-19T08:12:06.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.768+0000 7f6018f9c640 1 --2- 172.21.15.27:0/2072980234 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560612afbe00 0x560612afc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:06.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.768+0000 7f5ff3fff640 10 client.15570 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:06.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.768+0000 7f6018f9c640 1 --2- 172.21.15.27:0/2072980234 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560612afbe00 0x560612afc210 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f97a7ef04c61950f server_cookie=51c2e32ddc978fc3 in_seq=0 out_seq=0 2024-09-19T08:12:06.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.770+0000 7f5ff3fff640 1 -- 172.21.15.27:0/2072980234 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x560612a660a0 con 0x560612afbe00 2024-09-19T08:12:06.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.770+0000 7f5ff3fff640 10 client.15570 handle_command_reply: tid=0 2024-09-19T08:12:06.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.770+0000 7f601d5d9740 1 client.15570 shutdown 2024-09-19T08:12:06.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.770+0000 7f601d5d9740 1 -- 172.21.15.27:0/2072980234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b02370 msgr2=0x560612b15300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:06.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.770+0000 7f601d5d9740 1 --2- 172.21.15.27:0/2072980234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b02370 0x560612b15300 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f600003f040 tx=0x7f6000005610 comp rx=0 tx=0).stop 2024-09-19T08:12:06.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.770+0000 7f601d5d9740 1 -- 172.21.15.27:0/2072980234 shutdown_connections 2024-09-19T08:12:06.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.770+0000 7f601d5d9740 1 --2- 172.21.15.27:0/2072980234 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560612afbe00 0x560612afc210 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.770+0000 7f601d5d9740 1 --2- 172.21.15.27:0/2072980234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560612b0cc30 0x560612b0fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.774 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:12:06.774 INFO:teuthology.orchestra.run.smithi027.stdout: "epoch": 20, 2024-09-19T08:12:06.775 INFO:teuthology.orchestra.run.smithi027.stdout: "leader": 24482, 2024-09-19T08:12:06.775 INFO:teuthology.orchestra.run.smithi027.stdout: "set_version": 4, 2024-09-19T08:12:06.775 INFO:teuthology.orchestra.run.smithi027.stdout: "sets": { 2024-09-19T08:12:06.775 INFO:teuthology.orchestra.run.smithi027.stdout: "3e540564": { 2024-09-19T08:12:06.775 INFO:teuthology.orchestra.run.smithi027.stdout: "version": 4, 2024-09-19T08:12:06.775 INFO:teuthology.orchestra.run.smithi027.stdout: "age_ref": 0.0, 2024-09-19T08:12:06.775 INFO:teuthology.orchestra.run.smithi027.stdout: "state": { 2024-09-19T08:12:06.775 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RELEASED", 2024-09-19T08:12:06.775 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0 2024-09-19T08:12:06.775 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:12:06.775 INFO:teuthology.orchestra.run.smithi027.stdout: "timeout": 90.0, 2024-09-19T08:12:06.775 INFO:teuthology.orchestra.run.smithi027.stdout: "expiration": 131.2, 2024-09-19T08:12:06.775 INFO:teuthology.orchestra.run.smithi027.stdout: "members": { 2024-09-19T08:12:06.775 INFO:teuthology.orchestra.run.smithi027.stdout: "file:/": { 2024-09-19T08:12:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: "excluded": false, 2024-09-19T08:12:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: "state": { 2024-09-19T08:12:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RELEASED", 2024-09-19T08:12:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0 2024-09-19T08:12:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:06.776 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:06.776 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:12:06.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.770+0000 7f601d5d9740 1 --2- 172.21.15.27:0/2072980234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560612b02370 0x560612b15300 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.770+0000 7f601d5d9740 1 --2- 172.21.15.27:0/2072980234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560612b01a50 0x560612b14dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.770+0000 7f601d5d9740 1 -- 172.21.15.27:0/2072980234 >> 172.21.15.27:0/2072980234 conn(0x560612afdfe0 msgr2=0x560612af4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:06.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.770+0000 7f5ff3fff640 0 client.15570 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:06.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.770+0000 7f601d5d9740 1 -- 172.21.15.27:0/2072980234 shutdown_connections 2024-09-19T08:12:06.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.770+0000 7f601d5d9740 1 -- 172.21.15.27:0/2072980234 wait complete. 2024-09-19T08:12:06.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.770+0000 7f601d5d9740 20 client.15570 trim_cache size 0 max 16384 2024-09-19T08:12:06.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.771+0000 7f6019f9e640 1 -- 172.21.15.27:0/2309597540 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f60040a3550 msgr2=0x7f60040a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:06.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.771+0000 7f6019f9e640 1 --2- 172.21.15.27:0/2309597540 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f60040a3550 0x7f60040a5a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f600c005fd0 tx=0x7f600c009a20 comp rx=0 tx=0).stop 2024-09-19T08:12:06.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.771+0000 7f6019f9e640 1 -- 172.21.15.27:0/2309597540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60141019c0 msgr2=0x7f60140744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:06.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.771+0000 7f6019f9e640 1 --2- 172.21.15.27:0/2309597540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60141019c0 0x7f60140744f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f600800c970 tx=0x7f600800ce30 comp rx=0 tx=0).stop 2024-09-19T08:12:06.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.771+0000 7f6019f9e640 1 -- 172.21.15.27:0/2309597540 shutdown_connections 2024-09-19T08:12:06.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.771+0000 7f6019f9e640 1 --2- 172.21.15.27:0/2309597540 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f60040a3550 0x7f60040a5a10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.771+0000 7f6019f9e640 1 --2- 172.21.15.27:0/2309597540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60141079c0 0x7f6014074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.771+0000 7f6019f9e640 1 --2- 172.21.15.27:0/2309597540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6014102360 0x7f6014074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.771+0000 7f6019f9e640 1 --2- 172.21.15.27:0/2309597540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60141019c0 0x7f60140744f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:06.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.771+0000 7f6019f9e640 1 -- 172.21.15.27:0/2309597540 >> 172.21.15.27:0/2309597540 conn(0x7f60140fd700 msgr2=0x7f60140fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:06.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.772+0000 7f6019f9e640 1 -- 172.21.15.27:0/2309597540 shutdown_connections 2024-09-19T08:12:06.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:06.773+0000 7f6019f9e640 1 -- 172.21.15.27:0/2309597540 wait complete. 2024-09-19T08:12:07.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:06 smithi027 ceph-mon[31209]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:12:07.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:06 smithi203 ceph-mon[35198]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:12:07.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:06 smithi155 ceph-mon[35362]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:12:07.507 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3e540564', total seconds elapsed: 19.0 2024-09-19T08:12:09.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:08 smithi027 ceph-mon[31209]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:12:09.257 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:08 smithi203 ceph-mon[35198]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:12:09.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:08 smithi155 ceph-mon[35362]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:12:10.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:10 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:12:10.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:10 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:12:10.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:10 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:12:10.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:10 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:12:10.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:10 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:12:10.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:10 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:12:10.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:10 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:12:10.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:10 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:12:10.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:10 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:12:10.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:10 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:12:10.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:10 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:12:10.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:10 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:12:10.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:10 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:12:10.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:10 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:12:10.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:10 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:12:10.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:10 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:12:10.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:10 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:12:10.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:10 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:12:10.492 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:12:10.870 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:12:11.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:11 smithi027 ceph-mon[31209]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:12:11.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:11 smithi203 ceph-mon[35198]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:12:11.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:11 smithi155 ceph-mon[35362]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:12:11.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.498+0000 7fa2d5e10640 1 -- 172.21.15.27:0/1334154687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2d0102570 msgr2=0x7fa2d01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:11.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.498+0000 7fa2d5e10640 1 --2- 172.21.15.27:0/1334154687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2d0102570 0x7fa2d01029b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4009900 tx=0x7fa2c402a480 comp rx=0 tx=0).stop 2024-09-19T08:12:11.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.498+0000 7fa2d5e10640 1 -- 172.21.15.27:0/1334154687 shutdown_connections 2024-09-19T08:12:11.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.498+0000 7fa2d5e10640 1 --2- 172.21.15.27:0/1334154687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2d0102ef0 0x7fa2d010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.498+0000 7fa2d5e10640 1 --2- 172.21.15.27:0/1334154687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2d0102570 0x7fa2d01029b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.498+0000 7fa2d5e10640 1 --2- 172.21.15.27:0/1334154687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2d0100e20 0x7fa2d0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.498+0000 7fa2d5e10640 1 -- 172.21.15.27:0/1334154687 >> 172.21.15.27:0/1334154687 conn(0x7fa2d00fc7d0 msgr2=0x7fa2d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:11.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.498+0000 7fa2d5e10640 1 -- 172.21.15.27:0/1334154687 shutdown_connections 2024-09-19T08:12:11.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.498+0000 7fa2d5e10640 1 -- 172.21.15.27:0/1334154687 wait complete. 2024-09-19T08:12:11.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.499+0000 7fa2d5e10640 1 Processor -- start 2024-09-19T08:12:11.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.499+0000 7fa2d5e10640 1 -- start start 2024-09-19T08:12:11.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.500+0000 7fa2d5e10640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2d0100e20 0x7fa2d01973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:11.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.500+0000 7fa2d5e10640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2d0102570 0x7fa2d0197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:11.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.500+0000 7fa2d5e10640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2d0102ef0 0x7fa2d019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:11.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.500+0000 7fa2d5e10640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d0110fa0 con 0x7fa2d0102ef0 2024-09-19T08:12:11.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.500+0000 7fa2d5e10640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d0110e20 con 0x7fa2d0100e20 2024-09-19T08:12:11.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.500+0000 7fa2d5e10640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d0111120 con 0x7fa2d0102570 2024-09-19T08:12:11.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.500+0000 7fa2ceffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2d0102570 0x7fa2d0197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:11.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.500+0000 7fa2cf7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2d0100e20 0x7fa2d01973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:11.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.500+0000 7fa2ceffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2d0102570 0x7fa2d0197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.27:56420/0 (socket says 172.21.15.27:56420) 2024-09-19T08:12:11.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.500+0000 7fa2ceffd640 1 -- 172.21.15.27:0/1181490102 learned_addr learned my addr 172.21.15.27:0/1181490102 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:11.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.501+0000 7fa2cffff640 1 --2- 172.21.15.27:0/1181490102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2d0102ef0 0x7fa2d019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:11.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.501+0000 7fa2ceffd640 1 -- 172.21.15.27:0/1181490102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2d0100e20 msgr2=0x7fa2d01973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:11.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.501+0000 7fa2ceffd640 1 --2- 172.21.15.27:0/1181490102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2d0100e20 0x7fa2d01973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.501+0000 7fa2ceffd640 1 -- 172.21.15.27:0/1181490102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2d0102ef0 msgr2=0x7fa2d019bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:11.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.501+0000 7fa2ceffd640 1 --2- 172.21.15.27:0/1181490102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2d0102ef0 0x7fa2d019bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.501+0000 7fa2ceffd640 1 -- 172.21.15.27:0/1181490102 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d019c390 con 0x7fa2d0102570 2024-09-19T08:12:11.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.501+0000 7fa2ceffd640 1 --2- 172.21.15.27:0/1181490102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2d0102570 0x7fa2d0197920 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa2c402aa70 tx=0x7fa2c4003ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:11.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.501+0000 7fa2ccff9640 1 -- 172.21.15.27:0/1181490102 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4035070 con 0x7fa2d0102570 2024-09-19T08:12:11.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.501+0000 7fa2d5e10640 1 -- 172.21.15.27:0/1181490102 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d019c620 con 0x7fa2d0102570 2024-09-19T08:12:11.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.501+0000 7fa2ccff9640 1 -- 172.21.15.27:0/1181490102 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2c4031a20 con 0x7fa2d0102570 2024-09-19T08:12:11.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.501+0000 7fa2ccff9640 1 -- 172.21.15.27:0/1181490102 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4038c90 con 0x7fa2d0102570 2024-09-19T08:12:11.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.501+0000 7fa2d5e10640 1 -- 172.21.15.27:0/1181490102 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d0069f70 con 0x7fa2d0102570 2024-09-19T08:12:11.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.505+0000 7fa2ccff9640 1 -- 172.21.15.27:0/1181490102 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7fa2c4031bd0 con 0x7fa2d0102570 2024-09-19T08:12:11.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.505+0000 7fa2d81e9740 1 Processor -- start 2024-09-19T08:12:11.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.505+0000 7fa2d81e9740 1 -- start start 2024-09-19T08:12:11.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.506+0000 7fa2d81e9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d2fb41a20 0x559d2fb40340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:11.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.506+0000 7fa2d81e9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb40880 0x559d2fb40cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:11.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.506+0000 7fa2d81e9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb53d20 0x559d2fb56110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:11.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.506+0000 7fa2d81e9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559d2faa62e0 con 0x559d2fb40880 2024-09-19T08:12:11.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.506+0000 7fa2d81e9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559d2fa4dce0 con 0x559d2fb53d20 2024-09-19T08:12:11.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.506+0000 7fa2d81e9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559d2faa22a0 con 0x559d2fb41a20 2024-09-19T08:12:11.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.506+0000 7fa2cf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb40880 0x559d2fb40cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:11.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.506+0000 7fa2cf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb40880 0x559d2fb40cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35338/0 (socket says 172.21.15.27:35338) 2024-09-19T08:12:11.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.506+0000 7fa2cf7fe640 1 -- 172.21.15.27:0/1887528205 learned_addr learned my addr 172.21.15.27:0/1887528205 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:11.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.506+0000 7fa2ccff9640 1 --2- 172.21.15.27:0/1181490102 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa2b80a3550 0x7fa2b80a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:11.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.506+0000 7fa2cf7fe640 1 -- 172.21.15.27:0/1887528205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d2fb41a20 msgr2=0x559d2fb40340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:12:11.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.506+0000 7fa2cf7fe640 1 --2- 172.21.15.27:0/1887528205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d2fb41a20 0x559d2fb40340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.506+0000 7fa2cf7fe640 1 -- 172.21.15.27:0/1887528205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb53d20 msgr2=0x559d2fb56110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:11.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.506+0000 7fa2ceffd640 1 --2- 172.21.15.27:0/1887528205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb53d20 0x559d2fb56110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:11.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.506+0000 7fa2cf7fe640 1 --2- 172.21.15.27:0/1887528205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb53d20 0x559d2fb56110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.506+0000 7fa2cf7fe640 1 -- 172.21.15.27:0/1887528205 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d2fa32440 con 0x559d2fb40880 2024-09-19T08:12:11.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.507+0000 7fa2ceffd640 1 --2- 172.21.15.27:0/1887528205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb53d20 0x559d2fb56110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:12:11.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.507+0000 7fa2cf7fe640 1 --2- 172.21.15.27:0/1887528205 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb40880 0x559d2fb40cc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000bd10 tx=0x7fa2c000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3363e448f93b84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:11.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.507+0000 7fa2cffff640 1 --2- 172.21.15.27:0/1181490102 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa2b80a3550 0x7fa2b80a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:11.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.507+0000 7fa2b5ffb640 1 -- 172.21.15.27:0/1887528205 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0015070 con 0x559d2fb40880 2024-09-19T08:12:11.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.507+0000 7fa2b5ffb640 1 -- 172.21.15.27:0/1887528205 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2c0011920 con 0x559d2fb40880 2024-09-19T08:12:11.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.507+0000 7fa2b5ffb640 1 -- 172.21.15.27:0/1887528205 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c00109c0 con 0x559d2fb40880 2024-09-19T08:12:11.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.507+0000 7fa2ccff9640 1 -- 172.21.15.27:0/1181490102 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fa2c40f1e60 con 0x7fa2d0102570 2024-09-19T08:12:11.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.508+0000 7fa2d81e9740 1 -- 172.21.15.27:0/1887528205 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb40880 msgr2=0x559d2fb40cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:11.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.508+0000 7fa2d81e9740 1 --2- 172.21.15.27:0/1887528205 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb40880 0x559d2fb40cc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000bd10 tx=0x7fa2c000f730 comp rx=0 tx=0).stop 2024-09-19T08:12:11.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.508+0000 7fa2d81e9740 1 -- 172.21.15.27:0/1887528205 shutdown_connections 2024-09-19T08:12:11.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.508+0000 7fa2d81e9740 1 --2- 172.21.15.27:0/1887528205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb53d20 0x559d2fb56110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.508+0000 7fa2d81e9740 1 --2- 172.21.15.27:0/1887528205 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb40880 0x559d2fb40cc0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.508+0000 7fa2d81e9740 1 --2- 172.21.15.27:0/1887528205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d2fb41a20 0x559d2fb40340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.508+0000 7fa2d81e9740 1 -- 172.21.15.27:0/1887528205 >> 172.21.15.27:0/1887528205 conn(0x559d2fb3ca30 msgr2=0x559d2fb3ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:11.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.509+0000 7fa2cffff640 1 --2- 172.21.15.27:0/1181490102 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa2b80a3550 0x7fa2b80a5a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8005fd0 tx=0x7fa2c8009600 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:11.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.509+0000 7fa2d81e9740 1 -- 172.21.15.27:0/1887528205 shutdown_connections 2024-09-19T08:12:11.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.509+0000 7fa2d81e9740 1 -- 172.21.15.27:0/1887528205 wait complete. 2024-09-19T08:12:11.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.509+0000 7fa2d81e9740 1 -- start start 2024-09-19T08:12:11.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.510+0000 7fa2d81e9740 1 Processor -- start 2024-09-19T08:12:11.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.510+0000 7fa2d81e9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb40880 0x559d2fb46c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:11.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.510+0000 7fa2d81e9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d2fb41a20 0x559d2fb43ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:11.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.510+0000 7fa2d81e9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb53d20 0x559d2fb44610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:11.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.510+0000 7fa2d81e9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559d2fb56a50 con 0x559d2fb53d20 2024-09-19T08:12:11.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.511+0000 7fa2d81e9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559d2fa61050 con 0x559d2fb40880 2024-09-19T08:12:11.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.511+0000 7fa2cf7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb40880 0x559d2fb46c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:11.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.511+0000 7fa2cf7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb40880 0x559d2fb46c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.27:60396/0 (socket says 172.21.15.27:60396) 2024-09-19T08:12:11.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.511+0000 7fa2cf7fe640 1 -- 172.21.15.27:0/433792719 learned_addr learned my addr 172.21.15.27:0/433792719 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:11.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.511+0000 7fa2ceffd640 1 --2- 172.21.15.27:0/433792719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d2fb41a20 0x559d2fb43ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:11.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.511+0000 7fa2d81e9740 1 -- 172.21.15.27:0/433792719 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559d2fb56bd0 con 0x559d2fb41a20 2024-09-19T08:12:11.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.511+0000 7fa2d81e9740 10 client.0 _ll_register_callbacks cb 0x559d2faa1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:12:11.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.511+0000 7fa2ceffd640 1 -- 172.21.15.27:0/433792719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb40880 msgr2=0x559d2fb46c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:11.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.511+0000 7fa2ceffd640 1 --2- 172.21.15.27:0/433792719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb40880 0x559d2fb46c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.511+0000 7fa2ceffd640 1 -- 172.21.15.27:0/433792719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb53d20 msgr2=0x559d2fb44610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:12:11.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.511+0000 7fa2cffff640 1 --2- 172.21.15.27:0/433792719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb53d20 0x559d2fb44610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:11.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.512+0000 7fa2ceffd640 1 --2- 172.21.15.27:0/433792719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb53d20 0x559d2fb44610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.512+0000 7fa2ceffd640 1 -- 172.21.15.27:0/433792719 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d2f8173c0 con 0x559d2fb41a20 2024-09-19T08:12:11.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.512+0000 7fa2cffff640 1 --2- 172.21.15.27:0/433792719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb53d20 0x559d2fb44610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:12:11.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.512+0000 7fa2ceffd640 1 --2- 172.21.15.27:0/433792719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d2fb41a20 0x559d2fb43ed0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40ef480 tx=0x7fa2c40bdf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e53ad7b95f6fa9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:11.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.512+0000 7fa2aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T08:12:11.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.512+0000 7fa2aeffd640 1 -- 172.21.15.27:0/433792719 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c40be710 con 0x559d2fb41a20 2024-09-19T08:12:11.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.512+0000 7fa2d81e9740 1 -- 172.21.15.27:0/433792719 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2c0011920 con 0x559d2fb41a20 2024-09-19T08:12:11.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.512+0000 7fa2aeffd640 1 -- 172.21.15.27:0/433792719 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fa2c40be270 con 0x559d2fb41a20 2024-09-19T08:12:11.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.512+0000 7fa2aeffd640 1 -- 172.21.15.27:0/433792719 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa2c40c6c80 con 0x559d2fb41a20 2024-09-19T08:12:11.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.512+0000 7fa2d81e9740 10 client.25183 fetch_fsmap learned FSMap version 20 2024-09-19T08:12:11.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.513+0000 7fa2d81e9740 1 -- 172.21.15.27:0/433792719 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559d2fb56a50 con 0x559d2fb41a20 2024-09-19T08:12:11.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.513+0000 7fa2aeffd640 1 -- 172.21.15.27:0/433792719 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2c40be010 con 0x559d2fb41a20 2024-09-19T08:12:11.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.513+0000 7fa2aeffd640 1 -- 172.21.15.27:0/433792719 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa2c40ef760 con 0x559d2fb41a20 2024-09-19T08:12:11.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.513+0000 7fa2d81e9740 10 client.25183 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:12:11.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.513+0000 7fa2d81e9740 10 client.25183 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:12:11.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.513+0000 7fa2d81e9740 20 client.25183 populate_metadata read hostname 'smithi027' 2024-09-19T08:12:11.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.513+0000 7fa2d81e9740 1 --2- 172.21.15.27:0/433792719 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559d2fb638f0 0x559d2fb65d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:11.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.513+0000 7fa2d81e9740 4 client.25183 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:12:11.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.513+0000 7fa2d81e9740 1 -- 172.21.15.27:0/433792719 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa2c0011920 con 0x559d2fb638f0 2024-09-19T08:12:11.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.513+0000 7fa2cf7fe640 1 --2- 172.21.15.27:0/433792719 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559d2fb638f0 0x559d2fb65d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:11.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.514+0000 7fa2cf7fe640 1 --2- 172.21.15.27:0/433792719 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559d2fb638f0 0x559d2fb65d30 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12acfea36c4f9a92 server_cookie=63ee511ad665afe8 in_seq=0 out_seq=0 2024-09-19T08:12:11.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.514+0000 7fa2aeffd640 10 client.25183 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:11.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.515+0000 7fa2aeffd640 1 -- 172.21.15.27:0/433792719 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fa2c0011920 con 0x559d2fb638f0 2024-09-19T08:12:11.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.515+0000 7fa2aeffd640 10 client.25183 handle_command_reply: tid=0 2024-09-19T08:12:11.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.515+0000 7fa2d81e9740 1 client.25183 shutdown 2024-09-19T08:12:11.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.515+0000 7fa2d81e9740 1 -- 172.21.15.27:0/433792719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d2fb41a20 msgr2=0x559d2fb43ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:11.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.515+0000 7fa2d81e9740 1 --2- 172.21.15.27:0/433792719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d2fb41a20 0x559d2fb43ed0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40ef480 tx=0x7fa2c40bdf10 comp rx=0 tx=0).stop 2024-09-19T08:12:11.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.515+0000 7fa2d81e9740 1 -- 172.21.15.27:0/433792719 shutdown_connections 2024-09-19T08:12:11.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.515+0000 7fa2d81e9740 1 --2- 172.21.15.27:0/433792719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb53d20 0x559d2fb44610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.515+0000 7fa2d81e9740 1 --2- 172.21.15.27:0/433792719 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559d2fb638f0 0x559d2fb65d30 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.515+0000 7fa2d81e9740 1 --2- 172.21.15.27:0/433792719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d2fb41a20 0x559d2fb43ed0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.515+0000 7fa2d81e9740 1 --2- 172.21.15.27:0/433792719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb40880 0x559d2fb46c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.515+0000 7fa2d81e9740 1 -- 172.21.15.27:0/433792719 >> 172.21.15.27:0/433792719 conn(0x559d2fb3ca30 msgr2=0x559d2fb42750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:11.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.515+0000 7fa2aeffd640 0 client.25183 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:11.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.515+0000 7fa2d81e9740 1 -- 172.21.15.27:0/433792719 shutdown_connections 2024-09-19T08:12:11.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.515+0000 7fa2d81e9740 1 -- 172.21.15.27:0/433792719 wait complete. 2024-09-19T08:12:11.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.516+0000 7fa2d81e9740 20 client.25183 trim_cache size 0 max 16384 2024-09-19T08:12:11.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.550+0000 7fa2d81e9740 1 Processor -- start 2024-09-19T08:12:11.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.550+0000 7fa2d81e9740 1 -- start start 2024-09-19T08:12:11.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.550+0000 7fa2d81e9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb40880 0x559d2fb5fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:11.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.550+0000 7fa2d81e9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb41a20 0x559d2fb4fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:11.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.550+0000 7fa2d81e9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d2fb53d20 0x559d2fb532b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:11.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.550+0000 7fa2d81e9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d01a94d0 con 0x559d2fb41a20 2024-09-19T08:12:11.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.550+0000 7fa2d81e9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d01abd50 con 0x559d2fb40880 2024-09-19T08:12:11.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.550+0000 7fa2d81e9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d01a9b40 con 0x559d2fb53d20 2024-09-19T08:12:11.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.550+0000 7fa2ceffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb41a20 0x559d2fb4fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:11.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.550+0000 7fa2ceffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb41a20 0x559d2fb4fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35356/0 (socket says 172.21.15.27:35356) 2024-09-19T08:12:11.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.550+0000 7fa2ceffd640 1 -- 172.21.15.27:0/870604080 learned_addr learned my addr 172.21.15.27:0/870604080 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:11.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.551+0000 7fa2cf7fe640 1 --2- 172.21.15.27:0/870604080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb40880 0x559d2fb5fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:11.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.551+0000 7fa2ceffd640 1 -- 172.21.15.27:0/870604080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d2fb53d20 msgr2=0x559d2fb532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:11.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.551+0000 7fa2ceffd640 1 --2- 172.21.15.27:0/870604080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d2fb53d20 0x559d2fb532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.551+0000 7fa2ceffd640 1 -- 172.21.15.27:0/870604080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb40880 msgr2=0x559d2fb5fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:11.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.551+0000 7fa2ceffd640 1 --2- 172.21.15.27:0/870604080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb40880 0x559d2fb5fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.551+0000 7fa2ceffd640 1 -- 172.21.15.27:0/870604080 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d2fb41290 con 0x559d2fb41a20 2024-09-19T08:12:11.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.551+0000 7fa2ceffd640 1 --2- 172.21.15.27:0/870604080 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb41a20 0x559d2fb4fd00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40ef590 tx=0x7fa2c40bc520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68aa7bf5feb86ab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:11.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.551+0000 7fa2b57fa640 1 -- 172.21.15.27:0/870604080 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c40bd970 con 0x559d2fb41a20 2024-09-19T08:12:11.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.551+0000 7fa2b57fa640 1 -- 172.21.15.27:0/870604080 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2c40de0e0 con 0x559d2fb41a20 2024-09-19T08:12:11.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.551+0000 7fa2b57fa640 1 -- 172.21.15.27:0/870604080 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c40be270 con 0x559d2fb41a20 2024-09-19T08:12:11.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.552+0000 7fa2d81e9740 1 -- 172.21.15.27:0/870604080 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb41a20 msgr2=0x559d2fb4fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:11.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.552+0000 7fa2d81e9740 1 --2- 172.21.15.27:0/870604080 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb41a20 0x559d2fb4fd00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40ef590 tx=0x7fa2c40bc520 comp rx=0 tx=0).stop 2024-09-19T08:12:11.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.552+0000 7fa2d81e9740 1 -- 172.21.15.27:0/870604080 shutdown_connections 2024-09-19T08:12:11.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.552+0000 7fa2d81e9740 1 --2- 172.21.15.27:0/870604080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d2fb53d20 0x559d2fb532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.552+0000 7fa2d81e9740 1 --2- 172.21.15.27:0/870604080 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb41a20 0x559d2fb4fd00 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.552+0000 7fa2d81e9740 1 --2- 172.21.15.27:0/870604080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb40880 0x559d2fb5fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.552+0000 7fa2d81e9740 1 -- 172.21.15.27:0/870604080 >> 172.21.15.27:0/870604080 conn(0x559d2fb3ca30 msgr2=0x559d2fb55f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.553+0000 7fa2d81e9740 1 -- 172.21.15.27:0/870604080 shutdown_connections 2024-09-19T08:12:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.553+0000 7fa2d81e9740 1 -- 172.21.15.27:0/870604080 wait complete. 2024-09-19T08:12:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.553+0000 7fa2d81e9740 1 -- start start 2024-09-19T08:12:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.553+0000 7fa2d81e9740 1 Processor -- start 2024-09-19T08:12:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.554+0000 7fa2d81e9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb40880 0x559d2fb5be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.554+0000 7fa2d81e9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb41a20 0x559d2fb5c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.554+0000 7fa2d81e9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d2fb53d20 0x559d2fb51490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.554+0000 7fa2d81e9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d01aa210 con 0x559d2fb40880 2024-09-19T08:12:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.554+0000 7fa2d81e9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d01ab680 con 0x559d2fb41a20 2024-09-19T08:12:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.554+0000 7fa2d81e9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d01aa8e0 con 0x559d2fb53d20 2024-09-19T08:12:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.554+0000 7fa2d81e9740 10 client.0 _ll_register_callbacks cb 0x7fa2c40ba380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:12:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.554+0000 7fa2cf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb40880 0x559d2fb5be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.554+0000 7fa2cf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb40880 0x559d2fb5be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35372/0 (socket says 172.21.15.27:35372) 2024-09-19T08:12:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.554+0000 7fa2cf7fe640 1 -- 172.21.15.27:0/1753758124 learned_addr learned my addr 172.21.15.27:0/1753758124 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.554+0000 7fa2cffff640 1 --2- 172.21.15.27:0/1753758124 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d2fb53d20 0x559d2fb51490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.554+0000 7fa2ceffd640 1 --2- 172.21.15.27:0/1753758124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb41a20 0x559d2fb5c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.554+0000 7fa2cf7fe640 1 -- 172.21.15.27:0/1753758124 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d2fb53d20 msgr2=0x559d2fb51490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.554+0000 7fa2cf7fe640 1 --2- 172.21.15.27:0/1753758124 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d2fb53d20 0x559d2fb51490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.554+0000 7fa2cf7fe640 1 -- 172.21.15.27:0/1753758124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb41a20 msgr2=0x559d2fb5c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.554+0000 7fa2cf7fe640 1 --2- 172.21.15.27:0/1753758124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb41a20 0x559d2fb5c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.555+0000 7fa2cf7fe640 1 -- 172.21.15.27:0/1753758124 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d2fb52a20 con 0x559d2fb40880 2024-09-19T08:12:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.555+0000 7fa2cf7fe640 1 --2- 172.21.15.27:0/1753758124 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb40880 0x559d2fb5be60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0014040 tx=0x7fa2c0010500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2a16d963dc44e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.555+0000 7fa2aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:12:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.555+0000 7fa2aeffd640 1 -- 172.21.15.27:0/1753758124 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0015070 con 0x559d2fb40880 2024-09-19T08:12:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.555+0000 7fa2d81e9740 1 -- 172.21.15.27:0/1753758124 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2c40de0e0 con 0x559d2fb40880 2024-09-19T08:12:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.555+0000 7fa2aeffd640 1 -- 172.21.15.27:0/1753758124 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fa2c0005040 con 0x559d2fb40880 2024-09-19T08:12:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.555+0000 7fa2aeffd640 1 -- 172.21.15.27:0/1753758124 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa2c0033020 con 0x559d2fb40880 2024-09-19T08:12:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.555+0000 7fa2d81e9740 10 client.15585 fetch_fsmap learned FSMap version 20 2024-09-19T08:12:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.555+0000 7fa2d81e9740 1 -- 172.21.15.27:0/1753758124 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559d2fbceac0 con 0x559d2fb40880 2024-09-19T08:12:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.556+0000 7fa2aeffd640 1 -- 172.21.15.27:0/1753758124 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2c40de0e0 con 0x559d2fb40880 2024-09-19T08:12:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.556+0000 7fa2aeffd640 1 -- 172.21.15.27:0/1753758124 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa2c00035f0 con 0x559d2fb40880 2024-09-19T08:12:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.556+0000 7fa2d81e9740 10 client.15585 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:12:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.556+0000 7fa2d81e9740 10 client.15585 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:12:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.556+0000 7fa2d81e9740 20 client.15585 populate_metadata read hostname 'smithi027' 2024-09-19T08:12:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.556+0000 7fa2d81e9740 1 --2- 172.21.15.27:0/1753758124 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559d2fbceee0 0x559d2fbd1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.556+0000 7fa2d81e9740 4 client.15585 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:12:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.556+0000 7fa2d81e9740 1 -- 172.21.15.27:0/1753758124 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559d2fab3850 con 0x559d2fbceee0 2024-09-19T08:12:11.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.556+0000 7fa2ceffd640 1 --2- 172.21.15.27:0/1753758124 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559d2fbceee0 0x559d2fbd1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:11.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.557+0000 7fa2aeffd640 10 client.15585 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:11.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.557+0000 7fa2ceffd640 1 --2- 172.21.15.27:0/1753758124 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559d2fbceee0 0x559d2fbd1300 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bedb1182454ba82f server_cookie=cacb574aac75bb8a in_seq=0 out_seq=0 2024-09-19T08:12:11.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.557+0000 7fa2aeffd640 1 -- 172.21.15.27:0/1753758124 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559d2fab3850 con 0x559d2fbceee0 2024-09-19T08:12:11.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.557+0000 7fa2aeffd640 10 client.15585 handle_command_reply: tid=0 2024-09-19T08:12:11.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.557+0000 7fa2d81e9740 1 client.15585 shutdown 2024-09-19T08:12:11.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.557+0000 7fa2d81e9740 1 -- 172.21.15.27:0/1753758124 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb40880 msgr2=0x559d2fb5be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:11.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.557+0000 7fa2d81e9740 1 --2- 172.21.15.27:0/1753758124 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb40880 0x559d2fb5be60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0014040 tx=0x7fa2c0010500 comp rx=0 tx=0).stop 2024-09-19T08:12:11.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.557+0000 7fa2d81e9740 1 -- 172.21.15.27:0/1753758124 shutdown_connections 2024-09-19T08:12:11.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.557+0000 7fa2d81e9740 1 --2- 172.21.15.27:0/1753758124 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559d2fbceee0 0x559d2fbd1300 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.563 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:12:11.563 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:12:11.563 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:12:11.563 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:12:11.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.557+0000 7fa2d81e9740 1 --2- 172.21.15.27:0/1753758124 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d2fb53d20 0x559d2fb51490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.557+0000 7fa2d81e9740 1 --2- 172.21.15.27:0/1753758124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d2fb41a20 0x559d2fb5c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.557+0000 7fa2aeffd640 0 client.15585 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.557+0000 7fa2d81e9740 1 --2- 172.21.15.27:0/1753758124 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d2fb40880 0x559d2fb5be60 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.557+0000 7fa2d81e9740 1 -- 172.21.15.27:0/1753758124 >> 172.21.15.27:0/1753758124 conn(0x559d2fb3ca30 msgr2=0x559d2fb55630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.558+0000 7fa2d81e9740 1 -- 172.21.15.27:0/1753758124 shutdown_connections 2024-09-19T08:12:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.558+0000 7fa2d81e9740 1 -- 172.21.15.27:0/1753758124 wait complete. 2024-09-19T08:12:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.558+0000 7fa2d81e9740 20 client.15585 trim_cache size 0 max 16384 2024-09-19T08:12:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.558+0000 7fa2d5e10640 1 -- 172.21.15.27:0/1181490102 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa2b80a3550 msgr2=0x7fa2b80a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.558+0000 7fa2d5e10640 1 --2- 172.21.15.27:0/1181490102 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa2b80a3550 0x7fa2b80a5a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8005fd0 tx=0x7fa2c8009600 comp rx=0 tx=0).stop 2024-09-19T08:12:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.559+0000 7fa2d5e10640 1 -- 172.21.15.27:0/1181490102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2d0102570 msgr2=0x7fa2d0197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.559+0000 7fa2d5e10640 1 --2- 172.21.15.27:0/1181490102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2d0102570 0x7fa2d0197920 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa2c402aa70 tx=0x7fa2c4003ae0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.559+0000 7fa2d5e10640 1 -- 172.21.15.27:0/1181490102 shutdown_connections 2024-09-19T08:12:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.559+0000 7fa2d5e10640 1 --2- 172.21.15.27:0/1181490102 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa2b80a3550 0x7fa2b80a5a10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.559+0000 7fa2d5e10640 1 --2- 172.21.15.27:0/1181490102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2d0102ef0 0x7fa2d019bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.559+0000 7fa2d5e10640 1 --2- 172.21.15.27:0/1181490102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2d0102570 0x7fa2d0197920 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.559+0000 7fa2d5e10640 1 --2- 172.21.15.27:0/1181490102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2d0100e20 0x7fa2d01973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:11.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.559+0000 7fa2d5e10640 1 -- 172.21.15.27:0/1181490102 >> 172.21.15.27:0/1181490102 conn(0x7fa2d00fc7d0 msgr2=0x7fa2d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:11.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.559+0000 7fa2d5e10640 1 -- 172.21.15.27:0/1181490102 shutdown_connections 2024-09-19T08:12:11.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:11.559+0000 7fa2d5e10640 1 -- 172.21.15.27:0/1181490102 wait complete. 2024-09-19T08:12:12.391 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:12:12.391 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:12:12.669 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:12:13.091 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:13 smithi027 ceph-mon[31209]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:12:13.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.214+0000 7f29d359e640 1 -- 172.21.15.27:0/2490327295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29d41019d0 msgr2=0x7f29d4101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:13.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.214+0000 7f29d359e640 1 --2- 172.21.15.27:0/2490327295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29d41019d0 0x7f29d4101e30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f29c8009930 tx=0x7f29c802a420 comp rx=0 tx=0).stop 2024-09-19T08:12:13.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.214+0000 7f29d359e640 1 -- 172.21.15.27:0/2490327295 shutdown_connections 2024-09-19T08:12:13.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.214+0000 7f29d359e640 1 --2- 172.21.15.27:0/2490327295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29d4102370 0x7f29d410e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:13.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.214+0000 7f29d359e640 1 --2- 172.21.15.27:0/2490327295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29d41019d0 0x7f29d4101e30 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:13.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.214+0000 7f29d359e640 1 --2- 172.21.15.27:0/2490327295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29d41079d0 0x7f29d4107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:13.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.214+0000 7f29d359e640 1 -- 172.21.15.27:0/2490327295 >> 172.21.15.27:0/2490327295 conn(0x7f29d40fd710 msgr2=0x7f29d40ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:13.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.214+0000 7f29d359e640 1 -- 172.21.15.27:0/2490327295 shutdown_connections 2024-09-19T08:12:13.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.214+0000 7f29d359e640 1 -- 172.21.15.27:0/2490327295 wait complete. 2024-09-19T08:12:13.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.215+0000 7f29d359e640 1 Processor -- start 2024-09-19T08:12:13.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.216+0000 7f29d359e640 1 -- start start 2024-09-19T08:12:13.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.216+0000 7f29d359e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29d41019d0 0x7f29d40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:13.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.216+0000 7f29d359e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29d4102370 0x7f29d4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:13.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.216+0000 7f29d359e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29d41079d0 0x7f29d4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:13.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.216+0000 7f29d359e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f29d4111de0 con 0x7f29d41079d0 2024-09-19T08:12:13.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.216+0000 7f29d359e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f29d4111c60 con 0x7f29d4102370 2024-09-19T08:12:13.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.216+0000 7f29d359e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f29d4111f60 con 0x7f29d41019d0 2024-09-19T08:12:13.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.216+0000 7f29d1d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29d4102370 0x7f29d4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:13.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.216+0000 7f29d1d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29d4102370 0x7f29d4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.27:60430/0 (socket says 172.21.15.27:60430) 2024-09-19T08:12:13.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.216+0000 7f29d1d9b640 1 -- 172.21.15.27:0/1236797308 learned_addr learned my addr 172.21.15.27:0/1236797308 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:13.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.216+0000 7f29d259c640 1 --2- 172.21.15.27:0/1236797308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29d41019d0 0x7f29d40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:13.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.217+0000 7f29d2d9d640 1 --2- 172.21.15.27:0/1236797308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29d41079d0 0x7f29d4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:13.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.217+0000 7f29d1d9b640 1 -- 172.21.15.27:0/1236797308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29d41019d0 msgr2=0x7f29d40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:13.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.217+0000 7f29d1d9b640 1 --2- 172.21.15.27:0/1236797308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29d41019d0 0x7f29d40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:13.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.217+0000 7f29d1d9b640 1 -- 172.21.15.27:0/1236797308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29d41079d0 msgr2=0x7f29d4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:13.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.217+0000 7f29d1d9b640 1 --2- 172.21.15.27:0/1236797308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29d41079d0 0x7f29d4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:13.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.217+0000 7f29d1d9b640 1 -- 172.21.15.27:0/1236797308 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d41a67a0 con 0x7f29d4102370 2024-09-19T08:12:13.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.217+0000 7f29d2d9d640 1 --2- 172.21.15.27:0/1236797308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29d41079d0 0x7f29d4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:12:13.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.217+0000 7f29d1d9b640 1 --2- 172.21.15.27:0/1236797308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29d4102370 0x7f29d4074a30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f29c802a940 tx=0x7f29c8003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:13.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.217+0000 7f29c37fe640 1 -- 172.21.15.27:0/1236797308 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c803f070 con 0x7f29d4102370 2024-09-19T08:12:13.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.217+0000 7f29c37fe640 1 -- 172.21.15.27:0/1236797308 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29c8031c90 con 0x7f29d4102370 2024-09-19T08:12:13.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.217+0000 7f29c37fe640 1 -- 172.21.15.27:0/1236797308 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8035030 con 0x7f29d4102370 2024-09-19T08:12:13.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.217+0000 7f29d359e640 1 -- 172.21.15.27:0/1236797308 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d41a6a30 con 0x7f29d4102370 2024-09-19T08:12:13.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.218+0000 7f29d359e640 1 -- 172.21.15.27:0/1236797308 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d41a6ec0 con 0x7f29d4102370 2024-09-19T08:12:13.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.219+0000 7f29d359e640 1 -- 172.21.15.27:0/1236797308 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29d4101e30 con 0x7f29d4102370 2024-09-19T08:12:13.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.221+0000 7f29c37fe640 1 -- 172.21.15.27:0/1236797308 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7f29c8042070 con 0x7f29d4102370 2024-09-19T08:12:13.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.222+0000 7f29c37fe640 1 --2- 172.21.15.27:0/1236797308 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f29bc0a34d0 0x7f29bc0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:13.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.222+0000 7f29d259c640 1 --2- 172.21.15.27:0/1236797308 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f29bc0a34d0 0x7f29bc0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:13.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.222+0000 7f29c37fe640 1 -- 172.21.15.27:0/1236797308 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f29c80f0630 con 0x7f29d4102370 2024-09-19T08:12:13.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.223+0000 7f29d259c640 1 --2- 172.21.15.27:0/1236797308 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f29bc0a34d0 0x7f29bc0a5990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f29c4005d00 tx=0x7f29c400b410 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:13.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.226+0000 7f29c37fe640 1 -- 172.21.15.27:0/1236797308 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f29c80bcee0 con 0x7f29d4102370 2024-09-19T08:12:13.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.443+0000 7f29d359e640 1 -- 172.21.15.27:0/1236797308 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29d4109f90 con 0x7f29d4102370 2024-09-19T08:12:13.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.444+0000 7f29c37fe640 1 -- 172.21.15.27:0/1236797308 <== mon.2 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f29c80bc7e0 con 0x7f29d4102370 2024-09-19T08:12:13.445 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:12:13.445 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:12:13.445 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:12:13.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.447+0000 7f29d359e640 1 -- 172.21.15.27:0/1236797308 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f29bc0a34d0 msgr2=0x7f29bc0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:13.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.447+0000 7f29d359e640 1 --2- 172.21.15.27:0/1236797308 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f29bc0a34d0 0x7f29bc0a5990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f29c4005d00 tx=0x7f29c400b410 comp rx=0 tx=0).stop 2024-09-19T08:12:13.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.447+0000 7f29d359e640 1 -- 172.21.15.27:0/1236797308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29d4102370 msgr2=0x7f29d4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:13.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.447+0000 7f29d359e640 1 --2- 172.21.15.27:0/1236797308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29d4102370 0x7f29d4074a30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f29c802a940 tx=0x7f29c8003b90 comp rx=0 tx=0).stop 2024-09-19T08:12:13.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.447+0000 7f29d359e640 1 -- 172.21.15.27:0/1236797308 shutdown_connections 2024-09-19T08:12:13.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.447+0000 7f29d359e640 1 --2- 172.21.15.27:0/1236797308 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f29bc0a34d0 0x7f29bc0a5990 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:13.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.447+0000 7f29d359e640 1 --2- 172.21.15.27:0/1236797308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29d41079d0 0x7f29d4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:13.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.447+0000 7f29d359e640 1 --2- 172.21.15.27:0/1236797308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29d4102370 0x7f29d4074a30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:13.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.447+0000 7f29d359e640 1 --2- 172.21.15.27:0/1236797308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29d41019d0 0x7f29d40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:13.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.448+0000 7f29d359e640 1 -- 172.21.15.27:0/1236797308 >> 172.21.15.27:0/1236797308 conn(0x7f29d40fd710 msgr2=0x7f29d40fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:13.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.448+0000 7f29d359e640 1 -- 172.21.15.27:0/1236797308 shutdown_connections 2024-09-19T08:12:13.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:13.448+0000 7f29d359e640 1 -- 172.21.15.27:0/1236797308 wait complete. 2024-09-19T08:12:13.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:13 smithi155 ceph-mon[35362]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:12:13.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:13 smithi203 ceph-mon[35198]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:12:14.205 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:14 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1236797308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:12:14.246 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:12:14.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:14 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1236797308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:12:14.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:14 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1236797308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:12:14.519 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:12:15.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.114+0000 7f8f81db0640 1 -- 172.21.15.27:0/4080673659 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f7c102ef0 msgr2=0x7f8f7c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:15.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.114+0000 7f8f81db0640 1 --2- 172.21.15.27:0/4080673659 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f7c102ef0 0x7f8f7c10da40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009ca0 tx=0x7f8f7402a950 comp rx=0 tx=0).stop 2024-09-19T08:12:15.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.114+0000 7f8f81db0640 1 -- 172.21.15.27:0/4080673659 shutdown_connections 2024-09-19T08:12:15.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.114+0000 7f8f81db0640 1 --2- 172.21.15.27:0/4080673659 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f7c102ef0 0x7f8f7c10da40 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.114+0000 7f8f81db0640 1 --2- 172.21.15.27:0/4080673659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f7c102570 0x7f8f7c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.114+0000 7f8f81db0640 1 --2- 172.21.15.27:0/4080673659 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8f7c100e20 0x7f8f7c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.115+0000 7f8f81db0640 1 -- 172.21.15.27:0/4080673659 >> 172.21.15.27:0/4080673659 conn(0x7f8f7c0fc7d0 msgr2=0x7f8f7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:15.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.115+0000 7f8f81db0640 1 -- 172.21.15.27:0/4080673659 shutdown_connections 2024-09-19T08:12:15.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.115+0000 7f8f81db0640 1 -- 172.21.15.27:0/4080673659 wait complete. 2024-09-19T08:12:15.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.116+0000 7f8f81db0640 1 Processor -- start 2024-09-19T08:12:15.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.116+0000 7f8f81db0640 1 -- start start 2024-09-19T08:12:15.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.117+0000 7f8f81db0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f7c100e20 0x7f8f7c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:15.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.117+0000 7f8f81db0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f7c102570 0x7f8f7c198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:15.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.117+0000 7f8f81db0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8f7c102ef0 0x7f8f7c19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:15.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.117+0000 7f8f81db0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c1120f0 con 0x7f8f7c102570 2024-09-19T08:12:15.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.117+0000 7f8f81db0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c111f70 con 0x7f8f7c100e20 2024-09-19T08:12:15.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.117+0000 7f8f81db0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c112270 con 0x7f8f7c102ef0 2024-09-19T08:12:15.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.117+0000 7f8f7affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f7c102570 0x7f8f7c198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:15.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.117+0000 7f8f7b7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f7c100e20 0x7f8f7c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:15.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.117+0000 7f8f7affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f7c102570 0x7f8f7c198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35398/0 (socket says 172.21.15.27:35398) 2024-09-19T08:12:15.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.117+0000 7f8f7affd640 1 -- 172.21.15.27:0/1700366807 learned_addr learned my addr 172.21.15.27:0/1700366807 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:15.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.117+0000 7f8f7bfff640 1 --2- 172.21.15.27:0/1700366807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8f7c102ef0 0x7f8f7c19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:15.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.118+0000 7f8f7bfff640 1 -- 172.21.15.27:0/1700366807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f7c100e20 msgr2=0x7f8f7c1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:15.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.118+0000 7f8f7bfff640 1 --2- 172.21.15.27:0/1700366807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f7c100e20 0x7f8f7c1984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.118+0000 7f8f7bfff640 1 -- 172.21.15.27:0/1700366807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f7c102570 msgr2=0x7f8f7c198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:15.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.118+0000 7f8f7bfff640 1 --2- 172.21.15.27:0/1700366807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f7c102570 0x7f8f7c198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.118+0000 7f8f7bfff640 1 -- 172.21.15.27:0/1700366807 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f7c19d4a0 con 0x7f8f7c102ef0 2024-09-19T08:12:15.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.118+0000 7f8f7bfff640 1 --2- 172.21.15.27:0/1700366807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8f7c102ef0 0x7f8f7c19cdc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8f74005e30 tx=0x7f8f74003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:15.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.118+0000 7f8f78ff9640 1 -- 172.21.15.27:0/1700366807 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f74034040 con 0x7f8f7c102ef0 2024-09-19T08:12:15.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.118+0000 7f8f81db0640 1 -- 172.21.15.27:0/1700366807 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f7c19d730 con 0x7f8f7c102ef0 2024-09-19T08:12:15.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.118+0000 7f8f78ff9640 1 -- 172.21.15.27:0/1700366807 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f7402fe10 con 0x7f8f7c102ef0 2024-09-19T08:12:15.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.118+0000 7f8f78ff9640 1 -- 172.21.15.27:0/1700366807 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7403ce30 con 0x7f8f7c102ef0 2024-09-19T08:12:15.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.118+0000 7f8f81db0640 1 -- 172.21.15.27:0/1700366807 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f7c10e400 con 0x7f8f7c102ef0 2024-09-19T08:12:15.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.122+0000 7f8f78ff9640 1 -- 172.21.15.27:0/1700366807 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7f8f7404e060 con 0x7f8f7c102ef0 2024-09-19T08:12:15.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.122+0000 7f8f84189740 1 Processor -- start 2024-09-19T08:12:15.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.122+0000 7f8f84189740 1 -- start start 2024-09-19T08:12:15.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.122+0000 7f8f84189740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8b4350 0x5636ab8b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:15.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.122+0000 7f8f84189740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b2de0 0x5636ab8b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:15.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.122+0000 7f8f84189740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8bdb80 0x5636ab8bff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:15.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.122+0000 7f8f84189740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5636ab8102f0 con 0x5636ab8bdb80 2024-09-19T08:12:15.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.122+0000 7f8f84189740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5636ab7b7cf0 con 0x5636ab8b4350 2024-09-19T08:12:15.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.122+0000 7f8f84189740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5636ab80c2b0 con 0x5636ab8b2de0 2024-09-19T08:12:15.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.123+0000 7f8f7affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8bdb80 0x5636ab8bff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:15.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.123+0000 7f8f7affd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8b4350 0x5636ab8b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:15.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.123+0000 7f8f7affd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8b4350 0x5636ab8b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.27:60464/0 (socket says 172.21.15.27:60464) 2024-09-19T08:12:15.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.123+0000 7f8f7affd640 1 -- 172.21.15.27:0/2554241382 learned_addr learned my addr 172.21.15.27:0/2554241382 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:15.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.123+0000 7f8f7b7fe640 1 --2- 172.21.15.27:0/2554241382 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b2de0 0x5636ab8b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:15.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.123+0000 7f8f78ff9640 1 --2- 172.21.15.27:0/1700366807 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8f640a35d0 0x7f8f640a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:15.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.123+0000 7f8f7bfff640 1 --2- 172.21.15.27:0/1700366807 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8f640a35d0 0x7f8f640a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:15.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.123+0000 7f8f7affd640 1 -- 172.21.15.27:0/2554241382 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b2de0 msgr2=0x5636ab8b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:15.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.123+0000 7f8f7affd640 1 --2- 172.21.15.27:0/2554241382 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b2de0 0x5636ab8b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.123+0000 7f8f7affd640 1 -- 172.21.15.27:0/2554241382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8b4350 msgr2=0x5636ab8b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:15.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.123+0000 7f8f7affd640 1 --2- 172.21.15.27:0/2554241382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8b4350 0x5636ab8b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.123+0000 7f8f7affd640 1 -- 172.21.15.27:0/2554241382 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636ab79c3a0 con 0x5636ab8bdb80 2024-09-19T08:12:15.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.123+0000 7f8f7b7fe640 1 --2- 172.21.15.27:0/2554241382 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b2de0 0x5636ab8b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:12:15.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.123+0000 7f8f78ff9640 1 -- 172.21.15.27:0/1700366807 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f8f740f46f0 con 0x7f8f7c102ef0 2024-09-19T08:12:15.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.124+0000 7f8f7affd640 1 --2- 172.21.15.27:0/2554241382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8bdb80 0x5636ab8bff70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8f70014370 tx=0x7f8f7000a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d744cdb06f3aec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:15.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.124+0000 7f8f61ffb640 1 -- 172.21.15.27:0/2554241382 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7001c070 con 0x5636ab8bdb80 2024-09-19T08:12:15.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.124+0000 7f8f61ffb640 1 -- 172.21.15.27:0/2554241382 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f70017940 con 0x5636ab8bdb80 2024-09-19T08:12:15.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.125+0000 7f8f84189740 1 -- 172.21.15.27:0/2554241382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8bdb80 msgr2=0x5636ab8bff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:15.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.125+0000 7f8f7bfff640 1 --2- 172.21.15.27:0/1700366807 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8f640a35d0 0x7f8f640a5a90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f740f1d10 tx=0x7f8f740924f0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:15.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.125+0000 7f8f84189740 1 --2- 172.21.15.27:0/2554241382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8bdb80 0x5636ab8bff70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8f70014370 tx=0x7f8f7000a0d0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.125+0000 7f8f84189740 1 -- 172.21.15.27:0/2554241382 shutdown_connections 2024-09-19T08:12:15.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.125+0000 7f8f84189740 1 --2- 172.21.15.27:0/2554241382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8bdb80 0x5636ab8bff70 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.125+0000 7f8f84189740 1 --2- 172.21.15.27:0/2554241382 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b2de0 0x5636ab8b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.125+0000 7f8f84189740 1 --2- 172.21.15.27:0/2554241382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8b4350 0x5636ab8b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.125+0000 7f8f84189740 1 -- 172.21.15.27:0/2554241382 >> 172.21.15.27:0/2554241382 conn(0x5636ab873310 msgr2=0x5636ab8af470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:15.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.125+0000 7f8f84189740 1 -- 172.21.15.27:0/2554241382 shutdown_connections 2024-09-19T08:12:15.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.125+0000 7f8f84189740 1 -- 172.21.15.27:0/2554241382 wait complete. 2024-09-19T08:12:15.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.126+0000 7f8f84189740 1 -- start start 2024-09-19T08:12:15.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.126+0000 7f8f84189740 1 Processor -- start 2024-09-19T08:12:15.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.126+0000 7f8f84189740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b2de0 0x5636ab8bd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:15.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.126+0000 7f8f84189740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8b4350 0x5636ab8ba7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:15.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.126+0000 7f8f84189740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8bdb80 0x5636ab8bad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:15.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.126+0000 7f8f84189740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5636ab8c08d0 con 0x5636ab8bdb80 2024-09-19T08:12:15.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.126+0000 7f8f84189740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5636ab7cb060 con 0x5636ab8b4350 2024-09-19T08:12:15.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.126+0000 7f8f84189740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5636ab8c0a50 con 0x5636ab8b2de0 2024-09-19T08:12:15.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.127+0000 7f8f84189740 10 client.0 _ll_register_callbacks cb 0x5636ab51e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:12:15.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.127+0000 7f8f7b7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8b4350 0x5636ab8ba7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:15.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.127+0000 7f8f7b7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8b4350 0x5636ab8ba7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.27:60474/0 (socket says 172.21.15.27:60474) 2024-09-19T08:12:15.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.127+0000 7f8f7b7fe640 1 -- 172.21.15.27:0/1881979543 learned_addr learned my addr 172.21.15.27:0/1881979543 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:15.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.127+0000 7f8f7affd640 1 --2- 172.21.15.27:0/1881979543 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8bdb80 0x5636ab8bad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:15.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.127+0000 7f8f7b7fe640 1 -- 172.21.15.27:0/1881979543 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b2de0 msgr2=0x5636ab8bd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:15.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.127+0000 7f8f7affd640 1 --2- 172.21.15.27:0/1881979543 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b2de0 0x5636ab8bd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:15.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.127+0000 7f8f7b7fe640 1 --2- 172.21.15.27:0/1881979543 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b2de0 0x5636ab8bd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.127+0000 7f8f7b7fe640 1 -- 172.21.15.27:0/1881979543 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8bdb80 msgr2=0x5636ab8bad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:15.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.127+0000 7f8f7b7fe640 1 --2- 172.21.15.27:0/1881979543 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8bdb80 0x5636ab8bad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.127+0000 7f8f7b7fe640 1 -- 172.21.15.27:0/1881979543 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636ab5813c0 con 0x5636ab8b4350 2024-09-19T08:12:15.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.127+0000 7f8f7affd640 1 --2- 172.21.15.27:0/1881979543 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8bdb80 0x5636ab8bad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:12:15.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.128+0000 7f8f7b7fe640 1 --2- 172.21.15.27:0/1881979543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8b4350 0x5636ab8ba7c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c012700 tx=0x7f8f6c012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a9d1b53f6683c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:15.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.128+0000 7f8f5affd640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:12:15.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.128+0000 7f8f5affd640 1 -- 172.21.15.27:0/1881979543 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c004050 con 0x5636ab8b4350 2024-09-19T08:12:15.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.128+0000 7f8f5affd640 1 -- 172.21.15.27:0/1881979543 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f8f6c0041f0 con 0x5636ab8b4350 2024-09-19T08:12:15.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.128+0000 7f8f84189740 1 -- 172.21.15.27:0/1881979543 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f70017940 con 0x5636ab8b4350 2024-09-19T08:12:15.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.128+0000 7f8f5affd640 1 -- 172.21.15.27:0/1881979543 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8f6c0043f0 con 0x5636ab8b4350 2024-09-19T08:12:15.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.128+0000 7f8f84189740 10 client.25169 fetch_fsmap learned FSMap version 20 2024-09-19T08:12:15.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.128+0000 7f8f84189740 1 -- 172.21.15.27:0/1881979543 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5636ab8cc3b0 con 0x5636ab8b4350 2024-09-19T08:12:15.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.128+0000 7f8f5affd640 1 -- 172.21.15.27:0/1881979543 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f6c0035f0 con 0x5636ab8b4350 2024-09-19T08:12:15.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.129+0000 7f8f5affd640 1 -- 172.21.15.27:0/1881979543 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8f6c00f9a0 con 0x5636ab8b4350 2024-09-19T08:12:15.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.129+0000 7f8f84189740 10 client.25169 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:12:15.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.129+0000 7f8f84189740 10 client.25169 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:12:15.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.129+0000 7f8f84189740 20 client.25169 populate_metadata read hostname 'smithi027' 2024-09-19T08:12:15.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.129+0000 7f8f84189740 1 --2- 172.21.15.27:0/1881979543 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5636ab8cd7c0 0x5636ab8cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:15.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.129+0000 7f8f84189740 4 client.25169 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:12:15.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.129+0000 7f8f84189740 1 -- 172.21.15.27:0/1881979543 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8f70017940 con 0x5636ab8cd7c0 2024-09-19T08:12:15.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.130+0000 7f8f7affd640 1 --2- 172.21.15.27:0/1881979543 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5636ab8cd7c0 0x5636ab8cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:15.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.130+0000 7f8f5affd640 10 client.25169 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:15.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.130+0000 7f8f7affd640 1 --2- 172.21.15.27:0/1881979543 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5636ab8cd7c0 0x5636ab8cfbe0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3d1f76c6c51d719 server_cookie=18166e6f70ff5517 in_seq=0 out_seq=0 2024-09-19T08:12:15.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.131+0000 7f8f5affd640 1 -- 172.21.15.27:0/1881979543 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f8f70017940 con 0x5636ab8cd7c0 2024-09-19T08:12:15.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.131+0000 7f8f5affd640 10 client.25169 handle_command_reply: tid=0 2024-09-19T08:12:15.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.131+0000 7f8f84189740 1 client.25169 shutdown 2024-09-19T08:12:15.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.131+0000 7f8f84189740 1 -- 172.21.15.27:0/1881979543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8b4350 msgr2=0x5636ab8ba7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:15.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.131+0000 7f8f84189740 1 --2- 172.21.15.27:0/1881979543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8b4350 0x5636ab8ba7c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c012700 tx=0x7f8f6c012bc0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.131+0000 7f8f84189740 1 -- 172.21.15.27:0/1881979543 shutdown_connections 2024-09-19T08:12:15.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.131+0000 7f8f84189740 1 --2- 172.21.15.27:0/1881979543 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8bdb80 0x5636ab8bad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.131+0000 7f8f84189740 1 --2- 172.21.15.27:0/1881979543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8b4350 0x5636ab8ba7c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.131+0000 7f8f84189740 1 --2- 172.21.15.27:0/1881979543 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5636ab8cd7c0 0x5636ab8cfbe0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.131+0000 7f8f5affd640 0 client.25169 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:15.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.131+0000 7f8f84189740 1 --2- 172.21.15.27:0/1881979543 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b2de0 0x5636ab8bd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.131+0000 7f8f84189740 1 -- 172.21.15.27:0/1881979543 >> 172.21.15.27:0/1881979543 conn(0x5636ab873310 msgr2=0x5636ab8b5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:15.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.132+0000 7f8f84189740 1 -- 172.21.15.27:0/1881979543 shutdown_connections 2024-09-19T08:12:15.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.132+0000 7f8f84189740 1 -- 172.21.15.27:0/1881979543 wait complete. 2024-09-19T08:12:15.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.132+0000 7f8f84189740 20 client.25169 trim_cache size 0 max 16384 2024-09-19T08:12:15.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.158+0000 7f8f84189740 1 Processor -- start 2024-09-19T08:12:15.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.158+0000 7f8f84189740 1 -- start start 2024-09-19T08:12:15.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.158+0000 7f8f84189740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b2de0 0x5636ab8b5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:15.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.158+0000 7f8f84189740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8b4350 0x5636ab8b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:15.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.158+0000 7f8f84189740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8bdb80 0x5636ab8d5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:15.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.158+0000 7f8f84189740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c1a95e0 con 0x5636ab8b4350 2024-09-19T08:12:15.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.158+0000 7f8f84189740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c1abe40 con 0x5636ab8bdb80 2024-09-19T08:12:15.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.158+0000 7f8f84189740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c1a9c30 con 0x5636ab8b2de0 2024-09-19T08:12:15.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.158+0000 7f8f7b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8b4350 0x5636ab8b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:15.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.158+0000 7f8f7b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8b4350 0x5636ab8b5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35420/0 (socket says 172.21.15.27:35420) 2024-09-19T08:12:15.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.158+0000 7f8f7b7fe640 1 -- 172.21.15.27:0/3289054622 learned_addr learned my addr 172.21.15.27:0/3289054622 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:15.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.158+0000 7f8f7affd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b2de0 0x5636ab8b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:15.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.158+0000 7f8f7affd640 1 --2- 172.21.15.27:0/3289054622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8bdb80 0x5636ab8d5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:15.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.159+0000 7f8f7b7fe640 1 -- 172.21.15.27:0/3289054622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b2de0 msgr2=0x5636ab8b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:15.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.159+0000 7f8f7b7fe640 1 --2- 172.21.15.27:0/3289054622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b2de0 0x5636ab8b5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.159+0000 7f8f7b7fe640 1 -- 172.21.15.27:0/3289054622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8bdb80 msgr2=0x5636ab8d5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:15.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.159+0000 7f8f7b7fe640 1 --2- 172.21.15.27:0/3289054622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8bdb80 0x5636ab8d5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.159+0000 7f8f7b7fe640 1 -- 172.21.15.27:0/3289054622 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636ab8b63b0 con 0x5636ab8b4350 2024-09-19T08:12:15.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.159+0000 7f8f7b7fe640 1 --2- 172.21.15.27:0/3289054622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8b4350 0x5636ab8b5e70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00ff30 tx=0x7f8f6c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8686ca95dca3653f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:15.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.159+0000 7f8f617fa640 1 -- 172.21.15.27:0/3289054622 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c0037f0 con 0x5636ab8b4350 2024-09-19T08:12:15.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.159+0000 7f8f617fa640 1 -- 172.21.15.27:0/3289054622 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f6c003990 con 0x5636ab8b4350 2024-09-19T08:12:15.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.159+0000 7f8f617fa640 1 -- 172.21.15.27:0/3289054622 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c005630 con 0x5636ab8b4350 2024-09-19T08:12:15.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.160+0000 7f8f84189740 1 -- 172.21.15.27:0/3289054622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8b4350 msgr2=0x5636ab8b5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:15.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.160+0000 7f8f84189740 1 --2- 172.21.15.27:0/3289054622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8b4350 0x5636ab8b5e70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00ff30 tx=0x7f8f6c000bc0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.160+0000 7f8f84189740 1 -- 172.21.15.27:0/3289054622 shutdown_connections 2024-09-19T08:12:15.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.160+0000 7f8f84189740 1 --2- 172.21.15.27:0/3289054622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8bdb80 0x5636ab8d5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.160+0000 7f8f84189740 1 --2- 172.21.15.27:0/3289054622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8b4350 0x5636ab8b5e70 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.160+0000 7f8f84189740 1 --2- 172.21.15.27:0/3289054622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b2de0 0x5636ab8b5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.160+0000 7f8f84189740 1 -- 172.21.15.27:0/3289054622 >> 172.21.15.27:0/3289054622 conn(0x5636ab873310 msgr2=0x5636ab8a5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:15.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.160+0000 7f8f84189740 1 -- 172.21.15.27:0/3289054622 shutdown_connections 2024-09-19T08:12:15.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.161+0000 7f8f84189740 1 -- 172.21.15.27:0/3289054622 wait complete. 2024-09-19T08:12:15.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.161+0000 7f8f84189740 1 -- start start 2024-09-19T08:12:15.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.161+0000 7f8f84189740 1 Processor -- start 2024-09-19T08:12:15.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.161+0000 7f8f84189740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8b2de0 0x5636ab8c1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:15.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.161+0000 7f8f84189740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b4350 0x5636ab8c2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:15.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.162+0000 7f8f84189740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8bdb80 0x5636ab8c2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:15.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.162+0000 7f8f84189740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c1aa300 con 0x5636ab8b2de0 2024-09-19T08:12:15.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.162+0000 7f8f84189740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c1ab770 con 0x5636ab8bdb80 2024-09-19T08:12:15.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.162+0000 7f8f84189740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c1aa9d0 con 0x5636ab8b4350 2024-09-19T08:12:15.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.162+0000 7f8f84189740 10 client.0 _ll_register_callbacks cb 0x7f8f6c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:12:15.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.162+0000 7f8f7b7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b4350 0x5636ab8c2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:15.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.162+0000 7f8f7b7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b4350 0x5636ab8c2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.27:56496/0 (socket says 172.21.15.27:56496) 2024-09-19T08:12:15.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.162+0000 7f8f7b7fe640 1 -- 172.21.15.27:0/133927350 learned_addr learned my addr 172.21.15.27:0/133927350 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:15.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.162+0000 7f8f7affd640 1 --2- 172.21.15.27:0/133927350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8b2de0 0x5636ab8c1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:15.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.162+0000 7f8f7b7fe640 1 -- 172.21.15.27:0/133927350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8bdb80 msgr2=0x5636ab8c2560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:12:15.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.162+0000 7f8f7b7fe640 1 --2- 172.21.15.27:0/133927350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8bdb80 0x5636ab8c2560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.162+0000 7f8f7b7fe640 1 -- 172.21.15.27:0/133927350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8b2de0 msgr2=0x5636ab8c1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:15.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.162+0000 7f8f7b7fe640 1 --2- 172.21.15.27:0/133927350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8b2de0 0x5636ab8c1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.162+0000 7f8f7b7fe640 1 -- 172.21.15.27:0/133927350 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636ab9374b0 con 0x5636ab8b4350 2024-09-19T08:12:15.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.162+0000 7f8f7affd640 1 --2- 172.21.15.27:0/133927350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8b2de0 0x5636ab8c1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:12:15.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.163+0000 7f8f7b7fe640 1 --2- 172.21.15.27:0/133927350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b4350 0x5636ab8c2020 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00fdc0 tx=0x7f8f6c00fbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=badf4215435ce797 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:15.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.163+0000 7f8f5affd640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T08:12:15.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.163+0000 7f8f5affd640 1 -- 172.21.15.27:0/133927350 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c0037f0 con 0x5636ab8b4350 2024-09-19T08:12:15.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.163+0000 7f8f5affd640 1 -- 172.21.15.27:0/133927350 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f8f6c0055c0 con 0x5636ab8b4350 2024-09-19T08:12:15.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.163+0000 7f8f84189740 1 -- 172.21.15.27:0/133927350 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f6c003990 con 0x5636ab8b4350 2024-09-19T08:12:15.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.163+0000 7f8f5affd640 1 -- 172.21.15.27:0/133927350 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8f6c0035f0 con 0x5636ab8b4350 2024-09-19T08:12:15.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.163+0000 7f8f84189740 10 client.25207 fetch_fsmap learned FSMap version 20 2024-09-19T08:12:15.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.163+0000 7f8f84189740 1 -- 172.21.15.27:0/133927350 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5636ab938790 con 0x5636ab8b4350 2024-09-19T08:12:15.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.164+0000 7f8f5affd640 1 -- 172.21.15.27:0/133927350 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f6c003990 con 0x5636ab8b4350 2024-09-19T08:12:15.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.164+0000 7f8f5affd640 1 -- 172.21.15.27:0/133927350 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8f6c004af0 con 0x5636ab8b4350 2024-09-19T08:12:15.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.164+0000 7f8f84189740 10 client.25207 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:12:15.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.164+0000 7f8f84189740 10 client.25207 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:12:15.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.164+0000 7f8f84189740 20 client.25207 populate_metadata read hostname 'smithi027' 2024-09-19T08:12:15.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.164+0000 7f8f84189740 1 --2- 172.21.15.27:0/133927350 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5636ab938e20 0x5636ab93b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:15.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.164+0000 7f8f84189740 4 client.25207 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:12:15.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.164+0000 7f8f84189740 1 -- 172.21.15.27:0/133927350 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5636ab81d860 con 0x5636ab938e20 2024-09-19T08:12:15.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.165+0000 7f8f7affd640 1 --2- 172.21.15.27:0/133927350 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5636ab938e20 0x5636ab93b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:15.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.165+0000 7f8f7affd640 1 --2- 172.21.15.27:0/133927350 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5636ab938e20 0x5636ab93b280 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd3e811e3027c438 server_cookie=417a405a7c46336c in_seq=0 out_seq=0 2024-09-19T08:12:15.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.165+0000 7f8f5affd640 10 client.25207 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:15.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.165+0000 7f8f5affd640 1 -- 172.21.15.27:0/133927350 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5636ab81d860 con 0x5636ab938e20 2024-09-19T08:12:15.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.165+0000 7f8f5affd640 10 client.25207 handle_command_reply: tid=0 2024-09-19T08:12:15.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.165+0000 7f8f84189740 1 client.25207 shutdown 2024-09-19T08:12:15.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.165+0000 7f8f84189740 1 -- 172.21.15.27:0/133927350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b4350 msgr2=0x5636ab8c2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:15.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.165+0000 7f8f84189740 1 --2- 172.21.15.27:0/133927350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b4350 0x5636ab8c2020 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00fdc0 tx=0x7f8f6c00fbd0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.166+0000 7f8f84189740 1 -- 172.21.15.27:0/133927350 shutdown_connections 2024-09-19T08:12:15.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.166+0000 7f8f84189740 1 --2- 172.21.15.27:0/133927350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636ab8bdb80 0x5636ab8c2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.166+0000 7f8f84189740 1 --2- 172.21.15.27:0/133927350 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5636ab938e20 0x5636ab93b280 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.166+0000 7f8f84189740 1 --2- 172.21.15.27:0/133927350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636ab8b4350 0x5636ab8c2020 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.166+0000 7f8f84189740 1 --2- 172.21.15.27:0/133927350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5636ab8b2de0 0x5636ab8c1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.166+0000 7f8f84189740 1 -- 172.21.15.27:0/133927350 >> 172.21.15.27:0/133927350 conn(0x5636ab873310 msgr2=0x5636ab8bc020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:15.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.166+0000 7f8f5affd640 0 client.25207 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:15.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.166+0000 7f8f84189740 1 -- 172.21.15.27:0/133927350 shutdown_connections 2024-09-19T08:12:15.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.166+0000 7f8f84189740 1 -- 172.21.15.27:0/133927350 wait complete. 2024-09-19T08:12:15.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.166+0000 7f8f84189740 20 client.25207 trim_cache size 0 max 16384 2024-09-19T08:12:15.170 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:12:15.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.167+0000 7f8f81db0640 1 -- 172.21.15.27:0/1700366807 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8f640a35d0 msgr2=0x7f8f640a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:15.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.167+0000 7f8f81db0640 1 --2- 172.21.15.27:0/1700366807 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8f640a35d0 0x7f8f640a5a90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f740f1d10 tx=0x7f8f740924f0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.167+0000 7f8f81db0640 1 -- 172.21.15.27:0/1700366807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8f7c102ef0 msgr2=0x7f8f7c19cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:15.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.167+0000 7f8f81db0640 1 --2- 172.21.15.27:0/1700366807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8f7c102ef0 0x7f8f7c19cdc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8f74005e30 tx=0x7f8f74003c10 comp rx=0 tx=0).stop 2024-09-19T08:12:15.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.167+0000 7f8f81db0640 1 -- 172.21.15.27:0/1700366807 shutdown_connections 2024-09-19T08:12:15.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.167+0000 7f8f81db0640 1 --2- 172.21.15.27:0/1700366807 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8f640a35d0 0x7f8f640a5a90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.167+0000 7f8f81db0640 1 --2- 172.21.15.27:0/1700366807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8f7c102ef0 0x7f8f7c19cdc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.167+0000 7f8f81db0640 1 --2- 172.21.15.27:0/1700366807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f7c102570 0x7f8f7c198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.167+0000 7f8f81db0640 1 --2- 172.21.15.27:0/1700366807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f7c100e20 0x7f8f7c1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:15.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.167+0000 7f8f81db0640 1 -- 172.21.15.27:0/1700366807 >> 172.21.15.27:0/1700366807 conn(0x7f8f7c0fc7d0 msgr2=0x7f8f7c106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:15.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.167+0000 7f8f81db0640 1 -- 172.21.15.27:0/1700366807 shutdown_connections 2024-09-19T08:12:15.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:15.167+0000 7f8f81db0640 1 -- 172.21.15.27:0/1700366807 wait complete. 2024-09-19T08:12:15.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:15 smithi027 ceph-mon[31209]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:12:15.499 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:15 smithi155 ceph-mon[35362]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:12:15.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:15 smithi203 ceph-mon[35198]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:12:17.085 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:12:17.086 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:12:17.370 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:12:17.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:17 smithi155 ceph-mon[35362]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:12:17.495 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:17 smithi027 ceph-mon[31209]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:12:17.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:17 smithi203 ceph-mon[35198]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:12:17.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.918+0000 7f22bb314640 1 -- 172.21.15.27:0/3437421363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b410e4d0 msgr2=0x7f22b41108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:17.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.918+0000 7f22bb314640 1 --2- 172.21.15.27:0/3437421363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b410e4d0 0x7f22b41108e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009ca0 tx=0x7f22ac02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.918+0000 7f22bb314640 1 -- 172.21.15.27:0/3437421363 shutdown_connections 2024-09-19T08:12:17.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.918+0000 7f22bb314640 1 --2- 172.21.15.27:0/3437421363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b410e4d0 0x7f22b41108e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.918+0000 7f22bb314640 1 --2- 172.21.15.27:0/3437421363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22b4101360 0x7f22b410df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.918+0000 7f22bb314640 1 --2- 172.21.15.27:0/3437421363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22b41009b0 0x7f22b4100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.918+0000 7f22bb314640 1 -- 172.21.15.27:0/3437421363 >> 172.21.15.27:0/3437421363 conn(0x7f22b40fc7d0 msgr2=0x7f22b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:17.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.918+0000 7f22bb314640 1 -- 172.21.15.27:0/3437421363 shutdown_connections 2024-09-19T08:12:17.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.918+0000 7f22bb314640 1 -- 172.21.15.27:0/3437421363 wait complete. 2024-09-19T08:12:17.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.919+0000 7f22bb314640 1 Processor -- start 2024-09-19T08:12:17.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.919+0000 7f22bb314640 1 -- start start 2024-09-19T08:12:17.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.919+0000 7f22bb314640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22b41009b0 0x7f22b419a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:17.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.920+0000 7f22bb314640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22b4101360 0x7f22b419aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:17.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.920+0000 7f22bb314640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b410e4d0 0x7f22b419df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:17.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.920+0000 7f22bb314640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f22b4114220 con 0x7f22b410e4d0 2024-09-19T08:12:17.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.920+0000 7f22bb314640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f22b41140a0 con 0x7f22b41009b0 2024-09-19T08:12:17.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.920+0000 7f22bb314640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f22b41143a0 con 0x7f22b4101360 2024-09-19T08:12:17.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.920+0000 7f22b88af640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22b4101360 0x7f22b419aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:17.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.920+0000 7f22b88af640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22b4101360 0x7f22b419aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.27:56512/0 (socket says 172.21.15.27:56512) 2024-09-19T08:12:17.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.920+0000 7f22b88af640 1 -- 172.21.15.27:0/425302110 learned_addr learned my addr 172.21.15.27:0/425302110 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:17.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.920+0000 7f22b90b0640 1 --2- 172.21.15.27:0/425302110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22b41009b0 0x7f22b419a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:17.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.920+0000 7f22b98b1640 1 --2- 172.21.15.27:0/425302110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b410e4d0 0x7f22b419df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:17.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.920+0000 7f22b88af640 1 -- 172.21.15.27:0/425302110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22b41009b0 msgr2=0x7f22b419a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:17.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.920+0000 7f22b88af640 1 --2- 172.21.15.27:0/425302110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22b41009b0 0x7f22b419a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.920+0000 7f22b88af640 1 -- 172.21.15.27:0/425302110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b410e4d0 msgr2=0x7f22b419df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:17.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.920+0000 7f22b88af640 1 --2- 172.21.15.27:0/425302110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b410e4d0 0x7f22b419df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.920+0000 7f22b88af640 1 -- 172.21.15.27:0/425302110 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b419e6b0 con 0x7f22b4101360 2024-09-19T08:12:17.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.920+0000 7f22b88af640 1 --2- 172.21.15.27:0/425302110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22b4101360 0x7f22b419aca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f22a400e9f0 tx=0x7f22a400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:17.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.921+0000 7f22b98b1640 1 --2- 172.21.15.27:0/425302110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b410e4d0 0x7f22b419df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:12:17.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.921+0000 7f22aa7fc640 1 -- 172.21.15.27:0/425302110 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a400cd80 con 0x7f22b4101360 2024-09-19T08:12:17.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.921+0000 7f22aa7fc640 1 -- 172.21.15.27:0/425302110 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22a4010910 con 0x7f22b4101360 2024-09-19T08:12:17.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.921+0000 7f22bb314640 1 -- 172.21.15.27:0/425302110 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b419e9a0 con 0x7f22b4101360 2024-09-19T08:12:17.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.921+0000 7f22aa7fc640 1 -- 172.21.15.27:0/425302110 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a40188f0 con 0x7f22b4101360 2024-09-19T08:12:17.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.921+0000 7f22bb314640 1 -- 172.21.15.27:0/425302110 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b4102b30 con 0x7f22b4101360 2024-09-19T08:12:17.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.924+0000 7f22bd6ed740 1 Processor -- start 2024-09-19T08:12:17.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.924+0000 7f22aa7fc640 1 -- 172.21.15.27:0/425302110 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7f22a4010ac0 con 0x7f22b4101360 2024-09-19T08:12:17.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.924+0000 7f22bd6ed740 1 -- start start 2024-09-19T08:12:17.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.925+0000 7f22bd6ed740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba0b60 0x558550ba0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:17.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.925+0000 7f22bd6ed740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558550ba1480 0x558550bab800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:17.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.925+0000 7f22bd6ed740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550babd40 0x558550bae130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:17.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.925+0000 7f22bd6ed740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x558550b06280 con 0x558550ba0b60 2024-09-19T08:12:17.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.925+0000 7f22bd6ed740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558550aadb10 con 0x558550babd40 2024-09-19T08:12:17.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.925+0000 7f22bd6ed740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558550b02240 con 0x558550ba1480 2024-09-19T08:12:17.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.925+0000 7f22b98b1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba0b60 0x558550ba0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:17.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.925+0000 7f22b98b1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba0b60 0x558550ba0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35446/0 (socket says 172.21.15.27:35446) 2024-09-19T08:12:17.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.925+0000 7f22b98b1640 1 -- 172.21.15.27:0/4255435277 learned_addr learned my addr 172.21.15.27:0/4255435277 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:17.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.925+0000 7f22b90b0640 1 --2- 172.21.15.27:0/4255435277 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558550ba1480 0x558550bab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:17.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.925+0000 7f22b98b1640 1 -- 172.21.15.27:0/4255435277 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558550ba1480 msgr2=0x558550bab800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:17.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.925+0000 7f22b98b1640 1 --2- 172.21.15.27:0/4255435277 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558550ba1480 0x558550bab800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.925+0000 7f22b88af640 1 --2- 172.21.15.27:0/4255435277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550babd40 0x558550bae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:17.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.925+0000 7f22b98b1640 1 -- 172.21.15.27:0/4255435277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550babd40 msgr2=0x558550bae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:17.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.926+0000 7f22b98b1640 1 --2- 172.21.15.27:0/4255435277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550babd40 0x558550bae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.926+0000 7f22aa7fc640 1 --2- 172.21.15.27:0/425302110 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f22a00abd60 0x7f22a00ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.926+0000 7f22b98b1640 1 -- 172.21.15.27:0/4255435277 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558550aba1f0 con 0x558550ba0b60 2024-09-19T08:12:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.926+0000 7f22b88af640 1 --2- 172.21.15.27:0/4255435277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550babd40 0x558550bae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:12:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.926+0000 7f22b98b1640 1 --2- 172.21.15.27:0/4255435277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba0b60 0x558550ba0f40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f22ac02f510 tx=0x7f22ac009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef0852425aaa90a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.926+0000 7f22b90b0640 1 --2- 172.21.15.27:0/425302110 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f22a00abd60 0x7f22a00ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.926+0000 7f229f7fe640 1 -- 172.21.15.27:0/4255435277 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac031db0 con 0x558550ba0b60 2024-09-19T08:12:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.927+0000 7f229f7fe640 1 -- 172.21.15.27:0/4255435277 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22ac036070 con 0x558550ba0b60 2024-09-19T08:12:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.927+0000 7f229f7fe640 1 -- 172.21.15.27:0/4255435277 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac0042a0 con 0x558550ba0b60 2024-09-19T08:12:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.927+0000 7f22aa7fc640 1 -- 172.21.15.27:0/425302110 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f22a40d04a0 con 0x7f22b4101360 2024-09-19T08:12:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.928+0000 7f22bd6ed740 1 -- 172.21.15.27:0/4255435277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba0b60 msgr2=0x558550ba0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.928+0000 7f22b90b0640 1 --2- 172.21.15.27:0/425302110 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f22a00abd60 0x7f22a00ae220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x558550b9df50 tx=0x7f22b0005f90 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.928+0000 7f22bd6ed740 1 --2- 172.21.15.27:0/4255435277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba0b60 0x558550ba0f40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f22ac02f510 tx=0x7f22ac009800 comp rx=0 tx=0).stop 2024-09-19T08:12:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.928+0000 7f22bd6ed740 1 -- 172.21.15.27:0/4255435277 shutdown_connections 2024-09-19T08:12:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.928+0000 7f22bd6ed740 1 --2- 172.21.15.27:0/4255435277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550babd40 0x558550bae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.928+0000 7f22bd6ed740 1 --2- 172.21.15.27:0/4255435277 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558550ba1480 0x558550bab800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.928+0000 7f22bd6ed740 1 --2- 172.21.15.27:0/4255435277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba0b60 0x558550ba0f40 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.928+0000 7f22bd6ed740 1 -- 172.21.15.27:0/4255435277 >> 172.21.15.27:0/4255435277 conn(0x558550b9d0f0 msgr2=0x558550b9d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.928+0000 7f22bd6ed740 1 -- 172.21.15.27:0/4255435277 shutdown_connections 2024-09-19T08:12:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.928+0000 7f22bd6ed740 1 -- 172.21.15.27:0/4255435277 wait complete. 2024-09-19T08:12:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.929+0000 7f22bd6ed740 1 -- start start 2024-09-19T08:12:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.929+0000 7f22bd6ed740 1 Processor -- start 2024-09-19T08:12:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.929+0000 7f22bd6ed740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550ba0b60 0x558550ba8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.929+0000 7f22bd6ed740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba1480 0x558550ba9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.929+0000 7f22bd6ed740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558550babd40 0x558550ba9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:17.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.929+0000 7f22bd6ed740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x558550bae910 con 0x558550ba1480 2024-09-19T08:12:17.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.929+0000 7f22bd6ed740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558550ac0f10 con 0x558550ba0b60 2024-09-19T08:12:17.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.929+0000 7f22bd6ed740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558550baea90 con 0x558550babd40 2024-09-19T08:12:17.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.929+0000 7f22bd6ed740 10 client.0 _ll_register_callbacks cb 0x558550a89a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:12:17.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.930+0000 7f22b90b0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550ba0b60 0x558550ba8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:17.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.930+0000 7f22b88af640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba1480 0x558550ba9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:17.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.930+0000 7f22b88af640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba1480 0x558550ba9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35458/0 (socket says 172.21.15.27:35458) 2024-09-19T08:12:17.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.930+0000 7f22b88af640 1 -- 172.21.15.27:0/2675843931 learned_addr learned my addr 172.21.15.27:0/2675843931 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:17.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.930+0000 7f22b98b1640 1 --2- 172.21.15.27:0/2675843931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558550babd40 0x558550ba9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:17.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.930+0000 7f22b88af640 1 -- 172.21.15.27:0/2675843931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558550babd40 msgr2=0x558550ba9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:17.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.930+0000 7f22b88af640 1 --2- 172.21.15.27:0/2675843931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558550babd40 0x558550ba9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.930+0000 7f22b88af640 1 -- 172.21.15.27:0/2675843931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550ba0b60 msgr2=0x558550ba8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:17.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.930+0000 7f22b88af640 1 --2- 172.21.15.27:0/2675843931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550ba0b60 0x558550ba8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.930+0000 7f22b88af640 1 -- 172.21.15.27:0/2675843931 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585508776a0 con 0x558550ba1480 2024-09-19T08:12:17.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.930+0000 7f22b88af640 1 --2- 172.21.15.27:0/2675843931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba1480 0x558550ba9150 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f22a400c6a0 tx=0x7f22a409c0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95347304f8382df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:17.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.930+0000 7f229cff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:12:17.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.931+0000 7f229cff9640 1 -- 172.21.15.27:0/2675843931 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a409c520 con 0x558550ba1480 2024-09-19T08:12:17.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.931+0000 7f229cff9640 1 -- 172.21.15.27:0/2675843931 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f22a409b970 con 0x558550ba1480 2024-09-19T08:12:17.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.931+0000 7f22bd6ed740 1 -- 172.21.15.27:0/2675843931 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22ac036070 con 0x558550ba1480 2024-09-19T08:12:17.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.931+0000 7f229cff9640 1 -- 172.21.15.27:0/2675843931 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f22a40b4030 con 0x558550ba1480 2024-09-19T08:12:17.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.931+0000 7f22bd6ed740 10 client.15612 fetch_fsmap learned FSMap version 20 2024-09-19T08:12:17.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.931+0000 7f22bd6ed740 1 -- 172.21.15.27:0/2675843931 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558550bba4e0 con 0x558550ba1480 2024-09-19T08:12:17.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.931+0000 7f229cff9640 1 -- 172.21.15.27:0/2675843931 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22ac036070 con 0x558550ba1480 2024-09-19T08:12:17.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.931+0000 7f229cff9640 1 -- 172.21.15.27:0/2675843931 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f22a4098270 con 0x558550ba1480 2024-09-19T08:12:17.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.931+0000 7f22bd6ed740 10 client.15612 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:12:17.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.931+0000 7f22bd6ed740 10 client.15612 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:12:17.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.931+0000 7f22bd6ed740 20 client.15612 populate_metadata read hostname 'smithi027' 2024-09-19T08:12:17.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.932+0000 7f22bd6ed740 1 --2- 172.21.15.27:0/2675843931 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558550bbb9a0 0x558550bbddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:17.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.932+0000 7f22bd6ed740 4 client.15612 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:12:17.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.932+0000 7f22bd6ed740 1 -- 172.21.15.27:0/2675843931 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558550b137f0 con 0x558550bbb9a0 2024-09-19T08:12:17.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.932+0000 7f22b90b0640 1 --2- 172.21.15.27:0/2675843931 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558550bbb9a0 0x558550bbddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:17.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.932+0000 7f229cff9640 10 client.15612 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:17.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.933+0000 7f22b90b0640 1 --2- 172.21.15.27:0/2675843931 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558550bbb9a0 0x558550bbddd0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd4f6d80de028042 server_cookie=6aadaf5336eddca9 in_seq=0 out_seq=0 2024-09-19T08:12:17.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.933+0000 7f229cff9640 1 -- 172.21.15.27:0/2675843931 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558550b137f0 con 0x558550bbb9a0 2024-09-19T08:12:17.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.933+0000 7f229cff9640 10 client.15612 handle_command_reply: tid=0 2024-09-19T08:12:17.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.933+0000 7f22bd6ed740 1 client.15612 shutdown 2024-09-19T08:12:17.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.934+0000 7f22bd6ed740 1 -- 172.21.15.27:0/2675843931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba1480 msgr2=0x558550ba9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:17.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.934+0000 7f22bd6ed740 1 --2- 172.21.15.27:0/2675843931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba1480 0x558550ba9150 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f22a400c6a0 tx=0x7f22a409c0e0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.934+0000 7f22bd6ed740 1 -- 172.21.15.27:0/2675843931 shutdown_connections 2024-09-19T08:12:17.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.934+0000 7f22bd6ed740 1 --2- 172.21.15.27:0/2675843931 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558550bbb9a0 0x558550bbddd0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.934+0000 7f229cff9640 0 client.15612 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:17.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.934+0000 7f22bd6ed740 1 --2- 172.21.15.27:0/2675843931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558550babd40 0x558550ba9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.934+0000 7f22bd6ed740 1 --2- 172.21.15.27:0/2675843931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba1480 0x558550ba9150 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.934+0000 7f22bd6ed740 1 --2- 172.21.15.27:0/2675843931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550ba0b60 0x558550ba8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.934+0000 7f22bd6ed740 1 -- 172.21.15.27:0/2675843931 >> 172.21.15.27:0/2675843931 conn(0x558550b9d0f0 msgr2=0x558550b9c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:17.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.934+0000 7f22bd6ed740 1 -- 172.21.15.27:0/2675843931 shutdown_connections 2024-09-19T08:12:17.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.934+0000 7f22bd6ed740 1 -- 172.21.15.27:0/2675843931 wait complete. 2024-09-19T08:12:17.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.934+0000 7f22bd6ed740 20 client.15612 trim_cache size 0 max 16384 2024-09-19T08:12:17.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.952+0000 7f22bd6ed740 1 Processor -- start 2024-09-19T08:12:17.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.952+0000 7f22bd6ed740 1 -- start start 2024-09-19T08:12:17.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.952+0000 7f22bd6ed740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba0b60 0x558550baaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:17.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.952+0000 7f22bd6ed740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550ba1480 0x558550bc36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:17.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.952+0000 7f22bd6ed740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558550babd40 0x558550bc3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:17.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.952+0000 7f22bd6ed740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f22b41a9540 con 0x558550ba0b60 2024-09-19T08:12:17.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.952+0000 7f22bd6ed740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f22b41abda0 con 0x558550ba1480 2024-09-19T08:12:17.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.952+0000 7f22bd6ed740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f22b41a9b90 con 0x558550babd40 2024-09-19T08:12:17.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.952+0000 7f22b90b0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba0b60 0x558550baaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:17.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.952+0000 7f22b90b0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba0b60 0x558550baaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35462/0 (socket says 172.21.15.27:35462) 2024-09-19T08:12:17.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.952+0000 7f22b90b0640 1 -- 172.21.15.27:0/9770071 learned_addr learned my addr 172.21.15.27:0/9770071 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:17.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.952+0000 7f22b98b1640 1 --2- 172.21.15.27:0/9770071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558550babd40 0x558550bc3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:17.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.952+0000 7f22b88af640 1 --2- 172.21.15.27:0/9770071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550ba1480 0x558550bc36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:17.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.953+0000 7f22b90b0640 1 -- 172.21.15.27:0/9770071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558550babd40 msgr2=0x558550bc3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:17.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.953+0000 7f22b90b0640 1 --2- 172.21.15.27:0/9770071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558550babd40 0x558550bc3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.953+0000 7f22b90b0640 1 -- 172.21.15.27:0/9770071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550ba1480 msgr2=0x558550bc36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:17.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.953+0000 7f22b90b0640 1 --2- 172.21.15.27:0/9770071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550ba1480 0x558550bc36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.953+0000 7f22b90b0640 1 -- 172.21.15.27:0/9770071 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558550ba39d0 con 0x558550ba0b60 2024-09-19T08:12:17.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.953+0000 7f22b88af640 1 --2- 172.21.15.27:0/9770071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550ba1480 0x558550bc36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:12:17.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.953+0000 7f22b90b0640 1 --2- 172.21.15.27:0/9770071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba0b60 0x558550baaa70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f22b0012cb0 tx=0x7f22b001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f00ab5a0e04ff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:17.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.953+0000 7f229effd640 1 -- 172.21.15.27:0/9770071 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b0005020 con 0x558550ba0b60 2024-09-19T08:12:17.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.953+0000 7f229effd640 1 -- 172.21.15.27:0/9770071 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22b00047a0 con 0x558550ba0b60 2024-09-19T08:12:17.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.953+0000 7f229effd640 1 -- 172.21.15.27:0/9770071 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b002b710 con 0x558550ba0b60 2024-09-19T08:12:17.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.954+0000 7f22bd6ed740 1 -- 172.21.15.27:0/9770071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba0b60 msgr2=0x558550baaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:17.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.954+0000 7f22bd6ed740 1 --2- 172.21.15.27:0/9770071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba0b60 0x558550baaa70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f22b0012cb0 tx=0x7f22b001b000 comp rx=0 tx=0).stop 2024-09-19T08:12:17.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.955+0000 7f22bd6ed740 1 -- 172.21.15.27:0/9770071 shutdown_connections 2024-09-19T08:12:17.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.955+0000 7f22bd6ed740 1 --2- 172.21.15.27:0/9770071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558550babd40 0x558550bc3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.955+0000 7f22bd6ed740 1 --2- 172.21.15.27:0/9770071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550ba1480 0x558550bc36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.955+0000 7f22bd6ed740 1 --2- 172.21.15.27:0/9770071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba0b60 0x558550baaa70 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.955+0000 7f22bd6ed740 1 -- 172.21.15.27:0/9770071 >> 172.21.15.27:0/9770071 conn(0x558550b9d0f0 msgr2=0x558550baa360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:17.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.955+0000 7f22bd6ed740 1 -- 172.21.15.27:0/9770071 shutdown_connections 2024-09-19T08:12:17.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.955+0000 7f22bd6ed740 1 -- 172.21.15.27:0/9770071 wait complete. 2024-09-19T08:12:17.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.956+0000 7f22bd6ed740 1 -- start start 2024-09-19T08:12:17.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.956+0000 7f22bd6ed740 1 Processor -- start 2024-09-19T08:12:17.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.956+0000 7f22bd6ed740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558550ba0b60 0x558550bb0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:17.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.956+0000 7f22bd6ed740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba1480 0x558550bb06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:17.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.956+0000 7f22bd6ed740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550babd40 0x558550c25670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:17.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.956+0000 7f22bd6ed740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f22b41aa260 con 0x558550ba1480 2024-09-19T08:12:17.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.956+0000 7f22bd6ed740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f22b41ab6d0 con 0x558550babd40 2024-09-19T08:12:17.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.956+0000 7f22bd6ed740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f22b41aa930 con 0x558550ba0b60 2024-09-19T08:12:17.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.956+0000 7f22bd6ed740 10 client.0 _ll_register_callbacks cb 0x7f22a409c3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:12:17.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.956+0000 7f22b88af640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba1480 0x558550bb06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:17.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.956+0000 7f22b88af640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba1480 0x558550bb06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35478/0 (socket says 172.21.15.27:35478) 2024-09-19T08:12:17.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.956+0000 7f22b88af640 1 -- 172.21.15.27:0/289078590 learned_addr learned my addr 172.21.15.27:0/289078590 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:17.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.957+0000 7f22b98b1640 1 --2- 172.21.15.27:0/289078590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550babd40 0x558550c25670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:17.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.957+0000 7f22b88af640 1 -- 172.21.15.27:0/289078590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558550ba0b60 msgr2=0x558550bb0190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:12:17.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.957+0000 7f22b88af640 1 --2- 172.21.15.27:0/289078590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558550ba0b60 0x558550bb0190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.957+0000 7f22b88af640 1 -- 172.21.15.27:0/289078590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550babd40 msgr2=0x558550c25670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:17.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.957+0000 7f22b88af640 1 --2- 172.21.15.27:0/289078590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550babd40 0x558550c25670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.957+0000 7f22b88af640 1 -- 172.21.15.27:0/289078590 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558550c25be0 con 0x558550ba1480 2024-09-19T08:12:17.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.957+0000 7f22b88af640 1 --2- 172.21.15.27:0/289078590 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba1480 0x558550bb06d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f22a4098ef0 tx=0x7f22a40ce1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9705c2fb1a733402 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:17.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.957+0000 7f229cff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:12:17.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.957+0000 7f229cff9640 1 -- 172.21.15.27:0/289078590 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a409c520 con 0x558550ba1480 2024-09-19T08:12:17.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.957+0000 7f229cff9640 1 -- 172.21.15.27:0/289078590 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f22a40cd9a0 con 0x558550ba1480 2024-09-19T08:12:17.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.957+0000 7f22bd6ed740 1 -- 172.21.15.27:0/289078590 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22b00047a0 con 0x558550ba1480 2024-09-19T08:12:17.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.958+0000 7f229cff9640 1 -- 172.21.15.27:0/289078590 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f22a4065030 con 0x558550ba1480 2024-09-19T08:12:17.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.958+0000 7f22bd6ed740 10 client.15618 fetch_fsmap learned FSMap version 20 2024-09-19T08:12:17.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.958+0000 7f22bd6ed740 1 -- 172.21.15.27:0/289078590 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558550c26e70 con 0x558550ba1480 2024-09-19T08:12:17.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.958+0000 7f229cff9640 1 -- 172.21.15.27:0/289078590 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22a407d070 con 0x558550ba1480 2024-09-19T08:12:17.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.958+0000 7f229cff9640 1 -- 172.21.15.27:0/289078590 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f22a409b3e0 con 0x558550ba1480 2024-09-19T08:12:17.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.958+0000 7f22bd6ed740 10 client.15618 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:12:17.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.958+0000 7f22bd6ed740 10 client.15618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:12:17.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.958+0000 7f22bd6ed740 20 client.15618 populate_metadata read hostname 'smithi027' 2024-09-19T08:12:17.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.958+0000 7f22bd6ed740 1 --2- 172.21.15.27:0/289078590 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558550bbb9a0 0x558550c29630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:17.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.958+0000 7f22bd6ed740 4 client.15618 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:12:17.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.958+0000 7f22bd6ed740 1 -- 172.21.15.27:0/289078590 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558550b0dd00 con 0x558550bbb9a0 2024-09-19T08:12:17.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.958+0000 7f22b90b0640 1 --2- 172.21.15.27:0/289078590 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558550bbb9a0 0x558550c29630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:17.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.959+0000 7f22b90b0640 1 --2- 172.21.15.27:0/289078590 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558550bbb9a0 0x558550c29630 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1965036b87f35b46 server_cookie=d2bc5c77cdc78b57 in_seq=0 out_seq=0 2024-09-19T08:12:17.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.959+0000 7f229cff9640 10 client.15618 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:17.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.960+0000 7f229cff9640 1 -- 172.21.15.27:0/289078590 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558550b0dd00 con 0x558550bbb9a0 2024-09-19T08:12:17.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.960+0000 7f229cff9640 10 client.15618 handle_command_reply: tid=0 2024-09-19T08:12:17.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.960+0000 7f22bd6ed740 1 client.15618 shutdown 2024-09-19T08:12:17.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.960+0000 7f22bd6ed740 1 -- 172.21.15.27:0/289078590 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba1480 msgr2=0x558550bb06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:17.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.960+0000 7f22bd6ed740 1 --2- 172.21.15.27:0/289078590 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba1480 0x558550bb06d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f22a4098ef0 tx=0x7f22a40ce1a0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.960+0000 7f22bd6ed740 1 -- 172.21.15.27:0/289078590 shutdown_connections 2024-09-19T08:12:17.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.960+0000 7f22bd6ed740 1 --2- 172.21.15.27:0/289078590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558550babd40 0x558550c25670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.960+0000 7f22bd6ed740 1 --2- 172.21.15.27:0/289078590 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558550ba1480 0x558550bb06d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.965 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:12:17.965 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:12:17.965 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "b1ae850d-6af9-4128-971f-8d10064f4c1e", 2024-09-19T08:12:17.965 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:12:17.965 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:12:17.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.960+0000 7f22bd6ed740 1 --2- 172.21.15.27:0/289078590 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558550bbb9a0 0x558550c29630 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.960+0000 7f229cff9640 0 client.15618 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:17.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.960+0000 7f22bd6ed740 1 --2- 172.21.15.27:0/289078590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558550ba0b60 0x558550bb0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.960+0000 7f22bd6ed740 1 -- 172.21.15.27:0/289078590 >> 172.21.15.27:0/289078590 conn(0x558550b9d0f0 msgr2=0x558550b9c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:17.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.961+0000 7f22bd6ed740 1 -- 172.21.15.27:0/289078590 shutdown_connections 2024-09-19T08:12:17.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.961+0000 7f22bd6ed740 1 -- 172.21.15.27:0/289078590 wait complete. 2024-09-19T08:12:17.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.961+0000 7f22bd6ed740 20 client.15618 trim_cache size 0 max 16384 2024-09-19T08:12:17.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.961+0000 7f22bb314640 1 -- 172.21.15.27:0/425302110 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f22a00abd60 msgr2=0x7f22a00ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:17.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.961+0000 7f22bb314640 1 --2- 172.21.15.27:0/425302110 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f22a00abd60 0x7f22a00ae220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x558550b9df50 tx=0x7f22b0005f90 comp rx=0 tx=0).stop 2024-09-19T08:12:17.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.961+0000 7f22bb314640 1 -- 172.21.15.27:0/425302110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22b4101360 msgr2=0x7f22b419aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:17.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.961+0000 7f22bb314640 1 --2- 172.21.15.27:0/425302110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22b4101360 0x7f22b419aca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f22a400e9f0 tx=0x7f22a400eeb0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.962+0000 7f22bb314640 1 -- 172.21.15.27:0/425302110 shutdown_connections 2024-09-19T08:12:17.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.962+0000 7f22bb314640 1 --2- 172.21.15.27:0/425302110 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f22a00abd60 0x7f22a00ae220 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.962+0000 7f22bb314640 1 --2- 172.21.15.27:0/425302110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b410e4d0 0x7f22b419df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.962+0000 7f22bb314640 1 --2- 172.21.15.27:0/425302110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22b4101360 0x7f22b419aca0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.962+0000 7f22bb314640 1 --2- 172.21.15.27:0/425302110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22b41009b0 0x7f22b419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:17.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.962+0000 7f22bb314640 1 -- 172.21.15.27:0/425302110 >> 172.21.15.27:0/425302110 conn(0x7f22b40fc7d0 msgr2=0x7f22b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:17.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.962+0000 7f22bb314640 1 -- 172.21.15.27:0/425302110 shutdown_connections 2024-09-19T08:12:17.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:17.962+0000 7f22bb314640 1 -- 172.21.15.27:0/425302110 wait complete. 2024-09-19T08:12:18.791 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:12:19.078 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:12:19.208 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:19 smithi027 ceph-mon[31209]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:12:19.208 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:19 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:12:19.208 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:19 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:12:19.208 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:19 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:12:19.208 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:19 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:12:19.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:19 smithi155 ceph-mon[35362]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:12:19.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:19 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:12:19.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:19 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:12:19.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:19 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:12:19.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:19 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:12:19.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:19 smithi203 ceph-mon[35198]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:12:19.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:19 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:12:19.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:19 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:12:19.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:19 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:12:19.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:19 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:12:19.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.653+0000 7fb58a53c640 1 -- 172.21.15.27:0/2156778283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb584102570 msgr2=0x7fb5841029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:19.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.653+0000 7fb58a53c640 1 --2- 172.21.15.27:0/2156778283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb584102570 0x7fb5841029b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb578009900 tx=0x7fb57802a480 comp rx=0 tx=0).stop 2024-09-19T08:12:19.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.654+0000 7fb58a53c640 1 -- 172.21.15.27:0/2156778283 shutdown_connections 2024-09-19T08:12:19.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.654+0000 7fb58a53c640 1 --2- 172.21.15.27:0/2156778283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb584102ef0 0x7fb58410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.654+0000 7fb58a53c640 1 --2- 172.21.15.27:0/2156778283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb584102570 0x7fb5841029b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.654+0000 7fb58a53c640 1 --2- 172.21.15.27:0/2156778283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb584100e20 0x7fb584101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.654+0000 7fb58a53c640 1 -- 172.21.15.27:0/2156778283 >> 172.21.15.27:0/2156778283 conn(0x7fb5840fc7d0 msgr2=0x7fb5840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:19.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.654+0000 7fb58a53c640 1 -- 172.21.15.27:0/2156778283 shutdown_connections 2024-09-19T08:12:19.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.654+0000 7fb58a53c640 1 -- 172.21.15.27:0/2156778283 wait complete. 2024-09-19T08:12:19.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.655+0000 7fb58a53c640 1 Processor -- start 2024-09-19T08:12:19.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.655+0000 7fb58a53c640 1 -- start start 2024-09-19T08:12:19.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.655+0000 7fb58a53c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb584100e20 0x7fb584197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:19.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.655+0000 7fb58a53c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb584102570 0x7fb584197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:19.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.655+0000 7fb58a53c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb584102ef0 0x7fb58419bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:19.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.655+0000 7fb58a53c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb584110f50 con 0x7fb584102ef0 2024-09-19T08:12:19.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.655+0000 7fb58a53c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb584110dd0 con 0x7fb584100e20 2024-09-19T08:12:19.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.655+0000 7fb58a53c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb5841110d0 con 0x7fb584102570 2024-09-19T08:12:19.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.656+0000 7fb588ad9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb584102ef0 0x7fb58419bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:19.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.656+0000 7fb588ad9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb584102ef0 0x7fb58419bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35484/0 (socket says 172.21.15.27:35484) 2024-09-19T08:12:19.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.656+0000 7fb588ad9640 1 -- 172.21.15.27:0/3334962937 learned_addr learned my addr 172.21.15.27:0/3334962937 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:19.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.656+0000 7fb583fff640 1 --2- 172.21.15.27:0/3334962937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb584100e20 0x7fb584197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:19.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.656+0000 7fb5837fe640 1 --2- 172.21.15.27:0/3334962937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb584102570 0x7fb584197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:19.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.656+0000 7fb588ad9640 1 -- 172.21.15.27:0/3334962937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb584102570 msgr2=0x7fb584197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:19.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.656+0000 7fb588ad9640 1 --2- 172.21.15.27:0/3334962937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb584102570 0x7fb584197970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.656+0000 7fb588ad9640 1 -- 172.21.15.27:0/3334962937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb584100e20 msgr2=0x7fb584197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:19.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.656+0000 7fb588ad9640 1 --2- 172.21.15.27:0/3334962937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb584100e20 0x7fb584197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.656+0000 7fb588ad9640 1 -- 172.21.15.27:0/3334962937 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb58419c3e0 con 0x7fb584102ef0 2024-09-19T08:12:19.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.656+0000 7fb583fff640 1 --2- 172.21.15.27:0/3334962937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb584100e20 0x7fb584197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:12:19.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.656+0000 7fb588ad9640 1 --2- 172.21.15.27:0/3334962937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb584102ef0 0x7fb58419bd00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00ed70 tx=0x7fb57c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:19.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.656+0000 7fb5817fa640 1 -- 172.21.15.27:0/3334962937 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57c004b20 con 0x7fb584102ef0 2024-09-19T08:12:19.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.657+0000 7fb58a53c640 1 -- 172.21.15.27:0/3334962937 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb58419c6d0 con 0x7fb584102ef0 2024-09-19T08:12:19.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.657+0000 7fb5817fa640 1 -- 172.21.15.27:0/3334962937 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb57c004cc0 con 0x7fb584102ef0 2024-09-19T08:12:19.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.657+0000 7fb5817fa640 1 -- 172.21.15.27:0/3334962937 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57c005540 con 0x7fb584102ef0 2024-09-19T08:12:19.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.657+0000 7fb58a53c640 1 -- 172.21.15.27:0/3334962937 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb584069f70 con 0x7fb584102ef0 2024-09-19T08:12:19.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.660+0000 7fb58c915740 1 Processor -- start 2024-09-19T08:12:19.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.660+0000 7fb5817fa640 1 -- 172.21.15.27:0/3334962937 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7fb57c0056e0 con 0x7fb584102ef0 2024-09-19T08:12:19.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.660+0000 7fb58c915740 1 -- start start 2024-09-19T08:12:19.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.661+0000 7fb58c915740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bf44a0 0x555693bf4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:19.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.661+0000 7fb58c915740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bf4dc0 0x555693bff140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:19.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.661+0000 7fb58c915740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555693bff680 0x555693c01a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:19.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.661+0000 7fb58c915740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x555693b5a2e0 con 0x555693bf4dc0 2024-09-19T08:12:19.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.661+0000 7fb58c915740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x555693b01ce0 con 0x555693bff680 2024-09-19T08:12:19.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.661+0000 7fb58c915740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555693b562a0 con 0x555693bf44a0 2024-09-19T08:12:19.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.661+0000 7fb5837fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bf44a0 0x555693bf4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:19.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.661+0000 7fb5837fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bf44a0 0x555693bf4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.27:56580/0 (socket says 172.21.15.27:56580) 2024-09-19T08:12:19.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.661+0000 7fb5837fe640 1 -- 172.21.15.27:0/3359907305 learned_addr learned my addr 172.21.15.27:0/3359907305 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:19.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.661+0000 7fb583fff640 1 --2- 172.21.15.27:0/3359907305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bf4dc0 0x555693bff140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:19.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.661+0000 7fb5817fa640 1 --2- 172.21.15.27:0/3334962937 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb56c0a34d0 0x7fb56c0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:19.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.662+0000 7fb583fff640 1 -- 172.21.15.27:0/3359907305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bf44a0 msgr2=0x555693bf4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:19.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.662+0000 7fb583fff640 1 --2- 172.21.15.27:0/3359907305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bf44a0 0x555693bf4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.662+0000 7fb5817fa640 1 -- 172.21.15.27:0/3334962937 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fb57c0d2370 con 0x7fb584102ef0 2024-09-19T08:12:19.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.662+0000 7fb583fff640 1 -- 172.21.15.27:0/3359907305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555693bff680 msgr2=0x555693c01a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:19.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.662+0000 7fb583fff640 1 --2- 172.21.15.27:0/3359907305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555693bff680 0x555693c01a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.662+0000 7fb583fff640 1 -- 172.21.15.27:0/3359907305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555693ae6440 con 0x555693bf4dc0 2024-09-19T08:12:19.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.662+0000 7fb5837fe640 1 --2- 172.21.15.27:0/3359907305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bf44a0 0x555693bf4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:12:19.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.662+0000 7fb583fff640 1 --2- 172.21.15.27:0/3359907305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bf4dc0 0x555693bff140 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb57400ce30 tx=0x7fb57400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4577a54c50b43b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:19.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.662+0000 7fb588ad9640 1 --2- 172.21.15.27:0/3334962937 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb56c0a34d0 0x7fb56c0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.662+0000 7fb56a7fc640 1 -- 172.21.15.27:0/3359907305 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb574005220 con 0x555693bf4dc0 2024-09-19T08:12:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.663+0000 7fb56a7fc640 1 -- 172.21.15.27:0/3359907305 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb574004c80 con 0x555693bf4dc0 2024-09-19T08:12:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.663+0000 7fb56a7fc640 1 -- 172.21.15.27:0/3359907305 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5740108a0 con 0x555693bf4dc0 2024-09-19T08:12:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.663+0000 7fb58c915740 1 -- 172.21.15.27:0/3359907305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bf4dc0 msgr2=0x555693bff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.663+0000 7fb588ad9640 1 --2- 172.21.15.27:0/3334962937 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb56c0a34d0 0x7fb56c0a5990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb57c0cfb00 tx=0x7fb57c013040 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.663+0000 7fb58c915740 1 --2- 172.21.15.27:0/3359907305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bf4dc0 0x555693bff140 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb57400ce30 tx=0x7fb57400e720 comp rx=0 tx=0).stop 2024-09-19T08:12:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.663+0000 7fb58c915740 1 -- 172.21.15.27:0/3359907305 shutdown_connections 2024-09-19T08:12:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.663+0000 7fb58c915740 1 --2- 172.21.15.27:0/3359907305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555693bff680 0x555693c01a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.663+0000 7fb58c915740 1 --2- 172.21.15.27:0/3359907305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bf4dc0 0x555693bff140 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.663+0000 7fb58c915740 1 --2- 172.21.15.27:0/3359907305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bf44a0 0x555693bf4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.663+0000 7fb58c915740 1 -- 172.21.15.27:0/3359907305 >> 172.21.15.27:0/3359907305 conn(0x555693bf0a30 msgr2=0x555693bf0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:19.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.664+0000 7fb58c915740 1 -- 172.21.15.27:0/3359907305 shutdown_connections 2024-09-19T08:12:19.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.664+0000 7fb58c915740 1 -- 172.21.15.27:0/3359907305 wait complete. 2024-09-19T08:12:19.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.664+0000 7fb58c915740 1 -- start start 2024-09-19T08:12:19.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.664+0000 7fb58c915740 1 Processor -- start 2024-09-19T08:12:19.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.665+0000 7fb58c915740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555693bf44a0 0x555693bf85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:19.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.665+0000 7fb58c915740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bf4dc0 0x555693bf8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:19.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.665+0000 7fb58c915740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bff680 0x555693bf9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:19.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.665+0000 7fb5837fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bff680 0x555693bf9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:19.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.665+0000 7fb5837fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bff680 0x555693bf9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35494/0 (socket says 172.21.15.27:35494) 2024-09-19T08:12:19.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.665+0000 7fb583fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bf4dc0 0x555693bf8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:19.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.665+0000 7fb583fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bf4dc0 0x555693bf8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.27:56594/0 (socket says 172.21.15.27:56594) 2024-09-19T08:12:19.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.665+0000 7fb5837fe640 1 -- 172.21.15.27:0/1253440605 learned_addr learned my addr 172.21.15.27:0/1253440605 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:19.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.665+0000 7fb58c915740 1 -- 172.21.15.27:0/1253440605 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x555693c021f0 con 0x555693bff680 2024-09-19T08:12:19.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.665+0000 7fb58c915740 1 -- 172.21.15.27:0/1253440605 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x555693b15050 con 0x555693bf44a0 2024-09-19T08:12:19.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.665+0000 7fb58c915740 1 -- 172.21.15.27:0/1253440605 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555693c02370 con 0x555693bf4dc0 2024-09-19T08:12:19.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.666+0000 7fb5837fe640 1 --2- 172.21.15.27:0/1253440605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555693bf44a0 0x555693bf85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:19.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.666+0000 7fb5837fe640 1 -- 172.21.15.27:0/1253440605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bf4dc0 msgr2=0x555693bf8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:19.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.666+0000 7fb5837fe640 1 --2- 172.21.15.27:0/1253440605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bf4dc0 0x555693bf8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.666+0000 7fb5837fe640 1 -- 172.21.15.27:0/1253440605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555693bf44a0 msgr2=0x555693bf85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:19.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.666+0000 7fb5837fe640 1 --2- 172.21.15.27:0/1253440605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555693bf44a0 0x555693bf85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.666+0000 7fb5837fe640 1 -- 172.21.15.27:0/1253440605 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556938cb3c0 con 0x555693bff680 2024-09-19T08:12:19.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.666+0000 7fb5837fe640 1 --2- 172.21.15.27:0/1253440605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bff680 0x555693bf9050 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb578005ab0 tx=0x7fb578005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faecefa247213fff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:19.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.666+0000 7fb5637fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:12:19.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.666+0000 7fb5637fe640 1 -- 172.21.15.27:0/1253440605 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb578035040 con 0x555693bff680 2024-09-19T08:12:19.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.667+0000 7fb5637fe640 1 -- 172.21.15.27:0/1253440605 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fb578031540 con 0x555693bff680 2024-09-19T08:12:19.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.667+0000 7fb58c915740 10 client.0 _ll_register_callbacks cb 0x555693b55160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:12:19.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.667+0000 7fb58c915740 1 -- 172.21.15.27:0/1253440605 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb574004c80 con 0x555693bff680 2024-09-19T08:12:19.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.667+0000 7fb5637fe640 1 -- 172.21.15.27:0/1253440605 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb578003eb0 con 0x555693bff680 2024-09-19T08:12:19.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.667+0000 7fb58c915740 10 client.15630 fetch_fsmap learned FSMap version 20 2024-09-19T08:12:19.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.667+0000 7fb58c915740 1 -- 172.21.15.27:0/1253440605 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({fsmap=20}) -- 0x555693c162b0 con 0x555693bff680 2024-09-19T08:12:19.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.668+0000 7fb5637fe640 1 -- 172.21.15.27:0/1253440605 <== mon.0 v2:172.21.15.27:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb57803a070 con 0x555693bff680 2024-09-19T08:12:19.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.668+0000 7fb58c915740 10 client.15630 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:12:19.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.668+0000 7fb58c915740 10 client.15630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:12:19.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.668+0000 7fb58c915740 20 client.15630 populate_metadata read hostname 'smithi027' 2024-09-19T08:12:19.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.668+0000 7fb58c915740 1 --2- 172.21.15.27:0/1253440605 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555693c176b0 0x555693c19b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:19.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.668+0000 7fb58c915740 4 client.15630 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:12:19.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.668+0000 7fb58c915740 1 -- 172.21.15.27:0/1253440605 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555693b67850 con 0x555693c176b0 2024-09-19T08:12:19.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.668+0000 7fb583fff640 1 --2- 172.21.15.27:0/1253440605 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555693c176b0 0x555693c19b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:19.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.669+0000 7fb5637fe640 10 client.15630 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:19.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.669+0000 7fb583fff640 1 --2- 172.21.15.27:0/1253440605 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555693c176b0 0x555693c19b40 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6ae3103f1730653 server_cookie=c650d324af6b4d1 in_seq=0 out_seq=0 2024-09-19T08:12:19.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.669+0000 7fb5637fe640 1 -- 172.21.15.27:0/1253440605 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555693b67850 con 0x555693c176b0 2024-09-19T08:12:19.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.669+0000 7fb5637fe640 10 client.15630 handle_command_reply: tid=0 2024-09-19T08:12:19.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.670+0000 7fb58c915740 1 client.15630 shutdown 2024-09-19T08:12:19.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.670+0000 7fb58c915740 1 -- 172.21.15.27:0/1253440605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bff680 msgr2=0x555693bf9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:19.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.670+0000 7fb58c915740 1 --2- 172.21.15.27:0/1253440605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bff680 0x555693bf9050 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb578005ab0 tx=0x7fb578005fd0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.670+0000 7fb58c915740 1 -- 172.21.15.27:0/1253440605 shutdown_connections 2024-09-19T08:12:19.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.670+0000 7fb58c915740 1 --2- 172.21.15.27:0/1253440605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bff680 0x555693bf9050 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.670+0000 7fb58c915740 1 --2- 172.21.15.27:0/1253440605 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555693c176b0 0x555693c19b40 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.670+0000 7fb58c915740 1 --2- 172.21.15.27:0/1253440605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bf4dc0 0x555693bf8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.670+0000 7fb5637fe640 0 client.15630 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:19.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.670+0000 7fb58c915740 1 --2- 172.21.15.27:0/1253440605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555693bf44a0 0x555693bf85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.670+0000 7fb58c915740 1 -- 172.21.15.27:0/1253440605 >> 172.21.15.27:0/1253440605 conn(0x555693bf0a30 msgr2=0x555693bf6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:19.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.670+0000 7fb58c915740 1 -- 172.21.15.27:0/1253440605 shutdown_connections 2024-09-19T08:12:19.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.671+0000 7fb58c915740 1 -- 172.21.15.27:0/1253440605 wait complete. 2024-09-19T08:12:19.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.671+0000 7fb58c915740 20 client.15630 trim_cache size 0 max 16384 2024-09-19T08:12:19.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.704+0000 7fb58c915740 1 Processor -- start 2024-09-19T08:12:19.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.704+0000 7fb58c915740 1 -- start start 2024-09-19T08:12:19.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.704+0000 7fb58c915740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bf44a0 0x555693bfbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:19.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.704+0000 7fb58c915740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555693bf4dc0 0x555693c1f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:19.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.704+0000 7fb5837fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bf44a0 0x555693bfbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:19.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.704+0000 7fb58c915740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bff680 0x555693c1f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:19.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.704+0000 7fb58c915740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb5841a9570 con 0x555693bf44a0 2024-09-19T08:12:19.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.704+0000 7fb58c915740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb5841abdf0 con 0x555693bf4dc0 2024-09-19T08:12:19.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.704+0000 7fb5837fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bf44a0 0x555693bfbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35498/0 (socket says 172.21.15.27:35498) 2024-09-19T08:12:19.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.704+0000 7fb58c915740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb5841a9be0 con 0x555693bff680 2024-09-19T08:12:19.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.704+0000 7fb5837fe640 1 -- 172.21.15.27:0/1893444571 learned_addr learned my addr 172.21.15.27:0/1893444571 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:19.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.705+0000 7fb583fff640 1 --2- 172.21.15.27:0/1893444571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555693bf4dc0 0x555693c1f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:19.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.705+0000 7fb5837fe640 1 -- 172.21.15.27:0/1893444571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bff680 msgr2=0x555693c1f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:19.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.705+0000 7fb5837fe640 1 --2- 172.21.15.27:0/1893444571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bff680 0x555693c1f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.705+0000 7fb5837fe640 1 -- 172.21.15.27:0/1893444571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555693bf4dc0 msgr2=0x555693c1f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:19.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.705+0000 7fb5837fe640 1 --2- 172.21.15.27:0/1893444571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555693bf4dc0 0x555693c1f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.705+0000 7fb5837fe640 1 -- 172.21.15.27:0/1893444571 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555693bf42d0 con 0x555693bf44a0 2024-09-19T08:12:19.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.705+0000 7fb583fff640 1 --2- 172.21.15.27:0/1893444571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555693bf4dc0 0x555693c1f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:12:19.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.705+0000 7fb5837fe640 1 --2- 172.21.15.27:0/1893444571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bf44a0 0x555693bfbe40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb578009230 tx=0x7fb578043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42118fa995988ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:19.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.705+0000 7fb569ffb640 1 -- 172.21.15.27:0/1893444571 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb578057070 con 0x555693bf44a0 2024-09-19T08:12:19.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.706+0000 7fb569ffb640 1 -- 172.21.15.27:0/1893444571 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb574004c80 con 0x555693bf44a0 2024-09-19T08:12:19.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.706+0000 7fb569ffb640 1 -- 172.21.15.27:0/1893444571 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb578031540 con 0x555693bf44a0 2024-09-19T08:12:19.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.707+0000 7fb58c915740 1 -- 172.21.15.27:0/1893444571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bf44a0 msgr2=0x555693bfbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:19.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.707+0000 7fb58c915740 1 --2- 172.21.15.27:0/1893444571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bf44a0 0x555693bfbe40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb578009230 tx=0x7fb578043000 comp rx=0 tx=0).stop 2024-09-19T08:12:19.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.707+0000 7fb58c915740 1 -- 172.21.15.27:0/1893444571 shutdown_connections 2024-09-19T08:12:19.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.707+0000 7fb58c915740 1 --2- 172.21.15.27:0/1893444571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bff680 0x555693c1f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.707+0000 7fb58c915740 1 --2- 172.21.15.27:0/1893444571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555693bf4dc0 0x555693c1f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.707+0000 7fb58c915740 1 --2- 172.21.15.27:0/1893444571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bf44a0 0x555693bfbe40 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.707+0000 7fb58c915740 1 -- 172.21.15.27:0/1893444571 >> 172.21.15.27:0/1893444571 conn(0x555693bf0a30 msgr2=0x555693c02dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:19.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.707+0000 7fb58c915740 1 -- 172.21.15.27:0/1893444571 shutdown_connections 2024-09-19T08:12:19.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.707+0000 7fb58c915740 1 -- 172.21.15.27:0/1893444571 wait complete. 2024-09-19T08:12:19.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.707+0000 7fb58c915740 1 -- start start 2024-09-19T08:12:19.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.707+0000 7fb58c915740 1 Processor -- start 2024-09-19T08:12:19.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.708+0000 7fb58c915740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555693bf44a0 0x555693c11bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:19.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.708+0000 7fb58c915740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bf4dc0 0x555693c120f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:19.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.708+0000 7fb58c915740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bff680 0x555693c12630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:19.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.708+0000 7fb58c915740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb5841aa2b0 con 0x555693bf4dc0 2024-09-19T08:12:19.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.708+0000 7fb58c915740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb5841ab720 con 0x555693bf44a0 2024-09-19T08:12:19.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.708+0000 7fb58c915740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb5841aa980 con 0x555693bff680 2024-09-19T08:12:19.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.708+0000 7fb583fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bf4dc0 0x555693c120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:19.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.708+0000 7fb58c915740 10 client.0 _ll_register_callbacks cb 0x7fb57c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:12:19.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.708+0000 7fb583fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bf4dc0 0x555693c120f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35512/0 (socket says 172.21.15.27:35512) 2024-09-19T08:12:19.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.708+0000 7fb583fff640 1 -- 172.21.15.27:0/3377644422 learned_addr learned my addr 172.21.15.27:0/3377644422 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:19.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.708+0000 7fb5837fe640 1 --2- 172.21.15.27:0/3377644422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555693bf44a0 0x555693c11bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:19.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.709+0000 7fb5837fe640 1 --2- 172.21.15.27:0/3377644422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bff680 0x555693c12630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:19.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.709+0000 7fb583fff640 1 -- 172.21.15.27:0/3377644422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bff680 msgr2=0x555693c12630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:19.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.709+0000 7fb583fff640 1 --2- 172.21.15.27:0/3377644422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bff680 0x555693c12630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.709+0000 7fb583fff640 1 -- 172.21.15.27:0/3377644422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555693bf44a0 msgr2=0x555693c11bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:19.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.709+0000 7fb583fff640 1 --2- 172.21.15.27:0/3377644422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555693bf44a0 0x555693c11bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.709+0000 7fb583fff640 1 -- 172.21.15.27:0/3377644422 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555693c81460 con 0x555693bf4dc0 2024-09-19T08:12:19.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.709+0000 7fb583fff640 1 --2- 172.21.15.27:0/3377644422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bf4dc0 0x555693c120f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb57400ce30 tx=0x7fb574010490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e650eee57da83d39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:19.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.709+0000 7fb5637fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:12:19.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.709+0000 7fb5637fe640 1 -- 172.21.15.27:0/3377644422 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb574004a70 con 0x555693bf4dc0 2024-09-19T08:12:19.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.709+0000 7fb58c915740 1 -- 172.21.15.27:0/3377644422 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb574004c80 con 0x555693bf4dc0 2024-09-19T08:12:19.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.710+0000 7fb5637fe640 1 -- 172.21.15.27:0/3377644422 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fb574004020 con 0x555693bf4dc0 2024-09-19T08:12:19.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.710+0000 7fb5637fe640 1 -- 172.21.15.27:0/3377644422 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb574004220 con 0x555693bf4dc0 2024-09-19T08:12:19.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.710+0000 7fb58c915740 10 client.15636 fetch_fsmap learned FSMap version 20 2024-09-19T08:12:19.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.710+0000 7fb58c915740 1 -- 172.21.15.27:0/3377644422 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555693c827b0 con 0x555693bf4dc0 2024-09-19T08:12:19.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.710+0000 7fb5637fe640 1 -- 172.21.15.27:0/3377644422 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb574004c80 con 0x555693bf4dc0 2024-09-19T08:12:19.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.710+0000 7fb5637fe640 1 -- 172.21.15.27:0/3377644422 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb574003680 con 0x555693bf4dc0 2024-09-19T08:12:19.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.710+0000 7fb58c915740 10 client.15636 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:12:19.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.710+0000 7fb58c915740 10 client.15636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:12:19.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.710+0000 7fb58c915740 20 client.15636 populate_metadata read hostname 'smithi027' 2024-09-19T08:12:19.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.710+0000 7fb58c915740 1 --2- 172.21.15.27:0/3377644422 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555693c82bb0 0x555693c84fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:19.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.710+0000 7fb58c915740 4 client.15636 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:12:19.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.710+0000 7fb58c915740 1 -- 172.21.15.27:0/3377644422 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555693b61d60 con 0x555693c82bb0 2024-09-19T08:12:19.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.711+0000 7fb5837fe640 1 --2- 172.21.15.27:0/3377644422 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555693c82bb0 0x555693c84fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:19.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.711+0000 7fb5637fe640 10 client.15636 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:19.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.711+0000 7fb5837fe640 1 --2- 172.21.15.27:0/3377644422 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555693c82bb0 0x555693c84fd0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad4e8496c68e15f6 server_cookie=efd30e96537f106 in_seq=0 out_seq=0 2024-09-19T08:12:19.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.711+0000 7fb5637fe640 1 -- 172.21.15.27:0/3377644422 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x555693b61d60 con 0x555693c82bb0 2024-09-19T08:12:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.711+0000 7fb5637fe640 10 client.15636 handle_command_reply: tid=0 2024-09-19T08:12:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.711+0000 7fb58c915740 1 client.15636 shutdown 2024-09-19T08:12:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.712+0000 7fb58c915740 1 -- 172.21.15.27:0/3377644422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bf4dc0 msgr2=0x555693c120f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.712+0000 7fb58c915740 1 --2- 172.21.15.27:0/3377644422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bf4dc0 0x555693c120f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb57400ce30 tx=0x7fb574010490 comp rx=0 tx=0).stop 2024-09-19T08:12:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.712+0000 7fb58c915740 1 -- 172.21.15.27:0/3377644422 shutdown_connections 2024-09-19T08:12:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.712+0000 7fb58c915740 1 --2- 172.21.15.27:0/3377644422 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555693c82bb0 0x555693c84fd0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.712+0000 7fb58c915740 1 --2- 172.21.15.27:0/3377644422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555693bff680 0x555693c12630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.712+0000 7fb5637fe640 0 client.15636 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.712+0000 7fb58c915740 1 --2- 172.21.15.27:0/3377644422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555693bf4dc0 0x555693c120f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.712+0000 7fb58c915740 1 --2- 172.21.15.27:0/3377644422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555693bf44a0 0x555693c11bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.712+0000 7fb58c915740 1 -- 172.21.15.27:0/3377644422 >> 172.21.15.27:0/3377644422 conn(0x555693bf0a30 msgr2=0x555693bef350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.712+0000 7fb58c915740 1 -- 172.21.15.27:0/3377644422 shutdown_connections 2024-09-19T08:12:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.712+0000 7fb58c915740 1 -- 172.21.15.27:0/3377644422 wait complete. 2024-09-19T08:12:19.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.713+0000 7fb58c915740 20 client.15636 trim_cache size 0 max 16384 2024-09-19T08:12:19.716 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:12:19.716 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:12:19.716 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": { 2024-09-19T08:12:19.716 INFO:teuthology.orchestra.run.smithi027.stdout: "b1ae850d-6af9-4128-971f-8d10064f4c1e": { 2024-09-19T08:12:19.716 INFO:teuthology.orchestra.run.smithi027.stdout: "path": "/", 2024-09-19T08:12:19.717 INFO:teuthology.orchestra.run.smithi027.stdout: "tag": "b1ae850d-6af9-4128-971f-8d10064f4c1e", 2024-09-19T08:12:19.717 INFO:teuthology.orchestra.run.smithi027.stdout: "options": "recursive,force" 2024-09-19T08:12:19.717 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:19.717 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:19.717 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:12:19.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.713+0000 7fb58a53c640 1 -- 172.21.15.27:0/3334962937 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb56c0a34d0 msgr2=0x7fb56c0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:19.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.713+0000 7fb58a53c640 1 --2- 172.21.15.27:0/3334962937 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb56c0a34d0 0x7fb56c0a5990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb57c0cfb00 tx=0x7fb57c013040 comp rx=0 tx=0).stop 2024-09-19T08:12:19.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.713+0000 7fb58a53c640 1 -- 172.21.15.27:0/3334962937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb584102ef0 msgr2=0x7fb58419bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:19.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.713+0000 7fb58a53c640 1 --2- 172.21.15.27:0/3334962937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb584102ef0 0x7fb58419bd00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00ed70 tx=0x7fb57c00c6a0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.713+0000 7fb58a53c640 1 -- 172.21.15.27:0/3334962937 shutdown_connections 2024-09-19T08:12:19.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.713+0000 7fb58a53c640 1 --2- 172.21.15.27:0/3334962937 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb56c0a34d0 0x7fb56c0a5990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.713+0000 7fb58a53c640 1 --2- 172.21.15.27:0/3334962937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb584102ef0 0x7fb58419bd00 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.713+0000 7fb58a53c640 1 --2- 172.21.15.27:0/3334962937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb584102570 0x7fb584197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.713+0000 7fb58a53c640 1 --2- 172.21.15.27:0/3334962937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb584100e20 0x7fb584197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:19.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.713+0000 7fb58a53c640 1 -- 172.21.15.27:0/3334962937 >> 172.21.15.27:0/3334962937 conn(0x7fb5840fc7d0 msgr2=0x7fb5840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:19.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.714+0000 7fb58a53c640 1 -- 172.21.15.27:0/3334962937 shutdown_connections 2024-09-19T08:12:19.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:19.714+0000 7fb58a53c640 1 -- 172.21.15.27:0/3334962937 wait complete. 2024-09-19T08:12:20.639 INFO:tasks.cephfs.filesystem:scrub status for tag:b1ae850d-6af9-4128-971f-8d10064f4c1e - {'path': '/', 'tag': 'b1ae850d-6af9-4128-971f-8d10064f4c1e', 'options': 'recursive,force'} 2024-09-19T08:12:21.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:21 smithi155 ceph-mon[35362]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:12:21.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:21 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:12:21.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:21 smithi027 ceph-mon[31209]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:12:21.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:21 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:12:21.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:21 smithi203 ceph-mon[35198]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:12:21.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:21 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:12:23.310 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:23 smithi203 ceph-mon[35198]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T08:12:23.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:23 smithi155 ceph-mon[35362]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T08:12:23.501 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:23 smithi027 ceph-mon[31209]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T08:12:25.288 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:25 smithi155 ceph-mon[35362]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:12:25.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:25 smithi027 ceph-mon[31209]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:12:25.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:25 smithi203 ceph-mon[35198]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:12:27.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:27 smithi155 ceph-mon[35362]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:12:27.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:27 smithi027 ceph-mon[31209]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:12:27.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:27 smithi203 ceph-mon[35198]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:12:27.681 INFO:tasks.workunit.client.0.smithi027.stderr:Updating files: 96% (12387/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T08:12:28.308 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T08:12:28.309 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T08:12:28.309 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:12:28.570 INFO:tasks.workunit.client.0.smithi027.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T08:12:28.571 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-19T08:12:28.571 INFO:tasks.workunit.client.0.smithi027.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T08:12:28.571 INFO:tasks.workunit.client.0.smithi027.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T08:12:28.571 INFO:tasks.workunit.client.0.smithi027.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T08:12:28.571 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-19T08:12:28.571 INFO:tasks.workunit.client.0.smithi027.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T08:12:28.571 INFO:tasks.workunit.client.0.smithi027.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T08:12:28.571 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-19T08:12:28.572 INFO:tasks.workunit.client.0.smithi027.stderr: git switch -c 2024-09-19T08:12:28.572 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-19T08:12:28.572 INFO:tasks.workunit.client.0.smithi027.stderr:Or undo this operation with: 2024-09-19T08:12:28.572 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-19T08:12:28.572 INFO:tasks.workunit.client.0.smithi027.stderr: git switch - 2024-09-19T08:12:28.572 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-19T08:12:28.572 INFO:tasks.workunit.client.0.smithi027.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T08:12:28.572 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-19T08:12:28.572 INFO:tasks.workunit.client.0.smithi027.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T08:12:28.576 DEBUG:teuthology.orchestra.run.smithi027:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T08:12:28.581 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:12:28.604 INFO:tasks.workunit.client.0.smithi027.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T08:12:28.606 INFO:tasks.workunit.client.0.smithi027.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T08:12:28.606 INFO:tasks.workunit.client.0.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T08:12:29.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.168+0000 7f998fe8a640 1 -- 172.21.15.27:0/578909107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9988102ef0 msgr2=0x7f998810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:29.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.168+0000 7f998fe8a640 1 --2- 172.21.15.27:0/578909107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9988102ef0 0x7f998810da40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9978009ca0 tx=0x7f997802a950 comp rx=0 tx=0).stop 2024-09-19T08:12:29.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.168+0000 7f998fe8a640 1 -- 172.21.15.27:0/578909107 shutdown_connections 2024-09-19T08:12:29.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.168+0000 7f998fe8a640 1 --2- 172.21.15.27:0/578909107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9988102ef0 0x7f998810da40 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:29.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.168+0000 7f998fe8a640 1 --2- 172.21.15.27:0/578909107 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9988102570 0x7f99881029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:29.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.168+0000 7f998fe8a640 1 --2- 172.21.15.27:0/578909107 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9988100e20 0x7f9988101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:29.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.168+0000 7f998fe8a640 1 -- 172.21.15.27:0/578909107 >> 172.21.15.27:0/578909107 conn(0x7f99880fc7d0 msgr2=0x7f99880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:29.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.168+0000 7f998fe8a640 1 -- 172.21.15.27:0/578909107 shutdown_connections 2024-09-19T08:12:29.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.168+0000 7f998fe8a640 1 -- 172.21.15.27:0/578909107 wait complete. 2024-09-19T08:12:29.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.168+0000 7f998fe8a640 1 Processor -- start 2024-09-19T08:12:29.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.168+0000 7f998fe8a640 1 -- start start 2024-09-19T08:12:29.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.169+0000 7f998fe8a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9988100e20 0x7f99881983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:29.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.169+0000 7f998fe8a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9988102570 0x7f9988198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:29.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.169+0000 7f998fe8a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9988102ef0 0x7f998819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:29.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.169+0000 7f998fe8a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9988110f80 con 0x7f9988102ef0 2024-09-19T08:12:29.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.169+0000 7f998fe8a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9988110e00 con 0x7f9988100e20 2024-09-19T08:12:29.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.169+0000 7f998fe8a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9988111100 con 0x7f9988102570 2024-09-19T08:12:29.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.169+0000 7f998e427640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9988102ef0 0x7f998819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:29.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.169+0000 7f998e427640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9988102ef0 0x7f998819cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43672/0 (socket says 172.21.15.27:43672) 2024-09-19T08:12:29.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.169+0000 7f998e427640 1 -- 172.21.15.27:0/106424993 learned_addr learned my addr 172.21.15.27:0/106424993 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:29.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.169+0000 7f998dc26640 1 --2- 172.21.15.27:0/106424993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9988100e20 0x7f99881983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:29.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.169+0000 7f998d425640 1 --2- 172.21.15.27:0/106424993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9988102570 0x7f9988198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:29.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.169+0000 7f998e427640 1 -- 172.21.15.27:0/106424993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9988102570 msgr2=0x7f9988198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:29.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.169+0000 7f998e427640 1 --2- 172.21.15.27:0/106424993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9988102570 0x7f9988198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:29.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.169+0000 7f998e427640 1 -- 172.21.15.27:0/106424993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9988100e20 msgr2=0x7f99881983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:29.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.169+0000 7f998e427640 1 --2- 172.21.15.27:0/106424993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9988100e20 0x7f99881983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:29.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.169+0000 7f998e427640 1 -- 172.21.15.27:0/106424993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f998819d380 con 0x7f9988102ef0 2024-09-19T08:12:29.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.170+0000 7f998e427640 1 --2- 172.21.15.27:0/106424993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9988102ef0 0x7f998819cca0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f997802ae70 tx=0x7f997802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:29.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.170+0000 7f9986ffd640 1 -- 172.21.15.27:0/106424993 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978034040 con 0x7f9988102ef0 2024-09-19T08:12:29.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.170+0000 7f9986ffd640 1 -- 172.21.15.27:0/106424993 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9978030920 con 0x7f9988102ef0 2024-09-19T08:12:29.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.170+0000 7f998fe8a640 1 -- 172.21.15.27:0/106424993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f998819d610 con 0x7f9988102ef0 2024-09-19T08:12:29.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.170+0000 7f9986ffd640 1 -- 172.21.15.27:0/106424993 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99780047f0 con 0x7f9988102ef0 2024-09-19T08:12:29.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.170+0000 7f998fe8a640 1 -- 172.21.15.27:0/106424993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99881a4f50 con 0x7f9988102ef0 2024-09-19T08:12:29.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.171+0000 7f998fe8a640 1 -- 172.21.15.27:0/106424993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99881021b0 con 0x7f9988102ef0 2024-09-19T08:12:29.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.173+0000 7f9986ffd640 1 -- 172.21.15.27:0/106424993 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7f9978037020 con 0x7f9988102ef0 2024-09-19T08:12:29.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.173+0000 7f9986ffd640 1 --2- 172.21.15.27:0/106424993 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f99700a34d0 0x7f99700a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:29.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.173+0000 7f998dc26640 1 --2- 172.21.15.27:0/106424993 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f99700a34d0 0x7f99700a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:29.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.173+0000 7f9986ffd640 1 -- 172.21.15.27:0/106424993 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f99780f0d50 con 0x7f9988102ef0 2024-09-19T08:12:29.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.174+0000 7f998dc26640 1 --2- 172.21.15.27:0/106424993 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f99700a34d0 0x7f99700a5990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f998000abe0 tx=0x7f998000a2d0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:29.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.177+0000 7f9986ffd640 1 -- 172.21.15.27:0/106424993 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f99780bd640 con 0x7f9988102ef0 2024-09-19T08:12:29.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.391+0000 7f998fe8a640 1 -- 172.21.15.27:0/106424993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f998810a0a0 con 0x7f9988102ef0 2024-09-19T08:12:29.391 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:29 smithi027 ceph-mon[31209]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:12:29.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.392+0000 7f9986ffd640 1 -- 172.21.15.27:0/106424993 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f99780bcf40 con 0x7f9988102ef0 2024-09-19T08:12:29.392 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:12:29.392 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:12:29.392 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:12:29.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.394+0000 7f998fe8a640 1 -- 172.21.15.27:0/106424993 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f99700a34d0 msgr2=0x7f99700a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:29.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.394+0000 7f998fe8a640 1 --2- 172.21.15.27:0/106424993 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f99700a34d0 0x7f99700a5990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f998000abe0 tx=0x7f998000a2d0 comp rx=0 tx=0).stop 2024-09-19T08:12:29.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.394+0000 7f998fe8a640 1 -- 172.21.15.27:0/106424993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9988102ef0 msgr2=0x7f998819cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:29.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.394+0000 7f998fe8a640 1 --2- 172.21.15.27:0/106424993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9988102ef0 0x7f998819cca0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f997802ae70 tx=0x7f997802f5d0 comp rx=0 tx=0).stop 2024-09-19T08:12:29.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.394+0000 7f998fe8a640 1 -- 172.21.15.27:0/106424993 shutdown_connections 2024-09-19T08:12:29.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.394+0000 7f998fe8a640 1 --2- 172.21.15.27:0/106424993 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f99700a34d0 0x7f99700a5990 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:29.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.394+0000 7f998fe8a640 1 --2- 172.21.15.27:0/106424993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9988102ef0 0x7f998819cca0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:29.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.394+0000 7f998fe8a640 1 --2- 172.21.15.27:0/106424993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9988102570 0x7f9988198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:29.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.394+0000 7f998fe8a640 1 --2- 172.21.15.27:0/106424993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9988100e20 0x7f99881983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:29.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.394+0000 7f998fe8a640 1 -- 172.21.15.27:0/106424993 >> 172.21.15.27:0/106424993 conn(0x7f99880fc7d0 msgr2=0x7f998806a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:29.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.394+0000 7f998fe8a640 1 -- 172.21.15.27:0/106424993 shutdown_connections 2024-09-19T08:12:29.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:29.394+0000 7f998fe8a640 1 -- 172.21.15.27:0/106424993 wait complete. 2024-09-19T08:12:29.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:29 smithi155 ceph-mon[35362]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:12:29.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:29 smithi203 ceph-mon[35198]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:12:30.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:30 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/106424993' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:12:30.322 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24482 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T08:12:30.322 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24482 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T08:12:30.362 INFO:tasks.workunit.client.0.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T08:12:30.437 INFO:tasks.workunit.client.0.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T08:12:30.477 INFO:tasks.workunit.client.0.smithi027.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T08:12:30.479 INFO:tasks.workunit.client.0.smithi027.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T08:12:30.479 INFO:tasks.workunit.client.0.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T08:12:30.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:30 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/106424993' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:12:30.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:30 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/106424993' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:12:30.519 INFO:tasks.workunit.client.0.smithi027.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T08:12:30.523 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-19T08:12:30.523 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T08:12:30.540 INFO:tasks.workunit:Running workunits matching direct_io on client.0... 2024-09-19T08:12:30.541 INFO:tasks.workunit:Running workunit direct_io/big.sh... 2024-09-19T08:12:30.541 DEBUG:teuthology.orchestra.run.smithi027:workunit test direct_io/big.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/big.sh 2024-09-19T08:12:30.604 INFO:tasks.workunit.client.0.smithi027.stdout:test large (16MB) dio write 2024-09-19T08:12:30.605 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test large (16MB) dio write' 2024-09-19T08:12:30.605 INFO:tasks.workunit.client.0.smithi027.stderr:+ dd if=/dev/zero of=foo.big bs=16M count=1 oflag=direct 2024-09-19T08:12:30.631 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:12:30.696 INFO:tasks.workunit.client.0.smithi027.stderr:1+0 records in 2024-09-19T08:12:30.696 INFO:tasks.workunit.client.0.smithi027.stderr:1+0 records out 2024-09-19T08:12:30.696 INFO:tasks.workunit.client.0.smithi027.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.089243 s, 188 MB/s 2024-09-19T08:12:30.696 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo OK 2024-09-19T08:12:30.697 INFO:tasks.workunit.client.0.smithi027.stdout:OK 2024-09-19T08:12:30.697 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T08:12:30.698 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T08:12:30.772 INFO:tasks.workunit:Running workunit direct_io/direct_io_test... 2024-09-19T08:12:30.772 DEBUG:teuthology.orchestra.run.smithi027:workunit test direct_io/direct_io_test> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/direct_io_test 2024-09-19T08:12:31.322 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:31 smithi027 ceph-mon[31209]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:12:31.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.321+0000 7f5be32ed640 1 -- 172.21.15.27:0/3319976330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bdc102570 msgr2=0x7f5bdc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:31.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.321+0000 7f5be32ed640 1 --2- 172.21.15.27:0/3319976330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bdc102570 0x7f5bdc1029b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc009900 tx=0x7f5bcc02a480 comp rx=0 tx=0).stop 2024-09-19T08:12:31.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.321+0000 7f5be32ed640 1 -- 172.21.15.27:0/3319976330 shutdown_connections 2024-09-19T08:12:31.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.321+0000 7f5be32ed640 1 --2- 172.21.15.27:0/3319976330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5bdc102ef0 0x7f5bdc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.321+0000 7f5be32ed640 1 --2- 172.21.15.27:0/3319976330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bdc102570 0x7f5bdc1029b0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.321+0000 7f5be32ed640 1 --2- 172.21.15.27:0/3319976330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bdc100e20 0x7f5bdc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.321+0000 7f5be32ed640 1 -- 172.21.15.27:0/3319976330 >> 172.21.15.27:0/3319976330 conn(0x7f5bdc0fc7d0 msgr2=0x7f5bdc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:31.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.321+0000 7f5be32ed640 1 -- 172.21.15.27:0/3319976330 shutdown_connections 2024-09-19T08:12:31.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.321+0000 7f5be32ed640 1 -- 172.21.15.27:0/3319976330 wait complete. 2024-09-19T08:12:31.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.322+0000 7f5be32ed640 1 Processor -- start 2024-09-19T08:12:31.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.322+0000 7f5be32ed640 1 -- start start 2024-09-19T08:12:31.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.322+0000 7f5be32ed640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bdc100e20 0x7f5bdc19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:31.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.322+0000 7f5be32ed640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5bdc102570 0x7f5bdc19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:31.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.323+0000 7f5be32ed640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bdc102ef0 0x7f5bdc19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:31.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.323+0000 7f5be32ed640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc110f80 con 0x7f5bdc102ef0 2024-09-19T08:12:31.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.323+0000 7f5be32ed640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc110e00 con 0x7f5bdc100e20 2024-09-19T08:12:31.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.323+0000 7f5be32ed640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc111100 con 0x7f5bdc102570 2024-09-19T08:12:31.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.323+0000 7f5be188a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bdc102ef0 0x7f5bdc19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:31.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.323+0000 7f5be188a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bdc102ef0 0x7f5bdc19ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59414/0 (socket says 172.21.15.27:59414) 2024-09-19T08:12:31.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.323+0000 7f5be188a640 1 -- 172.21.15.27:0/1999434940 learned_addr learned my addr 172.21.15.27:0/1999434940 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:31.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.323+0000 7f5be0888640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5bdc102570 0x7f5bdc19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:31.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.323+0000 7f5be1089640 1 --2- 172.21.15.27:0/1999434940 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bdc100e20 0x7f5bdc19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:31.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.323+0000 7f5be188a640 1 -- 172.21.15.27:0/1999434940 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5bdc102570 msgr2=0x7f5bdc19abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:31.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.323+0000 7f5be188a640 1 --2- 172.21.15.27:0/1999434940 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5bdc102570 0x7f5bdc19abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.323+0000 7f5be188a640 1 -- 172.21.15.27:0/1999434940 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bdc100e20 msgr2=0x7f5bdc19a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:31.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.323+0000 7f5be188a640 1 --2- 172.21.15.27:0/1999434940 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bdc100e20 0x7f5bdc19a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.323+0000 7f5be188a640 1 -- 172.21.15.27:0/1999434940 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bdc19f650 con 0x7f5bdc102ef0 2024-09-19T08:12:31.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.323+0000 7f5be0888640 1 --2- 172.21.15.27:0/1999434940 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5bdc102570 0x7f5bdc19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:12:31.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.323+0000 7f5be188a640 1 --2- 172.21.15.27:0/1999434940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bdc102ef0 0x7f5bdc19ef70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400eb10 tx=0x7f5bd400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:31.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.323+0000 7f5bd27fc640 1 -- 172.21.15.27:0/1999434940 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4004b20 con 0x7f5bdc102ef0 2024-09-19T08:12:31.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.323+0000 7f5bd27fc640 1 -- 172.21.15.27:0/1999434940 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bd4004cc0 con 0x7f5bdc102ef0 2024-09-19T08:12:31.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.323+0000 7f5be32ed640 1 -- 172.21.15.27:0/1999434940 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bdc19f940 con 0x7f5bdc102ef0 2024-09-19T08:12:31.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.323+0000 7f5bd27fc640 1 -- 172.21.15.27:0/1999434940 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4010760 con 0x7f5bdc102ef0 2024-09-19T08:12:31.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.324+0000 7f5be32ed640 1 -- 172.21.15.27:0/1999434940 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bdc1a7220 con 0x7f5bdc102ef0 2024-09-19T08:12:31.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.326+0000 7f5bd27fc640 1 -- 172.21.15.27:0/1999434940 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7f5bd4010900 con 0x7f5bdc102ef0 2024-09-19T08:12:31.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.327+0000 7f5be56c6740 1 Processor -- start 2024-09-19T08:12:31.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.327+0000 7f5be56c6740 1 -- start start 2024-09-19T08:12:31.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.327+0000 7f5be56c6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce76552850 0x55ce76552c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:31.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.327+0000 7f5be56c6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce76553170 0x55ce7655d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:31.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.327+0000 7f5be56c6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7655da30 0x55ce7655fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:31.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.327+0000 7f5be56c6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55ce764b7160 con 0x55ce76553170 2024-09-19T08:12:31.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.327+0000 7f5be56c6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ce7645e720 con 0x55ce76552850 2024-09-19T08:12:31.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.327+0000 7f5be56c6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ce764b3120 con 0x55ce7655da30 2024-09-19T08:12:31.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.327+0000 7f5be1089640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce76553170 0x55ce7655d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:31.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.327+0000 7f5be0888640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7655da30 0x55ce7655fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:31.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.327+0000 7f5be1089640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce76553170 0x55ce7655d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59422/0 (socket says 172.21.15.27:59422) 2024-09-19T08:12:31.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.327+0000 7f5be1089640 1 -- 172.21.15.27:0/922774894 learned_addr learned my addr 172.21.15.27:0/922774894 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:31.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.327+0000 7f5be0888640 1 --2- 172.21.15.27:0/922774894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce76552850 0x55ce76552c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:31.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.327+0000 7f5be1089640 1 -- 172.21.15.27:0/922774894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7655da30 msgr2=0x55ce7655fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:31.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.327+0000 7f5bd27fc640 1 --2- 172.21.15.27:0/1999434940 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f5bc80a3550 0x7f5bc80a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:31.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.327+0000 7f5be1089640 1 --2- 172.21.15.27:0/922774894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7655da30 0x55ce7655fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.327+0000 7f5be1089640 1 -- 172.21.15.27:0/922774894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce76552850 msgr2=0x55ce76552c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:31.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.327+0000 7f5be1089640 1 --2- 172.21.15.27:0/922774894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce76552850 0x55ce76552c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.328+0000 7f5be1089640 1 -- 172.21.15.27:0/922774894 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce76228ba0 con 0x55ce76553170 2024-09-19T08:12:31.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.328+0000 7f5be188a640 1 --2- 172.21.15.27:0/1999434940 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f5bc80a3550 0x7f5bc80a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:31.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.328+0000 7f5be1089640 1 --2- 172.21.15.27:0/922774894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce76553170 0x55ce7655d4f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800ac20 tx=0x7f5bd800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1b46b8ff15db3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:31.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.328+0000 7f5bd27fc640 1 -- 172.21.15.27:0/1999434940 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f5bd40d0600 con 0x7f5bdc102ef0 2024-09-19T08:12:31.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.328+0000 7f5bc77fe640 1 -- 172.21.15.27:0/922774894 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd801d070 con 0x55ce76553170 2024-09-19T08:12:31.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.328+0000 7f5bc77fe640 1 -- 172.21.15.27:0/922774894 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bd8018b20 con 0x55ce76553170 2024-09-19T08:12:31.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.328+0000 7f5bc77fe640 1 -- 172.21.15.27:0/922774894 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8010a60 con 0x55ce76553170 2024-09-19T08:12:31.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.329+0000 7f5be56c6740 1 -- 172.21.15.27:0/922774894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce76553170 msgr2=0x55ce7655d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:31.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.329+0000 7f5be56c6740 1 --2- 172.21.15.27:0/922774894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce76553170 0x55ce7655d4f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800ac20 tx=0x7f5bd800f790 comp rx=0 tx=0).stop 2024-09-19T08:12:31.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.329+0000 7f5be188a640 1 --2- 172.21.15.27:0/1999434940 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f5bc80a3550 0x7f5bc80a5a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40cdc80 tx=0x7f5bd4017000 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:31.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.329+0000 7f5be56c6740 1 -- 172.21.15.27:0/922774894 shutdown_connections 2024-09-19T08:12:31.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.329+0000 7f5be56c6740 1 --2- 172.21.15.27:0/922774894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7655da30 0x55ce7655fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.329+0000 7f5be56c6740 1 --2- 172.21.15.27:0/922774894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce76553170 0x55ce7655d4f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.329+0000 7f5be56c6740 1 --2- 172.21.15.27:0/922774894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce76552850 0x55ce76552c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.329+0000 7f5be56c6740 1 -- 172.21.15.27:0/922774894 >> 172.21.15.27:0/922774894 conn(0x55ce7654ede0 msgr2=0x55ce7654f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:31.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.329+0000 7f5be56c6740 1 -- 172.21.15.27:0/922774894 shutdown_connections 2024-09-19T08:12:31.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.329+0000 7f5be56c6740 1 -- 172.21.15.27:0/922774894 wait complete. 2024-09-19T08:12:31.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.329+0000 7f5be56c6740 1 -- start start 2024-09-19T08:12:31.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.329+0000 7f5be56c6740 1 Processor -- start 2024-09-19T08:12:31.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.330+0000 7f5be56c6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce76552850 0x55ce7655a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:31.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.330+0000 7f5be56c6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce76553170 0x55ce7655ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:31.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.330+0000 7f5be56c6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce7655da30 0x55ce7655b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:31.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.330+0000 7f5be56c6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55ce76560600 con 0x55ce7655da30 2024-09-19T08:12:31.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.330+0000 7f5be56c6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ce7643f900 con 0x55ce76553170 2024-09-19T08:12:31.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.330+0000 7f5be56c6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ce76560780 con 0x55ce76552850 2024-09-19T08:12:31.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.330+0000 7f5be56c6740 10 client.0 _ll_register_callbacks cb 0x55ce7643d780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:12:31.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.330+0000 7f5be0888640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce76552850 0x55ce7655a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:31.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.330+0000 7f5be0888640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce7655da30 0x55ce7655b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:31.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.330+0000 7f5be0888640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce76552850 0x55ce7655a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.27:38856/0 (socket says 172.21.15.27:38856) 2024-09-19T08:12:31.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.330+0000 7f5be0888640 1 -- 172.21.15.27:0/222722403 learned_addr learned my addr 172.21.15.27:0/222722403 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:31.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.330+0000 7f5be1089640 1 --2- 172.21.15.27:0/222722403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce76553170 0x55ce7655ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:31.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.330+0000 7f5be0888640 1 -- 172.21.15.27:0/222722403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce76553170 msgr2=0x55ce7655ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:31.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.330+0000 7f5be0888640 1 --2- 172.21.15.27:0/222722403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce76553170 0x55ce7655ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.330+0000 7f5be0888640 1 -- 172.21.15.27:0/222722403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce7655da30 msgr2=0x55ce7655b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:31.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.330+0000 7f5be0888640 1 --2- 172.21.15.27:0/222722403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce7655da30 0x55ce7655b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.330+0000 7f5be0888640 1 -- 172.21.15.27:0/222722403 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce7647fc50 con 0x55ce76552850 2024-09-19T08:12:31.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.331+0000 7f5be0888640 1 --2- 172.21.15.27:0/222722403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce76552850 0x55ce7655a950 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc02a9a0 tx=0x7f5bcc009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f31e19c02de47d03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:31.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.331+0000 7f5bc4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T08:12:31.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.331+0000 7f5bc4ff9640 1 -- 172.21.15.27:0/222722403 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc041020 con 0x55ce76552850 2024-09-19T08:12:31.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.331+0000 7f5bc4ff9640 1 -- 172.21.15.27:0/222722403 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f5bcc032840 con 0x55ce76552850 2024-09-19T08:12:31.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.331+0000 7f5be56c6740 1 -- 172.21.15.27:0/222722403 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bd8018b20 con 0x55ce76552850 2024-09-19T08:12:31.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.331+0000 7f5bc4ff9640 1 -- 172.21.15.27:0/222722403 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5bcc035040 con 0x55ce76552850 2024-09-19T08:12:31.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.331+0000 7f5be56c6740 10 client.25246 fetch_fsmap learned FSMap version 20 2024-09-19T08:12:31.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.331+0000 7f5be56c6740 1 -- 172.21.15.27:0/222722403 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ce7656c2e0 con 0x55ce76552850 2024-09-19T08:12:31.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.331+0000 7f5bc4ff9640 1 -- 172.21.15.27:0/222722403 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bd8018b20 con 0x55ce76552850 2024-09-19T08:12:31.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.332+0000 7f5bc4ff9640 1 -- 172.21.15.27:0/222722403 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5bcc056b50 con 0x55ce76552850 2024-09-19T08:12:31.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.332+0000 7f5be56c6740 10 client.25246 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:12:31.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.332+0000 7f5be56c6740 10 client.25246 resolve_mds: validated gid 24482 aka daemon mds.b 2024-09-19T08:12:31.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.332+0000 7f5be56c6740 20 client.25246 populate_metadata read hostname 'smithi027' 2024-09-19T08:12:31.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.332+0000 7f5be56c6740 1 --2- 172.21.15.27:0/222722403 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ce7656d6f0 0x55ce7656fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:31.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.332+0000 7f5be56c6740 4 client.25246 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:12:31.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.332+0000 7f5be56c6740 1 -- 172.21.15.27:0/222722403 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce764c4890 con 0x55ce7656d6f0 2024-09-19T08:12:31.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.332+0000 7f5be1089640 1 --2- 172.21.15.27:0/222722403 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ce7656d6f0 0x55ce7656fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:31.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.332+0000 7f5be1089640 1 --2- 172.21.15.27:0/222722403 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ce7656d6f0 0x55ce7656fae0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31e1724848a6d8ec server_cookie=48099656bab508fe in_seq=0 out_seq=0 2024-09-19T08:12:31.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.332+0000 7f5bc4ff9640 10 client.25246 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:31.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.333+0000 7f5bc4ff9640 1 -- 172.21.15.27:0/222722403 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce764c4890 con 0x55ce7656d6f0 2024-09-19T08:12:31.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.333+0000 7f5bc4ff9640 10 client.25246 handle_command_reply: tid=0 2024-09-19T08:12:31.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.333+0000 7f5be56c6740 1 client.25246 shutdown 2024-09-19T08:12:31.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.333+0000 7f5be56c6740 1 -- 172.21.15.27:0/222722403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce76552850 msgr2=0x55ce7655a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:31.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.333+0000 7f5be56c6740 1 --2- 172.21.15.27:0/222722403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce76552850 0x55ce7655a950 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc02a9a0 tx=0x7f5bcc009260 comp rx=0 tx=0).stop 2024-09-19T08:12:31.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.333+0000 7f5be56c6740 1 -- 172.21.15.27:0/222722403 shutdown_connections 2024-09-19T08:12:31.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.333+0000 7f5be56c6740 1 --2- 172.21.15.27:0/222722403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce7655da30 0x55ce7655b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.333+0000 7f5be56c6740 1 --2- 172.21.15.27:0/222722403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce76553170 0x55ce7655ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.333+0000 7f5be56c6740 1 --2- 172.21.15.27:0/222722403 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ce7656d6f0 0x55ce7656fae0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.333+0000 7f5be56c6740 1 --2- 172.21.15.27:0/222722403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce76552850 0x55ce7655a950 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.333+0000 7f5bc4ff9640 0 client.25246 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:31.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.333+0000 7f5be56c6740 1 -- 172.21.15.27:0/222722403 >> 172.21.15.27:0/222722403 conn(0x55ce7654ede0 msgr2=0x55ce76554b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:31.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.334+0000 7f5be56c6740 1 -- 172.21.15.27:0/222722403 shutdown_connections 2024-09-19T08:12:31.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.334+0000 7f5be56c6740 1 -- 172.21.15.27:0/222722403 wait complete. 2024-09-19T08:12:31.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.334+0000 7f5be56c6740 20 client.25246 trim_cache size 0 max 16384 2024-09-19T08:12:31.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.353+0000 7f5be56c6740 1 Processor -- start 2024-09-19T08:12:31.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.353+0000 7f5be56c6740 1 -- start start 2024-09-19T08:12:31.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.353+0000 7f5be56c6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce76552850 0x55ce76555300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:31.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.353+0000 7f5be56c6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce76553170 0x55ce76559220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:31.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.353+0000 7f5be56c6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce7655da30 0x55ce76575340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:31.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.353+0000 7f5be56c6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc1ad960 con 0x55ce76552850 2024-09-19T08:12:31.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.353+0000 7f5be56c6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc1b01e0 con 0x55ce7655da30 2024-09-19T08:12:31.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.353+0000 7f5be56c6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc1adfd0 con 0x55ce76553170 2024-09-19T08:12:31.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.353+0000 7f5be0888640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce76552850 0x55ce76555300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:31.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.353+0000 7f5be1089640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce76553170 0x55ce76559220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:31.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.353+0000 7f5be0888640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce76552850 0x55ce76555300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59430/0 (socket says 172.21.15.27:59430) 2024-09-19T08:12:31.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.353+0000 7f5be0888640 1 -- 172.21.15.27:0/694199248 learned_addr learned my addr 172.21.15.27:0/694199248 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:31.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.353+0000 7f5be0888640 1 --2- 172.21.15.27:0/694199248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce7655da30 0x55ce76575340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:31.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.353+0000 7f5be1089640 1 -- 172.21.15.27:0/694199248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce7655da30 msgr2=0x55ce76575340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:31.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.354+0000 7f5be1089640 1 --2- 172.21.15.27:0/694199248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce7655da30 0x55ce76575340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.354+0000 7f5be1089640 1 -- 172.21.15.27:0/694199248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce76552850 msgr2=0x55ce76555300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:31.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.354+0000 7f5be1089640 1 --2- 172.21.15.27:0/694199248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce76552850 0x55ce76555300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.354+0000 7f5be1089640 1 -- 172.21.15.27:0/694199248 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce76556310 con 0x55ce76553170 2024-09-19T08:12:31.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.354+0000 7f5be0888640 1 --2- 172.21.15.27:0/694199248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce7655da30 0x55ce76575340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:12:31.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.354+0000 7f5be1089640 1 --2- 172.21.15.27:0/694199248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce76553170 0x55ce76559220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8000c00 tx=0x7f5bd800a880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b950346c1c057824 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:31.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.354+0000 7f5bc6ffd640 1 -- 172.21.15.27:0/694199248 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8032070 con 0x55ce76553170 2024-09-19T08:12:31.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.354+0000 7f5bc6ffd640 1 -- 172.21.15.27:0/694199248 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bd801e040 con 0x55ce76553170 2024-09-19T08:12:31.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.354+0000 7f5bc6ffd640 1 -- 172.21.15.27:0/694199248 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd801d040 con 0x55ce76553170 2024-09-19T08:12:31.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.355+0000 7f5be56c6740 1 -- 172.21.15.27:0/694199248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce76553170 msgr2=0x55ce76559220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:31.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.355+0000 7f5be56c6740 1 --2- 172.21.15.27:0/694199248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce76553170 0x55ce76559220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8000c00 tx=0x7f5bd800a880 comp rx=0 tx=0).stop 2024-09-19T08:12:31.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.355+0000 7f5be56c6740 1 -- 172.21.15.27:0/694199248 shutdown_connections 2024-09-19T08:12:31.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.355+0000 7f5be56c6740 1 --2- 172.21.15.27:0/694199248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce7655da30 0x55ce76575340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.355+0000 7f5be56c6740 1 --2- 172.21.15.27:0/694199248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce76553170 0x55ce76559220 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.355+0000 7f5be56c6740 1 --2- 172.21.15.27:0/694199248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce76552850 0x55ce76555300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.355+0000 7f5be56c6740 1 -- 172.21.15.27:0/694199248 >> 172.21.15.27:0/694199248 conn(0x55ce7654ede0 msgr2=0x55ce7654dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:31.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.355+0000 7f5be56c6740 1 -- 172.21.15.27:0/694199248 shutdown_connections 2024-09-19T08:12:31.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.355+0000 7f5be56c6740 1 -- 172.21.15.27:0/694199248 wait complete. 2024-09-19T08:12:31.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.355+0000 7f5be56c6740 1 -- start start 2024-09-19T08:12:31.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.355+0000 7f5be56c6740 1 Processor -- start 2024-09-19T08:12:31.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.356+0000 7f5be56c6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce76552850 0x55ce76561980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:31.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.356+0000 7f5be56c6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce76553170 0x55ce76561ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:31.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.356+0000 7f5be56c6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7655da30 0x55ce76562400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:31.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.356+0000 7f5be56c6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc1ae6a0 con 0x55ce76552850 2024-09-19T08:12:31.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.356+0000 7f5be56c6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc1afb10 con 0x55ce76553170 2024-09-19T08:12:31.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.356+0000 7f5be56c6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc1aed70 con 0x55ce7655da30 2024-09-19T08:12:31.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.356+0000 7f5be56c6740 10 client.0 _ll_register_callbacks cb 0x7f5bcc003830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:12:31.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.356+0000 7f5be0888640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce76552850 0x55ce76561980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:31.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.356+0000 7f5be0888640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce76552850 0x55ce76561980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59440/0 (socket says 172.21.15.27:59440) 2024-09-19T08:12:31.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.356+0000 7f5be0888640 1 -- 172.21.15.27:0/1973446953 learned_addr learned my addr 172.21.15.27:0/1973446953 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:31.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.356+0000 7f5be1089640 1 --2- 172.21.15.27:0/1973446953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce76553170 0x55ce76561ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:31.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.356+0000 7f5be0888640 1 --2- 172.21.15.27:0/1973446953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7655da30 0x55ce76562400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:31.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.356+0000 7f5be0888640 1 -- 172.21.15.27:0/1973446953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7655da30 msgr2=0x55ce76562400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:31.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.356+0000 7f5be0888640 1 --2- 172.21.15.27:0/1973446953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7655da30 0x55ce76562400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.356+0000 7f5be0888640 1 -- 172.21.15.27:0/1973446953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce76553170 msgr2=0x55ce76561ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:31.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.356+0000 7f5be0888640 1 --2- 172.21.15.27:0/1973446953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce76553170 0x55ce76561ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.356+0000 7f5be0888640 1 -- 172.21.15.27:0/1973446953 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce76559900 con 0x55ce76552850 2024-09-19T08:12:31.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.356+0000 7f5be0888640 1 --2- 172.21.15.27:0/1973446953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce76552850 0x55ce76561980 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc009230 tx=0x7f5bcc005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be416cd5799d868f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:31.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.356+0000 7f5bc4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:12:31.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.357+0000 7f5bc4ff9640 1 -- 172.21.15.27:0/1973446953 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc05c070 con 0x55ce76552850 2024-09-19T08:12:31.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.357+0000 7f5bc4ff9640 1 -- 172.21.15.27:0/1973446953 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f5bcc032840 con 0x55ce76552850 2024-09-19T08:12:31.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.357+0000 7f5be56c6740 1 -- 172.21.15.27:0/1973446953 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bd801e040 con 0x55ce76552850 2024-09-19T08:12:31.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.357+0000 7f5bc4ff9640 1 -- 172.21.15.27:0/1973446953 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5bcc069050 con 0x55ce76552850 2024-09-19T08:12:31.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.357+0000 7f5be56c6740 10 client.15660 fetch_fsmap learned FSMap version 20 2024-09-19T08:12:31.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.357+0000 7f5be56c6740 1 -- 172.21.15.27:0/1973446953 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ce765e0dd0 con 0x55ce76552850 2024-09-19T08:12:31.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.357+0000 7f5bc4ff9640 1 -- 172.21.15.27:0/1973446953 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bd801e040 con 0x55ce76552850 2024-09-19T08:12:31.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.357+0000 7f5bc4ff9640 1 -- 172.21.15.27:0/1973446953 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5bcc005250 con 0x55ce76552850 2024-09-19T08:12:31.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.357+0000 7f5be56c6740 10 client.15660 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:12:31.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.357+0000 7f5be56c6740 10 client.15660 resolve_mds: validated gid 24482 aka daemon mds.b 2024-09-19T08:12:31.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.357+0000 7f5be56c6740 20 client.15660 populate_metadata read hostname 'smithi027' 2024-09-19T08:12:31.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.357+0000 7f5be56c6740 1 --2- 172.21.15.27:0/1973446953 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ce765e14a0 0x55ce765e3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:31.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.357+0000 7f5be56c6740 4 client.15660 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T08:12:31.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.357+0000 7f5be56c6740 1 -- 172.21.15.27:0/1973446953 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x55ce764bebe0 con 0x55ce765e14a0 2024-09-19T08:12:31.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.358+0000 7f5be1089640 1 --2- 172.21.15.27:0/1973446953 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ce765e14a0 0x55ce765e3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:31.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.358+0000 7f5be1089640 1 --2- 172.21.15.27:0/1973446953 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ce765e14a0 0x55ce765e3890 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20dbf74f8f23d07c server_cookie=2eb1339faca43dcc in_seq=0 out_seq=0 2024-09-19T08:12:31.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.358+0000 7f5bc4ff9640 10 client.15660 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:31.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:31 smithi155 ceph-mon[35362]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:12:31.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:31 smithi203 ceph-mon[35198]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:12:31.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.602+0000 7f5bc4ff9640 1 -- 172.21.15.27:0/1973446953 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55ce764bebe0 con 0x55ce765e14a0 2024-09-19T08:12:31.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.602+0000 7f5bc4ff9640 10 client.15660 handle_command_reply: tid=0 2024-09-19T08:12:31.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.602+0000 7f5be56c6740 1 client.15660 shutdown 2024-09-19T08:12:31.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.603+0000 7f5be56c6740 1 -- 172.21.15.27:0/1973446953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce76552850 msgr2=0x55ce76561980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:31.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.603+0000 7f5be56c6740 1 --2- 172.21.15.27:0/1973446953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce76552850 0x55ce76561980 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc009230 tx=0x7f5bcc005b50 comp rx=0 tx=0).stop 2024-09-19T08:12:31.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.603+0000 7f5be56c6740 1 -- 172.21.15.27:0/1973446953 shutdown_connections 2024-09-19T08:12:31.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.603+0000 7f5be56c6740 1 --2- 172.21.15.27:0/1973446953 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ce765e14a0 0x55ce765e3890 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.603+0000 7f5be56c6740 1 --2- 172.21.15.27:0/1973446953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7655da30 0x55ce76562400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.603+0000 7f5be56c6740 1 --2- 172.21.15.27:0/1973446953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce76553170 0x55ce76561ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.603+0000 7f5bc4ff9640 0 client.15660 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:31.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.603+0000 7f5be56c6740 1 --2- 172.21.15.27:0/1973446953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce76552850 0x55ce76561980 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.603+0000 7f5be56c6740 1 -- 172.21.15.27:0/1973446953 >> 172.21.15.27:0/1973446953 conn(0x55ce7654ede0 msgr2=0x55ce7655c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:31.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.603+0000 7f5be56c6740 1 -- 172.21.15.27:0/1973446953 shutdown_connections 2024-09-19T08:12:31.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.603+0000 7f5be56c6740 1 -- 172.21.15.27:0/1973446953 wait complete. 2024-09-19T08:12:31.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.603+0000 7f5be56c6740 20 client.15660 trim_cache size 0 max 16384 2024-09-19T08:12:31.605 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:12:31.605 INFO:teuthology.orchestra.run.smithi027.stdout: "epoch": 20, 2024-09-19T08:12:31.605 INFO:teuthology.orchestra.run.smithi027.stdout: "leader": 24482, 2024-09-19T08:12:31.605 INFO:teuthology.orchestra.run.smithi027.stdout: "set_version": 6, 2024-09-19T08:12:31.605 INFO:teuthology.orchestra.run.smithi027.stdout: "sets": { 2024-09-19T08:12:31.605 INFO:teuthology.orchestra.run.smithi027.stdout: "b4e3713b": { 2024-09-19T08:12:31.605 INFO:teuthology.orchestra.run.smithi027.stdout: "version": 6, 2024-09-19T08:12:31.606 INFO:teuthology.orchestra.run.smithi027.stdout: "age_ref": 0.0, 2024-09-19T08:12:31.606 INFO:teuthology.orchestra.run.smithi027.stdout: "state": { 2024-09-19T08:12:31.606 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "QUIESCED", 2024-09-19T08:12:31.606 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0 2024-09-19T08:12:31.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:12:31.606 INFO:teuthology.orchestra.run.smithi027.stdout: "timeout": 90.0, 2024-09-19T08:12:31.606 INFO:teuthology.orchestra.run.smithi027.stdout: "expiration": 140.3, 2024-09-19T08:12:31.606 INFO:teuthology.orchestra.run.smithi027.stdout: "members": { 2024-09-19T08:12:31.606 INFO:teuthology.orchestra.run.smithi027.stdout: "file:/": { 2024-09-19T08:12:31.606 INFO:teuthology.orchestra.run.smithi027.stdout: "excluded": false, 2024-09-19T08:12:31.606 INFO:teuthology.orchestra.run.smithi027.stdout: "state": { 2024-09-19T08:12:31.606 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "QUIESCED", 2024-09-19T08:12:31.606 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0 2024-09-19T08:12:31.607 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:31.607 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:31.607 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:31.607 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:31.607 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:31.607 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:12:31.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.604+0000 7f5be32ed640 1 -- 172.21.15.27:0/1999434940 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f5bc80a3550 msgr2=0x7f5bc80a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:31.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.604+0000 7f5be32ed640 1 --2- 172.21.15.27:0/1999434940 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f5bc80a3550 0x7f5bc80a5a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40cdc80 tx=0x7f5bd4017000 comp rx=0 tx=0).stop 2024-09-19T08:12:31.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.604+0000 7f5be32ed640 1 -- 172.21.15.27:0/1999434940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bdc102ef0 msgr2=0x7f5bdc19ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:31.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.604+0000 7f5be32ed640 1 --2- 172.21.15.27:0/1999434940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bdc102ef0 0x7f5bdc19ef70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400eb10 tx=0x7f5bd400c2d0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.604+0000 7f5be32ed640 1 -- 172.21.15.27:0/1999434940 shutdown_connections 2024-09-19T08:12:31.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.604+0000 7f5be32ed640 1 --2- 172.21.15.27:0/1999434940 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f5bc80a3550 0x7f5bc80a5a10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.604+0000 7f5be32ed640 1 --2- 172.21.15.27:0/1999434940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bdc102ef0 0x7f5bdc19ef70 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.604+0000 7f5be32ed640 1 --2- 172.21.15.27:0/1999434940 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5bdc102570 0x7f5bdc19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.604+0000 7f5be32ed640 1 --2- 172.21.15.27:0/1999434940 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bdc100e20 0x7f5bdc19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:31.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.604+0000 7f5be32ed640 1 -- 172.21.15.27:0/1999434940 >> 172.21.15.27:0/1999434940 conn(0x7f5bdc0fc7d0 msgr2=0x7f5bdc06a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:31.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.604+0000 7f5be32ed640 1 -- 172.21.15.27:0/1999434940 shutdown_connections 2024-09-19T08:12:31.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:31.604+0000 7f5be32ed640 1 -- 172.21.15.27:0/1999434940 wait complete. 2024-09-19T08:12:32.294 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b4e3713b', quiesce took 4.0 seconds. Will release after: 16.35 2024-09-19T08:12:33.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:33 smithi155 ceph-mon[35362]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:12:33.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:33 smithi027 ceph-mon[31209]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:12:33.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:33 smithi203 ceph-mon[35198]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:12:35.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:35 smithi155 ceph-mon[35362]: pgmap v49: 97 pgs: 97 active+clean; 18 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 439 op/s 2024-09-19T08:12:35.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:35 smithi155 ceph-mon[35362]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-19T08:12:35.501 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:35 smithi027 ceph-mon[31209]: pgmap v49: 97 pgs: 97 active+clean; 18 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 439 op/s 2024-09-19T08:12:35.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:35 smithi027 ceph-mon[31209]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-19T08:12:35.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:35 smithi203 ceph-mon[35198]: pgmap v49: 97 pgs: 97 active+clean; 18 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 439 op/s 2024-09-19T08:12:35.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:35 smithi203 ceph-mon[35198]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-19T08:12:37.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:37 smithi155 ceph-mon[35362]: pgmap v50: 97 pgs: 97 active+clean; 18 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 438 op/s 2024-09-19T08:12:37.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:37 smithi027 ceph-mon[31209]: pgmap v50: 97 pgs: 97 active+clean; 18 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 438 op/s 2024-09-19T08:12:37.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:37 smithi203 ceph-mon[35198]: pgmap v50: 97 pgs: 97 active+clean; 18 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 438 op/s 2024-09-19T08:12:39.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:39 smithi155 ceph-mon[35362]: pgmap v51: 97 pgs: 97 active+clean; 1.8 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.4 MiB/s wr, 1.86k op/s 2024-09-19T08:12:39.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:39 smithi027 ceph-mon[31209]: pgmap v51: 97 pgs: 97 active+clean; 1.8 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.4 MiB/s wr, 1.86k op/s 2024-09-19T08:12:39.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:39 smithi203 ceph-mon[35198]: pgmap v51: 97 pgs: 97 active+clean; 1.8 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.4 MiB/s wr, 1.86k op/s 2024-09-19T08:12:40.000 INFO:tasks.workunit.client.0.smithi027.stdout:.......... 2024-09-19T08:12:40.000 INFO:tasks.workunit.client.0.smithi027.stdout:do_o_direct_reads: SUCCESS 2024-09-19T08:12:41.489 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:41 smithi155 ceph-mon[35362]: pgmap v52: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.4 MiB/s wr, 1.86k op/s 2024-09-19T08:12:41.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:41 smithi027 ceph-mon[31209]: pgmap v52: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.4 MiB/s wr, 1.86k op/s 2024-09-19T08:12:41.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:41 smithi203 ceph-mon[35198]: pgmap v52: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.4 MiB/s wr, 1.86k op/s 2024-09-19T08:12:43.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:43 smithi155 ceph-mon[35362]: pgmap v53: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.4 MiB/s wr, 1.86k op/s 2024-09-19T08:12:43.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:43 smithi027 ceph-mon[31209]: pgmap v53: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.4 MiB/s wr, 1.86k op/s 2024-09-19T08:12:43.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:43 smithi203 ceph-mon[35198]: pgmap v53: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.4 MiB/s wr, 1.86k op/s 2024-09-19T08:12:45.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:45 smithi155 ceph-mon[35362]: pgmap v54: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.4 MiB/s wr, 2.55k op/s 2024-09-19T08:12:45.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:45 smithi027 ceph-mon[31209]: pgmap v54: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.4 MiB/s wr, 2.55k op/s 2024-09-19T08:12:45.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:45 smithi203 ceph-mon[35198]: pgmap v54: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.4 MiB/s wr, 2.55k op/s 2024-09-19T08:12:47.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:47 smithi155 ceph-mon[35362]: pgmap v55: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.8 KiB/s wr, 2.12k op/s 2024-09-19T08:12:47.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:47 smithi027 ceph-mon[31209]: pgmap v55: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.8 KiB/s wr, 2.12k op/s 2024-09-19T08:12:47.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:47 smithi203 ceph-mon[35198]: pgmap v55: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.8 KiB/s wr, 2.12k op/s 2024-09-19T08:12:48.651 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:12:48.926 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:12:49.354 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:49 smithi027 ceph-mon[31209]: pgmap v56: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.8 KiB/s wr, 2.12k op/s 2024-09-19T08:12:49.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.440+0000 7fa7102fa640 1 -- 172.21.15.27:0/3718472807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa708102d30 msgr2=0x7fa708103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:49.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.440+0000 7fa7102fa640 1 --2- 172.21.15.27:0/3718472807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa708102d30 0x7fa708103110 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa704009930 tx=0x7fa70402a420 comp rx=0 tx=0).stop 2024-09-19T08:12:49.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.440+0000 7fa7102fa640 1 -- 172.21.15.27:0/3718472807 shutdown_connections 2024-09-19T08:12:49.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.440+0000 7fa7102fa640 1 --2- 172.21.15.27:0/3718472807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7081082a0 0x7fa70810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:49.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.440+0000 7fa7102fa640 1 --2- 172.21.15.27:0/3718472807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7081036e0 0x7fa708107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:49.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.440+0000 7fa7102fa640 1 --2- 172.21.15.27:0/3718472807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa708102d30 0x7fa708103110 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:49.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.440+0000 7fa7102fa640 1 -- 172.21.15.27:0/3718472807 >> 172.21.15.27:0/3718472807 conn(0x7fa7080fc7d0 msgr2=0x7fa7080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:49.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.440+0000 7fa7102fa640 1 -- 172.21.15.27:0/3718472807 shutdown_connections 2024-09-19T08:12:49.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.440+0000 7fa7102fa640 1 -- 172.21.15.27:0/3718472807 wait complete. 2024-09-19T08:12:49.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.441+0000 7fa7102fa640 1 Processor -- start 2024-09-19T08:12:49.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.441+0000 7fa7102fa640 1 -- start start 2024-09-19T08:12:49.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.441+0000 7fa7102fa640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa708102d30 0x7fa708198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:49.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.441+0000 7fa7102fa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7081036e0 0x7fa708198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:49.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.441+0000 7fa7102fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7081082a0 0x7fa70819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:49.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.441+0000 7fa7102fa640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa7081120a0 con 0x7fa7081036e0 2024-09-19T08:12:49.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.441+0000 7fa7102fa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa708111f20 con 0x7fa7081082a0 2024-09-19T08:12:49.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.441+0000 7fa7102fa640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa708112220 con 0x7fa708102d30 2024-09-19T08:12:49.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.441+0000 7fa70d895640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7081036e0 0x7fa708198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:49.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.442+0000 7fa70d895640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7081036e0 0x7fa708198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47316/0 (socket says 172.21.15.27:47316) 2024-09-19T08:12:49.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.442+0000 7fa70d895640 1 -- 172.21.15.27:0/2079159504 learned_addr learned my addr 172.21.15.27:0/2079159504 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:49.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.442+0000 7fa70e897640 1 --2- 172.21.15.27:0/2079159504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7081082a0 0x7fa70819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:49.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.442+0000 7fa70e096640 1 --2- 172.21.15.27:0/2079159504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa708102d30 0x7fa708198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:49.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.442+0000 7fa70d895640 1 -- 172.21.15.27:0/2079159504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa708102d30 msgr2=0x7fa708198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:49.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.442+0000 7fa70d895640 1 --2- 172.21.15.27:0/2079159504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa708102d30 0x7fa708198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:49.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.442+0000 7fa70d895640 1 -- 172.21.15.27:0/2079159504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7081082a0 msgr2=0x7fa70819ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:49.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.442+0000 7fa70d895640 1 --2- 172.21.15.27:0/2079159504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7081082a0 0x7fa70819ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:49.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.442+0000 7fa70d895640 1 -- 172.21.15.27:0/2079159504 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa70819d520 con 0x7fa7081036e0 2024-09-19T08:12:49.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.442+0000 7fa70e096640 1 --2- 172.21.15.27:0/2079159504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa708102d30 0x7fa708198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:12:49.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.442+0000 7fa70d895640 1 --2- 172.21.15.27:0/2079159504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7081036e0 0x7fa708198ab0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800d750 tx=0x7fa6f800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:49.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.442+0000 7fa6ff7fe640 1 -- 172.21.15.27:0/2079159504 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8017070 con 0x7fa7081036e0 2024-09-19T08:12:49.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.442+0000 7fa6ff7fe640 1 -- 172.21.15.27:0/2079159504 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6f8005500 con 0x7fa7081036e0 2024-09-19T08:12:49.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.442+0000 7fa7102fa640 1 -- 172.21.15.27:0/2079159504 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa70819d810 con 0x7fa7081036e0 2024-09-19T08:12:49.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.442+0000 7fa6ff7fe640 1 -- 172.21.15.27:0/2079159504 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8004e00 con 0x7fa7081036e0 2024-09-19T08:12:49.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.442+0000 7fa7102fa640 1 -- 172.21.15.27:0/2079159504 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7081a50f0 con 0x7fa7081036e0 2024-09-19T08:12:49.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.444+0000 7fa7102fa640 1 -- 172.21.15.27:0/2079159504 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa70806a850 con 0x7fa7081036e0 2024-09-19T08:12:49.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.445+0000 7fa6ff7fe640 1 -- 172.21.15.27:0/2079159504 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fa6f8004fa0 con 0x7fa7081036e0 2024-09-19T08:12:49.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.446+0000 7fa6ff7fe640 1 --2- 172.21.15.27:0/2079159504 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa6f40a33b0 0x7fa6f40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:49.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.446+0000 7fa70e096640 1 --2- 172.21.15.27:0/2079159504 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa6f40a33b0 0x7fa6f40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:49.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.446+0000 7fa6ff7fe640 1 -- 172.21.15.27:0/2079159504 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fa6f80cf690 con 0x7fa7081036e0 2024-09-19T08:12:49.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.447+0000 7fa70e096640 1 --2- 172.21.15.27:0/2079159504 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa6f40a33b0 0x7fa6f40a5870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa704000c00 tx=0x7fa704005a20 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:49.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.451+0000 7fa6ff7fe640 1 -- 172.21.15.27:0/2079159504 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa6f809c0c0 con 0x7fa7081036e0 2024-09-19T08:12:49.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:49 smithi155 ceph-mon[35362]: pgmap v56: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.8 KiB/s wr, 2.12k op/s 2024-09-19T08:12:49.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:49 smithi203 ceph-mon[35198]: pgmap v56: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.8 KiB/s wr, 2.12k op/s 2024-09-19T08:12:49.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.664+0000 7fa7102fa640 1 -- 172.21.15.27:0/2079159504 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa70810a2b0 con 0x7fa7081036e0 2024-09-19T08:12:49.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.665+0000 7fa6ff7fe640 1 -- 172.21.15.27:0/2079159504 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7fa6f809b9c0 con 0x7fa7081036e0 2024-09-19T08:12:49.666 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:12:49.666 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:12:49.666 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:12:49.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.667+0000 7fa7102fa640 1 -- 172.21.15.27:0/2079159504 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa6f40a33b0 msgr2=0x7fa6f40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:49.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.667+0000 7fa7102fa640 1 --2- 172.21.15.27:0/2079159504 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa6f40a33b0 0x7fa6f40a5870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa704000c00 tx=0x7fa704005a20 comp rx=0 tx=0).stop 2024-09-19T08:12:49.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.667+0000 7fa7102fa640 1 -- 172.21.15.27:0/2079159504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7081036e0 msgr2=0x7fa708198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:49.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.667+0000 7fa7102fa640 1 --2- 172.21.15.27:0/2079159504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7081036e0 0x7fa708198ab0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800d750 tx=0x7fa6f800dc10 comp rx=0 tx=0).stop 2024-09-19T08:12:49.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.667+0000 7fa7102fa640 1 -- 172.21.15.27:0/2079159504 shutdown_connections 2024-09-19T08:12:49.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.667+0000 7fa7102fa640 1 --2- 172.21.15.27:0/2079159504 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa6f40a33b0 0x7fa6f40a5870 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:49.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.667+0000 7fa7102fa640 1 --2- 172.21.15.27:0/2079159504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7081082a0 0x7fa70819ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:49.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.667+0000 7fa7102fa640 1 --2- 172.21.15.27:0/2079159504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7081036e0 0x7fa708198ab0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:49.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.667+0000 7fa7102fa640 1 --2- 172.21.15.27:0/2079159504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa708102d30 0x7fa708198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:49.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.667+0000 7fa7102fa640 1 -- 172.21.15.27:0/2079159504 >> 172.21.15.27:0/2079159504 conn(0x7fa7080fc7d0 msgr2=0x7fa708105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:49.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.667+0000 7fa7102fa640 1 -- 172.21.15.27:0/2079159504 shutdown_connections 2024-09-19T08:12:49.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:49.667+0000 7fa7102fa640 1 -- 172.21.15.27:0/2079159504 wait complete. 2024-09-19T08:12:50.343 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:50 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2079159504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:12:50.373 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24482 quiesce db --set-id b4e3713b --release --await' 2024-09-19T08:12:50.373 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24482 quiesce db --set-id b4e3713b --release --await 2024-09-19T08:12:50.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:50 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2079159504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:12:50.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:50 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2079159504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:12:50.639 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:12:50.646 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:12:51.177 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:51 smithi027 ceph-mon[31209]: pgmap v57: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.6 KiB/s wr, 694 op/s 2024-09-19T08:12:51.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.171+0000 7f028766d640 1 -- 172.21.15.27:0/3145714668 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02801002f0 msgr2=0x7f02801006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:51.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.171+0000 7f028766d640 1 --2- 172.21.15.27:0/3145714668 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02801002f0 0x7f02801006d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f027c009930 tx=0x7f027c02a420 comp rx=0 tx=0).stop 2024-09-19T08:12:51.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.171+0000 7f028766d640 1 -- 172.21.15.27:0/3145714668 shutdown_connections 2024-09-19T08:12:51.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.172+0000 7f028766d640 1 --2- 172.21.15.27:0/3145714668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0280106f50 0x7f028010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.172+0000 7f028766d640 1 --2- 172.21.15.27:0/3145714668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0280100ca0 0x7f0280106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.172+0000 7f028766d640 1 --2- 172.21.15.27:0/3145714668 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02801002f0 0x7f02801006d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.172+0000 7f028766d640 1 -- 172.21.15.27:0/3145714668 >> 172.21.15.27:0/3145714668 conn(0x7f0280077210 msgr2=0x7f02800fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:51.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.172+0000 7f028766d640 1 -- 172.21.15.27:0/3145714668 shutdown_connections 2024-09-19T08:12:51.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.172+0000 7f028766d640 1 -- 172.21.15.27:0/3145714668 wait complete. 2024-09-19T08:12:51.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.172+0000 7f028766d640 1 Processor -- start 2024-09-19T08:12:51.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.172+0000 7f028766d640 1 -- start start 2024-09-19T08:12:51.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.172+0000 7f028766d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02801002f0 0x7f02801984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:51.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.172+0000 7f028766d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0280100ca0 0x7f0280198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:51.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.172+0000 7f028766d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0280106f50 0x7f028019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:51.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.172+0000 7f028766d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0280111fa0 con 0x7f0280106f50 2024-09-19T08:12:51.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.172+0000 7f028766d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0280111e20 con 0x7f0280100ca0 2024-09-19T08:12:51.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.172+0000 7f028766d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0280112120 con 0x7f02801002f0 2024-09-19T08:12:51.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.173+0000 7f0285c0a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0280106f50 0x7f028019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:51.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.173+0000 7f0285c0a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0280106f50 0x7f028019cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45880/0 (socket says 172.21.15.27:45880) 2024-09-19T08:12:51.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.173+0000 7f0285c0a640 1 -- 172.21.15.27:0/3495949669 learned_addr learned my addr 172.21.15.27:0/3495949669 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:51.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.173+0000 7f0285409640 1 --2- 172.21.15.27:0/3495949669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02801002f0 0x7f02801984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:51.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.173+0000 7f0284c08640 1 --2- 172.21.15.27:0/3495949669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0280100ca0 0x7f0280198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:51.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.173+0000 7f0285c0a640 1 -- 172.21.15.27:0/3495949669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02801002f0 msgr2=0x7f02801984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:51.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.173+0000 7f0285c0a640 1 --2- 172.21.15.27:0/3495949669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02801002f0 0x7f02801984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.173+0000 7f0285c0a640 1 -- 172.21.15.27:0/3495949669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0280100ca0 msgr2=0x7f0280198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:51.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.173+0000 7f0285c0a640 1 --2- 172.21.15.27:0/3495949669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0280100ca0 0x7f0280198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.173+0000 7f0285c0a640 1 -- 172.21.15.27:0/3495949669 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f028019d490 con 0x7f0280106f50 2024-09-19T08:12:51.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.173+0000 7f0285c0a640 1 --2- 172.21.15.27:0/3495949669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0280106f50 0x7f028019cdb0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f027800cad0 tx=0x7f027800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:51.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.173+0000 7f02767fc640 1 -- 172.21.15.27:0/3495949669 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027800ad60 con 0x7f0280106f50 2024-09-19T08:12:51.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.173+0000 7f02767fc640 1 -- 172.21.15.27:0/3495949669 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0278005020 con 0x7f0280106f50 2024-09-19T08:12:51.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.173+0000 7f028766d640 1 -- 172.21.15.27:0/3495949669 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f028019d780 con 0x7f0280106f50 2024-09-19T08:12:51.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.173+0000 7f02767fc640 1 -- 172.21.15.27:0/3495949669 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027800f6b0 con 0x7f0280106f50 2024-09-19T08:12:51.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.173+0000 7f028766d640 1 -- 172.21.15.27:0/3495949669 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02801a5060 con 0x7f0280106f50 2024-09-19T08:12:51.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.176+0000 7f02767fc640 1 -- 172.21.15.27:0/3495949669 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0278005560 con 0x7f0280106f50 2024-09-19T08:12:51.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.176+0000 7f0289a46740 1 Processor -- start 2024-09-19T08:12:51.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.176+0000 7f0289a46740 1 -- start start 2024-09-19T08:12:51.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.177+0000 7f0289a46740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ba8bc9f40 0x564ba8bca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:51.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.177+0000 7f0289a46740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8bca860 0x564ba8bd9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:51.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.177+0000 7f0289a46740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bd9650 0x564ba8bdba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:51.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.177+0000 7f0289a46740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x564ba8b2f620 con 0x564ba8bca860 2024-09-19T08:12:51.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.177+0000 7f0289a46740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x564ba8ad6e50 con 0x564ba8bd9650 2024-09-19T08:12:51.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.177+0000 7f0289a46740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564ba8b2b5e0 con 0x564ba8bc9f40 2024-09-19T08:12:51.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.177+0000 7f02767fc640 1 --2- 172.21.15.27:0/3495949669 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f026c0a33b0 0x7f026c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.177+0000 7f0285409640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8bca860 0x564ba8bd9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.177+0000 7f0285409640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8bca860 0x564ba8bd9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45890/0 (socket says 172.21.15.27:45890) 2024-09-19T08:12:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.177+0000 7f0285409640 1 -- 172.21.15.27:0/1682631680 learned_addr learned my addr 172.21.15.27:0/1682631680 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.177+0000 7f0285c0a640 1 --2- 172.21.15.27:0/3495949669 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f026c0a33b0 0x7f026c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.177+0000 7f0284c08640 1 --2- 172.21.15.27:0/1682631680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ba8bc9f40 0x564ba8bca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.177+0000 7f0284c08640 1 --2- 172.21.15.27:0/1682631680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bd9650 0x564ba8bdba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.177+0000 7f02767fc640 1 -- 172.21.15.27:0/3495949669 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f02780cfbd0 con 0x7f0280106f50 2024-09-19T08:12:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.177+0000 7f0285409640 1 -- 172.21.15.27:0/1682631680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ba8bc9f40 msgr2=0x564ba8bca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.177+0000 7f0285409640 1 --2- 172.21.15.27:0/1682631680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ba8bc9f40 0x564ba8bca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.177+0000 7f0285409640 1 -- 172.21.15.27:0/1682631680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bd9650 msgr2=0x564ba8bdba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.177+0000 7f0285409640 1 --2- 172.21.15.27:0/1682631680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bd9650 0x564ba8bdba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.177+0000 7f0285409640 1 -- 172.21.15.27:0/1682631680 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba8ac7d40 con 0x564ba8bca860 2024-09-19T08:12:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.178+0000 7f0285c0a640 1 --2- 172.21.15.27:0/3495949669 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f026c0a33b0 0x7f026c0a5870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0278098360 tx=0x7f02780668f0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:51.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.178+0000 7f0285409640 1 --2- 172.21.15.27:0/1682631680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8bca860 0x564ba8bd9110 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f027c02a940 tx=0x7f027c0316e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9765bfbcd5087b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:51.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.178+0000 7f026b7fe640 1 -- 172.21.15.27:0/1682631680 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c040070 con 0x564ba8bca860 2024-09-19T08:12:51.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.178+0000 7f026b7fe640 1 -- 172.21.15.27:0/1682631680 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f027c005020 con 0x564ba8bca860 2024-09-19T08:12:51.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.178+0000 7f026b7fe640 1 -- 172.21.15.27:0/1682631680 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c035040 con 0x564ba8bca860 2024-09-19T08:12:51.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.179+0000 7f0289a46740 1 -- 172.21.15.27:0/1682631680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8bca860 msgr2=0x564ba8bd9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:51.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.179+0000 7f0289a46740 1 --2- 172.21.15.27:0/1682631680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8bca860 0x564ba8bd9110 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f027c02a940 tx=0x7f027c0316e0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.179+0000 7f0289a46740 1 -- 172.21.15.27:0/1682631680 shutdown_connections 2024-09-19T08:12:51.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.179+0000 7f0289a46740 1 --2- 172.21.15.27:0/1682631680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bd9650 0x564ba8bdba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.179+0000 7f0289a46740 1 --2- 172.21.15.27:0/1682631680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8bca860 0x564ba8bd9110 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.179+0000 7f0289a46740 1 --2- 172.21.15.27:0/1682631680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ba8bc9f40 0x564ba8bca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.179+0000 7f0289a46740 1 -- 172.21.15.27:0/1682631680 >> 172.21.15.27:0/1682631680 conn(0x564ba8bc65f0 msgr2=0x564ba8bc69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:51.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.179+0000 7f0289a46740 1 -- 172.21.15.27:0/1682631680 shutdown_connections 2024-09-19T08:12:51.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.179+0000 7f0289a46740 1 -- 172.21.15.27:0/1682631680 wait complete. 2024-09-19T08:12:51.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.179+0000 7f0289a46740 1 -- start start 2024-09-19T08:12:51.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.179+0000 7f0289a46740 1 Processor -- start 2024-09-19T08:12:51.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0289a46740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ba8bc9f40 0x564ba8bd6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:51.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0289a46740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8bca860 0x564ba8bd6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:51.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0289a46740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bd9650 0x564ba8bd6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:51.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0289a46740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x564ba8bdc220 con 0x564ba8bca860 2024-09-19T08:12:51.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0289a46740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x564ba8ab7f10 con 0x564ba8bd9650 2024-09-19T08:12:51.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0289a46740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564ba8bdc3a0 con 0x564ba8bc9f40 2024-09-19T08:12:51.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0289a46740 10 client.0 _ll_register_callbacks cb 0x564ba8adbdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:12:51.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0285409640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8bca860 0x564ba8bd6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:51.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0285409640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8bca860 0x564ba8bd6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45892/0 (socket says 172.21.15.27:45892) 2024-09-19T08:12:51.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0285409640 1 -- 172.21.15.27:0/1157909711 learned_addr learned my addr 172.21.15.27:0/1157909711 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:51.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0284c08640 1 --2- 172.21.15.27:0/1157909711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bd9650 0x564ba8bd6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:51.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0284c08640 1 --2- 172.21.15.27:0/1157909711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ba8bc9f40 0x564ba8bd6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:51.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0285409640 1 -- 172.21.15.27:0/1157909711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ba8bc9f40 msgr2=0x564ba8bd6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:51.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0285409640 1 --2- 172.21.15.27:0/1157909711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ba8bc9f40 0x564ba8bd6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0285409640 1 -- 172.21.15.27:0/1157909711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bd9650 msgr2=0x564ba8bd6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:51.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0285409640 1 --2- 172.21.15.27:0/1157909711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bd9650 0x564ba8bd6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0285409640 1 -- 172.21.15.27:0/1157909711 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ba883e580 con 0x564ba8bca860 2024-09-19T08:12:51.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0285409640 1 --2- 172.21.15.27:0/1157909711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8bca860 0x564ba8bd6a40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f027c02ab80 tx=0x7f027c0314b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b31195cfc6a9a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:51.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0268ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:12:51.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0268ff9640 1 -- 172.21.15.27:0/1157909711 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c040070 con 0x564ba8bca860 2024-09-19T08:12:51.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0268ff9640 1 -- 172.21.15.27:0/1157909711 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f027c0054a0 con 0x564ba8bca860 2024-09-19T08:12:51.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.180+0000 7f0289a46740 1 -- 172.21.15.27:0/1157909711 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f027c005020 con 0x564ba8bca860 2024-09-19T08:12:51.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.181+0000 7f0268ff9640 1 -- 172.21.15.27:0/1157909711 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f027c052020 con 0x564ba8bca860 2024-09-19T08:12:51.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.181+0000 7f0289a46740 10 client.15678 fetch_fsmap learned FSMap version 20 2024-09-19T08:12:51.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.181+0000 7f0289a46740 1 -- 172.21.15.27:0/1157909711 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564ba8908960 con 0x564ba8bca860 2024-09-19T08:12:51.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.181+0000 7f0268ff9640 1 -- 172.21.15.27:0/1157909711 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f027c005020 con 0x564ba8bca860 2024-09-19T08:12:51.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.181+0000 7f0268ff9640 1 -- 172.21.15.27:0/1157909711 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f027c03cad0 con 0x564ba8bca860 2024-09-19T08:12:51.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.181+0000 7f0289a46740 10 client.15678 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:12:51.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.181+0000 7f0289a46740 10 client.15678 resolve_mds: validated gid 24482 aka daemon mds.b 2024-09-19T08:12:51.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.181+0000 7f0289a46740 20 client.15678 populate_metadata read hostname 'smithi027' 2024-09-19T08:12:51.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.181+0000 7f0289a46740 1 --2- 172.21.15.27:0/1157909711 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564ba8be9040 0x564ba8beb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:51.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.181+0000 7f0289a46740 4 client.15678 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:12:51.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.181+0000 7f0289a46740 1 -- 172.21.15.27:0/1157909711 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ba8b3cb90 con 0x564ba8be9040 2024-09-19T08:12:51.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.181+0000 7f0284c08640 1 --2- 172.21.15.27:0/1157909711 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564ba8be9040 0x564ba8beb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:51.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.182+0000 7f0268ff9640 10 client.15678 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:51.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.182+0000 7f0284c08640 1 --2- 172.21.15.27:0/1157909711 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564ba8be9040 0x564ba8beb430 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70e4a9eda50f634 server_cookie=5de800275d25a8d7 in_seq=0 out_seq=0 2024-09-19T08:12:51.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.183+0000 7f0268ff9640 1 -- 172.21.15.27:0/1157909711 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ba8b3cb90 con 0x564ba8be9040 2024-09-19T08:12:51.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.183+0000 7f0268ff9640 10 client.15678 handle_command_reply: tid=0 2024-09-19T08:12:51.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.183+0000 7f0289a46740 1 client.15678 shutdown 2024-09-19T08:12:51.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.183+0000 7f0289a46740 1 -- 172.21.15.27:0/1157909711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8bca860 msgr2=0x564ba8bd6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:51.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.183+0000 7f0289a46740 1 --2- 172.21.15.27:0/1157909711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8bca860 0x564ba8bd6a40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f027c02ab80 tx=0x7f027c0314b0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.183+0000 7f0289a46740 1 -- 172.21.15.27:0/1157909711 shutdown_connections 2024-09-19T08:12:51.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.183+0000 7f0289a46740 1 --2- 172.21.15.27:0/1157909711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bd9650 0x564ba8bd6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.183+0000 7f0289a46740 1 --2- 172.21.15.27:0/1157909711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8bca860 0x564ba8bd6a40 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.183+0000 7f0289a46740 1 --2- 172.21.15.27:0/1157909711 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564ba8be9040 0x564ba8beb430 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.183+0000 7f0289a46740 1 --2- 172.21.15.27:0/1157909711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ba8bc9f40 0x564ba8bd6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.183+0000 7f0289a46740 1 -- 172.21.15.27:0/1157909711 >> 172.21.15.27:0/1157909711 conn(0x564ba8bc65f0 msgr2=0x564ba8bcc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:51.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.183+0000 7f0268ff9640 0 client.15678 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:51.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.183+0000 7f0289a46740 1 -- 172.21.15.27:0/1157909711 shutdown_connections 2024-09-19T08:12:51.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.183+0000 7f0289a46740 1 -- 172.21.15.27:0/1157909711 wait complete. 2024-09-19T08:12:51.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.183+0000 7f0289a46740 20 client.15678 trim_cache size 0 max 16384 2024-09-19T08:12:51.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.203+0000 7f0289a46740 1 Processor -- start 2024-09-19T08:12:51.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.203+0000 7f0289a46740 1 -- start start 2024-09-19T08:12:51.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.203+0000 7f0289a46740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bc9f40 0x564ba8bee070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:51.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.203+0000 7f0289a46740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ba8bd9650 0x564ba8bee5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:51.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.203+0000 7f0289a46740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8beeaf0 0x564ba8bd3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:51.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.203+0000 7f0289a46740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f02801a9590 con 0x564ba8beeaf0 2024-09-19T08:12:51.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.203+0000 7f0289a46740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f02801abdf0 con 0x564ba8bc9f40 2024-09-19T08:12:51.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.203+0000 7f0289a46740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f02801a9be0 con 0x564ba8bd9650 2024-09-19T08:12:51.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.203+0000 7f0284c08640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8beeaf0 0x564ba8bd3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:51.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.203+0000 7f0284c08640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8beeaf0 0x564ba8bd3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45894/0 (socket says 172.21.15.27:45894) 2024-09-19T08:12:51.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.203+0000 7f0284c08640 1 -- 172.21.15.27:0/2069477504 learned_addr learned my addr 172.21.15.27:0/2069477504 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:51.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.203+0000 7f0284c08640 1 --2- 172.21.15.27:0/2069477504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bc9f40 0x564ba8bee070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:51.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.203+0000 7f0285409640 1 --2- 172.21.15.27:0/2069477504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ba8bd9650 0x564ba8bee5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:51.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.204+0000 7f0284c08640 1 -- 172.21.15.27:0/2069477504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ba8bd9650 msgr2=0x564ba8bee5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:51.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.204+0000 7f0284c08640 1 --2- 172.21.15.27:0/2069477504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ba8bd9650 0x564ba8bee5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.204+0000 7f0284c08640 1 -- 172.21.15.27:0/2069477504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bc9f40 msgr2=0x564ba8bee070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:51.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.204+0000 7f0284c08640 1 --2- 172.21.15.27:0/2069477504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bc9f40 0x564ba8bee070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.204+0000 7f0284c08640 1 -- 172.21.15.27:0/2069477504 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba8bca690 con 0x564ba8beeaf0 2024-09-19T08:12:51.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.204+0000 7f0284c08640 1 --2- 172.21.15.27:0/2069477504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8beeaf0 0x564ba8bd3760 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0270000c00 tx=0x7f02700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48296dd48f2ecd8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:51.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.204+0000 7f026affd640 1 -- 172.21.15.27:0/2069477504 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0270012e40 con 0x564ba8beeaf0 2024-09-19T08:12:51.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.204+0000 7f026affd640 1 -- 172.21.15.27:0/2069477504 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f027000fc80 con 0x564ba8beeaf0 2024-09-19T08:12:51.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.204+0000 7f026affd640 1 -- 172.21.15.27:0/2069477504 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02700047a0 con 0x564ba8beeaf0 2024-09-19T08:12:51.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.205+0000 7f0289a46740 1 -- 172.21.15.27:0/2069477504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8beeaf0 msgr2=0x564ba8bd3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:51.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.205+0000 7f0289a46740 1 --2- 172.21.15.27:0/2069477504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8beeaf0 0x564ba8bd3760 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0270000c00 tx=0x7f02700046c0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.205+0000 7f0289a46740 1 -- 172.21.15.27:0/2069477504 shutdown_connections 2024-09-19T08:12:51.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.205+0000 7f0289a46740 1 --2- 172.21.15.27:0/2069477504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8beeaf0 0x564ba8bd3760 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.205+0000 7f0289a46740 1 --2- 172.21.15.27:0/2069477504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ba8bd9650 0x564ba8bee5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.205+0000 7f0289a46740 1 --2- 172.21.15.27:0/2069477504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bc9f40 0x564ba8bee070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.205+0000 7f0289a46740 1 -- 172.21.15.27:0/2069477504 >> 172.21.15.27:0/2069477504 conn(0x564ba8bc65f0 msgr2=0x564ba8bd4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:51.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.205+0000 7f0289a46740 1 -- 172.21.15.27:0/2069477504 shutdown_connections 2024-09-19T08:12:51.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.205+0000 7f0289a46740 1 -- 172.21.15.27:0/2069477504 wait complete. 2024-09-19T08:12:51.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.205+0000 7f0289a46740 1 -- start start 2024-09-19T08:12:51.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.205+0000 7f0289a46740 1 Processor -- start 2024-09-19T08:12:51.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.206+0000 7f0289a46740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ba8bc9f40 0x564ba8bec410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:51.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.206+0000 7f0289a46740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bd9650 0x564ba8bec950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:51.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.206+0000 7f0289a46740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8beeaf0 0x564ba8c4c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:51.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.206+0000 7f0289a46740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f02801aa2b0 con 0x564ba8beeaf0 2024-09-19T08:12:51.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.206+0000 7f0289a46740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f02801ab720 con 0x564ba8bd9650 2024-09-19T08:12:51.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.206+0000 7f0289a46740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f02801aa980 con 0x564ba8bc9f40 2024-09-19T08:12:51.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.206+0000 7f0289a46740 10 client.0 _ll_register_callbacks cb 0x7f027c0315b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:12:51.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.206+0000 7f0284c08640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8beeaf0 0x564ba8c4c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:51.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.206+0000 7f0284c08640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8beeaf0 0x564ba8c4c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45900/0 (socket says 172.21.15.27:45900) 2024-09-19T08:12:51.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.206+0000 7f0284c08640 1 -- 172.21.15.27:0/3498766141 learned_addr learned my addr 172.21.15.27:0/3498766141 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:51.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.206+0000 7f0284c08640 1 --2- 172.21.15.27:0/3498766141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ba8bc9f40 0x564ba8bec410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:51.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.206+0000 7f0285409640 1 --2- 172.21.15.27:0/3498766141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bd9650 0x564ba8bec950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:51.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.206+0000 7f0284c08640 1 -- 172.21.15.27:0/3498766141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ba8bc9f40 msgr2=0x564ba8bec410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:51.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.206+0000 7f0284c08640 1 --2- 172.21.15.27:0/3498766141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ba8bc9f40 0x564ba8bec410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.206+0000 7f0284c08640 1 -- 172.21.15.27:0/3498766141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bd9650 msgr2=0x564ba8bec950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:51.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.206+0000 7f0284c08640 1 --2- 172.21.15.27:0/3498766141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bd9650 0x564ba8bec950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.206+0000 7f0284c08640 1 -- 172.21.15.27:0/3498766141 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ba8c4cff0 con 0x564ba8beeaf0 2024-09-19T08:12:51.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.207+0000 7f0285409640 1 --2- 172.21.15.27:0/3498766141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bd9650 0x564ba8bec950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:12:51.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.207+0000 7f0284c08640 1 --2- 172.21.15.27:0/3498766141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8beeaf0 0x564ba8c4c950 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f027000a850 tx=0x7f027000a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a28fb95e8a7f5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:51.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.207+0000 7f0268ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:12:51.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.207+0000 7f0268ff9640 1 -- 172.21.15.27:0/3498766141 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0270005570 con 0x564ba8beeaf0 2024-09-19T08:12:51.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.207+0000 7f0268ff9640 1 -- 172.21.15.27:0/3498766141 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f0270004730 con 0x564ba8beeaf0 2024-09-19T08:12:51.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.207+0000 7f0289a46740 1 -- 172.21.15.27:0/3498766141 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f027000fc80 con 0x564ba8beeaf0 2024-09-19T08:12:51.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.207+0000 7f0268ff9640 1 -- 172.21.15.27:0/3498766141 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f027003b080 con 0x564ba8beeaf0 2024-09-19T08:12:51.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.207+0000 7f0289a46740 10 client.15684 fetch_fsmap learned FSMap version 20 2024-09-19T08:12:51.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.207+0000 7f0289a46740 1 -- 172.21.15.27:0/3498766141 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564ba8c54420 con 0x564ba8beeaf0 2024-09-19T08:12:51.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.207+0000 7f0268ff9640 1 -- 172.21.15.27:0/3498766141 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f027000fc80 con 0x564ba8beeaf0 2024-09-19T08:12:51.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.208+0000 7f0268ff9640 1 -- 172.21.15.27:0/3498766141 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f0270039840 con 0x564ba8beeaf0 2024-09-19T08:12:51.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.208+0000 7f0289a46740 10 client.15684 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:12:51.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.208+0000 7f0289a46740 10 client.15684 resolve_mds: validated gid 24482 aka daemon mds.b 2024-09-19T08:12:51.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.208+0000 7f0289a46740 20 client.15684 populate_metadata read hostname 'smithi027' 2024-09-19T08:12:51.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.208+0000 7f0289a46740 1 --2- 172.21.15.27:0/3498766141 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564ba8c54ac0 0x564ba8c56ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:51.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.208+0000 7f0289a46740 4 client.15684 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b4e3713b", "release": true, "await": true}] 2024-09-19T08:12:51.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.208+0000 7f0289a46740 1 -- 172.21.15.27:0/3498766141 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b4e3713b", "release": true, "await": true}) -- 0x564ba8b370a0 con 0x564ba8c54ac0 2024-09-19T08:12:51.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.208+0000 7f0285409640 1 --2- 172.21.15.27:0/3498766141 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564ba8c54ac0 0x564ba8c56ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:51.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.208+0000 7f0285409640 1 --2- 172.21.15.27:0/3498766141 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564ba8c54ac0 0x564ba8c56ee0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89bbda73f118da5b server_cookie=6a119bdeabdb9edc in_seq=0 out_seq=0 2024-09-19T08:12:51.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.209+0000 7f0268ff9640 10 client.15684 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:51.500 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T08:12:51.500 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T08:12:51.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.212+0000 7f0268ff9640 1 -- 172.21.15.27:0/3498766141 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x564ba8b370a0 con 0x564ba8c54ac0 2024-09-19T08:12:51.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.212+0000 7f0268ff9640 10 client.15684 handle_command_reply: tid=0 2024-09-19T08:12:51.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.212+0000 7f0289a46740 1 client.15684 shutdown 2024-09-19T08:12:51.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.212+0000 7f0289a46740 1 -- 172.21.15.27:0/3498766141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8beeaf0 msgr2=0x564ba8c4c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:51.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.212+0000 7f0289a46740 1 --2- 172.21.15.27:0/3498766141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8beeaf0 0x564ba8c4c950 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f027000a850 tx=0x7f027000a7e0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.212+0000 7f0289a46740 1 -- 172.21.15.27:0/3498766141 shutdown_connections 2024-09-19T08:12:51.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.212+0000 7f0289a46740 1 --2- 172.21.15.27:0/3498766141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ba8beeaf0 0x564ba8c4c950 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.212+0000 7f0289a46740 1 --2- 172.21.15.27:0/3498766141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564ba8bd9650 0x564ba8bec950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.212+0000 7f0289a46740 1 --2- 172.21.15.27:0/3498766141 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564ba8c54ac0 0x564ba8c56ee0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.212+0000 7f0289a46740 1 --2- 172.21.15.27:0/3498766141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ba8bc9f40 0x564ba8bec410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.212+0000 7f0289a46740 1 -- 172.21.15.27:0/3498766141 >> 172.21.15.27:0/3498766141 conn(0x564ba8bc65f0 msgr2=0x564ba8bc4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:51.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.212+0000 7f0268ff9640 0 client.15684 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:51.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.213+0000 7f0289a46740 1 -- 172.21.15.27:0/3498766141 shutdown_connections 2024-09-19T08:12:51.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.213+0000 7f0289a46740 1 -- 172.21.15.27:0/3498766141 wait complete. 2024-09-19T08:12:51.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.213+0000 7f0289a46740 20 client.15684 trim_cache size 0 max 16384 2024-09-19T08:12:51.502 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:12:51.502 INFO:teuthology.orchestra.run.smithi027.stdout: "epoch": 20, 2024-09-19T08:12:51.502 INFO:teuthology.orchestra.run.smithi027.stdout: "leader": 24482, 2024-09-19T08:12:51.502 INFO:teuthology.orchestra.run.smithi027.stdout: "set_version": 8, 2024-09-19T08:12:51.502 INFO:teuthology.orchestra.run.smithi027.stdout: "sets": { 2024-09-19T08:12:51.502 INFO:teuthology.orchestra.run.smithi027.stdout: "b4e3713b": { 2024-09-19T08:12:51.503 INFO:teuthology.orchestra.run.smithi027.stdout: "version": 8, 2024-09-19T08:12:51.503 INFO:teuthology.orchestra.run.smithi027.stdout: "age_ref": 0.0, 2024-09-19T08:12:51.503 INFO:teuthology.orchestra.run.smithi027.stdout: "state": { 2024-09-19T08:12:51.503 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RELEASED", 2024-09-19T08:12:51.503 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0 2024-09-19T08:12:51.503 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:12:51.503 INFO:teuthology.orchestra.run.smithi027.stdout: "timeout": 90.0, 2024-09-19T08:12:51.503 INFO:teuthology.orchestra.run.smithi027.stdout: "expiration": 140.3, 2024-09-19T08:12:51.503 INFO:teuthology.orchestra.run.smithi027.stdout: "members": { 2024-09-19T08:12:51.503 INFO:teuthology.orchestra.run.smithi027.stdout: "file:/": { 2024-09-19T08:12:51.503 INFO:teuthology.orchestra.run.smithi027.stdout: "excluded": false, 2024-09-19T08:12:51.503 INFO:teuthology.orchestra.run.smithi027.stdout: "state": { 2024-09-19T08:12:51.503 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RELEASED", 2024-09-19T08:12:51.503 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0 2024-09-19T08:12:51.504 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:51.504 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:51.504 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:51.504 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:51.504 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:51.504 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:12:51.505 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:51 smithi155 ceph-mon[35362]: pgmap v57: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.6 KiB/s wr, 694 op/s 2024-09-19T08:12:51.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.213+0000 7f028766d640 1 -- 172.21.15.27:0/3495949669 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f026c0a33b0 msgr2=0x7f026c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:51.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.213+0000 7f028766d640 1 --2- 172.21.15.27:0/3495949669 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f026c0a33b0 0x7f026c0a5870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0278098360 tx=0x7f02780668f0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.213+0000 7f028766d640 1 -- 172.21.15.27:0/3495949669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0280106f50 msgr2=0x7f028019cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:51.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.213+0000 7f028766d640 1 --2- 172.21.15.27:0/3495949669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0280106f50 0x7f028019cdb0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f027800cad0 tx=0x7f027800ced0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.214+0000 7f028766d640 1 -- 172.21.15.27:0/3495949669 shutdown_connections 2024-09-19T08:12:51.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.214+0000 7f028766d640 1 --2- 172.21.15.27:0/3495949669 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f026c0a33b0 0x7f026c0a5870 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.214+0000 7f028766d640 1 --2- 172.21.15.27:0/3495949669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0280106f50 0x7f028019cdb0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.214+0000 7f028766d640 1 --2- 172.21.15.27:0/3495949669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0280100ca0 0x7f0280198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.214+0000 7f028766d640 1 --2- 172.21.15.27:0/3495949669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02801002f0 0x7f02801984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:51.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.214+0000 7f028766d640 1 -- 172.21.15.27:0/3495949669 >> 172.21.15.27:0/3495949669 conn(0x7f0280077210 msgr2=0x7f02800fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:51.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.214+0000 7f028766d640 1 -- 172.21.15.27:0/3495949669 shutdown_connections 2024-09-19T08:12:51.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:51.214+0000 7f028766d640 1 -- 172.21.15.27:0/3495949669 wait complete. 2024-09-19T08:12:51.507 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:12:51.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:51 smithi203 ceph-mon[35198]: pgmap v57: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.6 KiB/s wr, 694 op/s 2024-09-19T08:12:51.577 INFO:tasks.workunit:Running workunit direct_io/misc.sh... 2024-09-19T08:12:51.577 DEBUG:teuthology.orchestra.run.smithi027:workunit test direct_io/misc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/misc.sh 2024-09-19T08:12:51.640 INFO:tasks.workunit.client.0.smithi027.stdout:test read from hole 2024-09-19T08:12:51.640 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test read from hole' 2024-09-19T08:12:51.640 INFO:tasks.workunit.client.0.smithi027.stderr:+ dd if=/dev/zero of=dd3 bs=1 seek=1048576 count=0 2024-09-19T08:12:51.641 INFO:tasks.workunit.client.0.smithi027.stderr:0+0 records in 2024-09-19T08:12:51.641 INFO:tasks.workunit.client.0.smithi027.stderr:0+0 records out 2024-09-19T08:12:51.641 INFO:tasks.workunit.client.0.smithi027.stderr:0 bytes copied, 3.5892e-05 s, 0.0 kB/s 2024-09-19T08:12:51.641 INFO:tasks.workunit.client.0.smithi027.stderr:+ dd if=dd3 of=/tmp/ddout1 skip=8 bs=512 count=2 iflag=direct 2024-09-19T08:12:51.644 INFO:tasks.workunit.client.0.smithi027.stderr:2+0 records in 2024-09-19T08:12:51.645 INFO:tasks.workunit.client.0.smithi027.stderr:2+0 records out 2024-09-19T08:12:51.645 INFO:tasks.workunit.client.0.smithi027.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00237409 s, 431 kB/s 2024-09-19T08:12:51.645 INFO:tasks.workunit.client.0.smithi027.stderr:+ dd if=/dev/zero of=/tmp/dd3 bs=512 count=2 2024-09-19T08:12:51.645 INFO:tasks.workunit.client.0.smithi027.stderr:2+0 records in 2024-09-19T08:12:51.645 INFO:tasks.workunit.client.0.smithi027.stderr:2+0 records out 2024-09-19T08:12:51.645 INFO:tasks.workunit.client.0.smithi027.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 4.1478e-05 s, 24.7 MB/s 2024-09-19T08:12:51.646 INFO:tasks.workunit.client.0.smithi027.stderr:+ cmp /tmp/dd3 /tmp/ddout1 2024-09-19T08:12:51.646 INFO:tasks.workunit.client.0.smithi027.stdout:other thing 2024-09-19T08:12:51.646 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'other thing' 2024-09-19T08:12:51.647 INFO:tasks.workunit.client.0.smithi027.stderr:+ dd if=/dev/urandom of=/tmp/dd10 bs=500 count=1 2024-09-19T08:12:51.647 INFO:tasks.workunit.client.0.smithi027.stderr:1+0 records in 2024-09-19T08:12:51.647 INFO:tasks.workunit.client.0.smithi027.stderr:1+0 records out 2024-09-19T08:12:51.647 INFO:tasks.workunit.client.0.smithi027.stderr:500 bytes copied, 4.1341e-05 s, 12.1 MB/s 2024-09-19T08:12:51.647 INFO:tasks.workunit.client.0.smithi027.stderr:+ dd if=/tmp/dd10 of=dd10 bs=512 seek=8388 count=1 2024-09-19T08:12:51.655 INFO:tasks.workunit.client.0.smithi027.stderr:0+1 records in 2024-09-19T08:12:51.655 INFO:tasks.workunit.client.0.smithi027.stderr:0+1 records out 2024-09-19T08:12:51.655 INFO:tasks.workunit.client.0.smithi027.stderr:500 bytes copied, 0.00584297 s, 85.6 kB/s 2024-09-19T08:12:51.655 INFO:tasks.workunit.client.0.smithi027.stderr:+ dd if=dd10 of=/tmp/dd10out bs=512 skip=8388 count=1 iflag=direct 2024-09-19T08:12:51.658 INFO:tasks.workunit.client.0.smithi027.stderr:0+1 records in 2024-09-19T08:12:51.658 INFO:tasks.workunit.client.0.smithi027.stderr:0+1 records out 2024-09-19T08:12:51.658 INFO:tasks.workunit.client.0.smithi027.stderr:500 bytes copied, 0.00279271 s, 179 kB/s 2024-09-19T08:12:51.658 INFO:tasks.workunit.client.0.smithi027.stderr:+ cmp /tmp/dd10 /tmp/dd10out 2024-09-19T08:12:51.659 INFO:tasks.workunit.client.0.smithi027.stdout:OK 2024-09-19T08:12:51.660 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo OK 2024-09-19T08:12:51.660 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T08:12:51.660 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T08:12:51.736 INFO:tasks.workunit:Running workunit direct_io/test_short_dio_read... 2024-09-19T08:12:51.737 DEBUG:teuthology.orchestra.run.smithi027:workunit test direct_io/test_short_dio_read> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_short_dio_read 2024-09-19T08:12:51.806 INFO:tasks.workunit.client.0.smithi027.stdout:writing first 3 bytes of 10k file 2024-09-19T08:12:51.807 INFO:tasks.workunit.client.0.smithi027.stdout:reading O_DIRECT 2024-09-19T08:12:51.807 INFO:tasks.workunit.client.0.smithi027.stdout:got 10000 2024-09-19T08:12:51.807 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T08:12:51.807 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T08:12:51.881 INFO:tasks.workunit:Running workunit direct_io/test_sync_io... 2024-09-19T08:12:51.881 DEBUG:teuthology.orchestra.run.smithi027:workunit test direct_io/test_sync_io> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_sync_io 2024-09-19T08:12:51.953 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b4e3713b', total seconds elapsed: 23.6 2024-09-19T08:12:51.953 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T08:12:51.953 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:12:52.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.420+0000 7f7e15cdf640 1 -- 172.21.15.27:0/2442076883 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e10102570 msgr2=0x7f7e101029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:52.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.420+0000 7f7e15cdf640 1 --2- 172.21.15.27:0/2442076883 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e10102570 0x7f7e101029b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7df8009900 tx=0x7f7df802a480 comp rx=0 tx=0).stop 2024-09-19T08:12:52.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.420+0000 7f7e15cdf640 1 -- 172.21.15.27:0/2442076883 shutdown_connections 2024-09-19T08:12:52.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.420+0000 7f7e15cdf640 1 --2- 172.21.15.27:0/2442076883 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e10102ef0 0x7f7e1010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.420+0000 7f7e15cdf640 1 --2- 172.21.15.27:0/2442076883 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e10102570 0x7f7e101029b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.420+0000 7f7e15cdf640 1 --2- 172.21.15.27:0/2442076883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e10100e20 0x7f7e10101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.420+0000 7f7e15cdf640 1 -- 172.21.15.27:0/2442076883 >> 172.21.15.27:0/2442076883 conn(0x7f7e100fc7d0 msgr2=0x7f7e100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:52.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.420+0000 7f7e15cdf640 1 -- 172.21.15.27:0/2442076883 shutdown_connections 2024-09-19T08:12:52.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.420+0000 7f7e15cdf640 1 -- 172.21.15.27:0/2442076883 wait complete. 2024-09-19T08:12:52.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.421+0000 7f7e15cdf640 1 Processor -- start 2024-09-19T08:12:52.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.421+0000 7f7e15cdf640 1 -- start start 2024-09-19T08:12:52.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.421+0000 7f7e15cdf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e10100e20 0x7f7e100fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:52.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.421+0000 7f7e15cdf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e10102570 0x7f7e100fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:52.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.421+0000 7f7e15cdf640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e10102ef0 0x7f7e100fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:52.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.421+0000 7f7e15cdf640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7e10110f80 con 0x7f7e10100e20 2024-09-19T08:12:52.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.421+0000 7f7e15cdf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7e10110e00 con 0x7f7e10102570 2024-09-19T08:12:52.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.421+0000 7f7e15cdf640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7e10111100 con 0x7f7e10102ef0 2024-09-19T08:12:52.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.421+0000 7f7e0f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e10100e20 0x7f7e100fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:52.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.421+0000 7f7e0f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e10100e20 0x7f7e100fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45928/0 (socket says 172.21.15.27:45928) 2024-09-19T08:12:52.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.421+0000 7f7e0f7fe640 1 -- 172.21.15.27:0/449925230 learned_addr learned my addr 172.21.15.27:0/449925230 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:52.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.422+0000 7f7e0ffff640 1 --2- 172.21.15.27:0/449925230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e10102ef0 0x7f7e100fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:52.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.422+0000 7f7e0effd640 1 --2- 172.21.15.27:0/449925230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e10102570 0x7f7e100fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:52.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.422+0000 7f7e0f7fe640 1 -- 172.21.15.27:0/449925230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e10102ef0 msgr2=0x7f7e100fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:52.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.422+0000 7f7e0f7fe640 1 --2- 172.21.15.27:0/449925230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e10102ef0 0x7f7e100fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.422+0000 7f7e0f7fe640 1 -- 172.21.15.27:0/449925230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e10102570 msgr2=0x7f7e100fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:52.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.422+0000 7f7e0f7fe640 1 --2- 172.21.15.27:0/449925230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e10102570 0x7f7e100fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.422+0000 7f7e0f7fe640 1 -- 172.21.15.27:0/449925230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e101a6970 con 0x7f7e10100e20 2024-09-19T08:12:52.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.422+0000 7f7e0f7fe640 1 --2- 172.21.15.27:0/449925230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e10100e20 0x7f7e100fcc80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000e9f0 tx=0x7f7e0000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:52.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.422+0000 7f7e0cff9640 1 -- 172.21.15.27:0/449925230 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0000cd80 con 0x7f7e10100e20 2024-09-19T08:12:52.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.422+0000 7f7e15cdf640 1 -- 172.21.15.27:0/449925230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e101a6c60 con 0x7f7e10100e20 2024-09-19T08:12:52.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.422+0000 7f7e0cff9640 1 -- 172.21.15.27:0/449925230 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e00010910 con 0x7f7e10100e20 2024-09-19T08:12:52.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.422+0000 7f7e0cff9640 1 -- 172.21.15.27:0/449925230 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e000188f0 con 0x7f7e10100e20 2024-09-19T08:12:52.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.422+0000 7f7e15cdf640 1 -- 172.21.15.27:0/449925230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e101a71a0 con 0x7f7e10100e20 2024-09-19T08:12:52.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.425+0000 7f7e180b8740 1 Processor -- start 2024-09-19T08:12:52.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.425+0000 7f7e180b8740 1 -- start start 2024-09-19T08:12:52.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.425+0000 7f7e0cff9640 1 -- 172.21.15.27:0/449925230 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7e00010ac0 con 0x7f7e10100e20 2024-09-19T08:12:52.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.425+0000 7f7e180b8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618c61764a0 0x5618c6176880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:52.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.425+0000 7f7e180b8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6176dc0 0x5618c6181140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:52.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.425+0000 7f7e180b8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c6181680 0x5618c6183a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:52.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.425+0000 7f7e180b8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5618c60dc2e0 con 0x5618c6181680 2024-09-19T08:12:52.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.425+0000 7f7e180b8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5618c6083ce0 con 0x5618c6176dc0 2024-09-19T08:12:52.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.425+0000 7f7e180b8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5618c60d82a0 con 0x5618c61764a0 2024-09-19T08:12:52.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.425+0000 7f7e0effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c6181680 0x5618c6183a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:52.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.425+0000 7f7e0effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c6181680 0x5618c6183a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45940/0 (socket says 172.21.15.27:45940) 2024-09-19T08:12:52.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.425+0000 7f7e0effd640 1 -- 172.21.15.27:0/1429868936 learned_addr learned my addr 172.21.15.27:0/1429868936 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:52.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.425+0000 7f7e0f7fe640 1 --2- 172.21.15.27:0/1429868936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6176dc0 0x5618c6181140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:52.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.425+0000 7f7e0ffff640 1 --2- 172.21.15.27:0/1429868936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618c61764a0 0x5618c6176880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:52.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.425+0000 7f7e0effd640 1 -- 172.21.15.27:0/1429868936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618c61764a0 msgr2=0x5618c6176880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:52.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.425+0000 7f7e0effd640 1 --2- 172.21.15.27:0/1429868936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618c61764a0 0x5618c6176880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.425+0000 7f7e0effd640 1 -- 172.21.15.27:0/1429868936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6176dc0 msgr2=0x5618c6181140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:52.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.425+0000 7f7e0effd640 1 --2- 172.21.15.27:0/1429868936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6176dc0 0x5618c6181140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.426+0000 7f7e0effd640 1 -- 172.21.15.27:0/1429868936 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618c6068440 con 0x5618c6181680 2024-09-19T08:12:52.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.426+0000 7f7e0effd640 1 --2- 172.21.15.27:0/1429868936 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c6181680 0x5618c6183a70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7df802a9a0 tx=0x7f7df8005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ca7a61bd2b56b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:52.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.426+0000 7f7e05ffb640 1 -- 172.21.15.27:0/1429868936 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df8035030 con 0x5618c6181680 2024-09-19T08:12:52.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.426+0000 7f7e05ffb640 1 -- 172.21.15.27:0/1429868936 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7df8005520 con 0x5618c6181680 2024-09-19T08:12:52.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.426+0000 7f7e05ffb640 1 -- 172.21.15.27:0/1429868936 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df80035f0 con 0x5618c6181680 2024-09-19T08:12:52.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.426+0000 7f7e0cff9640 1 --2- 172.21.15.27:0/449925230 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7dfc0a33b0 0x7f7dfc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:52.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.426+0000 7f7e0ffff640 1 --2- 172.21.15.27:0/449925230 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7dfc0a33b0 0x7f7dfc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:52.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.426+0000 7f7e0cff9640 1 -- 172.21.15.27:0/449925230 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f7e000d01e0 con 0x7f7e10100e20 2024-09-19T08:12:52.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.427+0000 7f7e180b8740 1 -- 172.21.15.27:0/1429868936 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c6181680 msgr2=0x5618c6183a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:52.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.427+0000 7f7e180b8740 1 --2- 172.21.15.27:0/1429868936 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c6181680 0x5618c6183a70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7df802a9a0 tx=0x7f7df8005e60 comp rx=0 tx=0).stop 2024-09-19T08:12:52.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.427+0000 7f7e180b8740 1 -- 172.21.15.27:0/1429868936 shutdown_connections 2024-09-19T08:12:52.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.427+0000 7f7e180b8740 1 --2- 172.21.15.27:0/1429868936 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c6181680 0x5618c6183a70 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.427+0000 7f7e180b8740 1 --2- 172.21.15.27:0/1429868936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6176dc0 0x5618c6181140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.427+0000 7f7e180b8740 1 --2- 172.21.15.27:0/1429868936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618c61764a0 0x5618c6176880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.427+0000 7f7e180b8740 1 -- 172.21.15.27:0/1429868936 >> 172.21.15.27:0/1429868936 conn(0x5618c6172a30 msgr2=0x5618c6172e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:52.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.427+0000 7f7e180b8740 1 -- 172.21.15.27:0/1429868936 shutdown_connections 2024-09-19T08:12:52.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.427+0000 7f7e0ffff640 1 --2- 172.21.15.27:0/449925230 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7dfc0a33b0 0x7f7dfc0a5870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7e08005fd0 tx=0x7f7e08009500 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:52.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.427+0000 7f7e180b8740 1 -- 172.21.15.27:0/1429868936 wait complete. 2024-09-19T08:12:52.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.427+0000 7f7e180b8740 1 -- start start 2024-09-19T08:12:52.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.428+0000 7f7e180b8740 1 Processor -- start 2024-09-19T08:12:52.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.428+0000 7f7e180b8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c61764a0 0x5618c6180fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:52.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.428+0000 7f7e180b8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618c6176dc0 0x5618c617e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:52.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.428+0000 7f7e180b8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6181680 0x5618c617e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:52.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.428+0000 7f7e180b8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5618c6184250 con 0x5618c61764a0 2024-09-19T08:12:52.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.428+0000 7f7e180b8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5618c6097050 con 0x5618c6181680 2024-09-19T08:12:52.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.428+0000 7f7e180b8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5618c61843d0 con 0x5618c6176dc0 2024-09-19T08:12:52.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.428+0000 7f7e180b8740 10 client.0 _ll_register_callbacks cb 0x5618c60d7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:12:52.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.428+0000 7f7e0f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c61764a0 0x5618c6180fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:52.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.428+0000 7f7e0f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c61764a0 0x5618c6180fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45954/0 (socket says 172.21.15.27:45954) 2024-09-19T08:12:52.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.428+0000 7f7e0f7fe640 1 -- 172.21.15.27:0/2754150888 learned_addr learned my addr 172.21.15.27:0/2754150888 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:52.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.428+0000 7f7e0effd640 1 --2- 172.21.15.27:0/2754150888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618c6176dc0 0x5618c617e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:52.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.428+0000 7f7e0ffff640 1 --2- 172.21.15.27:0/2754150888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6181680 0x5618c617e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:52.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.429+0000 7f7e0f7fe640 1 -- 172.21.15.27:0/2754150888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618c6176dc0 msgr2=0x5618c617e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:52.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.429+0000 7f7e0f7fe640 1 --2- 172.21.15.27:0/2754150888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618c6176dc0 0x5618c617e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.429+0000 7f7e0f7fe640 1 -- 172.21.15.27:0/2754150888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6181680 msgr2=0x5618c617e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.429+0000 7f7e0f7fe640 1 --2- 172.21.15.27:0/2754150888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6181680 0x5618c617e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.429+0000 7f7e0f7fe640 1 -- 172.21.15.27:0/2754150888 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618c5e4d3c0 con 0x5618c61764a0 2024-09-19T08:12:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.429+0000 7f7e0ffff640 1 --2- 172.21.15.27:0/2754150888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6181680 0x5618c617e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:12:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.429+0000 7f7e0effd640 1 --2- 172.21.15.27:0/2754150888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618c6176dc0 0x5618c617e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:12:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.429+0000 7f7e0f7fe640 1 --2- 172.21.15.27:0/2754150888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c61764a0 0x5618c6180fe0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7e000cd9e0 tx=0x7f7e00009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381154ab1356b73d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.429+0000 7f7deeffd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:12:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.429+0000 7f7deeffd640 1 -- 172.21.15.27:0/2754150888 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0009c050 con 0x5618c61764a0 2024-09-19T08:12:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.429+0000 7f7deeffd640 1 -- 172.21.15.27:0/2754150888 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f7e0009bb60 con 0x5618c61764a0 2024-09-19T08:12:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.429+0000 7f7e180b8740 1 -- 172.21.15.27:0/2754150888 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7df8005520 con 0x5618c61764a0 2024-09-19T08:12:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.429+0000 7f7deeffd640 1 -- 172.21.15.27:0/2754150888 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7e0009be70 con 0x5618c61764a0 2024-09-19T08:12:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.429+0000 7f7e180b8740 10 client.15696 fetch_fsmap learned FSMap version 20 2024-09-19T08:12:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.429+0000 7f7e180b8740 1 -- 172.21.15.27:0/2754150888 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5618c618fc20 con 0x5618c61764a0 2024-09-19T08:12:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.429+0000 7f7deeffd640 1 -- 172.21.15.27:0/2754150888 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7df8005520 con 0x5618c61764a0 2024-09-19T08:12:52.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.430+0000 7f7deeffd640 1 -- 172.21.15.27:0/2754150888 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7e00098260 con 0x5618c61764a0 2024-09-19T08:12:52.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.430+0000 7f7e180b8740 10 client.15696 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:12:52.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.430+0000 7f7e180b8740 10 client.15696 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:12:52.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.430+0000 7f7e180b8740 20 client.15696 populate_metadata read hostname 'smithi027' 2024-09-19T08:12:52.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.430+0000 7f7e180b8740 1 --2- 172.21.15.27:0/2754150888 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5618c6191030 0x5618c6193440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:52.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.430+0000 7f7e180b8740 4 client.15696 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:12:52.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.430+0000 7f7e180b8740 1 -- 172.21.15.27:0/2754150888 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618c60e9850 con 0x5618c6191030 2024-09-19T08:12:52.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.430+0000 7f7e0effd640 1 --2- 172.21.15.27:0/2754150888 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5618c6191030 0x5618c6193440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:52.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.431+0000 7f7deeffd640 10 client.15696 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:52.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.431+0000 7f7e0effd640 1 --2- 172.21.15.27:0/2754150888 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5618c6191030 0x5618c6193440 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e0173954a9346ec server_cookie=1ba4b709c74764e6 in_seq=0 out_seq=0 2024-09-19T08:12:52.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.431+0000 7f7deeffd640 1 -- 172.21.15.27:0/2754150888 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5618c60e9850 con 0x5618c6191030 2024-09-19T08:12:52.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.431+0000 7f7deeffd640 10 client.15696 handle_command_reply: tid=0 2024-09-19T08:12:52.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.431+0000 7f7e180b8740 1 client.15696 shutdown 2024-09-19T08:12:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.431+0000 7f7e180b8740 1 -- 172.21.15.27:0/2754150888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c61764a0 msgr2=0x5618c6180fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.431+0000 7f7e180b8740 1 --2- 172.21.15.27:0/2754150888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c61764a0 0x5618c6180fe0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7e000cd9e0 tx=0x7f7e00009700 comp rx=0 tx=0).stop 2024-09-19T08:12:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.432+0000 7f7e180b8740 1 -- 172.21.15.27:0/2754150888 shutdown_connections 2024-09-19T08:12:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.432+0000 7f7e180b8740 1 --2- 172.21.15.27:0/2754150888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6181680 0x5618c617e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.432+0000 7f7e180b8740 1 --2- 172.21.15.27:0/2754150888 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5618c6191030 0x5618c6193440 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.432+0000 7f7e180b8740 1 --2- 172.21.15.27:0/2754150888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618c6176dc0 0x5618c617e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.432+0000 7f7e180b8740 1 --2- 172.21.15.27:0/2754150888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c61764a0 0x5618c6180fe0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.432+0000 7f7deeffd640 0 client.15696 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.432+0000 7f7e180b8740 1 -- 172.21.15.27:0/2754150888 >> 172.21.15.27:0/2754150888 conn(0x5618c6172a30 msgr2=0x5618c6178710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.432+0000 7f7e180b8740 1 -- 172.21.15.27:0/2754150888 shutdown_connections 2024-09-19T08:12:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.432+0000 7f7e180b8740 1 -- 172.21.15.27:0/2754150888 wait complete. 2024-09-19T08:12:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.432+0000 7f7e180b8740 20 client.15696 trim_cache size 0 max 16384 2024-09-19T08:12:52.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.450+0000 7f7e180b8740 1 Processor -- start 2024-09-19T08:12:52.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.450+0000 7f7e180b8740 1 -- start start 2024-09-19T08:12:52.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.450+0000 7f7e180b8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c61764a0 0x5618c6172e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:52.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.450+0000 7f7e180b8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618c6176dc0 0x5618c6198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:52.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.450+0000 7f7e180b8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6181680 0x5618c61991f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:52.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.450+0000 7f7e180b8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7e101ad8d0 con 0x5618c61764a0 2024-09-19T08:12:52.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.450+0000 7f7e180b8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7e101b0150 con 0x5618c6181680 2024-09-19T08:12:52.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.450+0000 7f7e180b8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7e101adf40 con 0x5618c6176dc0 2024-09-19T08:12:52.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.450+0000 7f7e0f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c61764a0 0x5618c6172e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:52.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.450+0000 7f7e0f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c61764a0 0x5618c6172e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45970/0 (socket says 172.21.15.27:45970) 2024-09-19T08:12:52.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.450+0000 7f7e0f7fe640 1 -- 172.21.15.27:0/3890681214 learned_addr learned my addr 172.21.15.27:0/3890681214 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:52.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.450+0000 7f7e0ffff640 1 --2- 172.21.15.27:0/3890681214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6181680 0x5618c61991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:52.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.450+0000 7f7e0effd640 1 --2- 172.21.15.27:0/3890681214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618c6176dc0 0x5618c6198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:52.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.451+0000 7f7e0f7fe640 1 -- 172.21.15.27:0/3890681214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618c6176dc0 msgr2=0x5618c6198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:52.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.451+0000 7f7e0f7fe640 1 --2- 172.21.15.27:0/3890681214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618c6176dc0 0x5618c6198cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.451+0000 7f7e0f7fe640 1 -- 172.21.15.27:0/3890681214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6181680 msgr2=0x5618c61991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:52.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.451+0000 7f7e0f7fe640 1 --2- 172.21.15.27:0/3890681214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6181680 0x5618c61991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.451+0000 7f7e0f7fe640 1 -- 172.21.15.27:0/3890681214 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618c617d240 con 0x5618c61764a0 2024-09-19T08:12:52.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.451+0000 7f7e0f7fe640 1 --2- 172.21.15.27:0/3890681214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c61764a0 0x5618c6172e10 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7e000cdf80 tx=0x7f7e000d3da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f369859b5e8a8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:52.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.451+0000 7f7e057fa640 1 -- 172.21.15.27:0/3890681214 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0009c050 con 0x5618c61764a0 2024-09-19T08:12:52.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.451+0000 7f7e057fa640 1 -- 172.21.15.27:0/3890681214 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e000d0030 con 0x5618c61764a0 2024-09-19T08:12:52.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.451+0000 7f7e057fa640 1 -- 172.21.15.27:0/3890681214 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0009bbc0 con 0x5618c61764a0 2024-09-19T08:12:52.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.452+0000 7f7e180b8740 1 -- 172.21.15.27:0/3890681214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c61764a0 msgr2=0x5618c6172e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:52.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.452+0000 7f7e180b8740 1 --2- 172.21.15.27:0/3890681214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c61764a0 0x5618c6172e10 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7e000cdf80 tx=0x7f7e000d3da0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.452+0000 7f7e180b8740 1 -- 172.21.15.27:0/3890681214 shutdown_connections 2024-09-19T08:12:52.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.452+0000 7f7e180b8740 1 --2- 172.21.15.27:0/3890681214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6181680 0x5618c61991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.452+0000 7f7e180b8740 1 --2- 172.21.15.27:0/3890681214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618c6176dc0 0x5618c6198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.452+0000 7f7e180b8740 1 --2- 172.21.15.27:0/3890681214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c61764a0 0x5618c6172e10 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.452+0000 7f7e180b8740 1 -- 172.21.15.27:0/3890681214 >> 172.21.15.27:0/3890681214 conn(0x5618c6172a30 msgr2=0x5618c6171b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:52.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.452+0000 7f7e180b8740 1 -- 172.21.15.27:0/3890681214 shutdown_connections 2024-09-19T08:12:52.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.452+0000 7f7e180b8740 1 -- 172.21.15.27:0/3890681214 wait complete. 2024-09-19T08:12:52.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.452+0000 7f7e180b8740 1 -- start start 2024-09-19T08:12:52.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.453+0000 7f7e180b8740 1 Processor -- start 2024-09-19T08:12:52.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.453+0000 7f7e180b8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618c61764a0 0x5618c6187630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:52.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.453+0000 7f7e180b8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6176dc0 0x5618c6187b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:52.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.453+0000 7f7e180b8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c6181680 0x5618c61880b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:52.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.453+0000 7f7e180b8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7e101ae610 con 0x5618c6181680 2024-09-19T08:12:52.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.453+0000 7f7e180b8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7e101afa80 con 0x5618c6176dc0 2024-09-19T08:12:52.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.453+0000 7f7e180b8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7e101aece0 con 0x5618c61764a0 2024-09-19T08:12:52.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.453+0000 7f7e180b8740 10 client.0 _ll_register_callbacks cb 0x7f7e00098040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:12:52.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.453+0000 7f7e0ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c6181680 0x5618c61880b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:52.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.453+0000 7f7e0ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c6181680 0x5618c61880b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45974/0 (socket says 172.21.15.27:45974) 2024-09-19T08:12:52.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.453+0000 7f7e0ffff640 1 -- 172.21.15.27:0/4141536445 learned_addr learned my addr 172.21.15.27:0/4141536445 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:52.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.454+0000 7f7e0effd640 1 --2- 172.21.15.27:0/4141536445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6176dc0 0x5618c6187b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:52.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.454+0000 7f7e0ffff640 1 -- 172.21.15.27:0/4141536445 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618c61764a0 msgr2=0x5618c6187630 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:12:52.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.454+0000 7f7e0ffff640 1 --2- 172.21.15.27:0/4141536445 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618c61764a0 0x5618c6187630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.454+0000 7f7e0ffff640 1 -- 172.21.15.27:0/4141536445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6176dc0 msgr2=0x5618c6187b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:52.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.454+0000 7f7e0ffff640 1 --2- 172.21.15.27:0/4141536445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6176dc0 0x5618c6187b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.454+0000 7f7e0ffff640 1 -- 172.21.15.27:0/4141536445 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618c6203740 con 0x5618c6181680 2024-09-19T08:12:52.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.454+0000 7f7e0ffff640 1 --2- 172.21.15.27:0/4141536445 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c6181680 0x5618c61880b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7e08004410 tx=0x7f7e08004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d736635b0d1a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:52.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.454+0000 7f7deeffd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:12:52.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.454+0000 7f7deeffd640 1 -- 172.21.15.27:0/4141536445 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0801d990 con 0x5618c6181680 2024-09-19T08:12:52.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.455+0000 7f7deeffd640 1 -- 172.21.15.27:0/4141536445 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f7e0801db30 con 0x5618c6181680 2024-09-19T08:12:52.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.455+0000 7f7e180b8740 1 -- 172.21.15.27:0/4141536445 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e000d0030 con 0x5618c6181680 2024-09-19T08:12:52.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.455+0000 7f7deeffd640 1 -- 172.21.15.27:0/4141536445 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7e08037050 con 0x5618c6181680 2024-09-19T08:12:52.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.455+0000 7f7e180b8740 10 client.15702 fetch_fsmap learned FSMap version 20 2024-09-19T08:12:52.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.455+0000 7f7e180b8740 1 -- 172.21.15.27:0/4141536445 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5618c6204a90 con 0x5618c6181680 2024-09-19T08:12:52.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.455+0000 7f7deeffd640 1 -- 172.21.15.27:0/4141536445 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e0802e070 con 0x5618c6181680 2024-09-19T08:12:52.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.455+0000 7f7deeffd640 1 -- 172.21.15.27:0/4141536445 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7e080293f0 con 0x5618c6181680 2024-09-19T08:12:52.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.455+0000 7f7e180b8740 10 client.15702 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:12:52.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.455+0000 7f7e180b8740 10 client.15702 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:12:52.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.455+0000 7f7e180b8740 20 client.15702 populate_metadata read hostname 'smithi027' 2024-09-19T08:12:52.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.456+0000 7f7e180b8740 1 --2- 172.21.15.27:0/4141536445 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5618c6205260 0x5618c62076a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:52.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.456+0000 7f7e180b8740 4 client.15702 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:12:52.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.456+0000 7f7e180b8740 1 -- 172.21.15.27:0/4141536445 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f7e000d0030 con 0x5618c6205260 2024-09-19T08:12:52.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.456+0000 7f7e0f7fe640 1 --2- 172.21.15.27:0/4141536445 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5618c6205260 0x5618c62076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:52.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.456+0000 7f7e0f7fe640 1 --2- 172.21.15.27:0/4141536445 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5618c6205260 0x5618c62076a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e86ee77af0869b1c server_cookie=36fee9fed76ddc6c in_seq=0 out_seq=0 2024-09-19T08:12:52.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.456+0000 7f7deeffd640 10 client.15702 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:52.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.457+0000 7f7deeffd640 1 -- 172.21.15.27:0/4141536445 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f7e000d0030 con 0x5618c6205260 2024-09-19T08:12:52.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.457+0000 7f7deeffd640 10 client.15702 handle_command_reply: tid=0 2024-09-19T08:12:52.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.457+0000 7f7e180b8740 1 client.15702 shutdown 2024-09-19T08:12:52.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.457+0000 7f7e180b8740 1 -- 172.21.15.27:0/4141536445 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c6181680 msgr2=0x5618c61880b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:52.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.457+0000 7f7e180b8740 1 --2- 172.21.15.27:0/4141536445 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c6181680 0x5618c61880b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7e08004410 tx=0x7f7e08004ab0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.457+0000 7f7e180b8740 1 -- 172.21.15.27:0/4141536445 shutdown_connections 2024-09-19T08:12:52.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.457+0000 7f7e180b8740 1 --2- 172.21.15.27:0/4141536445 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5618c6181680 0x5618c61880b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.457+0000 7f7e180b8740 1 --2- 172.21.15.27:0/4141536445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5618c6176dc0 0x5618c6187b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.457+0000 7f7e180b8740 1 --2- 172.21.15.27:0/4141536445 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5618c6205260 0x5618c62076a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.457+0000 7f7deeffd640 0 client.15702 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:52.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.457+0000 7f7e180b8740 1 --2- 172.21.15.27:0/4141536445 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618c61764a0 0x5618c6187630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.457+0000 7f7e180b8740 1 -- 172.21.15.27:0/4141536445 >> 172.21.15.27:0/4141536445 conn(0x5618c6172a30 msgr2=0x5618c617faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:52.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.457+0000 7f7e180b8740 1 -- 172.21.15.27:0/4141536445 shutdown_connections 2024-09-19T08:12:52.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.457+0000 7f7e180b8740 1 -- 172.21.15.27:0/4141536445 wait complete. 2024-09-19T08:12:52.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.458+0000 7f7e180b8740 20 client.15702 trim_cache size 0 max 16384 2024-09-19T08:12:52.462 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:12:52.462 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:12:52.462 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:12:52.462 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:12:52.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.458+0000 7f7e15cdf640 1 -- 172.21.15.27:0/449925230 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7dfc0a33b0 msgr2=0x7f7dfc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:52.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.458+0000 7f7e15cdf640 1 --2- 172.21.15.27:0/449925230 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7dfc0a33b0 0x7f7dfc0a5870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7e08005fd0 tx=0x7f7e08009500 comp rx=0 tx=0).stop 2024-09-19T08:12:52.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.458+0000 7f7e15cdf640 1 -- 172.21.15.27:0/449925230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e10100e20 msgr2=0x7f7e100fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:52.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.458+0000 7f7e15cdf640 1 --2- 172.21.15.27:0/449925230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e10100e20 0x7f7e100fcc80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000e9f0 tx=0x7f7e0000eeb0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.458+0000 7f7e15cdf640 1 -- 172.21.15.27:0/449925230 shutdown_connections 2024-09-19T08:12:52.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.458+0000 7f7e15cdf640 1 --2- 172.21.15.27:0/449925230 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7dfc0a33b0 0x7f7dfc0a5870 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.458+0000 7f7e15cdf640 1 --2- 172.21.15.27:0/449925230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e10102ef0 0x7f7e100fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.458+0000 7f7e15cdf640 1 --2- 172.21.15.27:0/449925230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e10102570 0x7f7e100fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.458+0000 7f7e15cdf640 1 --2- 172.21.15.27:0/449925230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e10100e20 0x7f7e100fcc80 secure :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000e9f0 tx=0x7f7e0000eeb0 comp rx=0 tx=0).stop 2024-09-19T08:12:52.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.458+0000 7f7e15cdf640 1 -- 172.21.15.27:0/449925230 >> 172.21.15.27:0/449925230 conn(0x7f7e100fc7d0 msgr2=0x7f7e1006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:52.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.459+0000 7f7e15cdf640 1 -- 172.21.15.27:0/449925230 shutdown_connections 2024-09-19T08:12:52.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:52.459+0000 7f7e15cdf640 1 -- 172.21.15.27:0/449925230 wait complete. 2024-09-19T08:12:52.829 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:12:53.224 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:53 smithi027 ceph-mon[31209]: pgmap v58: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.5 KiB/s wr, 693 op/s 2024-09-19T08:12:53.251 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:12:53.251 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:12:53.398 INFO:tasks.workunit.client.0.smithi027.stdout:writing pattern 2024-09-19T08:12:53.398 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4190208 len 1024 2024-09-19T08:12:53.398 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4190208 len 1024 2024-09-19T08:12:53.398 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4190208 len 1024 2024-09-19T08:12:53.398 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4190208 len 1024 2024-09-19T08:12:53.398 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4190208 len 2048 2024-09-19T08:12:53.398 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4190208 len 2048 2024-09-19T08:12:53.398 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4190208 len 2048 2024-09-19T08:12:53.398 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4190208 len 2048 2024-09-19T08:12:53.398 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4190208 len 4096 2024-09-19T08:12:53.398 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4190208 len 4096 2024-09-19T08:12:53.399 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4190208 len 4096 2024-09-19T08:12:53.399 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4190208 len 4096 2024-09-19T08:12:53.399 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4190208 len 8192 2024-09-19T08:12:53.399 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4190208 len 8192 2024-09-19T08:12:53.399 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4190208 len 8192 2024-09-19T08:12:53.399 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4190208 len 8192 2024-09-19T08:12:53.399 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4190208 len 16384 2024-09-19T08:12:53.399 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4190208 len 16384 2024-09-19T08:12:53.399 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4190208 len 16384 2024-09-19T08:12:53.399 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4190208 len 16384 2024-09-19T08:12:53.399 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4190720 len 1024 2024-09-19T08:12:53.399 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4190720 len 1024 2024-09-19T08:12:53.399 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4190720 len 1024 2024-09-19T08:12:53.399 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4190720 len 1024 2024-09-19T08:12:53.400 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4190720 len 2048 2024-09-19T08:12:53.400 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4190720 len 2048 2024-09-19T08:12:53.400 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4190720 len 2048 2024-09-19T08:12:53.400 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4190720 len 2048 2024-09-19T08:12:53.400 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4190720 len 4096 2024-09-19T08:12:53.400 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4190720 len 4096 2024-09-19T08:12:53.400 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4190720 len 4096 2024-09-19T08:12:53.400 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4190720 len 4096 2024-09-19T08:12:53.400 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4190720 len 8192 2024-09-19T08:12:53.400 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4190720 len 8192 2024-09-19T08:12:53.400 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4190720 len 8192 2024-09-19T08:12:53.400 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4190720 len 8192 2024-09-19T08:12:53.400 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4190720 len 16384 2024-09-19T08:12:53.401 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4190720 len 16384 2024-09-19T08:12:53.401 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4190720 len 16384 2024-09-19T08:12:53.401 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4190720 len 16384 2024-09-19T08:12:53.401 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4191232 len 1024 2024-09-19T08:12:53.401 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4191232 len 1024 2024-09-19T08:12:53.401 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4191232 len 1024 2024-09-19T08:12:53.401 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4191232 len 1024 2024-09-19T08:12:53.401 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4191232 len 2048 2024-09-19T08:12:53.401 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4191232 len 2048 2024-09-19T08:12:53.401 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4191232 len 2048 2024-09-19T08:12:53.401 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4191232 len 2048 2024-09-19T08:12:53.401 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4191232 len 4096 2024-09-19T08:12:53.401 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4191232 len 4096 2024-09-19T08:12:53.401 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4191232 len 4096 2024-09-19T08:12:53.402 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4191232 len 4096 2024-09-19T08:12:53.402 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4191232 len 8192 2024-09-19T08:12:53.402 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4191232 len 8192 2024-09-19T08:12:53.402 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4191232 len 8192 2024-09-19T08:12:53.402 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4191232 len 8192 2024-09-19T08:12:53.402 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4191232 len 16384 2024-09-19T08:12:53.402 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4191232 len 16384 2024-09-19T08:12:53.402 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4191232 len 16384 2024-09-19T08:12:53.402 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4191232 len 16384 2024-09-19T08:12:53.402 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4191744 len 1024 2024-09-19T08:12:53.402 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4191744 len 1024 2024-09-19T08:12:53.402 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4191744 len 1024 2024-09-19T08:12:53.402 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4191744 len 1024 2024-09-19T08:12:53.402 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4191744 len 2048 2024-09-19T08:12:53.403 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4191744 len 2048 2024-09-19T08:12:53.403 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4191744 len 2048 2024-09-19T08:12:53.403 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4191744 len 2048 2024-09-19T08:12:53.403 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4191744 len 4096 2024-09-19T08:12:53.403 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4191744 len 4096 2024-09-19T08:12:53.403 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4191744 len 4096 2024-09-19T08:12:53.403 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4191744 len 4096 2024-09-19T08:12:53.403 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4191744 len 8192 2024-09-19T08:12:53.403 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4191744 len 8192 2024-09-19T08:12:53.403 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4191744 len 8192 2024-09-19T08:12:53.403 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4191744 len 8192 2024-09-19T08:12:53.403 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4191744 len 16384 2024-09-19T08:12:53.403 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4191744 len 16384 2024-09-19T08:12:53.403 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4191744 len 16384 2024-09-19T08:12:53.404 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4191744 len 16384 2024-09-19T08:12:53.404 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4192256 len 1024 2024-09-19T08:12:53.404 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4192256 len 1024 2024-09-19T08:12:53.404 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4192256 len 1024 2024-09-19T08:12:53.404 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4192256 len 1024 2024-09-19T08:12:53.404 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4192256 len 2048 2024-09-19T08:12:53.404 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4192256 len 2048 2024-09-19T08:12:53.404 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4192256 len 2048 2024-09-19T08:12:53.424 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4192256 len 2048 2024-09-19T08:12:53.425 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4192256 len 4096 2024-09-19T08:12:53.425 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4192256 len 4096 2024-09-19T08:12:53.425 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4192256 len 4096 2024-09-19T08:12:53.425 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4192256 len 4096 2024-09-19T08:12:53.425 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4192256 len 8192 2024-09-19T08:12:53.425 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4192256 len 8192 2024-09-19T08:12:53.425 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4192256 len 8192 2024-09-19T08:12:53.425 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4192256 len 8192 2024-09-19T08:12:53.426 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4192256 len 16384 2024-09-19T08:12:53.426 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4192256 len 16384 2024-09-19T08:12:53.426 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4192256 len 16384 2024-09-19T08:12:53.426 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4192256 len 16384 2024-09-19T08:12:53.426 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4192768 len 1024 2024-09-19T08:12:53.426 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4192768 len 1024 2024-09-19T08:12:53.426 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4192768 len 1024 2024-09-19T08:12:53.426 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4192768 len 1024 2024-09-19T08:12:53.427 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4192768 len 2048 2024-09-19T08:12:53.427 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4192768 len 2048 2024-09-19T08:12:53.427 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4192768 len 2048 2024-09-19T08:12:53.427 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4192768 len 2048 2024-09-19T08:12:53.427 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4192768 len 4096 2024-09-19T08:12:53.427 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4192768 len 4096 2024-09-19T08:12:53.427 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4192768 len 4096 2024-09-19T08:12:53.427 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4192768 len 4096 2024-09-19T08:12:53.427 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4192768 len 8192 2024-09-19T08:12:53.427 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4192768 len 8192 2024-09-19T08:12:53.428 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4192768 len 8192 2024-09-19T08:12:53.428 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4192768 len 8192 2024-09-19T08:12:53.428 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4192768 len 16384 2024-09-19T08:12:53.428 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4192768 len 16384 2024-09-19T08:12:53.428 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4192768 len 16384 2024-09-19T08:12:53.428 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4192768 len 16384 2024-09-19T08:12:53.428 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4193280 len 1024 2024-09-19T08:12:53.428 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4193280 len 1024 2024-09-19T08:12:53.428 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4193280 len 1024 2024-09-19T08:12:53.428 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4193280 len 1024 2024-09-19T08:12:53.429 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4193280 len 2048 2024-09-19T08:12:53.429 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4193280 len 2048 2024-09-19T08:12:53.429 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4193280 len 2048 2024-09-19T08:12:53.429 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4193280 len 2048 2024-09-19T08:12:53.429 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4193280 len 4096 2024-09-19T08:12:53.429 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4193280 len 4096 2024-09-19T08:12:53.429 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4193280 len 4096 2024-09-19T08:12:53.429 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4193280 len 4096 2024-09-19T08:12:53.429 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4193280 len 8192 2024-09-19T08:12:53.429 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4193280 len 8192 2024-09-19T08:12:53.430 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4193280 len 8192 2024-09-19T08:12:53.430 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4193280 len 8192 2024-09-19T08:12:53.430 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4193280 len 16384 2024-09-19T08:12:53.430 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4193280 len 16384 2024-09-19T08:12:53.430 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4193280 len 16384 2024-09-19T08:12:53.430 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4193280 len 16384 2024-09-19T08:12:53.430 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4193792 len 1024 2024-09-19T08:12:53.430 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4193792 len 1024 2024-09-19T08:12:53.430 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4193792 len 1024 2024-09-19T08:12:53.430 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4193792 len 1024 2024-09-19T08:12:53.430 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4193792 len 2048 2024-09-19T08:12:53.430 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4193792 len 2048 2024-09-19T08:12:53.430 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4193792 len 2048 2024-09-19T08:12:53.431 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4193792 len 2048 2024-09-19T08:12:53.431 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4193792 len 4096 2024-09-19T08:12:53.431 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4193792 len 4096 2024-09-19T08:12:53.431 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4193792 len 4096 2024-09-19T08:12:53.431 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4193792 len 4096 2024-09-19T08:12:53.431 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4193792 len 8192 2024-09-19T08:12:53.431 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4193792 len 8192 2024-09-19T08:12:53.431 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4193792 len 8192 2024-09-19T08:12:53.431 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4193792 len 8192 2024-09-19T08:12:53.431 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4193792 len 16384 2024-09-19T08:12:53.431 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4193792 len 16384 2024-09-19T08:12:53.431 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4193792 len 16384 2024-09-19T08:12:53.431 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4193792 len 16384 2024-09-19T08:12:53.432 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4194304 len 1024 2024-09-19T08:12:53.432 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4194304 len 1024 2024-09-19T08:12:53.432 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4194304 len 1024 2024-09-19T08:12:53.432 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4194304 len 1024 2024-09-19T08:12:53.432 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4194304 len 2048 2024-09-19T08:12:53.432 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4194304 len 2048 2024-09-19T08:12:53.432 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4194304 len 2048 2024-09-19T08:12:53.432 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4194304 len 2048 2024-09-19T08:12:53.432 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4194304 len 4096 2024-09-19T08:12:53.432 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4194304 len 4096 2024-09-19T08:12:53.432 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4194304 len 4096 2024-09-19T08:12:53.432 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4194304 len 4096 2024-09-19T08:12:53.433 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4194304 len 8192 2024-09-19T08:12:53.433 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4194304 len 8192 2024-09-19T08:12:53.433 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4194304 len 8192 2024-09-19T08:12:53.440 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4194304 len 8192 2024-09-19T08:12:53.440 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4194304 len 16384 2024-09-19T08:12:53.440 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4194304 len 16384 2024-09-19T08:12:53.440 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4194304 len 16384 2024-09-19T08:12:53.440 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4194304 len 16384 2024-09-19T08:12:53.440 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4194816 len 1024 2024-09-19T08:12:53.440 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4194816 len 1024 2024-09-19T08:12:53.440 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4194816 len 1024 2024-09-19T08:12:53.440 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4194816 len 1024 2024-09-19T08:12:53.440 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4194816 len 2048 2024-09-19T08:12:53.441 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4194816 len 2048 2024-09-19T08:12:53.441 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4194816 len 2048 2024-09-19T08:12:53.441 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4194816 len 2048 2024-09-19T08:12:53.441 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4194816 len 4096 2024-09-19T08:12:53.441 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4194816 len 4096 2024-09-19T08:12:53.441 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4194816 len 4096 2024-09-19T08:12:53.441 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4194816 len 4096 2024-09-19T08:12:53.441 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4194816 len 8192 2024-09-19T08:12:53.441 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4194816 len 8192 2024-09-19T08:12:53.441 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4194816 len 8192 2024-09-19T08:12:53.441 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4194816 len 8192 2024-09-19T08:12:53.441 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4194816 len 16384 2024-09-19T08:12:53.441 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4194816 len 16384 2024-09-19T08:12:53.441 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4194816 len 16384 2024-09-19T08:12:53.442 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4194816 len 16384 2024-09-19T08:12:53.442 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4195328 len 1024 2024-09-19T08:12:53.442 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4195328 len 1024 2024-09-19T08:12:53.442 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4195328 len 1024 2024-09-19T08:12:53.442 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4195328 len 1024 2024-09-19T08:12:53.442 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4195328 len 2048 2024-09-19T08:12:53.442 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4195328 len 2048 2024-09-19T08:12:53.442 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4195328 len 2048 2024-09-19T08:12:53.442 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4195328 len 2048 2024-09-19T08:12:53.442 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4195328 len 4096 2024-09-19T08:12:53.442 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4195328 len 4096 2024-09-19T08:12:53.442 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4195328 len 4096 2024-09-19T08:12:53.442 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4195328 len 4096 2024-09-19T08:12:53.442 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4195328 len 8192 2024-09-19T08:12:53.443 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4195328 len 8192 2024-09-19T08:12:53.443 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4195328 len 8192 2024-09-19T08:12:53.443 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4195328 len 8192 2024-09-19T08:12:53.443 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4195328 len 16384 2024-09-19T08:12:53.443 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4195328 len 16384 2024-09-19T08:12:53.443 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4195328 len 16384 2024-09-19T08:12:53.443 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4195328 len 16384 2024-09-19T08:12:53.443 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4195840 len 1024 2024-09-19T08:12:53.443 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4195840 len 1024 2024-09-19T08:12:53.443 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4195840 len 1024 2024-09-19T08:12:53.443 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4195840 len 1024 2024-09-19T08:12:53.443 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4195840 len 2048 2024-09-19T08:12:53.443 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4195840 len 2048 2024-09-19T08:12:53.443 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4195840 len 2048 2024-09-19T08:12:53.444 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4195840 len 2048 2024-09-19T08:12:53.444 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4195840 len 4096 2024-09-19T08:12:53.444 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4195840 len 4096 2024-09-19T08:12:53.444 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4195840 len 4096 2024-09-19T08:12:53.444 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4195840 len 4096 2024-09-19T08:12:53.444 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4195840 len 8192 2024-09-19T08:12:53.444 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4195840 len 8192 2024-09-19T08:12:53.444 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4195840 len 8192 2024-09-19T08:12:53.444 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4195840 len 8192 2024-09-19T08:12:53.444 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4195840 len 16384 2024-09-19T08:12:53.444 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4195840 len 16384 2024-09-19T08:12:53.444 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4195840 len 16384 2024-09-19T08:12:53.444 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4195840 len 16384 2024-09-19T08:12:53.444 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4196352 len 1024 2024-09-19T08:12:53.445 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4196352 len 1024 2024-09-19T08:12:53.445 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4196352 len 1024 2024-09-19T08:12:53.445 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4196352 len 1024 2024-09-19T08:12:53.445 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4196352 len 2048 2024-09-19T08:12:53.445 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4196352 len 2048 2024-09-19T08:12:53.445 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4196352 len 2048 2024-09-19T08:12:53.445 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4196352 len 2048 2024-09-19T08:12:53.445 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4196352 len 4096 2024-09-19T08:12:53.445 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4196352 len 4096 2024-09-19T08:12:53.445 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4196352 len 4096 2024-09-19T08:12:53.445 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4196352 len 4096 2024-09-19T08:12:53.445 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4196352 len 8192 2024-09-19T08:12:53.445 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4196352 len 8192 2024-09-19T08:12:53.446 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4196352 len 8192 2024-09-19T08:12:53.446 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4196352 len 8192 2024-09-19T08:12:53.446 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4196352 len 16384 2024-09-19T08:12:53.446 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4196352 len 16384 2024-09-19T08:12:53.446 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4196352 len 16384 2024-09-19T08:12:53.446 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4196352 len 16384 2024-09-19T08:12:53.446 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4196864 len 1024 2024-09-19T08:12:53.446 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4196864 len 1024 2024-09-19T08:12:53.453 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4196864 len 1024 2024-09-19T08:12:53.453 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4196864 len 1024 2024-09-19T08:12:53.453 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4196864 len 2048 2024-09-19T08:12:53.453 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4196864 len 2048 2024-09-19T08:12:53.453 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4196864 len 2048 2024-09-19T08:12:53.453 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4196864 len 2048 2024-09-19T08:12:53.453 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4196864 len 4096 2024-09-19T08:12:53.453 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4196864 len 4096 2024-09-19T08:12:53.453 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4196864 len 4096 2024-09-19T08:12:53.453 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4196864 len 4096 2024-09-19T08:12:53.453 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4196864 len 8192 2024-09-19T08:12:53.454 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4196864 len 8192 2024-09-19T08:12:53.454 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4196864 len 8192 2024-09-19T08:12:53.454 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4196864 len 8192 2024-09-19T08:12:53.454 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4196864 len 16384 2024-09-19T08:12:53.454 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4196864 len 16384 2024-09-19T08:12:53.454 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4196864 len 16384 2024-09-19T08:12:53.454 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4196864 len 16384 2024-09-19T08:12:53.454 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4197376 len 1024 2024-09-19T08:12:53.454 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4197376 len 1024 2024-09-19T08:12:53.454 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4197376 len 1024 2024-09-19T08:12:53.455 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4197376 len 1024 2024-09-19T08:12:53.455 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4197376 len 2048 2024-09-19T08:12:53.455 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4197376 len 2048 2024-09-19T08:12:53.455 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4197376 len 2048 2024-09-19T08:12:53.455 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4197376 len 2048 2024-09-19T08:12:53.455 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4197376 len 4096 2024-09-19T08:12:53.455 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4197376 len 4096 2024-09-19T08:12:53.455 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4197376 len 4096 2024-09-19T08:12:53.455 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4197376 len 4096 2024-09-19T08:12:53.455 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4197376 len 8192 2024-09-19T08:12:53.455 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4197376 len 8192 2024-09-19T08:12:53.455 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4197376 len 8192 2024-09-19T08:12:53.456 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4197376 len 8192 2024-09-19T08:12:53.457 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4197376 len 16384 2024-09-19T08:12:53.457 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4197376 len 16384 2024-09-19T08:12:53.457 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4197376 len 16384 2024-09-19T08:12:53.458 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4197376 len 16384 2024-09-19T08:12:53.458 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4197888 len 1024 2024-09-19T08:12:53.458 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4197888 len 1024 2024-09-19T08:12:53.458 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4197888 len 1024 2024-09-19T08:12:53.458 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4197888 len 1024 2024-09-19T08:12:53.458 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4197888 len 2048 2024-09-19T08:12:53.458 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4197888 len 2048 2024-09-19T08:12:53.459 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4197888 len 2048 2024-09-19T08:12:53.459 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4197888 len 2048 2024-09-19T08:12:53.459 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4197888 len 4096 2024-09-19T08:12:53.459 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4197888 len 4096 2024-09-19T08:12:53.459 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4197888 len 4096 2024-09-19T08:12:53.459 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4197888 len 4096 2024-09-19T08:12:53.459 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4197888 len 8192 2024-09-19T08:12:53.459 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4197888 len 8192 2024-09-19T08:12:53.459 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4197888 len 8192 2024-09-19T08:12:53.459 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4197888 len 8192 2024-09-19T08:12:53.459 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 0 offset 4197888 len 16384 2024-09-19T08:12:53.459 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4197888 len 16384 2024-09-19T08:12:53.459 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 0 offset 4197888 len 16384 2024-09-19T08:12:53.460 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 0 offset 4197888 len 16384 2024-09-19T08:12:53.460 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4190208 len 1024 2024-09-19T08:12:53.460 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4190208 len 1024 2024-09-19T08:12:53.460 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4190208 len 1024 2024-09-19T08:12:53.460 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4190208 len 1024 2024-09-19T08:12:53.460 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4190208 len 2048 2024-09-19T08:12:53.460 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4190208 len 2048 2024-09-19T08:12:53.460 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4190208 len 2048 2024-09-19T08:12:53.461 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4190208 len 2048 2024-09-19T08:12:53.461 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4190208 len 4096 2024-09-19T08:12:53.461 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4190208 len 4096 2024-09-19T08:12:53.461 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4190208 len 4096 2024-09-19T08:12:53.461 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4190208 len 4096 2024-09-19T08:12:53.462 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4190208 len 8192 2024-09-19T08:12:53.462 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4190208 len 8192 2024-09-19T08:12:53.462 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4190208 len 8192 2024-09-19T08:12:53.462 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4190208 len 8192 2024-09-19T08:12:53.462 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4190208 len 16384 2024-09-19T08:12:53.462 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4190208 len 16384 2024-09-19T08:12:53.462 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4190208 len 16384 2024-09-19T08:12:53.462 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4190208 len 16384 2024-09-19T08:12:53.463 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4190720 len 1024 2024-09-19T08:12:53.463 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4190720 len 1024 2024-09-19T08:12:53.463 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4190720 len 1024 2024-09-19T08:12:53.463 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4190720 len 1024 2024-09-19T08:12:53.463 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4190720 len 2048 2024-09-19T08:12:53.463 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4190720 len 2048 2024-09-19T08:12:53.463 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4190720 len 2048 2024-09-19T08:12:53.463 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4190720 len 2048 2024-09-19T08:12:53.463 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4190720 len 4096 2024-09-19T08:12:53.471 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4190720 len 4096 2024-09-19T08:12:53.472 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4190720 len 4096 2024-09-19T08:12:53.472 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4190720 len 4096 2024-09-19T08:12:53.472 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4190720 len 8192 2024-09-19T08:12:53.472 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4190720 len 8192 2024-09-19T08:12:53.472 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4190720 len 8192 2024-09-19T08:12:53.472 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4190720 len 8192 2024-09-19T08:12:53.472 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4190720 len 16384 2024-09-19T08:12:53.472 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4190720 len 16384 2024-09-19T08:12:53.472 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4190720 len 16384 2024-09-19T08:12:53.472 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4190720 len 16384 2024-09-19T08:12:53.472 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4191232 len 1024 2024-09-19T08:12:53.472 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4191232 len 1024 2024-09-19T08:12:53.472 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4191232 len 1024 2024-09-19T08:12:53.473 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4191232 len 1024 2024-09-19T08:12:53.473 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4191232 len 2048 2024-09-19T08:12:53.473 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4191232 len 2048 2024-09-19T08:12:53.473 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4191232 len 2048 2024-09-19T08:12:53.473 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4191232 len 2048 2024-09-19T08:12:53.473 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4191232 len 4096 2024-09-19T08:12:53.473 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4191232 len 4096 2024-09-19T08:12:53.473 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4191232 len 4096 2024-09-19T08:12:53.473 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4191232 len 4096 2024-09-19T08:12:53.473 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4191232 len 8192 2024-09-19T08:12:53.473 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4191232 len 8192 2024-09-19T08:12:53.473 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4191232 len 8192 2024-09-19T08:12:53.473 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4191232 len 8192 2024-09-19T08:12:53.473 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4191232 len 16384 2024-09-19T08:12:53.474 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4191232 len 16384 2024-09-19T08:12:53.474 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4191232 len 16384 2024-09-19T08:12:53.474 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4191232 len 16384 2024-09-19T08:12:53.474 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4191744 len 1024 2024-09-19T08:12:53.474 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4191744 len 1024 2024-09-19T08:12:53.474 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4191744 len 1024 2024-09-19T08:12:53.474 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4191744 len 1024 2024-09-19T08:12:53.474 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4191744 len 2048 2024-09-19T08:12:53.474 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4191744 len 2048 2024-09-19T08:12:53.474 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4191744 len 2048 2024-09-19T08:12:53.474 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4191744 len 2048 2024-09-19T08:12:53.474 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4191744 len 4096 2024-09-19T08:12:53.474 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4191744 len 4096 2024-09-19T08:12:53.474 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4191744 len 4096 2024-09-19T08:12:53.475 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4191744 len 4096 2024-09-19T08:12:53.475 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4191744 len 8192 2024-09-19T08:12:53.475 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4191744 len 8192 2024-09-19T08:12:53.475 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4191744 len 8192 2024-09-19T08:12:53.475 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4191744 len 8192 2024-09-19T08:12:53.475 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4191744 len 16384 2024-09-19T08:12:53.475 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4191744 len 16384 2024-09-19T08:12:53.475 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4191744 len 16384 2024-09-19T08:12:53.475 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4191744 len 16384 2024-09-19T08:12:53.475 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4192256 len 1024 2024-09-19T08:12:53.475 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4192256 len 1024 2024-09-19T08:12:53.475 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4192256 len 1024 2024-09-19T08:12:53.475 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4192256 len 1024 2024-09-19T08:12:53.475 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4192256 len 2048 2024-09-19T08:12:53.476 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4192256 len 2048 2024-09-19T08:12:53.476 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4192256 len 2048 2024-09-19T08:12:53.476 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4192256 len 2048 2024-09-19T08:12:53.476 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4192256 len 4096 2024-09-19T08:12:53.476 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4192256 len 4096 2024-09-19T08:12:53.476 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4192256 len 4096 2024-09-19T08:12:53.476 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4192256 len 4096 2024-09-19T08:12:53.476 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4192256 len 8192 2024-09-19T08:12:53.476 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4192256 len 8192 2024-09-19T08:12:53.476 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4192256 len 8192 2024-09-19T08:12:53.476 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4192256 len 8192 2024-09-19T08:12:53.476 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4192256 len 16384 2024-09-19T08:12:53.476 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4192256 len 16384 2024-09-19T08:12:53.476 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4192256 len 16384 2024-09-19T08:12:53.477 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4192256 len 16384 2024-09-19T08:12:53.477 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4192768 len 1024 2024-09-19T08:12:53.477 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4192768 len 1024 2024-09-19T08:12:53.477 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4192768 len 1024 2024-09-19T08:12:53.477 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4192768 len 1024 2024-09-19T08:12:53.477 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4192768 len 2048 2024-09-19T08:12:53.477 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4192768 len 2048 2024-09-19T08:12:53.477 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4192768 len 2048 2024-09-19T08:12:53.477 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4192768 len 2048 2024-09-19T08:12:53.478 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4192768 len 4096 2024-09-19T08:12:53.478 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4192768 len 4096 2024-09-19T08:12:53.478 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4192768 len 4096 2024-09-19T08:12:53.478 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4192768 len 4096 2024-09-19T08:12:53.478 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4192768 len 8192 2024-09-19T08:12:53.487 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4192768 len 8192 2024-09-19T08:12:53.487 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4192768 len 8192 2024-09-19T08:12:53.487 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4192768 len 8192 2024-09-19T08:12:53.487 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4192768 len 16384 2024-09-19T08:12:53.487 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4192768 len 16384 2024-09-19T08:12:53.487 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4192768 len 16384 2024-09-19T08:12:53.487 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4192768 len 16384 2024-09-19T08:12:53.487 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4193280 len 1024 2024-09-19T08:12:53.487 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4193280 len 1024 2024-09-19T08:12:53.488 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4193280 len 1024 2024-09-19T08:12:53.488 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4193280 len 1024 2024-09-19T08:12:53.488 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4193280 len 2048 2024-09-19T08:12:53.488 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4193280 len 2048 2024-09-19T08:12:53.488 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4193280 len 2048 2024-09-19T08:12:53.488 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4193280 len 2048 2024-09-19T08:12:53.488 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4193280 len 4096 2024-09-19T08:12:53.488 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4193280 len 4096 2024-09-19T08:12:53.488 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4193280 len 4096 2024-09-19T08:12:53.488 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4193280 len 4096 2024-09-19T08:12:53.488 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4193280 len 8192 2024-09-19T08:12:53.488 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4193280 len 8192 2024-09-19T08:12:53.488 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4193280 len 8192 2024-09-19T08:12:53.489 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4193280 len 8192 2024-09-19T08:12:53.489 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4193280 len 16384 2024-09-19T08:12:53.489 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4193280 len 16384 2024-09-19T08:12:53.489 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4193280 len 16384 2024-09-19T08:12:53.489 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4193280 len 16384 2024-09-19T08:12:53.489 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4193792 len 1024 2024-09-19T08:12:53.489 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4193792 len 1024 2024-09-19T08:12:53.489 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4193792 len 1024 2024-09-19T08:12:53.489 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4193792 len 1024 2024-09-19T08:12:53.489 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4193792 len 2048 2024-09-19T08:12:53.489 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4193792 len 2048 2024-09-19T08:12:53.489 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4193792 len 2048 2024-09-19T08:12:53.489 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4193792 len 2048 2024-09-19T08:12:53.489 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4193792 len 4096 2024-09-19T08:12:53.490 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4193792 len 4096 2024-09-19T08:12:53.490 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4193792 len 4096 2024-09-19T08:12:53.490 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4193792 len 4096 2024-09-19T08:12:53.490 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4193792 len 8192 2024-09-19T08:12:53.490 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4193792 len 8192 2024-09-19T08:12:53.490 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4193792 len 8192 2024-09-19T08:12:53.490 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4193792 len 8192 2024-09-19T08:12:53.490 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4193792 len 16384 2024-09-19T08:12:53.490 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4193792 len 16384 2024-09-19T08:12:53.490 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4193792 len 16384 2024-09-19T08:12:53.490 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4193792 len 16384 2024-09-19T08:12:53.490 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4194304 len 1024 2024-09-19T08:12:53.490 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4194304 len 1024 2024-09-19T08:12:53.490 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4194304 len 1024 2024-09-19T08:12:53.491 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4194304 len 1024 2024-09-19T08:12:53.491 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4194304 len 2048 2024-09-19T08:12:53.491 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4194304 len 2048 2024-09-19T08:12:53.491 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4194304 len 2048 2024-09-19T08:12:53.491 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4194304 len 2048 2024-09-19T08:12:53.491 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4194304 len 4096 2024-09-19T08:12:53.491 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4194304 len 4096 2024-09-19T08:12:53.491 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4194304 len 4096 2024-09-19T08:12:53.491 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4194304 len 4096 2024-09-19T08:12:53.491 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4194304 len 8192 2024-09-19T08:12:53.491 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4194304 len 8192 2024-09-19T08:12:53.492 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4194304 len 8192 2024-09-19T08:12:53.492 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4194304 len 8192 2024-09-19T08:12:53.492 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4194304 len 16384 2024-09-19T08:12:53.492 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4194304 len 16384 2024-09-19T08:12:53.492 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4194304 len 16384 2024-09-19T08:12:53.492 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4194304 len 16384 2024-09-19T08:12:53.492 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4194816 len 1024 2024-09-19T08:12:53.492 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4194816 len 1024 2024-09-19T08:12:53.492 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4194816 len 1024 2024-09-19T08:12:53.492 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4194816 len 1024 2024-09-19T08:12:53.492 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4194816 len 2048 2024-09-19T08:12:53.492 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4194816 len 2048 2024-09-19T08:12:53.492 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4194816 len 2048 2024-09-19T08:12:53.493 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4194816 len 2048 2024-09-19T08:12:53.493 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4194816 len 4096 2024-09-19T08:12:53.493 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4194816 len 4096 2024-09-19T08:12:53.493 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4194816 len 4096 2024-09-19T08:12:53.493 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4194816 len 4096 2024-09-19T08:12:53.493 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4194816 len 8192 2024-09-19T08:12:53.493 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4194816 len 8192 2024-09-19T08:12:53.493 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4194816 len 8192 2024-09-19T08:12:53.493 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4194816 len 8192 2024-09-19T08:12:53.493 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4194816 len 16384 2024-09-19T08:12:53.494 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:53 smithi155 ceph-mon[35362]: pgmap v58: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.5 KiB/s wr, 693 op/s 2024-09-19T08:12:53.496 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4194816 len 16384 2024-09-19T08:12:53.497 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4194816 len 16384 2024-09-19T08:12:53.497 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4194816 len 16384 2024-09-19T08:12:53.497 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4195328 len 1024 2024-09-19T08:12:53.497 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4195328 len 1024 2024-09-19T08:12:53.497 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4195328 len 1024 2024-09-19T08:12:53.497 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4195328 len 1024 2024-09-19T08:12:53.497 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4195328 len 2048 2024-09-19T08:12:53.497 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4195328 len 2048 2024-09-19T08:12:53.497 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4195328 len 2048 2024-09-19T08:12:53.497 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4195328 len 2048 2024-09-19T08:12:53.497 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4195328 len 4096 2024-09-19T08:12:53.497 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4195328 len 4096 2024-09-19T08:12:53.497 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4195328 len 4096 2024-09-19T08:12:53.498 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4195328 len 4096 2024-09-19T08:12:53.498 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4195328 len 8192 2024-09-19T08:12:53.498 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4195328 len 8192 2024-09-19T08:12:53.498 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4195328 len 8192 2024-09-19T08:12:53.498 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4195328 len 8192 2024-09-19T08:12:53.498 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4195328 len 16384 2024-09-19T08:12:53.498 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4195328 len 16384 2024-09-19T08:12:53.498 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4195328 len 16384 2024-09-19T08:12:53.498 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4195328 len 16384 2024-09-19T08:12:53.498 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4195840 len 1024 2024-09-19T08:12:53.498 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4195840 len 1024 2024-09-19T08:12:53.498 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4195840 len 1024 2024-09-19T08:12:53.498 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4195840 len 1024 2024-09-19T08:12:53.498 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4195840 len 2048 2024-09-19T08:12:53.499 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4195840 len 2048 2024-09-19T08:12:53.499 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4195840 len 2048 2024-09-19T08:12:53.499 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4195840 len 2048 2024-09-19T08:12:53.499 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4195840 len 4096 2024-09-19T08:12:53.499 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4195840 len 4096 2024-09-19T08:12:53.499 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4195840 len 4096 2024-09-19T08:12:53.499 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4195840 len 4096 2024-09-19T08:12:53.499 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4195840 len 8192 2024-09-19T08:12:53.499 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4195840 len 8192 2024-09-19T08:12:53.499 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4195840 len 8192 2024-09-19T08:12:53.499 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4195840 len 8192 2024-09-19T08:12:53.499 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4195840 len 16384 2024-09-19T08:12:53.499 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4195840 len 16384 2024-09-19T08:12:53.499 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4195840 len 16384 2024-09-19T08:12:53.500 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4195840 len 16384 2024-09-19T08:12:53.500 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4196352 len 1024 2024-09-19T08:12:53.500 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4196352 len 1024 2024-09-19T08:12:53.500 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4196352 len 1024 2024-09-19T08:12:53.500 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4196352 len 1024 2024-09-19T08:12:53.500 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4196352 len 2048 2024-09-19T08:12:53.500 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4196352 len 2048 2024-09-19T08:12:53.500 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4196352 len 2048 2024-09-19T08:12:53.500 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4196352 len 2048 2024-09-19T08:12:53.500 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4196352 len 4096 2024-09-19T08:12:53.500 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4196352 len 4096 2024-09-19T08:12:53.500 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4196352 len 4096 2024-09-19T08:12:53.500 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4196352 len 4096 2024-09-19T08:12:53.501 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4196352 len 8192 2024-09-19T08:12:53.501 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4196352 len 8192 2024-09-19T08:12:53.501 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4196352 len 8192 2024-09-19T08:12:53.501 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4196352 len 8192 2024-09-19T08:12:53.501 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4196352 len 16384 2024-09-19T08:12:53.501 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4196352 len 16384 2024-09-19T08:12:53.501 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4196352 len 16384 2024-09-19T08:12:53.501 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4196352 len 16384 2024-09-19T08:12:53.501 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4196864 len 1024 2024-09-19T08:12:53.501 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4196864 len 1024 2024-09-19T08:12:53.501 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4196864 len 1024 2024-09-19T08:12:53.501 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4196864 len 1024 2024-09-19T08:12:53.501 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4196864 len 2048 2024-09-19T08:12:53.502 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4196864 len 2048 2024-09-19T08:12:53.502 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4196864 len 2048 2024-09-19T08:12:53.502 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4196864 len 2048 2024-09-19T08:12:53.502 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4196864 len 4096 2024-09-19T08:12:53.502 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4196864 len 4096 2024-09-19T08:12:53.502 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4196864 len 4096 2024-09-19T08:12:53.502 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4196864 len 4096 2024-09-19T08:12:53.502 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4196864 len 8192 2024-09-19T08:12:53.502 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4196864 len 8192 2024-09-19T08:12:53.502 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4196864 len 8192 2024-09-19T08:12:53.502 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4196864 len 8192 2024-09-19T08:12:53.503 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4196864 len 16384 2024-09-19T08:12:53.503 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4196864 len 16384 2024-09-19T08:12:53.503 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4196864 len 16384 2024-09-19T08:12:53.503 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4196864 len 16384 2024-09-19T08:12:53.503 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4197376 len 1024 2024-09-19T08:12:53.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:53 smithi203 ceph-mon[35198]: pgmap v58: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.5 KiB/s wr, 693 op/s 2024-09-19T08:12:53.512 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4197376 len 1024 2024-09-19T08:12:53.513 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4197376 len 1024 2024-09-19T08:12:53.513 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4197376 len 1024 2024-09-19T08:12:53.513 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4197376 len 2048 2024-09-19T08:12:53.513 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4197376 len 2048 2024-09-19T08:12:53.513 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4197376 len 2048 2024-09-19T08:12:53.513 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4197376 len 2048 2024-09-19T08:12:53.513 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4197376 len 4096 2024-09-19T08:12:53.513 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4197376 len 4096 2024-09-19T08:12:53.513 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4197376 len 4096 2024-09-19T08:12:53.513 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4197376 len 4096 2024-09-19T08:12:53.513 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4197376 len 8192 2024-09-19T08:12:53.513 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4197376 len 8192 2024-09-19T08:12:53.514 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4197376 len 8192 2024-09-19T08:12:53.514 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4197376 len 8192 2024-09-19T08:12:53.514 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4197376 len 16384 2024-09-19T08:12:53.514 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4197376 len 16384 2024-09-19T08:12:53.514 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4197376 len 16384 2024-09-19T08:12:53.514 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4197376 len 16384 2024-09-19T08:12:53.514 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4197888 len 1024 2024-09-19T08:12:53.514 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4197888 len 1024 2024-09-19T08:12:53.514 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4197888 len 1024 2024-09-19T08:12:53.514 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4197888 len 1024 2024-09-19T08:12:53.514 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4197888 len 2048 2024-09-19T08:12:53.514 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4197888 len 2048 2024-09-19T08:12:53.514 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4197888 len 2048 2024-09-19T08:12:53.514 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4197888 len 2048 2024-09-19T08:12:53.515 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4197888 len 4096 2024-09-19T08:12:53.515 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4197888 len 4096 2024-09-19T08:12:53.515 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4197888 len 4096 2024-09-19T08:12:53.515 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4197888 len 4096 2024-09-19T08:12:53.515 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4197888 len 8192 2024-09-19T08:12:53.515 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4197888 len 8192 2024-09-19T08:12:53.515 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4197888 len 8192 2024-09-19T08:12:53.515 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4197888 len 8192 2024-09-19T08:12:53.515 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 512 offset 4197888 len 16384 2024-09-19T08:12:53.515 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4197888 len 16384 2024-09-19T08:12:53.515 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 512 offset 4197888 len 16384 2024-09-19T08:12:53.515 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 512 offset 4197888 len 16384 2024-09-19T08:12:53.515 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4190208 len 1024 2024-09-19T08:12:53.515 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4190208 len 1024 2024-09-19T08:12:53.516 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4190208 len 1024 2024-09-19T08:12:53.516 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4190208 len 1024 2024-09-19T08:12:53.516 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4190208 len 2048 2024-09-19T08:12:53.516 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4190208 len 2048 2024-09-19T08:12:53.516 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4190208 len 2048 2024-09-19T08:12:53.516 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4190208 len 2048 2024-09-19T08:12:53.516 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4190208 len 4096 2024-09-19T08:12:53.516 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4190208 len 4096 2024-09-19T08:12:53.516 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4190208 len 4096 2024-09-19T08:12:53.516 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4190208 len 4096 2024-09-19T08:12:53.516 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4190208 len 8192 2024-09-19T08:12:53.516 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4190208 len 8192 2024-09-19T08:12:53.516 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4190208 len 8192 2024-09-19T08:12:53.516 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4190208 len 8192 2024-09-19T08:12:53.517 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4190208 len 16384 2024-09-19T08:12:53.517 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4190208 len 16384 2024-09-19T08:12:53.517 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4190208 len 16384 2024-09-19T08:12:53.517 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4190208 len 16384 2024-09-19T08:12:53.517 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4190720 len 1024 2024-09-19T08:12:53.517 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4190720 len 1024 2024-09-19T08:12:53.517 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4190720 len 1024 2024-09-19T08:12:53.517 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4190720 len 1024 2024-09-19T08:12:53.517 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4190720 len 2048 2024-09-19T08:12:53.517 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4190720 len 2048 2024-09-19T08:12:53.517 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4190720 len 2048 2024-09-19T08:12:53.517 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4190720 len 2048 2024-09-19T08:12:53.517 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4190720 len 4096 2024-09-19T08:12:53.517 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4190720 len 4096 2024-09-19T08:12:53.518 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4190720 len 4096 2024-09-19T08:12:53.518 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4190720 len 4096 2024-09-19T08:12:53.518 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4190720 len 8192 2024-09-19T08:12:53.518 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4190720 len 8192 2024-09-19T08:12:53.518 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4190720 len 8192 2024-09-19T08:12:53.518 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4190720 len 8192 2024-09-19T08:12:53.518 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4190720 len 16384 2024-09-19T08:12:53.519 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4190720 len 16384 2024-09-19T08:12:53.519 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4190720 len 16384 2024-09-19T08:12:53.519 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4190720 len 16384 2024-09-19T08:12:53.519 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4191232 len 1024 2024-09-19T08:12:53.519 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4191232 len 1024 2024-09-19T08:12:53.519 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4191232 len 1024 2024-09-19T08:12:53.519 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4191232 len 1024 2024-09-19T08:12:53.536 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4191232 len 2048 2024-09-19T08:12:53.536 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4191232 len 2048 2024-09-19T08:12:53.536 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4191232 len 2048 2024-09-19T08:12:53.536 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4191232 len 2048 2024-09-19T08:12:53.536 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4191232 len 4096 2024-09-19T08:12:53.536 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4191232 len 4096 2024-09-19T08:12:53.536 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4191232 len 4096 2024-09-19T08:12:53.537 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4191232 len 4096 2024-09-19T08:12:53.537 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4191232 len 8192 2024-09-19T08:12:53.537 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4191232 len 8192 2024-09-19T08:12:53.537 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4191232 len 8192 2024-09-19T08:12:53.537 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4191232 len 8192 2024-09-19T08:12:53.537 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4191232 len 16384 2024-09-19T08:12:53.537 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4191232 len 16384 2024-09-19T08:12:53.537 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4191232 len 16384 2024-09-19T08:12:53.537 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4191232 len 16384 2024-09-19T08:12:53.537 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4191744 len 1024 2024-09-19T08:12:53.537 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4191744 len 1024 2024-09-19T08:12:53.537 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4191744 len 1024 2024-09-19T08:12:53.537 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4191744 len 1024 2024-09-19T08:12:53.538 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4191744 len 2048 2024-09-19T08:12:53.538 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4191744 len 2048 2024-09-19T08:12:53.538 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4191744 len 2048 2024-09-19T08:12:53.538 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4191744 len 2048 2024-09-19T08:12:53.538 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4191744 len 4096 2024-09-19T08:12:53.538 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4191744 len 4096 2024-09-19T08:12:53.538 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4191744 len 4096 2024-09-19T08:12:53.538 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4191744 len 4096 2024-09-19T08:12:53.538 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4191744 len 8192 2024-09-19T08:12:53.538 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4191744 len 8192 2024-09-19T08:12:53.539 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4191744 len 8192 2024-09-19T08:12:53.539 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4191744 len 8192 2024-09-19T08:12:53.539 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4191744 len 16384 2024-09-19T08:12:53.539 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4191744 len 16384 2024-09-19T08:12:53.539 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4191744 len 16384 2024-09-19T08:12:53.539 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4191744 len 16384 2024-09-19T08:12:53.539 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4192256 len 1024 2024-09-19T08:12:53.539 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4192256 len 1024 2024-09-19T08:12:53.539 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4192256 len 1024 2024-09-19T08:12:53.539 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4192256 len 1024 2024-09-19T08:12:53.539 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4192256 len 2048 2024-09-19T08:12:53.539 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4192256 len 2048 2024-09-19T08:12:53.539 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4192256 len 2048 2024-09-19T08:12:53.539 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4192256 len 2048 2024-09-19T08:12:53.540 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4192256 len 4096 2024-09-19T08:12:53.540 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4192256 len 4096 2024-09-19T08:12:53.540 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4192256 len 4096 2024-09-19T08:12:53.540 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4192256 len 4096 2024-09-19T08:12:53.540 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4192256 len 8192 2024-09-19T08:12:53.540 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4192256 len 8192 2024-09-19T08:12:53.540 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4192256 len 8192 2024-09-19T08:12:53.540 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4192256 len 8192 2024-09-19T08:12:53.540 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4192256 len 16384 2024-09-19T08:12:53.540 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4192256 len 16384 2024-09-19T08:12:53.541 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4192256 len 16384 2024-09-19T08:12:53.541 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4192256 len 16384 2024-09-19T08:12:53.541 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4192768 len 1024 2024-09-19T08:12:53.541 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4192768 len 1024 2024-09-19T08:12:53.541 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4192768 len 1024 2024-09-19T08:12:53.541 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4192768 len 1024 2024-09-19T08:12:53.541 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4192768 len 2048 2024-09-19T08:12:53.541 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4192768 len 2048 2024-09-19T08:12:53.541 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4192768 len 2048 2024-09-19T08:12:53.541 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4192768 len 2048 2024-09-19T08:12:53.541 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4192768 len 4096 2024-09-19T08:12:53.542 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4192768 len 4096 2024-09-19T08:12:53.542 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4192768 len 4096 2024-09-19T08:12:53.542 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4192768 len 4096 2024-09-19T08:12:53.542 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4192768 len 8192 2024-09-19T08:12:53.542 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4192768 len 8192 2024-09-19T08:12:53.542 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4192768 len 8192 2024-09-19T08:12:53.542 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4192768 len 8192 2024-09-19T08:12:53.542 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4192768 len 16384 2024-09-19T08:12:53.542 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4192768 len 16384 2024-09-19T08:12:53.543 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4192768 len 16384 2024-09-19T08:12:53.543 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4192768 len 16384 2024-09-19T08:12:53.543 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4193280 len 1024 2024-09-19T08:12:53.543 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4193280 len 1024 2024-09-19T08:12:53.543 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4193280 len 1024 2024-09-19T08:12:53.543 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4193280 len 1024 2024-09-19T08:12:53.543 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4193280 len 2048 2024-09-19T08:12:53.543 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4193280 len 2048 2024-09-19T08:12:53.543 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4193280 len 2048 2024-09-19T08:12:53.553 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4193280 len 2048 2024-09-19T08:12:53.553 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4193280 len 4096 2024-09-19T08:12:53.553 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4193280 len 4096 2024-09-19T08:12:53.554 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4193280 len 4096 2024-09-19T08:12:53.554 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4193280 len 4096 2024-09-19T08:12:53.554 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4193280 len 8192 2024-09-19T08:12:53.554 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4193280 len 8192 2024-09-19T08:12:53.554 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4193280 len 8192 2024-09-19T08:12:53.554 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4193280 len 8192 2024-09-19T08:12:53.554 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4193280 len 16384 2024-09-19T08:12:53.554 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4193280 len 16384 2024-09-19T08:12:53.554 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4193280 len 16384 2024-09-19T08:12:53.554 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4193280 len 16384 2024-09-19T08:12:53.554 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4193792 len 1024 2024-09-19T08:12:53.554 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4193792 len 1024 2024-09-19T08:12:53.554 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4193792 len 1024 2024-09-19T08:12:53.555 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4193792 len 1024 2024-09-19T08:12:53.555 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4193792 len 2048 2024-09-19T08:12:53.555 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4193792 len 2048 2024-09-19T08:12:53.555 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4193792 len 2048 2024-09-19T08:12:53.555 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4193792 len 2048 2024-09-19T08:12:53.555 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4193792 len 4096 2024-09-19T08:12:53.555 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4193792 len 4096 2024-09-19T08:12:53.555 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4193792 len 4096 2024-09-19T08:12:53.555 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4193792 len 4096 2024-09-19T08:12:53.555 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4193792 len 8192 2024-09-19T08:12:53.555 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4193792 len 8192 2024-09-19T08:12:53.555 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4193792 len 8192 2024-09-19T08:12:53.555 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4193792 len 8192 2024-09-19T08:12:53.555 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4193792 len 16384 2024-09-19T08:12:53.556 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4193792 len 16384 2024-09-19T08:12:53.556 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4193792 len 16384 2024-09-19T08:12:53.556 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4193792 len 16384 2024-09-19T08:12:53.556 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4194304 len 1024 2024-09-19T08:12:53.556 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4194304 len 1024 2024-09-19T08:12:53.556 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4194304 len 1024 2024-09-19T08:12:53.556 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4194304 len 1024 2024-09-19T08:12:53.556 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4194304 len 2048 2024-09-19T08:12:53.556 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4194304 len 2048 2024-09-19T08:12:53.556 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4194304 len 2048 2024-09-19T08:12:53.556 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4194304 len 2048 2024-09-19T08:12:53.556 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4194304 len 4096 2024-09-19T08:12:53.556 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4194304 len 4096 2024-09-19T08:12:53.557 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4194304 len 4096 2024-09-19T08:12:53.557 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4194304 len 4096 2024-09-19T08:12:53.557 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4194304 len 8192 2024-09-19T08:12:53.557 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4194304 len 8192 2024-09-19T08:12:53.557 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4194304 len 8192 2024-09-19T08:12:53.557 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4194304 len 8192 2024-09-19T08:12:53.557 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4194304 len 16384 2024-09-19T08:12:53.557 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4194304 len 16384 2024-09-19T08:12:53.557 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4194304 len 16384 2024-09-19T08:12:53.557 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4194304 len 16384 2024-09-19T08:12:53.557 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4194816 len 1024 2024-09-19T08:12:53.557 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4194816 len 1024 2024-09-19T08:12:53.557 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4194816 len 1024 2024-09-19T08:12:53.557 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4194816 len 1024 2024-09-19T08:12:53.558 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4194816 len 2048 2024-09-19T08:12:53.558 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4194816 len 2048 2024-09-19T08:12:53.558 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4194816 len 2048 2024-09-19T08:12:53.558 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4194816 len 2048 2024-09-19T08:12:53.558 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4194816 len 4096 2024-09-19T08:12:53.558 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4194816 len 4096 2024-09-19T08:12:53.558 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4194816 len 4096 2024-09-19T08:12:53.558 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4194816 len 4096 2024-09-19T08:12:53.558 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4194816 len 8192 2024-09-19T08:12:53.560 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4194816 len 8192 2024-09-19T08:12:53.561 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4194816 len 8192 2024-09-19T08:12:53.561 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4194816 len 8192 2024-09-19T08:12:53.561 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4194816 len 16384 2024-09-19T08:12:53.561 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4194816 len 16384 2024-09-19T08:12:53.561 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4194816 len 16384 2024-09-19T08:12:53.561 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4194816 len 16384 2024-09-19T08:12:53.561 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4195328 len 1024 2024-09-19T08:12:53.561 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4195328 len 1024 2024-09-19T08:12:53.561 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4195328 len 1024 2024-09-19T08:12:53.561 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4195328 len 1024 2024-09-19T08:12:53.562 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4195328 len 2048 2024-09-19T08:12:53.562 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4195328 len 2048 2024-09-19T08:12:53.562 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4195328 len 2048 2024-09-19T08:12:53.562 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4195328 len 2048 2024-09-19T08:12:53.562 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4195328 len 4096 2024-09-19T08:12:53.564 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4195328 len 4096 2024-09-19T08:12:53.564 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4195328 len 4096 2024-09-19T08:12:53.564 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4195328 len 4096 2024-09-19T08:12:53.564 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4195328 len 8192 2024-09-19T08:12:53.564 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4195328 len 8192 2024-09-19T08:12:53.564 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4195328 len 8192 2024-09-19T08:12:53.564 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4195328 len 8192 2024-09-19T08:12:53.564 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4195328 len 16384 2024-09-19T08:12:53.564 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4195328 len 16384 2024-09-19T08:12:53.564 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4195328 len 16384 2024-09-19T08:12:53.564 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4195328 len 16384 2024-09-19T08:12:53.564 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4195840 len 1024 2024-09-19T08:12:53.565 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4195840 len 1024 2024-09-19T08:12:53.565 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4195840 len 1024 2024-09-19T08:12:53.565 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4195840 len 1024 2024-09-19T08:12:53.565 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4195840 len 2048 2024-09-19T08:12:53.565 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4195840 len 2048 2024-09-19T08:12:53.565 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4195840 len 2048 2024-09-19T08:12:53.565 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4195840 len 2048 2024-09-19T08:12:53.565 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4195840 len 4096 2024-09-19T08:12:53.565 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4195840 len 4096 2024-09-19T08:12:53.565 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4195840 len 4096 2024-09-19T08:12:53.566 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4195840 len 4096 2024-09-19T08:12:53.566 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4195840 len 8192 2024-09-19T08:12:53.566 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4195840 len 8192 2024-09-19T08:12:53.566 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4195840 len 8192 2024-09-19T08:12:53.566 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4195840 len 8192 2024-09-19T08:12:53.566 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4195840 len 16384 2024-09-19T08:12:53.566 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4195840 len 16384 2024-09-19T08:12:53.566 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4195840 len 16384 2024-09-19T08:12:53.566 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4195840 len 16384 2024-09-19T08:12:53.566 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4196352 len 1024 2024-09-19T08:12:53.566 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4196352 len 1024 2024-09-19T08:12:53.566 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4196352 len 1024 2024-09-19T08:12:53.566 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4196352 len 1024 2024-09-19T08:12:53.567 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4196352 len 2048 2024-09-19T08:12:53.567 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4196352 len 2048 2024-09-19T08:12:53.567 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4196352 len 2048 2024-09-19T08:12:53.567 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4196352 len 2048 2024-09-19T08:12:53.567 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4196352 len 4096 2024-09-19T08:12:53.567 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4196352 len 4096 2024-09-19T08:12:53.567 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4196352 len 4096 2024-09-19T08:12:53.567 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4196352 len 4096 2024-09-19T08:12:53.567 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4196352 len 8192 2024-09-19T08:12:53.567 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4196352 len 8192 2024-09-19T08:12:53.568 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4196352 len 8192 2024-09-19T08:12:53.568 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4196352 len 8192 2024-09-19T08:12:53.568 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4196352 len 16384 2024-09-19T08:12:53.568 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4196352 len 16384 2024-09-19T08:12:53.568 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4196352 len 16384 2024-09-19T08:12:53.568 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4196352 len 16384 2024-09-19T08:12:53.568 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4196864 len 1024 2024-09-19T08:12:53.568 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4196864 len 1024 2024-09-19T08:12:53.568 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4196864 len 1024 2024-09-19T08:12:53.568 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4196864 len 1024 2024-09-19T08:12:53.568 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4196864 len 2048 2024-09-19T08:12:53.569 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4196864 len 2048 2024-09-19T08:12:53.569 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4196864 len 2048 2024-09-19T08:12:53.569 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4196864 len 2048 2024-09-19T08:12:53.569 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4196864 len 4096 2024-09-19T08:12:53.569 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4196864 len 4096 2024-09-19T08:12:53.569 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4196864 len 4096 2024-09-19T08:12:53.569 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4196864 len 4096 2024-09-19T08:12:53.569 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4196864 len 8192 2024-09-19T08:12:53.569 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4196864 len 8192 2024-09-19T08:12:53.569 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4196864 len 8192 2024-09-19T08:12:53.569 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4196864 len 8192 2024-09-19T08:12:53.569 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4196864 len 16384 2024-09-19T08:12:53.569 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4196864 len 16384 2024-09-19T08:12:53.570 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4196864 len 16384 2024-09-19T08:12:53.570 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4196864 len 16384 2024-09-19T08:12:53.570 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4197376 len 1024 2024-09-19T08:12:53.570 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4197376 len 1024 2024-09-19T08:12:53.570 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4197376 len 1024 2024-09-19T08:12:53.570 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4197376 len 1024 2024-09-19T08:12:53.570 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4197376 len 2048 2024-09-19T08:12:53.570 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4197376 len 2048 2024-09-19T08:12:53.570 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4197376 len 2048 2024-09-19T08:12:53.571 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4197376 len 2048 2024-09-19T08:12:53.571 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4197376 len 4096 2024-09-19T08:12:53.571 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4197376 len 4096 2024-09-19T08:12:53.571 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4197376 len 4096 2024-09-19T08:12:53.571 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4197376 len 4096 2024-09-19T08:12:53.603 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4197376 len 8192 2024-09-19T08:12:53.603 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4197376 len 8192 2024-09-19T08:12:53.603 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4197376 len 8192 2024-09-19T08:12:53.604 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4197376 len 8192 2024-09-19T08:12:53.604 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4197376 len 16384 2024-09-19T08:12:53.604 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4197376 len 16384 2024-09-19T08:12:53.604 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4197376 len 16384 2024-09-19T08:12:53.604 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4197376 len 16384 2024-09-19T08:12:53.604 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4197888 len 1024 2024-09-19T08:12:53.604 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4197888 len 1024 2024-09-19T08:12:53.604 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4197888 len 1024 2024-09-19T08:12:53.604 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4197888 len 1024 2024-09-19T08:12:53.604 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4197888 len 2048 2024-09-19T08:12:53.604 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4197888 len 2048 2024-09-19T08:12:53.604 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4197888 len 2048 2024-09-19T08:12:53.604 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4197888 len 2048 2024-09-19T08:12:53.605 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4197888 len 4096 2024-09-19T08:12:53.605 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4197888 len 4096 2024-09-19T08:12:53.605 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4197888 len 4096 2024-09-19T08:12:53.605 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4197888 len 4096 2024-09-19T08:12:53.605 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4197888 len 8192 2024-09-19T08:12:53.605 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4197888 len 8192 2024-09-19T08:12:53.605 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4197888 len 8192 2024-09-19T08:12:53.605 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4197888 len 8192 2024-09-19T08:12:53.605 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1024 offset 4197888 len 16384 2024-09-19T08:12:53.605 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4197888 len 16384 2024-09-19T08:12:53.605 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1024 offset 4197888 len 16384 2024-09-19T08:12:53.605 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1024 offset 4197888 len 16384 2024-09-19T08:12:53.605 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4190208 len 1024 2024-09-19T08:12:53.605 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4190208 len 1024 2024-09-19T08:12:53.606 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4190208 len 1024 2024-09-19T08:12:53.606 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4190208 len 1024 2024-09-19T08:12:53.606 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4190208 len 2048 2024-09-19T08:12:53.606 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4190208 len 2048 2024-09-19T08:12:53.606 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4190208 len 2048 2024-09-19T08:12:53.606 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4190208 len 2048 2024-09-19T08:12:53.606 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4190208 len 4096 2024-09-19T08:12:53.606 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4190208 len 4096 2024-09-19T08:12:53.606 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4190208 len 4096 2024-09-19T08:12:53.606 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4190208 len 4096 2024-09-19T08:12:53.606 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4190208 len 8192 2024-09-19T08:12:53.606 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4190208 len 8192 2024-09-19T08:12:53.606 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4190208 len 8192 2024-09-19T08:12:53.606 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4190208 len 8192 2024-09-19T08:12:53.607 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4190208 len 16384 2024-09-19T08:12:53.607 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4190208 len 16384 2024-09-19T08:12:53.607 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4190208 len 16384 2024-09-19T08:12:53.607 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4190208 len 16384 2024-09-19T08:12:53.607 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4190720 len 1024 2024-09-19T08:12:53.607 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4190720 len 1024 2024-09-19T08:12:53.607 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4190720 len 1024 2024-09-19T08:12:53.607 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4190720 len 1024 2024-09-19T08:12:53.607 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4190720 len 2048 2024-09-19T08:12:53.607 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4190720 len 2048 2024-09-19T08:12:53.607 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4190720 len 2048 2024-09-19T08:12:53.607 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4190720 len 2048 2024-09-19T08:12:53.608 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4190720 len 4096 2024-09-19T08:12:53.608 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4190720 len 4096 2024-09-19T08:12:53.608 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4190720 len 4096 2024-09-19T08:12:53.608 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4190720 len 4096 2024-09-19T08:12:53.608 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4190720 len 8192 2024-09-19T08:12:53.608 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4190720 len 8192 2024-09-19T08:12:53.608 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4190720 len 8192 2024-09-19T08:12:53.608 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4190720 len 8192 2024-09-19T08:12:53.608 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4190720 len 16384 2024-09-19T08:12:53.608 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4190720 len 16384 2024-09-19T08:12:53.608 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4190720 len 16384 2024-09-19T08:12:53.608 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4190720 len 16384 2024-09-19T08:12:53.608 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4191232 len 1024 2024-09-19T08:12:53.609 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4191232 len 1024 2024-09-19T08:12:53.609 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4191232 len 1024 2024-09-19T08:12:53.609 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4191232 len 1024 2024-09-19T08:12:53.609 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4191232 len 2048 2024-09-19T08:12:53.609 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4191232 len 2048 2024-09-19T08:12:53.609 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4191232 len 2048 2024-09-19T08:12:53.609 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4191232 len 2048 2024-09-19T08:12:53.609 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4191232 len 4096 2024-09-19T08:12:53.609 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4191232 len 4096 2024-09-19T08:12:53.609 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4191232 len 4096 2024-09-19T08:12:53.610 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4191232 len 4096 2024-09-19T08:12:53.610 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4191232 len 8192 2024-09-19T08:12:53.610 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4191232 len 8192 2024-09-19T08:12:53.623 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4191232 len 8192 2024-09-19T08:12:53.623 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4191232 len 8192 2024-09-19T08:12:53.623 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4191232 len 16384 2024-09-19T08:12:53.623 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4191232 len 16384 2024-09-19T08:12:53.623 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4191232 len 16384 2024-09-19T08:12:53.624 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4191232 len 16384 2024-09-19T08:12:53.624 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4191744 len 1024 2024-09-19T08:12:53.624 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4191744 len 1024 2024-09-19T08:12:53.624 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4191744 len 1024 2024-09-19T08:12:53.624 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4191744 len 1024 2024-09-19T08:12:53.624 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4191744 len 2048 2024-09-19T08:12:53.624 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4191744 len 2048 2024-09-19T08:12:53.624 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4191744 len 2048 2024-09-19T08:12:53.624 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4191744 len 2048 2024-09-19T08:12:53.624 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4191744 len 4096 2024-09-19T08:12:53.624 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4191744 len 4096 2024-09-19T08:12:53.624 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4191744 len 4096 2024-09-19T08:12:53.624 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4191744 len 4096 2024-09-19T08:12:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4191744 len 8192 2024-09-19T08:12:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4191744 len 8192 2024-09-19T08:12:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4191744 len 8192 2024-09-19T08:12:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4191744 len 8192 2024-09-19T08:12:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4191744 len 16384 2024-09-19T08:12:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4191744 len 16384 2024-09-19T08:12:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4191744 len 16384 2024-09-19T08:12:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4191744 len 16384 2024-09-19T08:12:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4192256 len 1024 2024-09-19T08:12:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4192256 len 1024 2024-09-19T08:12:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4192256 len 1024 2024-09-19T08:12:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4192256 len 1024 2024-09-19T08:12:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4192256 len 2048 2024-09-19T08:12:53.626 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4192256 len 2048 2024-09-19T08:12:53.626 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4192256 len 2048 2024-09-19T08:12:53.626 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4192256 len 2048 2024-09-19T08:12:53.626 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4192256 len 4096 2024-09-19T08:12:53.626 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4192256 len 4096 2024-09-19T08:12:53.626 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4192256 len 4096 2024-09-19T08:12:53.626 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4192256 len 4096 2024-09-19T08:12:53.626 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4192256 len 8192 2024-09-19T08:12:53.626 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4192256 len 8192 2024-09-19T08:12:53.626 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4192256 len 8192 2024-09-19T08:12:53.626 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4192256 len 8192 2024-09-19T08:12:53.626 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4192256 len 16384 2024-09-19T08:12:53.626 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4192256 len 16384 2024-09-19T08:12:53.626 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4192256 len 16384 2024-09-19T08:12:53.627 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4192256 len 16384 2024-09-19T08:12:53.627 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4192768 len 1024 2024-09-19T08:12:53.627 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4192768 len 1024 2024-09-19T08:12:53.627 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4192768 len 1024 2024-09-19T08:12:53.627 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4192768 len 1024 2024-09-19T08:12:53.627 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4192768 len 2048 2024-09-19T08:12:53.627 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4192768 len 2048 2024-09-19T08:12:53.627 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4192768 len 2048 2024-09-19T08:12:53.627 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4192768 len 2048 2024-09-19T08:12:53.627 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4192768 len 4096 2024-09-19T08:12:53.627 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4192768 len 4096 2024-09-19T08:12:53.627 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4192768 len 4096 2024-09-19T08:12:53.627 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4192768 len 4096 2024-09-19T08:12:53.628 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4192768 len 8192 2024-09-19T08:12:53.628 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4192768 len 8192 2024-09-19T08:12:53.628 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4192768 len 8192 2024-09-19T08:12:53.628 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4192768 len 8192 2024-09-19T08:12:53.628 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4192768 len 16384 2024-09-19T08:12:53.628 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4192768 len 16384 2024-09-19T08:12:53.628 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4192768 len 16384 2024-09-19T08:12:53.628 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4192768 len 16384 2024-09-19T08:12:53.628 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4193280 len 1024 2024-09-19T08:12:53.629 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4193280 len 1024 2024-09-19T08:12:53.629 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4193280 len 1024 2024-09-19T08:12:53.629 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4193280 len 1024 2024-09-19T08:12:53.629 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4193280 len 2048 2024-09-19T08:12:53.629 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4193280 len 2048 2024-09-19T08:12:53.629 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4193280 len 2048 2024-09-19T08:12:53.629 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4193280 len 2048 2024-09-19T08:12:53.629 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4193280 len 4096 2024-09-19T08:12:53.629 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4193280 len 4096 2024-09-19T08:12:53.629 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4193280 len 4096 2024-09-19T08:12:53.629 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4193280 len 4096 2024-09-19T08:12:53.629 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4193280 len 8192 2024-09-19T08:12:53.629 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4193280 len 8192 2024-09-19T08:12:53.629 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4193280 len 8192 2024-09-19T08:12:53.630 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4193280 len 8192 2024-09-19T08:12:53.636 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4193280 len 16384 2024-09-19T08:12:53.636 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4193280 len 16384 2024-09-19T08:12:53.636 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4193280 len 16384 2024-09-19T08:12:53.636 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4193280 len 16384 2024-09-19T08:12:53.636 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4193792 len 1024 2024-09-19T08:12:53.637 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4193792 len 1024 2024-09-19T08:12:53.637 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4193792 len 1024 2024-09-19T08:12:53.637 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4193792 len 1024 2024-09-19T08:12:53.637 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4193792 len 2048 2024-09-19T08:12:53.637 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4193792 len 2048 2024-09-19T08:12:53.637 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4193792 len 2048 2024-09-19T08:12:53.637 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4193792 len 2048 2024-09-19T08:12:53.637 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4193792 len 4096 2024-09-19T08:12:53.637 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4193792 len 4096 2024-09-19T08:12:53.637 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4193792 len 4096 2024-09-19T08:12:53.637 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4193792 len 4096 2024-09-19T08:12:53.637 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4193792 len 8192 2024-09-19T08:12:53.637 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4193792 len 8192 2024-09-19T08:12:53.637 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4193792 len 8192 2024-09-19T08:12:53.638 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4193792 len 8192 2024-09-19T08:12:53.638 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4193792 len 16384 2024-09-19T08:12:53.638 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4193792 len 16384 2024-09-19T08:12:53.638 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4193792 len 16384 2024-09-19T08:12:53.638 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4193792 len 16384 2024-09-19T08:12:53.638 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4194304 len 1024 2024-09-19T08:12:53.638 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4194304 len 1024 2024-09-19T08:12:53.638 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4194304 len 1024 2024-09-19T08:12:53.638 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4194304 len 1024 2024-09-19T08:12:53.638 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4194304 len 2048 2024-09-19T08:12:53.638 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4194304 len 2048 2024-09-19T08:12:53.638 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4194304 len 2048 2024-09-19T08:12:53.638 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4194304 len 2048 2024-09-19T08:12:53.638 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4194304 len 4096 2024-09-19T08:12:53.639 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4194304 len 4096 2024-09-19T08:12:53.639 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4194304 len 4096 2024-09-19T08:12:53.639 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4194304 len 4096 2024-09-19T08:12:53.639 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4194304 len 8192 2024-09-19T08:12:53.639 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4194304 len 8192 2024-09-19T08:12:53.639 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4194304 len 8192 2024-09-19T08:12:53.639 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4194304 len 8192 2024-09-19T08:12:53.639 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4194304 len 16384 2024-09-19T08:12:53.639 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4194304 len 16384 2024-09-19T08:12:53.639 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4194304 len 16384 2024-09-19T08:12:53.639 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4194304 len 16384 2024-09-19T08:12:53.640 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4194816 len 1024 2024-09-19T08:12:53.640 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4194816 len 1024 2024-09-19T08:12:53.640 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4194816 len 1024 2024-09-19T08:12:53.640 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4194816 len 1024 2024-09-19T08:12:53.640 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4194816 len 2048 2024-09-19T08:12:53.640 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4194816 len 2048 2024-09-19T08:12:53.640 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4194816 len 2048 2024-09-19T08:12:53.640 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4194816 len 2048 2024-09-19T08:12:53.640 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4194816 len 4096 2024-09-19T08:12:53.640 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4194816 len 4096 2024-09-19T08:12:53.640 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4194816 len 4096 2024-09-19T08:12:53.640 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4194816 len 4096 2024-09-19T08:12:53.640 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4194816 len 8192 2024-09-19T08:12:53.641 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4194816 len 8192 2024-09-19T08:12:53.641 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4194816 len 8192 2024-09-19T08:12:53.641 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4194816 len 8192 2024-09-19T08:12:53.641 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4194816 len 16384 2024-09-19T08:12:53.641 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4194816 len 16384 2024-09-19T08:12:53.641 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4194816 len 16384 2024-09-19T08:12:53.641 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4194816 len 16384 2024-09-19T08:12:53.641 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4195328 len 1024 2024-09-19T08:12:53.641 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4195328 len 1024 2024-09-19T08:12:53.641 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4195328 len 1024 2024-09-19T08:12:53.641 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4195328 len 1024 2024-09-19T08:12:53.641 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4195328 len 2048 2024-09-19T08:12:53.641 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4195328 len 2048 2024-09-19T08:12:53.642 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4195328 len 2048 2024-09-19T08:12:53.642 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4195328 len 2048 2024-09-19T08:12:53.642 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4195328 len 4096 2024-09-19T08:12:53.642 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4195328 len 4096 2024-09-19T08:12:53.642 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4195328 len 4096 2024-09-19T08:12:53.642 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4195328 len 4096 2024-09-19T08:12:53.642 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4195328 len 8192 2024-09-19T08:12:53.642 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4195328 len 8192 2024-09-19T08:12:53.642 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4195328 len 8192 2024-09-19T08:12:53.642 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4195328 len 8192 2024-09-19T08:12:53.642 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4195328 len 16384 2024-09-19T08:12:53.642 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4195328 len 16384 2024-09-19T08:12:53.642 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4195328 len 16384 2024-09-19T08:12:53.645 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4195328 len 16384 2024-09-19T08:12:53.645 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4195840 len 1024 2024-09-19T08:12:53.645 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4195840 len 1024 2024-09-19T08:12:53.645 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4195840 len 1024 2024-09-19T08:12:53.645 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4195840 len 1024 2024-09-19T08:12:53.645 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4195840 len 2048 2024-09-19T08:12:53.646 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4195840 len 2048 2024-09-19T08:12:53.646 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4195840 len 2048 2024-09-19T08:12:53.646 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4195840 len 2048 2024-09-19T08:12:53.646 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4195840 len 4096 2024-09-19T08:12:53.646 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4195840 len 4096 2024-09-19T08:12:53.646 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4195840 len 4096 2024-09-19T08:12:53.646 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4195840 len 4096 2024-09-19T08:12:53.646 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4195840 len 8192 2024-09-19T08:12:53.646 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4195840 len 8192 2024-09-19T08:12:53.646 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4195840 len 8192 2024-09-19T08:12:53.646 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4195840 len 8192 2024-09-19T08:12:53.646 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4195840 len 16384 2024-09-19T08:12:53.646 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4195840 len 16384 2024-09-19T08:12:53.646 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4195840 len 16384 2024-09-19T08:12:53.647 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4195840 len 16384 2024-09-19T08:12:53.647 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4196352 len 1024 2024-09-19T08:12:53.647 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4196352 len 1024 2024-09-19T08:12:53.647 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4196352 len 1024 2024-09-19T08:12:53.647 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4196352 len 1024 2024-09-19T08:12:53.647 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4196352 len 2048 2024-09-19T08:12:53.647 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4196352 len 2048 2024-09-19T08:12:53.647 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4196352 len 2048 2024-09-19T08:12:53.647 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4196352 len 2048 2024-09-19T08:12:53.647 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4196352 len 4096 2024-09-19T08:12:53.647 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4196352 len 4096 2024-09-19T08:12:53.647 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4196352 len 4096 2024-09-19T08:12:53.647 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4196352 len 4096 2024-09-19T08:12:53.647 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4196352 len 8192 2024-09-19T08:12:53.648 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4196352 len 8192 2024-09-19T08:12:53.648 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4196352 len 8192 2024-09-19T08:12:53.648 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4196352 len 8192 2024-09-19T08:12:53.648 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4196352 len 16384 2024-09-19T08:12:53.648 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4196352 len 16384 2024-09-19T08:12:53.648 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4196352 len 16384 2024-09-19T08:12:53.648 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4196352 len 16384 2024-09-19T08:12:53.648 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4196864 len 1024 2024-09-19T08:12:53.648 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4196864 len 1024 2024-09-19T08:12:53.648 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4196864 len 1024 2024-09-19T08:12:53.648 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4196864 len 1024 2024-09-19T08:12:53.648 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4196864 len 2048 2024-09-19T08:12:53.648 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4196864 len 2048 2024-09-19T08:12:53.649 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4196864 len 2048 2024-09-19T08:12:53.649 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4196864 len 2048 2024-09-19T08:12:53.649 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4196864 len 4096 2024-09-19T08:12:53.649 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4196864 len 4096 2024-09-19T08:12:53.649 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4196864 len 4096 2024-09-19T08:12:53.649 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4196864 len 4096 2024-09-19T08:12:53.649 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4196864 len 8192 2024-09-19T08:12:53.649 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4196864 len 8192 2024-09-19T08:12:53.649 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4196864 len 8192 2024-09-19T08:12:53.649 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4196864 len 8192 2024-09-19T08:12:53.649 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4196864 len 16384 2024-09-19T08:12:53.649 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4196864 len 16384 2024-09-19T08:12:53.649 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4196864 len 16384 2024-09-19T08:12:53.649 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4196864 len 16384 2024-09-19T08:12:53.649 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4197376 len 1024 2024-09-19T08:12:53.650 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4197376 len 1024 2024-09-19T08:12:53.650 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4197376 len 1024 2024-09-19T08:12:53.650 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4197376 len 1024 2024-09-19T08:12:53.650 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4197376 len 2048 2024-09-19T08:12:53.650 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4197376 len 2048 2024-09-19T08:12:53.650 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4197376 len 2048 2024-09-19T08:12:53.650 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4197376 len 2048 2024-09-19T08:12:53.650 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4197376 len 4096 2024-09-19T08:12:53.650 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4197376 len 4096 2024-09-19T08:12:53.650 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4197376 len 4096 2024-09-19T08:12:53.650 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4197376 len 4096 2024-09-19T08:12:53.650 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4197376 len 8192 2024-09-19T08:12:53.650 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4197376 len 8192 2024-09-19T08:12:53.651 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4197376 len 8192 2024-09-19T08:12:53.651 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4197376 len 8192 2024-09-19T08:12:53.651 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4197376 len 16384 2024-09-19T08:12:53.651 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4197376 len 16384 2024-09-19T08:12:53.651 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4197376 len 16384 2024-09-19T08:12:53.651 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4197376 len 16384 2024-09-19T08:12:53.651 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4197888 len 1024 2024-09-19T08:12:53.662 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4197888 len 1024 2024-09-19T08:12:53.662 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4197888 len 1024 2024-09-19T08:12:53.662 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4197888 len 1024 2024-09-19T08:12:53.662 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4197888 len 2048 2024-09-19T08:12:53.662 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4197888 len 2048 2024-09-19T08:12:53.662 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4197888 len 2048 2024-09-19T08:12:53.662 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4197888 len 2048 2024-09-19T08:12:53.663 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4197888 len 4096 2024-09-19T08:12:53.663 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4197888 len 4096 2024-09-19T08:12:53.663 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4197888 len 4096 2024-09-19T08:12:53.663 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4197888 len 4096 2024-09-19T08:12:53.663 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4197888 len 8192 2024-09-19T08:12:53.663 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4197888 len 8192 2024-09-19T08:12:53.663 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4197888 len 8192 2024-09-19T08:12:53.663 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4197888 len 8192 2024-09-19T08:12:53.663 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 1536 offset 4197888 len 16384 2024-09-19T08:12:53.663 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4197888 len 16384 2024-09-19T08:12:53.663 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 1536 offset 4197888 len 16384 2024-09-19T08:12:53.663 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 1536 offset 4197888 len 16384 2024-09-19T08:12:53.663 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4190208 len 1024 2024-09-19T08:12:53.664 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4190208 len 1024 2024-09-19T08:12:53.664 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4190208 len 1024 2024-09-19T08:12:53.664 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4190208 len 1024 2024-09-19T08:12:53.664 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4190208 len 2048 2024-09-19T08:12:53.664 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4190208 len 2048 2024-09-19T08:12:53.664 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4190208 len 2048 2024-09-19T08:12:53.664 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4190208 len 2048 2024-09-19T08:12:53.664 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4190208 len 4096 2024-09-19T08:12:53.664 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4190208 len 4096 2024-09-19T08:12:53.664 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4190208 len 4096 2024-09-19T08:12:53.664 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4190208 len 4096 2024-09-19T08:12:53.664 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4190208 len 8192 2024-09-19T08:12:53.664 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4190208 len 8192 2024-09-19T08:12:53.664 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4190208 len 8192 2024-09-19T08:12:53.665 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4190208 len 8192 2024-09-19T08:12:53.665 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4190208 len 16384 2024-09-19T08:12:53.665 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4190208 len 16384 2024-09-19T08:12:53.665 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4190208 len 16384 2024-09-19T08:12:53.665 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4190208 len 16384 2024-09-19T08:12:53.665 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4190720 len 1024 2024-09-19T08:12:53.665 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4190720 len 1024 2024-09-19T08:12:53.665 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4190720 len 1024 2024-09-19T08:12:53.665 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4190720 len 1024 2024-09-19T08:12:53.665 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4190720 len 2048 2024-09-19T08:12:53.665 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4190720 len 2048 2024-09-19T08:12:53.665 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4190720 len 2048 2024-09-19T08:12:53.665 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4190720 len 2048 2024-09-19T08:12:53.665 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4190720 len 4096 2024-09-19T08:12:53.666 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4190720 len 4096 2024-09-19T08:12:53.666 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4190720 len 4096 2024-09-19T08:12:53.666 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4190720 len 4096 2024-09-19T08:12:53.666 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4190720 len 8192 2024-09-19T08:12:53.666 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4190720 len 8192 2024-09-19T08:12:53.666 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4190720 len 8192 2024-09-19T08:12:53.666 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4190720 len 8192 2024-09-19T08:12:53.666 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4190720 len 16384 2024-09-19T08:12:53.666 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4190720 len 16384 2024-09-19T08:12:53.666 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4190720 len 16384 2024-09-19T08:12:53.666 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4190720 len 16384 2024-09-19T08:12:53.666 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4191232 len 1024 2024-09-19T08:12:53.666 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4191232 len 1024 2024-09-19T08:12:53.666 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4191232 len 1024 2024-09-19T08:12:53.667 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4191232 len 1024 2024-09-19T08:12:53.667 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4191232 len 2048 2024-09-19T08:12:53.667 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4191232 len 2048 2024-09-19T08:12:53.667 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4191232 len 2048 2024-09-19T08:12:53.667 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4191232 len 2048 2024-09-19T08:12:53.667 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4191232 len 4096 2024-09-19T08:12:53.667 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4191232 len 4096 2024-09-19T08:12:53.667 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4191232 len 4096 2024-09-19T08:12:53.667 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4191232 len 4096 2024-09-19T08:12:53.667 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4191232 len 8192 2024-09-19T08:12:53.667 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4191232 len 8192 2024-09-19T08:12:53.667 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4191232 len 8192 2024-09-19T08:12:53.667 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4191232 len 8192 2024-09-19T08:12:53.667 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4191232 len 16384 2024-09-19T08:12:53.668 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4191232 len 16384 2024-09-19T08:12:53.668 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4191232 len 16384 2024-09-19T08:12:53.668 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4191232 len 16384 2024-09-19T08:12:53.668 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4191744 len 1024 2024-09-19T08:12:53.668 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4191744 len 1024 2024-09-19T08:12:53.668 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4191744 len 1024 2024-09-19T08:12:53.668 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4191744 len 1024 2024-09-19T08:12:53.684 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4191744 len 2048 2024-09-19T08:12:53.684 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4191744 len 2048 2024-09-19T08:12:53.684 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4191744 len 2048 2024-09-19T08:12:53.684 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4191744 len 2048 2024-09-19T08:12:53.685 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4191744 len 4096 2024-09-19T08:12:53.685 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4191744 len 4096 2024-09-19T08:12:53.685 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4191744 len 4096 2024-09-19T08:12:53.685 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4191744 len 4096 2024-09-19T08:12:53.685 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4191744 len 8192 2024-09-19T08:12:53.685 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4191744 len 8192 2024-09-19T08:12:53.685 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4191744 len 8192 2024-09-19T08:12:53.685 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4191744 len 8192 2024-09-19T08:12:53.685 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4191744 len 16384 2024-09-19T08:12:53.685 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4191744 len 16384 2024-09-19T08:12:53.685 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4191744 len 16384 2024-09-19T08:12:53.686 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4191744 len 16384 2024-09-19T08:12:53.686 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4192256 len 1024 2024-09-19T08:12:53.686 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4192256 len 1024 2024-09-19T08:12:53.686 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4192256 len 1024 2024-09-19T08:12:53.686 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4192256 len 1024 2024-09-19T08:12:53.686 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4192256 len 2048 2024-09-19T08:12:53.686 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4192256 len 2048 2024-09-19T08:12:53.686 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4192256 len 2048 2024-09-19T08:12:53.687 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4192256 len 2048 2024-09-19T08:12:53.687 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4192256 len 4096 2024-09-19T08:12:53.687 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4192256 len 4096 2024-09-19T08:12:53.687 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4192256 len 4096 2024-09-19T08:12:53.687 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4192256 len 4096 2024-09-19T08:12:53.687 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4192256 len 8192 2024-09-19T08:12:53.687 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4192256 len 8192 2024-09-19T08:12:53.688 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4192256 len 8192 2024-09-19T08:12:53.688 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4192256 len 8192 2024-09-19T08:12:53.688 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4192256 len 16384 2024-09-19T08:12:53.688 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4192256 len 16384 2024-09-19T08:12:53.688 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4192256 len 16384 2024-09-19T08:12:53.688 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4192256 len 16384 2024-09-19T08:12:53.688 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4192768 len 1024 2024-09-19T08:12:53.688 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4192768 len 1024 2024-09-19T08:12:53.689 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4192768 len 1024 2024-09-19T08:12:53.689 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4192768 len 1024 2024-09-19T08:12:53.689 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4192768 len 2048 2024-09-19T08:12:53.689 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4192768 len 2048 2024-09-19T08:12:53.689 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4192768 len 2048 2024-09-19T08:12:53.689 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4192768 len 2048 2024-09-19T08:12:53.689 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4192768 len 4096 2024-09-19T08:12:53.689 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4192768 len 4096 2024-09-19T08:12:53.689 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4192768 len 4096 2024-09-19T08:12:53.689 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4192768 len 4096 2024-09-19T08:12:53.689 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4192768 len 8192 2024-09-19T08:12:53.690 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4192768 len 8192 2024-09-19T08:12:53.690 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4192768 len 8192 2024-09-19T08:12:53.690 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4192768 len 8192 2024-09-19T08:12:53.690 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4192768 len 16384 2024-09-19T08:12:53.690 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4192768 len 16384 2024-09-19T08:12:53.690 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4192768 len 16384 2024-09-19T08:12:53.690 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4192768 len 16384 2024-09-19T08:12:53.690 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4193280 len 1024 2024-09-19T08:12:53.690 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4193280 len 1024 2024-09-19T08:12:53.691 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4193280 len 1024 2024-09-19T08:12:53.691 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4193280 len 1024 2024-09-19T08:12:53.691 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4193280 len 2048 2024-09-19T08:12:53.691 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4193280 len 2048 2024-09-19T08:12:53.691 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4193280 len 2048 2024-09-19T08:12:53.691 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4193280 len 2048 2024-09-19T08:12:53.691 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4193280 len 4096 2024-09-19T08:12:53.691 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4193280 len 4096 2024-09-19T08:12:53.691 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4193280 len 4096 2024-09-19T08:12:53.691 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4193280 len 4096 2024-09-19T08:12:53.691 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4193280 len 8192 2024-09-19T08:12:53.691 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4193280 len 8192 2024-09-19T08:12:53.692 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4193280 len 8192 2024-09-19T08:12:53.692 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4193280 len 8192 2024-09-19T08:12:53.692 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4193280 len 16384 2024-09-19T08:12:53.692 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4193280 len 16384 2024-09-19T08:12:53.692 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4193280 len 16384 2024-09-19T08:12:53.692 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4193280 len 16384 2024-09-19T08:12:53.693 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4193792 len 1024 2024-09-19T08:12:53.693 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4193792 len 1024 2024-09-19T08:12:53.693 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4193792 len 1024 2024-09-19T08:12:53.693 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4193792 len 1024 2024-09-19T08:12:53.693 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4193792 len 2048 2024-09-19T08:12:53.693 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4193792 len 2048 2024-09-19T08:12:53.697 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4193792 len 2048 2024-09-19T08:12:53.697 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4193792 len 2048 2024-09-19T08:12:53.697 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4193792 len 4096 2024-09-19T08:12:53.698 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4193792 len 4096 2024-09-19T08:12:53.698 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4193792 len 4096 2024-09-19T08:12:53.698 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4193792 len 4096 2024-09-19T08:12:53.698 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4193792 len 8192 2024-09-19T08:12:53.698 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4193792 len 8192 2024-09-19T08:12:53.698 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4193792 len 8192 2024-09-19T08:12:53.698 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4193792 len 8192 2024-09-19T08:12:53.698 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4193792 len 16384 2024-09-19T08:12:53.698 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4193792 len 16384 2024-09-19T08:12:53.698 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4193792 len 16384 2024-09-19T08:12:53.698 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4193792 len 16384 2024-09-19T08:12:53.698 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4194304 len 1024 2024-09-19T08:12:53.698 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4194304 len 1024 2024-09-19T08:12:53.698 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4194304 len 1024 2024-09-19T08:12:53.699 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4194304 len 1024 2024-09-19T08:12:53.699 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4194304 len 2048 2024-09-19T08:12:53.699 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4194304 len 2048 2024-09-19T08:12:53.699 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4194304 len 2048 2024-09-19T08:12:53.699 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4194304 len 2048 2024-09-19T08:12:53.699 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4194304 len 4096 2024-09-19T08:12:53.699 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4194304 len 4096 2024-09-19T08:12:53.699 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4194304 len 4096 2024-09-19T08:12:53.699 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4194304 len 4096 2024-09-19T08:12:53.699 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4194304 len 8192 2024-09-19T08:12:53.699 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4194304 len 8192 2024-09-19T08:12:53.699 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4194304 len 8192 2024-09-19T08:12:53.699 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4194304 len 8192 2024-09-19T08:12:53.699 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4194304 len 16384 2024-09-19T08:12:53.700 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4194304 len 16384 2024-09-19T08:12:53.700 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4194304 len 16384 2024-09-19T08:12:53.700 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4194304 len 16384 2024-09-19T08:12:53.700 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4194816 len 1024 2024-09-19T08:12:53.700 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4194816 len 1024 2024-09-19T08:12:53.700 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4194816 len 1024 2024-09-19T08:12:53.700 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4194816 len 1024 2024-09-19T08:12:53.700 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4194816 len 2048 2024-09-19T08:12:53.700 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4194816 len 2048 2024-09-19T08:12:53.700 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4194816 len 2048 2024-09-19T08:12:53.700 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4194816 len 2048 2024-09-19T08:12:53.700 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4194816 len 4096 2024-09-19T08:12:53.700 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4194816 len 4096 2024-09-19T08:12:53.701 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4194816 len 4096 2024-09-19T08:12:53.701 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4194816 len 4096 2024-09-19T08:12:53.701 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4194816 len 8192 2024-09-19T08:12:53.701 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4194816 len 8192 2024-09-19T08:12:53.701 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4194816 len 8192 2024-09-19T08:12:53.701 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4194816 len 8192 2024-09-19T08:12:53.701 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4194816 len 16384 2024-09-19T08:12:53.701 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4194816 len 16384 2024-09-19T08:12:53.701 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4194816 len 16384 2024-09-19T08:12:53.701 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4194816 len 16384 2024-09-19T08:12:53.701 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4195328 len 1024 2024-09-19T08:12:53.701 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4195328 len 1024 2024-09-19T08:12:53.701 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4195328 len 1024 2024-09-19T08:12:53.702 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4195328 len 1024 2024-09-19T08:12:53.702 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4195328 len 2048 2024-09-19T08:12:53.702 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4195328 len 2048 2024-09-19T08:12:53.702 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4195328 len 2048 2024-09-19T08:12:53.702 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4195328 len 2048 2024-09-19T08:12:53.702 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4195328 len 4096 2024-09-19T08:12:53.702 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4195328 len 4096 2024-09-19T08:12:53.702 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4195328 len 4096 2024-09-19T08:12:53.702 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4195328 len 4096 2024-09-19T08:12:53.702 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4195328 len 8192 2024-09-19T08:12:53.702 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4195328 len 8192 2024-09-19T08:12:53.702 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4195328 len 8192 2024-09-19T08:12:53.702 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4195328 len 8192 2024-09-19T08:12:53.702 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4195328 len 16384 2024-09-19T08:12:53.703 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4195328 len 16384 2024-09-19T08:12:53.703 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4195328 len 16384 2024-09-19T08:12:53.703 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4195328 len 16384 2024-09-19T08:12:53.703 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4195840 len 1024 2024-09-19T08:12:53.703 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4195840 len 1024 2024-09-19T08:12:53.703 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4195840 len 1024 2024-09-19T08:12:53.703 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4195840 len 1024 2024-09-19T08:12:53.703 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4195840 len 2048 2024-09-19T08:12:53.703 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4195840 len 2048 2024-09-19T08:12:53.703 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4195840 len 2048 2024-09-19T08:12:53.703 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4195840 len 2048 2024-09-19T08:12:53.708 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4195840 len 4096 2024-09-19T08:12:53.708 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4195840 len 4096 2024-09-19T08:12:53.708 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4195840 len 4096 2024-09-19T08:12:53.708 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4195840 len 4096 2024-09-19T08:12:53.708 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4195840 len 8192 2024-09-19T08:12:53.708 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4195840 len 8192 2024-09-19T08:12:53.709 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4195840 len 8192 2024-09-19T08:12:53.709 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4195840 len 8192 2024-09-19T08:12:53.709 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4195840 len 16384 2024-09-19T08:12:53.709 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4195840 len 16384 2024-09-19T08:12:53.709 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4195840 len 16384 2024-09-19T08:12:53.709 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4195840 len 16384 2024-09-19T08:12:53.709 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4196352 len 1024 2024-09-19T08:12:53.709 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4196352 len 1024 2024-09-19T08:12:53.709 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4196352 len 1024 2024-09-19T08:12:53.709 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4196352 len 1024 2024-09-19T08:12:53.709 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4196352 len 2048 2024-09-19T08:12:53.709 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4196352 len 2048 2024-09-19T08:12:53.709 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4196352 len 2048 2024-09-19T08:12:53.710 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4196352 len 2048 2024-09-19T08:12:53.710 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4196352 len 4096 2024-09-19T08:12:53.710 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4196352 len 4096 2024-09-19T08:12:53.710 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4196352 len 4096 2024-09-19T08:12:53.710 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4196352 len 4096 2024-09-19T08:12:53.710 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4196352 len 8192 2024-09-19T08:12:53.710 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4196352 len 8192 2024-09-19T08:12:53.710 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4196352 len 8192 2024-09-19T08:12:53.710 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4196352 len 8192 2024-09-19T08:12:53.710 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4196352 len 16384 2024-09-19T08:12:53.710 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4196352 len 16384 2024-09-19T08:12:53.710 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4196352 len 16384 2024-09-19T08:12:53.710 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4196352 len 16384 2024-09-19T08:12:53.711 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4196864 len 1024 2024-09-19T08:12:53.711 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4196864 len 1024 2024-09-19T08:12:53.711 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4196864 len 1024 2024-09-19T08:12:53.711 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4196864 len 1024 2024-09-19T08:12:53.711 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4196864 len 2048 2024-09-19T08:12:53.711 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4196864 len 2048 2024-09-19T08:12:53.711 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4196864 len 2048 2024-09-19T08:12:53.711 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4196864 len 2048 2024-09-19T08:12:53.711 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4196864 len 4096 2024-09-19T08:12:53.711 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4196864 len 4096 2024-09-19T08:12:53.711 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4196864 len 4096 2024-09-19T08:12:53.711 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4196864 len 4096 2024-09-19T08:12:53.711 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4196864 len 8192 2024-09-19T08:12:53.712 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4196864 len 8192 2024-09-19T08:12:53.712 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4196864 len 8192 2024-09-19T08:12:53.712 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4196864 len 8192 2024-09-19T08:12:53.712 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4196864 len 16384 2024-09-19T08:12:53.712 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4196864 len 16384 2024-09-19T08:12:53.712 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4196864 len 16384 2024-09-19T08:12:53.712 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4196864 len 16384 2024-09-19T08:12:53.712 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4197376 len 1024 2024-09-19T08:12:53.712 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4197376 len 1024 2024-09-19T08:12:53.712 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4197376 len 1024 2024-09-19T08:12:53.712 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4197376 len 1024 2024-09-19T08:12:53.712 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4197376 len 2048 2024-09-19T08:12:53.712 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4197376 len 2048 2024-09-19T08:12:53.712 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4197376 len 2048 2024-09-19T08:12:53.713 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4197376 len 2048 2024-09-19T08:12:53.713 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4197376 len 4096 2024-09-19T08:12:53.713 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4197376 len 4096 2024-09-19T08:12:53.713 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4197376 len 4096 2024-09-19T08:12:53.713 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4197376 len 4096 2024-09-19T08:12:53.713 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4197376 len 8192 2024-09-19T08:12:53.713 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4197376 len 8192 2024-09-19T08:12:53.713 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4197376 len 8192 2024-09-19T08:12:53.713 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4197376 len 8192 2024-09-19T08:12:53.713 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4197376 len 16384 2024-09-19T08:12:53.713 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4197376 len 16384 2024-09-19T08:12:53.713 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4197376 len 16384 2024-09-19T08:12:53.713 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4197376 len 16384 2024-09-19T08:12:53.713 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4197888 len 1024 2024-09-19T08:12:53.714 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4197888 len 1024 2024-09-19T08:12:53.714 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4197888 len 1024 2024-09-19T08:12:53.714 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4197888 len 1024 2024-09-19T08:12:53.714 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4197888 len 2048 2024-09-19T08:12:53.714 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4197888 len 2048 2024-09-19T08:12:53.714 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4197888 len 2048 2024-09-19T08:12:53.714 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4197888 len 2048 2024-09-19T08:12:53.714 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4197888 len 4096 2024-09-19T08:12:53.714 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4197888 len 4096 2024-09-19T08:12:53.714 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4197888 len 4096 2024-09-19T08:12:53.726 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4197888 len 4096 2024-09-19T08:12:53.726 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4197888 len 8192 2024-09-19T08:12:53.726 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4197888 len 8192 2024-09-19T08:12:53.727 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4197888 len 8192 2024-09-19T08:12:53.727 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4197888 len 8192 2024-09-19T08:12:53.727 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2048 offset 4197888 len 16384 2024-09-19T08:12:53.727 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4197888 len 16384 2024-09-19T08:12:53.727 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2048 offset 4197888 len 16384 2024-09-19T08:12:53.727 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2048 offset 4197888 len 16384 2024-09-19T08:12:53.727 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4190208 len 1024 2024-09-19T08:12:53.727 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4190208 len 1024 2024-09-19T08:12:53.727 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4190208 len 1024 2024-09-19T08:12:53.728 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4190208 len 1024 2024-09-19T08:12:53.728 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4190208 len 2048 2024-09-19T08:12:53.728 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4190208 len 2048 2024-09-19T08:12:53.728 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4190208 len 2048 2024-09-19T08:12:53.728 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4190208 len 2048 2024-09-19T08:12:53.728 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4190208 len 4096 2024-09-19T08:12:53.728 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4190208 len 4096 2024-09-19T08:12:53.729 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4190208 len 4096 2024-09-19T08:12:53.729 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4190208 len 4096 2024-09-19T08:12:53.729 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4190208 len 8192 2024-09-19T08:12:53.729 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4190208 len 8192 2024-09-19T08:12:53.729 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4190208 len 8192 2024-09-19T08:12:53.729 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4190208 len 8192 2024-09-19T08:12:53.729 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4190208 len 16384 2024-09-19T08:12:53.730 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4190208 len 16384 2024-09-19T08:12:53.730 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4190208 len 16384 2024-09-19T08:12:53.730 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4190208 len 16384 2024-09-19T08:12:53.731 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4190720 len 1024 2024-09-19T08:12:53.731 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4190720 len 1024 2024-09-19T08:12:53.731 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4190720 len 1024 2024-09-19T08:12:53.731 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4190720 len 1024 2024-09-19T08:12:53.731 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4190720 len 2048 2024-09-19T08:12:53.731 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4190720 len 2048 2024-09-19T08:12:53.732 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4190720 len 2048 2024-09-19T08:12:53.732 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4190720 len 2048 2024-09-19T08:12:53.732 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4190720 len 4096 2024-09-19T08:12:53.732 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4190720 len 4096 2024-09-19T08:12:53.732 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4190720 len 4096 2024-09-19T08:12:53.732 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4190720 len 4096 2024-09-19T08:12:53.732 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4190720 len 8192 2024-09-19T08:12:53.732 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4190720 len 8192 2024-09-19T08:12:53.733 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4190720 len 8192 2024-09-19T08:12:53.733 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4190720 len 8192 2024-09-19T08:12:53.733 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4190720 len 16384 2024-09-19T08:12:53.733 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4190720 len 16384 2024-09-19T08:12:53.733 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4190720 len 16384 2024-09-19T08:12:53.733 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4190720 len 16384 2024-09-19T08:12:53.733 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4191232 len 1024 2024-09-19T08:12:53.733 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4191232 len 1024 2024-09-19T08:12:53.733 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4191232 len 1024 2024-09-19T08:12:53.733 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4191232 len 1024 2024-09-19T08:12:53.733 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4191232 len 2048 2024-09-19T08:12:53.733 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4191232 len 2048 2024-09-19T08:12:53.734 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4191232 len 2048 2024-09-19T08:12:53.734 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4191232 len 2048 2024-09-19T08:12:53.734 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4191232 len 4096 2024-09-19T08:12:53.734 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4191232 len 4096 2024-09-19T08:12:53.734 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4191232 len 4096 2024-09-19T08:12:53.734 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4191232 len 4096 2024-09-19T08:12:53.734 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4191232 len 8192 2024-09-19T08:12:53.734 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4191232 len 8192 2024-09-19T08:12:53.734 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4191232 len 8192 2024-09-19T08:12:53.734 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4191232 len 8192 2024-09-19T08:12:53.734 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4191232 len 16384 2024-09-19T08:12:53.734 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4191232 len 16384 2024-09-19T08:12:53.734 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4191232 len 16384 2024-09-19T08:12:53.734 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4191232 len 16384 2024-09-19T08:12:53.735 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4191744 len 1024 2024-09-19T08:12:53.735 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4191744 len 1024 2024-09-19T08:12:53.735 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4191744 len 1024 2024-09-19T08:12:53.735 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4191744 len 1024 2024-09-19T08:12:53.735 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4191744 len 2048 2024-09-19T08:12:53.735 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4191744 len 2048 2024-09-19T08:12:53.735 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4191744 len 2048 2024-09-19T08:12:53.735 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4191744 len 2048 2024-09-19T08:12:53.735 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4191744 len 4096 2024-09-19T08:12:53.735 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4191744 len 4096 2024-09-19T08:12:53.735 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4191744 len 4096 2024-09-19T08:12:53.735 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4191744 len 4096 2024-09-19T08:12:53.735 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4191744 len 8192 2024-09-19T08:12:53.748 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4191744 len 8192 2024-09-19T08:12:53.748 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4191744 len 8192 2024-09-19T08:12:53.748 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4191744 len 8192 2024-09-19T08:12:53.748 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4191744 len 16384 2024-09-19T08:12:53.748 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4191744 len 16384 2024-09-19T08:12:53.748 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4191744 len 16384 2024-09-19T08:12:53.749 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4191744 len 16384 2024-09-19T08:12:53.749 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4192256 len 1024 2024-09-19T08:12:53.749 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4192256 len 1024 2024-09-19T08:12:53.749 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4192256 len 1024 2024-09-19T08:12:53.749 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4192256 len 1024 2024-09-19T08:12:53.749 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4192256 len 2048 2024-09-19T08:12:53.749 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4192256 len 2048 2024-09-19T08:12:53.749 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4192256 len 2048 2024-09-19T08:12:53.749 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4192256 len 2048 2024-09-19T08:12:53.749 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4192256 len 4096 2024-09-19T08:12:53.749 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4192256 len 4096 2024-09-19T08:12:53.749 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4192256 len 4096 2024-09-19T08:12:53.749 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4192256 len 4096 2024-09-19T08:12:53.749 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4192256 len 8192 2024-09-19T08:12:53.750 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4192256 len 8192 2024-09-19T08:12:53.750 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4192256 len 8192 2024-09-19T08:12:53.750 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4192256 len 8192 2024-09-19T08:12:53.750 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4192256 len 16384 2024-09-19T08:12:53.750 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4192256 len 16384 2024-09-19T08:12:53.750 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4192256 len 16384 2024-09-19T08:12:53.750 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4192256 len 16384 2024-09-19T08:12:53.750 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4192768 len 1024 2024-09-19T08:12:53.750 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4192768 len 1024 2024-09-19T08:12:53.750 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4192768 len 1024 2024-09-19T08:12:53.750 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4192768 len 1024 2024-09-19T08:12:53.750 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4192768 len 2048 2024-09-19T08:12:53.750 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4192768 len 2048 2024-09-19T08:12:53.751 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4192768 len 2048 2024-09-19T08:12:53.751 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4192768 len 2048 2024-09-19T08:12:53.751 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4192768 len 4096 2024-09-19T08:12:53.751 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4192768 len 4096 2024-09-19T08:12:53.751 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4192768 len 4096 2024-09-19T08:12:53.751 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4192768 len 4096 2024-09-19T08:12:53.751 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4192768 len 8192 2024-09-19T08:12:53.751 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4192768 len 8192 2024-09-19T08:12:53.751 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4192768 len 8192 2024-09-19T08:12:53.751 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4192768 len 8192 2024-09-19T08:12:53.751 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4192768 len 16384 2024-09-19T08:12:53.751 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4192768 len 16384 2024-09-19T08:12:53.751 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4192768 len 16384 2024-09-19T08:12:53.751 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4192768 len 16384 2024-09-19T08:12:53.752 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4193280 len 1024 2024-09-19T08:12:53.752 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4193280 len 1024 2024-09-19T08:12:53.752 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4193280 len 1024 2024-09-19T08:12:53.752 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4193280 len 1024 2024-09-19T08:12:53.752 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4193280 len 2048 2024-09-19T08:12:53.752 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4193280 len 2048 2024-09-19T08:12:53.752 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4193280 len 2048 2024-09-19T08:12:53.752 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4193280 len 2048 2024-09-19T08:12:53.752 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4193280 len 4096 2024-09-19T08:12:53.752 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4193280 len 4096 2024-09-19T08:12:53.752 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4193280 len 4096 2024-09-19T08:12:53.753 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4193280 len 4096 2024-09-19T08:12:53.753 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4193280 len 8192 2024-09-19T08:12:53.753 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4193280 len 8192 2024-09-19T08:12:53.753 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4193280 len 8192 2024-09-19T08:12:53.753 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4193280 len 8192 2024-09-19T08:12:53.753 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4193280 len 16384 2024-09-19T08:12:53.753 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4193280 len 16384 2024-09-19T08:12:53.753 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4193280 len 16384 2024-09-19T08:12:53.753 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4193280 len 16384 2024-09-19T08:12:53.753 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4193792 len 1024 2024-09-19T08:12:53.754 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4193792 len 1024 2024-09-19T08:12:53.754 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4193792 len 1024 2024-09-19T08:12:53.754 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4193792 len 1024 2024-09-19T08:12:53.754 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4193792 len 2048 2024-09-19T08:12:53.754 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4193792 len 2048 2024-09-19T08:12:53.754 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4193792 len 2048 2024-09-19T08:12:53.754 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4193792 len 2048 2024-09-19T08:12:53.754 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4193792 len 4096 2024-09-19T08:12:53.754 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4193792 len 4096 2024-09-19T08:12:53.754 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4193792 len 4096 2024-09-19T08:12:53.754 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4193792 len 4096 2024-09-19T08:12:53.754 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4193792 len 8192 2024-09-19T08:12:53.754 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4193792 len 8192 2024-09-19T08:12:53.754 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4193792 len 8192 2024-09-19T08:12:53.755 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4193792 len 8192 2024-09-19T08:12:53.760 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4193792 len 16384 2024-09-19T08:12:53.761 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4193792 len 16384 2024-09-19T08:12:53.761 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4193792 len 16384 2024-09-19T08:12:53.761 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4193792 len 16384 2024-09-19T08:12:53.761 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4194304 len 1024 2024-09-19T08:12:53.761 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4194304 len 1024 2024-09-19T08:12:53.762 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4194304 len 1024 2024-09-19T08:12:53.763 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4194304 len 1024 2024-09-19T08:12:53.764 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4194304 len 2048 2024-09-19T08:12:53.764 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4194304 len 2048 2024-09-19T08:12:53.764 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4194304 len 2048 2024-09-19T08:12:53.764 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4194304 len 2048 2024-09-19T08:12:53.764 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4194304 len 4096 2024-09-19T08:12:53.764 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4194304 len 4096 2024-09-19T08:12:53.764 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4194304 len 4096 2024-09-19T08:12:53.764 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4194304 len 4096 2024-09-19T08:12:53.764 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4194304 len 8192 2024-09-19T08:12:53.764 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4194304 len 8192 2024-09-19T08:12:53.764 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4194304 len 8192 2024-09-19T08:12:53.764 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4194304 len 8192 2024-09-19T08:12:53.764 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4194304 len 16384 2024-09-19T08:12:53.765 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4194304 len 16384 2024-09-19T08:12:53.765 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4194304 len 16384 2024-09-19T08:12:53.765 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4194304 len 16384 2024-09-19T08:12:53.765 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4194816 len 1024 2024-09-19T08:12:53.765 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4194816 len 1024 2024-09-19T08:12:53.765 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4194816 len 1024 2024-09-19T08:12:53.765 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4194816 len 1024 2024-09-19T08:12:53.765 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4194816 len 2048 2024-09-19T08:12:53.766 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4194816 len 2048 2024-09-19T08:12:53.766 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4194816 len 2048 2024-09-19T08:12:53.766 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4194816 len 2048 2024-09-19T08:12:53.766 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4194816 len 4096 2024-09-19T08:12:53.766 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4194816 len 4096 2024-09-19T08:12:53.766 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4194816 len 4096 2024-09-19T08:12:53.766 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4194816 len 4096 2024-09-19T08:12:53.766 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4194816 len 8192 2024-09-19T08:12:53.766 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4194816 len 8192 2024-09-19T08:12:53.766 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4194816 len 8192 2024-09-19T08:12:53.767 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4194816 len 8192 2024-09-19T08:12:53.767 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4194816 len 16384 2024-09-19T08:12:53.767 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4194816 len 16384 2024-09-19T08:12:53.767 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4194816 len 16384 2024-09-19T08:12:53.767 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4194816 len 16384 2024-09-19T08:12:53.767 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4195328 len 1024 2024-09-19T08:12:53.767 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4195328 len 1024 2024-09-19T08:12:53.767 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4195328 len 1024 2024-09-19T08:12:53.767 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4195328 len 1024 2024-09-19T08:12:53.767 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4195328 len 2048 2024-09-19T08:12:53.767 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4195328 len 2048 2024-09-19T08:12:53.767 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4195328 len 2048 2024-09-19T08:12:53.767 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4195328 len 2048 2024-09-19T08:12:53.768 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4195328 len 4096 2024-09-19T08:12:53.768 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4195328 len 4096 2024-09-19T08:12:53.768 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4195328 len 4096 2024-09-19T08:12:53.768 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4195328 len 4096 2024-09-19T08:12:53.768 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4195328 len 8192 2024-09-19T08:12:53.768 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4195328 len 8192 2024-09-19T08:12:53.768 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4195328 len 8192 2024-09-19T08:12:53.768 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4195328 len 8192 2024-09-19T08:12:53.768 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4195328 len 16384 2024-09-19T08:12:53.768 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4195328 len 16384 2024-09-19T08:12:53.768 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4195328 len 16384 2024-09-19T08:12:53.768 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4195328 len 16384 2024-09-19T08:12:53.768 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4195840 len 1024 2024-09-19T08:12:53.768 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4195840 len 1024 2024-09-19T08:12:53.769 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4195840 len 1024 2024-09-19T08:12:53.769 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4195840 len 1024 2024-09-19T08:12:53.769 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4195840 len 2048 2024-09-19T08:12:53.769 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4195840 len 2048 2024-09-19T08:12:53.769 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4195840 len 2048 2024-09-19T08:12:53.769 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4195840 len 2048 2024-09-19T08:12:53.769 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4195840 len 4096 2024-09-19T08:12:53.769 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4195840 len 4096 2024-09-19T08:12:53.769 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4195840 len 4096 2024-09-19T08:12:53.769 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4195840 len 4096 2024-09-19T08:12:53.769 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4195840 len 8192 2024-09-19T08:12:53.769 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4195840 len 8192 2024-09-19T08:12:53.769 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4195840 len 8192 2024-09-19T08:12:53.770 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4195840 len 8192 2024-09-19T08:12:53.770 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4195840 len 16384 2024-09-19T08:12:53.770 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4195840 len 16384 2024-09-19T08:12:53.772 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4195840 len 16384 2024-09-19T08:12:53.772 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4195840 len 16384 2024-09-19T08:12:53.772 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4196352 len 1024 2024-09-19T08:12:53.772 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4196352 len 1024 2024-09-19T08:12:53.772 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4196352 len 1024 2024-09-19T08:12:53.772 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4196352 len 1024 2024-09-19T08:12:53.772 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4196352 len 2048 2024-09-19T08:12:53.772 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4196352 len 2048 2024-09-19T08:12:53.772 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4196352 len 2048 2024-09-19T08:12:53.773 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4196352 len 2048 2024-09-19T08:12:53.773 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4196352 len 4096 2024-09-19T08:12:53.773 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4196352 len 4096 2024-09-19T08:12:53.773 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4196352 len 4096 2024-09-19T08:12:53.773 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4196352 len 4096 2024-09-19T08:12:53.773 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4196352 len 8192 2024-09-19T08:12:53.773 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4196352 len 8192 2024-09-19T08:12:53.773 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4196352 len 8192 2024-09-19T08:12:53.773 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4196352 len 8192 2024-09-19T08:12:53.773 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4196352 len 16384 2024-09-19T08:12:53.773 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4196352 len 16384 2024-09-19T08:12:53.773 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4196352 len 16384 2024-09-19T08:12:53.773 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4196352 len 16384 2024-09-19T08:12:53.774 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4196864 len 1024 2024-09-19T08:12:53.774 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4196864 len 1024 2024-09-19T08:12:53.774 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4196864 len 1024 2024-09-19T08:12:53.774 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4196864 len 1024 2024-09-19T08:12:53.774 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4196864 len 2048 2024-09-19T08:12:53.774 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4196864 len 2048 2024-09-19T08:12:53.774 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4196864 len 2048 2024-09-19T08:12:53.774 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4196864 len 2048 2024-09-19T08:12:53.774 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4196864 len 4096 2024-09-19T08:12:53.774 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4196864 len 4096 2024-09-19T08:12:53.774 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4196864 len 4096 2024-09-19T08:12:53.774 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4196864 len 4096 2024-09-19T08:12:53.774 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4196864 len 8192 2024-09-19T08:12:53.775 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4196864 len 8192 2024-09-19T08:12:53.775 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4196864 len 8192 2024-09-19T08:12:53.775 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4196864 len 8192 2024-09-19T08:12:53.775 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4196864 len 16384 2024-09-19T08:12:53.775 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4196864 len 16384 2024-09-19T08:12:53.775 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4196864 len 16384 2024-09-19T08:12:53.775 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4196864 len 16384 2024-09-19T08:12:53.775 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4197376 len 1024 2024-09-19T08:12:53.775 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4197376 len 1024 2024-09-19T08:12:53.775 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4197376 len 1024 2024-09-19T08:12:53.775 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4197376 len 1024 2024-09-19T08:12:53.775 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4197376 len 2048 2024-09-19T08:12:53.775 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4197376 len 2048 2024-09-19T08:12:53.775 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4197376 len 2048 2024-09-19T08:12:53.776 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4197376 len 2048 2024-09-19T08:12:53.776 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4197376 len 4096 2024-09-19T08:12:53.776 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4197376 len 4096 2024-09-19T08:12:53.776 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4197376 len 4096 2024-09-19T08:12:53.776 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4197376 len 4096 2024-09-19T08:12:53.776 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4197376 len 8192 2024-09-19T08:12:53.776 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4197376 len 8192 2024-09-19T08:12:53.776 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4197376 len 8192 2024-09-19T08:12:53.776 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4197376 len 8192 2024-09-19T08:12:53.776 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4197376 len 16384 2024-09-19T08:12:53.776 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4197376 len 16384 2024-09-19T08:12:53.776 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4197376 len 16384 2024-09-19T08:12:53.776 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4197376 len 16384 2024-09-19T08:12:53.777 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4197888 len 1024 2024-09-19T08:12:53.777 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4197888 len 1024 2024-09-19T08:12:53.777 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4197888 len 1024 2024-09-19T08:12:53.777 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4197888 len 1024 2024-09-19T08:12:53.777 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4197888 len 2048 2024-09-19T08:12:53.777 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4197888 len 2048 2024-09-19T08:12:53.777 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4197888 len 2048 2024-09-19T08:12:53.777 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4197888 len 2048 2024-09-19T08:12:53.777 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4197888 len 4096 2024-09-19T08:12:53.777 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4197888 len 4096 2024-09-19T08:12:53.777 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4197888 len 4096 2024-09-19T08:12:53.777 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4197888 len 4096 2024-09-19T08:12:53.778 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4197888 len 8192 2024-09-19T08:12:53.778 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4197888 len 8192 2024-09-19T08:12:53.778 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4197888 len 8192 2024-09-19T08:12:53.778 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4197888 len 8192 2024-09-19T08:12:53.778 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 2560 offset 4197888 len 16384 2024-09-19T08:12:53.778 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4197888 len 16384 2024-09-19T08:12:53.778 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 2560 offset 4197888 len 16384 2024-09-19T08:12:53.778 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 2560 offset 4197888 len 16384 2024-09-19T08:12:53.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.770+0000 7f651a13e640 1 -- 172.21.15.27:0/443352056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6514100aa0 msgr2=0x7f651410ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:53.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.770+0000 7f651a13e640 1 --2- 172.21.15.27:0/443352056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6514100aa0 0x7f651410ea20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f650c009ca0 tx=0x7f650c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:12:53.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.770+0000 7f651a13e640 1 -- 172.21.15.27:0/443352056 shutdown_connections 2024-09-19T08:12:53.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.770+0000 7f651a13e640 1 --2- 172.21.15.27:0/443352056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6514100aa0 0x7f651410ea20 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:53.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.770+0000 7f651a13e640 1 --2- 172.21.15.27:0/443352056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6514100100 0x7f6514100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:53.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.770+0000 7f651a13e640 1 --2- 172.21.15.27:0/443352056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6514106b80 0x7f6514106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:53.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.770+0000 7f651a13e640 1 -- 172.21.15.27:0/443352056 >> 172.21.15.27:0/443352056 conn(0x7f6514077230 msgr2=0x7f65140fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:53.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.770+0000 7f651a13e640 1 -- 172.21.15.27:0/443352056 shutdown_connections 2024-09-19T08:12:53.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.770+0000 7f651a13e640 1 -- 172.21.15.27:0/443352056 wait complete. 2024-09-19T08:12:53.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.771+0000 7f651a13e640 1 Processor -- start 2024-09-19T08:12:53.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.771+0000 7f651a13e640 1 -- start start 2024-09-19T08:12:53.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.772+0000 7f651a13e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6514100100 0x7f65141012e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:53.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.772+0000 7f651a13e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6514100aa0 0x7f6514101820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:53.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.772+0000 7f651a13e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6514106b80 0x7f6514101d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:53.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.772+0000 7f651a13e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6514112050 con 0x7f6514100100 2024-09-19T08:12:53.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.772+0000 7f651a13e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6514111ed0 con 0x7f6514106b80 2024-09-19T08:12:53.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.772+0000 7f651a13e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f65141121d0 con 0x7f6514100aa0 2024-09-19T08:12:53.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.772+0000 7f65137fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6514100100 0x7f65141012e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:53.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.772+0000 7f65137fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6514100100 0x7f65141012e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46002/0 (socket says 172.21.15.27:46002) 2024-09-19T08:12:53.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.772+0000 7f65137fe640 1 -- 172.21.15.27:0/3406077616 learned_addr learned my addr 172.21.15.27:0/3406077616 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:53.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.772+0000 7f6512ffd640 1 --2- 172.21.15.27:0/3406077616 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6514100aa0 0x7f6514101820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:53.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.772+0000 7f6512ffd640 1 -- 172.21.15.27:0/3406077616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6514106b80 msgr2=0x7f6514101d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:53.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.772+0000 7f6512ffd640 1 --2- 172.21.15.27:0/3406077616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6514106b80 0x7f6514101d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:53.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.772+0000 7f6512ffd640 1 -- 172.21.15.27:0/3406077616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6514100100 msgr2=0x7f65141012e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:53.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.772+0000 7f6512ffd640 1 --2- 172.21.15.27:0/3406077616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6514100100 0x7f65141012e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:53.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.772+0000 7f6512ffd640 1 -- 172.21.15.27:0/3406077616 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65141a6930 con 0x7f6514100aa0 2024-09-19T08:12:53.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.772+0000 7f65137fe640 1 --2- 172.21.15.27:0/3406077616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6514100100 0x7f65141012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:12:53.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.772+0000 7f6512ffd640 1 --2- 172.21.15.27:0/3406077616 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6514100aa0 0x7f6514101820 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6508005fd0 tx=0x7f650800dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:53.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.772+0000 7f6510ff9640 1 -- 172.21.15.27:0/3406077616 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508009c30 con 0x7f6514100aa0 2024-09-19T08:12:53.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.773+0000 7f651a13e640 1 -- 172.21.15.27:0/3406077616 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65141a6c20 con 0x7f6514100aa0 2024-09-19T08:12:53.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.773+0000 7f6510ff9640 1 -- 172.21.15.27:0/3406077616 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6508009dd0 con 0x7f6514100aa0 2024-09-19T08:12:53.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.773+0000 7f6510ff9640 1 -- 172.21.15.27:0/3406077616 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508010460 con 0x7f6514100aa0 2024-09-19T08:12:53.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.773+0000 7f651a13e640 1 -- 172.21.15.27:0/3406077616 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65141a7160 con 0x7f6514100aa0 2024-09-19T08:12:53.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.774+0000 7f651a13e640 1 -- 172.21.15.27:0/3406077616 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6514100560 con 0x7f6514100aa0 2024-09-19T08:12:53.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.775+0000 7f6510ff9640 1 -- 172.21.15.27:0/3406077616 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6508003f50 con 0x7f6514100aa0 2024-09-19T08:12:53.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.776+0000 7f6510ff9640 1 --2- 172.21.15.27:0/3406077616 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f64fc0a33b0 0x7f64fc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:53.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.776+0000 7f65137fe640 1 --2- 172.21.15.27:0/3406077616 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f64fc0a33b0 0x7f64fc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:53.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.776+0000 7f6510ff9640 1 -- 172.21.15.27:0/3406077616 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f65080cfc10 con 0x7f6514100aa0 2024-09-19T08:12:53.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.776+0000 7f65137fe640 1 --2- 172.21.15.27:0/3406077616 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f64fc0a33b0 0x7f64fc0a5870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6504011440 tx=0x7f6504005f90 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:53.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:53.780+0000 7f6510ff9640 1 -- 172.21.15.27:0/3406077616 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6508017020 con 0x7f6514100aa0 2024-09-19T08:12:53.798 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4190208 len 1024 2024-09-19T08:12:53.798 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4190208 len 1024 2024-09-19T08:12:53.798 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4190208 len 1024 2024-09-19T08:12:53.799 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4190208 len 1024 2024-09-19T08:12:53.799 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4190208 len 2048 2024-09-19T08:12:53.799 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4190208 len 2048 2024-09-19T08:12:53.799 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4190208 len 2048 2024-09-19T08:12:53.799 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4190208 len 2048 2024-09-19T08:12:53.799 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4190208 len 4096 2024-09-19T08:12:53.799 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4190208 len 4096 2024-09-19T08:12:53.799 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4190208 len 4096 2024-09-19T08:12:53.799 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4190208 len 4096 2024-09-19T08:12:53.799 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4190208 len 8192 2024-09-19T08:12:53.799 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4190208 len 8192 2024-09-19T08:12:53.799 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4190208 len 8192 2024-09-19T08:12:53.799 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4190208 len 8192 2024-09-19T08:12:53.799 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4190208 len 16384 2024-09-19T08:12:53.800 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4190208 len 16384 2024-09-19T08:12:53.800 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4190208 len 16384 2024-09-19T08:12:53.800 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4190208 len 16384 2024-09-19T08:12:53.800 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4190720 len 1024 2024-09-19T08:12:53.800 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4190720 len 1024 2024-09-19T08:12:53.800 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4190720 len 1024 2024-09-19T08:12:53.800 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4190720 len 1024 2024-09-19T08:12:53.800 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4190720 len 2048 2024-09-19T08:12:53.800 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4190720 len 2048 2024-09-19T08:12:53.801 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4190720 len 2048 2024-09-19T08:12:53.801 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4190720 len 2048 2024-09-19T08:12:53.801 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4190720 len 4096 2024-09-19T08:12:53.801 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4190720 len 4096 2024-09-19T08:12:53.801 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4190720 len 4096 2024-09-19T08:12:53.801 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4190720 len 4096 2024-09-19T08:12:53.801 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4190720 len 8192 2024-09-19T08:12:53.801 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4190720 len 8192 2024-09-19T08:12:53.801 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4190720 len 8192 2024-09-19T08:12:53.802 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4190720 len 8192 2024-09-19T08:12:53.802 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4190720 len 16384 2024-09-19T08:12:53.802 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4190720 len 16384 2024-09-19T08:12:53.802 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4190720 len 16384 2024-09-19T08:12:53.802 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4190720 len 16384 2024-09-19T08:12:53.802 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4191232 len 1024 2024-09-19T08:12:53.802 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4191232 len 1024 2024-09-19T08:12:53.802 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4191232 len 1024 2024-09-19T08:12:53.802 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4191232 len 1024 2024-09-19T08:12:53.803 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4191232 len 2048 2024-09-19T08:12:53.803 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4191232 len 2048 2024-09-19T08:12:53.803 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4191232 len 2048 2024-09-19T08:12:53.803 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4191232 len 2048 2024-09-19T08:12:53.803 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4191232 len 4096 2024-09-19T08:12:53.803 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4191232 len 4096 2024-09-19T08:12:53.803 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4191232 len 4096 2024-09-19T08:12:53.803 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4191232 len 4096 2024-09-19T08:12:53.803 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4191232 len 8192 2024-09-19T08:12:53.803 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4191232 len 8192 2024-09-19T08:12:53.803 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4191232 len 8192 2024-09-19T08:12:53.803 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4191232 len 8192 2024-09-19T08:12:53.804 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4191232 len 16384 2024-09-19T08:12:53.804 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4191232 len 16384 2024-09-19T08:12:53.804 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4191232 len 16384 2024-09-19T08:12:53.804 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4191232 len 16384 2024-09-19T08:12:53.804 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4191744 len 1024 2024-09-19T08:12:53.804 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4191744 len 1024 2024-09-19T08:12:53.804 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4191744 len 1024 2024-09-19T08:12:53.804 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4191744 len 1024 2024-09-19T08:12:53.804 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4191744 len 2048 2024-09-19T08:12:53.804 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4191744 len 2048 2024-09-19T08:12:53.804 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4191744 len 2048 2024-09-19T08:12:53.804 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4191744 len 2048 2024-09-19T08:12:53.805 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4191744 len 4096 2024-09-19T08:12:53.805 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4191744 len 4096 2024-09-19T08:12:53.805 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4191744 len 4096 2024-09-19T08:12:53.805 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4191744 len 4096 2024-09-19T08:12:53.805 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4191744 len 8192 2024-09-19T08:12:53.805 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4191744 len 8192 2024-09-19T08:12:53.805 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4191744 len 8192 2024-09-19T08:12:53.805 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4191744 len 8192 2024-09-19T08:12:53.805 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4191744 len 16384 2024-09-19T08:12:53.805 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4191744 len 16384 2024-09-19T08:12:53.805 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4191744 len 16384 2024-09-19T08:12:53.805 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4191744 len 16384 2024-09-19T08:12:53.805 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4192256 len 1024 2024-09-19T08:12:53.805 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4192256 len 1024 2024-09-19T08:12:53.806 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4192256 len 1024 2024-09-19T08:12:53.821 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:12:53.823 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4192256 len 1024 2024-09-19T08:12:53.823 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4192256 len 2048 2024-09-19T08:12:53.823 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4192256 len 2048 2024-09-19T08:12:53.823 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4192256 len 2048 2024-09-19T08:12:53.823 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4192256 len 2048 2024-09-19T08:12:53.823 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4192256 len 4096 2024-09-19T08:12:53.823 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4192256 len 4096 2024-09-19T08:12:53.823 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4192256 len 4096 2024-09-19T08:12:53.824 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4192256 len 4096 2024-09-19T08:12:53.824 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4192256 len 8192 2024-09-19T08:12:53.824 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4192256 len 8192 2024-09-19T08:12:53.824 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4192256 len 8192 2024-09-19T08:12:53.824 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4192256 len 8192 2024-09-19T08:12:53.825 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4192256 len 16384 2024-09-19T08:12:53.825 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4192256 len 16384 2024-09-19T08:12:53.825 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4192256 len 16384 2024-09-19T08:12:53.825 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4192256 len 16384 2024-09-19T08:12:53.825 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4192768 len 1024 2024-09-19T08:12:53.825 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4192768 len 1024 2024-09-19T08:12:53.825 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4192768 len 1024 2024-09-19T08:12:53.825 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4192768 len 1024 2024-09-19T08:12:53.825 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4192768 len 2048 2024-09-19T08:12:53.825 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4192768 len 2048 2024-09-19T08:12:53.826 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4192768 len 2048 2024-09-19T08:12:53.826 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4192768 len 2048 2024-09-19T08:12:53.826 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4192768 len 4096 2024-09-19T08:12:53.826 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4192768 len 4096 2024-09-19T08:12:53.826 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4192768 len 4096 2024-09-19T08:12:53.826 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4192768 len 4096 2024-09-19T08:12:53.827 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4192768 len 8192 2024-09-19T08:12:53.827 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4192768 len 8192 2024-09-19T08:12:53.827 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4192768 len 8192 2024-09-19T08:12:53.827 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4192768 len 8192 2024-09-19T08:12:53.827 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4192768 len 16384 2024-09-19T08:12:53.827 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4192768 len 16384 2024-09-19T08:12:53.827 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4192768 len 16384 2024-09-19T08:12:53.828 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4192768 len 16384 2024-09-19T08:12:53.828 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4193280 len 1024 2024-09-19T08:12:53.828 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4193280 len 1024 2024-09-19T08:12:53.828 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4193280 len 1024 2024-09-19T08:12:53.828 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4193280 len 1024 2024-09-19T08:12:53.828 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4193280 len 2048 2024-09-19T08:12:53.828 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4193280 len 2048 2024-09-19T08:12:53.828 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4193280 len 2048 2024-09-19T08:12:53.828 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4193280 len 2048 2024-09-19T08:12:53.829 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4193280 len 4096 2024-09-19T08:12:53.829 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4193280 len 4096 2024-09-19T08:12:53.829 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4193280 len 4096 2024-09-19T08:12:53.829 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4193280 len 4096 2024-09-19T08:12:53.829 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4193280 len 8192 2024-09-19T08:12:53.829 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4193280 len 8192 2024-09-19T08:12:53.829 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4193280 len 8192 2024-09-19T08:12:53.829 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4193280 len 8192 2024-09-19T08:12:53.829 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4193280 len 16384 2024-09-19T08:12:53.829 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4193280 len 16384 2024-09-19T08:12:53.829 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4193280 len 16384 2024-09-19T08:12:53.829 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4193280 len 16384 2024-09-19T08:12:53.829 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4193792 len 1024 2024-09-19T08:12:53.830 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4193792 len 1024 2024-09-19T08:12:53.830 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4193792 len 1024 2024-09-19T08:12:53.830 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4193792 len 1024 2024-09-19T08:12:53.830 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4193792 len 2048 2024-09-19T08:12:53.830 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4193792 len 2048 2024-09-19T08:12:53.830 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4193792 len 2048 2024-09-19T08:12:53.831 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4193792 len 2048 2024-09-19T08:12:53.831 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4193792 len 4096 2024-09-19T08:12:53.831 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4193792 len 4096 2024-09-19T08:12:53.831 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4193792 len 4096 2024-09-19T08:12:53.831 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4193792 len 4096 2024-09-19T08:12:53.831 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4193792 len 8192 2024-09-19T08:12:53.831 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4193792 len 8192 2024-09-19T08:12:53.831 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4193792 len 8192 2024-09-19T08:12:53.831 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4193792 len 8192 2024-09-19T08:12:53.831 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4193792 len 16384 2024-09-19T08:12:53.831 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4193792 len 16384 2024-09-19T08:12:53.832 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4193792 len 16384 2024-09-19T08:12:53.832 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4193792 len 16384 2024-09-19T08:12:53.832 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4194304 len 1024 2024-09-19T08:12:53.832 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4194304 len 1024 2024-09-19T08:12:53.832 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4194304 len 1024 2024-09-19T08:12:53.832 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4194304 len 1024 2024-09-19T08:12:53.832 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4194304 len 2048 2024-09-19T08:12:53.834 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4194304 len 2048 2024-09-19T08:12:53.834 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4194304 len 2048 2024-09-19T08:12:53.835 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4194304 len 2048 2024-09-19T08:12:53.835 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4194304 len 4096 2024-09-19T08:12:53.835 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4194304 len 4096 2024-09-19T08:12:53.835 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4194304 len 4096 2024-09-19T08:12:53.835 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4194304 len 4096 2024-09-19T08:12:53.835 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4194304 len 8192 2024-09-19T08:12:53.835 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4194304 len 8192 2024-09-19T08:12:53.835 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4194304 len 8192 2024-09-19T08:12:53.836 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4194304 len 8192 2024-09-19T08:12:53.836 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4194304 len 16384 2024-09-19T08:12:53.836 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4194304 len 16384 2024-09-19T08:12:53.836 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4194304 len 16384 2024-09-19T08:12:53.836 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4194304 len 16384 2024-09-19T08:12:53.836 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4194816 len 1024 2024-09-19T08:12:53.836 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4194816 len 1024 2024-09-19T08:12:53.836 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4194816 len 1024 2024-09-19T08:12:53.837 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4194816 len 1024 2024-09-19T08:12:53.837 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4194816 len 2048 2024-09-19T08:12:53.837 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4194816 len 2048 2024-09-19T08:12:53.837 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4194816 len 2048 2024-09-19T08:12:53.837 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4194816 len 2048 2024-09-19T08:12:53.837 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4194816 len 4096 2024-09-19T08:12:53.837 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4194816 len 4096 2024-09-19T08:12:53.837 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4194816 len 4096 2024-09-19T08:12:53.837 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4194816 len 4096 2024-09-19T08:12:53.837 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4194816 len 8192 2024-09-19T08:12:53.837 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4194816 len 8192 2024-09-19T08:12:53.837 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4194816 len 8192 2024-09-19T08:12:53.837 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4194816 len 8192 2024-09-19T08:12:53.837 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4194816 len 16384 2024-09-19T08:12:53.838 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4194816 len 16384 2024-09-19T08:12:53.838 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4194816 len 16384 2024-09-19T08:12:53.838 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4194816 len 16384 2024-09-19T08:12:53.838 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4195328 len 1024 2024-09-19T08:12:53.838 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4195328 len 1024 2024-09-19T08:12:53.838 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4195328 len 1024 2024-09-19T08:12:53.838 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4195328 len 1024 2024-09-19T08:12:53.838 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4195328 len 2048 2024-09-19T08:12:53.838 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4195328 len 2048 2024-09-19T08:12:53.838 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4195328 len 2048 2024-09-19T08:12:53.838 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4195328 len 2048 2024-09-19T08:12:53.838 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4195328 len 4096 2024-09-19T08:12:53.838 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4195328 len 4096 2024-09-19T08:12:53.839 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4195328 len 4096 2024-09-19T08:12:53.839 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4195328 len 4096 2024-09-19T08:12:53.839 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4195328 len 8192 2024-09-19T08:12:53.839 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4195328 len 8192 2024-09-19T08:12:53.839 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4195328 len 8192 2024-09-19T08:12:53.839 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4195328 len 8192 2024-09-19T08:12:53.839 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4195328 len 16384 2024-09-19T08:12:53.839 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4195328 len 16384 2024-09-19T08:12:53.839 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4195328 len 16384 2024-09-19T08:12:53.839 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4195328 len 16384 2024-09-19T08:12:53.839 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4195840 len 1024 2024-09-19T08:12:53.839 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4195840 len 1024 2024-09-19T08:12:53.839 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4195840 len 1024 2024-09-19T08:12:53.840 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4195840 len 1024 2024-09-19T08:12:53.840 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4195840 len 2048 2024-09-19T08:12:53.840 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4195840 len 2048 2024-09-19T08:12:53.840 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4195840 len 2048 2024-09-19T08:12:53.840 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4195840 len 2048 2024-09-19T08:12:53.840 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4195840 len 4096 2024-09-19T08:12:53.840 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4195840 len 4096 2024-09-19T08:12:53.840 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4195840 len 4096 2024-09-19T08:12:53.840 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4195840 len 4096 2024-09-19T08:12:53.840 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4195840 len 8192 2024-09-19T08:12:53.840 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4195840 len 8192 2024-09-19T08:12:53.840 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4195840 len 8192 2024-09-19T08:12:53.841 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4195840 len 8192 2024-09-19T08:12:53.841 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4195840 len 16384 2024-09-19T08:12:53.841 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4195840 len 16384 2024-09-19T08:12:53.841 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4195840 len 16384 2024-09-19T08:12:53.841 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4195840 len 16384 2024-09-19T08:12:53.841 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4196352 len 1024 2024-09-19T08:12:53.841 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4196352 len 1024 2024-09-19T08:12:53.841 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4196352 len 1024 2024-09-19T08:12:53.841 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4196352 len 1024 2024-09-19T08:12:53.841 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4196352 len 2048 2024-09-19T08:12:53.841 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4196352 len 2048 2024-09-19T08:12:53.841 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4196352 len 2048 2024-09-19T08:12:53.841 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4196352 len 2048 2024-09-19T08:12:53.846 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4196352 len 4096 2024-09-19T08:12:53.846 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4196352 len 4096 2024-09-19T08:12:53.846 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4196352 len 4096 2024-09-19T08:12:53.846 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4196352 len 4096 2024-09-19T08:12:53.847 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4196352 len 8192 2024-09-19T08:12:53.847 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4196352 len 8192 2024-09-19T08:12:53.847 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4196352 len 8192 2024-09-19T08:12:53.847 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4196352 len 8192 2024-09-19T08:12:53.847 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4196352 len 16384 2024-09-19T08:12:53.847 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4196352 len 16384 2024-09-19T08:12:53.847 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4196352 len 16384 2024-09-19T08:12:53.847 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4196352 len 16384 2024-09-19T08:12:53.847 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4196864 len 1024 2024-09-19T08:12:53.847 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4196864 len 1024 2024-09-19T08:12:53.847 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4196864 len 1024 2024-09-19T08:12:53.847 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4196864 len 1024 2024-09-19T08:12:53.847 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4196864 len 2048 2024-09-19T08:12:53.848 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4196864 len 2048 2024-09-19T08:12:53.848 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4196864 len 2048 2024-09-19T08:12:53.848 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4196864 len 2048 2024-09-19T08:12:53.848 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4196864 len 4096 2024-09-19T08:12:53.848 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4196864 len 4096 2024-09-19T08:12:53.848 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4196864 len 4096 2024-09-19T08:12:53.848 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4196864 len 4096 2024-09-19T08:12:53.848 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4196864 len 8192 2024-09-19T08:12:53.848 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4196864 len 8192 2024-09-19T08:12:53.848 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4196864 len 8192 2024-09-19T08:12:53.849 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4196864 len 8192 2024-09-19T08:12:53.849 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4196864 len 16384 2024-09-19T08:12:53.849 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4196864 len 16384 2024-09-19T08:12:53.849 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4196864 len 16384 2024-09-19T08:12:53.849 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4196864 len 16384 2024-09-19T08:12:53.849 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4197376 len 1024 2024-09-19T08:12:53.849 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4197376 len 1024 2024-09-19T08:12:53.849 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4197376 len 1024 2024-09-19T08:12:53.849 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4197376 len 1024 2024-09-19T08:12:53.849 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4197376 len 2048 2024-09-19T08:12:53.849 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4197376 len 2048 2024-09-19T08:12:53.849 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4197376 len 2048 2024-09-19T08:12:53.849 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4197376 len 2048 2024-09-19T08:12:53.850 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4197376 len 4096 2024-09-19T08:12:53.850 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4197376 len 4096 2024-09-19T08:12:53.850 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4197376 len 4096 2024-09-19T08:12:53.850 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4197376 len 4096 2024-09-19T08:12:53.850 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4197376 len 8192 2024-09-19T08:12:53.850 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4197376 len 8192 2024-09-19T08:12:53.850 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4197376 len 8192 2024-09-19T08:12:53.850 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4197376 len 8192 2024-09-19T08:12:53.850 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4197376 len 16384 2024-09-19T08:12:53.850 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4197376 len 16384 2024-09-19T08:12:53.851 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4197376 len 16384 2024-09-19T08:12:53.851 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4197376 len 16384 2024-09-19T08:12:53.851 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4197888 len 1024 2024-09-19T08:12:53.851 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4197888 len 1024 2024-09-19T08:12:53.851 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4197888 len 1024 2024-09-19T08:12:53.851 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4197888 len 1024 2024-09-19T08:12:53.851 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4197888 len 2048 2024-09-19T08:12:53.851 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4197888 len 2048 2024-09-19T08:12:53.851 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4197888 len 2048 2024-09-19T08:12:53.851 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4197888 len 2048 2024-09-19T08:12:53.851 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4197888 len 4096 2024-09-19T08:12:53.851 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4197888 len 4096 2024-09-19T08:12:53.851 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4197888 len 4096 2024-09-19T08:12:53.852 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4197888 len 4096 2024-09-19T08:12:53.852 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4197888 len 8192 2024-09-19T08:12:53.852 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4197888 len 8192 2024-09-19T08:12:53.852 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4197888 len 8192 2024-09-19T08:12:53.852 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4197888 len 8192 2024-09-19T08:12:53.852 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3072 offset 4197888 len 16384 2024-09-19T08:12:53.852 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4197888 len 16384 2024-09-19T08:12:53.853 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3072 offset 4197888 len 16384 2024-09-19T08:12:53.853 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3072 offset 4197888 len 16384 2024-09-19T08:12:53.853 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4190208 len 1024 2024-09-19T08:12:53.853 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4190208 len 1024 2024-09-19T08:12:53.853 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4190208 len 1024 2024-09-19T08:12:53.853 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4190208 len 1024 2024-09-19T08:12:53.853 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4190208 len 2048 2024-09-19T08:12:53.853 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4190208 len 2048 2024-09-19T08:12:53.853 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4190208 len 2048 2024-09-19T08:12:53.853 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4190208 len 2048 2024-09-19T08:12:53.853 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4190208 len 4096 2024-09-19T08:12:53.853 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4190208 len 4096 2024-09-19T08:12:53.867 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4190208 len 4096 2024-09-19T08:12:53.867 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4190208 len 4096 2024-09-19T08:12:53.867 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4190208 len 8192 2024-09-19T08:12:53.867 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4190208 len 8192 2024-09-19T08:12:53.867 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4190208 len 8192 2024-09-19T08:12:53.867 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4190208 len 8192 2024-09-19T08:12:53.867 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4190208 len 16384 2024-09-19T08:12:53.867 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4190208 len 16384 2024-09-19T08:12:53.868 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4190208 len 16384 2024-09-19T08:12:53.868 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4190208 len 16384 2024-09-19T08:12:53.868 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4190720 len 1024 2024-09-19T08:12:53.868 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4190720 len 1024 2024-09-19T08:12:53.868 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4190720 len 1024 2024-09-19T08:12:53.868 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4190720 len 1024 2024-09-19T08:12:53.868 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4190720 len 2048 2024-09-19T08:12:53.868 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4190720 len 2048 2024-09-19T08:12:53.868 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4190720 len 2048 2024-09-19T08:12:53.868 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4190720 len 2048 2024-09-19T08:12:53.868 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4190720 len 4096 2024-09-19T08:12:53.868 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4190720 len 4096 2024-09-19T08:12:53.868 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4190720 len 4096 2024-09-19T08:12:53.869 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4190720 len 4096 2024-09-19T08:12:53.869 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4190720 len 8192 2024-09-19T08:12:53.869 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4190720 len 8192 2024-09-19T08:12:53.869 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4190720 len 8192 2024-09-19T08:12:53.869 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4190720 len 8192 2024-09-19T08:12:53.869 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4190720 len 16384 2024-09-19T08:12:53.869 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4190720 len 16384 2024-09-19T08:12:53.869 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4190720 len 16384 2024-09-19T08:12:53.869 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4190720 len 16384 2024-09-19T08:12:53.869 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4191232 len 1024 2024-09-19T08:12:53.869 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4191232 len 1024 2024-09-19T08:12:53.869 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4191232 len 1024 2024-09-19T08:12:53.869 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4191232 len 1024 2024-09-19T08:12:53.869 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4191232 len 2048 2024-09-19T08:12:53.870 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4191232 len 2048 2024-09-19T08:12:53.870 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4191232 len 2048 2024-09-19T08:12:53.870 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4191232 len 2048 2024-09-19T08:12:53.870 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4191232 len 4096 2024-09-19T08:12:53.870 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4191232 len 4096 2024-09-19T08:12:53.870 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4191232 len 4096 2024-09-19T08:12:53.870 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4191232 len 4096 2024-09-19T08:12:53.870 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4191232 len 8192 2024-09-19T08:12:53.870 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4191232 len 8192 2024-09-19T08:12:53.870 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4191232 len 8192 2024-09-19T08:12:53.870 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4191232 len 8192 2024-09-19T08:12:53.870 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4191232 len 16384 2024-09-19T08:12:53.870 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4191232 len 16384 2024-09-19T08:12:53.870 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4191232 len 16384 2024-09-19T08:12:53.871 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4191232 len 16384 2024-09-19T08:12:53.871 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4191744 len 1024 2024-09-19T08:12:53.871 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4191744 len 1024 2024-09-19T08:12:53.871 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4191744 len 1024 2024-09-19T08:12:53.871 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4191744 len 1024 2024-09-19T08:12:53.871 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4191744 len 2048 2024-09-19T08:12:53.871 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4191744 len 2048 2024-09-19T08:12:53.871 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4191744 len 2048 2024-09-19T08:12:53.871 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4191744 len 2048 2024-09-19T08:12:53.871 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4191744 len 4096 2024-09-19T08:12:53.871 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4191744 len 4096 2024-09-19T08:12:53.871 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4191744 len 4096 2024-09-19T08:12:53.871 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4191744 len 4096 2024-09-19T08:12:53.871 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4191744 len 8192 2024-09-19T08:12:53.872 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4191744 len 8192 2024-09-19T08:12:53.872 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4191744 len 8192 2024-09-19T08:12:53.872 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4191744 len 8192 2024-09-19T08:12:53.872 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4191744 len 16384 2024-09-19T08:12:53.872 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4191744 len 16384 2024-09-19T08:12:53.872 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4191744 len 16384 2024-09-19T08:12:53.872 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4191744 len 16384 2024-09-19T08:12:53.872 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4192256 len 1024 2024-09-19T08:12:53.872 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4192256 len 1024 2024-09-19T08:12:53.872 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4192256 len 1024 2024-09-19T08:12:53.872 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4192256 len 1024 2024-09-19T08:12:53.872 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4192256 len 2048 2024-09-19T08:12:53.872 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4192256 len 2048 2024-09-19T08:12:53.873 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4192256 len 2048 2024-09-19T08:12:53.873 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4192256 len 2048 2024-09-19T08:12:53.873 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4192256 len 4096 2024-09-19T08:12:53.873 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4192256 len 4096 2024-09-19T08:12:53.873 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4192256 len 4096 2024-09-19T08:12:53.873 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4192256 len 4096 2024-09-19T08:12:53.873 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4192256 len 8192 2024-09-19T08:12:53.888 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4192256 len 8192 2024-09-19T08:12:53.888 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4192256 len 8192 2024-09-19T08:12:53.888 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4192256 len 8192 2024-09-19T08:12:53.888 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4192256 len 16384 2024-09-19T08:12:53.888 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4192256 len 16384 2024-09-19T08:12:53.889 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4192256 len 16384 2024-09-19T08:12:53.889 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4192256 len 16384 2024-09-19T08:12:53.889 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4192768 len 1024 2024-09-19T08:12:53.889 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4192768 len 1024 2024-09-19T08:12:53.889 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4192768 len 1024 2024-09-19T08:12:53.889 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4192768 len 1024 2024-09-19T08:12:53.889 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4192768 len 2048 2024-09-19T08:12:53.889 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4192768 len 2048 2024-09-19T08:12:53.889 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4192768 len 2048 2024-09-19T08:12:53.889 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4192768 len 2048 2024-09-19T08:12:53.889 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4192768 len 4096 2024-09-19T08:12:53.889 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4192768 len 4096 2024-09-19T08:12:53.889 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4192768 len 4096 2024-09-19T08:12:53.890 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4192768 len 4096 2024-09-19T08:12:53.890 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4192768 len 8192 2024-09-19T08:12:53.890 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4192768 len 8192 2024-09-19T08:12:53.890 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4192768 len 8192 2024-09-19T08:12:53.890 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4192768 len 8192 2024-09-19T08:12:53.890 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4192768 len 16384 2024-09-19T08:12:53.890 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4192768 len 16384 2024-09-19T08:12:53.890 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4192768 len 16384 2024-09-19T08:12:53.890 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4192768 len 16384 2024-09-19T08:12:53.890 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4193280 len 1024 2024-09-19T08:12:53.890 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4193280 len 1024 2024-09-19T08:12:53.890 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4193280 len 1024 2024-09-19T08:12:53.890 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4193280 len 1024 2024-09-19T08:12:53.890 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4193280 len 2048 2024-09-19T08:12:53.891 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4193280 len 2048 2024-09-19T08:12:53.891 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4193280 len 2048 2024-09-19T08:12:53.891 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4193280 len 2048 2024-09-19T08:12:53.891 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4193280 len 4096 2024-09-19T08:12:53.891 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4193280 len 4096 2024-09-19T08:12:53.891 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4193280 len 4096 2024-09-19T08:12:53.891 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4193280 len 4096 2024-09-19T08:12:53.891 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4193280 len 8192 2024-09-19T08:12:53.891 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4193280 len 8192 2024-09-19T08:12:53.891 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4193280 len 8192 2024-09-19T08:12:53.891 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4193280 len 8192 2024-09-19T08:12:53.891 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4193280 len 16384 2024-09-19T08:12:53.892 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4193280 len 16384 2024-09-19T08:12:53.892 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4193280 len 16384 2024-09-19T08:12:53.892 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4193280 len 16384 2024-09-19T08:12:53.892 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4193792 len 1024 2024-09-19T08:12:53.892 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4193792 len 1024 2024-09-19T08:12:53.892 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4193792 len 1024 2024-09-19T08:12:53.892 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4193792 len 1024 2024-09-19T08:12:53.892 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4193792 len 2048 2024-09-19T08:12:53.892 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4193792 len 2048 2024-09-19T08:12:53.892 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4193792 len 2048 2024-09-19T08:12:53.892 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4193792 len 2048 2024-09-19T08:12:53.892 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4193792 len 4096 2024-09-19T08:12:53.892 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4193792 len 4096 2024-09-19T08:12:53.892 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4193792 len 4096 2024-09-19T08:12:53.893 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4193792 len 4096 2024-09-19T08:12:53.893 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4193792 len 8192 2024-09-19T08:12:53.893 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4193792 len 8192 2024-09-19T08:12:53.893 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4193792 len 8192 2024-09-19T08:12:53.893 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4193792 len 8192 2024-09-19T08:12:53.893 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4193792 len 16384 2024-09-19T08:12:53.893 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4193792 len 16384 2024-09-19T08:12:53.893 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4193792 len 16384 2024-09-19T08:12:53.893 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4193792 len 16384 2024-09-19T08:12:53.893 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4194304 len 1024 2024-09-19T08:12:53.893 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4194304 len 1024 2024-09-19T08:12:53.893 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4194304 len 1024 2024-09-19T08:12:53.893 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4194304 len 1024 2024-09-19T08:12:53.894 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4194304 len 2048 2024-09-19T08:12:53.894 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4194304 len 2048 2024-09-19T08:12:53.894 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4194304 len 2048 2024-09-19T08:12:53.894 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4194304 len 2048 2024-09-19T08:12:53.894 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4194304 len 4096 2024-09-19T08:12:53.894 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4194304 len 4096 2024-09-19T08:12:53.894 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4194304 len 4096 2024-09-19T08:12:53.894 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4194304 len 4096 2024-09-19T08:12:53.894 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4194304 len 8192 2024-09-19T08:12:53.894 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4194304 len 8192 2024-09-19T08:12:53.894 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4194304 len 8192 2024-09-19T08:12:53.898 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4194304 len 8192 2024-09-19T08:12:53.898 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4194304 len 16384 2024-09-19T08:12:53.898 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4194304 len 16384 2024-09-19T08:12:53.898 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4194304 len 16384 2024-09-19T08:12:53.898 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4194304 len 16384 2024-09-19T08:12:53.898 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4194816 len 1024 2024-09-19T08:12:53.898 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4194816 len 1024 2024-09-19T08:12:53.898 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4194816 len 1024 2024-09-19T08:12:53.898 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4194816 len 1024 2024-09-19T08:12:53.898 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4194816 len 2048 2024-09-19T08:12:53.898 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4194816 len 2048 2024-09-19T08:12:53.899 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4194816 len 2048 2024-09-19T08:12:53.899 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4194816 len 2048 2024-09-19T08:12:53.899 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4194816 len 4096 2024-09-19T08:12:53.899 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4194816 len 4096 2024-09-19T08:12:53.899 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4194816 len 4096 2024-09-19T08:12:53.899 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4194816 len 4096 2024-09-19T08:12:53.899 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4194816 len 8192 2024-09-19T08:12:53.899 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4194816 len 8192 2024-09-19T08:12:53.899 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4194816 len 8192 2024-09-19T08:12:53.899 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4194816 len 8192 2024-09-19T08:12:53.899 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4194816 len 16384 2024-09-19T08:12:53.899 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4194816 len 16384 2024-09-19T08:12:53.899 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4194816 len 16384 2024-09-19T08:12:53.900 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4194816 len 16384 2024-09-19T08:12:53.900 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4195328 len 1024 2024-09-19T08:12:53.900 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4195328 len 1024 2024-09-19T08:12:53.900 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4195328 len 1024 2024-09-19T08:12:53.900 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4195328 len 1024 2024-09-19T08:12:53.900 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4195328 len 2048 2024-09-19T08:12:53.900 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4195328 len 2048 2024-09-19T08:12:53.900 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4195328 len 2048 2024-09-19T08:12:53.900 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4195328 len 2048 2024-09-19T08:12:53.900 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4195328 len 4096 2024-09-19T08:12:53.900 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4195328 len 4096 2024-09-19T08:12:53.900 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4195328 len 4096 2024-09-19T08:12:53.900 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4195328 len 4096 2024-09-19T08:12:53.901 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4195328 len 8192 2024-09-19T08:12:53.901 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4195328 len 8192 2024-09-19T08:12:53.901 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4195328 len 8192 2024-09-19T08:12:53.901 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4195328 len 8192 2024-09-19T08:12:53.901 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4195328 len 16384 2024-09-19T08:12:53.901 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4195328 len 16384 2024-09-19T08:12:53.901 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4195328 len 16384 2024-09-19T08:12:53.901 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4195328 len 16384 2024-09-19T08:12:53.901 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4195840 len 1024 2024-09-19T08:12:53.901 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4195840 len 1024 2024-09-19T08:12:53.901 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4195840 len 1024 2024-09-19T08:12:53.901 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4195840 len 1024 2024-09-19T08:12:53.901 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4195840 len 2048 2024-09-19T08:12:53.902 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4195840 len 2048 2024-09-19T08:12:53.902 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4195840 len 2048 2024-09-19T08:12:53.902 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4195840 len 2048 2024-09-19T08:12:53.902 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4195840 len 4096 2024-09-19T08:12:53.902 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4195840 len 4096 2024-09-19T08:12:53.902 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4195840 len 4096 2024-09-19T08:12:53.902 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4195840 len 4096 2024-09-19T08:12:53.902 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4195840 len 8192 2024-09-19T08:12:53.902 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4195840 len 8192 2024-09-19T08:12:53.902 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4195840 len 8192 2024-09-19T08:12:53.902 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4195840 len 8192 2024-09-19T08:12:53.902 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4195840 len 16384 2024-09-19T08:12:53.902 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4195840 len 16384 2024-09-19T08:12:53.903 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4195840 len 16384 2024-09-19T08:12:53.903 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4195840 len 16384 2024-09-19T08:12:53.903 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4196352 len 1024 2024-09-19T08:12:53.903 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4196352 len 1024 2024-09-19T08:12:53.903 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4196352 len 1024 2024-09-19T08:12:53.903 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4196352 len 1024 2024-09-19T08:12:53.903 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4196352 len 2048 2024-09-19T08:12:53.903 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4196352 len 2048 2024-09-19T08:12:53.903 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4196352 len 2048 2024-09-19T08:12:53.903 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4196352 len 2048 2024-09-19T08:12:53.903 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4196352 len 4096 2024-09-19T08:12:53.903 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4196352 len 4096 2024-09-19T08:12:53.903 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4196352 len 4096 2024-09-19T08:12:53.903 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4196352 len 4096 2024-09-19T08:12:53.904 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4196352 len 8192 2024-09-19T08:12:53.904 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4196352 len 8192 2024-09-19T08:12:53.904 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4196352 len 8192 2024-09-19T08:12:53.904 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4196352 len 8192 2024-09-19T08:12:53.904 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4196352 len 16384 2024-09-19T08:12:54.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.008+0000 7f651a13e640 1 -- 172.21.15.27:0/3406077616 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6514102810 con 0x7f6514100aa0 2024-09-19T08:12:54.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.009+0000 7f6510ff9640 1 -- 172.21.15.27:0/3406077616 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f650809c640 con 0x7f6514100aa0 2024-09-19T08:12:54.010 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:12:54.010 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:12:54.010 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:12:54.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.011+0000 7f651a13e640 1 -- 172.21.15.27:0/3406077616 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f64fc0a33b0 msgr2=0x7f64fc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:54.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.011+0000 7f651a13e640 1 --2- 172.21.15.27:0/3406077616 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f64fc0a33b0 0x7f64fc0a5870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6504011440 tx=0x7f6504005f90 comp rx=0 tx=0).stop 2024-09-19T08:12:54.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.011+0000 7f651a13e640 1 -- 172.21.15.27:0/3406077616 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6514100aa0 msgr2=0x7f6514101820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:54.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.011+0000 7f651a13e640 1 --2- 172.21.15.27:0/3406077616 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6514100aa0 0x7f6514101820 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6508005fd0 tx=0x7f650800dde0 comp rx=0 tx=0).stop 2024-09-19T08:12:54.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.011+0000 7f651a13e640 1 -- 172.21.15.27:0/3406077616 shutdown_connections 2024-09-19T08:12:54.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.011+0000 7f651a13e640 1 --2- 172.21.15.27:0/3406077616 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f64fc0a33b0 0x7f64fc0a5870 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:54.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.011+0000 7f651a13e640 1 --2- 172.21.15.27:0/3406077616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6514106b80 0x7f6514101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:54.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.011+0000 7f651a13e640 1 --2- 172.21.15.27:0/3406077616 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6514100aa0 0x7f6514101820 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:54.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.011+0000 7f651a13e640 1 --2- 172.21.15.27:0/3406077616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6514100100 0x7f65141012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:54.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.011+0000 7f651a13e640 1 -- 172.21.15.27:0/3406077616 >> 172.21.15.27:0/3406077616 conn(0x7f6514077230 msgr2=0x7f65140fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:54.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.011+0000 7f651a13e640 1 -- 172.21.15.27:0/3406077616 shutdown_connections 2024-09-19T08:12:54.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.011+0000 7f651a13e640 1 -- 172.21.15.27:0/3406077616 wait complete. 2024-09-19T08:12:54.116 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4196352 len 16384 2024-09-19T08:12:54.116 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4196352 len 16384 2024-09-19T08:12:54.117 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4196352 len 16384 2024-09-19T08:12:54.117 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4196864 len 1024 2024-09-19T08:12:54.117 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4196864 len 1024 2024-09-19T08:12:54.117 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4196864 len 1024 2024-09-19T08:12:54.117 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4196864 len 1024 2024-09-19T08:12:54.117 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4196864 len 2048 2024-09-19T08:12:54.117 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4196864 len 2048 2024-09-19T08:12:54.117 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4196864 len 2048 2024-09-19T08:12:54.117 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4196864 len 2048 2024-09-19T08:12:54.117 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4196864 len 4096 2024-09-19T08:12:54.117 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4196864 len 4096 2024-09-19T08:12:54.117 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4196864 len 4096 2024-09-19T08:12:54.118 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4196864 len 4096 2024-09-19T08:12:54.118 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4196864 len 8192 2024-09-19T08:12:54.118 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4196864 len 8192 2024-09-19T08:12:54.118 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4196864 len 8192 2024-09-19T08:12:54.118 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4196864 len 8192 2024-09-19T08:12:54.118 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4196864 len 16384 2024-09-19T08:12:54.118 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4196864 len 16384 2024-09-19T08:12:54.118 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4196864 len 16384 2024-09-19T08:12:54.118 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4196864 len 16384 2024-09-19T08:12:54.118 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4197376 len 1024 2024-09-19T08:12:54.118 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4197376 len 1024 2024-09-19T08:12:54.118 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4197376 len 1024 2024-09-19T08:12:54.118 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4197376 len 1024 2024-09-19T08:12:54.118 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4197376 len 2048 2024-09-19T08:12:54.119 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4197376 len 2048 2024-09-19T08:12:54.119 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4197376 len 2048 2024-09-19T08:12:54.119 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4197376 len 2048 2024-09-19T08:12:54.119 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4197376 len 4096 2024-09-19T08:12:54.119 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4197376 len 4096 2024-09-19T08:12:54.119 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4197376 len 4096 2024-09-19T08:12:54.119 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4197376 len 4096 2024-09-19T08:12:54.119 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4197376 len 8192 2024-09-19T08:12:54.119 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4197376 len 8192 2024-09-19T08:12:54.119 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4197376 len 8192 2024-09-19T08:12:54.119 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4197376 len 8192 2024-09-19T08:12:54.119 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4197376 len 16384 2024-09-19T08:12:54.119 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4197376 len 16384 2024-09-19T08:12:54.119 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4197376 len 16384 2024-09-19T08:12:54.120 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4197376 len 16384 2024-09-19T08:12:54.120 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4197888 len 1024 2024-09-19T08:12:54.120 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4197888 len 1024 2024-09-19T08:12:54.120 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4197888 len 1024 2024-09-19T08:12:54.120 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4197888 len 1024 2024-09-19T08:12:54.120 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4197888 len 2048 2024-09-19T08:12:54.120 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4197888 len 2048 2024-09-19T08:12:54.120 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4197888 len 2048 2024-09-19T08:12:54.120 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4197888 len 2048 2024-09-19T08:12:54.120 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4197888 len 4096 2024-09-19T08:12:54.120 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4197888 len 4096 2024-09-19T08:12:54.120 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4197888 len 4096 2024-09-19T08:12:54.120 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4197888 len 4096 2024-09-19T08:12:54.121 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4197888 len 8192 2024-09-19T08:12:54.121 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4197888 len 8192 2024-09-19T08:12:54.121 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4197888 len 8192 2024-09-19T08:12:54.121 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4197888 len 8192 2024-09-19T08:12:54.121 INFO:tasks.workunit.client.0.smithi027.stdout:read_direct buf_align 3584 offset 4197888 len 16384 2024-09-19T08:12:54.121 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4197888 len 16384 2024-09-19T08:12:54.121 INFO:tasks.workunit.client.0.smithi027.stdout:read_sync buf_align 3584 offset 4197888 len 16384 2024-09-19T08:12:54.121 INFO:tasks.workunit.client.0.smithi027.stdout:read_file buf_align 3584 offset 4197888 len 16384 2024-09-19T08:12:54.121 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4190720 len 1024 2024-09-19T08:12:54.121 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4190720 len 1024 2024-09-19T08:12:54.122 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4190720 len 1024 2024-09-19T08:12:54.122 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4190720 len 1024 2024-09-19T08:12:54.122 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4190720 len 2048 2024-09-19T08:12:54.122 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4190720 len 2048 2024-09-19T08:12:54.122 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4190720 len 2048 2024-09-19T08:12:54.122 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4190720 len 2048 2024-09-19T08:12:54.122 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4190720 len 4096 2024-09-19T08:12:54.122 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4190720 len 4096 2024-09-19T08:12:54.122 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4190720 len 4096 2024-09-19T08:12:54.122 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4190720 len 4096 2024-09-19T08:12:54.122 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4190720 len 8192 2024-09-19T08:12:54.122 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4190720 len 8192 2024-09-19T08:12:54.122 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4190720 len 8192 2024-09-19T08:12:54.122 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4190720 len 8192 2024-09-19T08:12:54.123 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4190720 len 16384 2024-09-19T08:12:54.123 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4190720 len 16384 2024-09-19T08:12:54.123 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4190720 len 16384 2024-09-19T08:12:54.123 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4190720 len 16384 2024-09-19T08:12:54.123 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4191232 len 1024 2024-09-19T08:12:54.402 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:54 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3406077616' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:12:54.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:54 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3406077616' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:12:54.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:54 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3406077616' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:12:54.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.498+0000 7ff17965c640 1 -- 172.21.15.27:0/652859464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff174101de0 msgr2=0x7ff1741021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:54.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.498+0000 7ff17965c640 1 --2- 172.21.15.27:0/652859464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff174101de0 0x7ff1741021c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff164009900 tx=0x7ff16402a410 comp rx=0 tx=0).stop 2024-09-19T08:12:54.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.498+0000 7ff17965c640 1 -- 172.21.15.27:0/652859464 shutdown_connections 2024-09-19T08:12:54.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.498+0000 7ff17965c640 1 --2- 172.21.15.27:0/652859464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff174106f10 0x7ff17410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:54.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.498+0000 7ff17965c640 1 --2- 172.21.15.27:0/652859464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff174102790 0x7ff1741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:54.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.498+0000 7ff17965c640 1 --2- 172.21.15.27:0/652859464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff174101de0 0x7ff1741021c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:54.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.498+0000 7ff17965c640 1 -- 172.21.15.27:0/652859464 >> 172.21.15.27:0/652859464 conn(0x7ff1740fd880 msgr2=0x7ff1740ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:54.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.498+0000 7ff17965c640 1 -- 172.21.15.27:0/652859464 shutdown_connections 2024-09-19T08:12:54.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.498+0000 7ff17965c640 1 -- 172.21.15.27:0/652859464 wait complete. 2024-09-19T08:12:54.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.498+0000 7ff17965c640 1 Processor -- start 2024-09-19T08:12:54.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.499+0000 7ff17965c640 1 -- start start 2024-09-19T08:12:54.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.499+0000 7ff17965c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff174101de0 0x7ff1740744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:54.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.499+0000 7ff17965c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff174102790 0x7ff174074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:54.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.499+0000 7ff17965c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff174106f10 0x7ff174074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:54.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.499+0000 7ff17965c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff174111f30 con 0x7ff174102790 2024-09-19T08:12:54.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.499+0000 7ff17965c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff174111db0 con 0x7ff174101de0 2024-09-19T08:12:54.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.499+0000 7ff17965c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff1741120b0 con 0x7ff174106f10 2024-09-19T08:12:54.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.499+0000 7ff1727fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff174102790 0x7ff174074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:54.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.499+0000 7ff172ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff174101de0 0x7ff1740744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:54.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.499+0000 7ff1727fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff174102790 0x7ff174074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46018/0 (socket says 172.21.15.27:46018) 2024-09-19T08:12:54.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.499+0000 7ff1727fc640 1 -- 172.21.15.27:0/4054860105 learned_addr learned my addr 172.21.15.27:0/4054860105 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:54.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.499+0000 7ff1737fe640 1 --2- 172.21.15.27:0/4054860105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff174106f10 0x7ff174074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:54.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.499+0000 7ff172ffd640 1 -- 172.21.15.27:0/4054860105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff174106f10 msgr2=0x7ff174074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:54.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.500+0000 7ff172ffd640 1 --2- 172.21.15.27:0/4054860105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff174106f10 0x7ff174074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:54.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.500+0000 7ff172ffd640 1 -- 172.21.15.27:0/4054860105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff174102790 msgr2=0x7ff174074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:54.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.500+0000 7ff172ffd640 1 --2- 172.21.15.27:0/4054860105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff174102790 0x7ff174074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:54.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.500+0000 7ff172ffd640 1 -- 172.21.15.27:0/4054860105 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1741a68c0 con 0x7ff174101de0 2024-09-19T08:12:54.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.500+0000 7ff1737fe640 1 --2- 172.21.15.27:0/4054860105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff174106f10 0x7ff174074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:12:54.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.500+0000 7ff1727fc640 1 --2- 172.21.15.27:0/4054860105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff174102790 0x7ff174074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:12:54.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.500+0000 7ff172ffd640 1 --2- 172.21.15.27:0/4054860105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff174101de0 0x7ff1740744f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff164005940 tx=0x7ff1640040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:54.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.500+0000 7ff15bfff640 1 -- 172.21.15.27:0/4054860105 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16403f030 con 0x7ff174101de0 2024-09-19T08:12:54.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.500+0000 7ff15bfff640 1 -- 172.21.15.27:0/4054860105 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1640044c0 con 0x7ff174101de0 2024-09-19T08:12:54.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.500+0000 7ff17965c640 1 -- 172.21.15.27:0/4054860105 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1741a6b50 con 0x7ff174101de0 2024-09-19T08:12:54.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.500+0000 7ff15bfff640 1 -- 172.21.15.27:0/4054860105 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff164035070 con 0x7ff174101de0 2024-09-19T08:12:54.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.500+0000 7ff17965c640 1 -- 172.21.15.27:0/4054860105 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1741a7030 con 0x7ff174101de0 2024-09-19T08:12:54.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.501+0000 7ff17965c640 1 -- 172.21.15.27:0/4054860105 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1741021c0 con 0x7ff174101de0 2024-09-19T08:12:54.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.502+0000 7ff15bfff640 1 -- 172.21.15.27:0/4054860105 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff164042030 con 0x7ff174101de0 2024-09-19T08:12:54.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.503+0000 7ff15bfff640 1 --2- 172.21.15.27:0/4054860105 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff15c0a33b0 0x7ff15c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:54.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.503+0000 7ff15bfff640 1 -- 172.21.15.27:0/4054860105 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff1640f0230 con 0x7ff174101de0 2024-09-19T08:12:54.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.503+0000 7ff1727fc640 1 --2- 172.21.15.27:0/4054860105 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff15c0a33b0 0x7ff15c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:54.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.504+0000 7ff1727fc640 1 --2- 172.21.15.27:0/4054860105 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff15c0a33b0 0x7ff15c0a5870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff174075f80 tx=0x7ff168005f90 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:54.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.506+0000 7ff15bfff640 1 -- 172.21.15.27:0/4054860105 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff1640bc610 con 0x7ff174101de0 2024-09-19T08:12:54.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.741+0000 7ff17965c640 1 -- 172.21.15.27:0/4054860105 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff174075a20 con 0x7ff174101de0 2024-09-19T08:12:54.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.742+0000 7ff15bfff640 1 -- 172.21.15.27:0/4054860105 <== mon.2 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7ff1640c0910 con 0x7ff174101de0 2024-09-19T08:12:54.743 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:12:54.743 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:12:54.743 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:12:54.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.744+0000 7ff17965c640 1 -- 172.21.15.27:0/4054860105 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff15c0a33b0 msgr2=0x7ff15c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:54.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.744+0000 7ff17965c640 1 --2- 172.21.15.27:0/4054860105 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff15c0a33b0 0x7ff15c0a5870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff174075f80 tx=0x7ff168005f90 comp rx=0 tx=0).stop 2024-09-19T08:12:54.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.744+0000 7ff17965c640 1 -- 172.21.15.27:0/4054860105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff174101de0 msgr2=0x7ff1740744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:54.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.744+0000 7ff17965c640 1 --2- 172.21.15.27:0/4054860105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff174101de0 0x7ff1740744f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff164005940 tx=0x7ff1640040c0 comp rx=0 tx=0).stop 2024-09-19T08:12:54.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.744+0000 7ff17965c640 1 -- 172.21.15.27:0/4054860105 shutdown_connections 2024-09-19T08:12:54.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.744+0000 7ff17965c640 1 --2- 172.21.15.27:0/4054860105 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff15c0a33b0 0x7ff15c0a5870 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:54.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.744+0000 7ff17965c640 1 --2- 172.21.15.27:0/4054860105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff174106f10 0x7ff174074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:54.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.744+0000 7ff17965c640 1 --2- 172.21.15.27:0/4054860105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff174102790 0x7ff174074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:54.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.744+0000 7ff17965c640 1 --2- 172.21.15.27:0/4054860105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff174101de0 0x7ff1740744f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:54.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.744+0000 7ff17965c640 1 -- 172.21.15.27:0/4054860105 >> 172.21.15.27:0/4054860105 conn(0x7ff1740fd880 msgr2=0x7ff1740fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:54.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.744+0000 7ff17965c640 1 -- 172.21.15.27:0/4054860105 shutdown_connections 2024-09-19T08:12:54.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:54.745+0000 7ff17965c640 1 -- 172.21.15.27:0/4054860105 wait complete. 2024-09-19T08:12:54.853 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4191232 len 1024 2024-09-19T08:12:54.853 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4191232 len 1024 2024-09-19T08:12:54.853 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4191232 len 1024 2024-09-19T08:12:54.853 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4191232 len 2048 2024-09-19T08:12:54.853 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4191232 len 2048 2024-09-19T08:12:54.853 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4191232 len 2048 2024-09-19T08:12:54.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4191232 len 2048 2024-09-19T08:12:54.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4191232 len 4096 2024-09-19T08:12:54.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4191232 len 4096 2024-09-19T08:12:54.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4191232 len 4096 2024-09-19T08:12:54.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4191232 len 4096 2024-09-19T08:12:54.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4191232 len 8192 2024-09-19T08:12:54.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4191232 len 8192 2024-09-19T08:12:54.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4191232 len 8192 2024-09-19T08:12:54.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4191232 len 8192 2024-09-19T08:12:54.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4191232 len 16384 2024-09-19T08:12:54.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4191232 len 16384 2024-09-19T08:12:54.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4191232 len 16384 2024-09-19T08:12:54.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4191232 len 16384 2024-09-19T08:12:54.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4191744 len 1024 2024-09-19T08:12:54.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4191744 len 1024 2024-09-19T08:12:54.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4191744 len 1024 2024-09-19T08:12:54.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4191744 len 1024 2024-09-19T08:12:54.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4191744 len 2048 2024-09-19T08:12:54.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4191744 len 2048 2024-09-19T08:12:54.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4191744 len 2048 2024-09-19T08:12:54.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4191744 len 2048 2024-09-19T08:12:54.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4191744 len 4096 2024-09-19T08:12:54.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4191744 len 4096 2024-09-19T08:12:54.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4191744 len 4096 2024-09-19T08:12:54.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4191744 len 4096 2024-09-19T08:12:54.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4191744 len 8192 2024-09-19T08:12:54.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4191744 len 8192 2024-09-19T08:12:54.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4191744 len 8192 2024-09-19T08:12:54.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4191744 len 8192 2024-09-19T08:12:54.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4191744 len 16384 2024-09-19T08:12:54.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4191744 len 16384 2024-09-19T08:12:54.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4191744 len 16384 2024-09-19T08:12:54.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4191744 len 16384 2024-09-19T08:12:54.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4192256 len 1024 2024-09-19T08:12:54.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4192256 len 1024 2024-09-19T08:12:54.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4192256 len 1024 2024-09-19T08:12:54.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4192256 len 1024 2024-09-19T08:12:54.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4192256 len 2048 2024-09-19T08:12:54.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4192256 len 2048 2024-09-19T08:12:54.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4192256 len 2048 2024-09-19T08:12:54.857 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4192256 len 2048 2024-09-19T08:12:54.857 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4192256 len 4096 2024-09-19T08:12:54.857 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4192256 len 4096 2024-09-19T08:12:54.857 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4192256 len 4096 2024-09-19T08:12:54.857 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4192256 len 4096 2024-09-19T08:12:54.857 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4192256 len 8192 2024-09-19T08:12:54.857 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4192256 len 8192 2024-09-19T08:12:54.857 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4192256 len 8192 2024-09-19T08:12:54.859 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4192256 len 8192 2024-09-19T08:12:54.859 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4192256 len 16384 2024-09-19T08:12:54.859 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4192256 len 16384 2024-09-19T08:12:54.859 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4192256 len 16384 2024-09-19T08:12:54.859 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4192256 len 16384 2024-09-19T08:12:54.859 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4192768 len 1024 2024-09-19T08:12:54.859 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4192768 len 1024 2024-09-19T08:12:54.859 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4192768 len 1024 2024-09-19T08:12:54.859 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4192768 len 1024 2024-09-19T08:12:54.859 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4192768 len 2048 2024-09-19T08:12:54.859 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4192768 len 2048 2024-09-19T08:12:54.859 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4192768 len 2048 2024-09-19T08:12:54.860 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4192768 len 2048 2024-09-19T08:12:54.860 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4192768 len 4096 2024-09-19T08:12:54.860 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4192768 len 4096 2024-09-19T08:12:54.860 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4192768 len 4096 2024-09-19T08:12:54.860 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4192768 len 4096 2024-09-19T08:12:54.860 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4192768 len 8192 2024-09-19T08:12:54.860 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4192768 len 8192 2024-09-19T08:12:54.860 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4192768 len 8192 2024-09-19T08:12:54.860 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4192768 len 8192 2024-09-19T08:12:54.860 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4192768 len 16384 2024-09-19T08:12:54.860 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4192768 len 16384 2024-09-19T08:12:54.860 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4192768 len 16384 2024-09-19T08:12:54.860 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4192768 len 16384 2024-09-19T08:12:54.861 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4193280 len 1024 2024-09-19T08:12:54.861 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4193280 len 1024 2024-09-19T08:12:54.861 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4193280 len 1024 2024-09-19T08:12:54.861 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4193280 len 1024 2024-09-19T08:12:54.861 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4193280 len 2048 2024-09-19T08:12:54.861 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4193280 len 2048 2024-09-19T08:12:54.861 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4193280 len 2048 2024-09-19T08:12:55.055 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24482 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T08:12:55.055 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24482 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T08:12:55.375 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4193280 len 2048 2024-09-19T08:12:55.375 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4193280 len 4096 2024-09-19T08:12:55.375 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4193280 len 4096 2024-09-19T08:12:55.375 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4193280 len 4096 2024-09-19T08:12:55.375 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4193280 len 4096 2024-09-19T08:12:55.375 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4193280 len 8192 2024-09-19T08:12:55.375 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4193280 len 8192 2024-09-19T08:12:55.375 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4193280 len 8192 2024-09-19T08:12:55.375 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4193280 len 8192 2024-09-19T08:12:55.375 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4193280 len 16384 2024-09-19T08:12:55.376 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4193280 len 16384 2024-09-19T08:12:55.376 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4193280 len 16384 2024-09-19T08:12:55.376 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4193280 len 16384 2024-09-19T08:12:55.376 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4193792 len 1024 2024-09-19T08:12:55.376 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4193792 len 1024 2024-09-19T08:12:55.376 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4193792 len 1024 2024-09-19T08:12:55.376 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4193792 len 1024 2024-09-19T08:12:55.376 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4193792 len 2048 2024-09-19T08:12:55.376 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4193792 len 2048 2024-09-19T08:12:55.376 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4193792 len 2048 2024-09-19T08:12:55.376 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4193792 len 2048 2024-09-19T08:12:55.376 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4193792 len 4096 2024-09-19T08:12:55.376 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4193792 len 4096 2024-09-19T08:12:55.377 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4193792 len 4096 2024-09-19T08:12:55.377 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4193792 len 4096 2024-09-19T08:12:55.377 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4193792 len 8192 2024-09-19T08:12:55.377 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4193792 len 8192 2024-09-19T08:12:55.377 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4193792 len 8192 2024-09-19T08:12:55.377 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4193792 len 8192 2024-09-19T08:12:55.377 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4193792 len 16384 2024-09-19T08:12:55.377 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4193792 len 16384 2024-09-19T08:12:55.377 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4193792 len 16384 2024-09-19T08:12:55.377 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4193792 len 16384 2024-09-19T08:12:55.377 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4194304 len 1024 2024-09-19T08:12:55.377 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4194304 len 1024 2024-09-19T08:12:55.377 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4194304 len 1024 2024-09-19T08:12:55.378 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4194304 len 1024 2024-09-19T08:12:55.378 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4194304 len 2048 2024-09-19T08:12:55.378 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4194304 len 2048 2024-09-19T08:12:55.378 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4194304 len 2048 2024-09-19T08:12:55.378 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4194304 len 2048 2024-09-19T08:12:55.378 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4194304 len 4096 2024-09-19T08:12:55.378 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4194304 len 4096 2024-09-19T08:12:55.378 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4194304 len 4096 2024-09-19T08:12:55.378 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4194304 len 4096 2024-09-19T08:12:55.378 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4194304 len 8192 2024-09-19T08:12:55.378 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4194304 len 8192 2024-09-19T08:12:55.379 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4194304 len 8192 2024-09-19T08:12:55.379 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4194304 len 8192 2024-09-19T08:12:55.379 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4194304 len 16384 2024-09-19T08:12:55.379 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4194304 len 16384 2024-09-19T08:12:55.379 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4194304 len 16384 2024-09-19T08:12:55.379 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4194304 len 16384 2024-09-19T08:12:55.379 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4194816 len 1024 2024-09-19T08:12:55.379 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4194816 len 1024 2024-09-19T08:12:55.379 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4194816 len 1024 2024-09-19T08:12:55.379 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4194816 len 1024 2024-09-19T08:12:55.379 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4194816 len 2048 2024-09-19T08:12:55.379 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4194816 len 2048 2024-09-19T08:12:55.379 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4194816 len 2048 2024-09-19T08:12:55.380 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4194816 len 2048 2024-09-19T08:12:55.380 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4194816 len 4096 2024-09-19T08:12:55.380 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4194816 len 4096 2024-09-19T08:12:55.380 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4194816 len 4096 2024-09-19T08:12:55.380 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4194816 len 4096 2024-09-19T08:12:55.380 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4194816 len 8192 2024-09-19T08:12:55.380 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4194816 len 8192 2024-09-19T08:12:55.380 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4194816 len 8192 2024-09-19T08:12:55.380 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4194816 len 8192 2024-09-19T08:12:55.380 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4194816 len 16384 2024-09-19T08:12:55.380 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4194816 len 16384 2024-09-19T08:12:55.380 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4194816 len 16384 2024-09-19T08:12:55.380 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4194816 len 16384 2024-09-19T08:12:55.381 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4195328 len 1024 2024-09-19T08:12:55.381 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4195328 len 1024 2024-09-19T08:12:55.381 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4195328 len 1024 2024-09-19T08:12:55.381 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4195328 len 1024 2024-09-19T08:12:55.381 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4195328 len 2048 2024-09-19T08:12:55.381 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4195328 len 2048 2024-09-19T08:12:55.381 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4195328 len 2048 2024-09-19T08:12:55.381 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4195328 len 2048 2024-09-19T08:12:55.381 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4195328 len 4096 2024-09-19T08:12:55.381 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4195328 len 4096 2024-09-19T08:12:55.381 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4195328 len 4096 2024-09-19T08:12:55.381 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4195328 len 4096 2024-09-19T08:12:55.388 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:55 smithi155 ceph-mon[35362]: pgmap v59: 97 pgs: 97 active+clean; 1.9 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.1 KiB/s wr, 695 op/s 2024-09-19T08:12:55.388 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:55 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/4054860105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:12:55.429 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:55 smithi027 ceph-mon[31209]: pgmap v59: 97 pgs: 97 active+clean; 1.9 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.1 KiB/s wr, 695 op/s 2024-09-19T08:12:55.429 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:55 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/4054860105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:12:55.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:55 smithi203 ceph-mon[35198]: pgmap v59: 97 pgs: 97 active+clean; 1.9 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.1 KiB/s wr, 695 op/s 2024-09-19T08:12:55.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:55 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/4054860105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:12:55.763 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4195328 len 8192 2024-09-19T08:12:55.763 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4195328 len 8192 2024-09-19T08:12:55.763 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4195328 len 8192 2024-09-19T08:12:55.763 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4195328 len 8192 2024-09-19T08:12:55.763 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4195328 len 16384 2024-09-19T08:12:55.763 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4195328 len 16384 2024-09-19T08:12:55.763 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4195328 len 16384 2024-09-19T08:12:55.763 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4195328 len 16384 2024-09-19T08:12:55.764 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4195840 len 1024 2024-09-19T08:12:55.764 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4195840 len 1024 2024-09-19T08:12:55.764 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4195840 len 1024 2024-09-19T08:12:55.764 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4195840 len 1024 2024-09-19T08:12:55.764 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4195840 len 2048 2024-09-19T08:12:55.764 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4195840 len 2048 2024-09-19T08:12:55.764 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4195840 len 2048 2024-09-19T08:12:55.764 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4195840 len 2048 2024-09-19T08:12:55.764 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4195840 len 4096 2024-09-19T08:12:55.764 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4195840 len 4096 2024-09-19T08:12:55.764 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4195840 len 4096 2024-09-19T08:12:55.764 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4195840 len 4096 2024-09-19T08:12:55.764 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4195840 len 8192 2024-09-19T08:12:55.765 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4195840 len 8192 2024-09-19T08:12:55.765 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4195840 len 8192 2024-09-19T08:12:55.765 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4195840 len 8192 2024-09-19T08:12:55.765 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4195840 len 16384 2024-09-19T08:12:55.765 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4195840 len 16384 2024-09-19T08:12:55.765 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4195840 len 16384 2024-09-19T08:12:55.765 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4195840 len 16384 2024-09-19T08:12:55.765 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4196352 len 1024 2024-09-19T08:12:55.765 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4196352 len 1024 2024-09-19T08:12:55.765 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4196352 len 1024 2024-09-19T08:12:55.765 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4196352 len 1024 2024-09-19T08:12:55.765 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4196352 len 2048 2024-09-19T08:12:55.765 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4196352 len 2048 2024-09-19T08:12:55.765 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4196352 len 2048 2024-09-19T08:12:55.766 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4196352 len 2048 2024-09-19T08:12:55.766 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4196352 len 4096 2024-09-19T08:12:55.766 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4196352 len 4096 2024-09-19T08:12:55.766 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4196352 len 4096 2024-09-19T08:12:55.766 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4196352 len 4096 2024-09-19T08:12:55.766 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4196352 len 8192 2024-09-19T08:12:55.766 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4196352 len 8192 2024-09-19T08:12:55.766 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4196352 len 8192 2024-09-19T08:12:55.766 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4196352 len 8192 2024-09-19T08:12:55.766 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4196352 len 16384 2024-09-19T08:12:55.766 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4196352 len 16384 2024-09-19T08:12:55.766 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4196352 len 16384 2024-09-19T08:12:55.766 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4196352 len 16384 2024-09-19T08:12:55.767 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4196864 len 1024 2024-09-19T08:12:55.767 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4196864 len 1024 2024-09-19T08:12:55.767 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4196864 len 1024 2024-09-19T08:12:55.767 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4196864 len 1024 2024-09-19T08:12:55.767 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4196864 len 2048 2024-09-19T08:12:55.767 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4196864 len 2048 2024-09-19T08:12:55.767 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4196864 len 2048 2024-09-19T08:12:55.767 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4196864 len 2048 2024-09-19T08:12:55.767 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4196864 len 4096 2024-09-19T08:12:55.767 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4196864 len 4096 2024-09-19T08:12:55.767 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4196864 len 4096 2024-09-19T08:12:55.767 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4196864 len 4096 2024-09-19T08:12:55.767 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4196864 len 8192 2024-09-19T08:12:55.767 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4196864 len 8192 2024-09-19T08:12:55.767 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4196864 len 8192 2024-09-19T08:12:55.768 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4196864 len 8192 2024-09-19T08:12:55.768 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4196864 len 16384 2024-09-19T08:12:55.768 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4196864 len 16384 2024-09-19T08:12:55.768 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4196864 len 16384 2024-09-19T08:12:55.768 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4196864 len 16384 2024-09-19T08:12:55.768 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4197376 len 1024 2024-09-19T08:12:55.768 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4197376 len 1024 2024-09-19T08:12:55.768 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4197376 len 1024 2024-09-19T08:12:55.768 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4197376 len 1024 2024-09-19T08:12:55.768 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4197376 len 2048 2024-09-19T08:12:55.768 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4197376 len 2048 2024-09-19T08:12:55.768 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4197376 len 2048 2024-09-19T08:12:55.769 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4197376 len 2048 2024-09-19T08:12:55.769 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4197376 len 4096 2024-09-19T08:12:55.769 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4197376 len 4096 2024-09-19T08:12:55.769 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4197376 len 4096 2024-09-19T08:12:55.769 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4197376 len 4096 2024-09-19T08:12:55.769 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4197376 len 8192 2024-09-19T08:12:55.769 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4197376 len 8192 2024-09-19T08:12:55.769 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4197376 len 8192 2024-09-19T08:12:55.769 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4197376 len 8192 2024-09-19T08:12:55.769 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4197376 len 16384 2024-09-19T08:12:55.769 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4197376 len 16384 2024-09-19T08:12:55.771 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:12:55.773 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:12:56.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.320+0000 7fbcfcb5a640 1 -- 172.21.15.27:0/412717958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcf8102ef0 msgr2=0x7fbcf810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:56.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.320+0000 7fbcfcb5a640 1 --2- 172.21.15.27:0/412717958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcf8102ef0 0x7fbcf810da40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0009ca0 tx=0x7fbcf002a950 comp rx=0 tx=0).stop 2024-09-19T08:12:56.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.320+0000 7fbcfcb5a640 1 -- 172.21.15.27:0/412717958 shutdown_connections 2024-09-19T08:12:56.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.320+0000 7fbcfcb5a640 1 --2- 172.21.15.27:0/412717958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcf8102ef0 0x7fbcf810da40 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.320+0000 7fbcfcb5a640 1 --2- 172.21.15.27:0/412717958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcf8102570 0x7fbcf81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.320+0000 7fbcfcb5a640 1 --2- 172.21.15.27:0/412717958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbcf8100e20 0x7fbcf8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.320+0000 7fbcfcb5a640 1 -- 172.21.15.27:0/412717958 >> 172.21.15.27:0/412717958 conn(0x7fbcf80fc7d0 msgr2=0x7fbcf80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:56.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.320+0000 7fbcfcb5a640 1 -- 172.21.15.27:0/412717958 shutdown_connections 2024-09-19T08:12:56.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.320+0000 7fbcfcb5a640 1 -- 172.21.15.27:0/412717958 wait complete. 2024-09-19T08:12:56.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.321+0000 7fbcfcb5a640 1 Processor -- start 2024-09-19T08:12:56.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.321+0000 7fbcfcb5a640 1 -- start start 2024-09-19T08:12:56.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.321+0000 7fbcfcb5a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbcf8100e20 0x7fbcf81984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:56.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.321+0000 7fbcfcb5a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcf8102570 0x7fbcf8198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:56.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.321+0000 7fbcfcb5a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcf8102ef0 0x7fbcf819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:56.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.321+0000 7fbcfcb5a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf8110fa0 con 0x7fbcf8102ef0 2024-09-19T08:12:56.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.321+0000 7fbcfcb5a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf8110e20 con 0x7fbcf8102570 2024-09-19T08:12:56.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.321+0000 7fbcfcb5a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf8111120 con 0x7fbcf8100e20 2024-09-19T08:12:56.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.322+0000 7fbceffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcf8102570 0x7fbcf8198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:56.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.322+0000 7fbcf6d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcf8102ef0 0x7fbcf819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:56.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.322+0000 7fbceffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcf8102570 0x7fbcf8198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.27:54024/0 (socket says 172.21.15.27:54024) 2024-09-19T08:12:56.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.322+0000 7fbceffff640 1 -- 172.21.15.27:0/1782021225 learned_addr learned my addr 172.21.15.27:0/1782021225 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:56.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.322+0000 7fbcf659c640 1 --2- 172.21.15.27:0/1782021225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbcf8100e20 0x7fbcf81984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:56.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.322+0000 7fbceffff640 1 -- 172.21.15.27:0/1782021225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbcf8100e20 msgr2=0x7fbcf81984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:56.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.322+0000 7fbceffff640 1 --2- 172.21.15.27:0/1782021225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbcf8100e20 0x7fbcf81984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.322+0000 7fbceffff640 1 -- 172.21.15.27:0/1782021225 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcf8102ef0 msgr2=0x7fbcf819cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:56.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.322+0000 7fbceffff640 1 --2- 172.21.15.27:0/1782021225 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcf8102ef0 0x7fbcf819cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.322+0000 7fbceffff640 1 -- 172.21.15.27:0/1782021225 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf819d4a0 con 0x7fbcf8102570 2024-09-19T08:12:56.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.322+0000 7fbceffff640 1 --2- 172.21.15.27:0/1782021225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcf8102570 0x7fbcf8198a30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbce000b4a0 tx=0x7fbce000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:56.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.322+0000 7fbcef7fe640 1 -- 172.21.15.27:0/1782021225 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0014070 con 0x7fbcf8102570 2024-09-19T08:12:56.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.322+0000 7fbcfcb5a640 1 -- 172.21.15.27:0/1782021225 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf819d790 con 0x7fbcf8102570 2024-09-19T08:12:56.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.323+0000 7fbcef7fe640 1 -- 172.21.15.27:0/1782021225 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbce0010af0 con 0x7fbcf8102570 2024-09-19T08:12:56.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.323+0000 7fbcef7fe640 1 -- 172.21.15.27:0/1782021225 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0017d10 con 0x7fbcf8102570 2024-09-19T08:12:56.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.323+0000 7fbcfcb5a640 1 -- 172.21.15.27:0/1782021225 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf81a5070 con 0x7fbcf8102570 2024-09-19T08:12:56.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.325+0000 7fbcef7fe640 1 -- 172.21.15.27:0/1782021225 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fbce0017070 con 0x7fbcf8102570 2024-09-19T08:12:56.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.326+0000 7fbcfef33740 1 Processor -- start 2024-09-19T08:12:56.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.326+0000 7fbcfef33740 1 -- start start 2024-09-19T08:12:56.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.326+0000 7fbcfef33740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21a6850 0x5591d21a6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:56.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.326+0000 7fbcfef33740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a7170 0x5591d21b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:56.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.326+0000 7fbcfef33740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591d21b1a30 0x5591d21b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:56.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.326+0000 7fbcfef33740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5591d210b160 con 0x5591d21a6850 2024-09-19T08:12:56.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.326+0000 7fbcfef33740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5591d20b2720 con 0x5591d21a7170 2024-09-19T08:12:56.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.326+0000 7fbcfef33740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5591d2107120 con 0x5591d21b1a30 2024-09-19T08:12:56.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.326+0000 7fbcf659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a7170 0x5591d21b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:56.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.326+0000 7fbcf6d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21a6850 0x5591d21a6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:56.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.326+0000 7fbcf659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a7170 0x5591d21b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.27:54026/0 (socket says 172.21.15.27:54026) 2024-09-19T08:12:56.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.326+0000 7fbcf6d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21a6850 0x5591d21a6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46038/0 (socket says 172.21.15.27:46038) 2024-09-19T08:12:56.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.326+0000 7fbcf659c640 1 -- 172.21.15.27:0/4106532213 learned_addr learned my addr 172.21.15.27:0/4106532213 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:56.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.326+0000 7fbceffff640 1 --2- 172.21.15.27:0/4106532213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591d21b1a30 0x5591d21b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:56.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.327+0000 7fbcef7fe640 1 --2- 172.21.15.27:0/1782021225 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fbce40a33b0 0x7fbce40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:56.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.327+0000 7fbcef7fe640 1 -- 172.21.15.27:0/1782021225 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fbce00cef40 con 0x7fbcf8102570 2024-09-19T08:12:56.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.327+0000 7fbcf659c640 1 -- 172.21.15.27:0/4106532213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591d21b1a30 msgr2=0x5591d21b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:56.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.327+0000 7fbcf659c640 1 --2- 172.21.15.27:0/4106532213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591d21b1a30 0x5591d21b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.327+0000 7fbcf659c640 1 -- 172.21.15.27:0/4106532213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21a6850 msgr2=0x5591d21a6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:56.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.327+0000 7fbcf659c640 1 --2- 172.21.15.27:0/4106532213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21a6850 0x5591d21a6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.327+0000 7fbcf659c640 1 -- 172.21.15.27:0/4106532213 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591d1e7cba0 con 0x5591d21a7170 2024-09-19T08:12:56.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.327+0000 7fbcf6d9d640 1 --2- 172.21.15.27:0/1782021225 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fbce40a33b0 0x7fbce40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:56.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.327+0000 7fbcf659c640 1 --2- 172.21.15.27:0/4106532213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a7170 0x5591d21b14f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbce800bd10 tx=0x7fbce80107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dabb5ad499a6b16d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:56.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.327+0000 7fbcecff9640 1 -- 172.21.15.27:0/4106532213 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8004030 con 0x5591d21a7170 2024-09-19T08:12:56.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.328+0000 7fbcecff9640 1 -- 172.21.15.27:0/4106532213 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbce80041d0 con 0x5591d21a7170 2024-09-19T08:12:56.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.328+0000 7fbcecff9640 1 -- 172.21.15.27:0/4106532213 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8011820 con 0x5591d21a7170 2024-09-19T08:12:56.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.329+0000 7fbcfef33740 1 -- 172.21.15.27:0/4106532213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a7170 msgr2=0x5591d21b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:56.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.329+0000 7fbcf6d9d640 1 --2- 172.21.15.27:0/1782021225 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fbce40a33b0 0x7fbce40a5870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0005fe0 tx=0x7fbcf002a950 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:56.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.329+0000 7fbcfef33740 1 --2- 172.21.15.27:0/4106532213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a7170 0x5591d21b14f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbce800bd10 tx=0x7fbce80107a0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.329+0000 7fbcfef33740 1 -- 172.21.15.27:0/4106532213 shutdown_connections 2024-09-19T08:12:56.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.329+0000 7fbcfef33740 1 --2- 172.21.15.27:0/4106532213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591d21b1a30 0x5591d21b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.329+0000 7fbcfef33740 1 --2- 172.21.15.27:0/4106532213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a7170 0x5591d21b14f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.329+0000 7fbcfef33740 1 --2- 172.21.15.27:0/4106532213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21a6850 0x5591d21a6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.329+0000 7fbcfef33740 1 -- 172.21.15.27:0/4106532213 >> 172.21.15.27:0/4106532213 conn(0x5591d21a2de0 msgr2=0x5591d21a31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:56.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.329+0000 7fbcfef33740 1 -- 172.21.15.27:0/4106532213 shutdown_connections 2024-09-19T08:12:56.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.329+0000 7fbcfef33740 1 -- 172.21.15.27:0/4106532213 wait complete. 2024-09-19T08:12:56.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.329+0000 7fbcfef33740 1 -- start start 2024-09-19T08:12:56.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.330+0000 7fbcfef33740 1 Processor -- start 2024-09-19T08:12:56.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.330+0000 7fbcfef33740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21a6850 0x5591d21ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:56.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.330+0000 7fbcfef33740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a7170 0x5591d21aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:56.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.330+0000 7fbcfef33740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591d21b1a30 0x5591d21af330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:56.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.330+0000 7fbcfef33740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5591d21b4600 con 0x5591d21a6850 2024-09-19T08:12:56.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.330+0000 7fbcfef33740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5591d2093900 con 0x5591d21a7170 2024-09-19T08:12:56.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.330+0000 7fbcfef33740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5591d21b4780 con 0x5591d21b1a30 2024-09-19T08:12:56.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.330+0000 7fbcfef33740 10 client.0 _ll_register_callbacks cb 0x5591d2091780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:12:56.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.330+0000 7fbceffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a7170 0x5591d21aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:56.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.330+0000 7fbcf659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21a6850 0x5591d21ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:56.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.330+0000 7fbceffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a7170 0x5591d21aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.27:54034/0 (socket says 172.21.15.27:54034) 2024-09-19T08:12:56.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.330+0000 7fbceffff640 1 -- 172.21.15.27:0/3342885725 learned_addr learned my addr 172.21.15.27:0/3342885725 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:56.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.330+0000 7fbcf6d9d640 1 --2- 172.21.15.27:0/3342885725 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591d21b1a30 0x5591d21af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:56.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.331+0000 7fbceffff640 1 -- 172.21.15.27:0/3342885725 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591d21b1a30 msgr2=0x5591d21af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:56.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.331+0000 7fbceffff640 1 --2- 172.21.15.27:0/3342885725 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591d21b1a30 0x5591d21af330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.331+0000 7fbceffff640 1 -- 172.21.15.27:0/3342885725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21a6850 msgr2=0x5591d21ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:56.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.331+0000 7fbceffff640 1 --2- 172.21.15.27:0/3342885725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21a6850 0x5591d21ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.331+0000 7fbceffff640 1 -- 172.21.15.27:0/3342885725 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591d20d3c50 con 0x5591d21a7170 2024-09-19T08:12:56.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.331+0000 7fbceffff640 1 --2- 172.21.15.27:0/3342885725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a7170 0x5591d21aedf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009420 tx=0x7fbce000bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a9aa03970b33e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:56.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.331+0000 7fbcddffb640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:12:56.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.331+0000 7fbcddffb640 1 -- 172.21.15.27:0/3342885725 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce001e030 con 0x5591d21a7170 2024-09-19T08:12:56.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.331+0000 7fbcddffb640 1 -- 172.21.15.27:0/3342885725 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fbce0097a40 con 0x5591d21a7170 2024-09-19T08:12:56.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.331+0000 7fbcfef33740 1 -- 172.21.15.27:0/3342885725 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbce80041d0 con 0x5591d21a7170 2024-09-19T08:12:56.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.331+0000 7fbcddffb640 1 -- 172.21.15.27:0/3342885725 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbce009b3d0 con 0x5591d21a7170 2024-09-19T08:12:56.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.331+0000 7fbcfef33740 10 client.25271 fetch_fsmap learned FSMap version 20 2024-09-19T08:12:56.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.331+0000 7fbcfef33740 1 -- 172.21.15.27:0/3342885725 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5591d21c0240 con 0x5591d21a7170 2024-09-19T08:12:56.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.331+0000 7fbcddffb640 1 -- 172.21.15.27:0/3342885725 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbce80041d0 con 0x5591d21a7170 2024-09-19T08:12:56.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.332+0000 7fbcddffb640 1 -- 172.21.15.27:0/3342885725 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbce00bb0f0 con 0x5591d21a7170 2024-09-19T08:12:56.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.332+0000 7fbcfef33740 10 client.25271 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:12:56.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.332+0000 7fbcfef33740 10 client.25271 resolve_mds: validated gid 24482 aka daemon mds.b 2024-09-19T08:12:56.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.332+0000 7fbcfef33740 20 client.25271 populate_metadata read hostname 'smithi027' 2024-09-19T08:12:56.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.332+0000 7fbcfef33740 1 --2- 172.21.15.27:0/3342885725 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5591d21c1700 0x5591d21c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:56.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.332+0000 7fbcfef33740 4 client.25271 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:12:56.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.332+0000 7fbcfef33740 1 -- 172.21.15.27:0/3342885725 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591d2118890 con 0x5591d21c1700 2024-09-19T08:12:56.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.332+0000 7fbcf659c640 1 --2- 172.21.15.27:0/3342885725 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5591d21c1700 0x5591d21c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:56.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.332+0000 7fbcf659c640 1 --2- 172.21.15.27:0/3342885725 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5591d21c1700 0x5591d21c3b10 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16bd50d4731673e7 server_cookie=d2da742fbc9d8ea6 in_seq=0 out_seq=0 2024-09-19T08:12:56.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.333+0000 7fbcddffb640 10 client.25271 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:56.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.333+0000 7fbcddffb640 1 -- 172.21.15.27:0/3342885725 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5591d2118890 con 0x5591d21c1700 2024-09-19T08:12:56.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.333+0000 7fbcddffb640 10 client.25271 handle_command_reply: tid=0 2024-09-19T08:12:56.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.333+0000 7fbcfef33740 1 client.25271 shutdown 2024-09-19T08:12:56.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.334+0000 7fbcfef33740 1 -- 172.21.15.27:0/3342885725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a7170 msgr2=0x5591d21aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:56.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.334+0000 7fbcfef33740 1 --2- 172.21.15.27:0/3342885725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a7170 0x5591d21aedf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009420 tx=0x7fbce000bf90 comp rx=0 tx=0).stop 2024-09-19T08:12:56.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.334+0000 7fbcfef33740 1 -- 172.21.15.27:0/3342885725 shutdown_connections 2024-09-19T08:12:56.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.334+0000 7fbcfef33740 1 --2- 172.21.15.27:0/3342885725 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5591d21c1700 0x5591d21c3b10 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.334+0000 7fbcfef33740 1 --2- 172.21.15.27:0/3342885725 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591d21b1a30 0x5591d21af330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.334+0000 7fbcfef33740 1 --2- 172.21.15.27:0/3342885725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a7170 0x5591d21aedf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.334+0000 7fbcfef33740 1 --2- 172.21.15.27:0/3342885725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21a6850 0x5591d21ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.334+0000 7fbcfef33740 1 -- 172.21.15.27:0/3342885725 >> 172.21.15.27:0/3342885725 conn(0x5591d21a2de0 msgr2=0x5591d21a8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:56.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.334+0000 7fbcddffb640 0 client.25271 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:56.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.334+0000 7fbcfef33740 1 -- 172.21.15.27:0/3342885725 shutdown_connections 2024-09-19T08:12:56.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.334+0000 7fbcfef33740 1 -- 172.21.15.27:0/3342885725 wait complete. 2024-09-19T08:12:56.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.334+0000 7fbcfef33740 20 client.25271 trim_cache size 0 max 16384 2024-09-19T08:12:56.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.354+0000 7fbcfef33740 1 Processor -- start 2024-09-19T08:12:56.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.355+0000 7fbcfef33740 1 -- start start 2024-09-19T08:12:56.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.355+0000 7fbcfef33740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a6850 0x5591d21c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:56.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.355+0000 7fbcfef33740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591d21a7170 0x5591d21c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:56.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.355+0000 7fbcfef33740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21b1a30 0x5591d21ae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:56.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.355+0000 7fbcfef33740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf81a95b0 con 0x5591d21b1a30 2024-09-19T08:12:56.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.355+0000 7fbcfef33740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf81abe30 con 0x5591d21a6850 2024-09-19T08:12:56.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.355+0000 7fbcfef33740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf81a9c20 con 0x5591d21a7170 2024-09-19T08:12:56.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.355+0000 7fbcf6d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21b1a30 0x5591d21ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:56.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.355+0000 7fbcf6d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21b1a30 0x5591d21ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46058/0 (socket says 172.21.15.27:46058) 2024-09-19T08:12:56.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.355+0000 7fbcf6d9d640 1 -- 172.21.15.27:0/4221356737 learned_addr learned my addr 172.21.15.27:0/4221356737 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:56.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.355+0000 7fbcf6d9d640 1 -- 172.21.15.27:0/4221356737 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591d21a7170 msgr2=0x5591d21c9920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:12:56.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.355+0000 7fbcf6d9d640 1 --2- 172.21.15.27:0/4221356737 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591d21a7170 0x5591d21c9920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.355+0000 7fbcf6d9d640 1 -- 172.21.15.27:0/4221356737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a6850 msgr2=0x5591d21c93e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:12:56.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.355+0000 7fbcf6d9d640 1 --2- 172.21.15.27:0/4221356737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a6850 0x5591d21c93e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.355+0000 7fbcf6d9d640 1 -- 172.21.15.27:0/4221356737 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591d21a6fa0 con 0x5591d21b1a30 2024-09-19T08:12:56.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.356+0000 7fbcf6d9d640 1 --2- 172.21.15.27:0/4221356737 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21b1a30 0x5591d21ae870 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0009ca0 tx=0x7fbcf002fe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc66e98b9f7b941 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:56.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.356+0000 7fbcdffff640 1 -- 172.21.15.27:0/4221356737 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0043050 con 0x5591d21b1a30 2024-09-19T08:12:56.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.356+0000 7fbcdffff640 1 -- 172.21.15.27:0/4221356737 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcf0044040 con 0x5591d21b1a30 2024-09-19T08:12:56.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.356+0000 7fbcdffff640 1 -- 172.21.15.27:0/4221356737 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0034040 con 0x5591d21b1a30 2024-09-19T08:12:56.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.357+0000 7fbcfef33740 1 -- 172.21.15.27:0/4221356737 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21b1a30 msgr2=0x5591d21ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:56.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.357+0000 7fbcfef33740 1 --2- 172.21.15.27:0/4221356737 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21b1a30 0x5591d21ae870 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0009ca0 tx=0x7fbcf002fe00 comp rx=0 tx=0).stop 2024-09-19T08:12:56.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.357+0000 7fbcfef33740 1 -- 172.21.15.27:0/4221356737 shutdown_connections 2024-09-19T08:12:56.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.357+0000 7fbcfef33740 1 --2- 172.21.15.27:0/4221356737 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21b1a30 0x5591d21ae870 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.357+0000 7fbcfef33740 1 --2- 172.21.15.27:0/4221356737 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591d21a7170 0x5591d21c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.357+0000 7fbcfef33740 1 --2- 172.21.15.27:0/4221356737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a6850 0x5591d21c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.357+0000 7fbcfef33740 1 -- 172.21.15.27:0/4221356737 >> 172.21.15.27:0/4221356737 conn(0x5591d21a2de0 msgr2=0x5591d21a9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:56.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.357+0000 7fbcfef33740 1 -- 172.21.15.27:0/4221356737 shutdown_connections 2024-09-19T08:12:56.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.357+0000 7fbcfef33740 1 -- 172.21.15.27:0/4221356737 wait complete. 2024-09-19T08:12:56.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.357+0000 7fbcfef33740 1 -- start start 2024-09-19T08:12:56.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.357+0000 7fbcfef33740 1 Processor -- start 2024-09-19T08:12:56.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.358+0000 7fbcfef33740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a6850 0x5591d21b99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:56.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.358+0000 7fbcfef33740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21a7170 0x5591d21b9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:56.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.358+0000 7fbcfef33740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591d21b1a30 0x5591d21b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:56.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.358+0000 7fbcfef33740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf81aa2f0 con 0x5591d21a7170 2024-09-19T08:12:56.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.358+0000 7fbcfef33740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf81ab760 con 0x5591d21a6850 2024-09-19T08:12:56.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.358+0000 7fbcfef33740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf81aa9c0 con 0x5591d21b1a30 2024-09-19T08:12:56.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.358+0000 7fbcfef33740 10 client.0 _ll_register_callbacks cb 0x7fbce0017630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:12:56.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.358+0000 7fbcf659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a6850 0x5591d21b99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:56.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.358+0000 7fbcf6d9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591d21b1a30 0x5591d21b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:56.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.358+0000 7fbcf659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a6850 0x5591d21b99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.27:54046/0 (socket says 172.21.15.27:54046) 2024-09-19T08:12:56.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.358+0000 7fbcf6d9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591d21b1a30 0x5591d21b69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.27:33914/0 (socket says 172.21.15.27:33914) 2024-09-19T08:12:56.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.358+0000 7fbcf659c640 1 -- 172.21.15.27:0/2253570633 learned_addr learned my addr 172.21.15.27:0/2253570633 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:12:56.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.358+0000 7fbceffff640 1 --2- 172.21.15.27:0/2253570633 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21a7170 0x5591d21b9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:56.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.358+0000 7fbcf659c640 1 -- 172.21.15.27:0/2253570633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591d21b1a30 msgr2=0x5591d21b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:56.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.358+0000 7fbcf659c640 1 --2- 172.21.15.27:0/2253570633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591d21b1a30 0x5591d21b69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.358+0000 7fbcf659c640 1 -- 172.21.15.27:0/2253570633 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21a7170 msgr2=0x5591d21b9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:12:56.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.358+0000 7fbcf659c640 1 --2- 172.21.15.27:0/2253570633 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21a7170 0x5591d21b9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.358+0000 7fbcf659c640 1 -- 172.21.15.27:0/2253570633 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591d21b6ee0 con 0x5591d21a6850 2024-09-19T08:12:56.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.358+0000 7fbcf659c640 1 --2- 172.21.15.27:0/2253570633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a6850 0x5591d21b99d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbce800bd10 tx=0x7fbce800b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23a6931d0b6f0540 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:12:56.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.358+0000 7fbcddffb640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:12:56.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.359+0000 7fbcddffb640 1 -- 172.21.15.27:0/2253570633 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8005b90 con 0x5591d21a6850 2024-09-19T08:12:56.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.359+0000 7fbcddffb640 1 -- 172.21.15.27:0/2253570633 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fbce8005240 con 0x5591d21a6850 2024-09-19T08:12:56.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.359+0000 7fbcfef33740 1 -- 172.21.15.27:0/2253570633 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcf0044040 con 0x5591d21a6850 2024-09-19T08:12:56.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.359+0000 7fbcddffb640 1 -- 172.21.15.27:0/2253570633 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbce800b8e0 con 0x5591d21a6850 2024-09-19T08:12:56.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.359+0000 7fbcfef33740 10 client.25274 fetch_fsmap learned FSMap version 20 2024-09-19T08:12:56.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.359+0000 7fbcfef33740 1 -- 172.21.15.27:0/2253570633 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5591d222cae0 con 0x5591d21a6850 2024-09-19T08:12:56.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.359+0000 7fbcddffb640 1 -- 172.21.15.27:0/2253570633 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcf0044040 con 0x5591d21a6850 2024-09-19T08:12:56.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.359+0000 7fbcddffb640 1 -- 172.21.15.27:0/2253570633 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbce80115b0 con 0x5591d21a6850 2024-09-19T08:12:56.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.359+0000 7fbcfef33740 10 client.25274 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:12:56.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.359+0000 7fbcfef33740 10 client.25274 resolve_mds: validated gid 24482 aka daemon mds.b 2024-09-19T08:12:56.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.359+0000 7fbcfef33740 20 client.25274 populate_metadata read hostname 'smithi027' 2024-09-19T08:12:56.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.359+0000 7fbcfef33740 1 --2- 172.21.15.27:0/2253570633 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5591d222cf50 0x5591d222f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:12:56.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.359+0000 7fbcfef33740 4 client.25274 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T08:12:56.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.359+0000 7fbcfef33740 1 -- 172.21.15.27:0/2253570633 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x5591d2112be0 con 0x5591d222cf50 2024-09-19T08:12:56.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.360+0000 7fbceffff640 1 --2- 172.21.15.27:0/2253570633 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5591d222cf50 0x5591d222f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:12:56.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.360+0000 7fbceffff640 1 --2- 172.21.15.27:0/2253570633 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5591d222cf50 0x5591d222f340 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4aeadf0dd809f77e server_cookie=5275852079197813 in_seq=0 out_seq=0 2024-09-19T08:12:56.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.360+0000 7fbcddffb640 10 client.25274 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:56.544 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:12:56.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.376+0000 7fbcddffb640 1 -- 172.21.15.27:0/2253570633 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5591d2112be0 con 0x5591d222cf50 2024-09-19T08:12:56.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.376+0000 7fbcddffb640 10 client.25274 handle_command_reply: tid=0 2024-09-19T08:12:56.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.376+0000 7fbcfef33740 1 client.25274 shutdown 2024-09-19T08:12:56.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.377+0000 7fbcfef33740 1 -- 172.21.15.27:0/2253570633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a6850 msgr2=0x5591d21b99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:56.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.377+0000 7fbcfef33740 1 --2- 172.21.15.27:0/2253570633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a6850 0x5591d21b99d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbce800bd10 tx=0x7fbce800b690 comp rx=0 tx=0).stop 2024-09-19T08:12:56.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.377+0000 7fbcfef33740 1 -- 172.21.15.27:0/2253570633 shutdown_connections 2024-09-19T08:12:56.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.377+0000 7fbcfef33740 1 --2- 172.21.15.27:0/2253570633 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5591d222cf50 0x5591d222f340 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.377+0000 7fbcddffb640 0 client.25274 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:12:56.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.377+0000 7fbcfef33740 1 --2- 172.21.15.27:0/2253570633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591d21b1a30 0x5591d21b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.377+0000 7fbcfef33740 1 --2- 172.21.15.27:0/2253570633 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d21a7170 0x5591d21b9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.377+0000 7fbcfef33740 1 --2- 172.21.15.27:0/2253570633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591d21a6850 0x5591d21b99d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.377+0000 7fbcfef33740 1 -- 172.21.15.27:0/2253570633 >> 172.21.15.27:0/2253570633 conn(0x5591d21a2de0 msgr2=0x5591d21a82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:56.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.377+0000 7fbcfef33740 1 -- 172.21.15.27:0/2253570633 shutdown_connections 2024-09-19T08:12:56.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.377+0000 7fbcfef33740 1 -- 172.21.15.27:0/2253570633 wait complete. 2024-09-19T08:12:56.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.377+0000 7fbcfef33740 20 client.25274 trim_cache size 0 max 16384 2024-09-19T08:12:56.546 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:12:56.546 INFO:teuthology.orchestra.run.smithi027.stdout: "epoch": 20, 2024-09-19T08:12:56.547 INFO:teuthology.orchestra.run.smithi027.stdout: "leader": 24482, 2024-09-19T08:12:56.547 INFO:teuthology.orchestra.run.smithi027.stdout: "set_version": 10, 2024-09-19T08:12:56.547 INFO:teuthology.orchestra.run.smithi027.stdout: "sets": { 2024-09-19T08:12:56.547 INFO:teuthology.orchestra.run.smithi027.stdout: "3ddfad15": { 2024-09-19T08:12:56.547 INFO:teuthology.orchestra.run.smithi027.stdout: "version": 10, 2024-09-19T08:12:56.547 INFO:teuthology.orchestra.run.smithi027.stdout: "age_ref": 0.0, 2024-09-19T08:12:56.547 INFO:teuthology.orchestra.run.smithi027.stdout: "state": { 2024-09-19T08:12:56.547 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "QUIESCED", 2024-09-19T08:12:56.547 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0 2024-09-19T08:12:56.547 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:12:56.547 INFO:teuthology.orchestra.run.smithi027.stdout: "timeout": 90.0, 2024-09-19T08:12:56.547 INFO:teuthology.orchestra.run.smithi027.stdout: "expiration": 140.3, 2024-09-19T08:12:56.547 INFO:teuthology.orchestra.run.smithi027.stdout: "members": { 2024-09-19T08:12:56.548 INFO:teuthology.orchestra.run.smithi027.stdout: "file:/": { 2024-09-19T08:12:56.548 INFO:teuthology.orchestra.run.smithi027.stdout: "excluded": false, 2024-09-19T08:12:56.548 INFO:teuthology.orchestra.run.smithi027.stdout: "state": { 2024-09-19T08:12:56.548 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "QUIESCED", 2024-09-19T08:12:56.548 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0 2024-09-19T08:12:56.548 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:56.548 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:56.548 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:56.548 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:56.548 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:12:56.548 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:12:56.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.378+0000 7fbcfcb5a640 1 -- 172.21.15.27:0/1782021225 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fbce40a33b0 msgr2=0x7fbce40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:56.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.378+0000 7fbcfcb5a640 1 --2- 172.21.15.27:0/1782021225 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fbce40a33b0 0x7fbce40a5870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0005fe0 tx=0x7fbcf002a950 comp rx=0 tx=0).stop 2024-09-19T08:12:56.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.378+0000 7fbcfcb5a640 1 -- 172.21.15.27:0/1782021225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcf8102570 msgr2=0x7fbcf8198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:12:56.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.378+0000 7fbcfcb5a640 1 --2- 172.21.15.27:0/1782021225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcf8102570 0x7fbcf8198a30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbce000b4a0 tx=0x7fbce000b960 comp rx=0 tx=0).stop 2024-09-19T08:12:56.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.378+0000 7fbcfcb5a640 1 -- 172.21.15.27:0/1782021225 shutdown_connections 2024-09-19T08:12:56.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.378+0000 7fbcfcb5a640 1 --2- 172.21.15.27:0/1782021225 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fbce40a33b0 0x7fbce40a5870 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.378+0000 7fbcfcb5a640 1 --2- 172.21.15.27:0/1782021225 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcf8102ef0 0x7fbcf819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.378+0000 7fbcfcb5a640 1 --2- 172.21.15.27:0/1782021225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcf8102570 0x7fbcf8198a30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.378+0000 7fbcfcb5a640 1 --2- 172.21.15.27:0/1782021225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbcf8100e20 0x7fbcf81984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:12:56.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.378+0000 7fbcfcb5a640 1 -- 172.21.15.27:0/1782021225 >> 172.21.15.27:0/1782021225 conn(0x7fbcf80fc7d0 msgr2=0x7fbcf806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:12:56.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.378+0000 7fbcfcb5a640 1 -- 172.21.15.27:0/1782021225 shutdown_connections 2024-09-19T08:12:56.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:56.378+0000 7fbcfcb5a640 1 -- 172.21.15.27:0/1782021225 wait complete. 2024-09-19T08:12:57.209 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:57 smithi027 ceph-mon[31209]: pgmap v60: 97 pgs: 97 active+clean; 1.9 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 6.6 KiB/s wr, 3 op/s 2024-09-19T08:12:57.240 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3ddfad15', quiesce took 5.3 seconds. Will release after: 15.05 2024-09-19T08:12:57.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:57 smithi155 ceph-mon[35362]: pgmap v60: 97 pgs: 97 active+clean; 1.9 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 6.6 KiB/s wr, 3 op/s 2024-09-19T08:12:57.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:57 smithi203 ceph-mon[35198]: pgmap v60: 97 pgs: 97 active+clean; 1.9 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 6.6 KiB/s wr, 3 op/s 2024-09-19T08:12:59.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:12:59 smithi027 ceph-mon[31209]: pgmap v61: 97 pgs: 97 active+clean; 51 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 31 MiB/s rd, 949 KiB/s wr, 233 op/s 2024-09-19T08:12:59.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:12:59 smithi155 ceph-mon[35362]: pgmap v61: 97 pgs: 97 active+clean; 51 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 31 MiB/s rd, 949 KiB/s wr, 233 op/s 2024-09-19T08:12:59.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:12:59 smithi203 ceph-mon[35198]: pgmap v61: 97 pgs: 97 active+clean; 51 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 31 MiB/s rd, 949 KiB/s wr, 233 op/s 2024-09-19T08:13:00.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.913+0000 7f12d63b0640 1 -- 172.21.15.27:0/1974970259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f12d010c170 msgr2=0x7f12d010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:00.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.913+0000 7f12d63b0640 1 --2- 172.21.15.27:0/1974970259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f12d010c170 0x7f12d010e610 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009ca0 tx=0x7f12c802a950 comp rx=0 tx=0).stop 2024-09-19T08:13:00.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.913+0000 7f12d63b0640 1 -- 172.21.15.27:0/1974970259 shutdown_connections 2024-09-19T08:13:00.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.913+0000 7f12d63b0640 1 --2- 172.21.15.27:0/1974970259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f12d010c170 0x7f12d010e610 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.913+0000 7f12d63b0640 1 --2- 172.21.15.27:0/1974970259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12d0103660 0x7f12d010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.913+0000 7f12d63b0640 1 --2- 172.21.15.27:0/1974970259 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12d0102d40 0x7f12d0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.913+0000 7f12d63b0640 1 -- 172.21.15.27:0/1974970259 >> 172.21.15.27:0/1974970259 conn(0x7f12d00fc7a0 msgr2=0x7f12d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:00.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.913+0000 7f12d63b0640 1 -- 172.21.15.27:0/1974970259 shutdown_connections 2024-09-19T08:13:00.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.913+0000 7f12d63b0640 1 -- 172.21.15.27:0/1974970259 wait complete. 2024-09-19T08:13:00.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.913+0000 7f12d63b0640 1 Processor -- start 2024-09-19T08:13:00.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.914+0000 7f12d63b0640 1 -- start start 2024-09-19T08:13:00.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.914+0000 7f12d63b0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12d0102d40 0x7f12d01983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:00.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.914+0000 7f12d63b0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12d0103660 0x7f12d0198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:00.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.914+0000 7f12d63b0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f12d010c170 0x7f12d019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:00.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.914+0000 7f12d63b0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f12d0111f70 con 0x7f12d010c170 2024-09-19T08:13:00.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.914+0000 7f12d63b0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f12d0111df0 con 0x7f12d0103660 2024-09-19T08:13:00.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.914+0000 7f12d63b0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01120f0 con 0x7f12d0102d40 2024-09-19T08:13:00.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.914+0000 7f12d494d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f12d010c170 0x7f12d019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:00.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.914+0000 7f12d494d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f12d010c170 0x7f12d019cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46072/0 (socket says 172.21.15.27:46072) 2024-09-19T08:13:00.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.914+0000 7f12d494d640 1 -- 172.21.15.27:0/689879127 learned_addr learned my addr 172.21.15.27:0/689879127 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:00.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.914+0000 7f12cffff640 1 --2- 172.21.15.27:0/689879127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12d0102d40 0x7f12d01983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:00.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.914+0000 7f12cf7fe640 1 --2- 172.21.15.27:0/689879127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12d0103660 0x7f12d0198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:00.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.915+0000 7f12d494d640 1 -- 172.21.15.27:0/689879127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12d0102d40 msgr2=0x7f12d01983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:00.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.915+0000 7f12d494d640 1 --2- 172.21.15.27:0/689879127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12d0102d40 0x7f12d01983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.915+0000 7f12d494d640 1 -- 172.21.15.27:0/689879127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12d0103660 msgr2=0x7f12d0198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:00.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.915+0000 7f12d494d640 1 --2- 172.21.15.27:0/689879127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12d0103660 0x7f12d0198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.915+0000 7f12d494d640 1 -- 172.21.15.27:0/689879127 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d019d380 con 0x7f12d010c170 2024-09-19T08:13:00.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.915+0000 7f12d494d640 1 --2- 172.21.15.27:0/689879127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f12d010c170 0x7f12d019cca0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f12c802ae70 tx=0x7f12c802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:00.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.915+0000 7f12cd7fa640 1 -- 172.21.15.27:0/689879127 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c8034040 con 0x7f12d010c170 2024-09-19T08:13:00.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.915+0000 7f12cd7fa640 1 -- 172.21.15.27:0/689879127 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12c8030920 con 0x7f12d010c170 2024-09-19T08:13:00.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.915+0000 7f12d63b0640 1 -- 172.21.15.27:0/689879127 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d019d610 con 0x7f12d010c170 2024-09-19T08:13:00.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.915+0000 7f12cd7fa640 1 -- 172.21.15.27:0/689879127 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c8045480 con 0x7f12d010c170 2024-09-19T08:13:00.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.915+0000 7f12d63b0640 1 -- 172.21.15.27:0/689879127 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12d01a4f50 con 0x7f12d010c170 2024-09-19T08:13:00.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.917+0000 7f12cd7fa640 1 -- 172.21.15.27:0/689879127 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f12c8037020 con 0x7f12d010c170 2024-09-19T08:13:00.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.918+0000 7f12d8789740 1 Processor -- start 2024-09-19T08:13:00.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.918+0000 7f12d8789740 1 -- start start 2024-09-19T08:13:00.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.918+0000 7f12d8789740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a4221c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:00.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.918+0000 7f12d8789740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a4221c5d0 0x564a4221ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:00.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.918+0000 7f12d8789740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a42227370 0x564a42229760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:00.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.918+0000 7f12d8789740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x564a421822f0 con 0x564a4221db40 2024-09-19T08:13:00.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.918+0000 7f12d8789740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x564a42129cf0 con 0x564a4221c5d0 2024-09-19T08:13:00.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.918+0000 7f12d8789740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564a4217e2b0 con 0x564a42227370 2024-09-19T08:13:00.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.918+0000 7f12cd7fa640 1 --2- 172.21.15.27:0/689879127 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f12b80a3430 0x7f12b80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.918+0000 7f12cf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a4221c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.918+0000 7f12cf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a4221c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46078/0 (socket says 172.21.15.27:46078) 2024-09-19T08:13:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.918+0000 7f12cf7fe640 1 -- 172.21.15.27:0/3909847363 learned_addr learned my addr 172.21.15.27:0/3909847363 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.919+0000 7f12cffff640 1 --2- 172.21.15.27:0/3909847363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a4221c5d0 0x564a4221ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.919+0000 7f12cf7fe640 1 --2- 172.21.15.27:0/3909847363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a42227370 0x564a42229760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.919+0000 7f12d494d640 1 --2- 172.21.15.27:0/689879127 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f12b80a3430 0x7f12b80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.919+0000 7f12cd7fa640 1 -- 172.21.15.27:0/689879127 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f12c80f0a30 con 0x7f12d010c170 2024-09-19T08:13:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.919+0000 7f12cf7fe640 1 -- 172.21.15.27:0/3909847363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a42227370 msgr2=0x564a42229760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.919+0000 7f12cf7fe640 1 --2- 172.21.15.27:0/3909847363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a42227370 0x564a42229760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.919+0000 7f12cf7fe640 1 -- 172.21.15.27:0/3909847363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a4221c5d0 msgr2=0x564a4221ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.919+0000 7f12cf7fe640 1 --2- 172.21.15.27:0/3909847363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a4221c5d0 0x564a4221ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.919+0000 7f12cf7fe640 1 -- 172.21.15.27:0/3909847363 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a4210e3a0 con 0x564a4221db40 2024-09-19T08:13:00.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.919+0000 7f12cffff640 1 --2- 172.21.15.27:0/3909847363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a4221c5d0 0x564a4221ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:13:00.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.919+0000 7f12cf7fe640 1 --2- 172.21.15.27:0/3909847363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a4221c090 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f12c40058a0 tx=0x7f12c400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98095af53c4252f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:00.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.919+0000 7f12d494d640 1 --2- 172.21.15.27:0/689879127 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f12b80a3430 0x7f12b80a58f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f12c80ee390 tx=0x7f12c8004360 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:00.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.919+0000 7f12b67fc640 1 -- 172.21.15.27:0/3909847363 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c4004030 con 0x564a4221db40 2024-09-19T08:13:00.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.919+0000 7f12b67fc640 1 -- 172.21.15.27:0/3909847363 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12c40041d0 con 0x564a4221db40 2024-09-19T08:13:00.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.919+0000 7f12b67fc640 1 -- 172.21.15.27:0/3909847363 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c400f6e0 con 0x564a4221db40 2024-09-19T08:13:00.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.920+0000 7f12d8789740 1 -- 172.21.15.27:0/3909847363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 msgr2=0x564a4221c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:00.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.920+0000 7f12d8789740 1 --2- 172.21.15.27:0/3909847363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a4221c090 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f12c40058a0 tx=0x7f12c400b7b0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.920+0000 7f12d8789740 1 -- 172.21.15.27:0/3909847363 shutdown_connections 2024-09-19T08:13:00.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.920+0000 7f12d8789740 1 --2- 172.21.15.27:0/3909847363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a42227370 0x564a42229760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.920+0000 7f12d8789740 1 --2- 172.21.15.27:0/3909847363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a4221c5d0 0x564a4221ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.920+0000 7f12d8789740 1 --2- 172.21.15.27:0/3909847363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a4221c090 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.920+0000 7f12d8789740 1 -- 172.21.15.27:0/3909847363 >> 172.21.15.27:0/3909847363 conn(0x564a421e5310 msgr2=0x564a42218c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:00.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.920+0000 7f12d8789740 1 -- 172.21.15.27:0/3909847363 shutdown_connections 2024-09-19T08:13:00.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.920+0000 7f12d8789740 1 -- 172.21.15.27:0/3909847363 wait complete. 2024-09-19T08:13:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.920+0000 7f12d8789740 1 -- start start 2024-09-19T08:13:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.921+0000 7f12d8789740 1 Processor -- start 2024-09-19T08:13:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.921+0000 7f12d8789740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a4221c5d0 0x564a42226de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.921+0000 7f12d8789740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a42224090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.921+0000 7f12d8789740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a42227370 0x564a422247d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.921+0000 7f12d8789740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x564a4222a070 con 0x564a4221db40 2024-09-19T08:13:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.921+0000 7f12d8789740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x564a4213d060 con 0x564a42227370 2024-09-19T08:13:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.921+0000 7f12d8789740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564a4222a1f0 con 0x564a4221c5d0 2024-09-19T08:13:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.921+0000 7f12d8789740 10 client.0 _ll_register_callbacks cb 0x564a41e908c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:13:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.921+0000 7f12cffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a42224090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.921+0000 7f12cffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a42224090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46080/0 (socket says 172.21.15.27:46080) 2024-09-19T08:13:00.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.921+0000 7f12cffff640 1 -- 172.21.15.27:0/828396484 learned_addr learned my addr 172.21.15.27:0/828396484 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:00.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.921+0000 7f12cf7fe640 1 --2- 172.21.15.27:0/828396484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a42227370 0x564a422247d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:00.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.921+0000 7f12cf7fe640 1 --2- 172.21.15.27:0/828396484 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a4221c5d0 0x564a42226de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:00.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.922+0000 7f12cffff640 1 -- 172.21.15.27:0/828396484 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a4221c5d0 msgr2=0x564a42226de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:00.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.922+0000 7f12cffff640 1 --2- 172.21.15.27:0/828396484 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a4221c5d0 0x564a42226de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.922+0000 7f12cffff640 1 -- 172.21.15.27:0/828396484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a42227370 msgr2=0x564a422247d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:00.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.922+0000 7f12cffff640 1 --2- 172.21.15.27:0/828396484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a42227370 0x564a422247d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.922+0000 7f12cffff640 1 -- 172.21.15.27:0/828396484 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a41ef33c0 con 0x564a4221db40 2024-09-19T08:13:00.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.922+0000 7f12cf7fe640 1 --2- 172.21.15.27:0/828396484 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a4221c5d0 0x564a42226de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:13:00.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.922+0000 7f12cffff640 1 --2- 172.21.15.27:0/828396484 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a42224090 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f12c000bf70 tx=0x7f12c00128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf4748d4c4e8824 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:00.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.922+0000 7f12af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:13:00.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.922+0000 7f12af7fe640 1 -- 172.21.15.27:0/828396484 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c0010960 con 0x564a4221db40 2024-09-19T08:13:00.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.922+0000 7f12af7fe640 1 -- 172.21.15.27:0/828396484 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f12c0010b00 con 0x564a4221db40 2024-09-19T08:13:00.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.922+0000 7f12d8789740 1 -- 172.21.15.27:0/828396484 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12c40041d0 con 0x564a4221db40 2024-09-19T08:13:00.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.922+0000 7f12af7fe640 1 -- 172.21.15.27:0/828396484 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f12c0010d00 con 0x564a4221db40 2024-09-19T08:13:00.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.922+0000 7f12d8789740 10 client.15744 fetch_fsmap learned FSMap version 20 2024-09-19T08:13:00.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.922+0000 7f12d8789740 1 -- 172.21.15.27:0/828396484 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564a42235c00 con 0x564a4221db40 2024-09-19T08:13:00.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.922+0000 7f12af7fe640 1 -- 172.21.15.27:0/828396484 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12c40041d0 con 0x564a4221db40 2024-09-19T08:13:00.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.922+0000 7f12af7fe640 1 -- 172.21.15.27:0/828396484 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f12c001b450 con 0x564a4221db40 2024-09-19T08:13:00.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.923+0000 7f12d8789740 10 client.15744 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:13:00.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.923+0000 7f12d8789740 10 client.15744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:13:00.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.923+0000 7f12d8789740 20 client.15744 populate_metadata read hostname 'smithi027' 2024-09-19T08:13:00.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.923+0000 7f12d8789740 1 --2- 172.21.15.27:0/828396484 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564a42237160 0x564a42239580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:00.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.923+0000 7f12d8789740 4 client.15744 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:13:00.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.923+0000 7f12d8789740 1 -- 172.21.15.27:0/828396484 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a4218f860 con 0x564a42237160 2024-09-19T08:13:00.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.923+0000 7f12cf7fe640 1 --2- 172.21.15.27:0/828396484 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564a42237160 0x564a42239580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:00.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.923+0000 7f12cf7fe640 1 --2- 172.21.15.27:0/828396484 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564a42237160 0x564a42239580 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3de74cbac120a1da server_cookie=b3623aef1e901b47 in_seq=0 out_seq=0 2024-09-19T08:13:00.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.923+0000 7f12af7fe640 10 client.15744 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:00.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.924+0000 7f12af7fe640 1 -- 172.21.15.27:0/828396484 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564a4218f860 con 0x564a42237160 2024-09-19T08:13:00.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.924+0000 7f12af7fe640 10 client.15744 handle_command_reply: tid=0 2024-09-19T08:13:00.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.924+0000 7f12d8789740 1 client.15744 shutdown 2024-09-19T08:13:00.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.924+0000 7f12d8789740 1 -- 172.21.15.27:0/828396484 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 msgr2=0x564a42224090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:00.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.924+0000 7f12d8789740 1 --2- 172.21.15.27:0/828396484 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a42224090 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f12c000bf70 tx=0x7f12c00128e0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.924+0000 7f12d8789740 1 -- 172.21.15.27:0/828396484 shutdown_connections 2024-09-19T08:13:00.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.924+0000 7f12d8789740 1 --2- 172.21.15.27:0/828396484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a42227370 0x564a422247d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.924+0000 7f12d8789740 1 --2- 172.21.15.27:0/828396484 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a42224090 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.924+0000 7f12d8789740 1 --2- 172.21.15.27:0/828396484 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564a42237160 0x564a42239580 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.925+0000 7f12d8789740 1 --2- 172.21.15.27:0/828396484 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a4221c5d0 0x564a42226de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.925+0000 7f12d8789740 1 -- 172.21.15.27:0/828396484 >> 172.21.15.27:0/828396484 conn(0x564a421e5310 msgr2=0x564a4221e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:00.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.925+0000 7f12af7fe640 0 client.15744 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:00.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.925+0000 7f12d8789740 1 -- 172.21.15.27:0/828396484 shutdown_connections 2024-09-19T08:13:00.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.925+0000 7f12d8789740 1 -- 172.21.15.27:0/828396484 wait complete. 2024-09-19T08:13:00.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.925+0000 7f12d8789740 20 client.15744 trim_cache size 0 max 16384 2024-09-19T08:13:00.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.938+0000 7f12d8789740 1 Processor -- start 2024-09-19T08:13:00.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.938+0000 7f12d8789740 1 -- start start 2024-09-19T08:13:00.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.938+0000 7f12d8789740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a4221c5d0 0x564a42224060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:00.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.938+0000 7f12d8789740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a42233310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:00.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.938+0000 7f12d8789740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a42227370 0x564a4223ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:00.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.938+0000 7f12d8789740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01ab710 con 0x564a4221db40 2024-09-19T08:13:00.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.938+0000 7f12d8789740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01adf90 con 0x564a42227370 2024-09-19T08:13:00.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.938+0000 7f12d8789740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01abd80 con 0x564a4221c5d0 2024-09-19T08:13:00.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.938+0000 7f12cffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a42233310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:00.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.938+0000 7f12cffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a42233310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46086/0 (socket says 172.21.15.27:46086) 2024-09-19T08:13:00.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.938+0000 7f12cffff640 1 -- 172.21.15.27:0/3526167016 learned_addr learned my addr 172.21.15.27:0/3526167016 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:00.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.938+0000 7f12cf7fe640 1 --2- 172.21.15.27:0/3526167016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a42227370 0x564a4223ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:00.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.938+0000 7f12cffff640 1 -- 172.21.15.27:0/3526167016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a4221c5d0 msgr2=0x564a42224060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:00.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.938+0000 7f12cffff640 1 --2- 172.21.15.27:0/3526167016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a4221c5d0 0x564a42224060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.938+0000 7f12cffff640 1 -- 172.21.15.27:0/3526167016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a42227370 msgr2=0x564a4223ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:00.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.938+0000 7f12cffff640 1 --2- 172.21.15.27:0/3526167016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a42227370 0x564a4223ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.938+0000 7f12cffff640 1 -- 172.21.15.27:0/3526167016 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a42218ed0 con 0x564a4221db40 2024-09-19T08:13:00.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.939+0000 7f12cffff640 1 --2- 172.21.15.27:0/3526167016 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a42233310 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f12c0005d00 tx=0x7f12c0005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2fcefedac1b7b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:00.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.939+0000 7f12b5ffb640 1 -- 172.21.15.27:0/3526167016 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c0000e60 con 0x564a4221db40 2024-09-19T08:13:00.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.939+0000 7f12b5ffb640 1 -- 172.21.15.27:0/3526167016 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12c0005850 con 0x564a4221db40 2024-09-19T08:13:00.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.939+0000 7f12b5ffb640 1 -- 172.21.15.27:0/3526167016 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c0004380 con 0x564a4221db40 2024-09-19T08:13:00.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.939+0000 7f12d8789740 1 -- 172.21.15.27:0/3526167016 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 msgr2=0x564a42233310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:00.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.939+0000 7f12d8789740 1 --2- 172.21.15.27:0/3526167016 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a42233310 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f12c0005d00 tx=0x7f12c0005770 comp rx=0 tx=0).stop 2024-09-19T08:13:00.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.939+0000 7f12d8789740 1 -- 172.21.15.27:0/3526167016 shutdown_connections 2024-09-19T08:13:00.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.939+0000 7f12d8789740 1 --2- 172.21.15.27:0/3526167016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a42227370 0x564a4223ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.939+0000 7f12d8789740 1 --2- 172.21.15.27:0/3526167016 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a42233310 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.939+0000 7f12d8789740 1 --2- 172.21.15.27:0/3526167016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a4221c5d0 0x564a42224060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.939+0000 7f12d8789740 1 -- 172.21.15.27:0/3526167016 >> 172.21.15.27:0/3526167016 conn(0x564a421e5310 msgr2=0x564a42223950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:00.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.939+0000 7f12d8789740 1 -- 172.21.15.27:0/3526167016 shutdown_connections 2024-09-19T08:13:00.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.939+0000 7f12d8789740 1 -- 172.21.15.27:0/3526167016 wait complete. 2024-09-19T08:13:00.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.940+0000 7f12d8789740 1 -- start start 2024-09-19T08:13:00.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.940+0000 7f12d8789740 1 Processor -- start 2024-09-19T08:13:00.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.940+0000 7f12d8789740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a4221c5d0 0x564a4222abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:00.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.940+0000 7f12d8789740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a4222b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:00.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.940+0000 7f12d8789740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a42227370 0x564a4229fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:00.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.940+0000 7f12d8789740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01ac450 con 0x564a4221db40 2024-09-19T08:13:00.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.940+0000 7f12d8789740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01ad8c0 con 0x564a4221c5d0 2024-09-19T08:13:00.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.940+0000 7f12d8789740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01acb20 con 0x564a42227370 2024-09-19T08:13:00.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.940+0000 7f12d8789740 10 client.0 _ll_register_callbacks cb 0x7f12c000bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:13:00.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.940+0000 7f12cffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a4222b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:00.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.940+0000 7f12cffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a4222b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46094/0 (socket says 172.21.15.27:46094) 2024-09-19T08:13:00.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.940+0000 7f12cffff640 1 -- 172.21.15.27:0/1941537943 learned_addr learned my addr 172.21.15.27:0/1941537943 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:00.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.941+0000 7f12cf7fe640 1 --2- 172.21.15.27:0/1941537943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a4221c5d0 0x564a4222abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:00.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.941+0000 7f12cf7fe640 1 --2- 172.21.15.27:0/1941537943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a42227370 0x564a4229fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:00.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.941+0000 7f12cffff640 1 -- 172.21.15.27:0/1941537943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a42227370 msgr2=0x564a4229fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:00.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.941+0000 7f12cffff640 1 --2- 172.21.15.27:0/1941537943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a42227370 0x564a4229fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.941+0000 7f12cffff640 1 -- 172.21.15.27:0/1941537943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a4221c5d0 msgr2=0x564a4222abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:00.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.941+0000 7f12cffff640 1 --2- 172.21.15.27:0/1941537943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a4221c5d0 0x564a4222abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.941+0000 7f12cffff640 1 -- 172.21.15.27:0/1941537943 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a422a0400 con 0x564a4221db40 2024-09-19T08:13:00.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.941+0000 7f12cf7fe640 1 --2- 172.21.15.27:0/1941537943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a42227370 0x564a4229fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:13:00.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.941+0000 7f12cffff640 1 --2- 172.21.15.27:0/1941537943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a4222b100 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f12c000b470 tx=0x7f12c001b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18b0c757997d34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:00.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.941+0000 7f12af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:13:00.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.941+0000 7f12af7fe640 1 -- 172.21.15.27:0/1941537943 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c001bd00 con 0x564a4221db40 2024-09-19T08:13:00.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.941+0000 7f12af7fe640 1 -- 172.21.15.27:0/1941537943 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f12c0004100 con 0x564a4221db40 2024-09-19T08:13:00.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.941+0000 7f12d8789740 1 -- 172.21.15.27:0/1941537943 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12c0005850 con 0x564a4221db40 2024-09-19T08:13:00.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.941+0000 7f12af7fe640 1 -- 172.21.15.27:0/1941537943 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f12c0004340 con 0x564a4221db40 2024-09-19T08:13:00.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.941+0000 7f12d8789740 10 client.15750 fetch_fsmap learned FSMap version 20 2024-09-19T08:13:00.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.941+0000 7f12d8789740 1 -- 172.21.15.27:0/1941537943 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564a422a16e0 con 0x564a4221db40 2024-09-19T08:13:00.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.941+0000 7f12af7fe640 1 -- 172.21.15.27:0/1941537943 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12c0005850 con 0x564a4221db40 2024-09-19T08:13:00.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.942+0000 7f12af7fe640 1 -- 172.21.15.27:0/1941537943 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f12c0026480 con 0x564a4221db40 2024-09-19T08:13:00.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.942+0000 7f12d8789740 10 client.15750 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:13:00.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.942+0000 7f12d8789740 10 client.15750 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:13:00.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.942+0000 7f12d8789740 20 client.15750 populate_metadata read hostname 'smithi027' 2024-09-19T08:13:00.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.942+0000 7f12d8789740 1 --2- 172.21.15.27:0/1941537943 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564a422a1cf0 0x564a422a4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:00.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.942+0000 7f12d8789740 4 client.15750 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:13:00.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.942+0000 7f12d8789740 1 -- 172.21.15.27:0/1941537943 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564a42189d70 con 0x564a422a1cf0 2024-09-19T08:13:00.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.942+0000 7f12cf7fe640 1 --2- 172.21.15.27:0/1941537943 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564a422a1cf0 0x564a422a4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:00.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.942+0000 7f12cf7fe640 1 --2- 172.21.15.27:0/1941537943 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564a422a1cf0 0x564a422a4110 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9c8a92bc294e46b server_cookie=d91f50d7c96f55a4 in_seq=0 out_seq=0 2024-09-19T08:13:00.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.942+0000 7f12af7fe640 10 client.15750 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:00.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.943+0000 7f12af7fe640 1 -- 172.21.15.27:0/1941537943 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564a42189d70 con 0x564a422a1cf0 2024-09-19T08:13:00.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.943+0000 7f12af7fe640 10 client.15750 handle_command_reply: tid=0 2024-09-19T08:13:00.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.943+0000 7f12d8789740 1 client.15750 shutdown 2024-09-19T08:13:00.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.943+0000 7f12d8789740 1 -- 172.21.15.27:0/1941537943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 msgr2=0x564a4222b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:00.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.943+0000 7f12d8789740 1 --2- 172.21.15.27:0/1941537943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a4222b100 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f12c000b470 tx=0x7f12c001b5d0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.943+0000 7f12d8789740 1 -- 172.21.15.27:0/1941537943 shutdown_connections 2024-09-19T08:13:00.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.943+0000 7f12d8789740 1 --2- 172.21.15.27:0/1941537943 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564a422a1cf0 0x564a422a4110 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.943+0000 7f12d8789740 1 --2- 172.21.15.27:0/1941537943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a42227370 0x564a4229fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.943+0000 7f12d8789740 1 --2- 172.21.15.27:0/1941537943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4221db40 0x564a4222b100 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.943+0000 7f12af7fe640 0 client.15750 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:00.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.943+0000 7f12d8789740 1 --2- 172.21.15.27:0/1941537943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564a4221c5d0 0x564a4222abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.943+0000 7f12d8789740 1 -- 172.21.15.27:0/1941537943 >> 172.21.15.27:0/1941537943 conn(0x564a421e5310 msgr2=0x564a42226110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:00.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.943+0000 7f12d8789740 1 -- 172.21.15.27:0/1941537943 shutdown_connections 2024-09-19T08:13:00.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.943+0000 7f12d8789740 1 -- 172.21.15.27:0/1941537943 wait complete. 2024-09-19T08:13:00.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.943+0000 7f12d8789740 20 client.15750 trim_cache size 0 max 16384 2024-09-19T08:13:00.503 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:13:00.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.943+0000 7f12d63b0640 1 -- 172.21.15.27:0/689879127 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f12b80a3430 msgr2=0x7f12b80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:00.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.943+0000 7f12d63b0640 1 --2- 172.21.15.27:0/689879127 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f12b80a3430 0x7f12b80a58f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f12c80ee390 tx=0x7f12c8004360 comp rx=0 tx=0).stop 2024-09-19T08:13:00.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.943+0000 7f12d63b0640 1 -- 172.21.15.27:0/689879127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f12d010c170 msgr2=0x7f12d019cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:00.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.943+0000 7f12d63b0640 1 --2- 172.21.15.27:0/689879127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f12d010c170 0x7f12d019cca0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f12c802ae70 tx=0x7f12c802f5b0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.944+0000 7f12d63b0640 1 -- 172.21.15.27:0/689879127 shutdown_connections 2024-09-19T08:13:00.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.944+0000 7f12d63b0640 1 --2- 172.21.15.27:0/689879127 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f12b80a3430 0x7f12b80a58f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.944+0000 7f12d63b0640 1 --2- 172.21.15.27:0/689879127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f12d010c170 0x7f12d019cca0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.944+0000 7f12d63b0640 1 --2- 172.21.15.27:0/689879127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12d0103660 0x7f12d0198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.944+0000 7f12d63b0640 1 --2- 172.21.15.27:0/689879127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12d0102d40 0x7f12d01983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:00.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.944+0000 7f12d63b0640 1 -- 172.21.15.27:0/689879127 >> 172.21.15.27:0/689879127 conn(0x7f12d00fc7a0 msgr2=0x7f12d00fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:00.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.944+0000 7f12d63b0640 1 -- 172.21.15.27:0/689879127 shutdown_connections 2024-09-19T08:13:00.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:12:59.944+0000 7f12d63b0640 1 -- 172.21.15.27:0/689879127 wait complete. 2024-09-19T08:13:01.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:01 smithi155 ceph-mon[35362]: pgmap v62: 97 pgs: 97 active+clean; 59 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 955 KiB/s wr, 236 op/s 2024-09-19T08:13:01.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:01 smithi027 ceph-mon[31209]: pgmap v62: 97 pgs: 97 active+clean; 59 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 955 KiB/s wr, 236 op/s 2024-09-19T08:13:01.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:01 smithi203 ceph-mon[35198]: pgmap v62: 97 pgs: 97 active+clean; 59 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 955 KiB/s wr, 236 op/s 2024-09-19T08:13:02.265 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:13:02.265 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:13:02.540 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:13:03.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.048+0000 7f609d60a640 1 -- 172.21.15.27:0/89694640 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6098106f10 msgr2=0x7f609810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:03.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.048+0000 7f609d60a640 1 --2- 172.21.15.27:0/89694640 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6098106f10 0x7f609810ea90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6090009ca0 tx=0x7f609002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.048+0000 7f609d60a640 1 -- 172.21.15.27:0/89694640 shutdown_connections 2024-09-19T08:13:03.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.048+0000 7f609d60a640 1 --2- 172.21.15.27:0/89694640 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6098106f10 0x7f609810ea90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.048+0000 7f609d60a640 1 --2- 172.21.15.27:0/89694640 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6098102790 0x7f60981067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.048+0000 7f609d60a640 1 --2- 172.21.15.27:0/89694640 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6098101de0 0x7f60981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.048+0000 7f609d60a640 1 -- 172.21.15.27:0/89694640 >> 172.21.15.27:0/89694640 conn(0x7f60980fd8c0 msgr2=0x7f60980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:03.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.048+0000 7f609d60a640 1 -- 172.21.15.27:0/89694640 shutdown_connections 2024-09-19T08:13:03.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.048+0000 7f609d60a640 1 -- 172.21.15.27:0/89694640 wait complete. 2024-09-19T08:13:03.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.049+0000 7f609d60a640 1 Processor -- start 2024-09-19T08:13:03.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.049+0000 7f609d60a640 1 -- start start 2024-09-19T08:13:03.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.049+0000 7f609d60a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6098101de0 0x7f60981985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:03.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.049+0000 7f609d60a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6098102790 0x7f6098198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:03.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.049+0000 7f609d60a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6098106f10 0x7f609819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:03.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.049+0000 7f609d60a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6098112010 con 0x7f6098102790 2024-09-19T08:13:03.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.049+0000 7f609d60a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6098111e90 con 0x7f6098101de0 2024-09-19T08:13:03.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.049+0000 7f609d60a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6098112190 con 0x7f6098106f10 2024-09-19T08:13:03.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.050+0000 7f608e7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6098102790 0x7f6098198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:03.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.050+0000 7f608e7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6098102790 0x7f6098198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46096/0 (socket says 172.21.15.27:46096) 2024-09-19T08:13:03.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.050+0000 7f608e7fc640 1 -- 172.21.15.27:0/144161137 learned_addr learned my addr 172.21.15.27:0/144161137 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:03.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.050+0000 7f6096ffd640 1 --2- 172.21.15.27:0/144161137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6098101de0 0x7f60981985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:03.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.050+0000 7f60977fe640 1 --2- 172.21.15.27:0/144161137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6098106f10 0x7f609819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:03.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.050+0000 7f608e7fc640 1 -- 172.21.15.27:0/144161137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6098106f10 msgr2=0x7f609819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:03.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.050+0000 7f608e7fc640 1 --2- 172.21.15.27:0/144161137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6098106f10 0x7f609819cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.050+0000 7f608e7fc640 1 -- 172.21.15.27:0/144161137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6098101de0 msgr2=0x7f60981985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:03.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.050+0000 7f608e7fc640 1 --2- 172.21.15.27:0/144161137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6098101de0 0x7f60981985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.050+0000 7f608e7fc640 1 -- 172.21.15.27:0/144161137 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609819d5a0 con 0x7f6098102790 2024-09-19T08:13:03.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.050+0000 7f6096ffd640 1 --2- 172.21.15.27:0/144161137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6098101de0 0x7f60981985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:13:03.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.050+0000 7f608e7fc640 1 --2- 172.21.15.27:0/144161137 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6098102790 0x7f6098198b30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f608000b4a0 tx=0x7f608000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:03.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.050+0000 7f6094ff9640 1 -- 172.21.15.27:0/144161137 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6080014070 con 0x7f6098102790 2024-09-19T08:13:03.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.050+0000 7f609d60a640 1 -- 172.21.15.27:0/144161137 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609819d890 con 0x7f6098102790 2024-09-19T08:13:03.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.050+0000 7f6094ff9640 1 -- 172.21.15.27:0/144161137 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6080010af0 con 0x7f6098102790 2024-09-19T08:13:03.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.050+0000 7f6094ff9640 1 -- 172.21.15.27:0/144161137 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6080017d10 con 0x7f6098102790 2024-09-19T08:13:03.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.050+0000 7f609d60a640 1 -- 172.21.15.27:0/144161137 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60981a5170 con 0x7f6098102790 2024-09-19T08:13:03.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.053+0000 7f6094ff9640 1 -- 172.21.15.27:0/144161137 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6080017070 con 0x7f6098102790 2024-09-19T08:13:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.053+0000 7f609f9e3740 1 Processor -- start 2024-09-19T08:13:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.053+0000 7f609f9e3740 1 -- start start 2024-09-19T08:13:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.053+0000 7f609f9e3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fb4e23b60 0x564fb4e23f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.053+0000 7f609f9e3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e24480 0x564fb4e2e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.053+0000 7f6094ff9640 1 --2- 172.21.15.27:0/144161137 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f60840a33b0 0x7f60840a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.053+0000 7f609f9e3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4e31130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.053+0000 7f609f9e3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x564fb4d89280 con 0x564fb4e2ed40 2024-09-19T08:13:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.053+0000 7f609f9e3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x564fb4d30b10 con 0x564fb4e24480 2024-09-19T08:13:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.053+0000 7f609f9e3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564fb4d85240 con 0x564fb4e23b60 2024-09-19T08:13:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.054+0000 7f60977fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4e31130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.054+0000 7f60977fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4e31130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46112/0 (socket says 172.21.15.27:46112) 2024-09-19T08:13:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.054+0000 7f60977fe640 1 -- 172.21.15.27:0/2924288630 learned_addr learned my addr 172.21.15.27:0/2924288630 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.054+0000 7f608e7fc640 1 --2- 172.21.15.27:0/144161137 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f60840a33b0 0x7f60840a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.054+0000 7f6094ff9640 1 -- 172.21.15.27:0/144161137 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f60800cf0a0 con 0x7f6098102790 2024-09-19T08:13:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.054+0000 7f6096ffd640 1 --2- 172.21.15.27:0/2924288630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e24480 0x564fb4e2e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.054+0000 7f60977fe640 1 --2- 172.21.15.27:0/2924288630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fb4e23b60 0x564fb4e23f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.054+0000 7f60977fe640 1 -- 172.21.15.27:0/2924288630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fb4e23b60 msgr2=0x564fb4e23f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.054+0000 7f60977fe640 1 --2- 172.21.15.27:0/2924288630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fb4e23b60 0x564fb4e23f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.054+0000 7f60977fe640 1 -- 172.21.15.27:0/2924288630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e24480 msgr2=0x564fb4e2e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.054+0000 7f60977fe640 1 --2- 172.21.15.27:0/2924288630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e24480 0x564fb4e2e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.054+0000 7f60977fe640 1 -- 172.21.15.27:0/2924288630 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fb4d3d1f0 con 0x564fb4e2ed40 2024-09-19T08:13:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.054+0000 7f6096ffd640 1 --2- 172.21.15.27:0/2924288630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e24480 0x564fb4e2e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:13:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.054+0000 7f608e7fc640 1 --2- 172.21.15.27:0/144161137 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f60840a33b0 0x7f60840a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f608009b180 tx=0x7f608001c310 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.054+0000 7f60977fe640 1 --2- 172.21.15.27:0/2924288630 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4e31130 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6090009dc0 tx=0x7f6090009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c9a11d41bb178b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.054+0000 7f608d7fa640 1 -- 172.21.15.27:0/2924288630 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090044030 con 0x564fb4e2ed40 2024-09-19T08:13:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.054+0000 7f608d7fa640 1 -- 172.21.15.27:0/2924288630 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6090036040 con 0x564fb4e2ed40 2024-09-19T08:13:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.055+0000 7f608d7fa640 1 -- 172.21.15.27:0/2924288630 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609002fbe0 con 0x564fb4e2ed40 2024-09-19T08:13:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.055+0000 7f609f9e3740 1 -- 172.21.15.27:0/2924288630 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 msgr2=0x564fb4e31130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.055+0000 7f609f9e3740 1 --2- 172.21.15.27:0/2924288630 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4e31130 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6090009dc0 tx=0x7f6090009360 comp rx=0 tx=0).stop 2024-09-19T08:13:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.055+0000 7f609f9e3740 1 -- 172.21.15.27:0/2924288630 shutdown_connections 2024-09-19T08:13:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.055+0000 7f609f9e3740 1 --2- 172.21.15.27:0/2924288630 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4e31130 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.055+0000 7f609f9e3740 1 --2- 172.21.15.27:0/2924288630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e24480 0x564fb4e2e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.055+0000 7f609f9e3740 1 --2- 172.21.15.27:0/2924288630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fb4e23b60 0x564fb4e23f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.055+0000 7f609f9e3740 1 -- 172.21.15.27:0/2924288630 >> 172.21.15.27:0/2924288630 conn(0x564fb4e200f0 msgr2=0x564fb4e204d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.055+0000 7f609f9e3740 1 -- 172.21.15.27:0/2924288630 shutdown_connections 2024-09-19T08:13:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.055+0000 7f609f9e3740 1 -- 172.21.15.27:0/2924288630 wait complete. 2024-09-19T08:13:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.056+0000 7f609f9e3740 1 -- start start 2024-09-19T08:13:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.056+0000 7f609f9e3740 1 Processor -- start 2024-09-19T08:13:03.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.056+0000 7f609f9e3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fb4e23b60 0x564fb4e2bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:03.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.056+0000 7f609f9e3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e24480 0x564fb4e2c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:03.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.056+0000 7f609f9e3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4e2c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:03.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.056+0000 7f609f9e3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x564fb4e31910 con 0x564fb4e2ed40 2024-09-19T08:13:03.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.056+0000 7f609f9e3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x564fb4d43f10 con 0x564fb4e24480 2024-09-19T08:13:03.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.056+0000 7f609f9e3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564fb4e31a90 con 0x564fb4e23b60 2024-09-19T08:13:03.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.056+0000 7f609f9e3740 10 client.0 _ll_register_callbacks cb 0x564fb4d0ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:13:03.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.056+0000 7f60977fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4e2c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:03.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.056+0000 7f60977fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4e2c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46120/0 (socket says 172.21.15.27:46120) 2024-09-19T08:13:03.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.056+0000 7f60977fe640 1 -- 172.21.15.27:0/848596304 learned_addr learned my addr 172.21.15.27:0/848596304 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:03.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.057+0000 7f6096ffd640 1 --2- 172.21.15.27:0/848596304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e24480 0x564fb4e2c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:03.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.057+0000 7f60977fe640 1 --2- 172.21.15.27:0/848596304 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fb4e23b60 0x564fb4e2bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:03.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.057+0000 7f60977fe640 1 -- 172.21.15.27:0/848596304 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fb4e23b60 msgr2=0x564fb4e2bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:03.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.057+0000 7f60977fe640 1 --2- 172.21.15.27:0/848596304 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fb4e23b60 0x564fb4e2bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.057+0000 7f60977fe640 1 -- 172.21.15.27:0/848596304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e24480 msgr2=0x564fb4e2c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:03.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.057+0000 7f60977fe640 1 --2- 172.21.15.27:0/848596304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e24480 0x564fb4e2c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.057+0000 7f60977fe640 1 -- 172.21.15.27:0/848596304 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fb4afa6a0 con 0x564fb4e2ed40 2024-09-19T08:13:03.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.057+0000 7f60977fe640 1 --2- 172.21.15.27:0/848596304 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4e2c660 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6090009d90 tx=0x7f6090040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4870ed8bba345dba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:03.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.057+0000 7f607e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:13:03.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.057+0000 7f607e7fc640 1 -- 172.21.15.27:0/848596304 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090044070 con 0x564fb4e2ed40 2024-09-19T08:13:03.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.057+0000 7f607e7fc640 1 -- 172.21.15.27:0/848596304 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f6090031680 con 0x564fb4e2ed40 2024-09-19T08:13:03.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.057+0000 7f609f9e3740 1 -- 172.21.15.27:0/848596304 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6090036040 con 0x564fb4e2ed40 2024-09-19T08:13:03.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.057+0000 7f607e7fc640 1 -- 172.21.15.27:0/848596304 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f609005a020 con 0x564fb4e2ed40 2024-09-19T08:13:03.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.057+0000 7f609f9e3740 10 client.15762 fetch_fsmap learned FSMap version 20 2024-09-19T08:13:03.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.057+0000 7f609f9e3740 1 -- 172.21.15.27:0/848596304 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564fb4e31910 con 0x564fb4e2ed40 2024-09-19T08:13:03.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.057+0000 7f607e7fc640 1 -- 172.21.15.27:0/848596304 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6090036040 con 0x564fb4e2ed40 2024-09-19T08:13:03.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.058+0000 7f607e7fc640 1 -- 172.21.15.27:0/848596304 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6090030d00 con 0x564fb4e2ed40 2024-09-19T08:13:03.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.058+0000 7f609f9e3740 10 client.15762 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:13:03.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.058+0000 7f609f9e3740 10 client.15762 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:13:03.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.058+0000 7f609f9e3740 20 client.15762 populate_metadata read hostname 'smithi027' 2024-09-19T08:13:03.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.058+0000 7f609f9e3740 1 --2- 172.21.15.27:0/848596304 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564fb4e3e660 0x564fb4e40a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:03.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.058+0000 7f609f9e3740 4 client.15762 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:13:03.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.058+0000 7f609f9e3740 1 -- 172.21.15.27:0/848596304 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fb4d967f0 con 0x564fb4e3e660 2024-09-19T08:13:03.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.058+0000 7f6096ffd640 1 --2- 172.21.15.27:0/848596304 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564fb4e3e660 0x564fb4e40a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:03.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.058+0000 7f607e7fc640 10 client.15762 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:03.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.058+0000 7f6096ffd640 1 --2- 172.21.15.27:0/848596304 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564fb4e3e660 0x564fb4e40a50 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6df34c9bc889b21f server_cookie=27ea13f2d1df87d6 in_seq=0 out_seq=0 2024-09-19T08:13:03.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.059+0000 7f607e7fc640 1 -- 172.21.15.27:0/848596304 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564fb4d967f0 con 0x564fb4e3e660 2024-09-19T08:13:03.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.059+0000 7f607e7fc640 10 client.15762 handle_command_reply: tid=0 2024-09-19T08:13:03.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.059+0000 7f609f9e3740 1 client.15762 shutdown 2024-09-19T08:13:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.059+0000 7f609f9e3740 1 -- 172.21.15.27:0/848596304 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 msgr2=0x564fb4e2c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.059+0000 7f609f9e3740 1 --2- 172.21.15.27:0/848596304 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4e2c660 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6090009d90 tx=0x7f6090040040 comp rx=0 tx=0).stop 2024-09-19T08:13:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.059+0000 7f609f9e3740 1 -- 172.21.15.27:0/848596304 shutdown_connections 2024-09-19T08:13:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.059+0000 7f609f9e3740 1 --2- 172.21.15.27:0/848596304 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4e2c660 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.059+0000 7f609f9e3740 1 --2- 172.21.15.27:0/848596304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e24480 0x564fb4e2c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.059+0000 7f609f9e3740 1 --2- 172.21.15.27:0/848596304 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564fb4e3e660 0x564fb4e40a50 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.059+0000 7f609f9e3740 1 --2- 172.21.15.27:0/848596304 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fb4e23b60 0x564fb4e2bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.059+0000 7f607e7fc640 0 client.15762 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.059+0000 7f609f9e3740 1 -- 172.21.15.27:0/848596304 >> 172.21.15.27:0/848596304 conn(0x564fb4e200f0 msgr2=0x564fb4e25dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.059+0000 7f609f9e3740 1 -- 172.21.15.27:0/848596304 shutdown_connections 2024-09-19T08:13:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.059+0000 7f609f9e3740 1 -- 172.21.15.27:0/848596304 wait complete. 2024-09-19T08:13:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.059+0000 7f609f9e3740 20 client.15762 trim_cache size 0 max 16384 2024-09-19T08:13:03.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.077+0000 7f609f9e3740 1 Processor -- start 2024-09-19T08:13:03.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.077+0000 7f609f9e3740 1 -- start start 2024-09-19T08:13:03.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.078+0000 7f609f9e3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fb4e23b60 0x564fb4e2de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:03.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.078+0000 7f609f9e3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e24480 0x564fb4e46190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:03.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.078+0000 7f609f9e3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4e466d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:03.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.078+0000 7f609f9e3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f60981ab870 con 0x564fb4e2ed40 2024-09-19T08:13:03.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.078+0000 7f609f9e3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f60981ae0f0 con 0x564fb4e24480 2024-09-19T08:13:03.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.078+0000 7f609f9e3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f60981abee0 con 0x564fb4e23b60 2024-09-19T08:13:03.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.078+0000 7f60977fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4e466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:03.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.078+0000 7f60977fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4e466d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46130/0 (socket says 172.21.15.27:46130) 2024-09-19T08:13:03.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.078+0000 7f60977fe640 1 -- 172.21.15.27:0/1502847106 learned_addr learned my addr 172.21.15.27:0/1502847106 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:03.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.078+0000 7f60977fe640 1 --2- 172.21.15.27:0/1502847106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fb4e23b60 0x564fb4e2de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:03.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.078+0000 7f6096ffd640 1 --2- 172.21.15.27:0/1502847106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e24480 0x564fb4e46190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:03.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.078+0000 7f60977fe640 1 -- 172.21.15.27:0/1502847106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fb4e23b60 msgr2=0x564fb4e2de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:03.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.078+0000 7f60977fe640 1 --2- 172.21.15.27:0/1502847106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fb4e23b60 0x564fb4e2de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.078+0000 7f60977fe640 1 -- 172.21.15.27:0/1502847106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e24480 msgr2=0x564fb4e46190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:03.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.078+0000 7f60977fe640 1 --2- 172.21.15.27:0/1502847106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e24480 0x564fb4e46190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.078+0000 7f60977fe640 1 -- 172.21.15.27:0/1502847106 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fb4e1fb90 con 0x564fb4e2ed40 2024-09-19T08:13:03.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.078+0000 7f6096ffd640 1 --2- 172.21.15.27:0/1502847106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e24480 0x564fb4e46190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:13:03.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.078+0000 7f60977fe640 1 --2- 172.21.15.27:0/1502847106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4e466d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x564fb4e2ccd0 tx=0x7f6090009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6897982bcee435c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:03.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.079+0000 7f608cff9640 1 -- 172.21.15.27:0/1502847106 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090044040 con 0x564fb4e2ed40 2024-09-19T08:13:03.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.079+0000 7f608cff9640 1 -- 172.21.15.27:0/1502847106 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6090036020 con 0x564fb4e2ed40 2024-09-19T08:13:03.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.079+0000 7f608cff9640 1 -- 172.21.15.27:0/1502847106 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090031660 con 0x564fb4e2ed40 2024-09-19T08:13:03.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.079+0000 7f609f9e3740 1 -- 172.21.15.27:0/1502847106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 msgr2=0x564fb4e466d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:03.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.079+0000 7f609f9e3740 1 --2- 172.21.15.27:0/1502847106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4e466d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x564fb4e2ccd0 tx=0x7f6090009360 comp rx=0 tx=0).stop 2024-09-19T08:13:03.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.079+0000 7f609f9e3740 1 -- 172.21.15.27:0/1502847106 shutdown_connections 2024-09-19T08:13:03.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.079+0000 7f609f9e3740 1 --2- 172.21.15.27:0/1502847106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4e466d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.079+0000 7f609f9e3740 1 --2- 172.21.15.27:0/1502847106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e24480 0x564fb4e46190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.079+0000 7f609f9e3740 1 --2- 172.21.15.27:0/1502847106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fb4e23b60 0x564fb4e2de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.080+0000 7f609f9e3740 1 -- 172.21.15.27:0/1502847106 >> 172.21.15.27:0/1502847106 conn(0x564fb4e200f0 msgr2=0x564fb4e25dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:03.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.080+0000 7f609f9e3740 1 -- 172.21.15.27:0/1502847106 shutdown_connections 2024-09-19T08:13:03.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.080+0000 7f609f9e3740 1 -- 172.21.15.27:0/1502847106 wait complete. 2024-09-19T08:13:03.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.080+0000 7f609f9e3740 1 -- start start 2024-09-19T08:13:03.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.080+0000 7f609f9e3740 1 Processor -- start 2024-09-19T08:13:03.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.080+0000 7f609f9e3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e23b60 0x564fb4e33180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:03.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.080+0000 7f609f9e3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fb4e24480 0x564fb4e336c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:03.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.080+0000 7f609f9e3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4ea8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:03.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.080+0000 7f609f9e3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f60981ac5b0 con 0x564fb4e2ed40 2024-09-19T08:13:03.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.080+0000 7f609f9e3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f60981ada20 con 0x564fb4e23b60 2024-09-19T08:13:03.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.080+0000 7f609f9e3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f60981acc80 con 0x564fb4e24480 2024-09-19T08:13:03.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.080+0000 7f609f9e3740 10 client.0 _ll_register_callbacks cb 0x7f6090031bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:13:03.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.080+0000 7f60977fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4ea8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:03.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.080+0000 7f60977fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4ea8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46146/0 (socket says 172.21.15.27:46146) 2024-09-19T08:13:03.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.080+0000 7f60977fe640 1 -- 172.21.15.27:0/392882211 learned_addr learned my addr 172.21.15.27:0/392882211 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:03.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.081+0000 7f60977fe640 1 --2- 172.21.15.27:0/392882211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e23b60 0x564fb4e33180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:03.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.081+0000 7f6096ffd640 1 --2- 172.21.15.27:0/392882211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fb4e24480 0x564fb4e336c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:03.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.081+0000 7f60977fe640 1 -- 172.21.15.27:0/392882211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fb4e24480 msgr2=0x564fb4e336c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:03.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.081+0000 7f60977fe640 1 --2- 172.21.15.27:0/392882211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fb4e24480 0x564fb4e336c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.081+0000 7f60977fe640 1 -- 172.21.15.27:0/392882211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e23b60 msgr2=0x564fb4e33180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:03.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.081+0000 7f60977fe640 1 --2- 172.21.15.27:0/392882211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e23b60 0x564fb4e33180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.081+0000 7f60977fe640 1 -- 172.21.15.27:0/392882211 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fb4ea86a0 con 0x564fb4e2ed40 2024-09-19T08:13:03.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.081+0000 7f60977fe640 1 --2- 172.21.15.27:0/392882211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4ea8160 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6090009430 tx=0x7f6090058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1fe18925a30c66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:03.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.081+0000 7f607e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:13:03.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.081+0000 7f607e7fc640 1 -- 172.21.15.27:0/392882211 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090044040 con 0x564fb4e2ed40 2024-09-19T08:13:03.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.081+0000 7f607e7fc640 1 -- 172.21.15.27:0/392882211 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f6090058d10 con 0x564fb4e2ed40 2024-09-19T08:13:03.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.081+0000 7f609f9e3740 1 -- 172.21.15.27:0/392882211 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6090036020 con 0x564fb4e2ed40 2024-09-19T08:13:03.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.081+0000 7f607e7fc640 1 -- 172.21.15.27:0/392882211 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6090031660 con 0x564fb4e2ed40 2024-09-19T08:13:03.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.081+0000 7f609f9e3740 10 client.15768 fetch_fsmap learned FSMap version 20 2024-09-19T08:13:03.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.081+0000 7f609f9e3740 1 -- 172.21.15.27:0/392882211 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564fb4ea98f0 con 0x564fb4e2ed40 2024-09-19T08:13:03.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.081+0000 7f607e7fc640 1 -- 172.21.15.27:0/392882211 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6090036020 con 0x564fb4e2ed40 2024-09-19T08:13:03.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.082+0000 7f607e7fc640 1 -- 172.21.15.27:0/392882211 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f60900042f0 con 0x564fb4e2ed40 2024-09-19T08:13:03.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.082+0000 7f609f9e3740 10 client.15768 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:13:03.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.082+0000 7f609f9e3740 10 client.15768 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:13:03.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.082+0000 7f609f9e3740 20 client.15768 populate_metadata read hostname 'smithi027' 2024-09-19T08:13:03.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.082+0000 7f609f9e3740 1 --2- 172.21.15.27:0/392882211 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564fb4ea9eb0 0x564fb4eac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:03.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.082+0000 7f609f9e3740 4 client.15768 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:13:03.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.082+0000 7f609f9e3740 1 -- 172.21.15.27:0/392882211 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564fb4d90d00 con 0x564fb4ea9eb0 2024-09-19T08:13:03.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.082+0000 7f6096ffd640 1 --2- 172.21.15.27:0/392882211 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564fb4ea9eb0 0x564fb4eac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:03.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.082+0000 7f6096ffd640 1 --2- 172.21.15.27:0/392882211 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564fb4ea9eb0 0x564fb4eac2a0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b318301da59fc5ec server_cookie=c0bd8ec8b6e07df in_seq=0 out_seq=0 2024-09-19T08:13:03.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.082+0000 7f607e7fc640 10 client.15768 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:03.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.084+0000 7f607e7fc640 1 -- 172.21.15.27:0/392882211 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564fb4d90d00 con 0x564fb4ea9eb0 2024-09-19T08:13:03.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.084+0000 7f607e7fc640 10 client.15768 handle_command_reply: tid=0 2024-09-19T08:13:03.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.084+0000 7f609f9e3740 1 client.15768 shutdown 2024-09-19T08:13:03.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.084+0000 7f609f9e3740 1 -- 172.21.15.27:0/392882211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 msgr2=0x564fb4ea8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:03.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.084+0000 7f609f9e3740 1 --2- 172.21.15.27:0/392882211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4ea8160 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6090009430 tx=0x7f6090058040 comp rx=0 tx=0).stop 2024-09-19T08:13:03.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.084+0000 7f609f9e3740 1 -- 172.21.15.27:0/392882211 shutdown_connections 2024-09-19T08:13:03.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.084+0000 7f609f9e3740 1 --2- 172.21.15.27:0/392882211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564fb4e2ed40 0x564fb4ea8160 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.084+0000 7f609f9e3740 1 --2- 172.21.15.27:0/392882211 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x564fb4ea9eb0 0x564fb4eac2a0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.084+0000 7f609f9e3740 1 --2- 172.21.15.27:0/392882211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fb4e24480 0x564fb4e336c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.084+0000 7f609f9e3740 1 --2- 172.21.15.27:0/392882211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564fb4e23b60 0x564fb4e33180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.084+0000 7f609f9e3740 1 -- 172.21.15.27:0/392882211 >> 172.21.15.27:0/392882211 conn(0x564fb4e200f0 msgr2=0x564fb4e2bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:03.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.084+0000 7f607e7fc640 0 client.15768 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:03.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.084+0000 7f609f9e3740 1 -- 172.21.15.27:0/392882211 shutdown_connections 2024-09-19T08:13:03.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.084+0000 7f609f9e3740 1 -- 172.21.15.27:0/392882211 wait complete. 2024-09-19T08:13:03.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.084+0000 7f609f9e3740 20 client.15768 trim_cache size 0 max 16384 2024-09-19T08:13:03.089 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:13:03.089 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:13:03.089 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "2f5270a0-c0ec-4b4a-80d4-5efa491620d9", 2024-09-19T08:13:03.089 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:13:03.089 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:13:03.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.085+0000 7f609d60a640 1 -- 172.21.15.27:0/144161137 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f60840a33b0 msgr2=0x7f60840a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:03.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.085+0000 7f609d60a640 1 --2- 172.21.15.27:0/144161137 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f60840a33b0 0x7f60840a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f608009b180 tx=0x7f608001c310 comp rx=0 tx=0).stop 2024-09-19T08:13:03.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.085+0000 7f609d60a640 1 -- 172.21.15.27:0/144161137 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6098102790 msgr2=0x7f6098198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:03.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.085+0000 7f609d60a640 1 --2- 172.21.15.27:0/144161137 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6098102790 0x7f6098198b30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f608000b4a0 tx=0x7f608000b960 comp rx=0 tx=0).stop 2024-09-19T08:13:03.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.085+0000 7f609d60a640 1 -- 172.21.15.27:0/144161137 shutdown_connections 2024-09-19T08:13:03.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.085+0000 7f609d60a640 1 --2- 172.21.15.27:0/144161137 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f60840a33b0 0x7f60840a5870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.085+0000 7f609d60a640 1 --2- 172.21.15.27:0/144161137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6098106f10 0x7f609819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.085+0000 7f609d60a640 1 --2- 172.21.15.27:0/144161137 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6098102790 0x7f6098198b30 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.085+0000 7f609d60a640 1 --2- 172.21.15.27:0/144161137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6098101de0 0x7f60981985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:03.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.085+0000 7f609d60a640 1 -- 172.21.15.27:0/144161137 >> 172.21.15.27:0/144161137 conn(0x7f60980fd8c0 msgr2=0x7f60980fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:03.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.085+0000 7f609d60a640 1 -- 172.21.15.27:0/144161137 shutdown_connections 2024-09-19T08:13:03.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:03.085+0000 7f609d60a640 1 -- 172.21.15.27:0/144161137 wait complete. 2024-09-19T08:13:03.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:03 smithi027 ceph-mon[31209]: pgmap v63: 97 pgs: 97 active+clean; 59 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 955 KiB/s wr, 236 op/s 2024-09-19T08:13:03.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:03 smithi155 ceph-mon[35362]: pgmap v63: 97 pgs: 97 active+clean; 59 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 955 KiB/s wr, 236 op/s 2024-09-19T08:13:03.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:03 smithi203 ceph-mon[35198]: pgmap v63: 97 pgs: 97 active+clean; 59 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 955 KiB/s wr, 236 op/s 2024-09-19T08:13:03.738 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:13:03.997 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:13:04.379 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:04 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:13:04.379 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:04 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:13:04.379 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:04 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:13:04.379 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:04 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:13:04.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.463+0000 7fc3e81db640 1 -- 172.21.15.27:0/112070016 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e0103660 msgr2=0x7fc3e010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:04.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.463+0000 7fc3e81db640 1 --2- 172.21.15.27:0/112070016 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e0103660 0x7fc3e010bb50 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009900 tx=0x7fc3d002a480 comp rx=0 tx=0).stop 2024-09-19T08:13:04.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.463+0000 7fc3e81db640 1 -- 172.21.15.27:0/112070016 shutdown_connections 2024-09-19T08:13:04.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.463+0000 7fc3e81db640 1 --2- 172.21.15.27:0/112070016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3e010c170 0x7fc3e010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.463+0000 7fc3e81db640 1 --2- 172.21.15.27:0/112070016 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e0103660 0x7fc3e010bb50 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.463+0000 7fc3e81db640 1 --2- 172.21.15.27:0/112070016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3e0102d40 0x7fc3e0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.463+0000 7fc3e81db640 1 -- 172.21.15.27:0/112070016 >> 172.21.15.27:0/112070016 conn(0x7fc3e00fc7a0 msgr2=0x7fc3e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:04.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.463+0000 7fc3e81db640 1 -- 172.21.15.27:0/112070016 shutdown_connections 2024-09-19T08:13:04.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.463+0000 7fc3e81db640 1 -- 172.21.15.27:0/112070016 wait complete. 2024-09-19T08:13:04.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.464+0000 7fc3e81db640 1 Processor -- start 2024-09-19T08:13:04.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.464+0000 7fc3e81db640 1 -- start start 2024-09-19T08:13:04.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.464+0000 7fc3e81db640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e0102d40 0x7fc3e019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:04.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.464+0000 7fc3e81db640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3e0103660 0x7fc3e019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:04.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.464+0000 7fc3e81db640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3e010c170 0x7fc3e019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.464+0000 7fc3e81db640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e0111f70 con 0x7fc3e0102d40 2024-09-19T08:13:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.464+0000 7fc3e81db640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e0111df0 con 0x7fc3e0103660 2024-09-19T08:13:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.464+0000 7fc3e81db640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01120f0 con 0x7fc3e010c170 2024-09-19T08:13:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.464+0000 7fc3e5f77640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e0102d40 0x7fc3e019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.464+0000 7fc3e5f77640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e0102d40 0x7fc3e019a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46158/0 (socket says 172.21.15.27:46158) 2024-09-19T08:13:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.464+0000 7fc3e5f77640 1 -- 172.21.15.27:0/1605533146 learned_addr learned my addr 172.21.15.27:0/1605533146 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.464+0000 7fc3e6778640 1 --2- 172.21.15.27:0/1605533146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3e010c170 0x7fc3e019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.465+0000 7fc3e5776640 1 --2- 172.21.15.27:0/1605533146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3e0103660 0x7fc3e019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.465+0000 7fc3e5f77640 1 -- 172.21.15.27:0/1605533146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3e010c170 msgr2=0x7fc3e019eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.465+0000 7fc3e5f77640 1 --2- 172.21.15.27:0/1605533146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3e010c170 0x7fc3e019eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.465+0000 7fc3e5f77640 1 -- 172.21.15.27:0/1605533146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3e0103660 msgr2=0x7fc3e019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.465+0000 7fc3e5f77640 1 --2- 172.21.15.27:0/1605533146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3e0103660 0x7fc3e019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.465+0000 7fc3e5f77640 1 -- 172.21.15.27:0/1605533146 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e019f5b0 con 0x7fc3e0102d40 2024-09-19T08:13:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.465+0000 7fc3e6778640 1 --2- 172.21.15.27:0/1605533146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3e010c170 0x7fc3e019eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:13:04.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.465+0000 7fc3e5f77640 1 --2- 172.21.15.27:0/1605533146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e0102d40 0x7fc3e019a600 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00c920 tx=0x7fc3dc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:04.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.465+0000 7fc3d6ffd640 1 -- 172.21.15.27:0/1605533146 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc007c70 con 0x7fc3e0102d40 2024-09-19T08:13:04.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.465+0000 7fc3d6ffd640 1 -- 172.21.15.27:0/1605533146 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3dc007e10 con 0x7fc3e0102d40 2024-09-19T08:13:04.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.465+0000 7fc3e81db640 1 -- 172.21.15.27:0/1605533146 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e019f8a0 con 0x7fc3e0102d40 2024-09-19T08:13:04.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.465+0000 7fc3d6ffd640 1 -- 172.21.15.27:0/1605533146 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc018890 con 0x7fc3e0102d40 2024-09-19T08:13:04.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.465+0000 7fc3e81db640 1 -- 172.21.15.27:0/1605533146 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e01a7180 con 0x7fc3e0102d40 2024-09-19T08:13:04.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.467+0000 7fc3d6ffd640 1 -- 172.21.15.27:0/1605533146 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc3dc018a70 con 0x7fc3e0102d40 2024-09-19T08:13:04.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.468+0000 7fc3ea5b4740 1 Processor -- start 2024-09-19T08:13:04.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.468+0000 7fc3ea5b4740 1 -- start start 2024-09-19T08:13:04.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.468+0000 7fc3ea5b4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3bc5d04a0 0x55c3bc5d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:04.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.468+0000 7fc3ea5b4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5d0dc0 0x55c3bc5db140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:04.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.468+0000 7fc3ea5b4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5db680 0x55c3bc5dda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:04.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.468+0000 7fc3ea5b4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c3bc5362e0 con 0x55c3bc5db680 2024-09-19T08:13:04.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.468+0000 7fc3ea5b4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c3bc4ddce0 con 0x55c3bc5d0dc0 2024-09-19T08:13:04.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.468+0000 7fc3ea5b4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c3bc5322a0 con 0x55c3bc5d04a0 2024-09-19T08:13:04.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.468+0000 7fc3d6ffd640 1 --2- 172.21.15.27:0/1605533146 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc3cc0a33b0 0x7fc3cc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:04.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.468+0000 7fc3e5776640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5db680 0x55c3bc5dda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:04.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.468+0000 7fc3e5776640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5db680 0x55c3bc5dda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46168/0 (socket says 172.21.15.27:46168) 2024-09-19T08:13:04.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.468+0000 7fc3e5776640 1 -- 172.21.15.27:0/1052295829 learned_addr learned my addr 172.21.15.27:0/1052295829 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:04.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.468+0000 7fc3e5f77640 1 --2- 172.21.15.27:0/1052295829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5d0dc0 0x55c3bc5db140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:04.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.469+0000 7fc3e6778640 1 --2- 172.21.15.27:0/1052295829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3bc5d04a0 0x55c3bc5d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:04.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.469+0000 7fc3e6778640 1 --2- 172.21.15.27:0/1605533146 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc3cc0a33b0 0x7fc3cc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:04.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.469+0000 7fc3d6ffd640 1 -- 172.21.15.27:0/1605533146 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fc3dc0cff30 con 0x7fc3e0102d40 2024-09-19T08:13:04.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.469+0000 7fc3e5776640 1 -- 172.21.15.27:0/1052295829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3bc5d04a0 msgr2=0x55c3bc5d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:04.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.469+0000 7fc3e5776640 1 --2- 172.21.15.27:0/1052295829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3bc5d04a0 0x55c3bc5d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.469+0000 7fc3e5776640 1 -- 172.21.15.27:0/1052295829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5d0dc0 msgr2=0x55c3bc5db140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:04.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.469+0000 7fc3e5776640 1 --2- 172.21.15.27:0/1052295829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5d0dc0 0x55c3bc5db140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.469+0000 7fc3e5776640 1 -- 172.21.15.27:0/1052295829 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3bc4c2440 con 0x55c3bc5db680 2024-09-19T08:13:04.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.469+0000 7fc3e5f77640 1 --2- 172.21.15.27:0/1052295829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5d0dc0 0x55c3bc5db140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:13:04.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.469+0000 7fc3e5776640 1 --2- 172.21.15.27:0/1052295829 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5db680 0x55c3bc5dda70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009900 tx=0x7fc3d0032c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51907820813cb528 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:04.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.469+0000 7fc3e6778640 1 --2- 172.21.15.27:0/1605533146 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc3cc0a33b0 0x7fc3cc0a5870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009fd0 tx=0x7fc3d8009280 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:04.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.469+0000 7fc3cbfff640 1 -- 172.21.15.27:0/1052295829 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d003f070 con 0x55c3bc5db680 2024-09-19T08:13:04.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.469+0000 7fc3cbfff640 1 -- 172.21.15.27:0/1052295829 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3d0032e20 con 0x55c3bc5db680 2024-09-19T08:13:04.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.469+0000 7fc3cbfff640 1 -- 172.21.15.27:0/1052295829 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0035070 con 0x55c3bc5db680 2024-09-19T08:13:04.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.470+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/1052295829 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5db680 msgr2=0x55c3bc5dda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:04.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.470+0000 7fc3ea5b4740 1 --2- 172.21.15.27:0/1052295829 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5db680 0x55c3bc5dda70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009900 tx=0x7fc3d0032c30 comp rx=0 tx=0).stop 2024-09-19T08:13:04.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.470+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/1052295829 shutdown_connections 2024-09-19T08:13:04.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.470+0000 7fc3ea5b4740 1 --2- 172.21.15.27:0/1052295829 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5db680 0x55c3bc5dda70 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.470+0000 7fc3ea5b4740 1 --2- 172.21.15.27:0/1052295829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5d0dc0 0x55c3bc5db140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.470+0000 7fc3ea5b4740 1 --2- 172.21.15.27:0/1052295829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3bc5d04a0 0x55c3bc5d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.470+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/1052295829 >> 172.21.15.27:0/1052295829 conn(0x55c3bc5cca30 msgr2=0x55c3bc5cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:04.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.470+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/1052295829 shutdown_connections 2024-09-19T08:13:04.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.470+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/1052295829 wait complete. 2024-09-19T08:13:04.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.470+0000 7fc3ea5b4740 1 -- start start 2024-09-19T08:13:04.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.471+0000 7fc3ea5b4740 1 Processor -- start 2024-09-19T08:13:04.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.471+0000 7fc3ea5b4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5d04a0 0x55c3bc5db060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:04.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.471+0000 7fc3ea5b4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d0dc0 0x55c3bc5d8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:04.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.471+0000 7fc3ea5b4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3bc5db680 0x55c3bc5d88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:04.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.471+0000 7fc3ea5b4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c3bc5de250 con 0x55c3bc5d0dc0 2024-09-19T08:13:04.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.471+0000 7fc3ea5b4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c3bc4f1050 con 0x55c3bc5d04a0 2024-09-19T08:13:04.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.471+0000 7fc3ea5b4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c3bc5de3d0 con 0x55c3bc5db680 2024-09-19T08:13:04.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.471+0000 7fc3ea5b4740 10 client.0 _ll_register_callbacks cb 0x55c3bc531160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:13:04.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.471+0000 7fc3e5776640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d0dc0 0x55c3bc5d8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:04.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.471+0000 7fc3e5776640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d0dc0 0x55c3bc5d8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46182/0 (socket says 172.21.15.27:46182) 2024-09-19T08:13:04.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.471+0000 7fc3e5776640 1 -- 172.21.15.27:0/4185366943 learned_addr learned my addr 172.21.15.27:0/4185366943 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:04.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.471+0000 7fc3e5f77640 1 --2- 172.21.15.27:0/4185366943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5d04a0 0x55c3bc5db060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:04.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.471+0000 7fc3e6778640 1 --2- 172.21.15.27:0/4185366943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3bc5db680 0x55c3bc5d88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:04.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.471+0000 7fc3e5776640 1 -- 172.21.15.27:0/4185366943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3bc5db680 msgr2=0x55c3bc5d88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:04.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.472+0000 7fc3e5776640 1 --2- 172.21.15.27:0/4185366943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3bc5db680 0x55c3bc5d88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.472+0000 7fc3e5776640 1 -- 172.21.15.27:0/4185366943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5d04a0 msgr2=0x55c3bc5db060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:04.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.472+0000 7fc3e5776640 1 --2- 172.21.15.27:0/4185366943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5d04a0 0x55c3bc5db060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.472+0000 7fc3e5776640 1 -- 172.21.15.27:0/4185366943 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3bc2a73c0 con 0x55c3bc5d0dc0 2024-09-19T08:13:04.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.472+0000 7fc3e5f77640 1 --2- 172.21.15.27:0/4185366943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5d04a0 0x55c3bc5db060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:13:04.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.472+0000 7fc3e6778640 1 --2- 172.21.15.27:0/4185366943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3bc5db680 0x55c3bc5d88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:13:04.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.472+0000 7fc3e5776640 1 --2- 172.21.15.27:0/4185366943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d0dc0 0x55c3bc5d8310 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0005290 tx=0x7fc3d0031a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d63469a0bdcf28 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:04.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.472+0000 7fc3c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:13:04.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.472+0000 7fc3c97fa640 1 -- 172.21.15.27:0/4185366943 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d004a020 con 0x55c3bc5d0dc0 2024-09-19T08:13:04.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.472+0000 7fc3c97fa640 1 -- 172.21.15.27:0/4185366943 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fc3d00035f0 con 0x55c3bc5d0dc0 2024-09-19T08:13:04.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.472+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/4185366943 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3d0032e20 con 0x55c3bc5d0dc0 2024-09-19T08:13:04.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.472+0000 7fc3c97fa640 1 -- 172.21.15.27:0/4185366943 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc3d0055050 con 0x55c3bc5d0dc0 2024-09-19T08:13:04.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.472+0000 7fc3ea5b4740 10 client.15780 fetch_fsmap learned FSMap version 20 2024-09-19T08:13:04.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.472+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/4185366943 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c3bc5e9c90 con 0x55c3bc5d0dc0 2024-09-19T08:13:04.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.472+0000 7fc3c97fa640 1 -- 172.21.15.27:0/4185366943 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3d0032e20 con 0x55c3bc5d0dc0 2024-09-19T08:13:04.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.472+0000 7fc3c97fa640 1 -- 172.21.15.27:0/4185366943 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc3d0004ae0 con 0x55c3bc5d0dc0 2024-09-19T08:13:04.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.473+0000 7fc3ea5b4740 10 client.15780 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:13:04.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.473+0000 7fc3ea5b4740 10 client.15780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:13:04.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.473+0000 7fc3ea5b4740 20 client.15780 populate_metadata read hostname 'smithi027' 2024-09-19T08:13:04.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.473+0000 7fc3ea5b4740 1 --2- 172.21.15.27:0/4185366943 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c3bc5eafe0 0x55c3bc5ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:04.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.473+0000 7fc3ea5b4740 4 client.15780 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:13:04.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.473+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/4185366943 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3bc543850 con 0x55c3bc5eafe0 2024-09-19T08:13:04.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.473+0000 7fc3e5f77640 1 --2- 172.21.15.27:0/4185366943 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c3bc5eafe0 0x55c3bc5ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:04.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.473+0000 7fc3e5f77640 1 --2- 172.21.15.27:0/4185366943 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c3bc5eafe0 0x55c3bc5ed3d0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebf20fdd921ab2af server_cookie=e64f48c4252b1308 in_seq=0 out_seq=0 2024-09-19T08:13:04.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.473+0000 7fc3c97fa640 10 client.15780 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:04.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.474+0000 7fc3c97fa640 1 -- 172.21.15.27:0/4185366943 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c3bc543850 con 0x55c3bc5eafe0 2024-09-19T08:13:04.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.474+0000 7fc3c97fa640 10 client.15780 handle_command_reply: tid=0 2024-09-19T08:13:04.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.474+0000 7fc3ea5b4740 1 client.15780 shutdown 2024-09-19T08:13:04.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.474+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/4185366943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d0dc0 msgr2=0x55c3bc5d8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:04.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.474+0000 7fc3ea5b4740 1 --2- 172.21.15.27:0/4185366943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d0dc0 0x55c3bc5d8310 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0005290 tx=0x7fc3d0031a40 comp rx=0 tx=0).stop 2024-09-19T08:13:04.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.474+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/4185366943 shutdown_connections 2024-09-19T08:13:04.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.474+0000 7fc3ea5b4740 1 --2- 172.21.15.27:0/4185366943 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c3bc5eafe0 0x55c3bc5ed3d0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.474+0000 7fc3ea5b4740 1 --2- 172.21.15.27:0/4185366943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3bc5db680 0x55c3bc5d88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.474+0000 7fc3ea5b4740 1 --2- 172.21.15.27:0/4185366943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d0dc0 0x55c3bc5d8310 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.474+0000 7fc3c97fa640 0 client.15780 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:04.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.474+0000 7fc3ea5b4740 1 --2- 172.21.15.27:0/4185366943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5d04a0 0x55c3bc5db060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.474+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/4185366943 >> 172.21.15.27:0/4185366943 conn(0x55c3bc5cca30 msgr2=0x55c3bc5d2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:04.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.474+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/4185366943 shutdown_connections 2024-09-19T08:13:04.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.474+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/4185366943 wait complete. 2024-09-19T08:13:04.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.475+0000 7fc3ea5b4740 20 client.15780 trim_cache size 0 max 16384 2024-09-19T08:13:04.490 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:04 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:13:04.490 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:04 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:13:04.490 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:04 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:13:04.490 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:04 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:13:04.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.492+0000 7fc3ea5b4740 1 Processor -- start 2024-09-19T08:13:04.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.492+0000 7fc3ea5b4740 1 -- start start 2024-09-19T08:13:04.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.492+0000 7fc3ea5b4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d04a0 0x55c3bc5d5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:04.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.492+0000 7fc3ea5b4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3bc5d0dc0 0x55c3bc5d5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:04.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.492+0000 7fc3ea5b4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5db680 0x55c3bc5d30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:04.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.492+0000 7fc3ea5b4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01ad890 con 0x55c3bc5d04a0 2024-09-19T08:13:04.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.492+0000 7fc3ea5b4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01b0110 con 0x55c3bc5db680 2024-09-19T08:13:04.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.492+0000 7fc3ea5b4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01adf00 con 0x55c3bc5d0dc0 2024-09-19T08:13:04.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.492+0000 7fc3e5f77640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d04a0 0x55c3bc5d5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:04.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.492+0000 7fc3e5f77640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d04a0 0x55c3bc5d5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46184/0 (socket says 172.21.15.27:46184) 2024-09-19T08:13:04.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.492+0000 7fc3e5f77640 1 -- 172.21.15.27:0/3108557707 learned_addr learned my addr 172.21.15.27:0/3108557707 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:04.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.492+0000 7fc3e5f77640 1 -- 172.21.15.27:0/3108557707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3bc5d0dc0 msgr2=0x55c3bc5d5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:04.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.492+0000 7fc3e5f77640 1 --2- 172.21.15.27:0/3108557707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3bc5d0dc0 0x55c3bc5d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.492+0000 7fc3e5f77640 1 -- 172.21.15.27:0/3108557707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5db680 msgr2=0x55c3bc5d30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:04.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.492+0000 7fc3e5f77640 1 --2- 172.21.15.27:0/3108557707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5db680 0x55c3bc5d30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.492+0000 7fc3e5f77640 1 -- 172.21.15.27:0/3108557707 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3bc5db3d0 con 0x55c3bc5d04a0 2024-09-19T08:13:04.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.492+0000 7fc3e5f77640 1 --2- 172.21.15.27:0/3108557707 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d04a0 0x55c3bc5d5570 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc098bd0 tx=0x7fc3dc06df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9f4d6c94ae9c54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:04.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.493+0000 7fc3cb7fe640 1 -- 172.21.15.27:0/3108557707 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc09c200 con 0x55c3bc5d04a0 2024-09-19T08:13:04.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.493+0000 7fc3cb7fe640 1 -- 172.21.15.27:0/3108557707 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3dc0a05b0 con 0x55c3bc5d04a0 2024-09-19T08:13:04.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.493+0000 7fc3cb7fe640 1 -- 172.21.15.27:0/3108557707 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc0cd8f0 con 0x55c3bc5d04a0 2024-09-19T08:13:04.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.493+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/3108557707 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d04a0 msgr2=0x55c3bc5d5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:04.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.493+0000 7fc3ea5b4740 1 --2- 172.21.15.27:0/3108557707 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d04a0 0x55c3bc5d5570 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc098bd0 tx=0x7fc3dc06df80 comp rx=0 tx=0).stop 2024-09-19T08:13:04.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.493+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/3108557707 shutdown_connections 2024-09-19T08:13:04.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.493+0000 7fc3ea5b4740 1 --2- 172.21.15.27:0/3108557707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5db680 0x55c3bc5d30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.493+0000 7fc3ea5b4740 1 --2- 172.21.15.27:0/3108557707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3bc5d0dc0 0x55c3bc5d5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.493+0000 7fc3ea5b4740 1 --2- 172.21.15.27:0/3108557707 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d04a0 0x55c3bc5d5570 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.493+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/3108557707 >> 172.21.15.27:0/3108557707 conn(0x55c3bc5cca30 msgr2=0x55c3bc5d7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:04.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.493+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/3108557707 shutdown_connections 2024-09-19T08:13:04.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.493+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/3108557707 wait complete. 2024-09-19T08:13:04.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.494+0000 7fc3ea5b4740 1 -- start start 2024-09-19T08:13:04.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.494+0000 7fc3ea5b4740 1 Processor -- start 2024-09-19T08:13:04.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.494+0000 7fc3ea5b4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5d04a0 0x55c3bc5f08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:04.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.494+0000 7fc3ea5b4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d0dc0 0x55c3bc5edc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:04.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.494+0000 7fc3ea5b4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3bc5db680 0x55c3bc5ee170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:04.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.494+0000 7fc3ea5b4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01ae5d0 con 0x55c3bc5d0dc0 2024-09-19T08:13:04.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.494+0000 7fc3ea5b4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01afa40 con 0x55c3bc5d04a0 2024-09-19T08:13:04.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.494+0000 7fc3ea5b4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01aeca0 con 0x55c3bc5db680 2024-09-19T08:13:04.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.494+0000 7fc3ea5b4740 10 client.0 _ll_register_callbacks cb 0x7fc3d0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:13:04.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.494+0000 7fc3e5776640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d0dc0 0x55c3bc5edc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:04.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.494+0000 7fc3e5776640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d0dc0 0x55c3bc5edc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46190/0 (socket says 172.21.15.27:46190) 2024-09-19T08:13:04.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.494+0000 7fc3e5776640 1 -- 172.21.15.27:0/961922681 learned_addr learned my addr 172.21.15.27:0/961922681 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:04.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.495+0000 7fc3e5f77640 1 --2- 172.21.15.27:0/961922681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5d04a0 0x55c3bc5f08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:04.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.495+0000 7fc3e6778640 1 --2- 172.21.15.27:0/961922681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3bc5db680 0x55c3bc5ee170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:04.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.495+0000 7fc3e5776640 1 -- 172.21.15.27:0/961922681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3bc5db680 msgr2=0x55c3bc5ee170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:04.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.495+0000 7fc3e5776640 1 --2- 172.21.15.27:0/961922681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3bc5db680 0x55c3bc5ee170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.495+0000 7fc3e5776640 1 -- 172.21.15.27:0/961922681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5d04a0 msgr2=0x55c3bc5f08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:04.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.495+0000 7fc3e5776640 1 --2- 172.21.15.27:0/961922681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5d04a0 0x55c3bc5f08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.495+0000 7fc3e5776640 1 -- 172.21.15.27:0/961922681 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3bc5ee730 con 0x55c3bc5d0dc0 2024-09-19T08:13:04.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.495+0000 7fc3e5776640 1 --2- 172.21.15.27:0/961922681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d0dc0 0x55c3bc5edc30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0031550 tx=0x7fc3d0005340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3133a1cba4b89d17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:04.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.495+0000 7fc3c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:13:04.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.495+0000 7fc3c97fa640 1 -- 172.21.15.27:0/961922681 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d004a040 con 0x55c3bc5d0dc0 2024-09-19T08:13:04.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.495+0000 7fc3c97fa640 1 -- 172.21.15.27:0/961922681 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fc3d0031a20 con 0x55c3bc5d0dc0 2024-09-19T08:13:04.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.495+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/961922681 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3dc0a05b0 con 0x55c3bc5d0dc0 2024-09-19T08:13:04.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.495+0000 7fc3c97fa640 1 -- 172.21.15.27:0/961922681 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc3d003f070 con 0x55c3bc5d0dc0 2024-09-19T08:13:04.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.495+0000 7fc3ea5b4740 10 client.15786 fetch_fsmap learned FSMap version 20 2024-09-19T08:13:04.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.495+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/961922681 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c3bc6556c0 con 0x55c3bc5d0dc0 2024-09-19T08:13:04.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.495+0000 7fc3c97fa640 1 -- 172.21.15.27:0/961922681 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3dc0a05b0 con 0x55c3bc5d0dc0 2024-09-19T08:13:04.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.496+0000 7fc3c97fa640 1 -- 172.21.15.27:0/961922681 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc3d003b680 con 0x55c3bc5d0dc0 2024-09-19T08:13:04.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.496+0000 7fc3ea5b4740 10 client.15786 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:13:04.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.496+0000 7fc3ea5b4740 10 client.15786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:13:04.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.496+0000 7fc3ea5b4740 20 client.15786 populate_metadata read hostname 'smithi027' 2024-09-19T08:13:04.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.496+0000 7fc3ea5b4740 1 --2- 172.21.15.27:0/961922681 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c3bc655e30 0x55c3bc658250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:04.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.496+0000 7fc3ea5b4740 4 client.15786 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:13:04.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.496+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/961922681 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c3bc53dd60 con 0x55c3bc655e30 2024-09-19T08:13:04.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.496+0000 7fc3e5f77640 1 --2- 172.21.15.27:0/961922681 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c3bc655e30 0x55c3bc658250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:04.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.496+0000 7fc3e5f77640 1 --2- 172.21.15.27:0/961922681 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c3bc655e30 0x55c3bc658250 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c2687bc1a9a7995 server_cookie=442c87be7e570518 in_seq=0 out_seq=0 2024-09-19T08:13:04.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.496+0000 7fc3c97fa640 10 client.15786 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:04.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.497+0000 7fc3c97fa640 1 -- 172.21.15.27:0/961922681 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55c3bc53dd60 con 0x55c3bc655e30 2024-09-19T08:13:04.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.497+0000 7fc3c97fa640 10 client.15786 handle_command_reply: tid=0 2024-09-19T08:13:04.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.497+0000 7fc3ea5b4740 1 client.15786 shutdown 2024-09-19T08:13:04.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.497+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/961922681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d0dc0 msgr2=0x55c3bc5edc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:04.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.497+0000 7fc3ea5b4740 1 --2- 172.21.15.27:0/961922681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d0dc0 0x55c3bc5edc30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0031550 tx=0x7fc3d0005340 comp rx=0 tx=0).stop 2024-09-19T08:13:04.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.497+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/961922681 shutdown_connections 2024-09-19T08:13:04.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.497+0000 7fc3ea5b4740 1 --2- 172.21.15.27:0/961922681 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c3bc655e30 0x55c3bc658250 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.497+0000 7fc3ea5b4740 1 --2- 172.21.15.27:0/961922681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3bc5db680 0x55c3bc5ee170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.497+0000 7fc3c97fa640 0 client.15786 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:04.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.497+0000 7fc3ea5b4740 1 --2- 172.21.15.27:0/961922681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c3bc5d0dc0 0x55c3bc5edc30 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.497+0000 7fc3ea5b4740 1 --2- 172.21.15.27:0/961922681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3bc5d04a0 0x55c3bc5f08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.497+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/961922681 >> 172.21.15.27:0/961922681 conn(0x55c3bc5cca30 msgr2=0x55c3bc5cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:04.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.497+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/961922681 shutdown_connections 2024-09-19T08:13:04.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.497+0000 7fc3ea5b4740 1 -- 172.21.15.27:0/961922681 wait complete. 2024-09-19T08:13:04.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.497+0000 7fc3ea5b4740 20 client.15786 trim_cache size 0 max 16384 2024-09-19T08:13:04.501 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:13:04.502 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:13:04.502 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": { 2024-09-19T08:13:04.502 INFO:teuthology.orchestra.run.smithi027.stdout: "2f5270a0-c0ec-4b4a-80d4-5efa491620d9": { 2024-09-19T08:13:04.502 INFO:teuthology.orchestra.run.smithi027.stdout: "path": "/", 2024-09-19T08:13:04.502 INFO:teuthology.orchestra.run.smithi027.stdout: "tag": "2f5270a0-c0ec-4b4a-80d4-5efa491620d9", 2024-09-19T08:13:04.502 INFO:teuthology.orchestra.run.smithi027.stdout: "options": "recursive,force" 2024-09-19T08:13:04.502 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:13:04.502 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:13:04.502 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:13:04.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.498+0000 7fc3e81db640 1 -- 172.21.15.27:0/1605533146 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc3cc0a33b0 msgr2=0x7fc3cc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:04.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.498+0000 7fc3e81db640 1 --2- 172.21.15.27:0/1605533146 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc3cc0a33b0 0x7fc3cc0a5870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009fd0 tx=0x7fc3d8009280 comp rx=0 tx=0).stop 2024-09-19T08:13:04.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.498+0000 7fc3e81db640 1 -- 172.21.15.27:0/1605533146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e0102d40 msgr2=0x7fc3e019a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:04.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.498+0000 7fc3e81db640 1 --2- 172.21.15.27:0/1605533146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e0102d40 0x7fc3e019a600 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00c920 tx=0x7fc3dc00cde0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.498+0000 7fc3e81db640 1 -- 172.21.15.27:0/1605533146 shutdown_connections 2024-09-19T08:13:04.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.498+0000 7fc3e81db640 1 --2- 172.21.15.27:0/1605533146 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc3cc0a33b0 0x7fc3cc0a5870 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.498+0000 7fc3e81db640 1 --2- 172.21.15.27:0/1605533146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3e010c170 0x7fc3e019eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.498+0000 7fc3e81db640 1 --2- 172.21.15.27:0/1605533146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3e0103660 0x7fc3e019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.498+0000 7fc3e81db640 1 --2- 172.21.15.27:0/1605533146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e0102d40 0x7fc3e019a600 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:04.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.498+0000 7fc3e81db640 1 -- 172.21.15.27:0/1605533146 >> 172.21.15.27:0/1605533146 conn(0x7fc3e00fc7a0 msgr2=0x7fc3e010d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:04.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.498+0000 7fc3e81db640 1 -- 172.21.15.27:0/1605533146 shutdown_connections 2024-09-19T08:13:04.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:04.498+0000 7fc3e81db640 1 -- 172.21.15.27:0/1605533146 wait complete. 2024-09-19T08:13:04.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:04 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:13:04.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:04 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:13:04.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:04 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:13:04.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:04 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:13:05.217 INFO:tasks.cephfs.filesystem:scrub status for tag:2f5270a0-c0ec-4b4a-80d4-5efa491620d9 - {'path': '/', 'tag': '2f5270a0-c0ec-4b4a-80d4-5efa491620d9', 'options': 'recursive,force'} 2024-09-19T08:13:05.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:05 smithi155 ceph-mon[35362]: pgmap v64: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 986 KiB/s wr, 254 op/s 2024-09-19T08:13:05.493 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:05 smithi027 ceph-mon[31209]: pgmap v64: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 986 KiB/s wr, 254 op/s 2024-09-19T08:13:05.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:05 smithi203 ceph-mon[35198]: pgmap v64: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 986 KiB/s wr, 254 op/s 2024-09-19T08:13:06.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:06 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:13:06.496 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:06 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:13:06.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:06 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:13:07.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:07 smithi155 ceph-mon[35362]: pgmap v65: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 980 KiB/s wr, 252 op/s 2024-09-19T08:13:07.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:07 smithi027 ceph-mon[31209]: pgmap v65: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 980 KiB/s wr, 252 op/s 2024-09-19T08:13:07.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:07 smithi203 ceph-mon[35198]: pgmap v65: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 980 KiB/s wr, 252 op/s 2024-09-19T08:13:09.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:09 smithi155 ceph-mon[35362]: pgmap v66: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 980 KiB/s wr, 253 op/s 2024-09-19T08:13:09.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:09 smithi027 ceph-mon[31209]: pgmap v66: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 980 KiB/s wr, 253 op/s 2024-09-19T08:13:09.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:09 smithi203 ceph-mon[35198]: pgmap v66: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 980 KiB/s wr, 253 op/s 2024-09-19T08:13:10.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:10 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:13:10.501 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:10 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:13:10.507 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:10 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:13:11.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:11 smithi155 ceph-mon[35362]: pgmap v67: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 38 KiB/s wr, 23 op/s 2024-09-19T08:13:11.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:11 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:13:11.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:11 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:13:11.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:11 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:13:11.488 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:11 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:13:11.488 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:11 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:13:11.488 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:11 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:13:11.488 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:11 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:13:11.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:11 smithi027 ceph-mon[31209]: pgmap v67: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 38 KiB/s wr, 23 op/s 2024-09-19T08:13:11.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:11 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:13:11.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:11 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:13:11.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:11 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:13:11.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:11 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:13:11.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:11 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:13:11.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:11 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:13:11.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:11 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:13:11.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:11 smithi203 ceph-mon[35198]: pgmap v67: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 38 KiB/s wr, 23 op/s 2024-09-19T08:13:11.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:11 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:13:11.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:11 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:13:11.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:11 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:13:11.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:11 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:13:11.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:11 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:13:11.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:11 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:13:11.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:11 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:13:12.292 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:13:12.566 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:13:13.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.039+0000 7f60e84df640 1 -- 172.21.15.27:0/4046237799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e0102790 msgr2=0x7f60e01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:13.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.039+0000 7f60e84df640 1 --2- 172.21.15.27:0/4046237799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e0102790 0x7f60e01067e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009900 tx=0x7f60dc02a410 comp rx=0 tx=0).stop 2024-09-19T08:13:13.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.039+0000 7f60e84df640 1 -- 172.21.15.27:0/4046237799 shutdown_connections 2024-09-19T08:13:13.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.039+0000 7f60e84df640 1 --2- 172.21.15.27:0/4046237799 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60e0106f10 0x7f60e010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:13.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.039+0000 7f60e84df640 1 --2- 172.21.15.27:0/4046237799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e0102790 0x7f60e01067e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:13.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.039+0000 7f60e84df640 1 --2- 172.21.15.27:0/4046237799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60e0101de0 0x7f60e01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:13.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.039+0000 7f60e84df640 1 -- 172.21.15.27:0/4046237799 >> 172.21.15.27:0/4046237799 conn(0x7f60e00fd8c0 msgr2=0x7f60e00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:13.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.039+0000 7f60e84df640 1 -- 172.21.15.27:0/4046237799 shutdown_connections 2024-09-19T08:13:13.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.039+0000 7f60e84df640 1 -- 172.21.15.27:0/4046237799 wait complete. 2024-09-19T08:13:13.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.040+0000 7f60e84df640 1 Processor -- start 2024-09-19T08:13:13.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.040+0000 7f60e84df640 1 -- start start 2024-09-19T08:13:13.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.040+0000 7f60e84df640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60e0101de0 0x7f60e0198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:13.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.040+0000 7f60e84df640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60e0102790 0x7f60e0198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:13.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.040+0000 7f60e84df640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e0106f10 0x7f60e019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:13.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.040+0000 7f60e84df640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f60e0111f30 con 0x7f60e0106f10 2024-09-19T08:13:13.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.040+0000 7f60e84df640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f60e0111db0 con 0x7f60e0102790 2024-09-19T08:13:13.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.040+0000 7f60e84df640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f60e01120b0 con 0x7f60e0101de0 2024-09-19T08:13:13.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.040+0000 7f60e6a7c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e0106f10 0x7f60e019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:13.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.040+0000 7f60e6a7c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e0106f10 0x7f60e019cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54350/0 (socket says 172.21.15.27:54350) 2024-09-19T08:13:13.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.040+0000 7f60e627b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60e0101de0 0x7f60e0198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:13.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.040+0000 7f60e6a7c640 1 -- 172.21.15.27:0/2604130120 learned_addr learned my addr 172.21.15.27:0/2604130120 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:13.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.040+0000 7f60e5a7a640 1 --2- 172.21.15.27:0/2604130120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60e0102790 0x7f60e0198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:13.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.040+0000 7f60e6a7c640 1 -- 172.21.15.27:0/2604130120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60e0101de0 msgr2=0x7f60e0198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:13.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.040+0000 7f60e6a7c640 1 --2- 172.21.15.27:0/2604130120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60e0101de0 0x7f60e0198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:13.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.040+0000 7f60e6a7c640 1 -- 172.21.15.27:0/2604130120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60e0102790 msgr2=0x7f60e0198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:13.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.040+0000 7f60e6a7c640 1 --2- 172.21.15.27:0/2604130120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60e0102790 0x7f60e0198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:13.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.040+0000 7f60e6a7c640 1 -- 172.21.15.27:0/2604130120 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e019d3c0 con 0x7f60e0106f10 2024-09-19T08:13:13.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.041+0000 7f60e6a7c640 1 --2- 172.21.15.27:0/2604130120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e0106f10 0x7f60e019cce0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009fd0 tx=0x7f60d800def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:13.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.041+0000 7f60d37fe640 1 -- 172.21.15.27:0/2604130120 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d8017070 con 0x7f60e0106f10 2024-09-19T08:13:13.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.041+0000 7f60d37fe640 1 -- 172.21.15.27:0/2604130120 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60d8003e50 con 0x7f60e0106f10 2024-09-19T08:13:13.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.041+0000 7f60e84df640 1 -- 172.21.15.27:0/2604130120 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e019d6b0 con 0x7f60e0106f10 2024-09-19T08:13:13.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.041+0000 7f60d37fe640 1 -- 172.21.15.27:0/2604130120 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d8010460 con 0x7f60e0106f10 2024-09-19T08:13:13.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.041+0000 7f60e84df640 1 -- 172.21.15.27:0/2604130120 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e01a4f90 con 0x7f60e0106f10 2024-09-19T08:13:13.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.042+0000 7f60e84df640 1 -- 172.21.15.27:0/2604130120 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60e01021c0 con 0x7f60e0106f10 2024-09-19T08:13:13.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.043+0000 7f60d37fe640 1 -- 172.21.15.27:0/2604130120 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f60d8003970 con 0x7f60e0106f10 2024-09-19T08:13:13.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.044+0000 7f60d37fe640 1 --2- 172.21.15.27:0/2604130120 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f60cc0a3430 0x7f60cc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:13.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.044+0000 7f60e627b640 1 --2- 172.21.15.27:0/2604130120 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f60cc0a3430 0x7f60cc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:13.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.044+0000 7f60d37fe640 1 -- 172.21.15.27:0/2604130120 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f60d80cf8b0 con 0x7f60e0106f10 2024-09-19T08:13:13.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.044+0000 7f60e627b640 1 --2- 172.21.15.27:0/2604130120 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f60cc0a3430 0x7f60cc0a58f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f60d400abe0 tx=0x7f60d400a2d0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:13.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.047+0000 7f60d37fe640 1 -- 172.21.15.27:0/2604130120 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f60d809c360 con 0x7f60e0106f10 2024-09-19T08:13:13.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:13 smithi027 ceph-mon[31209]: pgmap v68: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 31 KiB/s wr, 19 op/s 2024-09-19T08:13:13.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.261+0000 7f60e84df640 1 -- 172.21.15.27:0/2604130120 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60e0199770 con 0x7f60e0106f10 2024-09-19T08:13:13.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.262+0000 7f60d37fe640 1 -- 172.21.15.27:0/2604130120 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f60e0199770 con 0x7f60e0106f10 2024-09-19T08:13:13.263 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:13:13.263 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:13:13.263 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:13:13.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.264+0000 7f60e84df640 1 -- 172.21.15.27:0/2604130120 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f60cc0a3430 msgr2=0x7f60cc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:13.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.264+0000 7f60e84df640 1 --2- 172.21.15.27:0/2604130120 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f60cc0a3430 0x7f60cc0a58f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f60d400abe0 tx=0x7f60d400a2d0 comp rx=0 tx=0).stop 2024-09-19T08:13:13.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.264+0000 7f60e84df640 1 -- 172.21.15.27:0/2604130120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e0106f10 msgr2=0x7f60e019cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:13.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.264+0000 7f60e84df640 1 --2- 172.21.15.27:0/2604130120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e0106f10 0x7f60e019cce0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009fd0 tx=0x7f60d800def0 comp rx=0 tx=0).stop 2024-09-19T08:13:13.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.264+0000 7f60e84df640 1 -- 172.21.15.27:0/2604130120 shutdown_connections 2024-09-19T08:13:13.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.264+0000 7f60e84df640 1 --2- 172.21.15.27:0/2604130120 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f60cc0a3430 0x7f60cc0a58f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:13.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.264+0000 7f60e84df640 1 --2- 172.21.15.27:0/2604130120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e0106f10 0x7f60e019cce0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:13.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.264+0000 7f60e84df640 1 --2- 172.21.15.27:0/2604130120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60e0102790 0x7f60e0198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:13.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.264+0000 7f60e84df640 1 --2- 172.21.15.27:0/2604130120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60e0101de0 0x7f60e0198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:13.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.264+0000 7f60e84df640 1 -- 172.21.15.27:0/2604130120 >> 172.21.15.27:0/2604130120 conn(0x7f60e00fd8c0 msgr2=0x7f60e00fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:13.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.265+0000 7f60e84df640 1 -- 172.21.15.27:0/2604130120 shutdown_connections 2024-09-19T08:13:13.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:13.265+0000 7f60e84df640 1 -- 172.21.15.27:0/2604130120 wait complete. 2024-09-19T08:13:13.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:13 smithi155 ceph-mon[35362]: pgmap v68: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 31 KiB/s wr, 19 op/s 2024-09-19T08:13:13.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:13 smithi203 ceph-mon[35198]: pgmap v68: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 31 KiB/s wr, 19 op/s 2024-09-19T08:13:13.919 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24482 quiesce db --set-id 3ddfad15 --release --await' 2024-09-19T08:13:13.919 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24482 quiesce db --set-id 3ddfad15 --release --await 2024-09-19T08:13:14.182 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:13:14.440 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:14 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2604130120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:13:14.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:14 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2604130120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:13:14.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:14 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2604130120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:13:14.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.679+0000 7f76cede1640 1 -- 172.21.15.27:0/2706930763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76c8102ef0 msgr2=0x7f76c810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:14.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.679+0000 7f76cede1640 1 --2- 172.21.15.27:0/2706930763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76c8102ef0 0x7f76c810da40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f76c0009ca0 tx=0x7f76c002a950 comp rx=0 tx=0).stop 2024-09-19T08:13:14.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.679+0000 7f76cede1640 1 -- 172.21.15.27:0/2706930763 shutdown_connections 2024-09-19T08:13:14.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.679+0000 7f76cede1640 1 --2- 172.21.15.27:0/2706930763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76c8102ef0 0x7f76c810da40 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.679+0000 7f76cede1640 1 --2- 172.21.15.27:0/2706930763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76c8102570 0x7f76c81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.679+0000 7f76cede1640 1 --2- 172.21.15.27:0/2706930763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76c8100e20 0x7f76c8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.679+0000 7f76cede1640 1 -- 172.21.15.27:0/2706930763 >> 172.21.15.27:0/2706930763 conn(0x7f76c80fc7d0 msgr2=0x7f76c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:14.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.679+0000 7f76cede1640 1 -- 172.21.15.27:0/2706930763 shutdown_connections 2024-09-19T08:13:14.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.679+0000 7f76cede1640 1 -- 172.21.15.27:0/2706930763 wait complete. 2024-09-19T08:13:14.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.679+0000 7f76cede1640 1 Processor -- start 2024-09-19T08:13:14.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.680+0000 7f76cede1640 1 -- start start 2024-09-19T08:13:14.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.680+0000 7f76cede1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76c8100e20 0x7f76c8199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:14.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.680+0000 7f76cede1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76c8102570 0x7f76c8199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:14.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.680+0000 7f76cede1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76c8102ef0 0x7f76c81a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:14.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.680+0000 7f76cede1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f76c8110fa0 con 0x7f76c8102ef0 2024-09-19T08:13:14.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.680+0000 7f76cede1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f76c8110e20 con 0x7f76c8100e20 2024-09-19T08:13:14.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.680+0000 7f76cede1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f76c8111120 con 0x7f76c8102570 2024-09-19T08:13:14.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.680+0000 7f76cd37e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76c8102ef0 0x7f76c81a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:14.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.680+0000 7f76cd37e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76c8102ef0 0x7f76c81a43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54354/0 (socket says 172.21.15.27:54354) 2024-09-19T08:13:14.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.680+0000 7f76cd37e640 1 -- 172.21.15.27:0/100985155 learned_addr learned my addr 172.21.15.27:0/100985155 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:14.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.680+0000 7f76c7fff640 1 --2- 172.21.15.27:0/100985155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76c8102570 0x7f76c8199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:14.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.680+0000 7f76ccb7d640 1 --2- 172.21.15.27:0/100985155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76c8100e20 0x7f76c8199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:14.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.680+0000 7f76cd37e640 1 -- 172.21.15.27:0/100985155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76c8102570 msgr2=0x7f76c8199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:14.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.680+0000 7f76cd37e640 1 --2- 172.21.15.27:0/100985155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76c8102570 0x7f76c8199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.680+0000 7f76cd37e640 1 -- 172.21.15.27:0/100985155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76c8100e20 msgr2=0x7f76c8199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:14.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.680+0000 7f76cd37e640 1 --2- 172.21.15.27:0/100985155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76c8100e20 0x7f76c8199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.680+0000 7f76cd37e640 1 -- 172.21.15.27:0/100985155 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c81a48f0 con 0x7f76c8102ef0 2024-09-19T08:13:14.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.680+0000 7f76ccb7d640 1 --2- 172.21.15.27:0/100985155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76c8100e20 0x7f76c8199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:13:14.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.680+0000 7f76cd37e640 1 --2- 172.21.15.27:0/100985155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76c8102ef0 0x7f76c81a43b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f76c002ae70 tx=0x7f76c002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.680+0000 7f76c5ffb640 1 -- 172.21.15.27:0/100985155 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c0034040 con 0x7f76c8102ef0 2024-09-19T08:13:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.681+0000 7f76cede1640 1 -- 172.21.15.27:0/100985155 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c81a4ac0 con 0x7f76c8102ef0 2024-09-19T08:13:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.681+0000 7f76c5ffb640 1 -- 172.21.15.27:0/100985155 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76c0030920 con 0x7f76c8102ef0 2024-09-19T08:13:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.681+0000 7f76c5ffb640 1 -- 172.21.15.27:0/100985155 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c0045480 con 0x7f76c8102ef0 2024-09-19T08:13:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.681+0000 7f76cede1640 1 -- 172.21.15.27:0/100985155 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c81a4f20 con 0x7f76c8102ef0 2024-09-19T08:13:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.684+0000 7f76c5ffb640 1 -- 172.21.15.27:0/100985155 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f76c0037020 con 0x7f76c8102ef0 2024-09-19T08:13:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.684+0000 7f76d11ba740 1 Processor -- start 2024-09-19T08:13:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.684+0000 7f76d11ba740 1 -- start start 2024-09-19T08:13:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.684+0000 7f76d11ba740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af0f40 0x560828af1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.684+0000 7f76d11ba740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828af1860 0x560828b00110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.684+0000 7f76d11ba740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560828b00650 0x560828b02a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.684+0000 7f76d11ba740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560828a56620 con 0x560828af0f40 2024-09-19T08:13:14.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.684+0000 7f76d11ba740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5608289fde50 con 0x560828af1860 2024-09-19T08:13:14.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.684+0000 7f76d11ba740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560828a525e0 con 0x560828b00650 2024-09-19T08:13:14.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.684+0000 7f76c7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af0f40 0x560828af1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:14.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.684+0000 7f76c7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af0f40 0x560828af1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54356/0 (socket says 172.21.15.27:54356) 2024-09-19T08:13:14.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.684+0000 7f76c7fff640 1 -- 172.21.15.27:0/1595460400 learned_addr learned my addr 172.21.15.27:0/1595460400 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:14.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.684+0000 7f76c5ffb640 1 --2- 172.21.15.27:0/100985155 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f76b80a33b0 0x7f76b80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:14.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.685+0000 7f76ccb7d640 1 --2- 172.21.15.27:0/1595460400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828af1860 0x560828b00110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:14.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.685+0000 7f76c7fff640 1 -- 172.21.15.27:0/1595460400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560828b00650 msgr2=0x560828b02a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:14.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.685+0000 7f76c7fff640 1 --2- 172.21.15.27:0/1595460400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560828b00650 0x560828b02a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.685+0000 7f76cd37e640 1 --2- 172.21.15.27:0/100985155 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f76b80a33b0 0x7f76b80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:14.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.685+0000 7f76c7fff640 1 -- 172.21.15.27:0/1595460400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828af1860 msgr2=0x560828b00110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:14.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.685+0000 7f76c7fff640 1 --2- 172.21.15.27:0/1595460400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828af1860 0x560828b00110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.685+0000 7f76c7fff640 1 -- 172.21.15.27:0/1595460400 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608289eed40 con 0x560828af0f40 2024-09-19T08:13:14.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.685+0000 7f76ccb7d640 1 --2- 172.21.15.27:0/1595460400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828af1860 0x560828b00110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:13:14.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.685+0000 7f76c5ffb640 1 -- 172.21.15.27:0/100985155 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f76c00f0b70 con 0x7f76c8102ef0 2024-09-19T08:13:14.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.685+0000 7f76c7fff640 1 --2- 172.21.15.27:0/1595460400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af0f40 0x560828af1320 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f76b4006e10 tx=0x7f76b4009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7babf698bf210d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:14.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.685+0000 7f76b2ffd640 1 -- 172.21.15.27:0/1595460400 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b400fc60 con 0x560828af0f40 2024-09-19T08:13:14.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.685+0000 7f76b2ffd640 1 -- 172.21.15.27:0/1595460400 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76b4010040 con 0x560828af0f40 2024-09-19T08:13:14.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.685+0000 7f76b2ffd640 1 -- 172.21.15.27:0/1595460400 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b4013610 con 0x560828af0f40 2024-09-19T08:13:14.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.686+0000 7f76d11ba740 1 -- 172.21.15.27:0/1595460400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af0f40 msgr2=0x560828af1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:14.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.686+0000 7f76cd37e640 1 --2- 172.21.15.27:0/100985155 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f76b80a33b0 0x7f76b80a5870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f76c00ee4d0 tx=0x7f76c0087d90 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:14.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.686+0000 7f76d11ba740 1 --2- 172.21.15.27:0/1595460400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af0f40 0x560828af1320 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f76b4006e10 tx=0x7f76b4009ea0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.686+0000 7f76d11ba740 1 -- 172.21.15.27:0/1595460400 shutdown_connections 2024-09-19T08:13:14.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.686+0000 7f76d11ba740 1 --2- 172.21.15.27:0/1595460400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560828b00650 0x560828b02a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.686+0000 7f76d11ba740 1 --2- 172.21.15.27:0/1595460400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828af1860 0x560828b00110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.686+0000 7f76d11ba740 1 --2- 172.21.15.27:0/1595460400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af0f40 0x560828af1320 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.686+0000 7f76d11ba740 1 -- 172.21.15.27:0/1595460400 >> 172.21.15.27:0/1595460400 conn(0x560828aed5f0 msgr2=0x560828aed9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:14.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.686+0000 7f76d11ba740 1 -- 172.21.15.27:0/1595460400 shutdown_connections 2024-09-19T08:13:14.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.686+0000 7f76d11ba740 1 -- 172.21.15.27:0/1595460400 wait complete. 2024-09-19T08:13:14.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.686+0000 7f76d11ba740 1 -- start start 2024-09-19T08:13:14.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.686+0000 7f76d11ba740 1 Processor -- start 2024-09-19T08:13:14.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76d11ba740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828af0f40 0x560828afd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:14.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76d11ba740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af1860 0x560828afda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:14.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76d11ba740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560828b00650 0x560828afdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:14.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76d11ba740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560828b03220 con 0x560828af1860 2024-09-19T08:13:14.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76d11ba740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5608289def10 con 0x560828af0f40 2024-09-19T08:13:14.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76d11ba740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560828b033a0 con 0x560828b00650 2024-09-19T08:13:14.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76d11ba740 10 client.0 _ll_register_callbacks cb 0x560828a02db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:13:14.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76ccb7d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af1860 0x560828afda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:14.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76ccb7d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af1860 0x560828afda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54372/0 (socket says 172.21.15.27:54372) 2024-09-19T08:13:14.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76ccb7d640 1 -- 172.21.15.27:0/600775833 learned_addr learned my addr 172.21.15.27:0/600775833 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:14.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76c7fff640 1 --2- 172.21.15.27:0/600775833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828af0f40 0x560828afd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:14.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76c7fff640 1 --2- 172.21.15.27:0/600775833 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560828b00650 0x560828afdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:14.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76ccb7d640 1 -- 172.21.15.27:0/600775833 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560828b00650 msgr2=0x560828afdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:14.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76ccb7d640 1 --2- 172.21.15.27:0/600775833 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560828b00650 0x560828afdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76ccb7d640 1 -- 172.21.15.27:0/600775833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828af0f40 msgr2=0x560828afd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:14.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76ccb7d640 1 --2- 172.21.15.27:0/600775833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828af0f40 0x560828afd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76ccb7d640 1 -- 172.21.15.27:0/600775833 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560828765580 con 0x560828af1860 2024-09-19T08:13:14.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76c7fff640 1 --2- 172.21.15.27:0/600775833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828af0f40 0x560828afd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:13:14.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76ccb7d640 1 --2- 172.21.15.27:0/600775833 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af1860 0x560828afda30 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00dee0 tx=0x7f76bc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a965fc0c278e4b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:14.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:13:14.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76a7fff640 1 -- 172.21.15.27:0/600775833 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76bc004220 con 0x560828af1860 2024-09-19T08:13:14.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.687+0000 7f76a7fff640 1 -- 172.21.15.27:0/600775833 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f76bc0043c0 con 0x560828af1860 2024-09-19T08:13:14.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.688+0000 7f76d11ba740 1 -- 172.21.15.27:0/600775833 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76b4010040 con 0x560828af1860 2024-09-19T08:13:14.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.688+0000 7f76a7fff640 1 -- 172.21.15.27:0/600775833 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f76bc011650 con 0x560828af1860 2024-09-19T08:13:14.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.688+0000 7f76d11ba740 10 client.15804 fetch_fsmap learned FSMap version 20 2024-09-19T08:13:14.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.688+0000 7f76d11ba740 1 -- 172.21.15.27:0/600775833 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56082882f960 con 0x560828af1860 2024-09-19T08:13:14.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.688+0000 7f76a7fff640 1 -- 172.21.15.27:0/600775833 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76b4010040 con 0x560828af1860 2024-09-19T08:13:14.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.688+0000 7f76a7fff640 1 -- 172.21.15.27:0/600775833 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f76bc003b10 con 0x560828af1860 2024-09-19T08:13:14.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.688+0000 7f76d11ba740 10 client.15804 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:13:14.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.688+0000 7f76d11ba740 10 client.15804 resolve_mds: validated gid 24482 aka daemon mds.b 2024-09-19T08:13:14.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.688+0000 7f76d11ba740 20 client.15804 populate_metadata read hostname 'smithi027' 2024-09-19T08:13:14.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.688+0000 7f76d11ba740 1 --2- 172.21.15.27:0/600775833 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560828b101b0 0x560828b125e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:14.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.688+0000 7f76d11ba740 4 client.15804 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:13:14.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.688+0000 7f76d11ba740 1 -- 172.21.15.27:0/600775833 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560828a63b90 con 0x560828b101b0 2024-09-19T08:13:14.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.688+0000 7f76c7fff640 1 --2- 172.21.15.27:0/600775833 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560828b101b0 0x560828b125e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:14.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.689+0000 7f76c7fff640 1 --2- 172.21.15.27:0/600775833 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560828b101b0 0x560828b125e0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5c6e94a94e43c8 server_cookie=631321b3edc84641 in_seq=0 out_seq=0 2024-09-19T08:13:14.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.689+0000 7f76a7fff640 10 client.15804 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:14.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.689+0000 7f76a7fff640 1 -- 172.21.15.27:0/600775833 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560828a63b90 con 0x560828b101b0 2024-09-19T08:13:14.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.689+0000 7f76a7fff640 10 client.15804 handle_command_reply: tid=0 2024-09-19T08:13:14.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.689+0000 7f76d11ba740 1 client.15804 shutdown 2024-09-19T08:13:14.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.690+0000 7f76d11ba740 1 -- 172.21.15.27:0/600775833 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af1860 msgr2=0x560828afda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:14.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.690+0000 7f76d11ba740 1 --2- 172.21.15.27:0/600775833 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af1860 0x560828afda30 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00dee0 tx=0x7f76bc00f730 comp rx=0 tx=0).stop 2024-09-19T08:13:14.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.690+0000 7f76d11ba740 1 -- 172.21.15.27:0/600775833 shutdown_connections 2024-09-19T08:13:14.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.690+0000 7f76d11ba740 1 --2- 172.21.15.27:0/600775833 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560828b101b0 0x560828b125e0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.690+0000 7f76d11ba740 1 --2- 172.21.15.27:0/600775833 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560828b00650 0x560828afdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.690+0000 7f76d11ba740 1 --2- 172.21.15.27:0/600775833 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af1860 0x560828afda30 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.690+0000 7f76d11ba740 1 --2- 172.21.15.27:0/600775833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828af0f40 0x560828afd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.690+0000 7f76a7fff640 0 client.15804 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:14.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.690+0000 7f76d11ba740 1 -- 172.21.15.27:0/600775833 >> 172.21.15.27:0/600775833 conn(0x560828aed5f0 msgr2=0x560828af3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:14.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.690+0000 7f76d11ba740 1 -- 172.21.15.27:0/600775833 shutdown_connections 2024-09-19T08:13:14.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.690+0000 7f76d11ba740 1 -- 172.21.15.27:0/600775833 wait complete. 2024-09-19T08:13:14.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.690+0000 7f76d11ba740 20 client.15804 trim_cache size 0 max 16384 2024-09-19T08:13:14.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.707+0000 7f76d11ba740 1 Processor -- start 2024-09-19T08:13:14.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.707+0000 7f76d11ba740 1 -- start start 2024-09-19T08:13:14.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.707+0000 7f76d11ba740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828af0f40 0x560828afbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:14.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.707+0000 7f76d11ba740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af1860 0x560828aec640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:14.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.707+0000 7f76d11ba740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560828b00650 0x560828b17ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:14.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.707+0000 7f76d11ba740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f76c81a94c0 con 0x560828af1860 2024-09-19T08:13:14.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.707+0000 7f76d11ba740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f76c81abd20 con 0x560828af0f40 2024-09-19T08:13:14.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.707+0000 7f76d11ba740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f76c81a9b10 con 0x560828b00650 2024-09-19T08:13:14.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.707+0000 7f76ccb7d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af1860 0x560828aec640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:14.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.707+0000 7f76ccb7d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af1860 0x560828aec640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54384/0 (socket says 172.21.15.27:54384) 2024-09-19T08:13:14.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.707+0000 7f76ccb7d640 1 -- 172.21.15.27:0/1275902738 learned_addr learned my addr 172.21.15.27:0/1275902738 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:14.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.707+0000 7f76c7fff640 1 --2- 172.21.15.27:0/1275902738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828af0f40 0x560828afbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:14.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.708+0000 7f76c7fff640 1 --2- 172.21.15.27:0/1275902738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560828b00650 0x560828b17ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:14.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.708+0000 7f76ccb7d640 1 -- 172.21.15.27:0/1275902738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560828b00650 msgr2=0x560828b17ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:14.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.708+0000 7f76ccb7d640 1 --2- 172.21.15.27:0/1275902738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560828b00650 0x560828b17ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.708+0000 7f76ccb7d640 1 -- 172.21.15.27:0/1275902738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828af0f40 msgr2=0x560828afbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:14.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.708+0000 7f76ccb7d640 1 --2- 172.21.15.27:0/1275902738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828af0f40 0x560828afbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.708+0000 7f76ccb7d640 1 -- 172.21.15.27:0/1275902738 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560828b12c60 con 0x560828af1860 2024-09-19T08:13:14.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.708+0000 7f76ccb7d640 1 --2- 172.21.15.27:0/1275902738 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af1860 0x560828aec640 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f76bc001eb0 tx=0x7f76bc00fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5ba02769724bc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:14.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.708+0000 7f76b27fc640 1 -- 172.21.15.27:0/1275902738 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76bc030070 con 0x560828af1860 2024-09-19T08:13:14.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.708+0000 7f76b27fc640 1 -- 172.21.15.27:0/1275902738 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76bc027040 con 0x560828af1860 2024-09-19T08:13:14.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.708+0000 7f76b27fc640 1 -- 172.21.15.27:0/1275902738 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76bc026070 con 0x560828af1860 2024-09-19T08:13:14.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.709+0000 7f76d11ba740 1 -- 172.21.15.27:0/1275902738 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af1860 msgr2=0x560828aec640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:14.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.709+0000 7f76d11ba740 1 --2- 172.21.15.27:0/1275902738 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af1860 0x560828aec640 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f76bc001eb0 tx=0x7f76bc00fc30 comp rx=0 tx=0).stop 2024-09-19T08:13:14.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.709+0000 7f76d11ba740 1 -- 172.21.15.27:0/1275902738 shutdown_connections 2024-09-19T08:13:14.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.709+0000 7f76d11ba740 1 --2- 172.21.15.27:0/1275902738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560828b00650 0x560828b17ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.709+0000 7f76d11ba740 1 --2- 172.21.15.27:0/1275902738 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af1860 0x560828aec640 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.709+0000 7f76d11ba740 1 --2- 172.21.15.27:0/1275902738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828af0f40 0x560828afbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.709+0000 7f76d11ba740 1 -- 172.21.15.27:0/1275902738 >> 172.21.15.27:0/1275902738 conn(0x560828aed5f0 msgr2=0x560828aebf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:14.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.709+0000 7f76d11ba740 1 -- 172.21.15.27:0/1275902738 shutdown_connections 2024-09-19T08:13:14.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.709+0000 7f76d11ba740 1 -- 172.21.15.27:0/1275902738 wait complete. 2024-09-19T08:13:14.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.709+0000 7f76d11ba740 1 -- start start 2024-09-19T08:13:14.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.709+0000 7f76d11ba740 1 Processor -- start 2024-09-19T08:13:14.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.710+0000 7f76d11ba740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af0f40 0x560828b04d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:14.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.710+0000 7f76d11ba740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560828af1860 0x560828b052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:14.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.710+0000 7f76d11ba740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828b00650 0x560828b73f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:14.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.710+0000 7f76d11ba740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f76c81aa1e0 con 0x560828af0f40 2024-09-19T08:13:14.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.710+0000 7f76d11ba740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f76c81ab650 con 0x560828b00650 2024-09-19T08:13:14.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.710+0000 7f76d11ba740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f76c81aa8b0 con 0x560828af1860 2024-09-19T08:13:14.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.710+0000 7f76d11ba740 10 client.0 _ll_register_callbacks cb 0x7f76bc00da70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:13:14.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.710+0000 7f76c7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af0f40 0x560828b04d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:14.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.710+0000 7f76c7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af0f40 0x560828b04d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54396/0 (socket says 172.21.15.27:54396) 2024-09-19T08:13:14.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.710+0000 7f76c7fff640 1 -- 172.21.15.27:0/1937853028 learned_addr learned my addr 172.21.15.27:0/1937853028 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:14.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.710+0000 7f76ccb7d640 1 --2- 172.21.15.27:0/1937853028 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560828af1860 0x560828b052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:14.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.710+0000 7f76c7fff640 1 -- 172.21.15.27:0/1937853028 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560828af1860 msgr2=0x560828b052a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:14.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.710+0000 7f76c7fff640 1 --2- 172.21.15.27:0/1937853028 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560828af1860 0x560828b052a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.710+0000 7f76c7fff640 1 -- 172.21.15.27:0/1937853028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828b00650 msgr2=0x560828b73f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:14.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.710+0000 7f76c7fff640 1 --2- 172.21.15.27:0/1937853028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828b00650 0x560828b73f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.710+0000 7f76c7fff640 1 -- 172.21.15.27:0/1937853028 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560828b745a0 con 0x560828af0f40 2024-09-19T08:13:14.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.711+0000 7f76c7fff640 1 --2- 172.21.15.27:0/1937853028 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af0f40 0x560828b04d60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f76b400b020 tx=0x7f76b4014dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600c8b3a2ee2632 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:14.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.711+0000 7f76a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:13:14.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.711+0000 7f76a7fff640 1 -- 172.21.15.27:0/1937853028 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b40146f0 con 0x560828af0f40 2024-09-19T08:13:14.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.711+0000 7f76a7fff640 1 -- 172.21.15.27:0/1937853028 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f76b4014890 con 0x560828af0f40 2024-09-19T08:13:14.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.711+0000 7f76d11ba740 1 -- 172.21.15.27:0/1937853028 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76bc027040 con 0x560828af0f40 2024-09-19T08:13:14.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.711+0000 7f76a7fff640 1 -- 172.21.15.27:0/1937853028 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f76b403a050 con 0x560828af0f40 2024-09-19T08:13:14.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.711+0000 7f76d11ba740 10 client.15810 fetch_fsmap learned FSMap version 20 2024-09-19T08:13:14.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.711+0000 7f76d11ba740 1 -- 172.21.15.27:0/1937853028 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560828b7b970 con 0x560828af0f40 2024-09-19T08:13:14.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.711+0000 7f76a7fff640 1 -- 172.21.15.27:0/1937853028 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76bc027040 con 0x560828af0f40 2024-09-19T08:13:14.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.711+0000 7f76a7fff640 1 -- 172.21.15.27:0/1937853028 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f76b4022450 con 0x560828af0f40 2024-09-19T08:13:14.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.711+0000 7f76d11ba740 10 client.15810 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:13:14.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.711+0000 7f76d11ba740 10 client.15810 resolve_mds: validated gid 24482 aka daemon mds.b 2024-09-19T08:13:14.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.711+0000 7f76d11ba740 20 client.15810 populate_metadata read hostname 'smithi027' 2024-09-19T08:13:14.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.711+0000 7f76d11ba740 1 --2- 172.21.15.27:0/1937853028 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560828b7bf00 0x560828b7e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:14.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.711+0000 7f76d11ba740 4 client.15810 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3ddfad15", "release": true, "await": true}] 2024-09-19T08:13:14.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.711+0000 7f76d11ba740 1 -- 172.21.15.27:0/1937853028 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3ddfad15", "release": true, "await": true}) -- 0x560828ae8950 con 0x560828b7bf00 2024-09-19T08:13:14.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.712+0000 7f76ccb7d640 1 --2- 172.21.15.27:0/1937853028 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560828b7bf00 0x560828b7e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:14.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.712+0000 7f76ccb7d640 1 --2- 172.21.15.27:0/1937853028 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560828b7bf00 0x560828b7e2f0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ee40d10009c4e25 server_cookie=bd6eddac7d7e28dd in_seq=0 out_seq=0 2024-09-19T08:13:14.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.712+0000 7f76a7fff640 10 client.15810 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:14.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.714+0000 7f76a7fff640 1 -- 172.21.15.27:0/1937853028 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x560828ae8950 con 0x560828b7bf00 2024-09-19T08:13:14.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.714+0000 7f76a7fff640 10 client.15810 handle_command_reply: tid=0 2024-09-19T08:13:14.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.714+0000 7f76d11ba740 1 client.15810 shutdown 2024-09-19T08:13:14.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.714+0000 7f76d11ba740 1 -- 172.21.15.27:0/1937853028 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af0f40 msgr2=0x560828b04d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:14.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.714+0000 7f76d11ba740 1 --2- 172.21.15.27:0/1937853028 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af0f40 0x560828b04d60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f76b400b020 tx=0x7f76b4014dd0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.714+0000 7f76d11ba740 1 -- 172.21.15.27:0/1937853028 shutdown_connections 2024-09-19T08:13:14.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.714+0000 7f76d11ba740 1 --2- 172.21.15.27:0/1937853028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560828b00650 0x560828b73f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.714+0000 7f76d11ba740 1 --2- 172.21.15.27:0/1937853028 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560828b7bf00 0x560828b7e2f0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.714+0000 7f76d11ba740 1 --2- 172.21.15.27:0/1937853028 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560828af1860 0x560828b052a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.714+0000 7f76d11ba740 1 --2- 172.21.15.27:0/1937853028 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560828af0f40 0x560828b04d60 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.714+0000 7f76d11ba740 1 -- 172.21.15.27:0/1937853028 >> 172.21.15.27:0/1937853028 conn(0x560828aed5f0 msgr2=0x560828afdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:14.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.714+0000 7f76a7fff640 0 client.15810 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:14.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.714+0000 7f76d11ba740 1 -- 172.21.15.27:0/1937853028 shutdown_connections 2024-09-19T08:13:14.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.714+0000 7f76d11ba740 1 -- 172.21.15.27:0/1937853028 wait complete. 2024-09-19T08:13:14.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.714+0000 7f76d11ba740 20 client.15810 trim_cache size 0 max 16384 2024-09-19T08:13:14.720 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:13:14.720 INFO:teuthology.orchestra.run.smithi027.stdout: "epoch": 20, 2024-09-19T08:13:14.720 INFO:teuthology.orchestra.run.smithi027.stdout: "leader": 24482, 2024-09-19T08:13:14.720 INFO:teuthology.orchestra.run.smithi027.stdout: "set_version": 12, 2024-09-19T08:13:14.720 INFO:teuthology.orchestra.run.smithi027.stdout: "sets": { 2024-09-19T08:13:14.720 INFO:teuthology.orchestra.run.smithi027.stdout: "3ddfad15": { 2024-09-19T08:13:14.721 INFO:teuthology.orchestra.run.smithi027.stdout: "version": 12, 2024-09-19T08:13:14.721 INFO:teuthology.orchestra.run.smithi027.stdout: "age_ref": 0.0, 2024-09-19T08:13:14.721 INFO:teuthology.orchestra.run.smithi027.stdout: "state": { 2024-09-19T08:13:14.721 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RELEASED", 2024-09-19T08:13:14.721 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0 2024-09-19T08:13:14.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:13:14.721 INFO:teuthology.orchestra.run.smithi027.stdout: "timeout": 90.0, 2024-09-19T08:13:14.721 INFO:teuthology.orchestra.run.smithi027.stdout: "expiration": 140.3, 2024-09-19T08:13:14.721 INFO:teuthology.orchestra.run.smithi027.stdout: "members": { 2024-09-19T08:13:14.721 INFO:teuthology.orchestra.run.smithi027.stdout: "file:/": { 2024-09-19T08:13:14.721 INFO:teuthology.orchestra.run.smithi027.stdout: "excluded": false, 2024-09-19T08:13:14.721 INFO:teuthology.orchestra.run.smithi027.stdout: "state": { 2024-09-19T08:13:14.722 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RELEASED", 2024-09-19T08:13:14.722 INFO:teuthology.orchestra.run.smithi027.stdout: "age": 0.0 2024-09-19T08:13:14.722 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:13:14.722 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:13:14.722 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:13:14.722 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:13:14.722 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:13:14.722 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:13:14.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.715+0000 7f76cede1640 1 -- 172.21.15.27:0/100985155 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f76b80a33b0 msgr2=0x7f76b80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:14.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.715+0000 7f76cede1640 1 --2- 172.21.15.27:0/100985155 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f76b80a33b0 0x7f76b80a5870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f76c00ee4d0 tx=0x7f76c0087d90 comp rx=0 tx=0).stop 2024-09-19T08:13:14.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.715+0000 7f76cede1640 1 -- 172.21.15.27:0/100985155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76c8102ef0 msgr2=0x7f76c81a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:14.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.715+0000 7f76cede1640 1 --2- 172.21.15.27:0/100985155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76c8102ef0 0x7f76c81a43b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f76c002ae70 tx=0x7f76c002f5d0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.715+0000 7f76cede1640 1 -- 172.21.15.27:0/100985155 shutdown_connections 2024-09-19T08:13:14.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.715+0000 7f76cede1640 1 --2- 172.21.15.27:0/100985155 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f76b80a33b0 0x7f76b80a5870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.715+0000 7f76cede1640 1 --2- 172.21.15.27:0/100985155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76c8102ef0 0x7f76c81a43b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.715+0000 7f76cede1640 1 --2- 172.21.15.27:0/100985155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76c8102570 0x7f76c8199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.715+0000 7f76cede1640 1 --2- 172.21.15.27:0/100985155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76c8100e20 0x7f76c8199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:14.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.715+0000 7f76cede1640 1 -- 172.21.15.27:0/100985155 >> 172.21.15.27:0/100985155 conn(0x7f76c80fc7d0 msgr2=0x7f76c8105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:14.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.715+0000 7f76cede1640 1 -- 172.21.15.27:0/100985155 shutdown_connections 2024-09-19T08:13:14.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:14.715+0000 7f76cede1640 1 -- 172.21.15.27:0/100985155 wait complete. 2024-09-19T08:13:14.820 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4197376 len 16384 2024-09-19T08:13:14.821 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4197376 len 16384 2024-09-19T08:13:14.821 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4197888 len 1024 2024-09-19T08:13:14.821 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4197888 len 1024 2024-09-19T08:13:14.821 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4197888 len 1024 2024-09-19T08:13:14.821 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4197888 len 1024 2024-09-19T08:13:14.821 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4197888 len 2048 2024-09-19T08:13:14.821 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4197888 len 2048 2024-09-19T08:13:14.821 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4197888 len 2048 2024-09-19T08:13:14.821 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4197888 len 2048 2024-09-19T08:13:14.821 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4197888 len 4096 2024-09-19T08:13:14.821 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4197888 len 4096 2024-09-19T08:13:14.821 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4197888 len 4096 2024-09-19T08:13:14.821 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4197888 len 4096 2024-09-19T08:13:14.822 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4197888 len 8192 2024-09-19T08:13:14.822 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4197888 len 8192 2024-09-19T08:13:14.822 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4197888 len 8192 2024-09-19T08:13:14.822 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4197888 len 8192 2024-09-19T08:13:14.822 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 0 offset 4197888 len 16384 2024-09-19T08:13:14.822 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4197888 len 16384 2024-09-19T08:13:14.822 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 0 offset 4197888 len 16384 2024-09-19T08:13:14.822 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 0 offset 4197888 len 16384 2024-09-19T08:13:14.822 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4190720 len 1024 2024-09-19T08:13:14.822 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4190720 len 1024 2024-09-19T08:13:14.822 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4190720 len 1024 2024-09-19T08:13:14.822 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4190720 len 1024 2024-09-19T08:13:14.822 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4190720 len 2048 2024-09-19T08:13:14.822 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4190720 len 2048 2024-09-19T08:13:14.823 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4190720 len 2048 2024-09-19T08:13:14.823 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4190720 len 2048 2024-09-19T08:13:14.823 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4190720 len 4096 2024-09-19T08:13:14.823 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4190720 len 4096 2024-09-19T08:13:14.823 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4190720 len 4096 2024-09-19T08:13:14.823 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4190720 len 4096 2024-09-19T08:13:14.823 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4190720 len 8192 2024-09-19T08:13:14.823 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4190720 len 8192 2024-09-19T08:13:14.823 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4190720 len 8192 2024-09-19T08:13:14.823 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4190720 len 8192 2024-09-19T08:13:14.823 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4190720 len 16384 2024-09-19T08:13:14.823 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4190720 len 16384 2024-09-19T08:13:14.823 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4190720 len 16384 2024-09-19T08:13:14.823 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4190720 len 16384 2024-09-19T08:13:14.824 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4191232 len 1024 2024-09-19T08:13:14.824 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4191232 len 1024 2024-09-19T08:13:14.824 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4191232 len 1024 2024-09-19T08:13:14.824 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4191232 len 1024 2024-09-19T08:13:14.824 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4191232 len 2048 2024-09-19T08:13:14.824 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4191232 len 2048 2024-09-19T08:13:14.824 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4191232 len 2048 2024-09-19T08:13:14.824 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4191232 len 2048 2024-09-19T08:13:14.824 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4191232 len 4096 2024-09-19T08:13:14.824 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4191232 len 4096 2024-09-19T08:13:14.824 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4191232 len 4096 2024-09-19T08:13:14.825 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4191232 len 4096 2024-09-19T08:13:14.825 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4191232 len 8192 2024-09-19T08:13:14.825 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4191232 len 8192 2024-09-19T08:13:14.825 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4191232 len 8192 2024-09-19T08:13:14.825 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4191232 len 8192 2024-09-19T08:13:14.825 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4191232 len 16384 2024-09-19T08:13:14.825 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4191232 len 16384 2024-09-19T08:13:14.825 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4191232 len 16384 2024-09-19T08:13:14.825 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4191232 len 16384 2024-09-19T08:13:14.825 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4191744 len 1024 2024-09-19T08:13:14.826 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4191744 len 1024 2024-09-19T08:13:14.826 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4191744 len 1024 2024-09-19T08:13:14.826 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4191744 len 1024 2024-09-19T08:13:14.826 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4191744 len 2048 2024-09-19T08:13:14.826 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4191744 len 2048 2024-09-19T08:13:14.826 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4191744 len 2048 2024-09-19T08:13:14.826 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4191744 len 2048 2024-09-19T08:13:14.826 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4191744 len 4096 2024-09-19T08:13:14.826 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4191744 len 4096 2024-09-19T08:13:14.826 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4191744 len 4096 2024-09-19T08:13:14.826 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4191744 len 4096 2024-09-19T08:13:14.826 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4191744 len 8192 2024-09-19T08:13:14.826 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4191744 len 8192 2024-09-19T08:13:14.826 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4191744 len 8192 2024-09-19T08:13:14.827 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4191744 len 8192 2024-09-19T08:13:14.827 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4191744 len 16384 2024-09-19T08:13:14.827 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4191744 len 16384 2024-09-19T08:13:14.827 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4191744 len 16384 2024-09-19T08:13:14.827 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4191744 len 16384 2024-09-19T08:13:14.827 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4192256 len 1024 2024-09-19T08:13:14.827 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4192256 len 1024 2024-09-19T08:13:15.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:15 smithi155 ceph-mon[35362]: pgmap v69: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 32 KiB/s wr, 20 op/s 2024-09-19T08:13:15.496 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4192256 len 1024 2024-09-19T08:13:15.496 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4192256 len 1024 2024-09-19T08:13:15.496 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4192256 len 2048 2024-09-19T08:13:15.496 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4192256 len 2048 2024-09-19T08:13:15.496 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4192256 len 2048 2024-09-19T08:13:15.496 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4192256 len 2048 2024-09-19T08:13:15.496 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4192256 len 4096 2024-09-19T08:13:15.496 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4192256 len 4096 2024-09-19T08:13:15.497 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4192256 len 4096 2024-09-19T08:13:15.497 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4192256 len 4096 2024-09-19T08:13:15.497 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4192256 len 8192 2024-09-19T08:13:15.497 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4192256 len 8192 2024-09-19T08:13:15.497 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4192256 len 8192 2024-09-19T08:13:15.497 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4192256 len 8192 2024-09-19T08:13:15.497 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4192256 len 16384 2024-09-19T08:13:15.497 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4192256 len 16384 2024-09-19T08:13:15.497 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4192256 len 16384 2024-09-19T08:13:15.497 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4192256 len 16384 2024-09-19T08:13:15.497 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4192768 len 1024 2024-09-19T08:13:15.497 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4192768 len 1024 2024-09-19T08:13:15.497 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4192768 len 1024 2024-09-19T08:13:15.497 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4192768 len 1024 2024-09-19T08:13:15.498 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4192768 len 2048 2024-09-19T08:13:15.498 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4192768 len 2048 2024-09-19T08:13:15.498 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4192768 len 2048 2024-09-19T08:13:15.498 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4192768 len 2048 2024-09-19T08:13:15.498 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4192768 len 4096 2024-09-19T08:13:15.498 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4192768 len 4096 2024-09-19T08:13:15.498 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4192768 len 4096 2024-09-19T08:13:15.498 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4192768 len 4096 2024-09-19T08:13:15.498 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4192768 len 8192 2024-09-19T08:13:15.498 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4192768 len 8192 2024-09-19T08:13:15.498 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4192768 len 8192 2024-09-19T08:13:15.498 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4192768 len 8192 2024-09-19T08:13:15.498 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4192768 len 16384 2024-09-19T08:13:15.498 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4192768 len 16384 2024-09-19T08:13:15.499 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4192768 len 16384 2024-09-19T08:13:15.499 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4192768 len 16384 2024-09-19T08:13:15.499 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4193280 len 1024 2024-09-19T08:13:15.499 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4193280 len 1024 2024-09-19T08:13:15.499 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4193280 len 1024 2024-09-19T08:13:15.499 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4193280 len 1024 2024-09-19T08:13:15.499 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4193280 len 2048 2024-09-19T08:13:15.499 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4193280 len 2048 2024-09-19T08:13:15.499 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4193280 len 2048 2024-09-19T08:13:15.499 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4193280 len 2048 2024-09-19T08:13:15.499 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4193280 len 4096 2024-09-19T08:13:15.499 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4193280 len 4096 2024-09-19T08:13:15.499 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4193280 len 4096 2024-09-19T08:13:15.499 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4193280 len 4096 2024-09-19T08:13:15.500 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4193280 len 8192 2024-09-19T08:13:15.500 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4193280 len 8192 2024-09-19T08:13:15.500 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4193280 len 8192 2024-09-19T08:13:15.500 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4193280 len 8192 2024-09-19T08:13:15.500 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4193280 len 16384 2024-09-19T08:13:15.500 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4193280 len 16384 2024-09-19T08:13:15.500 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4193280 len 16384 2024-09-19T08:13:15.500 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4193280 len 16384 2024-09-19T08:13:15.500 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4193792 len 1024 2024-09-19T08:13:15.500 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4193792 len 1024 2024-09-19T08:13:15.500 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4193792 len 1024 2024-09-19T08:13:15.500 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4193792 len 1024 2024-09-19T08:13:15.500 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4193792 len 2048 2024-09-19T08:13:15.500 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4193792 len 2048 2024-09-19T08:13:15.501 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4193792 len 2048 2024-09-19T08:13:15.501 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4193792 len 2048 2024-09-19T08:13:15.501 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4193792 len 4096 2024-09-19T08:13:15.501 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4193792 len 4096 2024-09-19T08:13:15.501 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4193792 len 4096 2024-09-19T08:13:15.501 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4193792 len 4096 2024-09-19T08:13:15.501 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4193792 len 8192 2024-09-19T08:13:15.501 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4193792 len 8192 2024-09-19T08:13:15.501 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4193792 len 8192 2024-09-19T08:13:15.501 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4193792 len 8192 2024-09-19T08:13:15.501 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4193792 len 16384 2024-09-19T08:13:15.501 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4193792 len 16384 2024-09-19T08:13:15.502 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4193792 len 16384 2024-09-19T08:13:15.502 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4193792 len 16384 2024-09-19T08:13:15.502 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4194304 len 1024 2024-09-19T08:13:15.502 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4194304 len 1024 2024-09-19T08:13:15.502 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4194304 len 1024 2024-09-19T08:13:15.502 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4194304 len 1024 2024-09-19T08:13:15.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:15 smithi027 ceph-mon[31209]: pgmap v69: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 32 KiB/s wr, 20 op/s 2024-09-19T08:13:15.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:15 smithi203 ceph-mon[35198]: pgmap v69: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 32 KiB/s wr, 20 op/s 2024-09-19T08:13:15.569 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3ddfad15', total seconds elapsed: 23.6 2024-09-19T08:13:15.851 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4194304 len 2048 2024-09-19T08:13:15.851 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4194304 len 2048 2024-09-19T08:13:15.851 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4194304 len 2048 2024-09-19T08:13:15.851 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4194304 len 2048 2024-09-19T08:13:15.851 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4194304 len 4096 2024-09-19T08:13:15.851 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4194304 len 4096 2024-09-19T08:13:15.851 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4194304 len 4096 2024-09-19T08:13:15.851 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4194304 len 4096 2024-09-19T08:13:15.852 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4194304 len 8192 2024-09-19T08:13:15.852 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4194304 len 8192 2024-09-19T08:13:15.852 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4194304 len 8192 2024-09-19T08:13:15.852 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4194304 len 8192 2024-09-19T08:13:15.852 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4194304 len 16384 2024-09-19T08:13:15.852 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4194304 len 16384 2024-09-19T08:13:15.852 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4194304 len 16384 2024-09-19T08:13:15.852 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4194304 len 16384 2024-09-19T08:13:15.852 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4194816 len 1024 2024-09-19T08:13:15.852 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4194816 len 1024 2024-09-19T08:13:15.852 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4194816 len 1024 2024-09-19T08:13:15.852 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4194816 len 1024 2024-09-19T08:13:15.852 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4194816 len 2048 2024-09-19T08:13:15.853 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4194816 len 2048 2024-09-19T08:13:15.853 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4194816 len 2048 2024-09-19T08:13:15.853 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4194816 len 2048 2024-09-19T08:13:15.853 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4194816 len 4096 2024-09-19T08:13:15.853 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4194816 len 4096 2024-09-19T08:13:15.853 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4194816 len 4096 2024-09-19T08:13:15.853 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4194816 len 4096 2024-09-19T08:13:15.853 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4194816 len 8192 2024-09-19T08:13:15.853 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4194816 len 8192 2024-09-19T08:13:15.853 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4194816 len 8192 2024-09-19T08:13:15.853 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4194816 len 8192 2024-09-19T08:13:15.853 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4194816 len 16384 2024-09-19T08:13:15.853 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4194816 len 16384 2024-09-19T08:13:15.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4194816 len 16384 2024-09-19T08:13:15.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4194816 len 16384 2024-09-19T08:13:15.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4195328 len 1024 2024-09-19T08:13:15.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4195328 len 1024 2024-09-19T08:13:15.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4195328 len 1024 2024-09-19T08:13:15.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4195328 len 1024 2024-09-19T08:13:15.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4195328 len 2048 2024-09-19T08:13:15.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4195328 len 2048 2024-09-19T08:13:15.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4195328 len 2048 2024-09-19T08:13:15.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4195328 len 2048 2024-09-19T08:13:15.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4195328 len 4096 2024-09-19T08:13:15.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4195328 len 4096 2024-09-19T08:13:15.854 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4195328 len 4096 2024-09-19T08:13:15.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4195328 len 4096 2024-09-19T08:13:15.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4195328 len 8192 2024-09-19T08:13:15.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4195328 len 8192 2024-09-19T08:13:15.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4195328 len 8192 2024-09-19T08:13:15.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4195328 len 8192 2024-09-19T08:13:15.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4195328 len 16384 2024-09-19T08:13:15.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4195328 len 16384 2024-09-19T08:13:15.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4195328 len 16384 2024-09-19T08:13:15.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4195328 len 16384 2024-09-19T08:13:15.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4195840 len 1024 2024-09-19T08:13:15.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4195840 len 1024 2024-09-19T08:13:15.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4195840 len 1024 2024-09-19T08:13:15.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4195840 len 1024 2024-09-19T08:13:15.855 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4195840 len 2048 2024-09-19T08:13:15.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4195840 len 2048 2024-09-19T08:13:15.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4195840 len 2048 2024-09-19T08:13:15.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4195840 len 2048 2024-09-19T08:13:15.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4195840 len 4096 2024-09-19T08:13:15.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4195840 len 4096 2024-09-19T08:13:15.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4195840 len 4096 2024-09-19T08:13:15.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4195840 len 4096 2024-09-19T08:13:15.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4195840 len 8192 2024-09-19T08:13:15.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4195840 len 8192 2024-09-19T08:13:15.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4195840 len 8192 2024-09-19T08:13:15.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4195840 len 8192 2024-09-19T08:13:15.856 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4195840 len 16384 2024-09-19T08:13:15.857 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4195840 len 16384 2024-09-19T08:13:15.857 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4195840 len 16384 2024-09-19T08:13:15.857 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4195840 len 16384 2024-09-19T08:13:15.857 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4196352 len 1024 2024-09-19T08:13:15.857 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4196352 len 1024 2024-09-19T08:13:15.857 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4196352 len 1024 2024-09-19T08:13:15.857 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4196352 len 1024 2024-09-19T08:13:15.857 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4196352 len 2048 2024-09-19T08:13:15.857 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4196352 len 2048 2024-09-19T08:13:16.216 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4196352 len 2048 2024-09-19T08:13:16.217 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4196352 len 2048 2024-09-19T08:13:16.217 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4196352 len 4096 2024-09-19T08:13:16.217 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4196352 len 4096 2024-09-19T08:13:16.217 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4196352 len 4096 2024-09-19T08:13:16.217 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4196352 len 4096 2024-09-19T08:13:16.217 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4196352 len 8192 2024-09-19T08:13:16.218 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4196352 len 8192 2024-09-19T08:13:16.218 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4196352 len 8192 2024-09-19T08:13:16.218 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4196352 len 8192 2024-09-19T08:13:16.218 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4196352 len 16384 2024-09-19T08:13:16.218 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4196352 len 16384 2024-09-19T08:13:16.218 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4196352 len 16384 2024-09-19T08:13:16.218 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4196352 len 16384 2024-09-19T08:13:16.219 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4196864 len 1024 2024-09-19T08:13:16.219 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4196864 len 1024 2024-09-19T08:13:16.219 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4196864 len 1024 2024-09-19T08:13:16.219 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4196864 len 1024 2024-09-19T08:13:16.219 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4196864 len 2048 2024-09-19T08:13:16.219 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4196864 len 2048 2024-09-19T08:13:16.220 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4196864 len 2048 2024-09-19T08:13:16.220 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4196864 len 2048 2024-09-19T08:13:16.220 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4196864 len 4096 2024-09-19T08:13:16.220 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4196864 len 4096 2024-09-19T08:13:16.220 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4196864 len 4096 2024-09-19T08:13:16.220 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4196864 len 4096 2024-09-19T08:13:16.220 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4196864 len 8192 2024-09-19T08:13:16.220 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4196864 len 8192 2024-09-19T08:13:16.221 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4196864 len 8192 2024-09-19T08:13:16.221 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4196864 len 8192 2024-09-19T08:13:16.221 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4196864 len 16384 2024-09-19T08:13:16.221 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4196864 len 16384 2024-09-19T08:13:16.221 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4196864 len 16384 2024-09-19T08:13:16.222 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4196864 len 16384 2024-09-19T08:13:16.222 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4197376 len 1024 2024-09-19T08:13:16.222 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4197376 len 1024 2024-09-19T08:13:16.222 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4197376 len 1024 2024-09-19T08:13:16.222 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4197376 len 1024 2024-09-19T08:13:16.222 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4197376 len 2048 2024-09-19T08:13:16.222 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4197376 len 2048 2024-09-19T08:13:16.223 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4197376 len 2048 2024-09-19T08:13:16.223 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4197376 len 2048 2024-09-19T08:13:16.223 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4197376 len 4096 2024-09-19T08:13:16.223 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4197376 len 4096 2024-09-19T08:13:16.223 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4197376 len 4096 2024-09-19T08:13:16.223 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4197376 len 4096 2024-09-19T08:13:16.223 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4197376 len 8192 2024-09-19T08:13:16.223 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4197376 len 8192 2024-09-19T08:13:16.223 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4197376 len 8192 2024-09-19T08:13:16.223 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4197376 len 8192 2024-09-19T08:13:16.223 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4197376 len 16384 2024-09-19T08:13:16.223 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4197376 len 16384 2024-09-19T08:13:16.223 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4197376 len 16384 2024-09-19T08:13:16.224 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4197376 len 16384 2024-09-19T08:13:16.224 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4197888 len 1024 2024-09-19T08:13:16.224 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4197888 len 1024 2024-09-19T08:13:16.224 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4197888 len 1024 2024-09-19T08:13:16.224 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4197888 len 1024 2024-09-19T08:13:16.224 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4197888 len 2048 2024-09-19T08:13:16.224 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4197888 len 2048 2024-09-19T08:13:16.224 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4197888 len 2048 2024-09-19T08:13:16.224 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4197888 len 2048 2024-09-19T08:13:16.225 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4197888 len 4096 2024-09-19T08:13:16.225 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4197888 len 4096 2024-09-19T08:13:16.225 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4197888 len 4096 2024-09-19T08:13:16.225 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4197888 len 4096 2024-09-19T08:13:16.225 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4197888 len 8192 2024-09-19T08:13:16.225 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4197888 len 8192 2024-09-19T08:13:16.225 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4197888 len 8192 2024-09-19T08:13:16.225 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4197888 len 8192 2024-09-19T08:13:16.226 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 512 offset 4197888 len 16384 2024-09-19T08:13:16.226 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4197888 len 16384 2024-09-19T08:13:16.226 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 512 offset 4197888 len 16384 2024-09-19T08:13:16.226 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 512 offset 4197888 len 16384 2024-09-19T08:13:16.226 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4190720 len 1024 2024-09-19T08:13:16.226 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4190720 len 1024 2024-09-19T08:13:16.226 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4190720 len 1024 2024-09-19T08:13:16.226 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4190720 len 1024 2024-09-19T08:13:16.226 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4190720 len 2048 2024-09-19T08:13:16.226 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4190720 len 2048 2024-09-19T08:13:16.226 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4190720 len 2048 2024-09-19T08:13:16.226 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4190720 len 2048 2024-09-19T08:13:16.226 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4190720 len 4096 2024-09-19T08:13:16.860 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4190720 len 4096 2024-09-19T08:13:16.860 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4190720 len 4096 2024-09-19T08:13:16.860 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4190720 len 4096 2024-09-19T08:13:16.860 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4190720 len 8192 2024-09-19T08:13:16.861 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4190720 len 8192 2024-09-19T08:13:16.861 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4190720 len 8192 2024-09-19T08:13:16.861 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4190720 len 8192 2024-09-19T08:13:16.861 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4190720 len 16384 2024-09-19T08:13:16.861 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4190720 len 16384 2024-09-19T08:13:16.861 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4190720 len 16384 2024-09-19T08:13:16.861 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4190720 len 16384 2024-09-19T08:13:16.861 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4191232 len 1024 2024-09-19T08:13:16.861 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4191232 len 1024 2024-09-19T08:13:16.861 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4191232 len 1024 2024-09-19T08:13:16.861 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4191232 len 1024 2024-09-19T08:13:16.861 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4191232 len 2048 2024-09-19T08:13:16.861 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4191232 len 2048 2024-09-19T08:13:16.862 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4191232 len 2048 2024-09-19T08:13:16.862 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4191232 len 2048 2024-09-19T08:13:16.862 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4191232 len 4096 2024-09-19T08:13:16.862 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4191232 len 4096 2024-09-19T08:13:16.862 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4191232 len 4096 2024-09-19T08:13:16.862 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4191232 len 4096 2024-09-19T08:13:16.862 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4191232 len 8192 2024-09-19T08:13:16.862 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4191232 len 8192 2024-09-19T08:13:16.862 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4191232 len 8192 2024-09-19T08:13:16.862 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4191232 len 8192 2024-09-19T08:13:16.862 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4191232 len 16384 2024-09-19T08:13:16.862 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4191232 len 16384 2024-09-19T08:13:16.862 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4191232 len 16384 2024-09-19T08:13:16.862 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4191232 len 16384 2024-09-19T08:13:16.863 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4191744 len 1024 2024-09-19T08:13:16.863 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4191744 len 1024 2024-09-19T08:13:16.863 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4191744 len 1024 2024-09-19T08:13:16.863 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4191744 len 1024 2024-09-19T08:13:16.863 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4191744 len 2048 2024-09-19T08:13:16.863 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4191744 len 2048 2024-09-19T08:13:16.863 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4191744 len 2048 2024-09-19T08:13:16.863 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4191744 len 2048 2024-09-19T08:13:16.863 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4191744 len 4096 2024-09-19T08:13:16.863 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4191744 len 4096 2024-09-19T08:13:16.863 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4191744 len 4096 2024-09-19T08:13:16.863 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4191744 len 4096 2024-09-19T08:13:16.863 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4191744 len 8192 2024-09-19T08:13:16.863 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4191744 len 8192 2024-09-19T08:13:16.864 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4191744 len 8192 2024-09-19T08:13:16.864 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4191744 len 8192 2024-09-19T08:13:16.864 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4191744 len 16384 2024-09-19T08:13:16.864 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4191744 len 16384 2024-09-19T08:13:16.864 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4191744 len 16384 2024-09-19T08:13:16.864 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4191744 len 16384 2024-09-19T08:13:16.864 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4192256 len 1024 2024-09-19T08:13:16.864 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4192256 len 1024 2024-09-19T08:13:16.864 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4192256 len 1024 2024-09-19T08:13:16.864 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4192256 len 1024 2024-09-19T08:13:16.864 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4192256 len 2048 2024-09-19T08:13:16.864 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4192256 len 2048 2024-09-19T08:13:16.865 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4192256 len 2048 2024-09-19T08:13:16.865 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4192256 len 2048 2024-09-19T08:13:16.865 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4192256 len 4096 2024-09-19T08:13:16.865 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4192256 len 4096 2024-09-19T08:13:16.865 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4192256 len 4096 2024-09-19T08:13:16.865 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4192256 len 4096 2024-09-19T08:13:16.865 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4192256 len 8192 2024-09-19T08:13:16.865 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4192256 len 8192 2024-09-19T08:13:16.865 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4192256 len 8192 2024-09-19T08:13:16.865 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4192256 len 8192 2024-09-19T08:13:16.865 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4192256 len 16384 2024-09-19T08:13:16.865 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4192256 len 16384 2024-09-19T08:13:16.865 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4192256 len 16384 2024-09-19T08:13:16.866 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4192256 len 16384 2024-09-19T08:13:16.866 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4192768 len 1024 2024-09-19T08:13:16.866 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4192768 len 1024 2024-09-19T08:13:16.866 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4192768 len 1024 2024-09-19T08:13:16.866 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4192768 len 1024 2024-09-19T08:13:16.866 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4192768 len 2048 2024-09-19T08:13:16.866 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4192768 len 2048 2024-09-19T08:13:16.866 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4192768 len 2048 2024-09-19T08:13:16.866 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4192768 len 2048 2024-09-19T08:13:16.866 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4192768 len 4096 2024-09-19T08:13:17.484 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4192768 len 4096 2024-09-19T08:13:17.484 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4192768 len 4096 2024-09-19T08:13:17.484 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4192768 len 4096 2024-09-19T08:13:17.484 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4192768 len 8192 2024-09-19T08:13:17.485 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4192768 len 8192 2024-09-19T08:13:17.485 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4192768 len 8192 2024-09-19T08:13:17.485 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4192768 len 8192 2024-09-19T08:13:17.485 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4192768 len 16384 2024-09-19T08:13:17.485 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4192768 len 16384 2024-09-19T08:13:17.485 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4192768 len 16384 2024-09-19T08:13:17.485 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4192768 len 16384 2024-09-19T08:13:17.485 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4193280 len 1024 2024-09-19T08:13:17.485 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4193280 len 1024 2024-09-19T08:13:17.485 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4193280 len 1024 2024-09-19T08:13:17.485 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4193280 len 1024 2024-09-19T08:13:17.485 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4193280 len 2048 2024-09-19T08:13:17.485 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4193280 len 2048 2024-09-19T08:13:17.485 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4193280 len 2048 2024-09-19T08:13:17.486 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4193280 len 2048 2024-09-19T08:13:17.486 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4193280 len 4096 2024-09-19T08:13:17.486 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4193280 len 4096 2024-09-19T08:13:17.486 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4193280 len 4096 2024-09-19T08:13:17.486 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4193280 len 4096 2024-09-19T08:13:17.486 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4193280 len 8192 2024-09-19T08:13:17.486 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4193280 len 8192 2024-09-19T08:13:17.486 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4193280 len 8192 2024-09-19T08:13:17.486 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4193280 len 8192 2024-09-19T08:13:17.486 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4193280 len 16384 2024-09-19T08:13:17.486 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4193280 len 16384 2024-09-19T08:13:17.486 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4193280 len 16384 2024-09-19T08:13:17.486 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4193280 len 16384 2024-09-19T08:13:17.486 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4193792 len 1024 2024-09-19T08:13:17.487 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4193792 len 1024 2024-09-19T08:13:17.487 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4193792 len 1024 2024-09-19T08:13:17.487 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4193792 len 1024 2024-09-19T08:13:17.487 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4193792 len 2048 2024-09-19T08:13:17.487 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4193792 len 2048 2024-09-19T08:13:17.487 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4193792 len 2048 2024-09-19T08:13:17.487 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4193792 len 2048 2024-09-19T08:13:17.487 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4193792 len 4096 2024-09-19T08:13:17.487 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4193792 len 4096 2024-09-19T08:13:17.487 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4193792 len 4096 2024-09-19T08:13:17.487 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4193792 len 4096 2024-09-19T08:13:17.487 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4193792 len 8192 2024-09-19T08:13:17.487 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4193792 len 8192 2024-09-19T08:13:17.487 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4193792 len 8192 2024-09-19T08:13:17.488 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4193792 len 8192 2024-09-19T08:13:17.488 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4193792 len 16384 2024-09-19T08:13:17.488 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4193792 len 16384 2024-09-19T08:13:17.488 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4193792 len 16384 2024-09-19T08:13:17.488 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4193792 len 16384 2024-09-19T08:13:17.488 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4194304 len 1024 2024-09-19T08:13:17.488 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4194304 len 1024 2024-09-19T08:13:17.488 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4194304 len 1024 2024-09-19T08:13:17.488 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4194304 len 1024 2024-09-19T08:13:17.488 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4194304 len 2048 2024-09-19T08:13:17.488 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4194304 len 2048 2024-09-19T08:13:17.488 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4194304 len 2048 2024-09-19T08:13:17.488 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4194304 len 2048 2024-09-19T08:13:17.488 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4194304 len 4096 2024-09-19T08:13:17.489 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4194304 len 4096 2024-09-19T08:13:17.489 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4194304 len 4096 2024-09-19T08:13:17.489 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4194304 len 4096 2024-09-19T08:13:17.489 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4194304 len 8192 2024-09-19T08:13:17.489 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4194304 len 8192 2024-09-19T08:13:17.489 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4194304 len 8192 2024-09-19T08:13:17.489 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4194304 len 8192 2024-09-19T08:13:17.489 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4194304 len 16384 2024-09-19T08:13:17.489 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4194304 len 16384 2024-09-19T08:13:17.489 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4194304 len 16384 2024-09-19T08:13:17.489 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4194304 len 16384 2024-09-19T08:13:17.489 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4194816 len 1024 2024-09-19T08:13:17.489 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4194816 len 1024 2024-09-19T08:13:17.490 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4194816 len 1024 2024-09-19T08:13:17.490 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4194816 len 1024 2024-09-19T08:13:17.490 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4194816 len 2048 2024-09-19T08:13:17.490 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4194816 len 2048 2024-09-19T08:13:17.490 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4194816 len 2048 2024-09-19T08:13:17.490 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4194816 len 2048 2024-09-19T08:13:17.490 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4194816 len 4096 2024-09-19T08:13:17.490 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4194816 len 4096 2024-09-19T08:13:17.490 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:17 smithi155 ceph-mon[35362]: pgmap v70: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T08:13:17.501 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:17 smithi027 ceph-mon[31209]: pgmap v70: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T08:13:17.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:17 smithi203 ceph-mon[35198]: pgmap v70: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T08:13:17.830 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4194816 len 4096 2024-09-19T08:13:17.830 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4194816 len 4096 2024-09-19T08:13:17.830 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4194816 len 8192 2024-09-19T08:13:17.830 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4194816 len 8192 2024-09-19T08:13:17.830 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4194816 len 8192 2024-09-19T08:13:17.830 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4194816 len 8192 2024-09-19T08:13:17.830 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4194816 len 16384 2024-09-19T08:13:17.830 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4194816 len 16384 2024-09-19T08:13:17.831 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4194816 len 16384 2024-09-19T08:13:17.831 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4194816 len 16384 2024-09-19T08:13:17.831 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4195328 len 1024 2024-09-19T08:13:17.831 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4195328 len 1024 2024-09-19T08:13:17.831 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4195328 len 1024 2024-09-19T08:13:17.831 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4195328 len 1024 2024-09-19T08:13:17.831 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4195328 len 2048 2024-09-19T08:13:17.831 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4195328 len 2048 2024-09-19T08:13:17.831 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4195328 len 2048 2024-09-19T08:13:17.831 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4195328 len 2048 2024-09-19T08:13:17.831 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4195328 len 4096 2024-09-19T08:13:17.831 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4195328 len 4096 2024-09-19T08:13:17.831 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4195328 len 4096 2024-09-19T08:13:17.831 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4195328 len 4096 2024-09-19T08:13:17.831 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4195328 len 8192 2024-09-19T08:13:17.832 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4195328 len 8192 2024-09-19T08:13:17.832 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4195328 len 8192 2024-09-19T08:13:17.832 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4195328 len 8192 2024-09-19T08:13:17.832 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4195328 len 16384 2024-09-19T08:13:17.832 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4195328 len 16384 2024-09-19T08:13:17.832 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4195328 len 16384 2024-09-19T08:13:17.832 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4195328 len 16384 2024-09-19T08:13:17.832 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4195840 len 1024 2024-09-19T08:13:17.832 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4195840 len 1024 2024-09-19T08:13:17.832 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4195840 len 1024 2024-09-19T08:13:17.832 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4195840 len 1024 2024-09-19T08:13:17.832 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4195840 len 2048 2024-09-19T08:13:17.832 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4195840 len 2048 2024-09-19T08:13:17.833 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4195840 len 2048 2024-09-19T08:13:17.833 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4195840 len 2048 2024-09-19T08:13:17.833 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4195840 len 4096 2024-09-19T08:13:17.833 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4195840 len 4096 2024-09-19T08:13:17.833 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4195840 len 4096 2024-09-19T08:13:17.833 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4195840 len 4096 2024-09-19T08:13:17.833 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4195840 len 8192 2024-09-19T08:13:17.834 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4195840 len 8192 2024-09-19T08:13:17.834 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4195840 len 8192 2024-09-19T08:13:17.834 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4195840 len 8192 2024-09-19T08:13:17.834 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4195840 len 16384 2024-09-19T08:13:17.834 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4195840 len 16384 2024-09-19T08:13:17.835 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4195840 len 16384 2024-09-19T08:13:17.835 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4195840 len 16384 2024-09-19T08:13:17.835 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4196352 len 1024 2024-09-19T08:13:17.835 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4196352 len 1024 2024-09-19T08:13:17.835 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4196352 len 1024 2024-09-19T08:13:17.835 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4196352 len 1024 2024-09-19T08:13:17.835 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4196352 len 2048 2024-09-19T08:13:17.835 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4196352 len 2048 2024-09-19T08:13:17.835 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4196352 len 2048 2024-09-19T08:13:17.835 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4196352 len 2048 2024-09-19T08:13:17.835 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4196352 len 4096 2024-09-19T08:13:17.835 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4196352 len 4096 2024-09-19T08:13:17.835 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4196352 len 4096 2024-09-19T08:13:17.836 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4196352 len 4096 2024-09-19T08:13:17.836 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4196352 len 8192 2024-09-19T08:13:17.836 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4196352 len 8192 2024-09-19T08:13:17.836 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4196352 len 8192 2024-09-19T08:13:17.836 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4196352 len 8192 2024-09-19T08:13:17.836 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4196352 len 16384 2024-09-19T08:13:17.836 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4196352 len 16384 2024-09-19T08:13:17.836 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4196352 len 16384 2024-09-19T08:13:17.836 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4196352 len 16384 2024-09-19T08:13:17.836 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4196864 len 1024 2024-09-19T08:13:17.836 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4196864 len 1024 2024-09-19T08:13:17.836 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4196864 len 1024 2024-09-19T08:13:17.836 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4196864 len 1024 2024-09-19T08:13:17.836 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4196864 len 2048 2024-09-19T08:13:17.837 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4196864 len 2048 2024-09-19T08:13:17.837 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4196864 len 2048 2024-09-19T08:13:17.837 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4196864 len 2048 2024-09-19T08:13:17.837 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4196864 len 4096 2024-09-19T08:13:17.837 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4196864 len 4096 2024-09-19T08:13:17.837 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4196864 len 4096 2024-09-19T08:13:18.275 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4196864 len 4096 2024-09-19T08:13:18.275 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4196864 len 8192 2024-09-19T08:13:18.275 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4196864 len 8192 2024-09-19T08:13:18.275 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4196864 len 8192 2024-09-19T08:13:18.275 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4196864 len 8192 2024-09-19T08:13:18.276 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4196864 len 16384 2024-09-19T08:13:18.276 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4196864 len 16384 2024-09-19T08:13:18.276 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4196864 len 16384 2024-09-19T08:13:18.276 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4196864 len 16384 2024-09-19T08:13:18.276 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4197376 len 1024 2024-09-19T08:13:18.277 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4197376 len 1024 2024-09-19T08:13:18.277 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4197376 len 1024 2024-09-19T08:13:18.277 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4197376 len 1024 2024-09-19T08:13:18.277 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4197376 len 2048 2024-09-19T08:13:18.277 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4197376 len 2048 2024-09-19T08:13:18.277 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4197376 len 2048 2024-09-19T08:13:18.277 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4197376 len 2048 2024-09-19T08:13:18.277 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4197376 len 4096 2024-09-19T08:13:18.278 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4197376 len 4096 2024-09-19T08:13:18.278 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4197376 len 4096 2024-09-19T08:13:18.278 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4197376 len 4096 2024-09-19T08:13:18.278 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4197376 len 8192 2024-09-19T08:13:18.278 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4197376 len 8192 2024-09-19T08:13:18.278 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4197376 len 8192 2024-09-19T08:13:18.278 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4197376 len 8192 2024-09-19T08:13:18.278 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4197376 len 16384 2024-09-19T08:13:18.278 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4197376 len 16384 2024-09-19T08:13:18.278 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4197376 len 16384 2024-09-19T08:13:18.278 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4197376 len 16384 2024-09-19T08:13:18.279 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4197888 len 1024 2024-09-19T08:13:18.279 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4197888 len 1024 2024-09-19T08:13:18.279 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4197888 len 1024 2024-09-19T08:13:18.279 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4197888 len 1024 2024-09-19T08:13:18.279 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4197888 len 2048 2024-09-19T08:13:18.279 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4197888 len 2048 2024-09-19T08:13:18.279 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4197888 len 2048 2024-09-19T08:13:18.279 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4197888 len 2048 2024-09-19T08:13:18.279 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4197888 len 4096 2024-09-19T08:13:18.279 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4197888 len 4096 2024-09-19T08:13:18.279 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4197888 len 4096 2024-09-19T08:13:18.279 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4197888 len 4096 2024-09-19T08:13:18.280 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4197888 len 8192 2024-09-19T08:13:18.280 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4197888 len 8192 2024-09-19T08:13:18.280 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4197888 len 8192 2024-09-19T08:13:18.280 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4197888 len 8192 2024-09-19T08:13:18.280 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1024 offset 4197888 len 16384 2024-09-19T08:13:18.280 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4197888 len 16384 2024-09-19T08:13:18.280 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1024 offset 4197888 len 16384 2024-09-19T08:13:18.280 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1024 offset 4197888 len 16384 2024-09-19T08:13:18.280 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4190720 len 1024 2024-09-19T08:13:18.280 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4190720 len 1024 2024-09-19T08:13:18.280 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4190720 len 1024 2024-09-19T08:13:18.280 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4190720 len 1024 2024-09-19T08:13:18.281 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4190720 len 2048 2024-09-19T08:13:18.281 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4190720 len 2048 2024-09-19T08:13:18.281 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4190720 len 2048 2024-09-19T08:13:18.281 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4190720 len 2048 2024-09-19T08:13:18.281 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4190720 len 4096 2024-09-19T08:13:18.281 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4190720 len 4096 2024-09-19T08:13:18.281 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4190720 len 4096 2024-09-19T08:13:18.281 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4190720 len 4096 2024-09-19T08:13:18.281 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4190720 len 8192 2024-09-19T08:13:18.281 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4190720 len 8192 2024-09-19T08:13:18.281 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4190720 len 8192 2024-09-19T08:13:18.281 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4190720 len 8192 2024-09-19T08:13:18.281 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4190720 len 16384 2024-09-19T08:13:18.281 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4190720 len 16384 2024-09-19T08:13:18.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4190720 len 16384 2024-09-19T08:13:18.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4190720 len 16384 2024-09-19T08:13:18.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4191232 len 1024 2024-09-19T08:13:18.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4191232 len 1024 2024-09-19T08:13:18.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4191232 len 1024 2024-09-19T08:13:18.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4191232 len 1024 2024-09-19T08:13:18.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4191232 len 2048 2024-09-19T08:13:18.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4191232 len 2048 2024-09-19T08:13:18.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4191232 len 2048 2024-09-19T08:13:18.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4191232 len 2048 2024-09-19T08:13:18.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4191232 len 4096 2024-09-19T08:13:18.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4191232 len 4096 2024-09-19T08:13:18.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4191232 len 4096 2024-09-19T08:13:18.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4191232 len 4096 2024-09-19T08:13:18.901 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4191232 len 8192 2024-09-19T08:13:18.902 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4191232 len 8192 2024-09-19T08:13:18.902 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4191232 len 8192 2024-09-19T08:13:18.902 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4191232 len 8192 2024-09-19T08:13:18.903 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4191232 len 16384 2024-09-19T08:13:18.903 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4191232 len 16384 2024-09-19T08:13:18.903 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4191232 len 16384 2024-09-19T08:13:18.903 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4191232 len 16384 2024-09-19T08:13:18.903 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4191744 len 1024 2024-09-19T08:13:18.903 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4191744 len 1024 2024-09-19T08:13:18.904 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4191744 len 1024 2024-09-19T08:13:18.904 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4191744 len 1024 2024-09-19T08:13:18.904 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4191744 len 2048 2024-09-19T08:13:18.904 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4191744 len 2048 2024-09-19T08:13:18.905 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4191744 len 2048 2024-09-19T08:13:18.905 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4191744 len 2048 2024-09-19T08:13:18.905 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4191744 len 4096 2024-09-19T08:13:18.905 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4191744 len 4096 2024-09-19T08:13:18.905 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4191744 len 4096 2024-09-19T08:13:18.905 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4191744 len 4096 2024-09-19T08:13:18.906 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4191744 len 8192 2024-09-19T08:13:18.906 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4191744 len 8192 2024-09-19T08:13:18.906 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4191744 len 8192 2024-09-19T08:13:18.906 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4191744 len 8192 2024-09-19T08:13:18.907 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4191744 len 16384 2024-09-19T08:13:18.907 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4191744 len 16384 2024-09-19T08:13:18.907 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4191744 len 16384 2024-09-19T08:13:18.907 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4191744 len 16384 2024-09-19T08:13:18.907 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4192256 len 1024 2024-09-19T08:13:18.908 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4192256 len 1024 2024-09-19T08:13:18.908 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4192256 len 1024 2024-09-19T08:13:18.908 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4192256 len 1024 2024-09-19T08:13:18.908 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4192256 len 2048 2024-09-19T08:13:18.908 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4192256 len 2048 2024-09-19T08:13:18.908 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4192256 len 2048 2024-09-19T08:13:18.909 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4192256 len 2048 2024-09-19T08:13:18.909 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4192256 len 4096 2024-09-19T08:13:18.909 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4192256 len 4096 2024-09-19T08:13:18.909 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4192256 len 4096 2024-09-19T08:13:18.909 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4192256 len 4096 2024-09-19T08:13:18.909 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4192256 len 8192 2024-09-19T08:13:18.910 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4192256 len 8192 2024-09-19T08:13:18.910 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4192256 len 8192 2024-09-19T08:13:18.910 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4192256 len 8192 2024-09-19T08:13:18.910 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4192256 len 16384 2024-09-19T08:13:18.910 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4192256 len 16384 2024-09-19T08:13:18.910 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4192256 len 16384 2024-09-19T08:13:18.911 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4192256 len 16384 2024-09-19T08:13:18.911 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4192768 len 1024 2024-09-19T08:13:18.911 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4192768 len 1024 2024-09-19T08:13:18.911 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4192768 len 1024 2024-09-19T08:13:18.911 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4192768 len 1024 2024-09-19T08:13:18.911 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4192768 len 2048 2024-09-19T08:13:18.912 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4192768 len 2048 2024-09-19T08:13:18.912 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4192768 len 2048 2024-09-19T08:13:18.912 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4192768 len 2048 2024-09-19T08:13:18.912 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4192768 len 4096 2024-09-19T08:13:18.912 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4192768 len 4096 2024-09-19T08:13:18.912 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4192768 len 4096 2024-09-19T08:13:18.913 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4192768 len 4096 2024-09-19T08:13:18.913 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4192768 len 8192 2024-09-19T08:13:18.913 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4192768 len 8192 2024-09-19T08:13:18.913 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4192768 len 8192 2024-09-19T08:13:18.913 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4192768 len 8192 2024-09-19T08:13:18.914 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4192768 len 16384 2024-09-19T08:13:18.914 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4192768 len 16384 2024-09-19T08:13:18.914 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4192768 len 16384 2024-09-19T08:13:18.914 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4192768 len 16384 2024-09-19T08:13:18.914 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4193280 len 1024 2024-09-19T08:13:18.914 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4193280 len 1024 2024-09-19T08:13:18.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4193280 len 1024 2024-09-19T08:13:18.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4193280 len 1024 2024-09-19T08:13:18.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4193280 len 2048 2024-09-19T08:13:18.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4193280 len 2048 2024-09-19T08:13:18.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4193280 len 2048 2024-09-19T08:13:18.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4193280 len 2048 2024-09-19T08:13:18.916 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4193280 len 4096 2024-09-19T08:13:18.916 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4193280 len 4096 2024-09-19T08:13:18.916 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4193280 len 4096 2024-09-19T08:13:18.916 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4193280 len 4096 2024-09-19T08:13:18.916 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4193280 len 8192 2024-09-19T08:13:19.390 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4193280 len 8192 2024-09-19T08:13:19.390 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4193280 len 8192 2024-09-19T08:13:19.390 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4193280 len 8192 2024-09-19T08:13:19.390 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4193280 len 16384 2024-09-19T08:13:19.390 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4193280 len 16384 2024-09-19T08:13:19.390 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4193280 len 16384 2024-09-19T08:13:19.390 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4193280 len 16384 2024-09-19T08:13:19.390 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4193792 len 1024 2024-09-19T08:13:19.390 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4193792 len 1024 2024-09-19T08:13:19.390 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4193792 len 1024 2024-09-19T08:13:19.390 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4193792 len 1024 2024-09-19T08:13:19.390 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4193792 len 2048 2024-09-19T08:13:19.391 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4193792 len 2048 2024-09-19T08:13:19.391 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4193792 len 2048 2024-09-19T08:13:19.391 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4193792 len 2048 2024-09-19T08:13:19.391 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4193792 len 4096 2024-09-19T08:13:19.391 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4193792 len 4096 2024-09-19T08:13:19.391 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4193792 len 4096 2024-09-19T08:13:19.391 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4193792 len 4096 2024-09-19T08:13:19.391 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4193792 len 8192 2024-09-19T08:13:19.391 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4193792 len 8192 2024-09-19T08:13:19.391 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4193792 len 8192 2024-09-19T08:13:19.392 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4193792 len 8192 2024-09-19T08:13:19.392 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4193792 len 16384 2024-09-19T08:13:19.392 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4193792 len 16384 2024-09-19T08:13:19.392 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4193792 len 16384 2024-09-19T08:13:19.392 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4193792 len 16384 2024-09-19T08:13:19.392 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4194304 len 1024 2024-09-19T08:13:19.392 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4194304 len 1024 2024-09-19T08:13:19.392 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4194304 len 1024 2024-09-19T08:13:19.392 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4194304 len 1024 2024-09-19T08:13:19.392 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4194304 len 2048 2024-09-19T08:13:19.392 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4194304 len 2048 2024-09-19T08:13:19.392 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4194304 len 2048 2024-09-19T08:13:19.393 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4194304 len 2048 2024-09-19T08:13:19.393 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4194304 len 4096 2024-09-19T08:13:19.393 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4194304 len 4096 2024-09-19T08:13:19.393 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4194304 len 4096 2024-09-19T08:13:19.393 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4194304 len 4096 2024-09-19T08:13:19.393 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4194304 len 8192 2024-09-19T08:13:19.393 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4194304 len 8192 2024-09-19T08:13:19.393 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4194304 len 8192 2024-09-19T08:13:19.393 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4194304 len 8192 2024-09-19T08:13:19.393 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4194304 len 16384 2024-09-19T08:13:19.393 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4194304 len 16384 2024-09-19T08:13:19.394 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4194304 len 16384 2024-09-19T08:13:19.394 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4194304 len 16384 2024-09-19T08:13:19.394 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4194816 len 1024 2024-09-19T08:13:19.394 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4194816 len 1024 2024-09-19T08:13:19.394 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4194816 len 1024 2024-09-19T08:13:19.394 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4194816 len 1024 2024-09-19T08:13:19.394 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4194816 len 2048 2024-09-19T08:13:19.394 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4194816 len 2048 2024-09-19T08:13:19.394 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4194816 len 2048 2024-09-19T08:13:19.394 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4194816 len 2048 2024-09-19T08:13:19.394 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4194816 len 4096 2024-09-19T08:13:19.394 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4194816 len 4096 2024-09-19T08:13:19.394 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4194816 len 4096 2024-09-19T08:13:19.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4194816 len 4096 2024-09-19T08:13:19.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4194816 len 8192 2024-09-19T08:13:19.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4194816 len 8192 2024-09-19T08:13:19.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4194816 len 8192 2024-09-19T08:13:19.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4194816 len 8192 2024-09-19T08:13:19.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4194816 len 16384 2024-09-19T08:13:19.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4194816 len 16384 2024-09-19T08:13:19.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4194816 len 16384 2024-09-19T08:13:19.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4194816 len 16384 2024-09-19T08:13:19.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4195328 len 1024 2024-09-19T08:13:19.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4195328 len 1024 2024-09-19T08:13:19.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4195328 len 1024 2024-09-19T08:13:19.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4195328 len 1024 2024-09-19T08:13:19.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4195328 len 2048 2024-09-19T08:13:19.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4195328 len 2048 2024-09-19T08:13:19.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4195328 len 2048 2024-09-19T08:13:19.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4195328 len 2048 2024-09-19T08:13:19.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4195328 len 4096 2024-09-19T08:13:19.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4195328 len 4096 2024-09-19T08:13:19.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4195328 len 4096 2024-09-19T08:13:19.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4195328 len 4096 2024-09-19T08:13:19.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4195328 len 8192 2024-09-19T08:13:19.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:19 smithi155 ceph-mon[35362]: pgmap v71: 97 pgs: 97 active+clean; 443 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 37 MiB/s rd, 329 KiB/s wr, 82 op/s 2024-09-19T08:13:19.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:19 smithi027 ceph-mon[31209]: pgmap v71: 97 pgs: 97 active+clean; 443 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 37 MiB/s rd, 329 KiB/s wr, 82 op/s 2024-09-19T08:13:19.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:19 smithi203 ceph-mon[35198]: pgmap v71: 97 pgs: 97 active+clean; 443 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 37 MiB/s rd, 329 KiB/s wr, 82 op/s 2024-09-19T08:13:19.774 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4195328 len 8192 2024-09-19T08:13:19.774 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4195328 len 8192 2024-09-19T08:13:19.775 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4195328 len 8192 2024-09-19T08:13:19.775 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4195328 len 16384 2024-09-19T08:13:19.775 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4195328 len 16384 2024-09-19T08:13:19.775 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4195328 len 16384 2024-09-19T08:13:19.775 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4195328 len 16384 2024-09-19T08:13:19.775 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4195840 len 1024 2024-09-19T08:13:19.775 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4195840 len 1024 2024-09-19T08:13:19.775 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4195840 len 1024 2024-09-19T08:13:19.775 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4195840 len 1024 2024-09-19T08:13:19.775 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4195840 len 2048 2024-09-19T08:13:19.775 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4195840 len 2048 2024-09-19T08:13:19.775 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4195840 len 2048 2024-09-19T08:13:19.775 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4195840 len 2048 2024-09-19T08:13:19.776 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4195840 len 4096 2024-09-19T08:13:19.776 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4195840 len 4096 2024-09-19T08:13:19.776 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4195840 len 4096 2024-09-19T08:13:19.776 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4195840 len 4096 2024-09-19T08:13:19.776 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4195840 len 8192 2024-09-19T08:13:19.776 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4195840 len 8192 2024-09-19T08:13:19.776 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4195840 len 8192 2024-09-19T08:13:19.776 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4195840 len 8192 2024-09-19T08:13:19.776 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4195840 len 16384 2024-09-19T08:13:19.776 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4195840 len 16384 2024-09-19T08:13:19.776 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4195840 len 16384 2024-09-19T08:13:19.776 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4195840 len 16384 2024-09-19T08:13:19.776 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4196352 len 1024 2024-09-19T08:13:19.777 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4196352 len 1024 2024-09-19T08:13:19.777 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4196352 len 1024 2024-09-19T08:13:19.777 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4196352 len 1024 2024-09-19T08:13:19.777 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4196352 len 2048 2024-09-19T08:13:19.777 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4196352 len 2048 2024-09-19T08:13:19.777 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4196352 len 2048 2024-09-19T08:13:19.777 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4196352 len 2048 2024-09-19T08:13:19.777 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4196352 len 4096 2024-09-19T08:13:19.777 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4196352 len 4096 2024-09-19T08:13:19.778 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4196352 len 4096 2024-09-19T08:13:19.778 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4196352 len 4096 2024-09-19T08:13:19.778 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4196352 len 8192 2024-09-19T08:13:19.778 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4196352 len 8192 2024-09-19T08:13:19.778 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4196352 len 8192 2024-09-19T08:13:19.778 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4196352 len 8192 2024-09-19T08:13:19.778 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4196352 len 16384 2024-09-19T08:13:19.778 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4196352 len 16384 2024-09-19T08:13:19.778 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4196352 len 16384 2024-09-19T08:13:19.778 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4196352 len 16384 2024-09-19T08:13:19.779 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4196864 len 1024 2024-09-19T08:13:19.779 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4196864 len 1024 2024-09-19T08:13:19.779 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4196864 len 1024 2024-09-19T08:13:19.779 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4196864 len 1024 2024-09-19T08:13:19.779 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4196864 len 2048 2024-09-19T08:13:19.779 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4196864 len 2048 2024-09-19T08:13:19.782 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4196864 len 2048 2024-09-19T08:13:19.782 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4196864 len 2048 2024-09-19T08:13:19.783 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4196864 len 4096 2024-09-19T08:13:19.783 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4196864 len 4096 2024-09-19T08:13:19.783 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4196864 len 4096 2024-09-19T08:13:19.783 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4196864 len 4096 2024-09-19T08:13:19.783 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4196864 len 8192 2024-09-19T08:13:19.783 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4196864 len 8192 2024-09-19T08:13:19.783 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4196864 len 8192 2024-09-19T08:13:19.783 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4196864 len 8192 2024-09-19T08:13:19.783 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4196864 len 16384 2024-09-19T08:13:19.783 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4196864 len 16384 2024-09-19T08:13:19.783 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4196864 len 16384 2024-09-19T08:13:19.783 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4196864 len 16384 2024-09-19T08:13:19.784 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4197376 len 1024 2024-09-19T08:13:19.784 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4197376 len 1024 2024-09-19T08:13:19.784 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4197376 len 1024 2024-09-19T08:13:19.784 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4197376 len 1024 2024-09-19T08:13:19.784 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4197376 len 2048 2024-09-19T08:13:19.784 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4197376 len 2048 2024-09-19T08:13:19.784 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4197376 len 2048 2024-09-19T08:13:19.784 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4197376 len 2048 2024-09-19T08:13:19.785 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4197376 len 4096 2024-09-19T08:13:19.785 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4197376 len 4096 2024-09-19T08:13:19.785 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4197376 len 4096 2024-09-19T08:13:19.785 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4197376 len 4096 2024-09-19T08:13:19.785 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4197376 len 8192 2024-09-19T08:13:19.785 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4197376 len 8192 2024-09-19T08:13:20.317 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4197376 len 8192 2024-09-19T08:13:20.317 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4197376 len 8192 2024-09-19T08:13:20.317 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4197376 len 16384 2024-09-19T08:13:20.317 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4197376 len 16384 2024-09-19T08:13:20.318 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4197376 len 16384 2024-09-19T08:13:20.318 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4197376 len 16384 2024-09-19T08:13:20.318 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4197888 len 1024 2024-09-19T08:13:20.318 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4197888 len 1024 2024-09-19T08:13:20.318 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4197888 len 1024 2024-09-19T08:13:20.318 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4197888 len 1024 2024-09-19T08:13:20.319 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4197888 len 2048 2024-09-19T08:13:20.319 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4197888 len 2048 2024-09-19T08:13:20.319 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4197888 len 2048 2024-09-19T08:13:20.319 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4197888 len 2048 2024-09-19T08:13:20.319 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4197888 len 4096 2024-09-19T08:13:20.320 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4197888 len 4096 2024-09-19T08:13:20.320 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4197888 len 4096 2024-09-19T08:13:20.320 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4197888 len 4096 2024-09-19T08:13:20.320 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4197888 len 8192 2024-09-19T08:13:20.320 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4197888 len 8192 2024-09-19T08:13:20.320 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4197888 len 8192 2024-09-19T08:13:20.320 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4197888 len 8192 2024-09-19T08:13:20.321 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 1536 offset 4197888 len 16384 2024-09-19T08:13:20.321 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4197888 len 16384 2024-09-19T08:13:20.321 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 1536 offset 4197888 len 16384 2024-09-19T08:13:20.321 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 1536 offset 4197888 len 16384 2024-09-19T08:13:20.321 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4190720 len 1024 2024-09-19T08:13:20.321 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4190720 len 1024 2024-09-19T08:13:20.321 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4190720 len 1024 2024-09-19T08:13:20.321 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4190720 len 1024 2024-09-19T08:13:20.321 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4190720 len 2048 2024-09-19T08:13:20.321 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4190720 len 2048 2024-09-19T08:13:20.321 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4190720 len 2048 2024-09-19T08:13:20.321 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4190720 len 2048 2024-09-19T08:13:20.322 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4190720 len 4096 2024-09-19T08:13:20.322 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4190720 len 4096 2024-09-19T08:13:20.322 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4190720 len 4096 2024-09-19T08:13:20.322 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4190720 len 4096 2024-09-19T08:13:20.322 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4190720 len 8192 2024-09-19T08:13:20.322 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4190720 len 8192 2024-09-19T08:13:20.322 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4190720 len 8192 2024-09-19T08:13:20.322 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4190720 len 8192 2024-09-19T08:13:20.322 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4190720 len 16384 2024-09-19T08:13:20.322 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4190720 len 16384 2024-09-19T08:13:20.322 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4190720 len 16384 2024-09-19T08:13:20.322 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4190720 len 16384 2024-09-19T08:13:20.322 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4191232 len 1024 2024-09-19T08:13:20.322 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4191232 len 1024 2024-09-19T08:13:20.323 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4191232 len 1024 2024-09-19T08:13:20.323 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4191232 len 1024 2024-09-19T08:13:20.323 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4191232 len 2048 2024-09-19T08:13:20.323 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4191232 len 2048 2024-09-19T08:13:20.323 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4191232 len 2048 2024-09-19T08:13:20.323 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4191232 len 2048 2024-09-19T08:13:20.323 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4191232 len 4096 2024-09-19T08:13:20.323 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4191232 len 4096 2024-09-19T08:13:20.323 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4191232 len 4096 2024-09-19T08:13:20.323 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4191232 len 4096 2024-09-19T08:13:20.323 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4191232 len 8192 2024-09-19T08:13:20.323 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4191232 len 8192 2024-09-19T08:13:20.323 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4191232 len 8192 2024-09-19T08:13:20.323 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4191232 len 8192 2024-09-19T08:13:20.324 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4191232 len 16384 2024-09-19T08:13:20.324 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4191232 len 16384 2024-09-19T08:13:20.324 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4191232 len 16384 2024-09-19T08:13:20.324 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4191232 len 16384 2024-09-19T08:13:20.324 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4191744 len 1024 2024-09-19T08:13:20.324 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4191744 len 1024 2024-09-19T08:13:20.324 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4191744 len 1024 2024-09-19T08:13:20.324 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4191744 len 1024 2024-09-19T08:13:20.324 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4191744 len 2048 2024-09-19T08:13:20.324 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4191744 len 2048 2024-09-19T08:13:20.324 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4191744 len 2048 2024-09-19T08:13:20.324 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4191744 len 2048 2024-09-19T08:13:20.324 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4191744 len 4096 2024-09-19T08:13:20.324 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4191744 len 4096 2024-09-19T08:13:20.325 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4191744 len 4096 2024-09-19T08:13:20.325 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4191744 len 4096 2024-09-19T08:13:20.325 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4191744 len 8192 2024-09-19T08:13:20.325 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4191744 len 8192 2024-09-19T08:13:20.325 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4191744 len 8192 2024-09-19T08:13:20.980 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4191744 len 8192 2024-09-19T08:13:20.980 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4191744 len 16384 2024-09-19T08:13:20.980 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4191744 len 16384 2024-09-19T08:13:20.980 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4191744 len 16384 2024-09-19T08:13:20.981 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4191744 len 16384 2024-09-19T08:13:20.981 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4192256 len 1024 2024-09-19T08:13:20.981 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4192256 len 1024 2024-09-19T08:13:20.981 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4192256 len 1024 2024-09-19T08:13:20.981 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4192256 len 1024 2024-09-19T08:13:20.981 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4192256 len 2048 2024-09-19T08:13:20.981 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4192256 len 2048 2024-09-19T08:13:20.981 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4192256 len 2048 2024-09-19T08:13:20.981 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4192256 len 2048 2024-09-19T08:13:20.981 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4192256 len 4096 2024-09-19T08:13:20.981 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4192256 len 4096 2024-09-19T08:13:20.981 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4192256 len 4096 2024-09-19T08:13:20.981 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4192256 len 4096 2024-09-19T08:13:20.982 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4192256 len 8192 2024-09-19T08:13:20.982 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4192256 len 8192 2024-09-19T08:13:20.982 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4192256 len 8192 2024-09-19T08:13:20.982 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4192256 len 8192 2024-09-19T08:13:20.982 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4192256 len 16384 2024-09-19T08:13:20.982 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4192256 len 16384 2024-09-19T08:13:20.982 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4192256 len 16384 2024-09-19T08:13:20.982 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4192256 len 16384 2024-09-19T08:13:20.982 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4192768 len 1024 2024-09-19T08:13:20.982 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4192768 len 1024 2024-09-19T08:13:20.982 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4192768 len 1024 2024-09-19T08:13:20.982 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4192768 len 1024 2024-09-19T08:13:20.982 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4192768 len 2048 2024-09-19T08:13:20.982 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4192768 len 2048 2024-09-19T08:13:20.983 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4192768 len 2048 2024-09-19T08:13:20.983 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4192768 len 2048 2024-09-19T08:13:20.983 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4192768 len 4096 2024-09-19T08:13:20.983 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4192768 len 4096 2024-09-19T08:13:20.983 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4192768 len 4096 2024-09-19T08:13:20.983 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4192768 len 4096 2024-09-19T08:13:20.983 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4192768 len 8192 2024-09-19T08:13:20.983 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4192768 len 8192 2024-09-19T08:13:20.983 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4192768 len 8192 2024-09-19T08:13:20.983 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4192768 len 8192 2024-09-19T08:13:20.983 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4192768 len 16384 2024-09-19T08:13:20.983 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4192768 len 16384 2024-09-19T08:13:20.983 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4192768 len 16384 2024-09-19T08:13:20.983 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4192768 len 16384 2024-09-19T08:13:20.984 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4193280 len 1024 2024-09-19T08:13:20.984 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4193280 len 1024 2024-09-19T08:13:20.984 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4193280 len 1024 2024-09-19T08:13:20.984 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4193280 len 1024 2024-09-19T08:13:20.984 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4193280 len 2048 2024-09-19T08:13:20.984 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4193280 len 2048 2024-09-19T08:13:20.984 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4193280 len 2048 2024-09-19T08:13:20.984 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4193280 len 2048 2024-09-19T08:13:20.984 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4193280 len 4096 2024-09-19T08:13:20.984 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4193280 len 4096 2024-09-19T08:13:20.984 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4193280 len 4096 2024-09-19T08:13:20.984 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4193280 len 4096 2024-09-19T08:13:20.984 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4193280 len 8192 2024-09-19T08:13:20.984 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4193280 len 8192 2024-09-19T08:13:20.985 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4193280 len 8192 2024-09-19T08:13:20.985 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4193280 len 8192 2024-09-19T08:13:20.985 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4193280 len 16384 2024-09-19T08:13:20.985 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4193280 len 16384 2024-09-19T08:13:20.985 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4193280 len 16384 2024-09-19T08:13:20.985 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4193280 len 16384 2024-09-19T08:13:20.985 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4193792 len 1024 2024-09-19T08:13:20.985 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4193792 len 1024 2024-09-19T08:13:20.985 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4193792 len 1024 2024-09-19T08:13:20.986 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4193792 len 1024 2024-09-19T08:13:20.986 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4193792 len 2048 2024-09-19T08:13:20.986 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4193792 len 2048 2024-09-19T08:13:20.986 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4193792 len 2048 2024-09-19T08:13:20.986 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4193792 len 2048 2024-09-19T08:13:20.986 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4193792 len 4096 2024-09-19T08:13:20.986 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4193792 len 4096 2024-09-19T08:13:20.986 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4193792 len 4096 2024-09-19T08:13:20.986 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4193792 len 4096 2024-09-19T08:13:20.986 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4193792 len 8192 2024-09-19T08:13:20.986 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4193792 len 8192 2024-09-19T08:13:20.986 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4193792 len 8192 2024-09-19T08:13:20.987 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4193792 len 8192 2024-09-19T08:13:21.295 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4193792 len 16384 2024-09-19T08:13:21.295 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4193792 len 16384 2024-09-19T08:13:21.295 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4193792 len 16384 2024-09-19T08:13:21.295 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4193792 len 16384 2024-09-19T08:13:21.295 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4194304 len 1024 2024-09-19T08:13:21.295 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4194304 len 1024 2024-09-19T08:13:21.295 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4194304 len 1024 2024-09-19T08:13:21.295 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4194304 len 1024 2024-09-19T08:13:21.295 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4194304 len 2048 2024-09-19T08:13:21.296 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4194304 len 2048 2024-09-19T08:13:21.296 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4194304 len 2048 2024-09-19T08:13:21.296 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4194304 len 2048 2024-09-19T08:13:21.296 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4194304 len 4096 2024-09-19T08:13:21.296 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4194304 len 4096 2024-09-19T08:13:21.296 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4194304 len 4096 2024-09-19T08:13:21.297 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4194304 len 4096 2024-09-19T08:13:21.297 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4194304 len 8192 2024-09-19T08:13:21.297 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4194304 len 8192 2024-09-19T08:13:21.297 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4194304 len 8192 2024-09-19T08:13:21.297 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4194304 len 8192 2024-09-19T08:13:21.297 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4194304 len 16384 2024-09-19T08:13:21.297 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4194304 len 16384 2024-09-19T08:13:21.297 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4194304 len 16384 2024-09-19T08:13:21.297 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4194304 len 16384 2024-09-19T08:13:21.297 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4194816 len 1024 2024-09-19T08:13:21.297 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4194816 len 1024 2024-09-19T08:13:21.297 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4194816 len 1024 2024-09-19T08:13:21.297 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4194816 len 1024 2024-09-19T08:13:21.298 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4194816 len 2048 2024-09-19T08:13:21.298 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4194816 len 2048 2024-09-19T08:13:21.298 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4194816 len 2048 2024-09-19T08:13:21.298 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4194816 len 2048 2024-09-19T08:13:21.298 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4194816 len 4096 2024-09-19T08:13:21.298 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4194816 len 4096 2024-09-19T08:13:21.298 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4194816 len 4096 2024-09-19T08:13:21.298 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4194816 len 4096 2024-09-19T08:13:21.298 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4194816 len 8192 2024-09-19T08:13:21.298 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4194816 len 8192 2024-09-19T08:13:21.298 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4194816 len 8192 2024-09-19T08:13:21.298 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4194816 len 8192 2024-09-19T08:13:21.299 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4194816 len 16384 2024-09-19T08:13:21.299 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4194816 len 16384 2024-09-19T08:13:21.299 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4194816 len 16384 2024-09-19T08:13:21.299 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4194816 len 16384 2024-09-19T08:13:21.299 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4195328 len 1024 2024-09-19T08:13:21.299 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4195328 len 1024 2024-09-19T08:13:21.299 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4195328 len 1024 2024-09-19T08:13:21.299 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4195328 len 1024 2024-09-19T08:13:21.299 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4195328 len 2048 2024-09-19T08:13:21.299 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4195328 len 2048 2024-09-19T08:13:21.299 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4195328 len 2048 2024-09-19T08:13:21.299 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4195328 len 2048 2024-09-19T08:13:21.299 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4195328 len 4096 2024-09-19T08:13:21.299 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4195328 len 4096 2024-09-19T08:13:21.300 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4195328 len 4096 2024-09-19T08:13:21.300 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4195328 len 4096 2024-09-19T08:13:21.300 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4195328 len 8192 2024-09-19T08:13:21.300 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4195328 len 8192 2024-09-19T08:13:21.300 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4195328 len 8192 2024-09-19T08:13:21.300 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4195328 len 8192 2024-09-19T08:13:21.300 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4195328 len 16384 2024-09-19T08:13:21.300 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4195328 len 16384 2024-09-19T08:13:21.301 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4195328 len 16384 2024-09-19T08:13:21.301 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4195328 len 16384 2024-09-19T08:13:21.301 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4195840 len 1024 2024-09-19T08:13:21.301 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4195840 len 1024 2024-09-19T08:13:21.301 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4195840 len 1024 2024-09-19T08:13:21.301 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4195840 len 1024 2024-09-19T08:13:21.301 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4195840 len 2048 2024-09-19T08:13:21.301 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4195840 len 2048 2024-09-19T08:13:21.301 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4195840 len 2048 2024-09-19T08:13:21.301 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4195840 len 2048 2024-09-19T08:13:21.301 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4195840 len 4096 2024-09-19T08:13:21.301 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4195840 len 4096 2024-09-19T08:13:21.301 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4195840 len 4096 2024-09-19T08:13:21.302 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4195840 len 4096 2024-09-19T08:13:21.302 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4195840 len 8192 2024-09-19T08:13:21.302 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4195840 len 8192 2024-09-19T08:13:21.302 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4195840 len 8192 2024-09-19T08:13:21.302 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4195840 len 8192 2024-09-19T08:13:21.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:21 smithi155 ceph-mon[35362]: pgmap v72: 97 pgs: 97 active+clean; 463 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 38 MiB/s rd, 332 KiB/s wr, 83 op/s 2024-09-19T08:13:21.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:21 smithi027 ceph-mon[31209]: pgmap v72: 97 pgs: 97 active+clean; 463 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 38 MiB/s rd, 332 KiB/s wr, 83 op/s 2024-09-19T08:13:21.507 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:21 smithi203 ceph-mon[35198]: pgmap v72: 97 pgs: 97 active+clean; 463 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 38 MiB/s rd, 332 KiB/s wr, 83 op/s 2024-09-19T08:13:21.686 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4195840 len 16384 2024-09-19T08:13:21.687 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4195840 len 16384 2024-09-19T08:13:21.687 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4195840 len 16384 2024-09-19T08:13:21.687 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4195840 len 16384 2024-09-19T08:13:21.687 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4196352 len 1024 2024-09-19T08:13:21.687 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4196352 len 1024 2024-09-19T08:13:21.687 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4196352 len 1024 2024-09-19T08:13:21.688 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4196352 len 1024 2024-09-19T08:13:21.688 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4196352 len 2048 2024-09-19T08:13:21.688 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4196352 len 2048 2024-09-19T08:13:21.688 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4196352 len 2048 2024-09-19T08:13:21.688 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4196352 len 2048 2024-09-19T08:13:21.688 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4196352 len 4096 2024-09-19T08:13:21.689 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4196352 len 4096 2024-09-19T08:13:21.689 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4196352 len 4096 2024-09-19T08:13:21.689 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4196352 len 4096 2024-09-19T08:13:21.689 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4196352 len 8192 2024-09-19T08:13:21.689 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4196352 len 8192 2024-09-19T08:13:21.689 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4196352 len 8192 2024-09-19T08:13:21.689 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4196352 len 8192 2024-09-19T08:13:21.689 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4196352 len 16384 2024-09-19T08:13:21.690 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4196352 len 16384 2024-09-19T08:13:21.690 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4196352 len 16384 2024-09-19T08:13:21.690 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4196352 len 16384 2024-09-19T08:13:21.690 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4196864 len 1024 2024-09-19T08:13:21.690 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4196864 len 1024 2024-09-19T08:13:21.690 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4196864 len 1024 2024-09-19T08:13:21.690 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4196864 len 1024 2024-09-19T08:13:21.690 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4196864 len 2048 2024-09-19T08:13:21.691 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4196864 len 2048 2024-09-19T08:13:21.691 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4196864 len 2048 2024-09-19T08:13:21.691 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4196864 len 2048 2024-09-19T08:13:21.691 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4196864 len 4096 2024-09-19T08:13:21.691 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4196864 len 4096 2024-09-19T08:13:21.691 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4196864 len 4096 2024-09-19T08:13:21.691 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4196864 len 4096 2024-09-19T08:13:21.692 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4196864 len 8192 2024-09-19T08:13:21.692 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4196864 len 8192 2024-09-19T08:13:21.692 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4196864 len 8192 2024-09-19T08:13:21.692 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4196864 len 8192 2024-09-19T08:13:21.692 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4196864 len 16384 2024-09-19T08:13:21.692 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4196864 len 16384 2024-09-19T08:13:21.692 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4196864 len 16384 2024-09-19T08:13:21.692 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4196864 len 16384 2024-09-19T08:13:21.692 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4197376 len 1024 2024-09-19T08:13:21.692 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4197376 len 1024 2024-09-19T08:13:21.693 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4197376 len 1024 2024-09-19T08:13:21.693 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4197376 len 1024 2024-09-19T08:13:21.693 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4197376 len 2048 2024-09-19T08:13:21.693 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4197376 len 2048 2024-09-19T08:13:21.693 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4197376 len 2048 2024-09-19T08:13:21.693 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4197376 len 2048 2024-09-19T08:13:21.693 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4197376 len 4096 2024-09-19T08:13:21.693 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4197376 len 4096 2024-09-19T08:13:21.693 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4197376 len 4096 2024-09-19T08:13:21.693 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4197376 len 4096 2024-09-19T08:13:21.693 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4197376 len 8192 2024-09-19T08:13:21.694 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4197376 len 8192 2024-09-19T08:13:21.694 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4197376 len 8192 2024-09-19T08:13:21.694 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4197376 len 8192 2024-09-19T08:13:21.694 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4197376 len 16384 2024-09-19T08:13:21.694 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4197376 len 16384 2024-09-19T08:13:21.694 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4197376 len 16384 2024-09-19T08:13:21.694 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4197376 len 16384 2024-09-19T08:13:21.694 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4197888 len 1024 2024-09-19T08:13:21.694 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4197888 len 1024 2024-09-19T08:13:21.694 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4197888 len 1024 2024-09-19T08:13:21.694 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4197888 len 1024 2024-09-19T08:13:21.694 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4197888 len 2048 2024-09-19T08:13:21.695 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4197888 len 2048 2024-09-19T08:13:21.695 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4197888 len 2048 2024-09-19T08:13:21.695 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4197888 len 2048 2024-09-19T08:13:21.695 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4197888 len 4096 2024-09-19T08:13:21.695 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4197888 len 4096 2024-09-19T08:13:21.695 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4197888 len 4096 2024-09-19T08:13:21.695 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4197888 len 4096 2024-09-19T08:13:21.695 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4197888 len 8192 2024-09-19T08:13:21.695 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4197888 len 8192 2024-09-19T08:13:21.695 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4197888 len 8192 2024-09-19T08:13:21.695 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4197888 len 8192 2024-09-19T08:13:21.696 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2048 offset 4197888 len 16384 2024-09-19T08:13:22.312 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4197888 len 16384 2024-09-19T08:13:22.312 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2048 offset 4197888 len 16384 2024-09-19T08:13:22.312 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2048 offset 4197888 len 16384 2024-09-19T08:13:22.312 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4190720 len 1024 2024-09-19T08:13:22.312 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4190720 len 1024 2024-09-19T08:13:22.312 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4190720 len 1024 2024-09-19T08:13:22.313 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4190720 len 1024 2024-09-19T08:13:22.313 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4190720 len 2048 2024-09-19T08:13:22.313 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4190720 len 2048 2024-09-19T08:13:22.313 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4190720 len 2048 2024-09-19T08:13:22.313 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4190720 len 2048 2024-09-19T08:13:22.313 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4190720 len 4096 2024-09-19T08:13:22.313 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4190720 len 4096 2024-09-19T08:13:22.313 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4190720 len 4096 2024-09-19T08:13:22.313 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4190720 len 4096 2024-09-19T08:13:22.313 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4190720 len 8192 2024-09-19T08:13:22.314 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4190720 len 8192 2024-09-19T08:13:22.314 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4190720 len 8192 2024-09-19T08:13:22.314 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4190720 len 8192 2024-09-19T08:13:22.314 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4190720 len 16384 2024-09-19T08:13:22.314 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4190720 len 16384 2024-09-19T08:13:22.314 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4190720 len 16384 2024-09-19T08:13:22.314 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4190720 len 16384 2024-09-19T08:13:22.314 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4191232 len 1024 2024-09-19T08:13:22.314 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4191232 len 1024 2024-09-19T08:13:22.314 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4191232 len 1024 2024-09-19T08:13:22.314 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4191232 len 1024 2024-09-19T08:13:22.314 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4191232 len 2048 2024-09-19T08:13:22.314 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4191232 len 2048 2024-09-19T08:13:22.314 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4191232 len 2048 2024-09-19T08:13:22.315 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4191232 len 2048 2024-09-19T08:13:22.315 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4191232 len 4096 2024-09-19T08:13:22.315 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4191232 len 4096 2024-09-19T08:13:22.315 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4191232 len 4096 2024-09-19T08:13:22.315 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4191232 len 4096 2024-09-19T08:13:22.315 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4191232 len 8192 2024-09-19T08:13:22.315 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4191232 len 8192 2024-09-19T08:13:22.315 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4191232 len 8192 2024-09-19T08:13:22.315 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4191232 len 8192 2024-09-19T08:13:22.315 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4191232 len 16384 2024-09-19T08:13:22.316 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4191232 len 16384 2024-09-19T08:13:22.316 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4191232 len 16384 2024-09-19T08:13:22.316 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4191232 len 16384 2024-09-19T08:13:22.316 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4191744 len 1024 2024-09-19T08:13:22.316 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4191744 len 1024 2024-09-19T08:13:22.316 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4191744 len 1024 2024-09-19T08:13:22.316 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4191744 len 1024 2024-09-19T08:13:22.316 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4191744 len 2048 2024-09-19T08:13:22.316 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4191744 len 2048 2024-09-19T08:13:22.316 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4191744 len 2048 2024-09-19T08:13:22.316 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4191744 len 2048 2024-09-19T08:13:22.316 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4191744 len 4096 2024-09-19T08:13:22.316 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4191744 len 4096 2024-09-19T08:13:22.317 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4191744 len 4096 2024-09-19T08:13:22.317 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4191744 len 4096 2024-09-19T08:13:22.317 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4191744 len 8192 2024-09-19T08:13:22.317 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4191744 len 8192 2024-09-19T08:13:22.317 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4191744 len 8192 2024-09-19T08:13:22.317 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4191744 len 8192 2024-09-19T08:13:22.317 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4191744 len 16384 2024-09-19T08:13:22.317 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4191744 len 16384 2024-09-19T08:13:22.317 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4191744 len 16384 2024-09-19T08:13:22.317 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4191744 len 16384 2024-09-19T08:13:22.318 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4192256 len 1024 2024-09-19T08:13:22.318 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4192256 len 1024 2024-09-19T08:13:22.318 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4192256 len 1024 2024-09-19T08:13:22.318 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4192256 len 1024 2024-09-19T08:13:22.318 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4192256 len 2048 2024-09-19T08:13:22.318 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4192256 len 2048 2024-09-19T08:13:22.318 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4192256 len 2048 2024-09-19T08:13:22.318 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4192256 len 2048 2024-09-19T08:13:22.318 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4192256 len 4096 2024-09-19T08:13:22.318 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4192256 len 4096 2024-09-19T08:13:22.318 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4192256 len 4096 2024-09-19T08:13:22.318 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4192256 len 4096 2024-09-19T08:13:22.318 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4192256 len 8192 2024-09-19T08:13:22.319 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4192256 len 8192 2024-09-19T08:13:22.319 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4192256 len 8192 2024-09-19T08:13:22.319 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4192256 len 8192 2024-09-19T08:13:22.319 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4192256 len 16384 2024-09-19T08:13:22.319 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4192256 len 16384 2024-09-19T08:13:22.911 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4192256 len 16384 2024-09-19T08:13:22.911 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4192256 len 16384 2024-09-19T08:13:22.911 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4192768 len 1024 2024-09-19T08:13:22.912 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4192768 len 1024 2024-09-19T08:13:22.912 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4192768 len 1024 2024-09-19T08:13:22.912 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4192768 len 1024 2024-09-19T08:13:22.912 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4192768 len 2048 2024-09-19T08:13:22.912 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4192768 len 2048 2024-09-19T08:13:22.912 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4192768 len 2048 2024-09-19T08:13:22.912 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4192768 len 2048 2024-09-19T08:13:22.912 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4192768 len 4096 2024-09-19T08:13:22.912 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4192768 len 4096 2024-09-19T08:13:22.912 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4192768 len 4096 2024-09-19T08:13:22.912 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4192768 len 4096 2024-09-19T08:13:22.912 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4192768 len 8192 2024-09-19T08:13:22.912 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4192768 len 8192 2024-09-19T08:13:22.913 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4192768 len 8192 2024-09-19T08:13:22.913 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4192768 len 8192 2024-09-19T08:13:22.913 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4192768 len 16384 2024-09-19T08:13:22.913 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4192768 len 16384 2024-09-19T08:13:22.913 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4192768 len 16384 2024-09-19T08:13:22.913 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4192768 len 16384 2024-09-19T08:13:22.913 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4193280 len 1024 2024-09-19T08:13:22.913 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4193280 len 1024 2024-09-19T08:13:22.913 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4193280 len 1024 2024-09-19T08:13:22.913 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4193280 len 1024 2024-09-19T08:13:22.913 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4193280 len 2048 2024-09-19T08:13:22.913 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4193280 len 2048 2024-09-19T08:13:22.913 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4193280 len 2048 2024-09-19T08:13:22.913 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4193280 len 2048 2024-09-19T08:13:22.914 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4193280 len 4096 2024-09-19T08:13:22.914 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4193280 len 4096 2024-09-19T08:13:22.914 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4193280 len 4096 2024-09-19T08:13:22.914 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4193280 len 4096 2024-09-19T08:13:22.914 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4193280 len 8192 2024-09-19T08:13:22.914 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4193280 len 8192 2024-09-19T08:13:22.914 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4193280 len 8192 2024-09-19T08:13:22.914 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4193280 len 8192 2024-09-19T08:13:22.914 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4193280 len 16384 2024-09-19T08:13:22.914 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4193280 len 16384 2024-09-19T08:13:22.914 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4193280 len 16384 2024-09-19T08:13:22.914 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4193280 len 16384 2024-09-19T08:13:22.914 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4193792 len 1024 2024-09-19T08:13:22.914 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4193792 len 1024 2024-09-19T08:13:22.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4193792 len 1024 2024-09-19T08:13:22.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4193792 len 1024 2024-09-19T08:13:22.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4193792 len 2048 2024-09-19T08:13:22.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4193792 len 2048 2024-09-19T08:13:22.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4193792 len 2048 2024-09-19T08:13:22.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4193792 len 2048 2024-09-19T08:13:22.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4193792 len 4096 2024-09-19T08:13:22.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4193792 len 4096 2024-09-19T08:13:22.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4193792 len 4096 2024-09-19T08:13:22.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4193792 len 4096 2024-09-19T08:13:22.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4193792 len 8192 2024-09-19T08:13:22.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4193792 len 8192 2024-09-19T08:13:22.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4193792 len 8192 2024-09-19T08:13:22.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4193792 len 8192 2024-09-19T08:13:22.915 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4193792 len 16384 2024-09-19T08:13:22.916 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4193792 len 16384 2024-09-19T08:13:22.916 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4193792 len 16384 2024-09-19T08:13:22.916 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4193792 len 16384 2024-09-19T08:13:22.916 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4194304 len 1024 2024-09-19T08:13:22.916 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4194304 len 1024 2024-09-19T08:13:22.916 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4194304 len 1024 2024-09-19T08:13:22.916 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4194304 len 1024 2024-09-19T08:13:22.916 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4194304 len 2048 2024-09-19T08:13:22.916 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4194304 len 2048 2024-09-19T08:13:22.916 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4194304 len 2048 2024-09-19T08:13:22.916 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4194304 len 2048 2024-09-19T08:13:22.916 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4194304 len 4096 2024-09-19T08:13:22.916 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4194304 len 4096 2024-09-19T08:13:22.917 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4194304 len 4096 2024-09-19T08:13:22.917 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4194304 len 4096 2024-09-19T08:13:22.917 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4194304 len 8192 2024-09-19T08:13:22.917 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4194304 len 8192 2024-09-19T08:13:22.917 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4194304 len 8192 2024-09-19T08:13:22.917 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4194304 len 8192 2024-09-19T08:13:22.917 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4194304 len 16384 2024-09-19T08:13:22.917 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4194304 len 16384 2024-09-19T08:13:22.917 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4194304 len 16384 2024-09-19T08:13:23.261 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4194304 len 16384 2024-09-19T08:13:23.261 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4194816 len 1024 2024-09-19T08:13:23.261 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4194816 len 1024 2024-09-19T08:13:23.262 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4194816 len 1024 2024-09-19T08:13:23.262 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4194816 len 1024 2024-09-19T08:13:23.262 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4194816 len 2048 2024-09-19T08:13:23.262 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4194816 len 2048 2024-09-19T08:13:23.262 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4194816 len 2048 2024-09-19T08:13:23.262 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4194816 len 2048 2024-09-19T08:13:23.262 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4194816 len 4096 2024-09-19T08:13:23.262 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4194816 len 4096 2024-09-19T08:13:23.262 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4194816 len 4096 2024-09-19T08:13:23.262 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4194816 len 4096 2024-09-19T08:13:23.262 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4194816 len 8192 2024-09-19T08:13:23.262 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4194816 len 8192 2024-09-19T08:13:23.263 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4194816 len 8192 2024-09-19T08:13:23.263 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4194816 len 8192 2024-09-19T08:13:23.263 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4194816 len 16384 2024-09-19T08:13:23.263 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4194816 len 16384 2024-09-19T08:13:23.263 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4194816 len 16384 2024-09-19T08:13:23.263 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4194816 len 16384 2024-09-19T08:13:23.263 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4195328 len 1024 2024-09-19T08:13:23.263 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4195328 len 1024 2024-09-19T08:13:23.264 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4195328 len 1024 2024-09-19T08:13:23.264 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4195328 len 1024 2024-09-19T08:13:23.264 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4195328 len 2048 2024-09-19T08:13:23.264 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4195328 len 2048 2024-09-19T08:13:23.264 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4195328 len 2048 2024-09-19T08:13:23.264 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4195328 len 2048 2024-09-19T08:13:23.264 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4195328 len 4096 2024-09-19T08:13:23.264 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4195328 len 4096 2024-09-19T08:13:23.264 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4195328 len 4096 2024-09-19T08:13:23.264 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4195328 len 4096 2024-09-19T08:13:23.264 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4195328 len 8192 2024-09-19T08:13:23.264 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4195328 len 8192 2024-09-19T08:13:23.265 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4195328 len 8192 2024-09-19T08:13:23.265 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4195328 len 8192 2024-09-19T08:13:23.265 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4195328 len 16384 2024-09-19T08:13:23.265 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4195328 len 16384 2024-09-19T08:13:23.265 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4195328 len 16384 2024-09-19T08:13:23.265 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4195328 len 16384 2024-09-19T08:13:23.265 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4195840 len 1024 2024-09-19T08:13:23.265 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4195840 len 1024 2024-09-19T08:13:23.265 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4195840 len 1024 2024-09-19T08:13:23.265 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4195840 len 1024 2024-09-19T08:13:23.266 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4195840 len 2048 2024-09-19T08:13:23.266 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4195840 len 2048 2024-09-19T08:13:23.266 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4195840 len 2048 2024-09-19T08:13:23.266 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4195840 len 2048 2024-09-19T08:13:23.266 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4195840 len 4096 2024-09-19T08:13:23.266 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4195840 len 4096 2024-09-19T08:13:23.266 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4195840 len 4096 2024-09-19T08:13:23.266 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4195840 len 4096 2024-09-19T08:13:23.266 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4195840 len 8192 2024-09-19T08:13:23.266 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4195840 len 8192 2024-09-19T08:13:23.266 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4195840 len 8192 2024-09-19T08:13:23.266 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4195840 len 8192 2024-09-19T08:13:23.266 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4195840 len 16384 2024-09-19T08:13:23.266 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4195840 len 16384 2024-09-19T08:13:23.266 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4195840 len 16384 2024-09-19T08:13:23.267 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4195840 len 16384 2024-09-19T08:13:23.267 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4196352 len 1024 2024-09-19T08:13:23.267 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4196352 len 1024 2024-09-19T08:13:23.267 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4196352 len 1024 2024-09-19T08:13:23.267 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4196352 len 1024 2024-09-19T08:13:23.267 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4196352 len 2048 2024-09-19T08:13:23.267 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4196352 len 2048 2024-09-19T08:13:23.267 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4196352 len 2048 2024-09-19T08:13:23.267 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4196352 len 2048 2024-09-19T08:13:23.267 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4196352 len 4096 2024-09-19T08:13:23.267 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4196352 len 4096 2024-09-19T08:13:23.267 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4196352 len 4096 2024-09-19T08:13:23.267 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4196352 len 4096 2024-09-19T08:13:23.268 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4196352 len 8192 2024-09-19T08:13:23.268 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4196352 len 8192 2024-09-19T08:13:23.268 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4196352 len 8192 2024-09-19T08:13:23.268 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4196352 len 8192 2024-09-19T08:13:23.268 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4196352 len 16384 2024-09-19T08:13:23.268 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4196352 len 16384 2024-09-19T08:13:23.268 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4196352 len 16384 2024-09-19T08:13:23.268 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4196352 len 16384 2024-09-19T08:13:23.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:23 smithi155 ceph-mon[35362]: pgmap v73: 97 pgs: 97 active+clean; 463 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 38 MiB/s rd, 332 KiB/s wr, 83 op/s 2024-09-19T08:13:23.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:23 smithi027 ceph-mon[31209]: pgmap v73: 97 pgs: 97 active+clean; 463 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 38 MiB/s rd, 332 KiB/s wr, 83 op/s 2024-09-19T08:13:23.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:23 smithi203 ceph-mon[35198]: pgmap v73: 97 pgs: 97 active+clean; 463 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 38 MiB/s rd, 332 KiB/s wr, 83 op/s 2024-09-19T08:13:23.740 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4196864 len 1024 2024-09-19T08:13:23.740 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4196864 len 1024 2024-09-19T08:13:23.740 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4196864 len 1024 2024-09-19T08:13:23.740 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4196864 len 1024 2024-09-19T08:13:23.740 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4196864 len 2048 2024-09-19T08:13:23.740 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4196864 len 2048 2024-09-19T08:13:23.740 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4196864 len 2048 2024-09-19T08:13:23.740 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4196864 len 2048 2024-09-19T08:13:23.740 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4196864 len 4096 2024-09-19T08:13:23.740 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4196864 len 4096 2024-09-19T08:13:23.741 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4196864 len 4096 2024-09-19T08:13:23.741 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4196864 len 4096 2024-09-19T08:13:23.741 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4196864 len 8192 2024-09-19T08:13:23.741 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4196864 len 8192 2024-09-19T08:13:23.741 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4196864 len 8192 2024-09-19T08:13:23.741 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4196864 len 8192 2024-09-19T08:13:23.741 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4196864 len 16384 2024-09-19T08:13:23.741 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4196864 len 16384 2024-09-19T08:13:23.741 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4196864 len 16384 2024-09-19T08:13:23.741 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4196864 len 16384 2024-09-19T08:13:23.741 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4197376 len 1024 2024-09-19T08:13:23.741 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4197376 len 1024 2024-09-19T08:13:23.742 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4197376 len 1024 2024-09-19T08:13:23.742 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4197376 len 1024 2024-09-19T08:13:23.742 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4197376 len 2048 2024-09-19T08:13:23.742 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4197376 len 2048 2024-09-19T08:13:23.742 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4197376 len 2048 2024-09-19T08:13:23.742 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4197376 len 2048 2024-09-19T08:13:23.742 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4197376 len 4096 2024-09-19T08:13:23.742 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4197376 len 4096 2024-09-19T08:13:23.742 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4197376 len 4096 2024-09-19T08:13:23.742 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4197376 len 4096 2024-09-19T08:13:23.742 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4197376 len 8192 2024-09-19T08:13:23.742 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4197376 len 8192 2024-09-19T08:13:23.742 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4197376 len 8192 2024-09-19T08:13:23.742 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4197376 len 8192 2024-09-19T08:13:23.743 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4197376 len 16384 2024-09-19T08:13:23.743 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4197376 len 16384 2024-09-19T08:13:23.743 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4197376 len 16384 2024-09-19T08:13:23.743 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4197376 len 16384 2024-09-19T08:13:23.743 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4197888 len 1024 2024-09-19T08:13:23.743 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4197888 len 1024 2024-09-19T08:13:23.743 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4197888 len 1024 2024-09-19T08:13:23.743 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4197888 len 1024 2024-09-19T08:13:23.743 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4197888 len 2048 2024-09-19T08:13:23.743 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4197888 len 2048 2024-09-19T08:13:23.743 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4197888 len 2048 2024-09-19T08:13:23.744 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4197888 len 2048 2024-09-19T08:13:23.744 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4197888 len 4096 2024-09-19T08:13:23.744 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4197888 len 4096 2024-09-19T08:13:23.744 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4197888 len 4096 2024-09-19T08:13:23.744 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4197888 len 4096 2024-09-19T08:13:23.744 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4197888 len 8192 2024-09-19T08:13:23.744 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4197888 len 8192 2024-09-19T08:13:23.744 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4197888 len 8192 2024-09-19T08:13:23.744 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4197888 len 8192 2024-09-19T08:13:23.744 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 2560 offset 4197888 len 16384 2024-09-19T08:13:23.744 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4197888 len 16384 2024-09-19T08:13:23.744 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 2560 offset 4197888 len 16384 2024-09-19T08:13:23.745 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 2560 offset 4197888 len 16384 2024-09-19T08:13:23.745 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4190720 len 1024 2024-09-19T08:13:23.745 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4190720 len 1024 2024-09-19T08:13:23.745 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4190720 len 1024 2024-09-19T08:13:23.745 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4190720 len 1024 2024-09-19T08:13:23.745 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4190720 len 2048 2024-09-19T08:13:23.745 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4190720 len 2048 2024-09-19T08:13:23.745 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4190720 len 2048 2024-09-19T08:13:23.745 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4190720 len 2048 2024-09-19T08:13:23.745 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4190720 len 4096 2024-09-19T08:13:23.745 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4190720 len 4096 2024-09-19T08:13:23.746 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4190720 len 4096 2024-09-19T08:13:23.746 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4190720 len 4096 2024-09-19T08:13:23.746 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4190720 len 8192 2024-09-19T08:13:23.746 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4190720 len 8192 2024-09-19T08:13:23.746 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4190720 len 8192 2024-09-19T08:13:23.746 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4190720 len 8192 2024-09-19T08:13:23.746 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4190720 len 16384 2024-09-19T08:13:23.746 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4190720 len 16384 2024-09-19T08:13:23.746 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4190720 len 16384 2024-09-19T08:13:23.746 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4190720 len 16384 2024-09-19T08:13:24.394 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4191232 len 1024 2024-09-19T08:13:24.394 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4191232 len 1024 2024-09-19T08:13:24.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4191232 len 1024 2024-09-19T08:13:24.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4191232 len 1024 2024-09-19T08:13:24.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4191232 len 2048 2024-09-19T08:13:24.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4191232 len 2048 2024-09-19T08:13:24.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4191232 len 2048 2024-09-19T08:13:24.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4191232 len 2048 2024-09-19T08:13:24.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4191232 len 4096 2024-09-19T08:13:24.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4191232 len 4096 2024-09-19T08:13:24.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4191232 len 4096 2024-09-19T08:13:24.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4191232 len 4096 2024-09-19T08:13:24.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4191232 len 8192 2024-09-19T08:13:24.395 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4191232 len 8192 2024-09-19T08:13:24.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4191232 len 8192 2024-09-19T08:13:24.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4191232 len 8192 2024-09-19T08:13:24.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4191232 len 16384 2024-09-19T08:13:24.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4191232 len 16384 2024-09-19T08:13:24.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4191232 len 16384 2024-09-19T08:13:24.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4191232 len 16384 2024-09-19T08:13:24.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4191744 len 1024 2024-09-19T08:13:24.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4191744 len 1024 2024-09-19T08:13:24.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4191744 len 1024 2024-09-19T08:13:24.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4191744 len 1024 2024-09-19T08:13:24.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4191744 len 2048 2024-09-19T08:13:24.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4191744 len 2048 2024-09-19T08:13:24.396 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4191744 len 2048 2024-09-19T08:13:24.397 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4191744 len 2048 2024-09-19T08:13:24.397 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4191744 len 4096 2024-09-19T08:13:24.397 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4191744 len 4096 2024-09-19T08:13:24.397 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4191744 len 4096 2024-09-19T08:13:24.397 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4191744 len 4096 2024-09-19T08:13:24.397 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4191744 len 8192 2024-09-19T08:13:24.397 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4191744 len 8192 2024-09-19T08:13:24.397 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4191744 len 8192 2024-09-19T08:13:24.397 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4191744 len 8192 2024-09-19T08:13:24.397 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4191744 len 16384 2024-09-19T08:13:24.397 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4191744 len 16384 2024-09-19T08:13:24.397 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4191744 len 16384 2024-09-19T08:13:24.397 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4191744 len 16384 2024-09-19T08:13:24.397 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4192256 len 1024 2024-09-19T08:13:24.398 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4192256 len 1024 2024-09-19T08:13:24.398 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4192256 len 1024 2024-09-19T08:13:24.398 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4192256 len 1024 2024-09-19T08:13:24.398 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4192256 len 2048 2024-09-19T08:13:24.398 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4192256 len 2048 2024-09-19T08:13:24.398 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4192256 len 2048 2024-09-19T08:13:24.398 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4192256 len 2048 2024-09-19T08:13:24.398 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4192256 len 4096 2024-09-19T08:13:24.398 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4192256 len 4096 2024-09-19T08:13:24.398 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4192256 len 4096 2024-09-19T08:13:24.398 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4192256 len 4096 2024-09-19T08:13:24.398 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4192256 len 8192 2024-09-19T08:13:24.398 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4192256 len 8192 2024-09-19T08:13:24.398 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4192256 len 8192 2024-09-19T08:13:24.399 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4192256 len 8192 2024-09-19T08:13:24.399 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4192256 len 16384 2024-09-19T08:13:24.399 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4192256 len 16384 2024-09-19T08:13:24.399 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4192256 len 16384 2024-09-19T08:13:24.399 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4192256 len 16384 2024-09-19T08:13:24.399 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4192768 len 1024 2024-09-19T08:13:24.399 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4192768 len 1024 2024-09-19T08:13:24.399 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4192768 len 1024 2024-09-19T08:13:24.399 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4192768 len 1024 2024-09-19T08:13:24.399 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4192768 len 2048 2024-09-19T08:13:24.399 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4192768 len 2048 2024-09-19T08:13:24.399 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4192768 len 2048 2024-09-19T08:13:24.399 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4192768 len 2048 2024-09-19T08:13:24.400 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4192768 len 4096 2024-09-19T08:13:24.400 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4192768 len 4096 2024-09-19T08:13:24.400 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4192768 len 4096 2024-09-19T08:13:24.400 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4192768 len 4096 2024-09-19T08:13:24.400 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4192768 len 8192 2024-09-19T08:13:24.400 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4192768 len 8192 2024-09-19T08:13:24.400 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4192768 len 8192 2024-09-19T08:13:24.400 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4192768 len 8192 2024-09-19T08:13:24.400 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4192768 len 16384 2024-09-19T08:13:24.400 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4192768 len 16384 2024-09-19T08:13:24.400 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4192768 len 16384 2024-09-19T08:13:24.400 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4192768 len 16384 2024-09-19T08:13:24.400 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4193280 len 1024 2024-09-19T08:13:24.941 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4193280 len 1024 2024-09-19T08:13:24.941 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4193280 len 1024 2024-09-19T08:13:24.941 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4193280 len 1024 2024-09-19T08:13:24.941 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4193280 len 2048 2024-09-19T08:13:24.941 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4193280 len 2048 2024-09-19T08:13:24.942 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4193280 len 2048 2024-09-19T08:13:24.942 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4193280 len 2048 2024-09-19T08:13:24.942 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4193280 len 4096 2024-09-19T08:13:24.942 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4193280 len 4096 2024-09-19T08:13:24.942 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4193280 len 4096 2024-09-19T08:13:24.942 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4193280 len 4096 2024-09-19T08:13:24.942 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4193280 len 8192 2024-09-19T08:13:24.942 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4193280 len 8192 2024-09-19T08:13:24.942 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4193280 len 8192 2024-09-19T08:13:24.942 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4193280 len 8192 2024-09-19T08:13:24.942 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4193280 len 16384 2024-09-19T08:13:24.942 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4193280 len 16384 2024-09-19T08:13:24.942 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4193280 len 16384 2024-09-19T08:13:24.942 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4193280 len 16384 2024-09-19T08:13:24.943 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4193792 len 1024 2024-09-19T08:13:24.943 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4193792 len 1024 2024-09-19T08:13:24.943 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4193792 len 1024 2024-09-19T08:13:24.943 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4193792 len 1024 2024-09-19T08:13:24.943 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4193792 len 2048 2024-09-19T08:13:24.943 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4193792 len 2048 2024-09-19T08:13:24.943 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4193792 len 2048 2024-09-19T08:13:24.943 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4193792 len 2048 2024-09-19T08:13:24.943 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4193792 len 4096 2024-09-19T08:13:24.943 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4193792 len 4096 2024-09-19T08:13:24.943 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4193792 len 4096 2024-09-19T08:13:24.943 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4193792 len 4096 2024-09-19T08:13:24.943 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4193792 len 8192 2024-09-19T08:13:24.943 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4193792 len 8192 2024-09-19T08:13:24.944 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4193792 len 8192 2024-09-19T08:13:24.944 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4193792 len 8192 2024-09-19T08:13:24.944 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4193792 len 16384 2024-09-19T08:13:24.944 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4193792 len 16384 2024-09-19T08:13:24.944 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4193792 len 16384 2024-09-19T08:13:24.944 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4193792 len 16384 2024-09-19T08:13:24.944 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4194304 len 1024 2024-09-19T08:13:24.944 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4194304 len 1024 2024-09-19T08:13:24.944 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4194304 len 1024 2024-09-19T08:13:24.944 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4194304 len 1024 2024-09-19T08:13:24.944 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4194304 len 2048 2024-09-19T08:13:24.944 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4194304 len 2048 2024-09-19T08:13:24.944 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4194304 len 2048 2024-09-19T08:13:24.945 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4194304 len 2048 2024-09-19T08:13:24.945 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4194304 len 4096 2024-09-19T08:13:24.945 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4194304 len 4096 2024-09-19T08:13:24.945 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4194304 len 4096 2024-09-19T08:13:24.945 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4194304 len 4096 2024-09-19T08:13:24.945 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4194304 len 8192 2024-09-19T08:13:24.945 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4194304 len 8192 2024-09-19T08:13:24.945 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4194304 len 8192 2024-09-19T08:13:24.945 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4194304 len 8192 2024-09-19T08:13:24.945 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4194304 len 16384 2024-09-19T08:13:24.946 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4194304 len 16384 2024-09-19T08:13:24.946 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4194304 len 16384 2024-09-19T08:13:24.946 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4194304 len 16384 2024-09-19T08:13:24.946 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4194816 len 1024 2024-09-19T08:13:24.946 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4194816 len 1024 2024-09-19T08:13:24.946 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4194816 len 1024 2024-09-19T08:13:24.946 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4194816 len 1024 2024-09-19T08:13:24.946 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4194816 len 2048 2024-09-19T08:13:24.946 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4194816 len 2048 2024-09-19T08:13:24.946 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4194816 len 2048 2024-09-19T08:13:24.946 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4194816 len 2048 2024-09-19T08:13:24.946 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4194816 len 4096 2024-09-19T08:13:24.946 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4194816 len 4096 2024-09-19T08:13:24.946 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4194816 len 4096 2024-09-19T08:13:24.947 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4194816 len 4096 2024-09-19T08:13:24.947 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4194816 len 8192 2024-09-19T08:13:24.947 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4194816 len 8192 2024-09-19T08:13:24.947 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4194816 len 8192 2024-09-19T08:13:24.947 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4194816 len 8192 2024-09-19T08:13:24.947 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4194816 len 16384 2024-09-19T08:13:24.947 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4194816 len 16384 2024-09-19T08:13:24.947 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4194816 len 16384 2024-09-19T08:13:24.947 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4194816 len 16384 2024-09-19T08:13:24.947 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4195328 len 1024 2024-09-19T08:13:24.947 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4195328 len 1024 2024-09-19T08:13:25.281 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4195328 len 1024 2024-09-19T08:13:25.281 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4195328 len 1024 2024-09-19T08:13:25.281 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4195328 len 2048 2024-09-19T08:13:25.281 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4195328 len 2048 2024-09-19T08:13:25.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4195328 len 2048 2024-09-19T08:13:25.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4195328 len 2048 2024-09-19T08:13:25.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4195328 len 4096 2024-09-19T08:13:25.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4195328 len 4096 2024-09-19T08:13:25.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4195328 len 4096 2024-09-19T08:13:25.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4195328 len 4096 2024-09-19T08:13:25.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4195328 len 8192 2024-09-19T08:13:25.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4195328 len 8192 2024-09-19T08:13:25.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4195328 len 8192 2024-09-19T08:13:25.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4195328 len 8192 2024-09-19T08:13:25.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4195328 len 16384 2024-09-19T08:13:25.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4195328 len 16384 2024-09-19T08:13:25.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4195328 len 16384 2024-09-19T08:13:25.282 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4195328 len 16384 2024-09-19T08:13:25.283 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4195840 len 1024 2024-09-19T08:13:25.283 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4195840 len 1024 2024-09-19T08:13:25.283 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4195840 len 1024 2024-09-19T08:13:25.283 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4195840 len 1024 2024-09-19T08:13:25.283 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4195840 len 2048 2024-09-19T08:13:25.283 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4195840 len 2048 2024-09-19T08:13:25.283 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4195840 len 2048 2024-09-19T08:13:25.283 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4195840 len 2048 2024-09-19T08:13:25.283 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4195840 len 4096 2024-09-19T08:13:25.283 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4195840 len 4096 2024-09-19T08:13:25.283 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4195840 len 4096 2024-09-19T08:13:25.283 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4195840 len 4096 2024-09-19T08:13:25.283 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4195840 len 8192 2024-09-19T08:13:25.284 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4195840 len 8192 2024-09-19T08:13:25.284 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4195840 len 8192 2024-09-19T08:13:25.284 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4195840 len 8192 2024-09-19T08:13:25.284 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4195840 len 16384 2024-09-19T08:13:25.284 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4195840 len 16384 2024-09-19T08:13:25.284 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4195840 len 16384 2024-09-19T08:13:25.284 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4195840 len 16384 2024-09-19T08:13:25.284 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4196352 len 1024 2024-09-19T08:13:25.284 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4196352 len 1024 2024-09-19T08:13:25.284 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4196352 len 1024 2024-09-19T08:13:25.284 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4196352 len 1024 2024-09-19T08:13:25.284 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4196352 len 2048 2024-09-19T08:13:25.284 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4196352 len 2048 2024-09-19T08:13:25.284 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4196352 len 2048 2024-09-19T08:13:25.285 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4196352 len 2048 2024-09-19T08:13:25.285 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4196352 len 4096 2024-09-19T08:13:25.285 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4196352 len 4096 2024-09-19T08:13:25.285 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4196352 len 4096 2024-09-19T08:13:25.285 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4196352 len 4096 2024-09-19T08:13:25.285 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4196352 len 8192 2024-09-19T08:13:25.285 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4196352 len 8192 2024-09-19T08:13:25.285 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4196352 len 8192 2024-09-19T08:13:25.285 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4196352 len 8192 2024-09-19T08:13:25.285 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4196352 len 16384 2024-09-19T08:13:25.285 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4196352 len 16384 2024-09-19T08:13:25.285 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4196352 len 16384 2024-09-19T08:13:25.285 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4196352 len 16384 2024-09-19T08:13:25.285 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4196864 len 1024 2024-09-19T08:13:25.286 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4196864 len 1024 2024-09-19T08:13:25.286 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4196864 len 1024 2024-09-19T08:13:25.286 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4196864 len 1024 2024-09-19T08:13:25.286 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4196864 len 2048 2024-09-19T08:13:25.286 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4196864 len 2048 2024-09-19T08:13:25.286 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4196864 len 2048 2024-09-19T08:13:25.286 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4196864 len 2048 2024-09-19T08:13:25.286 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4196864 len 4096 2024-09-19T08:13:25.286 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4196864 len 4096 2024-09-19T08:13:25.286 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4196864 len 4096 2024-09-19T08:13:25.286 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4196864 len 4096 2024-09-19T08:13:25.286 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4196864 len 8192 2024-09-19T08:13:25.286 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4196864 len 8192 2024-09-19T08:13:25.286 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4196864 len 8192 2024-09-19T08:13:25.287 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4196864 len 8192 2024-09-19T08:13:25.287 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4196864 len 16384 2024-09-19T08:13:25.287 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4196864 len 16384 2024-09-19T08:13:25.287 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4196864 len 16384 2024-09-19T08:13:25.287 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4196864 len 16384 2024-09-19T08:13:25.287 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4197376 len 1024 2024-09-19T08:13:25.287 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4197376 len 1024 2024-09-19T08:13:25.287 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4197376 len 1024 2024-09-19T08:13:25.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:25 smithi155 ceph-mon[35362]: pgmap v74: 97 pgs: 97 active+clean; 236 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 100 MiB/s rd, 1.0 MiB/s wr, 301 op/s 2024-09-19T08:13:25.501 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:25 smithi027 ceph-mon[31209]: pgmap v74: 97 pgs: 97 active+clean; 236 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 100 MiB/s rd, 1.0 MiB/s wr, 301 op/s 2024-09-19T08:13:25.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:25 smithi203 ceph-mon[35198]: pgmap v74: 97 pgs: 97 active+clean; 236 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 100 MiB/s rd, 1.0 MiB/s wr, 301 op/s 2024-09-19T08:13:25.795 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4197376 len 1024 2024-09-19T08:13:25.795 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4197376 len 2048 2024-09-19T08:13:25.795 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4197376 len 2048 2024-09-19T08:13:25.795 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4197376 len 2048 2024-09-19T08:13:25.795 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4197376 len 2048 2024-09-19T08:13:25.796 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4197376 len 4096 2024-09-19T08:13:25.796 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4197376 len 4096 2024-09-19T08:13:25.796 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4197376 len 4096 2024-09-19T08:13:25.796 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4197376 len 4096 2024-09-19T08:13:25.797 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4197376 len 8192 2024-09-19T08:13:25.797 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4197376 len 8192 2024-09-19T08:13:25.797 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4197376 len 8192 2024-09-19T08:13:25.797 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4197376 len 8192 2024-09-19T08:13:25.797 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4197376 len 16384 2024-09-19T08:13:25.797 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4197376 len 16384 2024-09-19T08:13:25.797 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4197376 len 16384 2024-09-19T08:13:25.797 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4197376 len 16384 2024-09-19T08:13:25.797 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4197888 len 1024 2024-09-19T08:13:25.797 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4197888 len 1024 2024-09-19T08:13:25.797 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4197888 len 1024 2024-09-19T08:13:25.797 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4197888 len 1024 2024-09-19T08:13:25.798 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4197888 len 2048 2024-09-19T08:13:25.798 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4197888 len 2048 2024-09-19T08:13:25.798 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4197888 len 2048 2024-09-19T08:13:25.798 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4197888 len 2048 2024-09-19T08:13:25.798 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4197888 len 4096 2024-09-19T08:13:25.798 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4197888 len 4096 2024-09-19T08:13:25.798 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4197888 len 4096 2024-09-19T08:13:25.798 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4197888 len 4096 2024-09-19T08:13:25.798 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4197888 len 8192 2024-09-19T08:13:25.798 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4197888 len 8192 2024-09-19T08:13:25.798 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4197888 len 8192 2024-09-19T08:13:25.798 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4197888 len 8192 2024-09-19T08:13:25.798 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3072 offset 4197888 len 16384 2024-09-19T08:13:25.799 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4197888 len 16384 2024-09-19T08:13:25.799 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3072 offset 4197888 len 16384 2024-09-19T08:13:25.799 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3072 offset 4197888 len 16384 2024-09-19T08:13:25.799 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4190720 len 1024 2024-09-19T08:13:25.799 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4190720 len 1024 2024-09-19T08:13:25.799 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4190720 len 1024 2024-09-19T08:13:25.799 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4190720 len 1024 2024-09-19T08:13:25.799 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4190720 len 2048 2024-09-19T08:13:25.799 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4190720 len 2048 2024-09-19T08:13:25.799 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4190720 len 2048 2024-09-19T08:13:25.799 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4190720 len 2048 2024-09-19T08:13:25.799 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4190720 len 4096 2024-09-19T08:13:25.799 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4190720 len 4096 2024-09-19T08:13:25.799 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4190720 len 4096 2024-09-19T08:13:25.800 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4190720 len 4096 2024-09-19T08:13:25.800 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4190720 len 8192 2024-09-19T08:13:25.800 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4190720 len 8192 2024-09-19T08:13:25.800 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4190720 len 8192 2024-09-19T08:13:25.800 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4190720 len 8192 2024-09-19T08:13:25.800 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4190720 len 16384 2024-09-19T08:13:25.800 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4190720 len 16384 2024-09-19T08:13:25.800 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4190720 len 16384 2024-09-19T08:13:25.800 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4190720 len 16384 2024-09-19T08:13:25.800 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4191232 len 1024 2024-09-19T08:13:25.800 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4191232 len 1024 2024-09-19T08:13:25.800 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4191232 len 1024 2024-09-19T08:13:25.800 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4191232 len 1024 2024-09-19T08:13:25.800 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4191232 len 2048 2024-09-19T08:13:25.801 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4191232 len 2048 2024-09-19T08:13:25.801 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4191232 len 2048 2024-09-19T08:13:25.801 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4191232 len 2048 2024-09-19T08:13:25.801 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4191232 len 4096 2024-09-19T08:13:25.801 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4191232 len 4096 2024-09-19T08:13:25.801 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4191232 len 4096 2024-09-19T08:13:25.801 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4191232 len 4096 2024-09-19T08:13:25.801 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4191232 len 8192 2024-09-19T08:13:25.801 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4191232 len 8192 2024-09-19T08:13:25.801 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4191232 len 8192 2024-09-19T08:13:25.801 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4191232 len 8192 2024-09-19T08:13:25.801 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4191232 len 16384 2024-09-19T08:13:25.801 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4191232 len 16384 2024-09-19T08:13:25.802 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4191232 len 16384 2024-09-19T08:13:25.802 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4191232 len 16384 2024-09-19T08:13:25.802 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4191744 len 1024 2024-09-19T08:13:25.802 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4191744 len 1024 2024-09-19T08:13:25.802 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4191744 len 1024 2024-09-19T08:13:25.802 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4191744 len 1024 2024-09-19T08:13:26.453 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4191744 len 2048 2024-09-19T08:13:26.453 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4191744 len 2048 2024-09-19T08:13:26.453 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4191744 len 2048 2024-09-19T08:13:26.453 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4191744 len 2048 2024-09-19T08:13:26.453 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4191744 len 4096 2024-09-19T08:13:26.453 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4191744 len 4096 2024-09-19T08:13:26.453 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4191744 len 4096 2024-09-19T08:13:26.454 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4191744 len 4096 2024-09-19T08:13:26.454 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4191744 len 8192 2024-09-19T08:13:26.454 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4191744 len 8192 2024-09-19T08:13:26.454 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4191744 len 8192 2024-09-19T08:13:26.454 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4191744 len 8192 2024-09-19T08:13:26.454 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4191744 len 16384 2024-09-19T08:13:26.454 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4191744 len 16384 2024-09-19T08:13:26.454 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4191744 len 16384 2024-09-19T08:13:26.455 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4191744 len 16384 2024-09-19T08:13:26.455 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4192256 len 1024 2024-09-19T08:13:26.455 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4192256 len 1024 2024-09-19T08:13:26.455 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4192256 len 1024 2024-09-19T08:13:26.455 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4192256 len 1024 2024-09-19T08:13:26.455 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4192256 len 2048 2024-09-19T08:13:26.455 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4192256 len 2048 2024-09-19T08:13:26.456 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4192256 len 2048 2024-09-19T08:13:26.456 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4192256 len 2048 2024-09-19T08:13:26.456 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4192256 len 4096 2024-09-19T08:13:26.456 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4192256 len 4096 2024-09-19T08:13:26.456 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4192256 len 4096 2024-09-19T08:13:26.456 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4192256 len 4096 2024-09-19T08:13:26.457 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4192256 len 8192 2024-09-19T08:13:26.457 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4192256 len 8192 2024-09-19T08:13:26.457 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4192256 len 8192 2024-09-19T08:13:26.457 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4192256 len 8192 2024-09-19T08:13:26.457 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4192256 len 16384 2024-09-19T08:13:26.457 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4192256 len 16384 2024-09-19T08:13:26.458 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4192256 len 16384 2024-09-19T08:13:26.458 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4192256 len 16384 2024-09-19T08:13:26.458 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4192768 len 1024 2024-09-19T08:13:26.458 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4192768 len 1024 2024-09-19T08:13:26.458 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4192768 len 1024 2024-09-19T08:13:26.458 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4192768 len 1024 2024-09-19T08:13:26.458 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4192768 len 2048 2024-09-19T08:13:26.458 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4192768 len 2048 2024-09-19T08:13:26.458 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4192768 len 2048 2024-09-19T08:13:26.459 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4192768 len 2048 2024-09-19T08:13:26.459 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4192768 len 4096 2024-09-19T08:13:26.459 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4192768 len 4096 2024-09-19T08:13:26.459 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4192768 len 4096 2024-09-19T08:13:26.459 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4192768 len 4096 2024-09-19T08:13:26.459 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4192768 len 8192 2024-09-19T08:13:26.459 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4192768 len 8192 2024-09-19T08:13:26.459 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4192768 len 8192 2024-09-19T08:13:26.459 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4192768 len 8192 2024-09-19T08:13:26.460 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4192768 len 16384 2024-09-19T08:13:26.460 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4192768 len 16384 2024-09-19T08:13:26.460 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4192768 len 16384 2024-09-19T08:13:26.460 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4192768 len 16384 2024-09-19T08:13:26.460 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4193280 len 1024 2024-09-19T08:13:26.460 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4193280 len 1024 2024-09-19T08:13:26.460 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4193280 len 1024 2024-09-19T08:13:26.460 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4193280 len 1024 2024-09-19T08:13:26.460 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4193280 len 2048 2024-09-19T08:13:26.460 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4193280 len 2048 2024-09-19T08:13:26.460 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4193280 len 2048 2024-09-19T08:13:26.460 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4193280 len 2048 2024-09-19T08:13:26.460 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4193280 len 4096 2024-09-19T08:13:26.461 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4193280 len 4096 2024-09-19T08:13:26.461 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4193280 len 4096 2024-09-19T08:13:26.461 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4193280 len 4096 2024-09-19T08:13:26.461 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4193280 len 8192 2024-09-19T08:13:26.461 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4193280 len 8192 2024-09-19T08:13:26.462 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4193280 len 8192 2024-09-19T08:13:26.462 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4193280 len 8192 2024-09-19T08:13:26.462 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4193280 len 16384 2024-09-19T08:13:26.462 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4193280 len 16384 2024-09-19T08:13:26.462 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4193280 len 16384 2024-09-19T08:13:26.462 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4193280 len 16384 2024-09-19T08:13:26.462 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4193792 len 1024 2024-09-19T08:13:26.462 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4193792 len 1024 2024-09-19T08:13:26.462 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4193792 len 1024 2024-09-19T08:13:26.462 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4193792 len 1024 2024-09-19T08:13:26.840 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4193792 len 2048 2024-09-19T08:13:26.840 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4193792 len 2048 2024-09-19T08:13:26.840 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4193792 len 2048 2024-09-19T08:13:26.840 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4193792 len 2048 2024-09-19T08:13:26.840 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4193792 len 4096 2024-09-19T08:13:26.840 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4193792 len 4096 2024-09-19T08:13:26.840 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4193792 len 4096 2024-09-19T08:13:26.840 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4193792 len 4096 2024-09-19T08:13:26.840 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4193792 len 8192 2024-09-19T08:13:26.841 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4193792 len 8192 2024-09-19T08:13:26.841 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4193792 len 8192 2024-09-19T08:13:26.841 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4193792 len 8192 2024-09-19T08:13:26.841 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4193792 len 16384 2024-09-19T08:13:26.841 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4193792 len 16384 2024-09-19T08:13:26.841 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4193792 len 16384 2024-09-19T08:13:26.841 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4193792 len 16384 2024-09-19T08:13:26.841 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4194304 len 1024 2024-09-19T08:13:26.842 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4194304 len 1024 2024-09-19T08:13:26.842 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4194304 len 1024 2024-09-19T08:13:26.842 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4194304 len 1024 2024-09-19T08:13:26.842 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4194304 len 2048 2024-09-19T08:13:26.842 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4194304 len 2048 2024-09-19T08:13:26.843 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4194304 len 2048 2024-09-19T08:13:26.843 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4194304 len 2048 2024-09-19T08:13:26.843 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4194304 len 4096 2024-09-19T08:13:26.843 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4194304 len 4096 2024-09-19T08:13:26.844 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4194304 len 4096 2024-09-19T08:13:26.844 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4194304 len 4096 2024-09-19T08:13:26.844 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4194304 len 8192 2024-09-19T08:13:26.844 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4194304 len 8192 2024-09-19T08:13:26.844 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4194304 len 8192 2024-09-19T08:13:26.844 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4194304 len 8192 2024-09-19T08:13:26.845 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4194304 len 16384 2024-09-19T08:13:26.845 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4194304 len 16384 2024-09-19T08:13:26.845 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4194304 len 16384 2024-09-19T08:13:26.845 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4194304 len 16384 2024-09-19T08:13:26.845 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4194816 len 1024 2024-09-19T08:13:26.846 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4194816 len 1024 2024-09-19T08:13:26.846 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4194816 len 1024 2024-09-19T08:13:26.846 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4194816 len 1024 2024-09-19T08:13:26.846 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4194816 len 2048 2024-09-19T08:13:26.846 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4194816 len 2048 2024-09-19T08:13:26.846 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4194816 len 2048 2024-09-19T08:13:26.847 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4194816 len 2048 2024-09-19T08:13:26.847 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4194816 len 4096 2024-09-19T08:13:26.847 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4194816 len 4096 2024-09-19T08:13:26.847 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4194816 len 4096 2024-09-19T08:13:26.847 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4194816 len 4096 2024-09-19T08:13:26.847 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4194816 len 8192 2024-09-19T08:13:26.848 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4194816 len 8192 2024-09-19T08:13:26.848 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4194816 len 8192 2024-09-19T08:13:26.848 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4194816 len 8192 2024-09-19T08:13:26.848 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4194816 len 16384 2024-09-19T08:13:26.848 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4194816 len 16384 2024-09-19T08:13:26.848 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4194816 len 16384 2024-09-19T08:13:26.849 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4194816 len 16384 2024-09-19T08:13:26.849 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4195328 len 1024 2024-09-19T08:13:26.849 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4195328 len 1024 2024-09-19T08:13:26.849 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4195328 len 1024 2024-09-19T08:13:26.849 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4195328 len 1024 2024-09-19T08:13:26.849 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4195328 len 2048 2024-09-19T08:13:26.850 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4195328 len 2048 2024-09-19T08:13:26.850 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4195328 len 2048 2024-09-19T08:13:26.850 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4195328 len 2048 2024-09-19T08:13:26.850 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4195328 len 4096 2024-09-19T08:13:26.850 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4195328 len 4096 2024-09-19T08:13:26.850 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4195328 len 4096 2024-09-19T08:13:26.850 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4195328 len 4096 2024-09-19T08:13:26.851 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4195328 len 8192 2024-09-19T08:13:26.851 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4195328 len 8192 2024-09-19T08:13:26.851 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4195328 len 8192 2024-09-19T08:13:26.851 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4195328 len 8192 2024-09-19T08:13:26.851 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4195328 len 16384 2024-09-19T08:13:26.851 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4195328 len 16384 2024-09-19T08:13:26.851 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4195328 len 16384 2024-09-19T08:13:26.852 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4195328 len 16384 2024-09-19T08:13:26.852 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4195840 len 1024 2024-09-19T08:13:26.852 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4195840 len 1024 2024-09-19T08:13:26.852 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4195840 len 1024 2024-09-19T08:13:26.852 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4195840 len 1024 2024-09-19T08:13:26.852 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4195840 len 2048 2024-09-19T08:13:27.196 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4195840 len 2048 2024-09-19T08:13:27.196 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4195840 len 2048 2024-09-19T08:13:27.197 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4195840 len 2048 2024-09-19T08:13:27.197 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4195840 len 4096 2024-09-19T08:13:27.197 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4195840 len 4096 2024-09-19T08:13:27.197 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4195840 len 4096 2024-09-19T08:13:27.197 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4195840 len 4096 2024-09-19T08:13:27.197 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4195840 len 8192 2024-09-19T08:13:27.197 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4195840 len 8192 2024-09-19T08:13:27.197 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4195840 len 8192 2024-09-19T08:13:27.197 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4195840 len 8192 2024-09-19T08:13:27.197 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4195840 len 16384 2024-09-19T08:13:27.197 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4195840 len 16384 2024-09-19T08:13:27.197 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4195840 len 16384 2024-09-19T08:13:27.198 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4195840 len 16384 2024-09-19T08:13:27.198 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4196352 len 1024 2024-09-19T08:13:27.198 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4196352 len 1024 2024-09-19T08:13:27.198 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4196352 len 1024 2024-09-19T08:13:27.198 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4196352 len 1024 2024-09-19T08:13:27.198 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4196352 len 2048 2024-09-19T08:13:27.198 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4196352 len 2048 2024-09-19T08:13:27.198 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4196352 len 2048 2024-09-19T08:13:27.198 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4196352 len 2048 2024-09-19T08:13:27.198 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4196352 len 4096 2024-09-19T08:13:27.198 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4196352 len 4096 2024-09-19T08:13:27.198 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4196352 len 4096 2024-09-19T08:13:27.199 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4196352 len 4096 2024-09-19T08:13:27.199 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4196352 len 8192 2024-09-19T08:13:27.199 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4196352 len 8192 2024-09-19T08:13:27.199 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4196352 len 8192 2024-09-19T08:13:27.199 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4196352 len 8192 2024-09-19T08:13:27.199 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4196352 len 16384 2024-09-19T08:13:27.199 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4196352 len 16384 2024-09-19T08:13:27.199 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4196352 len 16384 2024-09-19T08:13:27.199 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4196352 len 16384 2024-09-19T08:13:27.199 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4196864 len 1024 2024-09-19T08:13:27.199 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4196864 len 1024 2024-09-19T08:13:27.199 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4196864 len 1024 2024-09-19T08:13:27.199 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4196864 len 1024 2024-09-19T08:13:27.200 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4196864 len 2048 2024-09-19T08:13:27.200 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4196864 len 2048 2024-09-19T08:13:27.200 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4196864 len 2048 2024-09-19T08:13:27.200 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4196864 len 2048 2024-09-19T08:13:27.200 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4196864 len 4096 2024-09-19T08:13:27.200 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4196864 len 4096 2024-09-19T08:13:27.200 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4196864 len 4096 2024-09-19T08:13:27.200 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4196864 len 4096 2024-09-19T08:13:27.200 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4196864 len 8192 2024-09-19T08:13:27.201 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4196864 len 8192 2024-09-19T08:13:27.201 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4196864 len 8192 2024-09-19T08:13:27.201 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4196864 len 8192 2024-09-19T08:13:27.201 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4196864 len 16384 2024-09-19T08:13:27.201 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4196864 len 16384 2024-09-19T08:13:27.201 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4196864 len 16384 2024-09-19T08:13:27.201 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4196864 len 16384 2024-09-19T08:13:27.201 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4197376 len 1024 2024-09-19T08:13:27.201 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4197376 len 1024 2024-09-19T08:13:27.201 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4197376 len 1024 2024-09-19T08:13:27.201 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4197376 len 1024 2024-09-19T08:13:27.202 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4197376 len 2048 2024-09-19T08:13:27.202 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4197376 len 2048 2024-09-19T08:13:27.202 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4197376 len 2048 2024-09-19T08:13:27.202 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4197376 len 2048 2024-09-19T08:13:27.202 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4197376 len 4096 2024-09-19T08:13:27.203 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4197376 len 4096 2024-09-19T08:13:27.203 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4197376 len 4096 2024-09-19T08:13:27.203 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4197376 len 4096 2024-09-19T08:13:27.203 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4197376 len 8192 2024-09-19T08:13:27.203 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4197376 len 8192 2024-09-19T08:13:27.203 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4197376 len 8192 2024-09-19T08:13:27.204 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4197376 len 8192 2024-09-19T08:13:27.204 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4197376 len 16384 2024-09-19T08:13:27.204 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4197376 len 16384 2024-09-19T08:13:27.204 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4197376 len 16384 2024-09-19T08:13:27.204 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4197376 len 16384 2024-09-19T08:13:27.204 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4197888 len 1024 2024-09-19T08:13:27.204 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4197888 len 1024 2024-09-19T08:13:27.204 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4197888 len 1024 2024-09-19T08:13:27.204 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4197888 len 1024 2024-09-19T08:13:27.204 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4197888 len 2048 2024-09-19T08:13:27.204 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4197888 len 2048 2024-09-19T08:13:27.255 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4197888 len 2048 2024-09-19T08:13:27.255 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4197888 len 2048 2024-09-19T08:13:27.255 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4197888 len 4096 2024-09-19T08:13:27.256 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4197888 len 4096 2024-09-19T08:13:27.256 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4197888 len 4096 2024-09-19T08:13:27.256 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4197888 len 4096 2024-09-19T08:13:27.256 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4197888 len 8192 2024-09-19T08:13:27.256 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4197888 len 8192 2024-09-19T08:13:27.256 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4197888 len 8192 2024-09-19T08:13:27.256 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4197888 len 8192 2024-09-19T08:13:27.257 INFO:tasks.workunit.client.0.smithi027.stdout:write_direct buf_align 3584 offset 4197888 len 16384 2024-09-19T08:13:27.257 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4197888 len 16384 2024-09-19T08:13:27.257 INFO:tasks.workunit.client.0.smithi027.stdout:write_sync buf_align 3584 offset 4197888 len 16384 2024-09-19T08:13:27.257 INFO:tasks.workunit.client.0.smithi027.stdout:write_file buf_align 3584 offset 4197888 len 16384 2024-09-19T08:13:27.257 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T08:13:27.257 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T08:13:27.287 INFO:tasks.workunit:Stopping ['direct_io'] on client.0... 2024-09-19T08:13:27.288 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T08:13:27.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:27 smithi155 ceph-mon[35362]: pgmap v75: 97 pgs: 97 active+clean; 236 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 100 MiB/s rd, 1.0 MiB/s wr, 299 op/s 2024-09-19T08:13:27.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:27 smithi027 ceph-mon[31209]: pgmap v75: 97 pgs: 97 active+clean; 236 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 100 MiB/s rd, 1.0 MiB/s wr, 299 op/s 2024-09-19T08:13:27.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:27 smithi203 ceph-mon[35198]: pgmap v75: 97 pgs: 97 active+clean; 236 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 100 MiB/s rd, 1.0 MiB/s wr, 299 op/s 2024-09-19T08:13:27.677 DEBUG:teuthology.parallel:result is None 2024-09-19T08:13:27.677 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T08:13:27.712 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T08:13:27.712 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-19T08:13:27.937 INFO:tasks.quiescer:joining Quiescers 2024-09-19T08:13:27.937 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-19T08:13:27.937 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:13:28.194 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:13:28.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:28 smithi027 ceph-mon[31209]: pgmap v76: 97 pgs: 97 active+clean; 399 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 155 MiB/s rd, 1.4 MiB/s wr, 450 op/s 2024-09-19T08:13:28.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:28 smithi155 ceph-mon[35362]: pgmap v76: 97 pgs: 97 active+clean; 399 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 155 MiB/s rd, 1.4 MiB/s wr, 450 op/s 2024-09-19T08:13:28.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:28 smithi203 ceph-mon[35198]: pgmap v76: 97 pgs: 97 active+clean; 399 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 155 MiB/s rd, 1.4 MiB/s wr, 450 op/s 2024-09-19T08:13:28.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.723+0000 7fe3684fd640 1 -- 172.21.15.27:0/3039338483 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe360106f40 msgr2=0x7fe36010eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:28.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.723+0000 7fe3684fd640 1 --2- 172.21.15.27:0/3039338483 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe360106f40 0x7fe36010eac0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe358009ca0 tx=0x7fe35802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:13:28.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.723+0000 7fe3684fd640 1 -- 172.21.15.27:0/3039338483 shutdown_connections 2024-09-19T08:13:28.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.723+0000 7fe3684fd640 1 --2- 172.21.15.27:0/3039338483 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe360106f40 0x7fe36010eac0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:28.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.723+0000 7fe3684fd640 1 --2- 172.21.15.27:0/3039338483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3601027c0 0x7fe360106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:28.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.723+0000 7fe3684fd640 1 --2- 172.21.15.27:0/3039338483 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe360101e10 0x7fe3601021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:28.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.723+0000 7fe3684fd640 1 -- 172.21.15.27:0/3039338483 >> 172.21.15.27:0/3039338483 conn(0x7fe3600fd8d0 msgr2=0x7fe3600ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:28.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.723+0000 7fe3684fd640 1 -- 172.21.15.27:0/3039338483 shutdown_connections 2024-09-19T08:13:28.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.723+0000 7fe3684fd640 1 -- 172.21.15.27:0/3039338483 wait complete. 2024-09-19T08:13:28.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.723+0000 7fe3684fd640 1 Processor -- start 2024-09-19T08:13:28.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.724+0000 7fe3684fd640 1 -- start start 2024-09-19T08:13:28.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.724+0000 7fe3684fd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe360101e10 0x7fe3600744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:28.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.724+0000 7fe3684fd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3601027c0 0x7fe360074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:28.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.724+0000 7fe3684fd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe360106f40 0x7fe360074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:28.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.724+0000 7fe3684fd640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe360112040 con 0x7fe3601027c0 2024-09-19T08:13:28.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.724+0000 7fe3684fd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe360111ec0 con 0x7fe360101e10 2024-09-19T08:13:28.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.724+0000 7fe3684fd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3601121c0 con 0x7fe360106f40 2024-09-19T08:13:28.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.724+0000 7fe365a98640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3601027c0 0x7fe360074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:28.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.724+0000 7fe365a98640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3601027c0 0x7fe360074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40574/0 (socket says 172.21.15.27:40574) 2024-09-19T08:13:28.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.724+0000 7fe365a98640 1 -- 172.21.15.27:0/2325442985 learned_addr learned my addr 172.21.15.27:0/2325442985 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:28.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.724+0000 7fe366a9a640 1 --2- 172.21.15.27:0/2325442985 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe360106f40 0x7fe360074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:28.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.724+0000 7fe366299640 1 --2- 172.21.15.27:0/2325442985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe360101e10 0x7fe3600744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:28.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.724+0000 7fe365a98640 1 -- 172.21.15.27:0/2325442985 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe360106f40 msgr2=0x7fe360074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:28.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.724+0000 7fe365a98640 1 --2- 172.21.15.27:0/2325442985 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe360106f40 0x7fe360074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:28.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.724+0000 7fe365a98640 1 -- 172.21.15.27:0/2325442985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe360101e10 msgr2=0x7fe3600744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:28.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.724+0000 7fe365a98640 1 --2- 172.21.15.27:0/2325442985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe360101e10 0x7fe3600744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:28.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.724+0000 7fe365a98640 1 -- 172.21.15.27:0/2325442985 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3601a6a00 con 0x7fe3601027c0 2024-09-19T08:13:28.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.725+0000 7fe365a98640 1 --2- 172.21.15.27:0/2325442985 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3601027c0 0x7fe360074a30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe35000b4a0 tx=0x7fe35000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:28.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.725+0000 7fe3577fe640 1 -- 172.21.15.27:0/2325442985 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe350015020 con 0x7fe3601027c0 2024-09-19T08:13:28.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.725+0000 7fe3577fe640 1 -- 172.21.15.27:0/2325442985 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe350011d10 con 0x7fe3601027c0 2024-09-19T08:13:28.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.725+0000 7fe3684fd640 1 -- 172.21.15.27:0/2325442985 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3601a6cf0 con 0x7fe3601027c0 2024-09-19T08:13:28.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.725+0000 7fe3577fe640 1 -- 172.21.15.27:0/2325442985 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35000f2e0 con 0x7fe3601027c0 2024-09-19T08:13:28.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.725+0000 7fe3684fd640 1 -- 172.21.15.27:0/2325442985 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3601a71d0 con 0x7fe3601027c0 2024-09-19T08:13:28.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.726+0000 7fe3684fd640 1 -- 172.21.15.27:0/2325442985 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe360102270 con 0x7fe3601027c0 2024-09-19T08:13:28.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.727+0000 7fe3577fe640 1 -- 172.21.15.27:0/2325442985 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe350018020 con 0x7fe3601027c0 2024-09-19T08:13:28.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.728+0000 7fe3577fe640 1 --2- 172.21.15.27:0/2325442985 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe34c0a33b0 0x7fe34c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:28.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.728+0000 7fe366299640 1 --2- 172.21.15.27:0/2325442985 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe34c0a33b0 0x7fe34c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:28.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.728+0000 7fe3577fe640 1 -- 172.21.15.27:0/2325442985 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fe3500cf410 con 0x7fe3601027c0 2024-09-19T08:13:28.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.729+0000 7fe366299640 1 --2- 172.21.15.27:0/2325442985 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe34c0a33b0 0x7fe34c0a5870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe35c009990 tx=0x7fe35c009110 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:28.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.732+0000 7fe3577fe640 1 -- 172.21.15.27:0/2325442985 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe35001f020 con 0x7fe3601027c0 2024-09-19T08:13:28.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.945+0000 7fe3684fd640 1 -- 172.21.15.27:0/2325442985 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe36010a120 con 0x7fe3601027c0 2024-09-19T08:13:28.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.946+0000 7fe3577fe640 1 -- 172.21.15.27:0/2325442985 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7fe35009bf50 con 0x7fe3601027c0 2024-09-19T08:13:28.947 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:13:28.947 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:13:28.947 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:13:28.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.948+0000 7fe3684fd640 1 -- 172.21.15.27:0/2325442985 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe34c0a33b0 msgr2=0x7fe34c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:28.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.948+0000 7fe3684fd640 1 --2- 172.21.15.27:0/2325442985 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe34c0a33b0 0x7fe34c0a5870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe35c009990 tx=0x7fe35c009110 comp rx=0 tx=0).stop 2024-09-19T08:13:28.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.948+0000 7fe3684fd640 1 -- 172.21.15.27:0/2325442985 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3601027c0 msgr2=0x7fe360074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:28.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.948+0000 7fe3684fd640 1 --2- 172.21.15.27:0/2325442985 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3601027c0 0x7fe360074a30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe35000b4a0 tx=0x7fe35000b8a0 comp rx=0 tx=0).stop 2024-09-19T08:13:28.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.948+0000 7fe3684fd640 1 -- 172.21.15.27:0/2325442985 shutdown_connections 2024-09-19T08:13:28.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.948+0000 7fe3684fd640 1 --2- 172.21.15.27:0/2325442985 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe34c0a33b0 0x7fe34c0a5870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:28.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.948+0000 7fe3684fd640 1 --2- 172.21.15.27:0/2325442985 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe360106f40 0x7fe360074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:28.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.948+0000 7fe3684fd640 1 --2- 172.21.15.27:0/2325442985 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3601027c0 0x7fe360074a30 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:28.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.948+0000 7fe3684fd640 1 --2- 172.21.15.27:0/2325442985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe360101e10 0x7fe3600744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:28.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.948+0000 7fe3684fd640 1 -- 172.21.15.27:0/2325442985 >> 172.21.15.27:0/2325442985 conn(0x7fe3600fd8d0 msgr2=0x7fe3600fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:28.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.948+0000 7fe3684fd640 1 -- 172.21.15.27:0/2325442985 shutdown_connections 2024-09-19T08:13:28.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:28.948+0000 7fe3684fd640 1 -- 172.21.15.27:0/2325442985 wait complete. 2024-09-19T08:13:29.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:29 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2325442985' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:13:29.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:29 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2325442985' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:13:29.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:29 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2325442985' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:13:30.223 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:30 smithi027 ceph-mon[31209]: pgmap v77: 97 pgs: 97 active+clean; 418 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 120 MiB/s rd, 1.4 MiB/s wr, 410 op/s 2024-09-19T08:13:30.225 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24482 quiesce db --cancel --all' 2024-09-19T08:13:30.225 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24482 quiesce db --cancel --all 2024-09-19T08:13:30.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:30 smithi155 ceph-mon[35362]: pgmap v77: 97 pgs: 97 active+clean; 418 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 120 MiB/s rd, 1.4 MiB/s wr, 410 op/s 2024-09-19T08:13:30.488 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:13:30.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:30 smithi203 ceph-mon[35198]: pgmap v77: 97 pgs: 97 active+clean; 418 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 120 MiB/s rd, 1.4 MiB/s wr, 410 op/s 2024-09-19T08:13:30.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.964+0000 7f16ccf7d640 1 -- 172.21.15.27:0/3978433690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16c8106a80 msgr2=0x7f16c8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:30.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.964+0000 7f16ccf7d640 1 --2- 172.21.15.27:0/3978433690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16c8106a80 0x7f16c8106e60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f16b0009cd0 tx=0x7f16b002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:13:30.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.964+0000 7f16ccf7d640 1 -- 172.21.15.27:0/3978433690 shutdown_connections 2024-09-19T08:13:30.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.964+0000 7f16ccf7d640 1 --2- 172.21.15.27:0/3978433690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16c8101420 0x7f16c810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:30.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.964+0000 7f16ccf7d640 1 --2- 172.21.15.27:0/3978433690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16c8100a80 0x7f16c8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:30.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.964+0000 7f16ccf7d640 1 --2- 172.21.15.27:0/3978433690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16c8106a80 0x7f16c8106e60 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:30.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.964+0000 7f16ccf7d640 1 -- 172.21.15.27:0/3978433690 >> 172.21.15.27:0/3978433690 conn(0x7f16c80fc7a0 msgr2=0x7f16c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:30.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.964+0000 7f16ccf7d640 1 -- 172.21.15.27:0/3978433690 shutdown_connections 2024-09-19T08:13:30.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.964+0000 7f16ccf7d640 1 -- 172.21.15.27:0/3978433690 wait complete. 2024-09-19T08:13:30.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.965+0000 7f16ccf7d640 1 Processor -- start 2024-09-19T08:13:30.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.965+0000 7f16ccf7d640 1 -- start start 2024-09-19T08:13:30.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.965+0000 7f16ccf7d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16c8100a80 0x7f16c81970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:30.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.965+0000 7f16ccf7d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16c8101420 0x7f16c8197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:30.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.965+0000 7f16ccf7d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16c8106a80 0x7f16c8197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:31.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.965+0000 7f16ccf7d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f16c8110e40 con 0x7f16c8106a80 2024-09-19T08:13:31.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.965+0000 7f16ccf7d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f16c8110cc0 con 0x7f16c8101420 2024-09-19T08:13:31.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.965+0000 7f16ccf7d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f16c8110fc0 con 0x7f16c8100a80 2024-09-19T08:13:31.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.965+0000 7f16c6d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16c8106a80 0x7f16c8197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:31.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.965+0000 7f16c6d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16c8106a80 0x7f16c8197b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38748/0 (socket says 172.21.15.27:38748) 2024-09-19T08:13:31.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.965+0000 7f16c6d9d640 1 -- 172.21.15.27:0/159643486 learned_addr learned my addr 172.21.15.27:0/159643486 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:31.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.966+0000 7f16c659c640 1 --2- 172.21.15.27:0/159643486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16c8100a80 0x7f16c81970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:31.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.966+0000 7f16c5d9b640 1 --2- 172.21.15.27:0/159643486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16c8101420 0x7f16c8197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:31.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.966+0000 7f16c6d9d640 1 -- 172.21.15.27:0/159643486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16c8100a80 msgr2=0x7f16c81970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:31.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.966+0000 7f16c6d9d640 1 --2- 172.21.15.27:0/159643486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16c8100a80 0x7f16c81970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.966+0000 7f16c6d9d640 1 -- 172.21.15.27:0/159643486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16c8101420 msgr2=0x7f16c8197620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:31.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.966+0000 7f16c6d9d640 1 --2- 172.21.15.27:0/159643486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16c8101420 0x7f16c8197620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.966+0000 7f16c6d9d640 1 -- 172.21.15.27:0/159643486 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c81a6950 con 0x7f16c8106a80 2024-09-19T08:13:31.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.966+0000 7f16c5d9b640 1 --2- 172.21.15.27:0/159643486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16c8101420 0x7f16c8197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:13:31.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.966+0000 7f16c6d9d640 1 --2- 172.21.15.27:0/159643486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16c8106a80 0x7f16c8197b60 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f16c000d750 tx=0x7f16c000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:31.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.966+0000 7f16bf7fe640 1 -- 172.21.15.27:0/159643486 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c0017070 con 0x7f16c8106a80 2024-09-19T08:13:31.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.966+0000 7f16bf7fe640 1 -- 172.21.15.27:0/159643486 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16c0005500 con 0x7f16c8106a80 2024-09-19T08:13:31.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.966+0000 7f16ccf7d640 1 -- 172.21.15.27:0/159643486 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c81a6c40 con 0x7f16c8106a80 2024-09-19T08:13:31.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.966+0000 7f16bf7fe640 1 -- 172.21.15.27:0/159643486 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c0004d90 con 0x7f16c8106a80 2024-09-19T08:13:31.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.966+0000 7f16ccf7d640 1 -- 172.21.15.27:0/159643486 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c81a7180 con 0x7f16c8106a80 2024-09-19T08:13:31.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.968+0000 7f16bf7fe640 1 -- 172.21.15.27:0/159643486 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f16c0004f30 con 0x7f16c8106a80 2024-09-19T08:13:31.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.969+0000 7f16cf356740 1 Processor -- start 2024-09-19T08:13:31.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.969+0000 7f16cf356740 1 -- start start 2024-09-19T08:13:31.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.969+0000 7f16cf356740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380f9a00 0x5596380f9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:31.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.969+0000 7f16cf356740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596380fa320 0x5596381046a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:31.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.969+0000 7f16cf356740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559638104be0 0x559638106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:31.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.969+0000 7f16cf356740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55963805e200 con 0x5596380f9a00 2024-09-19T08:13:31.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.969+0000 7f16cf356740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559638004dc0 con 0x559638104be0 2024-09-19T08:13:31.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.969+0000 7f16cf356740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55963805a1c0 con 0x5596380fa320 2024-09-19T08:13:31.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.969+0000 7f16c5d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380f9a00 0x5596380f9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:31.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.969+0000 7f16c5d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380f9a00 0x5596380f9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38756/0 (socket says 172.21.15.27:38756) 2024-09-19T08:13:31.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.969+0000 7f16c5d9b640 1 -- 172.21.15.27:0/2827972388 learned_addr learned my addr 172.21.15.27:0/2827972388 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:31.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.970+0000 7f16bf7fe640 1 --2- 172.21.15.27:0/159643486 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f16b40a3430 0x7f16b40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:31.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.970+0000 7f16c5d9b640 1 --2- 172.21.15.27:0/2827972388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559638104be0 0x559638106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:31.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.970+0000 7f16c659c640 1 --2- 172.21.15.27:0/2827972388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596380fa320 0x5596381046a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:31.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.970+0000 7f16c5d9b640 1 -- 172.21.15.27:0/2827972388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596380fa320 msgr2=0x5596381046a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:31.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.970+0000 7f16c5d9b640 1 --2- 172.21.15.27:0/2827972388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596380fa320 0x5596381046a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.970+0000 7f16c5d9b640 1 -- 172.21.15.27:0/2827972388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559638104be0 msgr2=0x559638106fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:31.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.970+0000 7f16c5d9b640 1 --2- 172.21.15.27:0/2827972388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559638104be0 0x559638106fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.970+0000 7f16c5d9b640 1 -- 172.21.15.27:0/2827972388 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559637dcf620 con 0x5596380f9a00 2024-09-19T08:13:31.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.970+0000 7f16c6d9d640 1 --2- 172.21.15.27:0/159643486 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f16b40a3430 0x7f16b40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:31.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.970+0000 7f16bf7fe640 1 -- 172.21.15.27:0/159643486 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f16c00cf6d0 con 0x7f16c8106a80 2024-09-19T08:13:31.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.970+0000 7f16c5d9b640 1 --2- 172.21.15.27:0/2827972388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380f9a00 0x5596380f9de0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f16b8005d00 tx=0x7f16b8009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5597ab155a64d31c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:31.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.970+0000 7f16bcff9640 1 -- 172.21.15.27:0/2827972388 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b80150f0 con 0x5596380f9a00 2024-09-19T08:13:31.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.970+0000 7f16bcff9640 1 -- 172.21.15.27:0/2827972388 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16b8005500 con 0x5596380f9a00 2024-09-19T08:13:31.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.970+0000 7f16bcff9640 1 -- 172.21.15.27:0/2827972388 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8004e20 con 0x5596380f9a00 2024-09-19T08:13:31.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.970+0000 7f16c6d9d640 1 --2- 172.21.15.27:0/159643486 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f16b40a3430 0x7f16b40a58f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f16c0097e00 tx=0x7f16c0086040 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:31.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.971+0000 7f16cf356740 1 -- 172.21.15.27:0/2827972388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380f9a00 msgr2=0x5596380f9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:31.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.971+0000 7f16cf356740 1 --2- 172.21.15.27:0/2827972388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380f9a00 0x5596380f9de0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f16b8005d00 tx=0x7f16b8009670 comp rx=0 tx=0).stop 2024-09-19T08:13:31.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.971+0000 7f16cf356740 1 -- 172.21.15.27:0/2827972388 shutdown_connections 2024-09-19T08:13:31.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.971+0000 7f16cf356740 1 --2- 172.21.15.27:0/2827972388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559638104be0 0x559638106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.971+0000 7f16cf356740 1 --2- 172.21.15.27:0/2827972388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596380fa320 0x5596381046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.971+0000 7f16cf356740 1 --2- 172.21.15.27:0/2827972388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380f9a00 0x5596380f9de0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.971+0000 7f16cf356740 1 -- 172.21.15.27:0/2827972388 >> 172.21.15.27:0/2827972388 conn(0x5596380f5f90 msgr2=0x5596380f6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:31.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.971+0000 7f16cf356740 1 -- 172.21.15.27:0/2827972388 shutdown_connections 2024-09-19T08:13:31.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.971+0000 7f16cf356740 1 -- 172.21.15.27:0/2827972388 wait complete. 2024-09-19T08:13:31.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.971+0000 7f16cf356740 1 -- start start 2024-09-19T08:13:31.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.971+0000 7f16cf356740 1 Processor -- start 2024-09-19T08:13:31.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.972+0000 7f16cf356740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596380f9a00 0x559638104410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:31.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.972+0000 7f16cf356740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380fa320 0x5596381016c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:31.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.972+0000 7f16cf356740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559638104be0 0x559638101c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:31.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.972+0000 7f16cf356740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5596381077b0 con 0x5596380fa320 2024-09-19T08:13:31.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.972+0000 7f16cf356740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559637ff8c50 con 0x5596380f9a00 2024-09-19T08:13:31.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.972+0000 7f16cf356740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559638107930 con 0x559638104be0 2024-09-19T08:13:31.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.972+0000 7f16cf356740 10 client.0 _ll_register_callbacks cb 0x55963800aba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:13:31.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.972+0000 7f16c659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380fa320 0x5596381016c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:31.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.972+0000 7f16c659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380fa320 0x5596381016c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38760/0 (socket says 172.21.15.27:38760) 2024-09-19T08:13:31.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.972+0000 7f16c659c640 1 -- 172.21.15.27:0/1939788636 learned_addr learned my addr 172.21.15.27:0/1939788636 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:31.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.972+0000 7f16c5d9b640 1 --2- 172.21.15.27:0/1939788636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596380f9a00 0x559638104410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:31.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.972+0000 7f16c5d9b640 1 --2- 172.21.15.27:0/1939788636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559638104be0 0x559638101c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:31.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.972+0000 7f16c659c640 1 -- 172.21.15.27:0/1939788636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559638104be0 msgr2=0x559638101c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:31.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.972+0000 7f16c659c640 1 --2- 172.21.15.27:0/1939788636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559638104be0 0x559638101c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.972+0000 7f16c659c640 1 -- 172.21.15.27:0/1939788636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596380f9a00 msgr2=0x559638104410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:31.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.972+0000 7f16c659c640 1 --2- 172.21.15.27:0/1939788636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596380f9a00 0x559638104410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.972+0000 7f16c659c640 1 -- 172.21.15.27:0/1939788636 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559638102430 con 0x5596380fa320 2024-09-19T08:13:31.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.972+0000 7f16c5d9b640 1 --2- 172.21.15.27:0/1939788636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596380f9a00 0x559638104410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:13:31.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.972+0000 7f16c659c640 1 --2- 172.21.15.27:0/1939788636 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380fa320 0x5596381016c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f16b0009cd0 tx=0x7f16b0031af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bedd7aea82aff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:31.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.972+0000 7f16adffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:13:31.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.973+0000 7f16adffb640 1 -- 172.21.15.27:0/1939788636 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b0047020 con 0x5596380fa320 2024-09-19T08:13:31.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.973+0000 7f16adffb640 1 -- 172.21.15.27:0/1939788636 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f16b0003970 con 0x5596380fa320 2024-09-19T08:13:31.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.973+0000 7f16cf356740 1 -- 172.21.15.27:0/1939788636 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16b8005500 con 0x5596380fa320 2024-09-19T08:13:31.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.973+0000 7f16adffb640 1 -- 172.21.15.27:0/1939788636 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f16b0003b90 con 0x5596380fa320 2024-09-19T08:13:31.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.973+0000 7f16cf356740 10 client.15828 fetch_fsmap learned FSMap version 20 2024-09-19T08:13:31.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.973+0000 7f16cf356740 1 -- 172.21.15.27:0/1939788636 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5596381132c0 con 0x5596380fa320 2024-09-19T08:13:31.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.973+0000 7f16adffb640 1 -- 172.21.15.27:0/1939788636 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16b8005500 con 0x5596380fa320 2024-09-19T08:13:31.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.973+0000 7f16adffb640 1 -- 172.21.15.27:0/1939788636 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f16b0042070 con 0x5596380fa320 2024-09-19T08:13:31.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.973+0000 7f16cf356740 10 client.15828 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:13:31.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.973+0000 7f16cf356740 10 client.15828 resolve_mds: validated gid 24482 aka daemon mds.b 2024-09-19T08:13:31.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.973+0000 7f16cf356740 20 client.15828 populate_metadata read hostname 'smithi027' 2024-09-19T08:13:31.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.973+0000 7f16cf356740 1 --2- 172.21.15.27:0/1939788636 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559638114780 0x559638116bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:31.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.973+0000 7f16cf356740 4 client.15828 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:13:31.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.973+0000 7f16cf356740 1 -- 172.21.15.27:0/1939788636 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55963806b770 con 0x559638114780 2024-09-19T08:13:31.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.974+0000 7f16c5d9b640 1 --2- 172.21.15.27:0/1939788636 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559638114780 0x559638116bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:31.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.974+0000 7f16adffb640 10 client.15828 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:31.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.974+0000 7f16c5d9b640 1 --2- 172.21.15.27:0/1939788636 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559638114780 0x559638116bb0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d6c0016a544e004 server_cookie=883afb2c8f96b7a5 in_seq=0 out_seq=0 2024-09-19T08:13:31.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.975+0000 7f16adffb640 1 -- 172.21.15.27:0/1939788636 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55963806b770 con 0x559638114780 2024-09-19T08:13:31.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.975+0000 7f16adffb640 10 client.15828 handle_command_reply: tid=0 2024-09-19T08:13:31.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.975+0000 7f16cf356740 1 client.15828 shutdown 2024-09-19T08:13:31.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.975+0000 7f16cf356740 1 -- 172.21.15.27:0/1939788636 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380fa320 msgr2=0x5596381016c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:31.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.975+0000 7f16cf356740 1 --2- 172.21.15.27:0/1939788636 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380fa320 0x5596381016c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f16b0009cd0 tx=0x7f16b0031af0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.975+0000 7f16cf356740 1 -- 172.21.15.27:0/1939788636 shutdown_connections 2024-09-19T08:13:31.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.975+0000 7f16cf356740 1 --2- 172.21.15.27:0/1939788636 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559638114780 0x559638116bb0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.975+0000 7f16cf356740 1 --2- 172.21.15.27:0/1939788636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559638104be0 0x559638101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.975+0000 7f16cf356740 1 --2- 172.21.15.27:0/1939788636 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380fa320 0x5596381016c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.975+0000 7f16cf356740 1 --2- 172.21.15.27:0/1939788636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596380f9a00 0x559638104410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.975+0000 7f16adffb640 0 client.15828 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:31.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.975+0000 7f16cf356740 1 -- 172.21.15.27:0/1939788636 >> 172.21.15.27:0/1939788636 conn(0x5596380f5f90 msgr2=0x5596380f51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:31.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.975+0000 7f16cf356740 1 -- 172.21.15.27:0/1939788636 shutdown_connections 2024-09-19T08:13:31.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.975+0000 7f16cf356740 1 -- 172.21.15.27:0/1939788636 wait complete. 2024-09-19T08:13:31.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.975+0000 7f16cf356740 20 client.15828 trim_cache size 0 max 16384 2024-09-19T08:13:31.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.992+0000 7f16cf356740 1 Processor -- start 2024-09-19T08:13:31.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.992+0000 7f16cf356740 1 -- start start 2024-09-19T08:13:31.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.992+0000 7f16cf356740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596380f5f90 0x55963811c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:31.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.992+0000 7f16cf356740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596380f9a00 0x55963811c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:31.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.992+0000 7f16cf356740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380fa320 0x5596380fe9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:31.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.992+0000 7f16cf356740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81ad8f0 con 0x5596380fa320 2024-09-19T08:13:31.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.992+0000 7f16cf356740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81b0170 con 0x5596380f9a00 2024-09-19T08:13:31.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.992+0000 7f16cf356740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81adf60 con 0x5596380f5f90 2024-09-19T08:13:31.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.992+0000 7f16c5d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380fa320 0x5596380fe9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:31.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.992+0000 7f16c5d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380fa320 0x5596380fe9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38776/0 (socket says 172.21.15.27:38776) 2024-09-19T08:13:31.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.992+0000 7f16c5d9b640 1 -- 172.21.15.27:0/1586970682 learned_addr learned my addr 172.21.15.27:0/1586970682 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:31.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.993+0000 7f16c5d9b640 1 --2- 172.21.15.27:0/1586970682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596380f5f90 0x55963811c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:31.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.993+0000 7f16c659c640 1 --2- 172.21.15.27:0/1586970682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596380f9a00 0x55963811c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:31.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.993+0000 7f16c5d9b640 1 -- 172.21.15.27:0/1586970682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596380f5f90 msgr2=0x55963811c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:31.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.993+0000 7f16c5d9b640 1 --2- 172.21.15.27:0/1586970682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596380f5f90 0x55963811c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.993+0000 7f16c5d9b640 1 -- 172.21.15.27:0/1586970682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596380f9a00 msgr2=0x55963811c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:31.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.993+0000 7f16c5d9b640 1 --2- 172.21.15.27:0/1586970682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596380f9a00 0x55963811c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.993+0000 7f16c5d9b640 1 -- 172.21.15.27:0/1586970682 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596380fa150 con 0x5596380fa320 2024-09-19T08:13:31.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.993+0000 7f16c5d9b640 1 --2- 172.21.15.27:0/1586970682 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380fa320 0x5596380fe9a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f16b8004ad0 tx=0x7f16b8017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a28e2031b922ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:31.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.993+0000 7f16affff640 1 -- 172.21.15.27:0/1586970682 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b80150b0 con 0x5596380fa320 2024-09-19T08:13:31.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.993+0000 7f16affff640 1 -- 172.21.15.27:0/1586970682 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16b80139a0 con 0x5596380fa320 2024-09-19T08:13:31.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.993+0000 7f16affff640 1 -- 172.21.15.27:0/1586970682 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8004dd0 con 0x5596380fa320 2024-09-19T08:13:31.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.994+0000 7f16cf356740 1 -- 172.21.15.27:0/1586970682 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380fa320 msgr2=0x5596380fe9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:31.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.994+0000 7f16cf356740 1 --2- 172.21.15.27:0/1586970682 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380fa320 0x5596380fe9a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f16b8004ad0 tx=0x7f16b8017040 comp rx=0 tx=0).stop 2024-09-19T08:13:31.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.994+0000 7f16cf356740 1 -- 172.21.15.27:0/1586970682 shutdown_connections 2024-09-19T08:13:31.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.994+0000 7f16cf356740 1 --2- 172.21.15.27:0/1586970682 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380fa320 0x5596380fe9a0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.994+0000 7f16cf356740 1 --2- 172.21.15.27:0/1586970682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596380f9a00 0x55963811c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.994+0000 7f16cf356740 1 --2- 172.21.15.27:0/1586970682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596380f5f90 0x55963811c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.994+0000 7f16cf356740 1 -- 172.21.15.27:0/1586970682 >> 172.21.15.27:0/1586970682 conn(0x559638101d60 msgr2=0x5596380ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.994+0000 7f16cf356740 1 -- 172.21.15.27:0/1586970682 shutdown_connections 2024-09-19T08:13:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.994+0000 7f16cf356740 1 -- 172.21.15.27:0/1586970682 wait complete. 2024-09-19T08:13:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.994+0000 7f16cf356740 1 -- start start 2024-09-19T08:13:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.994+0000 7f16cf356740 1 Processor -- start 2024-09-19T08:13:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.994+0000 7f16cf356740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380f5f90 0x55963810d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.994+0000 7f16cf356740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596380f9a00 0x55963810a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.994+0000 7f16cf356740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596380fa320 0x55963810ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.995+0000 7f16cf356740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81ae630 con 0x5596380f5f90 2024-09-19T08:13:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.995+0000 7f16cf356740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81afaa0 con 0x5596380fa320 2024-09-19T08:13:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.995+0000 7f16cf356740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81aed00 con 0x5596380f9a00 2024-09-19T08:13:31.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.995+0000 7f16c5d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380f5f90 0x55963810d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:31.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.995+0000 7f16cf356740 10 client.0 _ll_register_callbacks cb 0x7f16b0009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:13:31.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.995+0000 7f16c5d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380f5f90 0x55963810d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38786/0 (socket says 172.21.15.27:38786) 2024-09-19T08:13:31.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.995+0000 7f16c5d9b640 1 -- 172.21.15.27:0/2571492189 learned_addr learned my addr 172.21.15.27:0/2571492189 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:31.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.995+0000 7f16c5d9b640 1 -- 172.21.15.27:0/2571492189 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596380f9a00 msgr2=0x55963810a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:31.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.995+0000 7f16c5d9b640 1 --2- 172.21.15.27:0/2571492189 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596380f9a00 0x55963810a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.995+0000 7f16c5d9b640 1 -- 172.21.15.27:0/2571492189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596380fa320 msgr2=0x55963810ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:31.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.995+0000 7f16c5d9b640 1 --2- 172.21.15.27:0/2571492189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596380fa320 0x55963810ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.995+0000 7f16c5d9b640 1 -- 172.21.15.27:0/2571492189 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55963810b470 con 0x5596380f5f90 2024-09-19T08:13:31.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.995+0000 7f16c5d9b640 1 --2- 172.21.15.27:0/2571492189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380f5f90 0x55963810d360 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f16b8005820 tx=0x7f16b80092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e8ce1474c3d078 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:31.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.995+0000 7f16adffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:13:31.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.995+0000 7f16adffb640 1 -- 172.21.15.27:0/2571492189 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8013b50 con 0x5596380f5f90 2024-09-19T08:13:31.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.995+0000 7f16adffb640 1 -- 172.21.15.27:0/2571492189 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f16b8013cf0 con 0x5596380f5f90 2024-09-19T08:13:31.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.995+0000 7f16cf356740 1 -- 172.21.15.27:0/2571492189 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16b80139a0 con 0x5596380f5f90 2024-09-19T08:13:31.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.995+0000 7f16adffb640 1 -- 172.21.15.27:0/2571492189 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f16b80134c0 con 0x5596380f5f90 2024-09-19T08:13:31.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.995+0000 7f16cf356740 10 client.15834 fetch_fsmap learned FSMap version 20 2024-09-19T08:13:31.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.995+0000 7f16cf356740 1 -- 172.21.15.27:0/2571492189 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55963817f4a0 con 0x5596380f5f90 2024-09-19T08:13:31.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.996+0000 7f16adffb640 1 -- 172.21.15.27:0/2571492189 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16b80139a0 con 0x5596380f5f90 2024-09-19T08:13:31.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.996+0000 7f16adffb640 1 -- 172.21.15.27:0/2571492189 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f16b800c070 con 0x5596380f5f90 2024-09-19T08:13:31.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.996+0000 7f16cf356740 10 client.15834 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:13:31.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.996+0000 7f16cf356740 10 client.15834 resolve_mds: validated gid 24482 aka daemon mds.b 2024-09-19T08:13:31.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.996+0000 7f16cf356740 20 client.15834 populate_metadata read hostname 'smithi027' 2024-09-19T08:13:31.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.996+0000 7f16cf356740 1 --2- 172.21.15.27:0/2571492189 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559638104be0 0x5596381819e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:31.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.996+0000 7f16cf356740 4 client.15834 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-19T08:13:31.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.996+0000 7f16cf356740 1 -- 172.21.15.27:0/2571492189 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x559638065c80 con 0x559638104be0 2024-09-19T08:13:31.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.996+0000 7f16c659c640 1 --2- 172.21.15.27:0/2571492189 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559638104be0 0x5596381819e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:31.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.996+0000 7f16c659c640 1 --2- 172.21.15.27:0/2571492189 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559638104be0 0x5596381819e0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e17e4508cbee9f1 server_cookie=d102e45765b22ead in_seq=0 out_seq=0 2024-09-19T08:13:31.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.996+0000 7f16adffb640 10 client.15834 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:31.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.997+0000 7f16adffb640 1 -- 172.21.15.27:0/2571492189 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x559638065c80 con 0x559638104be0 2024-09-19T08:13:31.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.997+0000 7f16adffb640 10 client.15834 handle_command_reply: tid=0 2024-09-19T08:13:31.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.997+0000 7f16cf356740 1 client.15834 shutdown 2024-09-19T08:13:31.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.997+0000 7f16cf356740 1 -- 172.21.15.27:0/2571492189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380f5f90 msgr2=0x55963810d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:31.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.997+0000 7f16cf356740 1 --2- 172.21.15.27:0/2571492189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380f5f90 0x55963810d360 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f16b8005820 tx=0x7f16b80092a0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.997+0000 7f16cf356740 1 -- 172.21.15.27:0/2571492189 shutdown_connections 2024-09-19T08:13:31.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.997+0000 7f16cf356740 1 --2- 172.21.15.27:0/2571492189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596380fa320 0x55963810ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.997+0000 7f16cf356740 1 --2- 172.21.15.27:0/2571492189 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559638104be0 0x5596381819e0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.997+0000 7f16adffb640 0 client.15834 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:31.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.997+0000 7f16cf356740 1 --2- 172.21.15.27:0/2571492189 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596380f9a00 0x55963810a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.997+0000 7f16cf356740 1 --2- 172.21.15.27:0/2571492189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596380f5f90 0x55963810d360 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.997+0000 7f16cf356740 1 -- 172.21.15.27:0/2571492189 >> 172.21.15.27:0/2571492189 conn(0x559638101d60 msgr2=0x5596380f49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:31.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.997+0000 7f16cf356740 1 -- 172.21.15.27:0/2571492189 shutdown_connections 2024-09-19T08:13:31.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.997+0000 7f16cf356740 1 -- 172.21.15.27:0/2571492189 wait complete. 2024-09-19T08:13:31.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.997+0000 7f16cf356740 20 client.15834 trim_cache size 0 max 16384 2024-09-19T08:13:31.016 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:13:31.016 INFO:teuthology.orchestra.run.smithi027.stdout: "epoch": 20, 2024-09-19T08:13:31.017 INFO:teuthology.orchestra.run.smithi027.stdout: "leader": 24482, 2024-09-19T08:13:31.017 INFO:teuthology.orchestra.run.smithi027.stdout: "set_version": 12, 2024-09-19T08:13:31.017 INFO:teuthology.orchestra.run.smithi027.stdout: "sets": {} 2024-09-19T08:13:31.017 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:13:31.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.998+0000 7f16ccf7d640 1 -- 172.21.15.27:0/159643486 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f16b40a3430 msgr2=0x7f16b40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:31.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.998+0000 7f16ccf7d640 1 --2- 172.21.15.27:0/159643486 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f16b40a3430 0x7f16b40a58f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f16c0097e00 tx=0x7f16c0086040 comp rx=0 tx=0).stop 2024-09-19T08:13:31.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.998+0000 7f16ccf7d640 1 -- 172.21.15.27:0/159643486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16c8106a80 msgr2=0x7f16c8197b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:31.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.998+0000 7f16ccf7d640 1 --2- 172.21.15.27:0/159643486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16c8106a80 0x7f16c8197b60 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f16c000d750 tx=0x7f16c000dc10 comp rx=0 tx=0).stop 2024-09-19T08:13:31.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.998+0000 7f16ccf7d640 1 -- 172.21.15.27:0/159643486 shutdown_connections 2024-09-19T08:13:31.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.998+0000 7f16ccf7d640 1 --2- 172.21.15.27:0/159643486 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f16b40a3430 0x7f16b40a58f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.998+0000 7f16ccf7d640 1 --2- 172.21.15.27:0/159643486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16c8106a80 0x7f16c8197b60 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.998+0000 7f16ccf7d640 1 --2- 172.21.15.27:0/159643486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16c8101420 0x7f16c8197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.998+0000 7f16ccf7d640 1 --2- 172.21.15.27:0/159643486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16c8100a80 0x7f16c81970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:31.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.998+0000 7f16ccf7d640 1 -- 172.21.15.27:0/159643486 >> 172.21.15.27:0/159643486 conn(0x7f16c80fc7a0 msgr2=0x7f16c80fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:31.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.998+0000 7f16ccf7d640 1 -- 172.21.15.27:0/159643486 shutdown_connections 2024-09-19T08:13:31.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:30.998+0000 7f16ccf7d640 1 -- 172.21.15.27:0/159643486 wait complete. 2024-09-19T08:13:31.829 INFO:tasks.quiescer:done joining Quiescers 2024-09-19T08:13:31.829 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-19T08:13:31.840 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-19T08:13:31.840 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T08:13:31.840 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi027.front.sepia.ceph.com 2024-09-19T08:13:31.840 DEBUG:teuthology.orchestra.run.smithi027:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-19T08:13:31.871 DEBUG:teuthology.orchestra.run.smithi027:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-19T08:13:32.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:32 smithi155 ceph-mon[35362]: pgmap v78: 97 pgs: 97 active+clean; 418 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 118 MiB/s rd, 1.4 MiB/s wr, 408 op/s 2024-09-19T08:13:32.751 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:32 smithi027 ceph-mon[31209]: pgmap v78: 97 pgs: 97 active+clean; 418 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 118 MiB/s rd, 1.4 MiB/s wr, 408 op/s 2024-09-19T08:13:32.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:32 smithi203 ceph-mon[35198]: pgmap v78: 97 pgs: 97 active+clean; 418 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 118 MiB/s rd, 1.4 MiB/s wr, 408 op/s 2024-09-19T08:13:34.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:34 smithi155 ceph-mon[35362]: pgmap v79: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 118 MiB/s rd, 1.4 MiB/s wr, 440 op/s 2024-09-19T08:13:34.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:34 smithi027 ceph-mon[31209]: pgmap v79: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 118 MiB/s rd, 1.4 MiB/s wr, 440 op/s 2024-09-19T08:13:34.756 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:34 smithi203 ceph-mon[35198]: pgmap v79: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 118 MiB/s rd, 1.4 MiB/s wr, 440 op/s 2024-09-19T08:13:35.218 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:13:35.493 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:13:35.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.961+0000 7fb7da8b7640 1 -- 172.21.15.27:0/3125869651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d410c170 msgr2=0x7fb7d410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:35.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.961+0000 7fb7da8b7640 1 --2- 172.21.15.27:0/3125869651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d410c170 0x7fb7d410e610 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009ca0 tx=0x7fb7cc02a950 comp rx=0 tx=0).stop 2024-09-19T08:13:35.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.961+0000 7fb7da8b7640 1 -- 172.21.15.27:0/3125869651 shutdown_connections 2024-09-19T08:13:35.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.961+0000 7fb7da8b7640 1 --2- 172.21.15.27:0/3125869651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d410c170 0x7fb7d410e610 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.961+0000 7fb7da8b7640 1 --2- 172.21.15.27:0/3125869651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7d4103660 0x7fb7d410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.961+0000 7fb7da8b7640 1 --2- 172.21.15.27:0/3125869651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7d4102d40 0x7fb7d4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.961+0000 7fb7da8b7640 1 -- 172.21.15.27:0/3125869651 >> 172.21.15.27:0/3125869651 conn(0x7fb7d40fc7a0 msgr2=0x7fb7d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:35.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.961+0000 7fb7da8b7640 1 -- 172.21.15.27:0/3125869651 shutdown_connections 2024-09-19T08:13:35.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.961+0000 7fb7da8b7640 1 -- 172.21.15.27:0/3125869651 wait complete. 2024-09-19T08:13:35.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.962+0000 7fb7da8b7640 1 Processor -- start 2024-09-19T08:13:35.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.962+0000 7fb7da8b7640 1 -- start start 2024-09-19T08:13:35.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7da8b7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7d4102d40 0x7fb7d41983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:35.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7da8b7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d4103660 0x7fb7d4198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:35.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7da8b7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7d410c170 0x7fb7d419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:35.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7da8b7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d4111f70 con 0x7fb7d4103660 2024-09-19T08:13:35.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7da8b7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d4111df0 con 0x7fb7d4102d40 2024-09-19T08:13:35.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7da8b7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d41120f0 con 0x7fb7d410c170 2024-09-19T08:13:35.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7d37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d4103660 0x7fb7d4198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:35.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7d37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d4103660 0x7fb7d4198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38808/0 (socket says 172.21.15.27:38808) 2024-09-19T08:13:35.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7d37fe640 1 -- 172.21.15.27:0/1109637233 learned_addr learned my addr 172.21.15.27:0/1109637233 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:35.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7d3fff640 1 --2- 172.21.15.27:0/1109637233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7d4102d40 0x7fb7d41983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:35.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7d37fe640 1 -- 172.21.15.27:0/1109637233 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7d410c170 msgr2=0x7fb7d419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:35.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7d8e54640 1 --2- 172.21.15.27:0/1109637233 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7d410c170 0x7fb7d419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:35.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7d37fe640 1 --2- 172.21.15.27:0/1109637233 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7d410c170 0x7fb7d419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7d37fe640 1 -- 172.21.15.27:0/1109637233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7d4102d40 msgr2=0x7fb7d41983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:35.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7d37fe640 1 --2- 172.21.15.27:0/1109637233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7d4102d40 0x7fb7d41983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7d37fe640 1 -- 172.21.15.27:0/1109637233 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d419d380 con 0x7fb7d4103660 2024-09-19T08:13:35.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7d3fff640 1 --2- 172.21.15.27:0/1109637233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7d4102d40 0x7fb7d41983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:13:35.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7d8e54640 1 --2- 172.21.15.27:0/1109637233 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7d410c170 0x7fb7d419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:13:35.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7d37fe640 1 --2- 172.21.15.27:0/1109637233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d4103660 0x7fb7d4198910 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb7c800d950 tx=0x7fb7c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:35.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7d17fa640 1 -- 172.21.15.27:0/1109637233 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c8017030 con 0x7fb7d4103660 2024-09-19T08:13:35.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7d17fa640 1 -- 172.21.15.27:0/1109637233 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7c8004020 con 0x7fb7d4103660 2024-09-19T08:13:35.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.963+0000 7fb7da8b7640 1 -- 172.21.15.27:0/1109637233 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7d419d670 con 0x7fb7d4103660 2024-09-19T08:13:35.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.964+0000 7fb7d17fa640 1 -- 172.21.15.27:0/1109637233 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c80047a0 con 0x7fb7d4103660 2024-09-19T08:13:35.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.964+0000 7fb7da8b7640 1 -- 172.21.15.27:0/1109637233 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7d41a4f50 con 0x7fb7d4103660 2024-09-19T08:13:35.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.966+0000 7fb7d17fa640 1 -- 172.21.15.27:0/1109637233 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fb7c80041d0 con 0x7fb7d4103660 2024-09-19T08:13:35.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.966+0000 7fb7dcc90740 1 Processor -- start 2024-09-19T08:13:35.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.966+0000 7fb7dcc90740 1 -- start start 2024-09-19T08:13:35.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.966+0000 7fb7dcc90740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6bae6380 0x55cf6bae6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:35.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.966+0000 7fb7dcc90740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6bae6ca0 0x55cf6baf5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:35.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.966+0000 7fb7dcc90740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6baf5a90 0x55cf6baf7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:35.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.966+0000 7fb7dcc90740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55cf6ba4c2e0 con 0x55cf6bae6380 2024-09-19T08:13:35.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.966+0000 7fb7dcc90740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55cf6b9f3ce0 con 0x55cf6baf5a90 2024-09-19T08:13:35.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.966+0000 7fb7dcc90740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cf6ba482a0 con 0x55cf6bae6ca0 2024-09-19T08:13:35.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.966+0000 7fb7d8e54640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6bae6380 0x55cf6bae6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:35.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.967+0000 7fb7d8e54640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6bae6380 0x55cf6bae6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38820/0 (socket says 172.21.15.27:38820) 2024-09-19T08:13:35.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.967+0000 7fb7d8e54640 1 -- 172.21.15.27:0/976539801 learned_addr learned my addr 172.21.15.27:0/976539801 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:35.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.967+0000 7fb7d3fff640 1 --2- 172.21.15.27:0/976539801 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6bae6ca0 0x55cf6baf5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:35.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.967+0000 7fb7d37fe640 1 --2- 172.21.15.27:0/976539801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6baf5a90 0x55cf6baf7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:35.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.967+0000 7fb7d17fa640 1 --2- 172.21.15.27:0/1109637233 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb7bc0a33b0 0x7fb7bc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:35.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.967+0000 7fb7d8e54640 1 -- 172.21.15.27:0/976539801 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6bae6ca0 msgr2=0x55cf6baf5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:35.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.967+0000 7fb7d8e54640 1 --2- 172.21.15.27:0/976539801 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6bae6ca0 0x55cf6baf5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.967+0000 7fb7d8e54640 1 -- 172.21.15.27:0/976539801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6baf5a90 msgr2=0x55cf6baf7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:35.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.967+0000 7fb7d8e54640 1 --2- 172.21.15.27:0/976539801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6baf5a90 0x55cf6baf7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.967+0000 7fb7d8e54640 1 -- 172.21.15.27:0/976539801 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf6b9d8440 con 0x55cf6bae6380 2024-09-19T08:13:35.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.967+0000 7fb7d37fe640 1 --2- 172.21.15.27:0/976539801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6baf5a90 0x55cf6baf7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:13:35.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.967+0000 7fb7d17fa640 1 -- 172.21.15.27:0/1109637233 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fb7c80cf660 con 0x7fb7d4103660 2024-09-19T08:13:35.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.967+0000 7fb7d8e54640 1 --2- 172.21.15.27:0/976539801 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6bae6380 0x55cf6bae6760 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009880 tx=0x7fb7cc0098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab047e42bc288d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:35.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.967+0000 7fb7d8e54640 1 --2- 172.21.15.27:0/1109637233 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb7bc0a33b0 0x7fb7bc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:35.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.967+0000 7fb7ba7fc640 1 -- 172.21.15.27:0/976539801 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc034050 con 0x55cf6bae6380 2024-09-19T08:13:35.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.967+0000 7fb7ba7fc640 1 -- 172.21.15.27:0/976539801 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7cc003b30 con 0x55cf6bae6380 2024-09-19T08:13:35.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.967+0000 7fb7ba7fc640 1 -- 172.21.15.27:0/976539801 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc030640 con 0x55cf6bae6380 2024-09-19T08:13:35.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.968+0000 7fb7d8e54640 1 --2- 172.21.15.27:0/1109637233 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb7bc0a33b0 0x7fb7bc0a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc048000 tx=0x7fb7cc049000 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:35.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.968+0000 7fb7dcc90740 1 -- 172.21.15.27:0/976539801 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6bae6380 msgr2=0x55cf6bae6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:35.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.968+0000 7fb7dcc90740 1 --2- 172.21.15.27:0/976539801 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6bae6380 0x55cf6bae6760 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009880 tx=0x7fb7cc0098b0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.968+0000 7fb7dcc90740 1 -- 172.21.15.27:0/976539801 shutdown_connections 2024-09-19T08:13:35.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.968+0000 7fb7dcc90740 1 --2- 172.21.15.27:0/976539801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6baf5a90 0x55cf6baf7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.968+0000 7fb7dcc90740 1 --2- 172.21.15.27:0/976539801 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6bae6ca0 0x55cf6baf5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.968+0000 7fb7dcc90740 1 --2- 172.21.15.27:0/976539801 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6bae6380 0x55cf6bae6760 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.968+0000 7fb7dcc90740 1 -- 172.21.15.27:0/976539801 >> 172.21.15.27:0/976539801 conn(0x55cf6bae2a30 msgr2=0x55cf6bae2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:35.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.968+0000 7fb7dcc90740 1 -- 172.21.15.27:0/976539801 shutdown_connections 2024-09-19T08:13:35.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.968+0000 7fb7dcc90740 1 -- 172.21.15.27:0/976539801 wait complete. 2024-09-19T08:13:35.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.969+0000 7fb7dcc90740 1 -- start start 2024-09-19T08:13:35.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.969+0000 7fb7dcc90740 1 Processor -- start 2024-09-19T08:13:35.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.969+0000 7fb7dcc90740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6bae6380 0x55cf6baf53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:35.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.969+0000 7fb7dcc90740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6bae6ca0 0x55cf6baf2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:35.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.969+0000 7fb7dcc90740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6baf5a90 0x55cf6baf2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:35.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.969+0000 7fb7dcc90740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55cf6baf8660 con 0x55cf6baf5a90 2024-09-19T08:13:35.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.969+0000 7fb7dcc90740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55cf6ba07050 con 0x55cf6bae6ca0 2024-09-19T08:13:35.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.969+0000 7fb7dcc90740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cf6baf87e0 con 0x55cf6bae6380 2024-09-19T08:13:35.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.969+0000 7fb7dcc90740 10 client.0 _ll_register_callbacks cb 0x55cf6ba47160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:13:35.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.969+0000 7fb7d8e54640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6baf5a90 0x55cf6baf2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:35.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.969+0000 7fb7d3fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6bae6380 0x55cf6baf53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:35.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.969+0000 7fb7d8e54640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6baf5a90 0x55cf6baf2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38828/0 (socket says 172.21.15.27:38828) 2024-09-19T08:13:35.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.969+0000 7fb7d8e54640 1 -- 172.21.15.27:0/987129490 learned_addr learned my addr 172.21.15.27:0/987129490 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:35.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.969+0000 7fb7d37fe640 1 --2- 172.21.15.27:0/987129490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6bae6ca0 0x55cf6baf2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:35.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.970+0000 7fb7d8e54640 1 -- 172.21.15.27:0/987129490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6bae6380 msgr2=0x55cf6baf53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:35.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.970+0000 7fb7d8e54640 1 --2- 172.21.15.27:0/987129490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6bae6380 0x55cf6baf53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.970+0000 7fb7d8e54640 1 -- 172.21.15.27:0/987129490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6bae6ca0 msgr2=0x55cf6baf2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:35.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.970+0000 7fb7d8e54640 1 --2- 172.21.15.27:0/987129490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6bae6ca0 0x55cf6baf2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.970+0000 7fb7d8e54640 1 -- 172.21.15.27:0/987129490 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf6b7bd3c0 con 0x55cf6baf5a90 2024-09-19T08:13:35.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.970+0000 7fb7d3fff640 1 --2- 172.21.15.27:0/987129490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6bae6380 0x55cf6baf53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:13:35.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.970+0000 7fb7d8e54640 1 --2- 172.21.15.27:0/987129490 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6baf5a90 0x55cf6baf2bb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009430 tx=0x7fb7cc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35556f49a2a581c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:35.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.970+0000 7fb7b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:13:35.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.970+0000 7fb7b37fe640 1 -- 172.21.15.27:0/987129490 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc034070 con 0x55cf6baf5a90 2024-09-19T08:13:35.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.970+0000 7fb7dcc90740 1 -- 172.21.15.27:0/987129490 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7cc003b30 con 0x55cf6baf5a90 2024-09-19T08:13:35.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.970+0000 7fb7b37fe640 1 -- 172.21.15.27:0/987129490 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fb7cc004210 con 0x55cf6baf5a90 2024-09-19T08:13:35.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.970+0000 7fb7b37fe640 1 -- 172.21.15.27:0/987129490 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb7cc004410 con 0x55cf6baf5a90 2024-09-19T08:13:35.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.970+0000 7fb7dcc90740 10 client.15846 fetch_fsmap learned FSMap version 20 2024-09-19T08:13:35.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.970+0000 7fb7dcc90740 1 -- 172.21.15.27:0/987129490 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cf6baf8660 con 0x55cf6baf5a90 2024-09-19T08:13:35.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.970+0000 7fb7b37fe640 1 -- 172.21.15.27:0/987129490 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7cc003b30 con 0x55cf6baf5a90 2024-09-19T08:13:35.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.971+0000 7fb7b37fe640 1 -- 172.21.15.27:0/987129490 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb7cc050780 con 0x55cf6baf5a90 2024-09-19T08:13:35.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.971+0000 7fb7dcc90740 10 client.15846 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:13:35.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.971+0000 7fb7dcc90740 10 client.15846 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:13:35.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.971+0000 7fb7dcc90740 20 client.15846 populate_metadata read hostname 'smithi027' 2024-09-19T08:13:35.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.971+0000 7fb7dcc90740 1 --2- 172.21.15.27:0/987129490 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55cf6bb05140 0x55cf6bb07530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:35.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.971+0000 7fb7dcc90740 4 client.15846 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:13:35.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.971+0000 7fb7dcc90740 1 -- 172.21.15.27:0/987129490 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf6ba59850 con 0x55cf6bb05140 2024-09-19T08:13:35.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.971+0000 7fb7d3fff640 1 --2- 172.21.15.27:0/987129490 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55cf6bb05140 0x55cf6bb07530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:35.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.971+0000 7fb7d3fff640 1 --2- 172.21.15.27:0/987129490 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55cf6bb05140 0x55cf6bb07530 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a81a72cd2066cfe1 server_cookie=dfbfb3164611be01 in_seq=0 out_seq=0 2024-09-19T08:13:35.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.971+0000 7fb7b37fe640 10 client.15846 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:35.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.972+0000 7fb7b37fe640 1 -- 172.21.15.27:0/987129490 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cf6ba59850 con 0x55cf6bb05140 2024-09-19T08:13:35.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.972+0000 7fb7b37fe640 10 client.15846 handle_command_reply: tid=0 2024-09-19T08:13:35.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.972+0000 7fb7dcc90740 1 client.15846 shutdown 2024-09-19T08:13:35.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.972+0000 7fb7dcc90740 1 -- 172.21.15.27:0/987129490 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6baf5a90 msgr2=0x55cf6baf2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:35.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.972+0000 7fb7dcc90740 1 --2- 172.21.15.27:0/987129490 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6baf5a90 0x55cf6baf2bb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009430 tx=0x7fb7cc003f10 comp rx=0 tx=0).stop 2024-09-19T08:13:35.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.972+0000 7fb7dcc90740 1 -- 172.21.15.27:0/987129490 shutdown_connections 2024-09-19T08:13:35.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.972+0000 7fb7dcc90740 1 --2- 172.21.15.27:0/987129490 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6baf5a90 0x55cf6baf2bb0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.972+0000 7fb7dcc90740 1 --2- 172.21.15.27:0/987129490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6bae6ca0 0x55cf6baf2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.972+0000 7fb7dcc90740 1 --2- 172.21.15.27:0/987129490 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55cf6bb05140 0x55cf6bb07530 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.972+0000 7fb7dcc90740 1 --2- 172.21.15.27:0/987129490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6bae6380 0x55cf6baf53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.972+0000 7fb7dcc90740 1 -- 172.21.15.27:0/987129490 >> 172.21.15.27:0/987129490 conn(0x55cf6bae2a30 msgr2=0x55cf6bae8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:35.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.972+0000 7fb7b37fe640 0 client.15846 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:35.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.973+0000 7fb7dcc90740 1 -- 172.21.15.27:0/987129490 shutdown_connections 2024-09-19T08:13:35.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.973+0000 7fb7dcc90740 1 -- 172.21.15.27:0/987129490 wait complete. 2024-09-19T08:13:35.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.973+0000 7fb7dcc90740 20 client.15846 trim_cache size 0 max 16384 2024-09-19T08:13:35.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.990+0000 7fb7dcc90740 1 Processor -- start 2024-09-19T08:13:35.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.990+0000 7fb7dcc90740 1 -- start start 2024-09-19T08:13:35.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.990+0000 7fb7dcc90740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6bae6380 0x55cf6bb01900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:35.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.990+0000 7fb7dcc90740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6bae6ca0 0x55cf6bb0ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:35.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.990+0000 7fb7dcc90740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6baf5a90 0x55cf6bb0d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:35.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.990+0000 7fb7dcc90740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d41a9580 con 0x55cf6baf5a90 2024-09-19T08:13:35.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.990+0000 7fb7dcc90740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d41abdb0 con 0x55cf6bae6380 2024-09-19T08:13:35.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.990+0000 7fb7dcc90740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d41a9bf0 con 0x55cf6bae6ca0 2024-09-19T08:13:35.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.990+0000 7fb7d8e54640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6baf5a90 0x55cf6bb0d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:35.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.990+0000 7fb7d8e54640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6baf5a90 0x55cf6bb0d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38838/0 (socket says 172.21.15.27:38838) 2024-09-19T08:13:35.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.990+0000 7fb7d8e54640 1 -- 172.21.15.27:0/3878434709 learned_addr learned my addr 172.21.15.27:0/3878434709 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:35.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.990+0000 7fb7d37fe640 1 --2- 172.21.15.27:0/3878434709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6bae6ca0 0x55cf6bb0ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:35.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.990+0000 7fb7d8e54640 1 -- 172.21.15.27:0/3878434709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6bae6ca0 msgr2=0x55cf6bb0ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:35.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.990+0000 7fb7d3fff640 1 --2- 172.21.15.27:0/3878434709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6bae6380 0x55cf6bb01900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:35.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.990+0000 7fb7d8e54640 1 --2- 172.21.15.27:0/3878434709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6bae6ca0 0x55cf6bb0ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.990+0000 7fb7d8e54640 1 -- 172.21.15.27:0/3878434709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6bae6380 msgr2=0x55cf6bb01900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:35.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.990+0000 7fb7d8e54640 1 --2- 172.21.15.27:0/3878434709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6bae6380 0x55cf6bb01900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.991+0000 7fb7d8e54640 1 -- 172.21.15.27:0/3878434709 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf6bae24d0 con 0x55cf6baf5a90 2024-09-19T08:13:35.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.991+0000 7fb7d3fff640 1 --2- 172.21.15.27:0/3878434709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6bae6380 0x55cf6bb01900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:13:35.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.991+0000 7fb7d8e54640 1 --2- 172.21.15.27:0/3878434709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6baf5a90 0x55cf6bb0d230 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc002230 tx=0x7fb7cc003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f0eeb0bfcc5d0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:35.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.991+0000 7fb7b9ffb640 1 -- 172.21.15.27:0/3878434709 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc065070 con 0x55cf6baf5a90 2024-09-19T08:13:35.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.991+0000 7fb7b9ffb640 1 -- 172.21.15.27:0/3878434709 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7cc054070 con 0x55cf6baf5a90 2024-09-19T08:13:35.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.991+0000 7fb7b9ffb640 1 -- 172.21.15.27:0/3878434709 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc034040 con 0x55cf6baf5a90 2024-09-19T08:13:35.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.992+0000 7fb7dcc90740 1 -- 172.21.15.27:0/3878434709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6baf5a90 msgr2=0x55cf6bb0d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:35.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.992+0000 7fb7dcc90740 1 --2- 172.21.15.27:0/3878434709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6baf5a90 0x55cf6bb0d230 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc002230 tx=0x7fb7cc003970 comp rx=0 tx=0).stop 2024-09-19T08:13:35.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.992+0000 7fb7dcc90740 1 -- 172.21.15.27:0/3878434709 shutdown_connections 2024-09-19T08:13:35.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.992+0000 7fb7dcc90740 1 --2- 172.21.15.27:0/3878434709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6baf5a90 0x55cf6bb0d230 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.992+0000 7fb7dcc90740 1 --2- 172.21.15.27:0/3878434709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6bae6ca0 0x55cf6bb0ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.992+0000 7fb7dcc90740 1 --2- 172.21.15.27:0/3878434709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6bae6380 0x55cf6bb01900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.992+0000 7fb7dcc90740 1 -- 172.21.15.27:0/3878434709 >> 172.21.15.27:0/3878434709 conn(0x55cf6bae2a30 msgr2=0x55cf6baf1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:35.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.992+0000 7fb7dcc90740 1 -- 172.21.15.27:0/3878434709 shutdown_connections 2024-09-19T08:13:35.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.992+0000 7fb7dcc90740 1 -- 172.21.15.27:0/3878434709 wait complete. 2024-09-19T08:13:35.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.992+0000 7fb7dcc90740 1 -- start start 2024-09-19T08:13:35.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.992+0000 7fb7dcc90740 1 Processor -- start 2024-09-19T08:13:35.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.992+0000 7fb7dcc90740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6bae6380 0x55cf6baf96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:35.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7dcc90740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6bae6ca0 0x55cf6baf9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:35.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7dcc90740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6baf5a90 0x55cf6bafa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:35.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7dcc90740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d41aa270 con 0x55cf6bae6380 2024-09-19T08:13:35.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7dcc90740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d41ab6e0 con 0x55cf6bae6ca0 2024-09-19T08:13:35.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7dcc90740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d41aa940 con 0x55cf6baf5a90 2024-09-19T08:13:35.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7dcc90740 10 client.0 _ll_register_callbacks cb 0x7fb7cc047020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:13:35.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7d3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6bae6380 0x55cf6baf96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:35.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7d3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6bae6380 0x55cf6baf96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38840/0 (socket says 172.21.15.27:38840) 2024-09-19T08:13:35.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7d3fff640 1 -- 172.21.15.27:0/3582066692 learned_addr learned my addr 172.21.15.27:0/3582066692 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:35.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7d37fe640 1 --2- 172.21.15.27:0/3582066692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6bae6ca0 0x55cf6baf9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:35.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7d8e54640 1 --2- 172.21.15.27:0/3582066692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6baf5a90 0x55cf6bafa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:35.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7d3fff640 1 -- 172.21.15.27:0/3582066692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6baf5a90 msgr2=0x55cf6bafa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:35.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7d3fff640 1 --2- 172.21.15.27:0/3582066692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6baf5a90 0x55cf6bafa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7d3fff640 1 -- 172.21.15.27:0/3582066692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6bae6ca0 msgr2=0x55cf6baf9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:35.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7d3fff640 1 --2- 172.21.15.27:0/3582066692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6bae6ca0 0x55cf6baf9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:35.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7d3fff640 1 -- 172.21.15.27:0/3582066692 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf6bb6ecc0 con 0x55cf6bae6380 2024-09-19T08:13:35.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7d8e54640 1 --2- 172.21.15.27:0/3582066692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6baf5a90 0x55cf6bafa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:13:35.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7d3fff640 1 --2- 172.21.15.27:0/3582066692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6bae6380 0x55cf6baf96e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400dc70 tx=0x7fb7c4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2476f2ab6ad4e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:35.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:13:35.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7b37fe640 1 -- 172.21.15.27:0/3582066692 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4005020 con 0x55cf6bae6380 2024-09-19T08:13:35.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7b37fe640 1 -- 172.21.15.27:0/3582066692 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fb7c40051c0 con 0x55cf6bae6380 2024-09-19T08:13:35.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.993+0000 7fb7dcc90740 1 -- 172.21.15.27:0/3582066692 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7cc054070 con 0x55cf6bae6380 2024-09-19T08:13:35.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.994+0000 7fb7b37fe640 1 -- 172.21.15.27:0/3582066692 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb7c402b050 con 0x55cf6bae6380 2024-09-19T08:13:35.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.994+0000 7fb7dcc90740 10 client.15852 fetch_fsmap learned FSMap version 20 2024-09-19T08:13:36.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.994+0000 7fb7dcc90740 1 -- 172.21.15.27:0/3582066692 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cf6bb6fea0 con 0x55cf6bae6380 2024-09-19T08:13:36.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.994+0000 7fb7b37fe640 1 -- 172.21.15.27:0/3582066692 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7cc054070 con 0x55cf6bae6380 2024-09-19T08:13:36.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.994+0000 7fb7b37fe640 1 -- 172.21.15.27:0/3582066692 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb7c401b7a0 con 0x55cf6bae6380 2024-09-19T08:13:36.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.994+0000 7fb7dcc90740 10 client.15852 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:13:36.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.994+0000 7fb7dcc90740 10 client.15852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:13:36.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.994+0000 7fb7dcc90740 20 client.15852 populate_metadata read hostname 'smithi027' 2024-09-19T08:13:36.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.994+0000 7fb7dcc90740 1 --2- 172.21.15.27:0/3582066692 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55cf6bb705f0 0x55cf6bb72a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:36.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.994+0000 7fb7dcc90740 4 client.15852 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:13:36.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.994+0000 7fb7dcc90740 1 -- 172.21.15.27:0/3582066692 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cf6ba53d60 con 0x55cf6bb705f0 2024-09-19T08:13:36.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.994+0000 7fb7d37fe640 1 --2- 172.21.15.27:0/3582066692 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55cf6bb705f0 0x55cf6bb72a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:36.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.995+0000 7fb7b37fe640 10 client.15852 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:36.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.995+0000 7fb7d37fe640 1 --2- 172.21.15.27:0/3582066692 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55cf6bb705f0 0x55cf6bb72a10 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7942aea5aca7329d server_cookie=b78ea4d70d98749f in_seq=0 out_seq=0 2024-09-19T08:13:36.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.995+0000 7fb7b37fe640 1 -- 172.21.15.27:0/3582066692 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55cf6ba53d60 con 0x55cf6bb705f0 2024-09-19T08:13:36.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.995+0000 7fb7b37fe640 10 client.15852 handle_command_reply: tid=0 2024-09-19T08:13:36.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.995+0000 7fb7dcc90740 1 client.15852 shutdown 2024-09-19T08:13:36.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.995+0000 7fb7dcc90740 1 -- 172.21.15.27:0/3582066692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6bae6380 msgr2=0x55cf6baf96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:36.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.995+0000 7fb7dcc90740 1 --2- 172.21.15.27:0/3582066692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6bae6380 0x55cf6baf96e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400dc70 tx=0x7fb7c4011810 comp rx=0 tx=0).stop 2024-09-19T08:13:36.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.995+0000 7fb7dcc90740 1 -- 172.21.15.27:0/3582066692 shutdown_connections 2024-09-19T08:13:36.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.995+0000 7fb7dcc90740 1 --2- 172.21.15.27:0/3582066692 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55cf6bb705f0 0x55cf6bb72a10 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:36.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.995+0000 7fb7dcc90740 1 --2- 172.21.15.27:0/3582066692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cf6baf5a90 0x55cf6bafa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:36.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.995+0000 7fb7dcc90740 1 --2- 172.21.15.27:0/3582066692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cf6bae6ca0 0x55cf6baf9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:36.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.995+0000 7fb7b37fe640 0 client.15852 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:36.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.995+0000 7fb7dcc90740 1 --2- 172.21.15.27:0/3582066692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cf6bae6380 0x55cf6baf96e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:36.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.995+0000 7fb7dcc90740 1 -- 172.21.15.27:0/3582066692 >> 172.21.15.27:0/3582066692 conn(0x55cf6bae2a30 msgr2=0x55cf6bae1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:36.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.995+0000 7fb7dcc90740 1 -- 172.21.15.27:0/3582066692 shutdown_connections 2024-09-19T08:13:36.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.995+0000 7fb7dcc90740 1 -- 172.21.15.27:0/3582066692 wait complete. 2024-09-19T08:13:36.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.995+0000 7fb7dcc90740 20 client.15852 trim_cache size 0 max 16384 2024-09-19T08:13:36.003 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:13:36.003 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:13:36.004 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:13:36.004 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:13:36.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.996+0000 7fb7da8b7640 1 -- 172.21.15.27:0/1109637233 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb7bc0a33b0 msgr2=0x7fb7bc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:36.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.996+0000 7fb7da8b7640 1 --2- 172.21.15.27:0/1109637233 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb7bc0a33b0 0x7fb7bc0a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc048000 tx=0x7fb7cc049000 comp rx=0 tx=0).stop 2024-09-19T08:13:36.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.996+0000 7fb7da8b7640 1 -- 172.21.15.27:0/1109637233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d4103660 msgr2=0x7fb7d4198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:36.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.996+0000 7fb7da8b7640 1 --2- 172.21.15.27:0/1109637233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d4103660 0x7fb7d4198910 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb7c800d950 tx=0x7fb7c800de10 comp rx=0 tx=0).stop 2024-09-19T08:13:36.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.996+0000 7fb7da8b7640 1 -- 172.21.15.27:0/1109637233 shutdown_connections 2024-09-19T08:13:36.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.996+0000 7fb7da8b7640 1 --2- 172.21.15.27:0/1109637233 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb7bc0a33b0 0x7fb7bc0a5870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:36.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.996+0000 7fb7da8b7640 1 --2- 172.21.15.27:0/1109637233 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7d410c170 0x7fb7d419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:36.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.996+0000 7fb7da8b7640 1 --2- 172.21.15.27:0/1109637233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d4103660 0x7fb7d4198910 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:36.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.996+0000 7fb7da8b7640 1 --2- 172.21.15.27:0/1109637233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7d4102d40 0x7fb7d41983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:36.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.996+0000 7fb7da8b7640 1 -- 172.21.15.27:0/1109637233 >> 172.21.15.27:0/1109637233 conn(0x7fb7d40fc7a0 msgr2=0x7fb7d40fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:36.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.996+0000 7fb7da8b7640 1 -- 172.21.15.27:0/1109637233 shutdown_connections 2024-09-19T08:13:36.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:35.996+0000 7fb7da8b7640 1 -- 172.21.15.27:0/1109637233 wait complete. 2024-09-19T08:13:36.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:36 smithi155 ceph-mon[35362]: pgmap v80: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 703 KiB/s wr, 222 op/s 2024-09-19T08:13:36.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:36 smithi027 ceph-mon[31209]: pgmap v80: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 703 KiB/s wr, 222 op/s 2024-09-19T08:13:36.762 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:36 smithi203 ceph-mon[35198]: pgmap v80: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 703 KiB/s wr, 222 op/s 2024-09-19T08:13:36.798 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:13:36.799 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:13:37.057 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:13:37.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.563+0000 7efc1e673640 1 -- 172.21.15.27:0/3296263250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc18102790 msgr2=0x7efc181067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:37.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.563+0000 7efc1e673640 1 --2- 172.21.15.27:0/3296263250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc18102790 0x7efc181067e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009900 tx=0x7efc0c02a410 comp rx=0 tx=0).stop 2024-09-19T08:13:37.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.563+0000 7efc1e673640 1 -- 172.21.15.27:0/3296263250 shutdown_connections 2024-09-19T08:13:37.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.563+0000 7efc1e673640 1 --2- 172.21.15.27:0/3296263250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc18106f10 0x7efc1810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:37.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.563+0000 7efc1e673640 1 --2- 172.21.15.27:0/3296263250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc18102790 0x7efc181067e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:37.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.563+0000 7efc1e673640 1 --2- 172.21.15.27:0/3296263250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc18101de0 0x7efc181021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:37.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.563+0000 7efc1e673640 1 -- 172.21.15.27:0/3296263250 >> 172.21.15.27:0/3296263250 conn(0x7efc180fd8c0 msgr2=0x7efc180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:37.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.563+0000 7efc1e673640 1 -- 172.21.15.27:0/3296263250 shutdown_connections 2024-09-19T08:13:37.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.563+0000 7efc1e673640 1 -- 172.21.15.27:0/3296263250 wait complete. 2024-09-19T08:13:37.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.564+0000 7efc1e673640 1 Processor -- start 2024-09-19T08:13:37.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.564+0000 7efc1e673640 1 -- start start 2024-09-19T08:13:37.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.564+0000 7efc1e673640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc18101de0 0x7efc18198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:37.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.564+0000 7efc1e673640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc18102790 0x7efc181989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:37.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.564+0000 7efc1e673640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc18106f10 0x7efc1819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:37.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.564+0000 7efc1e673640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7efc18111f70 con 0x7efc18102790 2024-09-19T08:13:37.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.564+0000 7efc1e673640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efc18111df0 con 0x7efc18101de0 2024-09-19T08:13:37.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.564+0000 7efc1e673640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efc181120f0 con 0x7efc18106f10 2024-09-19T08:13:37.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.564+0000 7efc177fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc18102790 0x7efc181989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:37.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.564+0000 7efc177fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc18102790 0x7efc181989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38850/0 (socket says 172.21.15.27:38850) 2024-09-19T08:13:37.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.564+0000 7efc177fe640 1 -- 172.21.15.27:0/3697574992 learned_addr learned my addr 172.21.15.27:0/3697574992 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:37.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.565+0000 7efc17fff640 1 --2- 172.21.15.27:0/3697574992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc18101de0 0x7efc18198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:37.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.565+0000 7efc1cc10640 1 --2- 172.21.15.27:0/3697574992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc18106f10 0x7efc1819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:37.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.565+0000 7efc177fe640 1 -- 172.21.15.27:0/3697574992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc18106f10 msgr2=0x7efc1819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:37.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.565+0000 7efc177fe640 1 --2- 172.21.15.27:0/3697574992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc18106f10 0x7efc1819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:37.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.565+0000 7efc177fe640 1 -- 172.21.15.27:0/3697574992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc18101de0 msgr2=0x7efc18198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:37.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.565+0000 7efc177fe640 1 --2- 172.21.15.27:0/3697574992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc18101de0 0x7efc18198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:37.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.565+0000 7efc177fe640 1 -- 172.21.15.27:0/3697574992 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1819d440 con 0x7efc18102790 2024-09-19T08:13:37.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.565+0000 7efc1cc10640 1 --2- 172.21.15.27:0/3697574992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc18106f10 0x7efc1819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:13:37.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.565+0000 7efc177fe640 1 --2- 172.21.15.27:0/3697574992 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc18102790 0x7efc181989d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7efc0c006010 tx=0x7efc0c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:37.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.565+0000 7efc157fa640 1 -- 172.21.15.27:0/3697574992 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c03f030 con 0x7efc18102790 2024-09-19T08:13:37.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.565+0000 7efc1e673640 1 -- 172.21.15.27:0/3697574992 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc1819d6d0 con 0x7efc18102790 2024-09-19T08:13:37.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.565+0000 7efc157fa640 1 -- 172.21.15.27:0/3697574992 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc0c003ce0 con 0x7efc18102790 2024-09-19T08:13:37.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.565+0000 7efc157fa640 1 -- 172.21.15.27:0/3697574992 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c035070 con 0x7efc18102790 2024-09-19T08:13:37.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.565+0000 7efc1e673640 1 -- 172.21.15.27:0/3697574992 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc181a5010 con 0x7efc18102790 2024-09-19T08:13:37.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.566+0000 7efc1e673640 1 -- 172.21.15.27:0/3697574992 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc181021c0 con 0x7efc18102790 2024-09-19T08:13:37.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.567+0000 7efc157fa640 1 -- 172.21.15.27:0/3697574992 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7efc0c042030 con 0x7efc18102790 2024-09-19T08:13:37.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.568+0000 7efc157fa640 1 --2- 172.21.15.27:0/3697574992 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7efc000a33b0 0x7efc000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:37.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.568+0000 7efc17fff640 1 --2- 172.21.15.27:0/3697574992 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7efc000a33b0 0x7efc000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:37.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.568+0000 7efc157fa640 1 -- 172.21.15.27:0/3697574992 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7efc0c0f02b0 con 0x7efc18102790 2024-09-19T08:13:37.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.569+0000 7efc17fff640 1 --2- 172.21.15.27:0/3697574992 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7efc000a33b0 0x7efc000a5870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efc08005d00 tx=0x7efc0800b410 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:37.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.572+0000 7efc157fa640 1 -- 172.21.15.27:0/3697574992 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efc0c0bcda0 con 0x7efc18102790 2024-09-19T08:13:37.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.785+0000 7efc1e673640 1 -- 172.21.15.27:0/3697574992 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc1810a0f0 con 0x7efc18102790 2024-09-19T08:13:37.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.786+0000 7efc157fa640 1 -- 172.21.15.27:0/3697574992 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7efc0c0bc6a0 con 0x7efc18102790 2024-09-19T08:13:37.786 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:13:37.786 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:13:37.786 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:13:37.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.788+0000 7efc1e673640 1 -- 172.21.15.27:0/3697574992 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7efc000a33b0 msgr2=0x7efc000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:37.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.788+0000 7efc1e673640 1 --2- 172.21.15.27:0/3697574992 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7efc000a33b0 0x7efc000a5870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efc08005d00 tx=0x7efc0800b410 comp rx=0 tx=0).stop 2024-09-19T08:13:37.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.788+0000 7efc1e673640 1 -- 172.21.15.27:0/3697574992 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc18102790 msgr2=0x7efc181989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:37.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.788+0000 7efc1e673640 1 --2- 172.21.15.27:0/3697574992 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc18102790 0x7efc181989d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7efc0c006010 tx=0x7efc0c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:13:37.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.788+0000 7efc1e673640 1 -- 172.21.15.27:0/3697574992 shutdown_connections 2024-09-19T08:13:37.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.788+0000 7efc1e673640 1 --2- 172.21.15.27:0/3697574992 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7efc000a33b0 0x7efc000a5870 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:37.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.788+0000 7efc1e673640 1 --2- 172.21.15.27:0/3697574992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc18106f10 0x7efc1819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:37.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.788+0000 7efc1e673640 1 --2- 172.21.15.27:0/3697574992 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc18102790 0x7efc181989d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:37.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.788+0000 7efc1e673640 1 --2- 172.21.15.27:0/3697574992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc18101de0 0x7efc18198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:37.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.788+0000 7efc1e673640 1 -- 172.21.15.27:0/3697574992 >> 172.21.15.27:0/3697574992 conn(0x7efc180fd8c0 msgr2=0x7efc180fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:37.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.788+0000 7efc1e673640 1 -- 172.21.15.27:0/3697574992 shutdown_connections 2024-09-19T08:13:37.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:37.788+0000 7efc1e673640 1 -- 172.21.15.27:0/3697574992 wait complete. 2024-09-19T08:13:38.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:38 smithi027 ceph-mon[31209]: pgmap v81: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 703 KiB/s wr, 223 op/s 2024-09-19T08:13:38.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:38 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3697574992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:13:38.508 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:13:38.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:38 smithi155 ceph-mon[35362]: pgmap v81: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 703 KiB/s wr, 223 op/s 2024-09-19T08:13:38.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:38 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3697574992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:13:38.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:38 smithi203 ceph-mon[35198]: pgmap v81: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 703 KiB/s wr, 223 op/s 2024-09-19T08:13:38.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:38 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3697574992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:13:38.765 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:13:39.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.250+0000 7f22276e3640 1 -- 172.21.15.27:0/2876596536 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2220103760 msgr2=0x7f2220107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:39.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.250+0000 7f22276e3640 1 --2- 172.21.15.27:0/2876596536 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2220103760 0x7f2220107ba0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2210009930 tx=0x7f221002a420 comp rx=0 tx=0).stop 2024-09-19T08:13:39.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.251+0000 7f22276e3640 1 -- 172.21.15.27:0/2876596536 shutdown_connections 2024-09-19T08:13:39.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.251+0000 7f22276e3640 1 --2- 172.21.15.27:0/2876596536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22201082e0 0x7f222010ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.251+0000 7f22276e3640 1 --2- 172.21.15.27:0/2876596536 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2220103760 0x7f2220107ba0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.251+0000 7f22276e3640 1 --2- 172.21.15.27:0/2876596536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2220102db0 0x7f2220103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.251+0000 7f22276e3640 1 -- 172.21.15.27:0/2876596536 >> 172.21.15.27:0/2876596536 conn(0x7f22200fc7d0 msgr2=0x7f22200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:39.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.251+0000 7f22276e3640 1 -- 172.21.15.27:0/2876596536 shutdown_connections 2024-09-19T08:13:39.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.251+0000 7f22276e3640 1 -- 172.21.15.27:0/2876596536 wait complete. 2024-09-19T08:13:39.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.251+0000 7f22276e3640 1 Processor -- start 2024-09-19T08:13:39.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.251+0000 7f22276e3640 1 -- start start 2024-09-19T08:13:39.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.251+0000 7f22276e3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2220102db0 0x7f22201985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:39.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.251+0000 7f22276e3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2220103760 0x7f2220198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:39.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.252+0000 7f22276e3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22201082e0 0x7f222019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:39.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.252+0000 7f22276e3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2220112050 con 0x7f2220103760 2024-09-19T08:13:39.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.252+0000 7f22276e3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2220111ed0 con 0x7f2220102db0 2024-09-19T08:13:39.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.252+0000 7f22276e3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f22201121d0 con 0x7f22201082e0 2024-09-19T08:13:39.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.252+0000 7f2224c7e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2220103760 0x7f2220198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:39.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.252+0000 7f2224c7e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2220103760 0x7f2220198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38862/0 (socket says 172.21.15.27:38862) 2024-09-19T08:13:39.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.252+0000 7f2224c7e640 1 -- 172.21.15.27:0/2309224964 learned_addr learned my addr 172.21.15.27:0/2309224964 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:39.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.252+0000 7f222547f640 1 --2- 172.21.15.27:0/2309224964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2220102db0 0x7f22201985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:39.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.252+0000 7f2224c7e640 1 -- 172.21.15.27:0/2309224964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22201082e0 msgr2=0x7f222019cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:39.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.252+0000 7f2224c7e640 1 --2- 172.21.15.27:0/2309224964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22201082e0 0x7f222019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.252+0000 7f2224c7e640 1 -- 172.21.15.27:0/2309224964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2220102db0 msgr2=0x7f22201985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:39.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.252+0000 7f2224c7e640 1 --2- 172.21.15.27:0/2309224964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2220102db0 0x7f22201985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.252+0000 7f2224c7e640 1 -- 172.21.15.27:0/2309224964 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f222019d580 con 0x7f2220103760 2024-09-19T08:13:39.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.252+0000 7f222547f640 1 --2- 172.21.15.27:0/2309224964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2220102db0 0x7f22201985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:13:39.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.252+0000 7f2224c7e640 1 --2- 172.21.15.27:0/2309224964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2220103760 0x7f2220198b10 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2210005940 tx=0x7f2210003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:39.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.252+0000 7f22167fc640 1 -- 172.21.15.27:0/2309224964 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221003f070 con 0x7f2220103760 2024-09-19T08:13:39.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.252+0000 7f22276e3640 1 -- 172.21.15.27:0/2309224964 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f222019d810 con 0x7f2220103760 2024-09-19T08:13:39.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.252+0000 7f22167fc640 1 -- 172.21.15.27:0/2309224964 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2210031c30 con 0x7f2220103760 2024-09-19T08:13:39.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.252+0000 7f22167fc640 1 -- 172.21.15.27:0/2309224964 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2210035030 con 0x7f2220103760 2024-09-19T08:13:39.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.252+0000 7f22276e3640 1 -- 172.21.15.27:0/2309224964 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22201a5150 con 0x7f2220103760 2024-09-19T08:13:39.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.255+0000 7f22167fc640 1 -- 172.21.15.27:0/2309224964 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2210042070 con 0x7f2220103760 2024-09-19T08:13:39.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.255+0000 7f2229abc740 1 Processor -- start 2024-09-19T08:13:39.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.255+0000 7f2229abc740 1 -- start start 2024-09-19T08:13:39.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.255+0000 7f2229abc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579937f50 0x5645799364a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:39.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.255+0000 7f2229abc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5645799369e0 0x564579936e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:39.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.255+0000 7f2229abc740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579941780 0x564579943b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:39.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.255+0000 7f2229abc740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5645798982f0 con 0x564579941780 2024-09-19T08:13:39.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.255+0000 7f2229abc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56457983fcf0 con 0x564579937f50 2024-09-19T08:13:39.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.255+0000 7f2229abc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5645798942b0 con 0x5645799369e0 2024-09-19T08:13:39.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.255+0000 7f2224c7e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579941780 0x564579943b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:39.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.256+0000 7f2224c7e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579941780 0x564579943b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38870/0 (socket says 172.21.15.27:38870) 2024-09-19T08:13:39.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.256+0000 7f2224c7e640 1 -- 172.21.15.27:0/1751188814 learned_addr learned my addr 172.21.15.27:0/1751188814 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:39.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.256+0000 7f22167fc640 1 --2- 172.21.15.27:0/2309224964 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f220c0a33b0 0x7f220c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:39.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.256+0000 7f222547f640 1 --2- 172.21.15.27:0/1751188814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5645799369e0 0x564579936e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:39.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.256+0000 7f2225c80640 1 --2- 172.21.15.27:0/1751188814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579937f50 0x5645799364a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:39.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.256+0000 7f2225c80640 1 --2- 172.21.15.27:0/2309224964 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f220c0a33b0 0x7f220c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:39.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.256+0000 7f22167fc640 1 -- 172.21.15.27:0/2309224964 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f22100f0570 con 0x7f2220103760 2024-09-19T08:13:39.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.256+0000 7f2224c7e640 1 -- 172.21.15.27:0/1751188814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5645799369e0 msgr2=0x564579936e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:39.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.256+0000 7f2224c7e640 1 --2- 172.21.15.27:0/1751188814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5645799369e0 0x564579936e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.256+0000 7f2224c7e640 1 -- 172.21.15.27:0/1751188814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579937f50 msgr2=0x5645799364a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:39.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.256+0000 7f2224c7e640 1 --2- 172.21.15.27:0/1751188814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579937f50 0x5645799364a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.256+0000 7f2224c7e640 1 -- 172.21.15.27:0/1751188814 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645798243a0 con 0x564579941780 2024-09-19T08:13:39.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.256+0000 7f222547f640 1 --2- 172.21.15.27:0/1751188814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5645799369e0 0x564579936e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:13:39.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.256+0000 7f2224c7e640 1 --2- 172.21.15.27:0/1751188814 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579941780 0x564579943b70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f22100b8d00 tx=0x7f221003b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4997871ecff2fc66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:39.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.256+0000 7f2225c80640 1 --2- 172.21.15.27:0/2309224964 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f220c0a33b0 0x7f220c0a5870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f22180139d0 tx=0x7f2218009760 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:39.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.256+0000 7f220b7fe640 1 -- 172.21.15.27:0/1751188814 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2210049070 con 0x564579941780 2024-09-19T08:13:39.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.256+0000 7f220b7fe640 1 -- 172.21.15.27:0/1751188814 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22100bcfa0 con 0x564579941780 2024-09-19T08:13:39.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.256+0000 7f220b7fe640 1 -- 172.21.15.27:0/1751188814 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22100b8f10 con 0x564579941780 2024-09-19T08:13:39.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.257+0000 7f2229abc740 1 -- 172.21.15.27:0/1751188814 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579941780 msgr2=0x564579943b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:39.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.257+0000 7f2229abc740 1 --2- 172.21.15.27:0/1751188814 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579941780 0x564579943b70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f22100b8d00 tx=0x7f221003b890 comp rx=0 tx=0).stop 2024-09-19T08:13:39.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.257+0000 7f2229abc740 1 -- 172.21.15.27:0/1751188814 shutdown_connections 2024-09-19T08:13:39.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.257+0000 7f2229abc740 1 --2- 172.21.15.27:0/1751188814 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579941780 0x564579943b70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.257+0000 7f2229abc740 1 --2- 172.21.15.27:0/1751188814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5645799369e0 0x564579936e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.257+0000 7f2229abc740 1 --2- 172.21.15.27:0/1751188814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579937f50 0x5645799364a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.257+0000 7f2229abc740 1 -- 172.21.15.27:0/1751188814 >> 172.21.15.27:0/1751188814 conn(0x5645798fb310 msgr2=0x564579933070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:39.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.257+0000 7f2229abc740 1 -- 172.21.15.27:0/1751188814 shutdown_connections 2024-09-19T08:13:39.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.257+0000 7f2229abc740 1 -- 172.21.15.27:0/1751188814 wait complete. 2024-09-19T08:13:39.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.258+0000 7f2229abc740 1 -- start start 2024-09-19T08:13:39.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.258+0000 7f2229abc740 1 Processor -- start 2024-09-19T08:13:39.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.258+0000 7f2229abc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5645799369e0 0x56457993e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:39.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.258+0000 7f2229abc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579937f50 0x56457993ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:39.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.258+0000 7f2229abc740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579941780 0x56457993ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:39.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.258+0000 7f2229abc740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5645798982f0 con 0x564579941780 2024-09-19T08:13:39.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.258+0000 7f2229abc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x564579853060 con 0x564579937f50 2024-09-19T08:13:39.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.258+0000 7f2229abc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564579944240 con 0x5645799369e0 2024-09-19T08:13:39.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.258+0000 7f2229abc740 10 client.0 _ll_register_callbacks cb 0x5645795a68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:13:39.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.258+0000 7f2225c80640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579941780 0x56457993ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:39.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.258+0000 7f2225c80640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579941780 0x56457993ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38884/0 (socket says 172.21.15.27:38884) 2024-09-19T08:13:39.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.258+0000 7f2225c80640 1 -- 172.21.15.27:0/1535772017 learned_addr learned my addr 172.21.15.27:0/1535772017 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:39.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.258+0000 7f222547f640 1 --2- 172.21.15.27:0/1535772017 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5645799369e0 0x56457993e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:39.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.258+0000 7f2224c7e640 1 --2- 172.21.15.27:0/1535772017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579937f50 0x56457993ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:39.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.258+0000 7f2225c80640 1 -- 172.21.15.27:0/1535772017 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5645799369e0 msgr2=0x56457993e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:39.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.259+0000 7f2225c80640 1 --2- 172.21.15.27:0/1535772017 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5645799369e0 0x56457993e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.259+0000 7f2225c80640 1 -- 172.21.15.27:0/1535772017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579937f50 msgr2=0x56457993ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:39.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.259+0000 7f2225c80640 1 --2- 172.21.15.27:0/1535772017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579937f50 0x56457993ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.259+0000 7f2225c80640 1 -- 172.21.15.27:0/1535772017 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645796093c0 con 0x564579941780 2024-09-19T08:13:39.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.259+0000 7f2225c80640 1 --2- 172.21.15.27:0/1535772017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579941780 0x56457993ef80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f22180137b0 tx=0x7f22180094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25902ed523a53266 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:39.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.259+0000 7f2208ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:13:39.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.259+0000 7f2208ff9640 1 -- 172.21.15.27:0/1535772017 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2218025070 con 0x564579941780 2024-09-19T08:13:39.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.259+0000 7f2229abc740 1 -- 172.21.15.27:0/1535772017 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22100bcfa0 con 0x564579941780 2024-09-19T08:13:39.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.259+0000 7f2208ff9640 1 -- 172.21.15.27:0/1535772017 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f2218011e10 con 0x564579941780 2024-09-19T08:13:39.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.259+0000 7f2208ff9640 1 -- 172.21.15.27:0/1535772017 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2218030050 con 0x564579941780 2024-09-19T08:13:39.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.259+0000 7f2229abc740 10 client.15870 fetch_fsmap learned FSMap version 20 2024-09-19T08:13:39.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.259+0000 7f2229abc740 1 -- 172.21.15.27:0/1535772017 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56457994fca0 con 0x564579941780 2024-09-19T08:13:39.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.259+0000 7f2208ff9640 1 -- 172.21.15.27:0/1535772017 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22100bcfa0 con 0x564579941780 2024-09-19T08:13:39.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.259+0000 7f2208ff9640 1 -- 172.21.15.27:0/1535772017 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f221801d040 con 0x564579941780 2024-09-19T08:13:39.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.259+0000 7f2229abc740 10 client.15870 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:13:39.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.259+0000 7f2229abc740 10 client.15870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:13:39.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.260+0000 7f2229abc740 20 client.15870 populate_metadata read hostname 'smithi027' 2024-09-19T08:13:39.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.260+0000 7f2229abc740 1 --2- 172.21.15.27:0/1535772017 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5645799510b0 0x5645799534e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:39.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.260+0000 7f2229abc740 4 client.15870 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:13:39.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.260+0000 7f2229abc740 1 -- 172.21.15.27:0/1535772017 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645798a5860 con 0x5645799510b0 2024-09-19T08:13:39.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.260+0000 7f222547f640 1 --2- 172.21.15.27:0/1535772017 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5645799510b0 0x5645799534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:39.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.260+0000 7f2208ff9640 10 client.15870 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:39.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.260+0000 7f222547f640 1 --2- 172.21.15.27:0/1535772017 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5645799510b0 0x5645799534e0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87e88070c2f108f8 server_cookie=49fe578c0a5344f7 in_seq=0 out_seq=0 2024-09-19T08:13:39.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.261+0000 7f2208ff9640 1 -- 172.21.15.27:0/1535772017 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5645798a5860 con 0x5645799510b0 2024-09-19T08:13:39.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.261+0000 7f2208ff9640 10 client.15870 handle_command_reply: tid=0 2024-09-19T08:13:39.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.261+0000 7f2229abc740 1 client.15870 shutdown 2024-09-19T08:13:39.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.261+0000 7f2229abc740 1 -- 172.21.15.27:0/1535772017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579941780 msgr2=0x56457993ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:39.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.261+0000 7f2229abc740 1 --2- 172.21.15.27:0/1535772017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579941780 0x56457993ef80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f22180137b0 tx=0x7f22180094c0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.261+0000 7f2229abc740 1 -- 172.21.15.27:0/1535772017 shutdown_connections 2024-09-19T08:13:39.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.261+0000 7f2229abc740 1 --2- 172.21.15.27:0/1535772017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579941780 0x56457993ef80 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.261+0000 7f2229abc740 1 --2- 172.21.15.27:0/1535772017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579937f50 0x56457993ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.261+0000 7f2229abc740 1 --2- 172.21.15.27:0/1535772017 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5645799510b0 0x5645799534e0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.261+0000 7f2229abc740 1 --2- 172.21.15.27:0/1535772017 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5645799369e0 0x56457993e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.261+0000 7f2208ff9640 0 client.15870 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:39.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.261+0000 7f2229abc740 1 -- 172.21.15.27:0/1535772017 >> 172.21.15.27:0/1535772017 conn(0x5645798fb310 msgr2=0x564579938da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:39.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.261+0000 7f2229abc740 1 -- 172.21.15.27:0/1535772017 shutdown_connections 2024-09-19T08:13:39.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.261+0000 7f2229abc740 1 -- 172.21.15.27:0/1535772017 wait complete. 2024-09-19T08:13:39.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.261+0000 7f2229abc740 20 client.15870 trim_cache size 0 max 16384 2024-09-19T08:13:39.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.274+0000 7f2229abc740 1 Processor -- start 2024-09-19T08:13:39.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.274+0000 7f2229abc740 1 -- start start 2024-09-19T08:13:39.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.275+0000 7f2229abc740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645799369e0 0x564579939530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:39.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.275+0000 7f2229abc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579937f50 0x564579939a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:39.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.275+0000 7f2229abc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564579941780 0x564579958db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:39.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.275+0000 7f2229abc740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f22201a95d0 con 0x5645799369e0 2024-09-19T08:13:39.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.275+0000 7f2229abc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f22201abe30 con 0x564579937f50 2024-09-19T08:13:39.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.275+0000 7f2229abc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f22201a9c20 con 0x564579941780 2024-09-19T08:13:39.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.275+0000 7f222547f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645799369e0 0x564579939530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:39.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.275+0000 7f222547f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645799369e0 0x564579939530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38896/0 (socket says 172.21.15.27:38896) 2024-09-19T08:13:39.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.275+0000 7f222547f640 1 -- 172.21.15.27:0/2000521418 learned_addr learned my addr 172.21.15.27:0/2000521418 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:39.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.275+0000 7f222547f640 1 -- 172.21.15.27:0/2000521418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564579941780 msgr2=0x564579958db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:39.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.275+0000 7f222547f640 1 --2- 172.21.15.27:0/2000521418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564579941780 0x564579958db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.275+0000 7f2224c7e640 1 --2- 172.21.15.27:0/2000521418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579937f50 0x564579939a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:39.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.275+0000 7f222547f640 1 -- 172.21.15.27:0/2000521418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579937f50 msgr2=0x564579939a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:39.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.275+0000 7f222547f640 1 --2- 172.21.15.27:0/2000521418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579937f50 0x564579939a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.275+0000 7f222547f640 1 -- 172.21.15.27:0/2000521418 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56457994d360 con 0x5645799369e0 2024-09-19T08:13:39.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.275+0000 7f2224c7e640 1 --2- 172.21.15.27:0/2000521418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579937f50 0x564579939a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:13:39.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.275+0000 7f222547f640 1 --2- 172.21.15.27:0/2000521418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645799369e0 0x564579939530 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f221c005fd0 tx=0x7f221c014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8145e45a25f5ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:39.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.275+0000 7f220affd640 1 -- 172.21.15.27:0/2000521418 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221c004020 con 0x5645799369e0 2024-09-19T08:13:39.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.276+0000 7f220affd640 1 -- 172.21.15.27:0/2000521418 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f221c0041c0 con 0x5645799369e0 2024-09-19T08:13:39.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.276+0000 7f220affd640 1 -- 172.21.15.27:0/2000521418 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221c0126b0 con 0x5645799369e0 2024-09-19T08:13:39.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.276+0000 7f2229abc740 1 -- 172.21.15.27:0/2000521418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645799369e0 msgr2=0x564579939530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:39.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.276+0000 7f2229abc740 1 --2- 172.21.15.27:0/2000521418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645799369e0 0x564579939530 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f221c005fd0 tx=0x7f221c014840 comp rx=0 tx=0).stop 2024-09-19T08:13:39.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.276+0000 7f2229abc740 1 -- 172.21.15.27:0/2000521418 shutdown_connections 2024-09-19T08:13:39.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.276+0000 7f2229abc740 1 --2- 172.21.15.27:0/2000521418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564579941780 0x564579958db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.276+0000 7f2229abc740 1 --2- 172.21.15.27:0/2000521418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579937f50 0x564579939a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.276+0000 7f2229abc740 1 --2- 172.21.15.27:0/2000521418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645799369e0 0x564579939530 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.276+0000 7f2229abc740 1 -- 172.21.15.27:0/2000521418 >> 172.21.15.27:0/2000521418 conn(0x5645798fb310 msgr2=0x564579940580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:39.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.276+0000 7f2229abc740 1 -- 172.21.15.27:0/2000521418 shutdown_connections 2024-09-19T08:13:39.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.276+0000 7f2229abc740 1 -- 172.21.15.27:0/2000521418 wait complete. 2024-09-19T08:13:39.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.277+0000 7f2229abc740 1 -- start start 2024-09-19T08:13:39.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.277+0000 7f2229abc740 1 Processor -- start 2024-09-19T08:13:39.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.277+0000 7f2229abc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5645799369e0 0x564579949760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:39.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.277+0000 7f2229abc740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579937f50 0x564579949ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:39.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.277+0000 7f2229abc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579941780 0x56457993adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:39.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.277+0000 7f2229abc740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f22201aa2f0 con 0x564579937f50 2024-09-19T08:13:39.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.277+0000 7f2229abc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f22201ab760 con 0x564579941780 2024-09-19T08:13:39.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.277+0000 7f2229abc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f22201aa9c0 con 0x5645799369e0 2024-09-19T08:13:39.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.277+0000 7f2229abc740 10 client.0 _ll_register_callbacks cb 0x7f22180135a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:13:39.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.277+0000 7f2224c7e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579937f50 0x564579949ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:39.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.277+0000 7f2224c7e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579937f50 0x564579949ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38900/0 (socket says 172.21.15.27:38900) 2024-09-19T08:13:39.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.277+0000 7f2224c7e640 1 -- 172.21.15.27:0/2206497014 learned_addr learned my addr 172.21.15.27:0/2206497014 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:39.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.277+0000 7f2225c80640 1 --2- 172.21.15.27:0/2206497014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579941780 0x56457993adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:39.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.277+0000 7f222547f640 1 --2- 172.21.15.27:0/2206497014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5645799369e0 0x564579949760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:39.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.277+0000 7f2224c7e640 1 -- 172.21.15.27:0/2206497014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5645799369e0 msgr2=0x564579949760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:39.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.278+0000 7f2224c7e640 1 --2- 172.21.15.27:0/2206497014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5645799369e0 0x564579949760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.278+0000 7f2224c7e640 1 -- 172.21.15.27:0/2206497014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579941780 msgr2=0x56457993adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:39.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.278+0000 7f2224c7e640 1 --2- 172.21.15.27:0/2206497014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579941780 0x56457993adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.278+0000 7f2224c7e640 1 -- 172.21.15.27:0/2206497014 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56457993b5e0 con 0x564579937f50 2024-09-19T08:13:39.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.278+0000 7f2224c7e640 1 --2- 172.21.15.27:0/2206497014 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579937f50 0x564579949ca0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f22100ee310 tx=0x7f22100bc320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505354d3dc805a46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:39.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.278+0000 7f2208ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:13:39.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.278+0000 7f2208ff9640 1 -- 172.21.15.27:0/2206497014 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2210049040 con 0x564579937f50 2024-09-19T08:13:39.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.278+0000 7f2208ff9640 1 -- 172.21.15.27:0/2206497014 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f221003b4f0 con 0x564579937f50 2024-09-19T08:13:39.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.278+0000 7f2229abc740 1 -- 172.21.15.27:0/2206497014 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f221c0041c0 con 0x564579937f50 2024-09-19T08:13:39.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.278+0000 7f2208ff9640 1 -- 172.21.15.27:0/2206497014 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f22100bc8a0 con 0x564579937f50 2024-09-19T08:13:39.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.278+0000 7f2229abc740 10 client.15876 fetch_fsmap learned FSMap version 20 2024-09-19T08:13:39.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.278+0000 7f2229abc740 1 -- 172.21.15.27:0/2206497014 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5645799bb830 con 0x564579937f50 2024-09-19T08:13:39.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.278+0000 7f2208ff9640 1 -- 172.21.15.27:0/2206497014 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f221c0041c0 con 0x564579937f50 2024-09-19T08:13:39.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.278+0000 7f2208ff9640 1 -- 172.21.15.27:0/2206497014 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f22100bdbd0 con 0x564579937f50 2024-09-19T08:13:39.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.278+0000 7f2229abc740 10 client.15876 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:13:39.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.278+0000 7f2229abc740 10 client.15876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:13:39.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.278+0000 7f2229abc740 20 client.15876 populate_metadata read hostname 'smithi027' 2024-09-19T08:13:39.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.278+0000 7f2229abc740 1 --2- 172.21.15.27:0/2206497014 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5645799bbc20 0x5645799be010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:39.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.278+0000 7f2229abc740 4 client.15876 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:13:39.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.278+0000 7f2229abc740 1 -- 172.21.15.27:0/2206497014 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56457989fd70 con 0x5645799bbc20 2024-09-19T08:13:39.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.279+0000 7f222547f640 1 --2- 172.21.15.27:0/2206497014 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5645799bbc20 0x5645799be010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:39.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.279+0000 7f222547f640 1 --2- 172.21.15.27:0/2206497014 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5645799bbc20 0x5645799be010 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c515a2058a2d00bd server_cookie=a9d68e8fe2fba107 in_seq=0 out_seq=0 2024-09-19T08:13:39.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.279+0000 7f2208ff9640 10 client.15876 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:39.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.279+0000 7f2208ff9640 1 -- 172.21.15.27:0/2206497014 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56457989fd70 con 0x5645799bbc20 2024-09-19T08:13:39.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.279+0000 7f2208ff9640 10 client.15876 handle_command_reply: tid=0 2024-09-19T08:13:39.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.279+0000 7f2229abc740 1 client.15876 shutdown 2024-09-19T08:13:39.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.279+0000 7f2229abc740 1 -- 172.21.15.27:0/2206497014 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579937f50 msgr2=0x564579949ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:39.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.279+0000 7f2229abc740 1 --2- 172.21.15.27:0/2206497014 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579937f50 0x564579949ca0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f22100ee310 tx=0x7f22100bc320 comp rx=0 tx=0).stop 2024-09-19T08:13:39.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.280+0000 7f2229abc740 1 -- 172.21.15.27:0/2206497014 shutdown_connections 2024-09-19T08:13:39.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.280+0000 7f2229abc740 1 --2- 172.21.15.27:0/2206497014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564579941780 0x56457993adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.280+0000 7f2229abc740 1 --2- 172.21.15.27:0/2206497014 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564579937f50 0x564579949ca0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.280+0000 7f2229abc740 1 --2- 172.21.15.27:0/2206497014 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5645799bbc20 0x5645799be010 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.280+0000 7f2229abc740 1 --2- 172.21.15.27:0/2206497014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5645799369e0 0x564579949760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.280+0000 7f2208ff9640 0 client.15876 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:39.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.280+0000 7f2229abc740 1 -- 172.21.15.27:0/2206497014 >> 172.21.15.27:0/2206497014 conn(0x5645798fb310 msgr2=0x56457993ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:39.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.280+0000 7f2229abc740 1 -- 172.21.15.27:0/2206497014 shutdown_connections 2024-09-19T08:13:39.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.280+0000 7f2229abc740 1 -- 172.21.15.27:0/2206497014 wait complete. 2024-09-19T08:13:39.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.280+0000 7f2229abc740 20 client.15876 trim_cache size 0 max 16384 2024-09-19T08:13:39.301 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:13:39.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.280+0000 7f22276e3640 1 -- 172.21.15.27:0/2309224964 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f220c0a33b0 msgr2=0x7f220c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:39.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.280+0000 7f22276e3640 1 --2- 172.21.15.27:0/2309224964 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f220c0a33b0 0x7f220c0a5870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f22180139d0 tx=0x7f2218009760 comp rx=0 tx=0).stop 2024-09-19T08:13:39.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.280+0000 7f22276e3640 1 -- 172.21.15.27:0/2309224964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2220103760 msgr2=0x7f2220198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:39.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.280+0000 7f22276e3640 1 --2- 172.21.15.27:0/2309224964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2220103760 0x7f2220198b10 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2210005940 tx=0x7f2210003c10 comp rx=0 tx=0).stop 2024-09-19T08:13:39.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.280+0000 7f22276e3640 1 -- 172.21.15.27:0/2309224964 shutdown_connections 2024-09-19T08:13:39.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.280+0000 7f22276e3640 1 --2- 172.21.15.27:0/2309224964 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f220c0a33b0 0x7f220c0a5870 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.280+0000 7f22276e3640 1 --2- 172.21.15.27:0/2309224964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22201082e0 0x7f222019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.280+0000 7f22276e3640 1 --2- 172.21.15.27:0/2309224964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2220103760 0x7f2220198b10 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.280+0000 7f22276e3640 1 --2- 172.21.15.27:0/2309224964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2220102db0 0x7f22201985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:39.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.280+0000 7f22276e3640 1 -- 172.21.15.27:0/2309224964 >> 172.21.15.27:0/2309224964 conn(0x7f22200fc7d0 msgr2=0x7f2220106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:39.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.281+0000 7f22276e3640 1 -- 172.21.15.27:0/2309224964 shutdown_connections 2024-09-19T08:13:39.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:39.281+0000 7f22276e3640 1 -- 172.21.15.27:0/2309224964 wait complete. 2024-09-19T08:13:40.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:40 smithi155 ceph-mon[35362]: pgmap v82: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 265 KiB/s wr, 73 op/s 2024-09-19T08:13:40.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:40 smithi027 ceph-mon[31209]: pgmap v82: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 265 KiB/s wr, 73 op/s 2024-09-19T08:13:40.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:40 smithi203 ceph-mon[35198]: pgmap v82: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 265 KiB/s wr, 73 op/s 2024-09-19T08:13:40.926 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:13:40.926 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:13:41.198 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:13:41.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.712+0000 7ff3d2b98640 1 -- 172.21.15.27:0/1174775436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3cc106f10 msgr2=0x7ff3cc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:41.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.712+0000 7ff3d2b98640 1 --2- 172.21.15.27:0/1174775436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3cc106f10 0x7ff3cc10ea90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4009ca0 tx=0x7ff3c402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.712+0000 7ff3d2b98640 1 -- 172.21.15.27:0/1174775436 shutdown_connections 2024-09-19T08:13:41.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.712+0000 7ff3d2b98640 1 --2- 172.21.15.27:0/1174775436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3cc106f10 0x7ff3cc10ea90 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.712+0000 7ff3d2b98640 1 --2- 172.21.15.27:0/1174775436 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3cc102790 0x7ff3cc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.712+0000 7ff3d2b98640 1 --2- 172.21.15.27:0/1174775436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3cc101de0 0x7ff3cc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.712+0000 7ff3d2b98640 1 -- 172.21.15.27:0/1174775436 >> 172.21.15.27:0/1174775436 conn(0x7ff3cc0fd8c0 msgr2=0x7ff3cc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:41.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.712+0000 7ff3d2b98640 1 -- 172.21.15.27:0/1174775436 shutdown_connections 2024-09-19T08:13:41.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.712+0000 7ff3d2b98640 1 -- 172.21.15.27:0/1174775436 wait complete. 2024-09-19T08:13:41.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.713+0000 7ff3d2b98640 1 Processor -- start 2024-09-19T08:13:41.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.713+0000 7ff3d2b98640 1 -- start start 2024-09-19T08:13:41.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.713+0000 7ff3d2b98640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3cc101de0 0x7ff3cc198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:41.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.713+0000 7ff3d2b98640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3cc102790 0x7ff3cc198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:41.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.713+0000 7ff3d2b98640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3cc106f10 0x7ff3cc19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:41.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.713+0000 7ff3d2b98640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc111f70 con 0x7ff3cc101de0 2024-09-19T08:13:41.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.713+0000 7ff3d2b98640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc111df0 con 0x7ff3cc106f10 2024-09-19T08:13:41.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.713+0000 7ff3d2b98640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc1120f0 con 0x7ff3cc102790 2024-09-19T08:13:41.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.713+0000 7ff3d0934640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3cc101de0 0x7ff3cc198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:41.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.713+0000 7ff3d0934640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3cc101de0 0x7ff3cc198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33506/0 (socket says 172.21.15.27:33506) 2024-09-19T08:13:41.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.713+0000 7ff3d0934640 1 -- 172.21.15.27:0/530677841 learned_addr learned my addr 172.21.15.27:0/530677841 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:41.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.713+0000 7ff3cbfff640 1 --2- 172.21.15.27:0/530677841 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3cc102790 0x7ff3cc198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:41.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.714+0000 7ff3d1135640 1 --2- 172.21.15.27:0/530677841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3cc106f10 0x7ff3cc19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:41.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.714+0000 7ff3d0934640 1 -- 172.21.15.27:0/530677841 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3cc102790 msgr2=0x7ff3cc198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:41.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.714+0000 7ff3d0934640 1 --2- 172.21.15.27:0/530677841 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3cc102790 0x7ff3cc198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.714+0000 7ff3d0934640 1 -- 172.21.15.27:0/530677841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3cc106f10 msgr2=0x7ff3cc19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:41.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.714+0000 7ff3d0934640 1 --2- 172.21.15.27:0/530677841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3cc106f10 0x7ff3cc19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.714+0000 7ff3d0934640 1 -- 172.21.15.27:0/530677841 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3cc19d2f0 con 0x7ff3cc101de0 2024-09-19T08:13:41.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.714+0000 7ff3d1135640 1 --2- 172.21.15.27:0/530677841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3cc106f10 0x7ff3cc19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:13:41.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.714+0000 7ff3d0934640 1 --2- 172.21.15.27:0/530677841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3cc101de0 0x7ff3cc198340 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000d950 tx=0x7ff3c000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:41.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.714+0000 7ff3c9ffb640 1 -- 172.21.15.27:0/530677841 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0017070 con 0x7ff3cc101de0 2024-09-19T08:13:41.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.714+0000 7ff3d2b98640 1 -- 172.21.15.27:0/530677841 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3cc19d5e0 con 0x7ff3cc101de0 2024-09-19T08:13:41.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.714+0000 7ff3c9ffb640 1 -- 172.21.15.27:0/530677841 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3c000de80 con 0x7ff3cc101de0 2024-09-19T08:13:41.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.714+0000 7ff3c9ffb640 1 -- 172.21.15.27:0/530677841 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c000f620 con 0x7ff3cc101de0 2024-09-19T08:13:41.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.715+0000 7ff3d2b98640 1 -- 172.21.15.27:0/530677841 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3cc1a4ec0 con 0x7ff3cc101de0 2024-09-19T08:13:41.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.717+0000 7ff3c9ffb640 1 -- 172.21.15.27:0/530677841 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff3c0009c30 con 0x7ff3cc101de0 2024-09-19T08:13:41.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.717+0000 7ff3d4f71740 1 Processor -- start 2024-09-19T08:13:41.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.718+0000 7ff3d4f71740 1 -- start start 2024-09-19T08:13:41.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.718+0000 7ff3c9ffb640 1 --2- 172.21.15.27:0/530677841 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff3bc0a33b0 0x7ff3bc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:41.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.718+0000 7ff3d4f71740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f9910b60 0x5555f9910f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:41.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.718+0000 7ff3d4f71740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9911480 0x5555f991b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:41.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.718+0000 7ff3d4f71740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f991bd40 0x5555f991e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:41.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.718+0000 7ff3d4f71740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5555f9876280 con 0x5555f9911480 2024-09-19T08:13:41.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.718+0000 7ff3d4f71740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5555f981db10 con 0x5555f9910b60 2024-09-19T08:13:41.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.718+0000 7ff3d4f71740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5555f9872240 con 0x5555f991bd40 2024-09-19T08:13:41.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.718+0000 7ff3d1135640 1 --2- 172.21.15.27:0/530677841 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff3bc0a33b0 0x7ff3bc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:41.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.718+0000 7ff3c9ffb640 1 -- 172.21.15.27:0/530677841 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff3c00cf940 con 0x7ff3cc101de0 2024-09-19T08:13:41.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.718+0000 7ff3cbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9911480 0x5555f991b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:41.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.718+0000 7ff3cbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9911480 0x5555f991b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33508/0 (socket says 172.21.15.27:33508) 2024-09-19T08:13:41.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.718+0000 7ff3cbfff640 1 -- 172.21.15.27:0/2196663327 learned_addr learned my addr 172.21.15.27:0/2196663327 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:41.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.718+0000 7ff3d0934640 1 --2- 172.21.15.27:0/2196663327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f9910b60 0x5555f9910f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:41.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.718+0000 7ff3d1135640 1 --2- 172.21.15.27:0/2196663327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f991bd40 0x5555f991e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:41.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.718+0000 7ff3cbfff640 1 -- 172.21.15.27:0/2196663327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f991bd40 msgr2=0x5555f991e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:41.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.718+0000 7ff3cbfff640 1 --2- 172.21.15.27:0/2196663327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f991bd40 0x5555f991e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.718+0000 7ff3cbfff640 1 -- 172.21.15.27:0/2196663327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f9910b60 msgr2=0x5555f9910f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:41.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.718+0000 7ff3cbfff640 1 --2- 172.21.15.27:0/2196663327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f9910b60 0x5555f9910f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.718+0000 7ff3cbfff640 1 -- 172.21.15.27:0/2196663327 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555f982a1f0 con 0x5555f9911480 2024-09-19T08:13:41.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.719+0000 7ff3d1135640 1 --2- 172.21.15.27:0/530677841 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff3bc0a33b0 0x7ff3bc0a5870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4006010 tx=0x7ff3c4031ce0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:41.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.719+0000 7ff3cbfff640 1 --2- 172.21.15.27:0/2196663327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9911480 0x5555f991b800 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800ac20 tx=0x7ff3b800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448a77c4ab517934 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:41.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.719+0000 7ff3b6ffd640 1 -- 172.21.15.27:0/2196663327 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b801d070 con 0x5555f9911480 2024-09-19T08:13:41.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.719+0000 7ff3b6ffd640 1 -- 172.21.15.27:0/2196663327 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3b8018b20 con 0x5555f9911480 2024-09-19T08:13:41.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.719+0000 7ff3b6ffd640 1 -- 172.21.15.27:0/2196663327 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8010a40 con 0x5555f9911480 2024-09-19T08:13:41.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.720+0000 7ff3d4f71740 1 -- 172.21.15.27:0/2196663327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9911480 msgr2=0x5555f991b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:41.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.720+0000 7ff3d4f71740 1 --2- 172.21.15.27:0/2196663327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9911480 0x5555f991b800 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800ac20 tx=0x7ff3b800f790 comp rx=0 tx=0).stop 2024-09-19T08:13:41.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.720+0000 7ff3d4f71740 1 -- 172.21.15.27:0/2196663327 shutdown_connections 2024-09-19T08:13:41.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.720+0000 7ff3d4f71740 1 --2- 172.21.15.27:0/2196663327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f991bd40 0x5555f991e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.720+0000 7ff3d4f71740 1 --2- 172.21.15.27:0/2196663327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9911480 0x5555f991b800 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.720+0000 7ff3d4f71740 1 --2- 172.21.15.27:0/2196663327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f9910b60 0x5555f9910f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.720+0000 7ff3d4f71740 1 -- 172.21.15.27:0/2196663327 >> 172.21.15.27:0/2196663327 conn(0x5555f990d0f0 msgr2=0x5555f990d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:41.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.720+0000 7ff3d4f71740 1 -- 172.21.15.27:0/2196663327 shutdown_connections 2024-09-19T08:13:41.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.720+0000 7ff3d4f71740 1 -- 172.21.15.27:0/2196663327 wait complete. 2024-09-19T08:13:41.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.720+0000 7ff3d4f71740 1 -- start start 2024-09-19T08:13:41.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.720+0000 7ff3d4f71740 1 Processor -- start 2024-09-19T08:13:41.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.720+0000 7ff3d4f71740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9910b60 0x5555f9918bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:41.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.720+0000 7ff3d4f71740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f9911480 0x5555f9919100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:41.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.720+0000 7ff3d4f71740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f991bd40 0x5555f9919640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:41.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.720+0000 7ff3d4f71740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5555f991e910 con 0x5555f9910b60 2024-09-19T08:13:41.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.720+0000 7ff3d4f71740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5555f9830f10 con 0x5555f991bd40 2024-09-19T08:13:41.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.721+0000 7ff3d4f71740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5555f991ea90 con 0x5555f9911480 2024-09-19T08:13:41.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.721+0000 7ff3d4f71740 10 client.0 _ll_register_callbacks cb 0x5555f97f9a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:13:41.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.721+0000 7ff3d0934640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9910b60 0x5555f9918bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:41.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.721+0000 7ff3d0934640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9910b60 0x5555f9918bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33516/0 (socket says 172.21.15.27:33516) 2024-09-19T08:13:41.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.721+0000 7ff3d0934640 1 -- 172.21.15.27:0/3522281393 learned_addr learned my addr 172.21.15.27:0/3522281393 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:41.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.721+0000 7ff3cbfff640 1 --2- 172.21.15.27:0/3522281393 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f9911480 0x5555f9919100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:41.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.721+0000 7ff3d1135640 1 --2- 172.21.15.27:0/3522281393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f991bd40 0x5555f9919640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:41.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.721+0000 7ff3d0934640 1 -- 172.21.15.27:0/3522281393 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f9911480 msgr2=0x5555f9919100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:41.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.721+0000 7ff3d0934640 1 --2- 172.21.15.27:0/3522281393 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f9911480 0x5555f9919100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.721+0000 7ff3d0934640 1 -- 172.21.15.27:0/3522281393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f991bd40 msgr2=0x5555f9919640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:41.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.721+0000 7ff3d0934640 1 --2- 172.21.15.27:0/3522281393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f991bd40 0x5555f9919640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.721+0000 7ff3d0934640 1 -- 172.21.15.27:0/3522281393 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555f95e76a0 con 0x5555f9910b60 2024-09-19T08:13:41.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.721+0000 7ff3d0934640 1 --2- 172.21.15.27:0/3522281393 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9910b60 0x5555f9918bc0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00cd6e0 tx=0x7ff3c009bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bf897942b7a307 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:41.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.721+0000 7ff3abfff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:13:41.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.721+0000 7ff3abfff640 1 -- 172.21.15.27:0/3522281393 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0020040 con 0x5555f9910b60 2024-09-19T08:13:41.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.721+0000 7ff3abfff640 1 -- 172.21.15.27:0/3522281393 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff3c00982e0 con 0x5555f9910b60 2024-09-19T08:13:41.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.721+0000 7ff3d4f71740 1 -- 172.21.15.27:0/3522281393 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3b8018b20 con 0x5555f9910b60 2024-09-19T08:13:41.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.721+0000 7ff3abfff640 1 -- 172.21.15.27:0/3522281393 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff3c008af70 con 0x5555f9910b60 2024-09-19T08:13:41.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.721+0000 7ff3d4f71740 10 client.15888 fetch_fsmap learned FSMap version 20 2024-09-19T08:13:41.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.721+0000 7ff3d4f71740 1 -- 172.21.15.27:0/3522281393 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5555f992a4c0 con 0x5555f9910b60 2024-09-19T08:13:41.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.722+0000 7ff3abfff640 1 -- 172.21.15.27:0/3522281393 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3b8018b20 con 0x5555f9910b60 2024-09-19T08:13:41.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.722+0000 7ff3abfff640 1 -- 172.21.15.27:0/3522281393 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff3c008c040 con 0x5555f9910b60 2024-09-19T08:13:41.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.722+0000 7ff3d4f71740 10 client.15888 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:13:41.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.722+0000 7ff3d4f71740 10 client.15888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:13:41.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.722+0000 7ff3d4f71740 20 client.15888 populate_metadata read hostname 'smithi027' 2024-09-19T08:13:41.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.722+0000 7ff3d4f71740 1 --2- 172.21.15.27:0/3522281393 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5555f992b8c0 0x5555f992dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:41.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.722+0000 7ff3d4f71740 4 client.15888 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:13:41.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.722+0000 7ff3d4f71740 1 -- 172.21.15.27:0/3522281393 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555f98837f0 con 0x5555f992b8c0 2024-09-19T08:13:41.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.722+0000 7ff3cbfff640 1 --2- 172.21.15.27:0/3522281393 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5555f992b8c0 0x5555f992dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:41.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.723+0000 7ff3cbfff640 1 --2- 172.21.15.27:0/3522281393 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5555f992b8c0 0x5555f992dd10 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1b0fefbcfa71a3e server_cookie=acaec7b75abdaec in_seq=0 out_seq=0 2024-09-19T08:13:41.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.723+0000 7ff3abfff640 10 client.15888 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:41.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.723+0000 7ff3abfff640 1 -- 172.21.15.27:0/3522281393 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5555f98837f0 con 0x5555f992b8c0 2024-09-19T08:13:41.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.723+0000 7ff3abfff640 10 client.15888 handle_command_reply: tid=0 2024-09-19T08:13:41.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.723+0000 7ff3d4f71740 1 client.15888 shutdown 2024-09-19T08:13:41.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.724+0000 7ff3d4f71740 1 -- 172.21.15.27:0/3522281393 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9910b60 msgr2=0x5555f9918bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:41.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.724+0000 7ff3d4f71740 1 --2- 172.21.15.27:0/3522281393 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9910b60 0x5555f9918bc0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00cd6e0 tx=0x7ff3c009bd30 comp rx=0 tx=0).stop 2024-09-19T08:13:41.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.724+0000 7ff3d4f71740 1 -- 172.21.15.27:0/3522281393 shutdown_connections 2024-09-19T08:13:41.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.724+0000 7ff3d4f71740 1 --2- 172.21.15.27:0/3522281393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f991bd40 0x5555f9919640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.724+0000 7ff3d4f71740 1 --2- 172.21.15.27:0/3522281393 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5555f992b8c0 0x5555f992dd10 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.724+0000 7ff3d4f71740 1 --2- 172.21.15.27:0/3522281393 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f9911480 0x5555f9919100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.724+0000 7ff3d4f71740 1 --2- 172.21.15.27:0/3522281393 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9910b60 0x5555f9918bc0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.724+0000 7ff3d4f71740 1 -- 172.21.15.27:0/3522281393 >> 172.21.15.27:0/3522281393 conn(0x5555f990d0f0 msgr2=0x5555f9912e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:41.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.724+0000 7ff3abfff640 0 client.15888 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:41.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.724+0000 7ff3d4f71740 1 -- 172.21.15.27:0/3522281393 shutdown_connections 2024-09-19T08:13:41.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.724+0000 7ff3d4f71740 1 -- 172.21.15.27:0/3522281393 wait complete. 2024-09-19T08:13:41.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.724+0000 7ff3d4f71740 20 client.15888 trim_cache size 0 max 16384 2024-09-19T08:13:41.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.741+0000 7ff3d4f71740 1 Processor -- start 2024-09-19T08:13:41.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.741+0000 7ff3d4f71740 1 -- start start 2024-09-19T08:13:41.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.741+0000 7ff3d4f71740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9910b60 0x5555f991a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:41.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.741+0000 7ff3d4f71740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f9911480 0x5555f9933580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:41.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.741+0000 7ff3d4f71740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f991bd40 0x5555f9933ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:41.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.741+0000 7ff3d4f71740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc1ab610 con 0x5555f9910b60 2024-09-19T08:13:41.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.741+0000 7ff3d4f71740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc1ade90 con 0x5555f9911480 2024-09-19T08:13:41.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.741+0000 7ff3d4f71740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc1abc80 con 0x5555f991bd40 2024-09-19T08:13:41.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.742+0000 7ff3d0934640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9910b60 0x5555f991a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:41.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.742+0000 7ff3d0934640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9910b60 0x5555f991a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33520/0 (socket says 172.21.15.27:33520) 2024-09-19T08:13:41.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.742+0000 7ff3d0934640 1 -- 172.21.15.27:0/661692990 learned_addr learned my addr 172.21.15.27:0/661692990 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:41.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.742+0000 7ff3cbfff640 1 --2- 172.21.15.27:0/661692990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f9911480 0x5555f9933580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:41.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.742+0000 7ff3d1135640 1 --2- 172.21.15.27:0/661692990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f991bd40 0x5555f9933ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:41.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.742+0000 7ff3d0934640 1 -- 172.21.15.27:0/661692990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f991bd40 msgr2=0x5555f9933ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:41.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.742+0000 7ff3d0934640 1 --2- 172.21.15.27:0/661692990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f991bd40 0x5555f9933ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.742+0000 7ff3d0934640 1 -- 172.21.15.27:0/661692990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f9911480 msgr2=0x5555f9933580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:41.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.742+0000 7ff3d0934640 1 --2- 172.21.15.27:0/661692990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f9911480 0x5555f9933580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.742+0000 7ff3d0934640 1 -- 172.21.15.27:0/661692990 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555f9917110 con 0x5555f9910b60 2024-09-19T08:13:41.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.742+0000 7ff3d1135640 1 --2- 172.21.15.27:0/661692990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f991bd40 0x5555f9933ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:13:41.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.742+0000 7ff3cbfff640 1 --2- 172.21.15.27:0/661692990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f9911480 0x5555f9933580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:13:41.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.742+0000 7ff3d0934640 1 --2- 172.21.15.27:0/661692990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9910b60 0x5555f991a9b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009610 tx=0x7ff3c00a4a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2171e234f5a6b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:41.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.742+0000 7ff3b67fc640 1 -- 172.21.15.27:0/661692990 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c00982e0 con 0x5555f9910b60 2024-09-19T08:13:41.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.742+0000 7ff3b67fc640 1 -- 172.21.15.27:0/661692990 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3c009ad80 con 0x5555f9910b60 2024-09-19T08:13:41.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.742+0000 7ff3b67fc640 1 -- 172.21.15.27:0/661692990 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c009b0c0 con 0x5555f9910b60 2024-09-19T08:13:41.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.743+0000 7ff3d4f71740 1 -- 172.21.15.27:0/661692990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9910b60 msgr2=0x5555f991a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:41.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.743+0000 7ff3d4f71740 1 --2- 172.21.15.27:0/661692990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9910b60 0x5555f991a9b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009610 tx=0x7ff3c00a4a60 comp rx=0 tx=0).stop 2024-09-19T08:13:41.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.743+0000 7ff3d4f71740 1 -- 172.21.15.27:0/661692990 shutdown_connections 2024-09-19T08:13:41.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.743+0000 7ff3d4f71740 1 --2- 172.21.15.27:0/661692990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f991bd40 0x5555f9933ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.743+0000 7ff3d4f71740 1 --2- 172.21.15.27:0/661692990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f9911480 0x5555f9933580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.743+0000 7ff3d4f71740 1 --2- 172.21.15.27:0/661692990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f9910b60 0x5555f991a9b0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.743+0000 7ff3d4f71740 1 -- 172.21.15.27:0/661692990 >> 172.21.15.27:0/661692990 conn(0x5555f990d0f0 msgr2=0x5555f991a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:41.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.743+0000 7ff3d4f71740 1 -- 172.21.15.27:0/661692990 shutdown_connections 2024-09-19T08:13:41.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.743+0000 7ff3d4f71740 1 -- 172.21.15.27:0/661692990 wait complete. 2024-09-19T08:13:41.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.743+0000 7ff3d4f71740 1 -- start start 2024-09-19T08:13:41.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.743+0000 7ff3d4f71740 1 Processor -- start 2024-09-19T08:13:41.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.744+0000 7ff3d4f71740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f9910b60 0x5555f9915d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:41.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.744+0000 7ff3d4f71740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f9911480 0x5555f99162a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:41.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.744+0000 7ff3d4f71740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f991bd40 0x5555f99167e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:41.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.744+0000 7ff3d4f71740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc1ac350 con 0x5555f991bd40 2024-09-19T08:13:41.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.744+0000 7ff3d4f71740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc1ad7c0 con 0x5555f9911480 2024-09-19T08:13:41.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.744+0000 7ff3d4f71740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc1aca20 con 0x5555f9910b60 2024-09-19T08:13:41.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.744+0000 7ff3d4f71740 10 client.0 _ll_register_callbacks cb 0x7ff3c009c400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:13:41.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.744+0000 7ff3d1135640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f991bd40 0x5555f99167e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:41.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.744+0000 7ff3d1135640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f991bd40 0x5555f99167e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33536/0 (socket says 172.21.15.27:33536) 2024-09-19T08:13:41.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.744+0000 7ff3d1135640 1 -- 172.21.15.27:0/2989156062 learned_addr learned my addr 172.21.15.27:0/2989156062 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:41.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.744+0000 7ff3cbfff640 1 --2- 172.21.15.27:0/2989156062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f9911480 0x5555f99162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:41.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.744+0000 7ff3d0934640 1 --2- 172.21.15.27:0/2989156062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f9910b60 0x5555f9915d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:41.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.744+0000 7ff3d1135640 1 -- 172.21.15.27:0/2989156062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f9910b60 msgr2=0x5555f9915d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:41.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.744+0000 7ff3d1135640 1 --2- 172.21.15.27:0/2989156062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f9910b60 0x5555f9915d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.744+0000 7ff3d1135640 1 -- 172.21.15.27:0/2989156062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f9911480 msgr2=0x5555f99162a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:41.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.744+0000 7ff3d1135640 1 --2- 172.21.15.27:0/2989156062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f9911480 0x5555f99162a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.744+0000 7ff3d1135640 1 -- 172.21.15.27:0/2989156062 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555f9922430 con 0x5555f991bd40 2024-09-19T08:13:41.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.744+0000 7ff3d1135640 1 --2- 172.21.15.27:0/2989156062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f991bd40 0x5555f99167e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4035000 tx=0x7ff3c402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd629bdcf4469875 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:41.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.744+0000 7ff3abfff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:13:41.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.744+0000 7ff3abfff640 1 -- 172.21.15.27:0/2989156062 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4004740 con 0x5555f991bd40 2024-09-19T08:13:41.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.745+0000 7ff3abfff640 1 -- 172.21.15.27:0/2989156062 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff3c402f610 con 0x5555f991bd40 2024-09-19T08:13:41.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.745+0000 7ff3d4f71740 1 -- 172.21.15.27:0/2989156062 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3c009ad80 con 0x5555f991bd40 2024-09-19T08:13:41.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.745+0000 7ff3abfff640 1 -- 172.21.15.27:0/2989156062 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff3c402f810 con 0x5555f991bd40 2024-09-19T08:13:41.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.745+0000 7ff3d4f71740 10 client.15894 fetch_fsmap learned FSMap version 20 2024-09-19T08:13:41.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.745+0000 7ff3d4f71740 1 -- 172.21.15.27:0/2989156062 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5555f9996960 con 0x5555f991bd40 2024-09-19T08:13:41.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.745+0000 7ff3abfff640 1 -- 172.21.15.27:0/2989156062 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3c009ad80 con 0x5555f991bd40 2024-09-19T08:13:41.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.745+0000 7ff3abfff640 1 -- 172.21.15.27:0/2989156062 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff3c40307e0 con 0x5555f991bd40 2024-09-19T08:13:41.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.745+0000 7ff3d4f71740 10 client.15894 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:13:41.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.745+0000 7ff3d4f71740 10 client.15894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:13:41.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.745+0000 7ff3d4f71740 20 client.15894 populate_metadata read hostname 'smithi027' 2024-09-19T08:13:41.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.745+0000 7ff3d4f71740 1 --2- 172.21.15.27:0/2989156062 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5555f9997110 0x5555f9999530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:41.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.745+0000 7ff3d4f71740 4 client.15894 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:13:41.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.745+0000 7ff3d4f71740 1 -- 172.21.15.27:0/2989156062 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5555f987dd00 con 0x5555f9997110 2024-09-19T08:13:41.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.745+0000 7ff3d0934640 1 --2- 172.21.15.27:0/2989156062 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5555f9997110 0x5555f9999530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:41.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.746+0000 7ff3d0934640 1 --2- 172.21.15.27:0/2989156062 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5555f9997110 0x5555f9999530 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=427ae00498285997 server_cookie=51b173276b39da50 in_seq=0 out_seq=0 2024-09-19T08:13:41.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.746+0000 7ff3abfff640 10 client.15894 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:41.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.747+0000 7ff3abfff640 1 -- 172.21.15.27:0/2989156062 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5555f987dd00 con 0x5555f9997110 2024-09-19T08:13:41.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.747+0000 7ff3abfff640 10 client.15894 handle_command_reply: tid=0 2024-09-19T08:13:41.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.747+0000 7ff3d4f71740 1 client.15894 shutdown 2024-09-19T08:13:41.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.747+0000 7ff3d4f71740 1 -- 172.21.15.27:0/2989156062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f991bd40 msgr2=0x5555f99167e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:41.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.747+0000 7ff3d4f71740 1 --2- 172.21.15.27:0/2989156062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f991bd40 0x5555f99167e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4035000 tx=0x7ff3c402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.747+0000 7ff3d4f71740 1 -- 172.21.15.27:0/2989156062 shutdown_connections 2024-09-19T08:13:41.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.747+0000 7ff3d4f71740 1 --2- 172.21.15.27:0/2989156062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555f991bd40 0x5555f99167e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.747+0000 7ff3d4f71740 1 --2- 172.21.15.27:0/2989156062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5555f9911480 0x5555f99162a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.747+0000 7ff3d4f71740 1 --2- 172.21.15.27:0/2989156062 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5555f9997110 0x5555f9999530 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.747+0000 7ff3d4f71740 1 --2- 172.21.15.27:0/2989156062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f9910b60 0x5555f9915d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.747+0000 7ff3abfff640 0 client.15894 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:41.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.747+0000 7ff3d4f71740 1 -- 172.21.15.27:0/2989156062 >> 172.21.15.27:0/2989156062 conn(0x5555f990d0f0 msgr2=0x5555f990c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:41.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.747+0000 7ff3d4f71740 1 -- 172.21.15.27:0/2989156062 shutdown_connections 2024-09-19T08:13:41.912 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:13:41.912 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:13:41.912 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "17a2105a-6c33-47f8-babf-be2fa625233c", 2024-09-19T08:13:41.912 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:13:41.912 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:13:41.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.747+0000 7ff3d4f71740 1 -- 172.21.15.27:0/2989156062 wait complete. 2024-09-19T08:13:41.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.748+0000 7ff3d4f71740 20 client.15894 trim_cache size 0 max 16384 2024-09-19T08:13:41.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.748+0000 7ff3d2b98640 1 -- 172.21.15.27:0/530677841 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff3bc0a33b0 msgr2=0x7ff3bc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:41.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.748+0000 7ff3d2b98640 1 --2- 172.21.15.27:0/530677841 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff3bc0a33b0 0x7ff3bc0a5870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4006010 tx=0x7ff3c4031ce0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.748+0000 7ff3d2b98640 1 -- 172.21.15.27:0/530677841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3cc101de0 msgr2=0x7ff3cc198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:41.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.748+0000 7ff3d2b98640 1 --2- 172.21.15.27:0/530677841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3cc101de0 0x7ff3cc198340 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000d950 tx=0x7ff3c000dd50 comp rx=0 tx=0).stop 2024-09-19T08:13:41.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.748+0000 7ff3d2b98640 1 -- 172.21.15.27:0/530677841 shutdown_connections 2024-09-19T08:13:41.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.748+0000 7ff3d2b98640 1 --2- 172.21.15.27:0/530677841 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff3bc0a33b0 0x7ff3bc0a5870 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.748+0000 7ff3d2b98640 1 --2- 172.21.15.27:0/530677841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3cc106f10 0x7ff3cc19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.748+0000 7ff3d2b98640 1 --2- 172.21.15.27:0/530677841 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3cc102790 0x7ff3cc198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.748+0000 7ff3d2b98640 1 --2- 172.21.15.27:0/530677841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3cc101de0 0x7ff3cc198340 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:41.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.748+0000 7ff3d2b98640 1 -- 172.21.15.27:0/530677841 >> 172.21.15.27:0/530677841 conn(0x7ff3cc0fd8c0 msgr2=0x7ff3cc0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:41.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.748+0000 7ff3d2b98640 1 -- 172.21.15.27:0/530677841 shutdown_connections 2024-09-19T08:13:41.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:41.748+0000 7ff3d2b98640 1 -- 172.21.15.27:0/530677841 wait complete. 2024-09-19T08:13:42.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:42 smithi027 ceph-mon[31209]: pgmap v83: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 19 KiB/s wr, 32 op/s 2024-09-19T08:13:42.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:42 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:13:42.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:42 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:13:42.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:42 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:13:42.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:42 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:13:42.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:42 smithi155 ceph-mon[35362]: pgmap v83: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 19 KiB/s wr, 32 op/s 2024-09-19T08:13:42.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:42 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:13:42.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:42 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:13:42.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:42 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:13:42.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:42 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:13:42.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:42 smithi203 ceph-mon[35198]: pgmap v83: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 19 KiB/s wr, 32 op/s 2024-09-19T08:13:42.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:42 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:13:42.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:42 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:13:42.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:42 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:13:42.759 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:42 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:13:42.762 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:13:43.034 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:13:43.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.538+0000 7f07e16be640 1 -- 172.21.15.27:0/2124268869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07dc101de0 msgr2=0x7f07dc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:43.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.538+0000 7f07e16be640 1 --2- 172.21.15.27:0/2124268869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07dc101de0 0x7f07dc1021c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009900 tx=0x7f07cc02a410 comp rx=0 tx=0).stop 2024-09-19T08:13:43.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.538+0000 7f07e16be640 1 -- 172.21.15.27:0/2124268869 shutdown_connections 2024-09-19T08:13:43.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.538+0000 7f07e16be640 1 --2- 172.21.15.27:0/2124268869 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07dc106f10 0x7f07dc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.538+0000 7f07e16be640 1 --2- 172.21.15.27:0/2124268869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07dc102790 0x7f07dc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.538+0000 7f07e16be640 1 --2- 172.21.15.27:0/2124268869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07dc101de0 0x7f07dc1021c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.538+0000 7f07e16be640 1 -- 172.21.15.27:0/2124268869 >> 172.21.15.27:0/2124268869 conn(0x7f07dc0fd8c0 msgr2=0x7f07dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:43.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.538+0000 7f07e16be640 1 -- 172.21.15.27:0/2124268869 shutdown_connections 2024-09-19T08:13:43.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.538+0000 7f07e16be640 1 -- 172.21.15.27:0/2124268869 wait complete. 2024-09-19T08:13:43.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.539+0000 7f07e16be640 1 Processor -- start 2024-09-19T08:13:43.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.539+0000 7f07e16be640 1 -- start start 2024-09-19T08:13:43.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.539+0000 7f07e16be640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07dc101de0 0x7f07dc1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:43.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.539+0000 7f07e16be640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07dc102790 0x7f07dc198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:43.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.539+0000 7f07e16be640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07dc106f10 0x7f07dc19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:43.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.539+0000 7f07e16be640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc111f70 con 0x7f07dc102790 2024-09-19T08:13:43.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.539+0000 7f07e16be640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc111df0 con 0x7f07dc106f10 2024-09-19T08:13:43.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.539+0000 7f07e16be640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc1120f0 con 0x7f07dc101de0 2024-09-19T08:13:43.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.539+0000 7f07da7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07dc102790 0x7f07dc198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:43.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.539+0000 7f07da7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07dc102790 0x7f07dc198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33540/0 (socket says 172.21.15.27:33540) 2024-09-19T08:13:43.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.539+0000 7f07da7fc640 1 -- 172.21.15.27:0/3604364874 learned_addr learned my addr 172.21.15.27:0/3604364874 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:43.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.539+0000 7f07daffd640 1 --2- 172.21.15.27:0/3604364874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07dc101de0 0x7f07dc1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:43.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.539+0000 7f07db7fe640 1 --2- 172.21.15.27:0/3604364874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07dc106f10 0x7f07dc19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:43.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.539+0000 7f07da7fc640 1 -- 172.21.15.27:0/3604364874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07dc101de0 msgr2=0x7f07dc1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:43.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.539+0000 7f07da7fc640 1 --2- 172.21.15.27:0/3604364874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07dc101de0 0x7f07dc1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.539+0000 7f07da7fc640 1 -- 172.21.15.27:0/3604364874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07dc106f10 msgr2=0x7f07dc19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:43.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.539+0000 7f07da7fc640 1 --2- 172.21.15.27:0/3604364874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07dc106f10 0x7f07dc19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.539+0000 7f07da7fc640 1 -- 172.21.15.27:0/3604364874 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07dc19d480 con 0x7f07dc102790 2024-09-19T08:13:43.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.540+0000 7f07da7fc640 1 --2- 172.21.15.27:0/3604364874 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07dc102790 0x7f07dc198a10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f07d000eab0 tx=0x7f07d000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:43.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.540+0000 7f07c3fff640 1 -- 172.21.15.27:0/3604364874 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d000ce40 con 0x7f07dc102790 2024-09-19T08:13:43.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.540+0000 7f07c3fff640 1 -- 172.21.15.27:0/3604364874 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07d0011950 con 0x7f07dc102790 2024-09-19T08:13:43.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.540+0000 7f07e16be640 1 -- 172.21.15.27:0/3604364874 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07dc19d770 con 0x7f07dc102790 2024-09-19T08:13:43.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.540+0000 7f07c3fff640 1 -- 172.21.15.27:0/3604364874 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d0010ae0 con 0x7f07dc102790 2024-09-19T08:13:43.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.540+0000 7f07e16be640 1 -- 172.21.15.27:0/3604364874 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07dc1a5050 con 0x7f07dc102790 2024-09-19T08:13:43.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.543+0000 7f07c3fff640 1 -- 172.21.15.27:0/3604364874 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f07d0011b00 con 0x7f07dc102790 2024-09-19T08:13:43.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.543+0000 7f07e3a97740 1 Processor -- start 2024-09-19T08:13:43.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.543+0000 7f07e3a97740 1 -- start start 2024-09-19T08:13:43.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.543+0000 7f07e3a97740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad1e3a0 0x55c7dad1e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:43.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.543+0000 7f07e3a97740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad1ecc0 0x55c7dad2d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:43.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.543+0000 7f07e3a97740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad2da90 0x55c7dad2fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:43.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.543+0000 7f07e3a97740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c7dac842e0 con 0x55c7dad2da90 2024-09-19T08:13:43.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.543+0000 7f07e3a97740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c7dac2bce0 con 0x55c7dad1e3a0 2024-09-19T08:13:43.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.543+0000 7f07e3a97740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c7dac802a0 con 0x55c7dad1ecc0 2024-09-19T08:13:43.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.543+0000 7f07da7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad2da90 0x55c7dad2fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:43.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.543+0000 7f07da7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad2da90 0x55c7dad2fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33544/0 (socket says 172.21.15.27:33544) 2024-09-19T08:13:43.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.544+0000 7f07da7fc640 1 -- 172.21.15.27:0/2892969523 learned_addr learned my addr 172.21.15.27:0/2892969523 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:43.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.544+0000 7f07db7fe640 1 --2- 172.21.15.27:0/2892969523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad1e3a0 0x55c7dad1e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:43.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.544+0000 7f07daffd640 1 --2- 172.21.15.27:0/2892969523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad1ecc0 0x55c7dad2d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:43.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.544+0000 7f07da7fc640 1 -- 172.21.15.27:0/2892969523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad1ecc0 msgr2=0x55c7dad2d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:43.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.544+0000 7f07da7fc640 1 --2- 172.21.15.27:0/2892969523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad1ecc0 0x55c7dad2d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.544+0000 7f07da7fc640 1 -- 172.21.15.27:0/2892969523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad1e3a0 msgr2=0x55c7dad1e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:43.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.544+0000 7f07da7fc640 1 --2- 172.21.15.27:0/2892969523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad1e3a0 0x55c7dad1e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.544+0000 7f07da7fc640 1 -- 172.21.15.27:0/2892969523 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7dac10440 con 0x55c7dad2da90 2024-09-19T08:13:43.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.544+0000 7f07c3fff640 1 --2- 172.21.15.27:0/3604364874 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f07c40a33b0 0x7f07c40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:43.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.544+0000 7f07db7fe640 1 --2- 172.21.15.27:0/3604364874 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f07c40a33b0 0x7f07c40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:43.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.544+0000 7f07c3fff640 1 -- 172.21.15.27:0/3604364874 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f07d00d0310 con 0x7f07dc102790 2024-09-19T08:13:43.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.544+0000 7f07da7fc640 1 --2- 172.21.15.27:0/2892969523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad2da90 0x55c7dad2fe80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f07d00cda20 tx=0x7f07d00d85e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f58c70abd84ee75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:43.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.544+0000 7f07c17fa640 1 -- 172.21.15.27:0/2892969523 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d00988e0 con 0x55c7dad2da90 2024-09-19T08:13:43.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.544+0000 7f07c17fa640 1 -- 172.21.15.27:0/2892969523 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07d009cd40 con 0x55c7dad2da90 2024-09-19T08:13:43.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.544+0000 7f07c17fa640 1 -- 172.21.15.27:0/2892969523 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d00988e0 con 0x55c7dad2da90 2024-09-19T08:13:43.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.545+0000 7f07e3a97740 1 -- 172.21.15.27:0/2892969523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad2da90 msgr2=0x55c7dad2fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:43.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.545+0000 7f07db7fe640 1 --2- 172.21.15.27:0/3604364874 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f07c40a33b0 0x7f07c40a5870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f07d4005fd0 tx=0x7f07d4005cc0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:43.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.545+0000 7f07e3a97740 1 --2- 172.21.15.27:0/2892969523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad2da90 0x55c7dad2fe80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f07d00cda20 tx=0x7f07d00d85e0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.545+0000 7f07e3a97740 1 -- 172.21.15.27:0/2892969523 shutdown_connections 2024-09-19T08:13:43.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.545+0000 7f07e3a97740 1 --2- 172.21.15.27:0/2892969523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad2da90 0x55c7dad2fe80 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.545+0000 7f07e3a97740 1 --2- 172.21.15.27:0/2892969523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad1ecc0 0x55c7dad2d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.545+0000 7f07e3a97740 1 --2- 172.21.15.27:0/2892969523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad1e3a0 0x55c7dad1e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.545+0000 7f07e3a97740 1 -- 172.21.15.27:0/2892969523 >> 172.21.15.27:0/2892969523 conn(0x55c7dad1aa30 msgr2=0x55c7dad1ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:43.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.545+0000 7f07e3a97740 1 -- 172.21.15.27:0/2892969523 shutdown_connections 2024-09-19T08:13:43.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.545+0000 7f07e3a97740 1 -- 172.21.15.27:0/2892969523 wait complete. 2024-09-19T08:13:43.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.545+0000 7f07e3a97740 1 -- start start 2024-09-19T08:13:43.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.546+0000 7f07e3a97740 1 Processor -- start 2024-09-19T08:13:43.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.546+0000 7f07e3a97740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad1e3a0 0x55c7dad2d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:43.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.546+0000 7f07e3a97740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad1ecc0 0x55c7dad2a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:43.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.546+0000 7f07e3a97740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad2da90 0x55c7dad2ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:43.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.546+0000 7f07e3a97740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c7dad306c0 con 0x55c7dad1ecc0 2024-09-19T08:13:43.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.546+0000 7f07e3a97740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c7dac3f050 con 0x55c7dad1e3a0 2024-09-19T08:13:43.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.546+0000 7f07e3a97740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c7dad30840 con 0x55c7dad2da90 2024-09-19T08:13:43.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.546+0000 7f07e3a97740 10 client.0 _ll_register_callbacks cb 0x55c7dac7f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:13:43.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.546+0000 7f07da7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad1ecc0 0x55c7dad2a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:43.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.546+0000 7f07daffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad1e3a0 0x55c7dad2d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:43.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.546+0000 7f07daffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad1e3a0 0x55c7dad2d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.27:57956/0 (socket says 172.21.15.27:57956) 2024-09-19T08:13:43.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.546+0000 7f07daffd640 1 -- 172.21.15.27:0/2636185696 learned_addr learned my addr 172.21.15.27:0/2636185696 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:43.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.546+0000 7f07db7fe640 1 --2- 172.21.15.27:0/2636185696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad2da90 0x55c7dad2ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:43.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.546+0000 7f07da7fc640 1 -- 172.21.15.27:0/2636185696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad2da90 msgr2=0x55c7dad2ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:43.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.546+0000 7f07da7fc640 1 --2- 172.21.15.27:0/2636185696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad2da90 0x55c7dad2ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.546+0000 7f07da7fc640 1 -- 172.21.15.27:0/2636185696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad1e3a0 msgr2=0x55c7dad2d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:43.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.546+0000 7f07da7fc640 1 --2- 172.21.15.27:0/2636185696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad1e3a0 0x55c7dad2d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.546+0000 7f07da7fc640 1 -- 172.21.15.27:0/2636185696 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7da9f53c0 con 0x55c7dad1ecc0 2024-09-19T08:13:43.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.546+0000 7f07daffd640 1 --2- 172.21.15.27:0/2636185696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad1e3a0 0x55c7dad2d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:13:43.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.547+0000 7f07da7fc640 1 --2- 172.21.15.27:0/2636185696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad1ecc0 0x55c7dad2a730 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f07d000ea80 tx=0x7f07d0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0289594304e1d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:43.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.547+0000 7f07beff5640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:13:43.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.547+0000 7f07beff5640 1 -- 172.21.15.27:0/2636185696 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d00b5060 con 0x55c7dad1ecc0 2024-09-19T08:13:43.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.547+0000 7f07beff5640 1 -- 172.21.15.27:0/2636185696 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f07d009c8a0 con 0x55c7dad1ecc0 2024-09-19T08:13:43.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.547+0000 7f07e3a97740 1 -- 172.21.15.27:0/2636185696 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07d009cd40 con 0x55c7dad1ecc0 2024-09-19T08:13:43.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.547+0000 7f07beff5640 1 -- 172.21.15.27:0/2636185696 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f07d009bfa0 con 0x55c7dad1ecc0 2024-09-19T08:13:43.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.547+0000 7f07e3a97740 10 client.15906 fetch_fsmap learned FSMap version 20 2024-09-19T08:13:43.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.547+0000 7f07e3a97740 1 -- 172.21.15.27:0/2636185696 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c7dad306c0 con 0x55c7dad1ecc0 2024-09-19T08:13:43.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.547+0000 7f07beff5640 1 -- 172.21.15.27:0/2636185696 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07d009cd40 con 0x55c7dad1ecc0 2024-09-19T08:13:43.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.547+0000 7f07beff5640 1 -- 172.21.15.27:0/2636185696 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f07d000f040 con 0x55c7dad1ecc0 2024-09-19T08:13:43.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.547+0000 7f07e3a97740 10 client.15906 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:13:43.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.547+0000 7f07e3a97740 10 client.15906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:13:43.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.547+0000 7f07e3a97740 20 client.15906 populate_metadata read hostname 'smithi027' 2024-09-19T08:13:43.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.547+0000 7f07e3a97740 1 --2- 172.21.15.27:0/2636185696 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c7dad3d2e0 0x55c7dad3f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:43.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.547+0000 7f07e3a97740 4 client.15906 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:13:43.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.547+0000 7f07e3a97740 1 -- 172.21.15.27:0/2636185696 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7dac91850 con 0x55c7dad3d2e0 2024-09-19T08:13:43.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.548+0000 7f07daffd640 1 --2- 172.21.15.27:0/2636185696 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c7dad3d2e0 0x55c7dad3f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:43.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.548+0000 7f07daffd640 1 --2- 172.21.15.27:0/2636185696 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c7dad3d2e0 0x55c7dad3f6d0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b0ad8afbe06cb65 server_cookie=192f508ffde7551c in_seq=0 out_seq=0 2024-09-19T08:13:43.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.548+0000 7f07beff5640 10 client.15906 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:43.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.549+0000 7f07beff5640 1 -- 172.21.15.27:0/2636185696 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c7dac91850 con 0x55c7dad3d2e0 2024-09-19T08:13:43.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.549+0000 7f07beff5640 10 client.15906 handle_command_reply: tid=0 2024-09-19T08:13:43.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.549+0000 7f07e3a97740 1 client.15906 shutdown 2024-09-19T08:13:43.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.549+0000 7f07e3a97740 1 -- 172.21.15.27:0/2636185696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad1ecc0 msgr2=0x55c7dad2a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:43.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.549+0000 7f07e3a97740 1 --2- 172.21.15.27:0/2636185696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad1ecc0 0x55c7dad2a730 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f07d000ea80 tx=0x7f07d0000f40 comp rx=0 tx=0).stop 2024-09-19T08:13:43.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.549+0000 7f07e3a97740 1 -- 172.21.15.27:0/2636185696 shutdown_connections 2024-09-19T08:13:43.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.549+0000 7f07e3a97740 1 --2- 172.21.15.27:0/2636185696 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c7dad3d2e0 0x55c7dad3f6d0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.549+0000 7f07e3a97740 1 --2- 172.21.15.27:0/2636185696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad2da90 0x55c7dad2ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.549+0000 7f07e3a97740 1 --2- 172.21.15.27:0/2636185696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad1ecc0 0x55c7dad2a730 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.549+0000 7f07e3a97740 1 --2- 172.21.15.27:0/2636185696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad1e3a0 0x55c7dad2d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.549+0000 7f07e3a97740 1 -- 172.21.15.27:0/2636185696 >> 172.21.15.27:0/2636185696 conn(0x55c7dad1aa30 msgr2=0x55c7dad20790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:43.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.549+0000 7f07beff5640 0 client.15906 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:43.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.549+0000 7f07e3a97740 1 -- 172.21.15.27:0/2636185696 shutdown_connections 2024-09-19T08:13:43.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.549+0000 7f07e3a97740 1 -- 172.21.15.27:0/2636185696 wait complete. 2024-09-19T08:13:43.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.549+0000 7f07e3a97740 20 client.15906 trim_cache size 0 max 16384 2024-09-19T08:13:43.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.567+0000 7f07e3a97740 1 Processor -- start 2024-09-19T08:13:43.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.567+0000 7f07e3a97740 1 -- start start 2024-09-19T08:13:43.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.567+0000 7f07e3a97740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad1e3a0 0x55c7dad39960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:43.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.567+0000 7f07e3a97740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad1ecc0 0x55c7dad44d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:43.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.567+0000 7f07e3a97740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad2da90 0x55c7dad45270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:43.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.567+0000 7f07e3a97740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc1a9570 con 0x55c7dad1ecc0 2024-09-19T08:13:43.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.567+0000 7f07e3a97740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc1abdf0 con 0x55c7dad2da90 2024-09-19T08:13:43.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.567+0000 7f07e3a97740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc1a9be0 con 0x55c7dad1e3a0 2024-09-19T08:13:43.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.567+0000 7f07da7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad1ecc0 0x55c7dad44d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:43.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.567+0000 7f07da7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad1ecc0 0x55c7dad44d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33556/0 (socket says 172.21.15.27:33556) 2024-09-19T08:13:43.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.567+0000 7f07da7fc640 1 -- 172.21.15.27:0/3513207435 learned_addr learned my addr 172.21.15.27:0/3513207435 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:43.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.567+0000 7f07daffd640 1 --2- 172.21.15.27:0/3513207435 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad1e3a0 0x55c7dad39960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:43.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.567+0000 7f07da7fc640 1 -- 172.21.15.27:0/3513207435 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad1e3a0 msgr2=0x55c7dad39960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:43.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.567+0000 7f07da7fc640 1 --2- 172.21.15.27:0/3513207435 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad1e3a0 0x55c7dad39960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.567+0000 7f07da7fc640 1 -- 172.21.15.27:0/3513207435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad2da90 msgr2=0x55c7dad45270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:43.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.567+0000 7f07db7fe640 1 --2- 172.21.15.27:0/3513207435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad2da90 0x55c7dad45270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:43.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.567+0000 7f07da7fc640 1 --2- 172.21.15.27:0/3513207435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad2da90 0x55c7dad45270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.567+0000 7f07da7fc640 1 -- 172.21.15.27:0/3513207435 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7dad1eaf0 con 0x55c7dad1ecc0 2024-09-19T08:13:43.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.568+0000 7f07da7fc640 1 --2- 172.21.15.27:0/3513207435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad1ecc0 0x55c7dad44d30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f07d00a4d80 tx=0x7f07d00d85e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e7a2856521a417 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:43.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.568+0000 7f07c0ff9640 1 -- 172.21.15.27:0/3513207435 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d00b5040 con 0x55c7dad1ecc0 2024-09-19T08:13:43.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.568+0000 7f07c0ff9640 1 -- 172.21.15.27:0/3513207435 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07d009cd40 con 0x55c7dad1ecc0 2024-09-19T08:13:43.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.568+0000 7f07c0ff9640 1 -- 172.21.15.27:0/3513207435 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d009c180 con 0x55c7dad1ecc0 2024-09-19T08:13:43.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.568+0000 7f07e3a97740 1 -- 172.21.15.27:0/3513207435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad1ecc0 msgr2=0x55c7dad44d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:43.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.568+0000 7f07e3a97740 1 --2- 172.21.15.27:0/3513207435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad1ecc0 0x55c7dad44d30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f07d00a4d80 tx=0x7f07d00d85e0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.568+0000 7f07e3a97740 1 -- 172.21.15.27:0/3513207435 shutdown_connections 2024-09-19T08:13:43.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.568+0000 7f07e3a97740 1 --2- 172.21.15.27:0/3513207435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad2da90 0x55c7dad45270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.568+0000 7f07e3a97740 1 --2- 172.21.15.27:0/3513207435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad1ecc0 0x55c7dad44d30 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.568+0000 7f07e3a97740 1 --2- 172.21.15.27:0/3513207435 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad1e3a0 0x55c7dad39960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.568+0000 7f07e3a97740 1 -- 172.21.15.27:0/3513207435 >> 172.21.15.27:0/3513207435 conn(0x55c7dad1aa30 msgr2=0x55c7dad29820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:43.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.569+0000 7f07e3a97740 1 -- 172.21.15.27:0/3513207435 shutdown_connections 2024-09-19T08:13:43.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.569+0000 7f07e3a97740 1 -- 172.21.15.27:0/3513207435 wait complete. 2024-09-19T08:13:43.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.569+0000 7f07e3a97740 1 -- start start 2024-09-19T08:13:43.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.569+0000 7f07e3a97740 1 Processor -- start 2024-09-19T08:13:43.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.569+0000 7f07e3a97740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad1e3a0 0x55c7dad311e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:43.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.569+0000 7f07e3a97740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad1ecc0 0x55c7dad31720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:43.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.569+0000 7f07e3a97740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad2da90 0x55c7dada5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:43.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.569+0000 7f07e3a97740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc1aa2b0 con 0x55c7dad2da90 2024-09-19T08:13:43.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.569+0000 7f07e3a97740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc1ab720 con 0x55c7dad1e3a0 2024-09-19T08:13:43.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.569+0000 7f07e3a97740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc1aa980 con 0x55c7dad1ecc0 2024-09-19T08:13:43.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.569+0000 7f07e3a97740 10 client.0 _ll_register_callbacks cb 0x7f07d4004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:13:43.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.569+0000 7f07db7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad2da90 0x55c7dada5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.569+0000 7f07db7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad2da90 0x55c7dada5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33558/0 (socket says 172.21.15.27:33558) 2024-09-19T08:13:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.569+0000 7f07db7fe640 1 -- 172.21.15.27:0/1753031018 learned_addr learned my addr 172.21.15.27:0/1753031018 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:13:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.569+0000 7f07daffd640 1 --2- 172.21.15.27:0/1753031018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad1e3a0 0x55c7dad311e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.570+0000 7f07da7fc640 1 --2- 172.21.15.27:0/1753031018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad1ecc0 0x55c7dad31720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.570+0000 7f07db7fe640 1 -- 172.21.15.27:0/1753031018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad1ecc0 msgr2=0x55c7dad31720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.570+0000 7f07db7fe640 1 --2- 172.21.15.27:0/1753031018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad1ecc0 0x55c7dad31720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.570+0000 7f07db7fe640 1 -- 172.21.15.27:0/1753031018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad1e3a0 msgr2=0x55c7dad311e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:13:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.570+0000 7f07db7fe640 1 --2- 172.21.15.27:0/1753031018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad1e3a0 0x55c7dad311e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.570+0000 7f07db7fe640 1 -- 172.21.15.27:0/1753031018 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7dada62b0 con 0x55c7dad2da90 2024-09-19T08:13:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.570+0000 7f07da7fc640 1 --2- 172.21.15.27:0/1753031018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad1ecc0 0x55c7dad31720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:13:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.570+0000 7f07db7fe640 1 --2- 172.21.15.27:0/1753031018 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad2da90 0x55c7dada5cf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f07d4003d20 tx=0x7f07d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1481838733beb25b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:13:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.570+0000 7f07beff5640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:13:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.570+0000 7f07beff5640 1 -- 172.21.15.27:0/1753031018 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d402d060 con 0x55c7dad2da90 2024-09-19T08:13:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.570+0000 7f07beff5640 1 -- 172.21.15.27:0/1753031018 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f07d4028430 con 0x55c7dad2da90 2024-09-19T08:13:43.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.570+0000 7f07e3a97740 1 -- 172.21.15.27:0/1753031018 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07d009cd40 con 0x55c7dad2da90 2024-09-19T08:13:43.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.570+0000 7f07beff5640 1 -- 172.21.15.27:0/1753031018 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f07d4028630 con 0x55c7dad2da90 2024-09-19T08:13:43.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.570+0000 7f07e3a97740 10 client.15912 fetch_fsmap learned FSMap version 20 2024-09-19T08:13:43.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.570+0000 7f07e3a97740 1 -- 172.21.15.27:0/1753031018 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c7dada7590 con 0x55c7dad2da90 2024-09-19T08:13:43.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.570+0000 7f07beff5640 1 -- 172.21.15.27:0/1753031018 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07d009cd40 con 0x55c7dad2da90 2024-09-19T08:13:43.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.571+0000 7f07beff5640 1 -- 172.21.15.27:0/1753031018 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f07d4027070 con 0x55c7dad2da90 2024-09-19T08:13:43.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.571+0000 7f07e3a97740 10 client.15912 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:13:43.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.571+0000 7f07e3a97740 10 client.15912 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:13:43.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.571+0000 7f07e3a97740 20 client.15912 populate_metadata read hostname 'smithi027' 2024-09-19T08:13:43.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.571+0000 7f07e3a97740 1 --2- 172.21.15.27:0/1753031018 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c7dada7cb0 0x55c7dadaa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:13:43.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.571+0000 7f07e3a97740 4 client.15912 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:13:43.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.571+0000 7f07e3a97740 1 -- 172.21.15.27:0/1753031018 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c7dac8bd60 con 0x55c7dada7cb0 2024-09-19T08:13:43.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.571+0000 7f07daffd640 1 --2- 172.21.15.27:0/1753031018 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c7dada7cb0 0x55c7dadaa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:13:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.571+0000 7f07daffd640 1 --2- 172.21.15.27:0/1753031018 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c7dada7cb0 0x55c7dadaa0d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3a58b6204312bf9 server_cookie=7d8f808cba4518cc in_seq=0 out_seq=0 2024-09-19T08:13:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.571+0000 7f07beff5640 10 client.15912 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.572+0000 7f07beff5640 1 -- 172.21.15.27:0/1753031018 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55c7dac8bd60 con 0x55c7dada7cb0 2024-09-19T08:13:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.572+0000 7f07beff5640 10 client.15912 handle_command_reply: tid=0 2024-09-19T08:13:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.572+0000 7f07e3a97740 1 client.15912 shutdown 2024-09-19T08:13:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.572+0000 7f07e3a97740 1 -- 172.21.15.27:0/1753031018 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad2da90 msgr2=0x55c7dada5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.572+0000 7f07e3a97740 1 --2- 172.21.15.27:0/1753031018 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad2da90 0x55c7dada5cf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f07d4003d20 tx=0x7f07d4004730 comp rx=0 tx=0).stop 2024-09-19T08:13:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.572+0000 7f07e3a97740 1 -- 172.21.15.27:0/1753031018 shutdown_connections 2024-09-19T08:13:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.572+0000 7f07e3a97740 1 --2- 172.21.15.27:0/1753031018 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7dad2da90 0x55c7dada5cf0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.572+0000 7f07e3a97740 1 --2- 172.21.15.27:0/1753031018 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c7dada7cb0 0x55c7dadaa0d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.572+0000 7f07e3a97740 1 --2- 172.21.15.27:0/1753031018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c7dad1ecc0 0x55c7dad31720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.572+0000 7f07e3a97740 1 --2- 172.21.15.27:0/1753031018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7dad1e3a0 0x55c7dad311e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.572+0000 7f07e3a97740 1 -- 172.21.15.27:0/1753031018 >> 172.21.15.27:0/1753031018 conn(0x55c7dad1aa30 msgr2=0x55c7dad2bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:43.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.572+0000 7f07beff5640 0 client.15912 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:13:43.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.572+0000 7f07e3a97740 1 -- 172.21.15.27:0/1753031018 shutdown_connections 2024-09-19T08:13:43.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.572+0000 7f07e3a97740 1 -- 172.21.15.27:0/1753031018 wait complete. 2024-09-19T08:13:43.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.572+0000 7f07e3a97740 20 client.15912 trim_cache size 0 max 16384 2024-09-19T08:13:43.577 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:13:43.577 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:13:43.577 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": { 2024-09-19T08:13:43.577 INFO:teuthology.orchestra.run.smithi027.stdout: "17a2105a-6c33-47f8-babf-be2fa625233c": { 2024-09-19T08:13:43.577 INFO:teuthology.orchestra.run.smithi027.stdout: "path": "/", 2024-09-19T08:13:43.577 INFO:teuthology.orchestra.run.smithi027.stdout: "tag": "17a2105a-6c33-47f8-babf-be2fa625233c", 2024-09-19T08:13:43.578 INFO:teuthology.orchestra.run.smithi027.stdout: "options": "recursive,force" 2024-09-19T08:13:43.578 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:13:43.578 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:13:43.578 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:13:43.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.572+0000 7f07e16be640 1 -- 172.21.15.27:0/3604364874 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f07c40a33b0 msgr2=0x7f07c40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:43.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.572+0000 7f07e16be640 1 --2- 172.21.15.27:0/3604364874 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f07c40a33b0 0x7f07c40a5870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f07d4005fd0 tx=0x7f07d4005cc0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.572+0000 7f07e16be640 1 -- 172.21.15.27:0/3604364874 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07dc102790 msgr2=0x7f07dc198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:13:43.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.572+0000 7f07e16be640 1 --2- 172.21.15.27:0/3604364874 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07dc102790 0x7f07dc198a10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f07d000eab0 tx=0x7f07d000ef70 comp rx=0 tx=0).stop 2024-09-19T08:13:43.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.573+0000 7f07e16be640 1 -- 172.21.15.27:0/3604364874 shutdown_connections 2024-09-19T08:13:43.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.573+0000 7f07e16be640 1 --2- 172.21.15.27:0/3604364874 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f07c40a33b0 0x7f07c40a5870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.573+0000 7f07e16be640 1 --2- 172.21.15.27:0/3604364874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07dc106f10 0x7f07dc19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.573+0000 7f07e16be640 1 --2- 172.21.15.27:0/3604364874 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07dc102790 0x7f07dc198a10 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.573+0000 7f07e16be640 1 --2- 172.21.15.27:0/3604364874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07dc101de0 0x7f07dc1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:13:43.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.573+0000 7f07e16be640 1 -- 172.21.15.27:0/3604364874 >> 172.21.15.27:0/3604364874 conn(0x7f07dc0fd8c0 msgr2=0x7f07dc0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:13:43.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.573+0000 7f07e16be640 1 -- 172.21.15.27:0/3604364874 shutdown_connections 2024-09-19T08:13:43.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:13:43.573+0000 7f07e16be640 1 -- 172.21.15.27:0/3604364874 wait complete. 2024-09-19T08:13:44.280 INFO:tasks.cephfs.filesystem:scrub status for tag:17a2105a-6c33-47f8-babf-be2fa625233c - {'path': '/', 'tag': '17a2105a-6c33-47f8-babf-be2fa625233c', 'options': 'recursive,force'} 2024-09-19T08:13:44.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:44 smithi027 ceph-mon[31209]: pgmap v84: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 19 KiB/s wr, 33 op/s 2024-09-19T08:13:44.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:44 smithi155 ceph-mon[35362]: pgmap v84: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 19 KiB/s wr, 33 op/s 2024-09-19T08:13:44.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:44 smithi203 ceph-mon[35198]: pgmap v84: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 19 KiB/s wr, 33 op/s 2024-09-19T08:13:45.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:45 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:13:45.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:45 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:13:45.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:45 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:13:46.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:46 smithi155 ceph-mon[35362]: pgmap v85: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:13:46.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:46 smithi027 ceph-mon[31209]: pgmap v85: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:13:46.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:46 smithi203 ceph-mon[35198]: pgmap v85: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:13:48.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:48 smithi155 ceph-mon[35362]: pgmap v86: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:13:48.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:48 smithi027 ceph-mon[31209]: pgmap v86: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:13:48.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:48 smithi203 ceph-mon[35198]: pgmap v86: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:13:50.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:50 smithi155 ceph-mon[35362]: pgmap v87: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:13:50.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:50 smithi027 ceph-mon[31209]: pgmap v87: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:13:50.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:50 smithi203 ceph-mon[35198]: pgmap v87: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:13:52.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:52 smithi155 ceph-mon[35362]: pgmap v88: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:13:52.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:52 smithi027 ceph-mon[31209]: pgmap v88: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:13:52.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:52 smithi203 ceph-mon[35198]: pgmap v88: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:13:54.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:54 smithi155 ceph-mon[35362]: pgmap v89: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:13:54.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:54 smithi027 ceph-mon[31209]: pgmap v89: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:13:54.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:54 smithi203 ceph-mon[35198]: pgmap v89: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:13:56.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:56 smithi155 ceph-mon[35362]: pgmap v90: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:13:56.751 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:56 smithi027 ceph-mon[31209]: pgmap v90: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:13:56.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:56 smithi203 ceph-mon[35198]: pgmap v90: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:13:58.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:13:58 smithi155 ceph-mon[35362]: pgmap v91: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:13:58.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:13:58 smithi027 ceph-mon[31209]: pgmap v91: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:13:58.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:13:58 smithi203 ceph-mon[35198]: pgmap v91: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:14:00.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:00 smithi155 ceph-mon[35362]: pgmap v92: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-19T08:14:00.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:00 smithi027 ceph-mon[31209]: pgmap v92: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-19T08:14:00.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:00 smithi203 ceph-mon[35198]: pgmap v92: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-19T08:14:02.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:02 smithi155 ceph-mon[35362]: pgmap v93: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:14:02.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:02 smithi027 ceph-mon[31209]: pgmap v93: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:14:02.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:02 smithi203 ceph-mon[35198]: pgmap v93: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:14:04.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:04 smithi155 ceph-mon[35362]: pgmap v94: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:14:04.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:04 smithi027 ceph-mon[31209]: pgmap v94: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:14:04.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:04 smithi203 ceph-mon[35198]: pgmap v94: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:14:06.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:06 smithi155 ceph-mon[35362]: pgmap v95: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:14:06.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:06 smithi027 ceph-mon[31209]: pgmap v95: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:14:06.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:06 smithi203 ceph-mon[35198]: pgmap v95: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:14:08.737 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:08 smithi155 ceph-mon[35362]: pgmap v96: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:14:08.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:08 smithi027 ceph-mon[31209]: pgmap v96: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:14:08.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:08 smithi203 ceph-mon[35198]: pgmap v96: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:14:10.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:10 smithi027 ceph-mon[31209]: pgmap v97: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:14:10.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:10 smithi203 ceph-mon[35198]: pgmap v97: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:14:10.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:10 smithi155 ceph-mon[35362]: pgmap v97: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:14:11.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:11 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:14:11.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:11 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:14:11.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:11 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:14:11.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:11 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:14:11.757 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:11 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:14:11.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:11 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:14:11.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:11 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:14:11.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:11 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:14:11.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:11 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:14:11.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:11 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:14:11.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:11 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:14:11.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:11 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:14:12.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:12 smithi027 ceph-mon[31209]: pgmap v98: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:14:12.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:12 smithi203 ceph-mon[35198]: pgmap v98: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:14:12.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:12 smithi155 ceph-mon[35362]: pgmap v98: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:14:14.281 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:14:14.555 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:14:14.677 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:14 smithi027 ceph-mon[31209]: pgmap v99: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:14:14.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:14 smithi203 ceph-mon[35198]: pgmap v99: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:14:14.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:14 smithi155 ceph-mon[35362]: pgmap v99: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:14:15.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.056+0000 7f682f6a2640 1 -- 172.21.15.27:0/1983011644 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6828100e30 msgr2=0x7f6828104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:15.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.056+0000 7f682f6a2640 1 --2- 172.21.15.27:0/1983011644 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6828100e30 0x7f6828104e80 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f681800aa10 tx=0x7f681802b720 comp rx=0 tx=0).stop 2024-09-19T08:14:15.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.056+0000 7f682f6a2640 1 -- 172.21.15.27:0/1983011644 shutdown_connections 2024-09-19T08:14:15.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.056+0000 7f682f6a2640 1 --2- 172.21.15.27:0/1983011644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68281055b0 0x7f682810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.056+0000 7f682f6a2640 1 --2- 172.21.15.27:0/1983011644 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6828100e30 0x7f6828104e80 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.056+0000 7f682f6a2640 1 --2- 172.21.15.27:0/1983011644 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6828100480 0x7f6828100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.056+0000 7f682f6a2640 1 -- 172.21.15.27:0/1983011644 >> 172.21.15.27:0/1983011644 conn(0x7f6828077210 msgr2=0x7f68280fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:15.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.056+0000 7f682f6a2640 1 -- 172.21.15.27:0/1983011644 shutdown_connections 2024-09-19T08:14:15.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.056+0000 7f682f6a2640 1 -- 172.21.15.27:0/1983011644 wait complete. 2024-09-19T08:14:15.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.057+0000 7f682f6a2640 1 Processor -- start 2024-09-19T08:14:15.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.057+0000 7f682f6a2640 1 -- start start 2024-09-19T08:14:15.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.057+0000 7f682f6a2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6828100480 0x7f68281983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:15.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.057+0000 7f682f6a2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6828100e30 0x7f6828198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:15.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.057+0000 7f682f6a2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68281055b0 0x7f682819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:15.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.057+0000 7f682f6a2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f682810fde0 con 0x7f6828100480 2024-09-19T08:14:15.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.057+0000 7f682f6a2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f682810fc60 con 0x7f6828100e30 2024-09-19T08:14:15.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.057+0000 7f682f6a2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f682810ff60 con 0x7f68281055b0 2024-09-19T08:14:15.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.057+0000 7f682d43e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6828100480 0x7f68281983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:15.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.057+0000 7f682d43e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6828100480 0x7f68281983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33498/0 (socket says 172.21.15.27:33498) 2024-09-19T08:14:15.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.058+0000 7f682d43e640 1 -- 172.21.15.27:0/1287853127 learned_addr learned my addr 172.21.15.27:0/1287853127 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:15.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.058+0000 7f682cc3d640 1 --2- 172.21.15.27:0/1287853127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6828100e30 0x7f6828198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:15.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.058+0000 7f682dc3f640 1 --2- 172.21.15.27:0/1287853127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68281055b0 0x7f682819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:15.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.058+0000 7f682d43e640 1 -- 172.21.15.27:0/1287853127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68281055b0 msgr2=0x7f682819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:15.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.058+0000 7f682d43e640 1 --2- 172.21.15.27:0/1287853127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68281055b0 0x7f682819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.058+0000 7f682d43e640 1 -- 172.21.15.27:0/1287853127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6828100e30 msgr2=0x7f6828198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:15.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.058+0000 7f682d43e640 1 --2- 172.21.15.27:0/1287853127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6828100e30 0x7f6828198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.058+0000 7f682d43e640 1 -- 172.21.15.27:0/1287853127 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682819d380 con 0x7f6828100480 2024-09-19T08:14:15.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.058+0000 7f682cc3d640 1 --2- 172.21.15.27:0/1287853127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6828100e30 0x7f6828198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:14:15.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.058+0000 7f682dc3f640 1 --2- 172.21.15.27:0/1287853127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68281055b0 0x7f682819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:14:15.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.058+0000 7f682d43e640 1 --2- 172.21.15.27:0/1287853127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6828100480 0x7f68281983d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f682400d950 tx=0x7f682400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:15.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.058+0000 7f681e7fc640 1 -- 172.21.15.27:0/1287853127 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6824017070 con 0x7f6828100480 2024-09-19T08:14:15.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.058+0000 7f681e7fc640 1 -- 172.21.15.27:0/1287853127 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6824009c30 con 0x7f6828100480 2024-09-19T08:14:15.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.058+0000 7f682f6a2640 1 -- 172.21.15.27:0/1287853127 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f682819d670 con 0x7f6828100480 2024-09-19T08:14:15.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.058+0000 7f681e7fc640 1 -- 172.21.15.27:0/1287853127 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682400f6b0 con 0x7f6828100480 2024-09-19T08:14:15.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.058+0000 7f682f6a2640 1 -- 172.21.15.27:0/1287853127 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68281a4f50 con 0x7f6828100480 2024-09-19T08:14:15.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.061+0000 7f681e7fc640 1 -- 172.21.15.27:0/1287853127 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f68240109d0 con 0x7f6828100480 2024-09-19T08:14:15.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.061+0000 7f6831a7b740 1 Processor -- start 2024-09-19T08:14:15.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.061+0000 7f6831a7b740 1 -- start start 2024-09-19T08:14:15.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.061+0000 7f6831a7b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773c4a0 0x55680773c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:15.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.061+0000 7f6831a7b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55680773cdc0 0x556807747140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:15.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.061+0000 7f6831a7b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556807747680 0x556807749a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:15.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.061+0000 7f6831a7b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5568076a22e0 con 0x55680773c4a0 2024-09-19T08:14:15.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.061+0000 7f6831a7b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x556807649ce0 con 0x556807747680 2024-09-19T08:14:15.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.061+0000 7f6831a7b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55680769e2a0 con 0x55680773cdc0 2024-09-19T08:14:15.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.061+0000 7f682dc3f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773c4a0 0x55680773c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:15.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.061+0000 7f682dc3f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773c4a0 0x55680773c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33510/0 (socket says 172.21.15.27:33510) 2024-09-19T08:14:15.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.061+0000 7f682dc3f640 1 -- 172.21.15.27:0/3269121615 learned_addr learned my addr 172.21.15.27:0/3269121615 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:15.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.062+0000 7f682d43e640 1 --2- 172.21.15.27:0/3269121615 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55680773cdc0 0x556807747140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:15.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.062+0000 7f681e7fc640 1 --2- 172.21.15.27:0/1287853127 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f68140a33b0 0x7f68140a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:15.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.062+0000 7f682cc3d640 1 --2- 172.21.15.27:0/3269121615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556807747680 0x556807749a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:15.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.062+0000 7f682dc3f640 1 -- 172.21.15.27:0/3269121615 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55680773cdc0 msgr2=0x556807747140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:15.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.062+0000 7f682dc3f640 1 --2- 172.21.15.27:0/3269121615 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55680773cdc0 0x556807747140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.062+0000 7f682dc3f640 1 -- 172.21.15.27:0/3269121615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556807747680 msgr2=0x556807749a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:15.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.062+0000 7f682dc3f640 1 --2- 172.21.15.27:0/3269121615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556807747680 0x556807749a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.062+0000 7f682dc3f640 1 -- 172.21.15.27:0/3269121615 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55680762e440 con 0x55680773c4a0 2024-09-19T08:14:15.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.062+0000 7f682cc3d640 1 --2- 172.21.15.27:0/3269121615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556807747680 0x556807749a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:14:15.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.062+0000 7f681e7fc640 1 -- 172.21.15.27:0/1287853127 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f68240cf9d0 con 0x7f6828100480 2024-09-19T08:14:15.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.062+0000 7f682dc3f640 1 --2- 172.21.15.27:0/1287853127 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f68140a33b0 0x7f68140a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:15.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.062+0000 7f682dc3f640 1 --2- 172.21.15.27:0/3269121615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773c4a0 0x55680773c880 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6820008de0 tx=0x7f682000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433d0d4bad760e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:15.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.062+0000 7f68137fe640 1 -- 172.21.15.27:0/3269121615 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682001f070 con 0x55680773c4a0 2024-09-19T08:14:15.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.062+0000 7f68137fe640 1 -- 172.21.15.27:0/3269121615 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f682000fbd0 con 0x55680773c4a0 2024-09-19T08:14:15.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.062+0000 7f68137fe640 1 -- 172.21.15.27:0/3269121615 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682000e7f0 con 0x55680773c4a0 2024-09-19T08:14:15.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.063+0000 7f6831a7b740 1 -- 172.21.15.27:0/3269121615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773c4a0 msgr2=0x55680773c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:15.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.063+0000 7f682dc3f640 1 --2- 172.21.15.27:0/1287853127 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f68140a33b0 0x7f68140a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f682001c000 tx=0x7f682000ef70 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:15.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.063+0000 7f6831a7b740 1 --2- 172.21.15.27:0/3269121615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773c4a0 0x55680773c880 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6820008de0 tx=0x7f682000d710 comp rx=0 tx=0).stop 2024-09-19T08:14:15.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.063+0000 7f6831a7b740 1 -- 172.21.15.27:0/3269121615 shutdown_connections 2024-09-19T08:14:15.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.063+0000 7f6831a7b740 1 --2- 172.21.15.27:0/3269121615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556807747680 0x556807749a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.063+0000 7f6831a7b740 1 --2- 172.21.15.27:0/3269121615 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55680773cdc0 0x556807747140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.063+0000 7f6831a7b740 1 --2- 172.21.15.27:0/3269121615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773c4a0 0x55680773c880 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.063+0000 7f6831a7b740 1 -- 172.21.15.27:0/3269121615 >> 172.21.15.27:0/3269121615 conn(0x556807738a30 msgr2=0x556807738e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:15.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.063+0000 7f6831a7b740 1 -- 172.21.15.27:0/3269121615 shutdown_connections 2024-09-19T08:14:15.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.063+0000 7f6831a7b740 1 -- 172.21.15.27:0/3269121615 wait complete. 2024-09-19T08:14:15.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.063+0000 7f6831a7b740 1 -- start start 2024-09-19T08:14:15.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.063+0000 7f6831a7b740 1 Processor -- start 2024-09-19T08:14:15.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.064+0000 7f6831a7b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55680773c4a0 0x556807746fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:15.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.064+0000 7f6831a7b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773cdc0 0x556807744290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:15.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.064+0000 7f6831a7b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556807747680 0x5568077447f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:15.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.064+0000 7f6831a7b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55680774a250 con 0x55680773cdc0 2024-09-19T08:14:15.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.064+0000 7f6831a7b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55680765d050 con 0x556807747680 2024-09-19T08:14:15.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.064+0000 7f6831a7b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55680774a3d0 con 0x55680773c4a0 2024-09-19T08:14:15.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.064+0000 7f6831a7b740 10 client.0 _ll_register_callbacks cb 0x55680769d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:14:15.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.064+0000 7f682cc3d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773cdc0 0x556807744290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:15.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.064+0000 7f682cc3d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773cdc0 0x556807744290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33512/0 (socket says 172.21.15.27:33512) 2024-09-19T08:14:15.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.064+0000 7f682cc3d640 1 -- 172.21.15.27:0/558961422 learned_addr learned my addr 172.21.15.27:0/558961422 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:15.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.064+0000 7f682dc3f640 1 --2- 172.21.15.27:0/558961422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556807747680 0x5568077447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:15.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.064+0000 7f682d43e640 1 --2- 172.21.15.27:0/558961422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55680773c4a0 0x556807746fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:15.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.064+0000 7f682cc3d640 1 -- 172.21.15.27:0/558961422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55680773c4a0 msgr2=0x556807746fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:15.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.064+0000 7f682cc3d640 1 --2- 172.21.15.27:0/558961422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55680773c4a0 0x556807746fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.064+0000 7f682cc3d640 1 -- 172.21.15.27:0/558961422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556807747680 msgr2=0x5568077447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:15.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.064+0000 7f682cc3d640 1 --2- 172.21.15.27:0/558961422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556807747680 0x5568077447f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.064+0000 7f682cc3d640 1 -- 172.21.15.27:0/558961422 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568074133c0 con 0x55680773cdc0 2024-09-19T08:14:15.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.065+0000 7f682cc3d640 1 --2- 172.21.15.27:0/558961422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773cdc0 0x556807744290 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f681802bc40 tx=0x7f6818005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b342de1f890118ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:15.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.065+0000 7f6810ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:14:15.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.065+0000 7f6810ff9640 1 -- 172.21.15.27:0/558961422 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681803f070 con 0x55680773cdc0 2024-09-19T08:14:15.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.065+0000 7f6810ff9640 1 -- 172.21.15.27:0/558961422 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f68180048c0 con 0x55680773cdc0 2024-09-19T08:14:15.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.065+0000 7f6831a7b740 1 -- 172.21.15.27:0/558961422 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f682000fbd0 con 0x55680773cdc0 2024-09-19T08:14:15.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.065+0000 7f6810ff9640 1 -- 172.21.15.27:0/558961422 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f681804b050 con 0x55680773cdc0 2024-09-19T08:14:15.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.065+0000 7f6831a7b740 10 client.15924 fetch_fsmap learned FSMap version 20 2024-09-19T08:14:15.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.065+0000 7f6831a7b740 1 -- 172.21.15.27:0/558961422 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556807755be0 con 0x55680773cdc0 2024-09-19T08:14:15.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.065+0000 7f6810ff9640 1 -- 172.21.15.27:0/558961422 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f682000fbd0 con 0x55680773cdc0 2024-09-19T08:14:15.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.065+0000 7f6810ff9640 1 -- 172.21.15.27:0/558961422 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f681800b040 con 0x55680773cdc0 2024-09-19T08:14:15.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.065+0000 7f6831a7b740 10 client.15924 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:14:15.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.065+0000 7f6831a7b740 10 client.15924 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:14:15.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.065+0000 7f6831a7b740 20 client.15924 populate_metadata read hostname 'smithi027' 2024-09-19T08:14:15.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.065+0000 7f6831a7b740 1 --2- 172.21.15.27:0/558961422 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556807757040 0x556807759470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:15.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.065+0000 7f6831a7b740 4 client.15924 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:14:15.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.065+0000 7f6831a7b740 1 -- 172.21.15.27:0/558961422 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568076af850 con 0x556807757040 2024-09-19T08:14:15.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.066+0000 7f682d43e640 1 --2- 172.21.15.27:0/558961422 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556807757040 0x556807759470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:15.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.066+0000 7f682d43e640 1 --2- 172.21.15.27:0/558961422 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556807757040 0x556807759470 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23cda4ac94b7cfb server_cookie=b019bfcf949b624e in_seq=0 out_seq=0 2024-09-19T08:14:15.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.066+0000 7f6810ff9640 10 client.15924 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:15.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.067+0000 7f6810ff9640 1 -- 172.21.15.27:0/558961422 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5568076af850 con 0x556807757040 2024-09-19T08:14:15.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.067+0000 7f6810ff9640 10 client.15924 handle_command_reply: tid=0 2024-09-19T08:14:15.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.067+0000 7f6831a7b740 1 client.15924 shutdown 2024-09-19T08:14:15.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.067+0000 7f6831a7b740 1 -- 172.21.15.27:0/558961422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773cdc0 msgr2=0x556807744290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:15.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.067+0000 7f6831a7b740 1 --2- 172.21.15.27:0/558961422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773cdc0 0x556807744290 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f681802bc40 tx=0x7f6818005270 comp rx=0 tx=0).stop 2024-09-19T08:14:15.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.067+0000 7f6831a7b740 1 -- 172.21.15.27:0/558961422 shutdown_connections 2024-09-19T08:14:15.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.067+0000 7f6831a7b740 1 --2- 172.21.15.27:0/558961422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556807747680 0x5568077447f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.067+0000 7f6831a7b740 1 --2- 172.21.15.27:0/558961422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773cdc0 0x556807744290 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.067+0000 7f6831a7b740 1 --2- 172.21.15.27:0/558961422 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556807757040 0x556807759470 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.067+0000 7f6831a7b740 1 --2- 172.21.15.27:0/558961422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55680773c4a0 0x556807746fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.067+0000 7f6810ff9640 0 client.15924 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:15.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.067+0000 7f6831a7b740 1 -- 172.21.15.27:0/558961422 >> 172.21.15.27:0/558961422 conn(0x556807738a30 msgr2=0x55680773e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:15.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.067+0000 7f6831a7b740 1 -- 172.21.15.27:0/558961422 shutdown_connections 2024-09-19T08:14:15.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.067+0000 7f6831a7b740 1 -- 172.21.15.27:0/558961422 wait complete. 2024-09-19T08:14:15.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.067+0000 7f6831a7b740 20 client.15924 trim_cache size 0 max 16384 2024-09-19T08:14:15.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.085+0000 7f6831a7b740 1 Processor -- start 2024-09-19T08:14:15.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.085+0000 7f6831a7b740 1 -- start start 2024-09-19T08:14:15.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.085+0000 7f6831a7b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55680773c4a0 0x5568077534b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:15.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.085+0000 7f6831a7b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55680773cdc0 0x55680774fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:15.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.085+0000 7f6831a7b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556807747680 0x55680774ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:15.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.085+0000 7f6831a7b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f68281ab760 con 0x556807747680 2024-09-19T08:14:15.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.085+0000 7f6831a7b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f68281adfe0 con 0x55680773cdc0 2024-09-19T08:14:15.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.085+0000 7f6831a7b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f68281abdd0 con 0x55680773c4a0 2024-09-19T08:14:15.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.085+0000 7f682dc3f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556807747680 0x55680774ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:15.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.085+0000 7f682dc3f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556807747680 0x55680774ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33518/0 (socket says 172.21.15.27:33518) 2024-09-19T08:14:15.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.085+0000 7f682dc3f640 1 -- 172.21.15.27:0/1688844340 learned_addr learned my addr 172.21.15.27:0/1688844340 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:15.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.085+0000 7f682d43e640 1 --2- 172.21.15.27:0/1688844340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55680773c4a0 0x5568077534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:15.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.085+0000 7f682cc3d640 1 --2- 172.21.15.27:0/1688844340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55680773cdc0 0x55680774fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:15.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.085+0000 7f682dc3f640 1 -- 172.21.15.27:0/1688844340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55680773c4a0 msgr2=0x5568077534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:15.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.085+0000 7f682dc3f640 1 --2- 172.21.15.27:0/1688844340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55680773c4a0 0x5568077534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.085+0000 7f682dc3f640 1 -- 172.21.15.27:0/1688844340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55680773cdc0 msgr2=0x55680774fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:15.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.085+0000 7f682dc3f640 1 --2- 172.21.15.27:0/1688844340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55680773cdc0 0x55680774fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.085+0000 7f682dc3f640 1 -- 172.21.15.27:0/1688844340 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568077427e0 con 0x556807747680 2024-09-19T08:14:15.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.086+0000 7f682dc3f640 1 --2- 172.21.15.27:0/1688844340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556807747680 0x55680774ff40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6820008db0 tx=0x7f6820023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbad0a4e4c4df3e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:15.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.086+0000 7f6812ffd640 1 -- 172.21.15.27:0/1688844340 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6820034070 con 0x556807747680 2024-09-19T08:14:15.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.086+0000 7f6812ffd640 1 -- 172.21.15.27:0/1688844340 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f682000bcc0 con 0x556807747680 2024-09-19T08:14:15.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.086+0000 7f6812ffd640 1 -- 172.21.15.27:0/1688844340 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682001f040 con 0x556807747680 2024-09-19T08:14:15.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.086+0000 7f6831a7b740 1 -- 172.21.15.27:0/1688844340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556807747680 msgr2=0x55680774ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:15.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.086+0000 7f6831a7b740 1 --2- 172.21.15.27:0/1688844340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556807747680 0x55680774ff40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6820008db0 tx=0x7f6820023000 comp rx=0 tx=0).stop 2024-09-19T08:14:15.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.086+0000 7f6831a7b740 1 -- 172.21.15.27:0/1688844340 shutdown_connections 2024-09-19T08:14:15.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.086+0000 7f6831a7b740 1 --2- 172.21.15.27:0/1688844340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556807747680 0x55680774ff40 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.086+0000 7f6831a7b740 1 --2- 172.21.15.27:0/1688844340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55680773cdc0 0x55680774fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.086+0000 7f6831a7b740 1 --2- 172.21.15.27:0/1688844340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55680773c4a0 0x5568077534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.086+0000 7f6831a7b740 1 -- 172.21.15.27:0/1688844340 >> 172.21.15.27:0/1688844340 conn(0x556807738a30 msgr2=0x556807743380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:15.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.086+0000 7f6831a7b740 1 -- 172.21.15.27:0/1688844340 shutdown_connections 2024-09-19T08:14:15.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.087+0000 7f6831a7b740 1 -- 172.21.15.27:0/1688844340 wait complete. 2024-09-19T08:14:15.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.087+0000 7f6831a7b740 1 -- start start 2024-09-19T08:14:15.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.087+0000 7f6831a7b740 1 Processor -- start 2024-09-19T08:14:15.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.087+0000 7f6831a7b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773c4a0 0x5568077b9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:15.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.087+0000 7f6831a7b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55680773cdc0 0x5568077ba3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:15.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.087+0000 7f6831a7b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556807747680 0x5568077c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:15.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.087+0000 7f6831a7b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f68281ac4a0 con 0x55680773c4a0 2024-09-19T08:14:15.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.087+0000 7f6831a7b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f68281ad910 con 0x55680773cdc0 2024-09-19T08:14:15.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.087+0000 7f6831a7b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f68281acb70 con 0x556807747680 2024-09-19T08:14:15.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.087+0000 7f6831a7b740 10 client.0 _ll_register_callbacks cb 0x7f681800a890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:14:15.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.088+0000 7f682d43e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773c4a0 0x5568077b9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:15.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.088+0000 7f682d43e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773c4a0 0x5568077b9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33532/0 (socket says 172.21.15.27:33532) 2024-09-19T08:14:15.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.088+0000 7f682d43e640 1 -- 172.21.15.27:0/181427432 learned_addr learned my addr 172.21.15.27:0/181427432 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:15.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.088+0000 7f682cc3d640 1 --2- 172.21.15.27:0/181427432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55680773cdc0 0x5568077ba3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:15.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.088+0000 7f682dc3f640 1 --2- 172.21.15.27:0/181427432 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556807747680 0x5568077c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:15.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.088+0000 7f682d43e640 1 -- 172.21.15.27:0/181427432 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556807747680 msgr2=0x5568077c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:15.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.088+0000 7f682d43e640 1 --2- 172.21.15.27:0/181427432 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556807747680 0x5568077c4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.088+0000 7f682d43e640 1 -- 172.21.15.27:0/181427432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55680773cdc0 msgr2=0x5568077ba3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:15.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.088+0000 7f682d43e640 1 --2- 172.21.15.27:0/181427432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55680773cdc0 0x5568077ba3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.088+0000 7f682d43e640 1 -- 172.21.15.27:0/181427432 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568077c5290 con 0x55680773c4a0 2024-09-19T08:14:15.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.088+0000 7f682d43e640 1 --2- 172.21.15.27:0/181427432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773c4a0 0x5568077b9eb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6824098160 tx=0x7f6824010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63add702c5481cb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:15.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.088+0000 7f6810ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:14:15.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.088+0000 7f6810ff9640 1 -- 172.21.15.27:0/181427432 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6824020040 con 0x55680773c4a0 2024-09-19T08:14:15.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.088+0000 7f6810ff9640 1 -- 172.21.15.27:0/181427432 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f6824098370 con 0x55680773c4a0 2024-09-19T08:14:15.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.088+0000 7f6831a7b740 1 -- 172.21.15.27:0/181427432 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f682000bcc0 con 0x55680773c4a0 2024-09-19T08:14:15.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.088+0000 7f6810ff9640 1 -- 172.21.15.27:0/181427432 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f68240a00b0 con 0x55680773c4a0 2024-09-19T08:14:15.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.088+0000 7f6831a7b740 10 client.15930 fetch_fsmap learned FSMap version 20 2024-09-19T08:14:15.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.088+0000 7f6831a7b740 1 -- 172.21.15.27:0/181427432 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5568077c6540 con 0x55680773c4a0 2024-09-19T08:14:15.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.089+0000 7f6810ff9640 1 -- 172.21.15.27:0/181427432 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f682000bcc0 con 0x55680773c4a0 2024-09-19T08:14:15.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.089+0000 7f6810ff9640 1 -- 172.21.15.27:0/181427432 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f682409abc0 con 0x55680773c4a0 2024-09-19T08:14:15.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.089+0000 7f6831a7b740 10 client.15930 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:14:15.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.089+0000 7f6831a7b740 10 client.15930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:14:15.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.089+0000 7f6831a7b740 20 client.15930 populate_metadata read hostname 'smithi027' 2024-09-19T08:14:15.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.089+0000 7f6831a7b740 1 --2- 172.21.15.27:0/181427432 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5568077c6c60 0x5568077c9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:15.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.089+0000 7f6831a7b740 4 client.15930 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:14:15.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.089+0000 7f6831a7b740 1 -- 172.21.15.27:0/181427432 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5568076a9d60 con 0x5568077c6c60 2024-09-19T08:14:15.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.089+0000 7f682cc3d640 1 --2- 172.21.15.27:0/181427432 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5568077c6c60 0x5568077c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:15.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.090+0000 7f682cc3d640 1 --2- 172.21.15.27:0/181427432 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5568077c6c60 0x5568077c9050 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb7d00d4a99310ac server_cookie=7f636c44b326a79 in_seq=0 out_seq=0 2024-09-19T08:14:15.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.090+0000 7f6810ff9640 10 client.15930 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:15.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.090+0000 7f6810ff9640 1 -- 172.21.15.27:0/181427432 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5568076a9d60 con 0x5568077c6c60 2024-09-19T08:14:15.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.090+0000 7f6810ff9640 10 client.15930 handle_command_reply: tid=0 2024-09-19T08:14:15.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.090+0000 7f6831a7b740 1 client.15930 shutdown 2024-09-19T08:14:15.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.090+0000 7f6831a7b740 1 -- 172.21.15.27:0/181427432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773c4a0 msgr2=0x5568077b9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:15.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.090+0000 7f6831a7b740 1 --2- 172.21.15.27:0/181427432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773c4a0 0x5568077b9eb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6824098160 tx=0x7f6824010d70 comp rx=0 tx=0).stop 2024-09-19T08:14:15.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.090+0000 7f6831a7b740 1 -- 172.21.15.27:0/181427432 shutdown_connections 2024-09-19T08:14:15.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.090+0000 7f6831a7b740 1 --2- 172.21.15.27:0/181427432 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5568077c6c60 0x5568077c9050 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.090+0000 7f6831a7b740 1 --2- 172.21.15.27:0/181427432 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556807747680 0x5568077c4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.090+0000 7f6831a7b740 1 --2- 172.21.15.27:0/181427432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55680773cdc0 0x5568077ba3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.090+0000 7f6831a7b740 1 --2- 172.21.15.27:0/181427432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55680773c4a0 0x5568077b9eb0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.090+0000 7f6831a7b740 1 -- 172.21.15.27:0/181427432 >> 172.21.15.27:0/181427432 conn(0x556807738a30 msgr2=0x556807745af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:15.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.090+0000 7f6810ff9640 0 client.15930 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:15.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.090+0000 7f6831a7b740 1 -- 172.21.15.27:0/181427432 shutdown_connections 2024-09-19T08:14:15.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.090+0000 7f6831a7b740 1 -- 172.21.15.27:0/181427432 wait complete. 2024-09-19T08:14:15.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.090+0000 7f6831a7b740 20 client.15930 trim_cache size 0 max 16384 2024-09-19T08:14:15.099 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:14:15.099 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:14:15.099 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:14:15.099 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:14:15.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.091+0000 7f682f6a2640 1 -- 172.21.15.27:0/1287853127 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f68140a33b0 msgr2=0x7f68140a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:15.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.091+0000 7f682f6a2640 1 --2- 172.21.15.27:0/1287853127 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f68140a33b0 0x7f68140a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f682001c000 tx=0x7f682000ef70 comp rx=0 tx=0).stop 2024-09-19T08:14:15.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.091+0000 7f682f6a2640 1 -- 172.21.15.27:0/1287853127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6828100480 msgr2=0x7f68281983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:15.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.091+0000 7f682f6a2640 1 --2- 172.21.15.27:0/1287853127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6828100480 0x7f68281983d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f682400d950 tx=0x7f682400de10 comp rx=0 tx=0).stop 2024-09-19T08:14:15.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.091+0000 7f682f6a2640 1 -- 172.21.15.27:0/1287853127 shutdown_connections 2024-09-19T08:14:15.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.091+0000 7f682f6a2640 1 --2- 172.21.15.27:0/1287853127 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f68140a33b0 0x7f68140a5870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.091+0000 7f682f6a2640 1 --2- 172.21.15.27:0/1287853127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68281055b0 0x7f682819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.091+0000 7f682f6a2640 1 --2- 172.21.15.27:0/1287853127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6828100e30 0x7f6828198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.091+0000 7f682f6a2640 1 --2- 172.21.15.27:0/1287853127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6828100480 0x7f68281983d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:15.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.091+0000 7f682f6a2640 1 -- 172.21.15.27:0/1287853127 >> 172.21.15.27:0/1287853127 conn(0x7f6828077210 msgr2=0x7f6828103cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:15.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.091+0000 7f682f6a2640 1 -- 172.21.15.27:0/1287853127 shutdown_connections 2024-09-19T08:14:15.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:15.091+0000 7f682f6a2640 1 -- 172.21.15.27:0/1287853127 wait complete. 2024-09-19T08:14:15.884 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:14:15.884 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:14:16.144 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:14:16.565 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:16 smithi027 ceph-mon[31209]: pgmap v100: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T08:14:16.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.647+0000 7f15e1df9640 1 -- 172.21.15.27:0/1740775351 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc10e4f0 msgr2=0x7f15dc110900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:16.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.647+0000 7f15e1df9640 1 --2- 172.21.15.27:0/1740775351 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc10e4f0 0x7f15dc110900 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009ca0 tx=0x7f15d402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:14:16.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.647+0000 7f15e1df9640 1 -- 172.21.15.27:0/1740775351 shutdown_connections 2024-09-19T08:14:16.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.647+0000 7f15e1df9640 1 --2- 172.21.15.27:0/1740775351 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc10e4f0 0x7f15dc110900 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:16.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.647+0000 7f15e1df9640 1 --2- 172.21.15.27:0/1740775351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15dc101380 0x7f15dc10dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:16.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.647+0000 7f15e1df9640 1 --2- 172.21.15.27:0/1740775351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15dc1009d0 0x7f15dc100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:16.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.647+0000 7f15e1df9640 1 -- 172.21.15.27:0/1740775351 >> 172.21.15.27:0/1740775351 conn(0x7f15dc0fc7d0 msgr2=0x7f15dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:16.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.647+0000 7f15e1df9640 1 -- 172.21.15.27:0/1740775351 shutdown_connections 2024-09-19T08:14:16.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.647+0000 7f15e1df9640 1 -- 172.21.15.27:0/1740775351 wait complete. 2024-09-19T08:14:16.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.647+0000 7f15e1df9640 1 Processor -- start 2024-09-19T08:14:16.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.647+0000 7f15e1df9640 1 -- start start 2024-09-19T08:14:16.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.648+0000 7f15e1df9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc1009d0 0x7f15dc19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:16.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.648+0000 7f15e1df9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15dc101380 0x7f15dc19ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:16.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.648+0000 7f15e1df9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15dc10e4f0 0x7f15dc19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:16.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.648+0000 7f15e1df9640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc114230 con 0x7f15dc1009d0 2024-09-19T08:14:16.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.648+0000 7f15e1df9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc1140b0 con 0x7f15dc101380 2024-09-19T08:14:16.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.648+0000 7f15e1df9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc1143b0 con 0x7f15dc10e4f0 2024-09-19T08:14:16.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.648+0000 7f15db7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc1009d0 0x7f15dc19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:16.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.648+0000 7f15db7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc1009d0 0x7f15dc19a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33548/0 (socket says 172.21.15.27:33548) 2024-09-19T08:14:16.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.648+0000 7f15db7fe640 1 -- 172.21.15.27:0/2963091149 learned_addr learned my addr 172.21.15.27:0/2963091149 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:16.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.648+0000 7f15dbfff640 1 --2- 172.21.15.27:0/2963091149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15dc10e4f0 0x7f15dc19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:16.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.648+0000 7f15daffd640 1 --2- 172.21.15.27:0/2963091149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15dc101380 0x7f15dc19ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:16.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.648+0000 7f15db7fe640 1 -- 172.21.15.27:0/2963091149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15dc10e4f0 msgr2=0x7f15dc19efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:16.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.648+0000 7f15db7fe640 1 --2- 172.21.15.27:0/2963091149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15dc10e4f0 0x7f15dc19efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:16.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.648+0000 7f15db7fe640 1 -- 172.21.15.27:0/2963091149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15dc101380 msgr2=0x7f15dc19ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:16.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.648+0000 7f15db7fe640 1 --2- 172.21.15.27:0/2963091149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15dc101380 0x7f15dc19ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:16.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.648+0000 7f15db7fe640 1 -- 172.21.15.27:0/2963091149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15dc19f680 con 0x7f15dc1009d0 2024-09-19T08:14:16.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.648+0000 7f15daffd640 1 --2- 172.21.15.27:0/2963091149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15dc101380 0x7f15dc19ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:14:16.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.648+0000 7f15db7fe640 1 --2- 172.21.15.27:0/2963091149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc1009d0 0x7f15dc19a6d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00c890 tx=0x7f15cc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:16.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.649+0000 7f15d8ff9640 1 -- 172.21.15.27:0/2963091149 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc004220 con 0x7f15dc1009d0 2024-09-19T08:14:16.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.649+0000 7f15d8ff9640 1 -- 172.21.15.27:0/2963091149 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15cc0043c0 con 0x7f15dc1009d0 2024-09-19T08:14:16.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.649+0000 7f15d8ff9640 1 -- 172.21.15.27:0/2963091149 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc0049e0 con 0x7f15dc1009d0 2024-09-19T08:14:16.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.649+0000 7f15e1df9640 1 -- 172.21.15.27:0/2963091149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15dc19f970 con 0x7f15dc1009d0 2024-09-19T08:14:16.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.649+0000 7f15e1df9640 1 -- 172.21.15.27:0/2963091149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15dc1a7250 con 0x7f15dc1009d0 2024-09-19T08:14:16.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.650+0000 7f15e1df9640 1 -- 172.21.15.27:0/2963091149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15dc100db0 con 0x7f15dc1009d0 2024-09-19T08:14:16.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.651+0000 7f15d8ff9640 1 -- 172.21.15.27:0/2963091149 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f15cc0079b0 con 0x7f15dc1009d0 2024-09-19T08:14:16.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.651+0000 7f15d8ff9640 1 --2- 172.21.15.27:0/2963091149 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f15c40a33b0 0x7f15c40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:16.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.652+0000 7f15daffd640 1 --2- 172.21.15.27:0/2963091149 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f15c40a33b0 0x7f15c40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:16.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.652+0000 7f15d8ff9640 1 -- 172.21.15.27:0/2963091149 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f15cc0cfd30 con 0x7f15dc1009d0 2024-09-19T08:14:16.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.652+0000 7f15daffd640 1 --2- 172.21.15.27:0/2963091149 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f15c40a33b0 0x7f15c40a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f15d0005fd0 tx=0x7f15d0005850 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:16.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.656+0000 7f15d8ff9640 1 -- 172.21.15.27:0/2963091149 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f15cc014030 con 0x7f15dc1009d0 2024-09-19T08:14:16.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:16 smithi203 ceph-mon[35198]: pgmap v100: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T08:14:16.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.869+0000 7f15e1df9640 1 -- 172.21.15.27:0/2963091149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15dc109680 con 0x7f15dc1009d0 2024-09-19T08:14:16.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.870+0000 7f15d8ff9640 1 -- 172.21.15.27:0/2963091149 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f15cc09c760 con 0x7f15dc1009d0 2024-09-19T08:14:16.870 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:14:16.870 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:14:16.870 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:14:16.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.872+0000 7f15e1df9640 1 -- 172.21.15.27:0/2963091149 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f15c40a33b0 msgr2=0x7f15c40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:16.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.872+0000 7f15e1df9640 1 --2- 172.21.15.27:0/2963091149 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f15c40a33b0 0x7f15c40a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f15d0005fd0 tx=0x7f15d0005850 comp rx=0 tx=0).stop 2024-09-19T08:14:16.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.872+0000 7f15e1df9640 1 -- 172.21.15.27:0/2963091149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc1009d0 msgr2=0x7f15dc19a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:16.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.872+0000 7f15e1df9640 1 --2- 172.21.15.27:0/2963091149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc1009d0 0x7f15dc19a6d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00c890 tx=0x7f15cc00cd50 comp rx=0 tx=0).stop 2024-09-19T08:14:16.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.872+0000 7f15e1df9640 1 -- 172.21.15.27:0/2963091149 shutdown_connections 2024-09-19T08:14:16.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.872+0000 7f15e1df9640 1 --2- 172.21.15.27:0/2963091149 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f15c40a33b0 0x7f15c40a5870 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:16.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.872+0000 7f15e1df9640 1 --2- 172.21.15.27:0/2963091149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15dc10e4f0 0x7f15dc19efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:16.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.872+0000 7f15e1df9640 1 --2- 172.21.15.27:0/2963091149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15dc101380 0x7f15dc19ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:16.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.872+0000 7f15e1df9640 1 --2- 172.21.15.27:0/2963091149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc1009d0 0x7f15dc19a6d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:16.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.872+0000 7f15e1df9640 1 -- 172.21.15.27:0/2963091149 >> 172.21.15.27:0/2963091149 conn(0x7f15dc0fc7d0 msgr2=0x7f15dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:16.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.872+0000 7f15e1df9640 1 -- 172.21.15.27:0/2963091149 shutdown_connections 2024-09-19T08:14:16.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:16.872+0000 7f15e1df9640 1 -- 172.21.15.27:0/2963091149 wait complete. 2024-09-19T08:14:16.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:16 smithi155 ceph-mon[35362]: pgmap v100: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T08:14:17.712 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:17 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2963091149' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:14:17.743 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:14:17.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:17 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2963091149' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:14:17.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:17 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2963091149' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:14:18.001 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:14:18.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.485+0000 7f7c600eb640 1 -- 172.21.15.27:0/54897377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c58101de0 msgr2=0x7f7c581021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.485+0000 7f7c600eb640 1 --2- 172.21.15.27:0/54897377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c58101de0 0x7f7c581021c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009900 tx=0x7f7c5002a410 comp rx=0 tx=0).stop 2024-09-19T08:14:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.485+0000 7f7c600eb640 1 -- 172.21.15.27:0/54897377 shutdown_connections 2024-09-19T08:14:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.485+0000 7f7c600eb640 1 --2- 172.21.15.27:0/54897377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c58106f10 0x7f7c5810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.485+0000 7f7c600eb640 1 --2- 172.21.15.27:0/54897377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c58102790 0x7f7c581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.485+0000 7f7c600eb640 1 --2- 172.21.15.27:0/54897377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c58101de0 0x7f7c581021c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.485+0000 7f7c600eb640 1 -- 172.21.15.27:0/54897377 >> 172.21.15.27:0/54897377 conn(0x7f7c580fd8c0 msgr2=0x7f7c580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.485+0000 7f7c600eb640 1 -- 172.21.15.27:0/54897377 shutdown_connections 2024-09-19T08:14:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.485+0000 7f7c600eb640 1 -- 172.21.15.27:0/54897377 wait complete. 2024-09-19T08:14:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.486+0000 7f7c600eb640 1 Processor -- start 2024-09-19T08:14:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.486+0000 7f7c600eb640 1 -- start start 2024-09-19T08:14:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.486+0000 7f7c600eb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c58101de0 0x7f7c58198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:18.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.486+0000 7f7c600eb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c58102790 0x7f7c581989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:18.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.486+0000 7f7c600eb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c58106f10 0x7f7c5819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:18.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.486+0000 7f7c600eb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7c58111f90 con 0x7f7c58106f10 2024-09-19T08:14:18.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.486+0000 7f7c600eb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7c58111e10 con 0x7f7c58102790 2024-09-19T08:14:18.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.486+0000 7f7c600eb640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7c58112110 con 0x7f7c58101de0 2024-09-19T08:14:18.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.486+0000 7f7c5e688640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c58106f10 0x7f7c5819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:18.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.486+0000 7f7c5e688640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c58106f10 0x7f7c5819cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33564/0 (socket says 172.21.15.27:33564) 2024-09-19T08:14:18.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.486+0000 7f7c5e688640 1 -- 172.21.15.27:0/3655264730 learned_addr learned my addr 172.21.15.27:0/3655264730 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:18.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.487+0000 7f7c5d686640 1 --2- 172.21.15.27:0/3655264730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c58102790 0x7f7c581989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:18.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.487+0000 7f7c5de87640 1 --2- 172.21.15.27:0/3655264730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c58101de0 0x7f7c58198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:18.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.487+0000 7f7c5e688640 1 -- 172.21.15.27:0/3655264730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c58101de0 msgr2=0x7f7c58198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:18.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.487+0000 7f7c5e688640 1 --2- 172.21.15.27:0/3655264730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c58101de0 0x7f7c58198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.487+0000 7f7c5e688640 1 -- 172.21.15.27:0/3655264730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c58102790 msgr2=0x7f7c581989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:18.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.487+0000 7f7c5e688640 1 --2- 172.21.15.27:0/3655264730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c58102790 0x7f7c581989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.487+0000 7f7c5e688640 1 -- 172.21.15.27:0/3655264730 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c5819d430 con 0x7f7c58106f10 2024-09-19T08:14:18.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.487+0000 7f7c5e688640 1 --2- 172.21.15.27:0/3655264730 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c58106f10 0x7f7c5819cd50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800b970 tx=0x7f7c4800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:18.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.487+0000 7f7c56ffd640 1 -- 172.21.15.27:0/3655264730 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48019070 con 0x7f7c58106f10 2024-09-19T08:14:18.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.487+0000 7f7c56ffd640 1 -- 172.21.15.27:0/3655264730 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c4800cb40 con 0x7f7c58106f10 2024-09-19T08:14:18.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.487+0000 7f7c600eb640 1 -- 172.21.15.27:0/3655264730 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c5819d720 con 0x7f7c58106f10 2024-09-19T08:14:18.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.487+0000 7f7c56ffd640 1 -- 172.21.15.27:0/3655264730 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48007650 con 0x7f7c58106f10 2024-09-19T08:14:18.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.487+0000 7f7c600eb640 1 -- 172.21.15.27:0/3655264730 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c581a5000 con 0x7f7c58106f10 2024-09-19T08:14:18.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.490+0000 7f7c56ffd640 1 -- 172.21.15.27:0/3655264730 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7c4801c070 con 0x7f7c58106f10 2024-09-19T08:14:18.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.490+0000 7f7c624c4740 1 Processor -- start 2024-09-19T08:14:18.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.490+0000 7f7c624c4740 1 -- start start 2024-09-19T08:14:18.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.490+0000 7f7c624c4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f9f0feb40 0x560f9f0fd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:18.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.490+0000 7f7c624c4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f0fda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:18.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.490+0000 7f7c624c4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f108370 0x560f9f10a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:18.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.490+0000 7f7c624c4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560f9f0632f0 con 0x560f9f0fd5d0 2024-09-19T08:14:18.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.490+0000 7f7c624c4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x560f9f00acf0 con 0x560f9f108370 2024-09-19T08:14:18.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.490+0000 7f7c624c4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560f9f05f2b0 con 0x560f9f0feb40 2024-09-19T08:14:18.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.490+0000 7f7c5de87640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f0fda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:18.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.490+0000 7f7c5de87640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f0fda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33570/0 (socket says 172.21.15.27:33570) 2024-09-19T08:14:18.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.490+0000 7f7c5de87640 1 -- 172.21.15.27:0/2926994689 learned_addr learned my addr 172.21.15.27:0/2926994689 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:18.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.490+0000 7f7c5d686640 1 --2- 172.21.15.27:0/2926994689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f108370 0x560f9f10a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:18.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.491+0000 7f7c5d686640 1 --2- 172.21.15.27:0/2926994689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f9f0feb40 0x560f9f0fd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:18.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.491+0000 7f7c56ffd640 1 --2- 172.21.15.27:0/3655264730 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7c400a33b0 0x7f7c400a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:18.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.491+0000 7f7c5de87640 1 -- 172.21.15.27:0/2926994689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f9f0feb40 msgr2=0x560f9f0fd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:18.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.491+0000 7f7c5de87640 1 --2- 172.21.15.27:0/2926994689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f9f0feb40 0x560f9f0fd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.491+0000 7f7c5de87640 1 -- 172.21.15.27:0/2926994689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f108370 msgr2=0x560f9f10a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:18.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.491+0000 7f7c5de87640 1 --2- 172.21.15.27:0/2926994689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f108370 0x560f9f10a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.491+0000 7f7c5de87640 1 -- 172.21.15.27:0/2926994689 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f9efef3a0 con 0x560f9f0fd5d0 2024-09-19T08:14:18.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.491+0000 7f7c5d686640 1 --2- 172.21.15.27:0/2926994689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f108370 0x560f9f10a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:14:18.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.491+0000 7f7c5e688640 1 --2- 172.21.15.27:0/3655264730 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7c400a33b0 0x7f7c400a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:18.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.491+0000 7f7c56ffd640 1 -- 172.21.15.27:0/3655264730 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f7c480cf080 con 0x7f7c58106f10 2024-09-19T08:14:18.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.491+0000 7f7c5de87640 1 --2- 172.21.15.27:0/2926994689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f0fda10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009900 tx=0x7f7c50031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3a76ef09c681eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:18.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.491+0000 7f7c3ffff640 1 -- 172.21.15.27:0/2926994689 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c50040070 con 0x560f9f0fd5d0 2024-09-19T08:14:18.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.491+0000 7f7c3ffff640 1 -- 172.21.15.27:0/2926994689 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c50005020 con 0x560f9f0fd5d0 2024-09-19T08:14:18.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.491+0000 7f7c3ffff640 1 -- 172.21.15.27:0/2926994689 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c50035040 con 0x560f9f0fd5d0 2024-09-19T08:14:18.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.492+0000 7f7c624c4740 1 -- 172.21.15.27:0/2926994689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 msgr2=0x560f9f0fda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:18.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.492+0000 7f7c5e688640 1 --2- 172.21.15.27:0/3655264730 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7c400a33b0 0x7f7c400a5870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7c480cca80 tx=0x7f7c48004a40 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:18.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.492+0000 7f7c624c4740 1 --2- 172.21.15.27:0/2926994689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f0fda10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009900 tx=0x7f7c50031630 comp rx=0 tx=0).stop 2024-09-19T08:14:18.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.492+0000 7f7c624c4740 1 -- 172.21.15.27:0/2926994689 shutdown_connections 2024-09-19T08:14:18.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.492+0000 7f7c624c4740 1 --2- 172.21.15.27:0/2926994689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f108370 0x560f9f10a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.492+0000 7f7c624c4740 1 --2- 172.21.15.27:0/2926994689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f0fda10 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.492+0000 7f7c624c4740 1 --2- 172.21.15.27:0/2926994689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f9f0feb40 0x560f9f0fd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.492+0000 7f7c624c4740 1 -- 172.21.15.27:0/2926994689 >> 172.21.15.27:0/2926994689 conn(0x560f9f0c6310 msgr2=0x560f9f0f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:18.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.492+0000 7f7c624c4740 1 -- 172.21.15.27:0/2926994689 shutdown_connections 2024-09-19T08:14:18.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.492+0000 7f7c624c4740 1 -- 172.21.15.27:0/2926994689 wait complete. 2024-09-19T08:14:18.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.493+0000 7f7c624c4740 1 -- start start 2024-09-19T08:14:18.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.493+0000 7f7c624c4740 1 Processor -- start 2024-09-19T08:14:18.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.493+0000 7f7c624c4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f107d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:18.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.493+0000 7f7c624c4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f0feb40 0x560f9f104fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:18.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.493+0000 7f7c624c4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f9f108370 0x560f9f105570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:18.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.493+0000 7f7c624c4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560f9f10b010 con 0x560f9f0fd5d0 2024-09-19T08:14:18.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.493+0000 7f7c624c4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x560f9f01e060 con 0x560f9f0feb40 2024-09-19T08:14:18.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.493+0000 7f7c624c4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560f9f10b190 con 0x560f9f108370 2024-09-19T08:14:18.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.493+0000 7f7c624c4740 10 client.0 _ll_register_callbacks cb 0x560f9ed718c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:14:18.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.493+0000 7f7c5d686640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f107d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:18.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.493+0000 7f7c5d686640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f107d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33582/0 (socket says 172.21.15.27:33582) 2024-09-19T08:14:18.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.493+0000 7f7c5d686640 1 -- 172.21.15.27:0/48479001 learned_addr learned my addr 172.21.15.27:0/48479001 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:18.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.493+0000 7f7c5de87640 1 --2- 172.21.15.27:0/48479001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f0feb40 0x560f9f104fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:18.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.493+0000 7f7c5d686640 1 -- 172.21.15.27:0/48479001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f9f108370 msgr2=0x560f9f105570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:18.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.493+0000 7f7c5d686640 1 --2- 172.21.15.27:0/48479001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f9f108370 0x560f9f105570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.494+0000 7f7c5d686640 1 -- 172.21.15.27:0/48479001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f0feb40 msgr2=0x560f9f104fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:18.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.494+0000 7f7c5d686640 1 --2- 172.21.15.27:0/48479001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f0feb40 0x560f9f104fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.494+0000 7f7c5d686640 1 -- 172.21.15.27:0/48479001 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f9edd43c0 con 0x560f9f0fd5d0 2024-09-19T08:14:18.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.494+0000 7f7c5d686640 1 --2- 172.21.15.27:0/48479001 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f107d20 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00be80 tx=0x7f7c4c012aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ad2e4436c03d7e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:18.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.494+0000 7f7c3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:14:18.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.494+0000 7f7c3d7fa640 1 -- 172.21.15.27:0/48479001 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c005220 con 0x560f9f0fd5d0 2024-09-19T08:14:18.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.494+0000 7f7c3d7fa640 1 -- 172.21.15.27:0/48479001 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f7c4c0053c0 con 0x560f9f0fd5d0 2024-09-19T08:14:18.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.494+0000 7f7c624c4740 1 -- 172.21.15.27:0/48479001 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c50005020 con 0x560f9f0fd5d0 2024-09-19T08:14:18.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.494+0000 7f7c3d7fa640 1 -- 172.21.15.27:0/48479001 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7c4c0055c0 con 0x560f9f0fd5d0 2024-09-19T08:14:18.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.494+0000 7f7c624c4740 10 client.15948 fetch_fsmap learned FSMap version 20 2024-09-19T08:14:18.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.494+0000 7f7c624c4740 1 -- 172.21.15.27:0/48479001 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560f9f116ac0 con 0x560f9f0fd5d0 2024-09-19T08:14:18.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.494+0000 7f7c3d7fa640 1 -- 172.21.15.27:0/48479001 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c50005020 con 0x560f9f0fd5d0 2024-09-19T08:14:18.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.494+0000 7f7c3d7fa640 1 -- 172.21.15.27:0/48479001 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7c4c011ba0 con 0x560f9f0fd5d0 2024-09-19T08:14:18.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.494+0000 7f7c624c4740 10 client.15948 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:14:18.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.494+0000 7f7c624c4740 10 client.15948 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:14:18.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.494+0000 7f7c624c4740 20 client.15948 populate_metadata read hostname 'smithi027' 2024-09-19T08:14:18.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.495+0000 7f7c624c4740 1 --2- 172.21.15.27:0/48479001 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560f9f117ed0 0x560f9f11a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:18.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.495+0000 7f7c624c4740 4 client.15948 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:14:18.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.495+0000 7f7c624c4740 1 -- 172.21.15.27:0/48479001 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f9f070860 con 0x560f9f117ed0 2024-09-19T08:14:18.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.495+0000 7f7c5de87640 1 --2- 172.21.15.27:0/48479001 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560f9f117ed0 0x560f9f11a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:18.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.495+0000 7f7c5de87640 1 --2- 172.21.15.27:0/48479001 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560f9f117ed0 0x560f9f11a2c0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b316f54a842acbed server_cookie=48fc08641126ea5e in_seq=0 out_seq=0 2024-09-19T08:14:18.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.495+0000 7f7c3d7fa640 10 client.15948 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:18.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.496+0000 7f7c3d7fa640 1 -- 172.21.15.27:0/48479001 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560f9f070860 con 0x560f9f117ed0 2024-09-19T08:14:18.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.496+0000 7f7c3d7fa640 10 client.15948 handle_command_reply: tid=0 2024-09-19T08:14:18.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.496+0000 7f7c624c4740 1 client.15948 shutdown 2024-09-19T08:14:18.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.496+0000 7f7c624c4740 1 -- 172.21.15.27:0/48479001 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 msgr2=0x560f9f107d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:18.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.496+0000 7f7c624c4740 1 --2- 172.21.15.27:0/48479001 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f107d20 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00be80 tx=0x7f7c4c012aa0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.496+0000 7f7c624c4740 1 -- 172.21.15.27:0/48479001 shutdown_connections 2024-09-19T08:14:18.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.496+0000 7f7c624c4740 1 --2- 172.21.15.27:0/48479001 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560f9f117ed0 0x560f9f11a2c0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.496+0000 7f7c624c4740 1 --2- 172.21.15.27:0/48479001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f9f108370 0x560f9f105570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.496+0000 7f7c624c4740 1 --2- 172.21.15.27:0/48479001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f0feb40 0x560f9f104fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.496+0000 7f7c624c4740 1 --2- 172.21.15.27:0/48479001 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f107d20 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.496+0000 7f7c3d7fa640 0 client.15948 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:18.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.496+0000 7f7c624c4740 1 -- 172.21.15.27:0/48479001 >> 172.21.15.27:0/48479001 conn(0x560f9f0c6310 msgr2=0x560f9f0ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:18.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.496+0000 7f7c624c4740 1 -- 172.21.15.27:0/48479001 shutdown_connections 2024-09-19T08:14:18.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.496+0000 7f7c624c4740 1 -- 172.21.15.27:0/48479001 wait complete. 2024-09-19T08:14:18.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.497+0000 7f7c624c4740 20 client.15948 trim_cache size 0 max 16384 2024-09-19T08:14:18.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.510+0000 7f7c624c4740 1 Processor -- start 2024-09-19T08:14:18.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.511+0000 7f7c624c4740 1 -- start start 2024-09-19T08:14:18.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.511+0000 7f7c624c4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f1142b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:18.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.511+0000 7f7c624c4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f9f0feb40 0x560f9f100120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:18.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.511+0000 7f7c624c4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f108370 0x560f9f100660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:18.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.511+0000 7f7c624c4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7c581ab870 con 0x560f9f0fd5d0 2024-09-19T08:14:18.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.511+0000 7f7c624c4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7c581ae0f0 con 0x560f9f108370 2024-09-19T08:14:18.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.511+0000 7f7c624c4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7c581abee0 con 0x560f9f0feb40 2024-09-19T08:14:18.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.511+0000 7f7c5d686640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f1142b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:18.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.511+0000 7f7c5d686640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f1142b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33586/0 (socket says 172.21.15.27:33586) 2024-09-19T08:14:18.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.511+0000 7f7c5d686640 1 -- 172.21.15.27:0/1319081344 learned_addr learned my addr 172.21.15.27:0/1319081344 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:18.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.511+0000 7f7c5de87640 1 --2- 172.21.15.27:0/1319081344 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f9f0feb40 0x560f9f100120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:18.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.511+0000 7f7c5d686640 1 --2- 172.21.15.27:0/1319081344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f108370 0x560f9f100660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:18.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.511+0000 7f7c5d686640 1 -- 172.21.15.27:0/1319081344 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f9f0feb40 msgr2=0x560f9f100120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:18.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.511+0000 7f7c5d686640 1 --2- 172.21.15.27:0/1319081344 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f9f0feb40 0x560f9f100120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.511+0000 7f7c5d686640 1 -- 172.21.15.27:0/1319081344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f108370 msgr2=0x560f9f100660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:18.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.511+0000 7f7c5d686640 1 --2- 172.21.15.27:0/1319081344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f108370 0x560f9f100660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.511+0000 7f7c5d686640 1 -- 172.21.15.27:0/1319081344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f9f11a630 con 0x560f9f0fd5d0 2024-09-19T08:14:18.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.511+0000 7f7c5d686640 1 --2- 172.21.15.27:0/1319081344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f1142b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00c010 tx=0x7f7c4c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cae535fff10a602 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:18.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.512+0000 7f7c3f7fe640 1 -- 172.21.15.27:0/1319081344 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c01dc60 con 0x560f9f0fd5d0 2024-09-19T08:14:18.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.512+0000 7f7c3f7fe640 1 -- 172.21.15.27:0/1319081344 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c4c01de00 con 0x560f9f0fd5d0 2024-09-19T08:14:18.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.512+0000 7f7c3f7fe640 1 -- 172.21.15.27:0/1319081344 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c011800 con 0x560f9f0fd5d0 2024-09-19T08:14:18.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.512+0000 7f7c624c4740 1 -- 172.21.15.27:0/1319081344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 msgr2=0x560f9f1142b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:18.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.512+0000 7f7c624c4740 1 --2- 172.21.15.27:0/1319081344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f1142b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00c010 tx=0x7f7c4c00ba10 comp rx=0 tx=0).stop 2024-09-19T08:14:18.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.512+0000 7f7c624c4740 1 -- 172.21.15.27:0/1319081344 shutdown_connections 2024-09-19T08:14:18.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.512+0000 7f7c624c4740 1 --2- 172.21.15.27:0/1319081344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f108370 0x560f9f100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.512+0000 7f7c624c4740 1 --2- 172.21.15.27:0/1319081344 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f9f0feb40 0x560f9f100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.512+0000 7f7c624c4740 1 --2- 172.21.15.27:0/1319081344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f1142b0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.512+0000 7f7c624c4740 1 -- 172.21.15.27:0/1319081344 >> 172.21.15.27:0/1319081344 conn(0x560f9f0c6310 msgr2=0x560f9f1038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:18.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.513+0000 7f7c624c4740 1 -- 172.21.15.27:0/1319081344 shutdown_connections 2024-09-19T08:14:18.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.513+0000 7f7c624c4740 1 -- 172.21.15.27:0/1319081344 wait complete. 2024-09-19T08:14:18.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.513+0000 7f7c624c4740 1 -- start start 2024-09-19T08:14:18.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.513+0000 7f7c624c4740 1 Processor -- start 2024-09-19T08:14:18.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.513+0000 7f7c624c4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f1106b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:18.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.513+0000 7f7c624c4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f9f0feb40 0x560f9f110bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:18.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.513+0000 7f7c624c4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f108370 0x560f9f102270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:18.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.513+0000 7f7c624c4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7c581ac5b0 con 0x560f9f0fd5d0 2024-09-19T08:14:18.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.513+0000 7f7c624c4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7c581ada20 con 0x560f9f108370 2024-09-19T08:14:18.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.513+0000 7f7c624c4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7c581acc80 con 0x560f9f0feb40 2024-09-19T08:14:18.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.513+0000 7f7c624c4740 10 client.0 _ll_register_callbacks cb 0x7f7c4c00b960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:14:18.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.513+0000 7f7c5d686640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f1106b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:18.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.514+0000 7f7c5d686640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f1106b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33594/0 (socket says 172.21.15.27:33594) 2024-09-19T08:14:18.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.514+0000 7f7c5d686640 1 -- 172.21.15.27:0/909173318 learned_addr learned my addr 172.21.15.27:0/909173318 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:18.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.514+0000 7f7c5de87640 1 --2- 172.21.15.27:0/909173318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f9f0feb40 0x560f9f110bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:18.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.514+0000 7f7c5d686640 1 --2- 172.21.15.27:0/909173318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f108370 0x560f9f102270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:18.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.514+0000 7f7c5d686640 1 -- 172.21.15.27:0/909173318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f9f0feb40 msgr2=0x560f9f110bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:18.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.514+0000 7f7c5d686640 1 --2- 172.21.15.27:0/909173318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f9f0feb40 0x560f9f110bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.514+0000 7f7c5d686640 1 -- 172.21.15.27:0/909173318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f108370 msgr2=0x560f9f102270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:18.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.514+0000 7f7c5d686640 1 --2- 172.21.15.27:0/909173318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f108370 0x560f9f102270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.514+0000 7f7c5d686640 1 -- 172.21.15.27:0/909173318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f9f102aa0 con 0x560f9f0fd5d0 2024-09-19T08:14:18.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.514+0000 7f7c5d686640 1 --2- 172.21.15.27:0/909173318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f1106b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c004f70 tx=0x7f7c4c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d766eef5f27147 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:18.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.514+0000 7f7c3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:14:18.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.514+0000 7f7c3d7fa640 1 -- 172.21.15.27:0/909173318 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c046060 con 0x560f9f0fd5d0 2024-09-19T08:14:18.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.514+0000 7f7c3d7fa640 1 -- 172.21.15.27:0/909173318 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f7c4c011040 con 0x560f9f0fd5d0 2024-09-19T08:14:18.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.514+0000 7f7c624c4740 1 -- 172.21.15.27:0/909173318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c4c01de00 con 0x560f9f0fd5d0 2024-09-19T08:14:18.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.514+0000 7f7c3d7fa640 1 -- 172.21.15.27:0/909173318 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7c4c011240 con 0x560f9f0fd5d0 2024-09-19T08:14:18.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.514+0000 7f7c624c4740 10 client.15954 fetch_fsmap learned FSMap version 20 2024-09-19T08:14:18.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.514+0000 7f7c624c4740 1 -- 172.21.15.27:0/909173318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560f9f11fbf0 con 0x560f9f0fd5d0 2024-09-19T08:14:18.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.515+0000 7f7c3d7fa640 1 -- 172.21.15.27:0/909173318 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c4c01de00 con 0x560f9f0fd5d0 2024-09-19T08:14:18.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.515+0000 7f7c3d7fa640 1 -- 172.21.15.27:0/909173318 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7c4c0115a0 con 0x560f9f0fd5d0 2024-09-19T08:14:18.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.515+0000 7f7c624c4740 10 client.15954 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:14:18.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.515+0000 7f7c624c4740 10 client.15954 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:14:18.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.515+0000 7f7c624c4740 20 client.15954 populate_metadata read hostname 'smithi027' 2024-09-19T08:14:18.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.515+0000 7f7c624c4740 1 --2- 172.21.15.27:0/909173318 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560f9f182cf0 0x560f9f1850e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:18.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.515+0000 7f7c624c4740 4 client.15954 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:14:18.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.515+0000 7f7c624c4740 1 -- 172.21.15.27:0/909173318 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560f9f06ad70 con 0x560f9f182cf0 2024-09-19T08:14:18.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.515+0000 7f7c5de87640 1 --2- 172.21.15.27:0/909173318 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560f9f182cf0 0x560f9f1850e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:18.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.516+0000 7f7c5de87640 1 --2- 172.21.15.27:0/909173318 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560f9f182cf0 0x560f9f1850e0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=836c99268fc85ed server_cookie=72bca5bcb3591bec in_seq=0 out_seq=0 2024-09-19T08:14:18.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.516+0000 7f7c3d7fa640 10 client.15954 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:18.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.516+0000 7f7c3d7fa640 1 -- 172.21.15.27:0/909173318 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560f9f06ad70 con 0x560f9f182cf0 2024-09-19T08:14:18.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.516+0000 7f7c3d7fa640 10 client.15954 handle_command_reply: tid=0 2024-09-19T08:14:18.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.516+0000 7f7c624c4740 1 client.15954 shutdown 2024-09-19T08:14:18.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.516+0000 7f7c624c4740 1 -- 172.21.15.27:0/909173318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 msgr2=0x560f9f1106b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:18.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.516+0000 7f7c624c4740 1 --2- 172.21.15.27:0/909173318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f1106b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c004f70 tx=0x7f7c4c001e70 comp rx=0 tx=0).stop 2024-09-19T08:14:18.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.516+0000 7f7c624c4740 1 -- 172.21.15.27:0/909173318 shutdown_connections 2024-09-19T08:14:18.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.516+0000 7f7c624c4740 1 --2- 172.21.15.27:0/909173318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560f9f108370 0x560f9f102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.516+0000 7f7c624c4740 1 --2- 172.21.15.27:0/909173318 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x560f9f182cf0 0x560f9f1850e0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.516+0000 7f7c624c4740 1 --2- 172.21.15.27:0/909173318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f9f0feb40 0x560f9f110bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.516+0000 7f7c624c4740 1 --2- 172.21.15.27:0/909173318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560f9f0fd5d0 0x560f9f1106b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.516+0000 7f7c624c4740 1 -- 172.21.15.27:0/909173318 >> 172.21.15.27:0/909173318 conn(0x560f9f0c6310 msgr2=0x560f9f0f84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:18.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.516+0000 7f7c3d7fa640 0 client.15954 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:18.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.516+0000 7f7c624c4740 1 -- 172.21.15.27:0/909173318 shutdown_connections 2024-09-19T08:14:18.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.516+0000 7f7c624c4740 1 -- 172.21.15.27:0/909173318 wait complete. 2024-09-19T08:14:18.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.516+0000 7f7c624c4740 20 client.15954 trim_cache size 0 max 16384 2024-09-19T08:14:18.523 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:14:18.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.517+0000 7f7c600eb640 1 -- 172.21.15.27:0/3655264730 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7c400a33b0 msgr2=0x7f7c400a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:18.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.517+0000 7f7c600eb640 1 --2- 172.21.15.27:0/3655264730 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7c400a33b0 0x7f7c400a5870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7c480cca80 tx=0x7f7c48004a40 comp rx=0 tx=0).stop 2024-09-19T08:14:18.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.517+0000 7f7c600eb640 1 -- 172.21.15.27:0/3655264730 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c58106f10 msgr2=0x7f7c5819cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:18.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.517+0000 7f7c600eb640 1 --2- 172.21.15.27:0/3655264730 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c58106f10 0x7f7c5819cd50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800b970 tx=0x7f7c4800be30 comp rx=0 tx=0).stop 2024-09-19T08:14:18.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.517+0000 7f7c600eb640 1 -- 172.21.15.27:0/3655264730 shutdown_connections 2024-09-19T08:14:18.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.517+0000 7f7c600eb640 1 --2- 172.21.15.27:0/3655264730 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7c400a33b0 0x7f7c400a5870 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.517+0000 7f7c600eb640 1 --2- 172.21.15.27:0/3655264730 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c58106f10 0x7f7c5819cd50 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.517+0000 7f7c600eb640 1 --2- 172.21.15.27:0/3655264730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c58102790 0x7f7c581989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.517+0000 7f7c600eb640 1 --2- 172.21.15.27:0/3655264730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c58101de0 0x7f7c58198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:18.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.517+0000 7f7c600eb640 1 -- 172.21.15.27:0/3655264730 >> 172.21.15.27:0/3655264730 conn(0x7f7c580fd8c0 msgr2=0x7f7c580fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:18.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.517+0000 7f7c600eb640 1 -- 172.21.15.27:0/3655264730 shutdown_connections 2024-09-19T08:14:18.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:18.517+0000 7f7c600eb640 1 -- 172.21.15.27:0/3655264730 wait complete. 2024-09-19T08:14:18.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:18 smithi027 ceph-mon[31209]: pgmap v101: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:14:18.758 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:18 smithi203 ceph-mon[35198]: pgmap v101: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:14:18.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:18 smithi155 ceph-mon[35362]: pgmap v101: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:14:20.353 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:14:20.354 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:14:20.651 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:14:20.708 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:20 smithi027 ceph-mon[31209]: pgmap v102: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:14:20.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:20 smithi155 ceph-mon[35362]: pgmap v102: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:14:21.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:20 smithi203 ceph-mon[35198]: pgmap v102: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:14:21.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.250+0000 7f6c6a8ae640 1 -- 172.21.15.27:0/1772730125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c64102df0 msgr2=0x7f6c641031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:21.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.250+0000 7f6c6a8ae640 1 --2- 172.21.15.27:0/1772730125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c64102df0 0x7f6c641031d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009900 tx=0x7f6c5402a410 comp rx=0 tx=0).stop 2024-09-19T08:14:21.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.250+0000 7f6c6a8ae640 1 -- 172.21.15.27:0/1772730125 shutdown_connections 2024-09-19T08:14:21.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.250+0000 7f6c6a8ae640 1 --2- 172.21.15.27:0/1772730125 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c6410c2f0 0x7f6c6410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.250+0000 7f6c6a8ae640 1 --2- 172.21.15.27:0/1772730125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c641037a0 0x7f6c6410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.250+0000 7f6c6a8ae640 1 --2- 172.21.15.27:0/1772730125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c64102df0 0x7f6c641031d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.250+0000 7f6c6a8ae640 1 -- 172.21.15.27:0/1772730125 >> 172.21.15.27:0/1772730125 conn(0x7f6c640fc7d0 msgr2=0x7f6c640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:21.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.250+0000 7f6c6a8ae640 1 -- 172.21.15.27:0/1772730125 shutdown_connections 2024-09-19T08:14:21.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.250+0000 7f6c6a8ae640 1 -- 172.21.15.27:0/1772730125 wait complete. 2024-09-19T08:14:21.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.251+0000 7f6c6a8ae640 1 Processor -- start 2024-09-19T08:14:21.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.251+0000 7f6c6a8ae640 1 -- start start 2024-09-19T08:14:21.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.251+0000 7f6c6a8ae640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c64102df0 0x7f6c641a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:21.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.251+0000 7f6c6a8ae640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c641037a0 0x7f6c641a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:21.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.251+0000 7f6c6a8ae640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c6410c2f0 0x7f6c6419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:21.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.251+0000 7f6c6a8ae640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6c64112110 con 0x7f6c6410c2f0 2024-09-19T08:14:21.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.251+0000 7f6c6a8ae640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c64111f90 con 0x7f6c64102df0 2024-09-19T08:14:21.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.251+0000 7f6c6a8ae640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c64112290 con 0x7f6c641037a0 2024-09-19T08:14:21.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.252+0000 7f6c68e4b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c6410c2f0 0x7f6c6419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:21.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.252+0000 7f6c637fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c641037a0 0x7f6c641a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:21.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.252+0000 7f6c63fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c64102df0 0x7f6c641a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:21.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.252+0000 7f6c637fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c641037a0 0x7f6c641a0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.27:44858/0 (socket says 172.21.15.27:44858) 2024-09-19T08:14:21.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.252+0000 7f6c68e4b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c6410c2f0 0x7f6c6419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43526/0 (socket says 172.21.15.27:43526) 2024-09-19T08:14:21.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.252+0000 7f6c637fe640 1 -- 172.21.15.27:0/114183229 learned_addr learned my addr 172.21.15.27:0/114183229 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:21.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.252+0000 7f6c68e4b640 1 -- 172.21.15.27:0/114183229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c641037a0 msgr2=0x7f6c641a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:21.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.252+0000 7f6c68e4b640 1 --2- 172.21.15.27:0/114183229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c641037a0 0x7f6c641a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.252+0000 7f6c68e4b640 1 -- 172.21.15.27:0/114183229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c64102df0 msgr2=0x7f6c641a0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:21.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.252+0000 7f6c68e4b640 1 --2- 172.21.15.27:0/114183229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c64102df0 0x7f6c641a0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.252+0000 7f6c68e4b640 1 -- 172.21.15.27:0/114183229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6419aea0 con 0x7f6c6410c2f0 2024-09-19T08:14:21.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.252+0000 7f6c68e4b640 1 --2- 172.21.15.27:0/114183229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c6410c2f0 0x7f6c6419a630 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00e940 tx=0x7f6c5c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:21.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.253+0000 7f6c617fa640 1 -- 172.21.15.27:0/114183229 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c004d20 con 0x7f6c6410c2f0 2024-09-19T08:14:21.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.253+0000 7f6c6a8ae640 1 -- 172.21.15.27:0/114183229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6419b190 con 0x7f6c6410c2f0 2024-09-19T08:14:21.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.253+0000 7f6c617fa640 1 -- 172.21.15.27:0/114183229 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c5c005020 con 0x7f6c6410c2f0 2024-09-19T08:14:21.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.253+0000 7f6c617fa640 1 -- 172.21.15.27:0/114183229 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c0116d0 con 0x7f6c6410c2f0 2024-09-19T08:14:21.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.253+0000 7f6c6a8ae640 1 -- 172.21.15.27:0/114183229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c641a74e0 con 0x7f6c6410c2f0 2024-09-19T08:14:21.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.255+0000 7f6c617fa640 1 -- 172.21.15.27:0/114183229 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6c5c0054d0 con 0x7f6c6410c2f0 2024-09-19T08:14:21.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.256+0000 7f6c6cc87740 1 Processor -- start 2024-09-19T08:14:21.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.256+0000 7f6c6cc87740 1 -- start start 2024-09-19T08:14:21.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.256+0000 7f6c6cc87740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14efb60 0x55a3c14eff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:21.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.256+0000 7f6c6cc87740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14f0480 0x55a3c14fa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:21.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.256+0000 7f6c6cc87740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14fad40 0x55a3c14fd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:21.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.256+0000 7f6c6cc87740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55a3c1455280 con 0x55a3c14fad40 2024-09-19T08:14:21.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.256+0000 7f6c6cc87740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a3c13fcb10 con 0x55a3c14f0480 2024-09-19T08:14:21.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.256+0000 7f6c6cc87740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a3c1451240 con 0x55a3c14efb60 2024-09-19T08:14:21.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.256+0000 7f6c617fa640 1 --2- 172.21.15.27:0/114183229 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6c4c0a33b0 0x7f6c4c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:21.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.256+0000 7f6c637fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14fad40 0x55a3c14fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:21.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.256+0000 7f6c63fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14f0480 0x55a3c14fa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:21.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.256+0000 7f6c637fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14fad40 0x55a3c14fd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43536/0 (socket says 172.21.15.27:43536) 2024-09-19T08:14:21.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.256+0000 7f6c637fe640 1 -- 172.21.15.27:0/1526720038 learned_addr learned my addr 172.21.15.27:0/1526720038 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:21.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.256+0000 7f6c68e4b640 1 --2- 172.21.15.27:0/114183229 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6c4c0a33b0 0x7f6c4c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:21.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.256+0000 7f6c637fe640 1 --2- 172.21.15.27:0/1526720038 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14efb60 0x55a3c14eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:21.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.256+0000 7f6c617fa640 1 -- 172.21.15.27:0/114183229 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f6c5c0d0020 con 0x7f6c6410c2f0 2024-09-19T08:14:21.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.257+0000 7f6c63fff640 1 -- 172.21.15.27:0/1526720038 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14efb60 msgr2=0x55a3c14eff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:21.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.257+0000 7f6c63fff640 1 --2- 172.21.15.27:0/1526720038 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14efb60 0x55a3c14eff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.257+0000 7f6c63fff640 1 -- 172.21.15.27:0/1526720038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14fad40 msgr2=0x55a3c14fd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:21.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.257+0000 7f6c63fff640 1 --2- 172.21.15.27:0/1526720038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14fad40 0x55a3c14fd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.257+0000 7f6c63fff640 1 -- 172.21.15.27:0/1526720038 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3c14091f0 con 0x55a3c14f0480 2024-09-19T08:14:21.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.257+0000 7f6c637fe640 1 --2- 172.21.15.27:0/1526720038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14fad40 0x55a3c14fd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:14:21.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.257+0000 7f6c68e4b640 1 --2- 172.21.15.27:0/114183229 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6c4c0a33b0 0x7f6c4c0a5870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0cd870 tx=0x7f6c5c005440 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:21.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.257+0000 7f6c63fff640 1 --2- 172.21.15.27:0/1526720038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14f0480 0x55a3c14fa800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6c54005940 tx=0x7f6c54005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee7247d167cd412 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:21.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.257+0000 7f6c4a7fc640 1 -- 172.21.15.27:0/1526720038 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c54040070 con 0x55a3c14f0480 2024-09-19T08:14:21.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.257+0000 7f6c4a7fc640 1 -- 172.21.15.27:0/1526720038 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c540319f0 con 0x55a3c14f0480 2024-09-19T08:14:21.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.257+0000 7f6c4a7fc640 1 -- 172.21.15.27:0/1526720038 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c54035040 con 0x55a3c14f0480 2024-09-19T08:14:21.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.258+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1526720038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14f0480 msgr2=0x55a3c14fa800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:21.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.258+0000 7f6c6cc87740 1 --2- 172.21.15.27:0/1526720038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14f0480 0x55a3c14fa800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6c54005940 tx=0x7f6c54005e80 comp rx=0 tx=0).stop 2024-09-19T08:14:21.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.258+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1526720038 shutdown_connections 2024-09-19T08:14:21.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.258+0000 7f6c6cc87740 1 --2- 172.21.15.27:0/1526720038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14fad40 0x55a3c14fd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.258+0000 7f6c6cc87740 1 --2- 172.21.15.27:0/1526720038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14f0480 0x55a3c14fa800 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.258+0000 7f6c6cc87740 1 --2- 172.21.15.27:0/1526720038 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14efb60 0x55a3c14eff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.258+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1526720038 >> 172.21.15.27:0/1526720038 conn(0x55a3c14ec0f0 msgr2=0x55a3c14ec4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:21.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.258+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1526720038 shutdown_connections 2024-09-19T08:14:21.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.258+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1526720038 wait complete. 2024-09-19T08:14:21.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.258+0000 7f6c6cc87740 1 -- start start 2024-09-19T08:14:21.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.259+0000 7f6c6cc87740 1 Processor -- start 2024-09-19T08:14:21.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.259+0000 7f6c6cc87740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14efb60 0x55a3c14f7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:21.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.259+0000 7f6c6cc87740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14f0480 0x55a3c14f8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:21.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.259+0000 7f6c6cc87740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14fad40 0x55a3c14f8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:21.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.259+0000 7f6c6cc87740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55a3c14fd910 con 0x55a3c14efb60 2024-09-19T08:14:21.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.259+0000 7f6c6cc87740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a3c140ff10 con 0x55a3c14fad40 2024-09-19T08:14:21.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.259+0000 7f6c6cc87740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a3c14fda90 con 0x55a3c14f0480 2024-09-19T08:14:21.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.259+0000 7f6c6cc87740 10 client.0 _ll_register_callbacks cb 0x55a3c13d8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:14:21.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.259+0000 7f6c637fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14efb60 0x55a3c14f7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:21.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.259+0000 7f6c637fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14efb60 0x55a3c14f7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43546/0 (socket says 172.21.15.27:43546) 2024-09-19T08:14:21.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.259+0000 7f6c637fe640 1 -- 172.21.15.27:0/1987208617 learned_addr learned my addr 172.21.15.27:0/1987208617 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:21.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.259+0000 7f6c63fff640 1 --2- 172.21.15.27:0/1987208617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14f0480 0x55a3c14f8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:21.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.259+0000 7f6c637fe640 1 --2- 172.21.15.27:0/1987208617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14fad40 0x55a3c14f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:21.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.259+0000 7f6c637fe640 1 -- 172.21.15.27:0/1987208617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14f0480 msgr2=0x55a3c14f8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:21.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.259+0000 7f6c637fe640 1 --2- 172.21.15.27:0/1987208617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14f0480 0x55a3c14f8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.259+0000 7f6c637fe640 1 -- 172.21.15.27:0/1987208617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14fad40 msgr2=0x55a3c14f8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:21.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.259+0000 7f6c637fe640 1 --2- 172.21.15.27:0/1987208617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14fad40 0x55a3c14f8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.259+0000 7f6c637fe640 1 -- 172.21.15.27:0/1987208617 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3c11c66a0 con 0x55a3c14efb60 2024-09-19T08:14:21.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.259+0000 7f6c63fff640 1 --2- 172.21.15.27:0/1987208617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14f0480 0x55a3c14f8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:14:21.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.260+0000 7f6c637fe640 1 --2- 172.21.15.27:0/1987208617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14efb60 0x55a3c14f7bd0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6c58012b90 tx=0x7f6c58014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc3f0a67ecc89a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:21.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.260+0000 7f6c437fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:14:21.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.260+0000 7f6c437fe640 1 -- 172.21.15.27:0/1987208617 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c58004230 con 0x55a3c14efb60 2024-09-19T08:14:21.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.260+0000 7f6c437fe640 1 -- 172.21.15.27:0/1987208617 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f6c580043d0 con 0x55a3c14efb60 2024-09-19T08:14:21.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.260+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1987208617 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c540319f0 con 0x55a3c14efb60 2024-09-19T08:14:21.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.260+0000 7f6c437fe640 1 -- 172.21.15.27:0/1987208617 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6c58005020 con 0x55a3c14efb60 2024-09-19T08:14:21.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.260+0000 7f6c6cc87740 10 client.15966 fetch_fsmap learned FSMap version 20 2024-09-19T08:14:21.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.260+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1987208617 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a3c1509520 con 0x55a3c14efb60 2024-09-19T08:14:21.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.260+0000 7f6c437fe640 1 -- 172.21.15.27:0/1987208617 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c540319f0 con 0x55a3c14efb60 2024-09-19T08:14:21.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.260+0000 7f6c437fe640 1 -- 172.21.15.27:0/1987208617 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6c58004bd0 con 0x55a3c14efb60 2024-09-19T08:14:21.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.260+0000 7f6c6cc87740 10 client.15966 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:14:21.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.260+0000 7f6c6cc87740 10 client.15966 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:14:21.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.260+0000 7f6c6cc87740 20 client.15966 populate_metadata read hostname 'smithi027' 2024-09-19T08:14:21.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.260+0000 7f6c6cc87740 1 --2- 172.21.15.27:0/1987208617 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55a3c150a9e0 0x55a3c150cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:21.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.260+0000 7f6c6cc87740 4 client.15966 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:14:21.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.260+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1987208617 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3c14627f0 con 0x55a3c150a9e0 2024-09-19T08:14:21.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.261+0000 7f6c63fff640 1 --2- 172.21.15.27:0/1987208617 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55a3c150a9e0 0x55a3c150cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:21.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.262+0000 7f6c63fff640 1 --2- 172.21.15.27:0/1987208617 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55a3c150a9e0 0x55a3c150cdd0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f6b7e5496b86574 server_cookie=737ff3d85cc604cd in_seq=0 out_seq=0 2024-09-19T08:14:21.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.262+0000 7f6c437fe640 10 client.15966 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:21.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.262+0000 7f6c437fe640 1 -- 172.21.15.27:0/1987208617 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a3c14627f0 con 0x55a3c150a9e0 2024-09-19T08:14:21.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.262+0000 7f6c437fe640 10 client.15966 handle_command_reply: tid=0 2024-09-19T08:14:21.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.263+0000 7f6c6cc87740 1 client.15966 shutdown 2024-09-19T08:14:21.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.263+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1987208617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14efb60 msgr2=0x55a3c14f7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:21.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.263+0000 7f6c6cc87740 1 --2- 172.21.15.27:0/1987208617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14efb60 0x55a3c14f7bd0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6c58012b90 tx=0x7f6c58014040 comp rx=0 tx=0).stop 2024-09-19T08:14:21.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.263+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1987208617 shutdown_connections 2024-09-19T08:14:21.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.263+0000 7f6c6cc87740 1 --2- 172.21.15.27:0/1987208617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14fad40 0x55a3c14f8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.263+0000 7f6c6cc87740 1 --2- 172.21.15.27:0/1987208617 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55a3c150a9e0 0x55a3c150cdd0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.263+0000 7f6c6cc87740 1 --2- 172.21.15.27:0/1987208617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14f0480 0x55a3c14f8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.263+0000 7f6c6cc87740 1 --2- 172.21.15.27:0/1987208617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14efb60 0x55a3c14f7bd0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.263+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1987208617 >> 172.21.15.27:0/1987208617 conn(0x55a3c14ec0f0 msgr2=0x55a3c14eb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:21.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.263+0000 7f6c437fe640 0 client.15966 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:21.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.263+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1987208617 shutdown_connections 2024-09-19T08:14:21.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.263+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1987208617 wait complete. 2024-09-19T08:14:21.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.263+0000 7f6c6cc87740 20 client.15966 trim_cache size 0 max 16384 2024-09-19T08:14:21.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.295+0000 7f6c6cc87740 1 Processor -- start 2024-09-19T08:14:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.296+0000 7f6c6cc87740 1 -- start start 2024-09-19T08:14:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.296+0000 7f6c6cc87740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14ec0f0 0x55a3c14f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.296+0000 7f6c6cc87740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14efb60 0x55a3c14f9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.296+0000 7f6c6cc87740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14f0480 0x55a3c1512680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.296+0000 7f6c6cc87740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6c641ad9e0 con 0x55a3c14f0480 2024-09-19T08:14:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.296+0000 7f6c6cc87740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c641b0260 con 0x55a3c14efb60 2024-09-19T08:14:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.296+0000 7f6c6cc87740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c641ae050 con 0x55a3c14ec0f0 2024-09-19T08:14:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.296+0000 7f6c637fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14f0480 0x55a3c1512680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.296+0000 7f6c637fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14f0480 0x55a3c1512680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43554/0 (socket says 172.21.15.27:43554) 2024-09-19T08:14:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.296+0000 7f6c637fe640 1 -- 172.21.15.27:0/3733522457 learned_addr learned my addr 172.21.15.27:0/3733522457 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.296+0000 7f6c637fe640 1 --2- 172.21.15.27:0/3733522457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14ec0f0 0x55a3c14f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:21.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.296+0000 7f6c63fff640 1 --2- 172.21.15.27:0/3733522457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14efb60 0x55a3c14f9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:21.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.296+0000 7f6c637fe640 1 -- 172.21.15.27:0/3733522457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14ec0f0 msgr2=0x55a3c14f25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:21.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.296+0000 7f6c637fe640 1 --2- 172.21.15.27:0/3733522457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14ec0f0 0x55a3c14f25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.296+0000 7f6c637fe640 1 -- 172.21.15.27:0/3733522457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14efb60 msgr2=0x55a3c14f9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:21.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.296+0000 7f6c637fe640 1 --2- 172.21.15.27:0/3733522457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14efb60 0x55a3c14f9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.296+0000 7f6c637fe640 1 -- 172.21.15.27:0/3733522457 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3c14ebf20 con 0x55a3c14f0480 2024-09-19T08:14:21.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.296+0000 7f6c63fff640 1 --2- 172.21.15.27:0/3733522457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14efb60 0x55a3c14f9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:14:21.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.296+0000 7f6c637fe640 1 --2- 172.21.15.27:0/3733522457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14f0480 0x55a3c1512680 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6c58005fd0 tx=0x7f6c580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=441e169816439c68 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:21.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.297+0000 7f6c49ffb640 1 -- 172.21.15.27:0/3733522457 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c580110d0 con 0x55a3c14f0480 2024-09-19T08:14:21.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.297+0000 7f6c49ffb640 1 -- 172.21.15.27:0/3733522457 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c580056a0 con 0x55a3c14f0480 2024-09-19T08:14:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.297+0000 7f6c49ffb640 1 -- 172.21.15.27:0/3733522457 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c580256e0 con 0x55a3c14f0480 2024-09-19T08:14:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.297+0000 7f6c6cc87740 1 -- 172.21.15.27:0/3733522457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14f0480 msgr2=0x55a3c1512680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.297+0000 7f6c6cc87740 1 --2- 172.21.15.27:0/3733522457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14f0480 0x55a3c1512680 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6c58005fd0 tx=0x7f6c580046c0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.297+0000 7f6c6cc87740 1 -- 172.21.15.27:0/3733522457 shutdown_connections 2024-09-19T08:14:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.297+0000 7f6c6cc87740 1 --2- 172.21.15.27:0/3733522457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14f0480 0x55a3c1512680 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.297+0000 7f6c6cc87740 1 --2- 172.21.15.27:0/3733522457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14efb60 0x55a3c14f9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.297+0000 7f6c6cc87740 1 --2- 172.21.15.27:0/3733522457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14ec0f0 0x55a3c14f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.297+0000 7f6c6cc87740 1 -- 172.21.15.27:0/3733522457 >> 172.21.15.27:0/3733522457 conn(0x55a3c14f35c0 msgr2=0x55a3c14f9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.298+0000 7f6c6cc87740 1 -- 172.21.15.27:0/3733522457 shutdown_connections 2024-09-19T08:14:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.298+0000 7f6c6cc87740 1 -- 172.21.15.27:0/3733522457 wait complete. 2024-09-19T08:14:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.298+0000 7f6c6cc87740 1 -- start start 2024-09-19T08:14:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.298+0000 7f6c6cc87740 1 Processor -- start 2024-09-19T08:14:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.298+0000 7f6c6cc87740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14ec0f0 0x55a3c15035e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.298+0000 7f6c6cc87740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14efb60 0x55a3c14fe910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.298+0000 7f6c6cc87740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14f0480 0x55a3c14ff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.298+0000 7f6c6cc87740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6c641ae720 con 0x55a3c14efb60 2024-09-19T08:14:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.298+0000 7f6c6cc87740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c641afb90 con 0x55a3c14ec0f0 2024-09-19T08:14:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.298+0000 7f6c6cc87740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c641aedf0 con 0x55a3c14f0480 2024-09-19T08:14:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.298+0000 7f6c6cc87740 10 client.0 _ll_register_callbacks cb 0x7f6c58012810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:14:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.299+0000 7f6c63fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14efb60 0x55a3c14fe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.299+0000 7f6c63fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14efb60 0x55a3c14fe910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43564/0 (socket says 172.21.15.27:43564) 2024-09-19T08:14:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.299+0000 7f6c63fff640 1 -- 172.21.15.27:0/1668726053 learned_addr learned my addr 172.21.15.27:0/1668726053 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.299+0000 7f6c637fe640 1 --2- 172.21.15.27:0/1668726053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14ec0f0 0x55a3c15035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.299+0000 7f6c637fe640 1 --2- 172.21.15.27:0/1668726053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14f0480 0x55a3c14ff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.299+0000 7f6c63fff640 1 -- 172.21.15.27:0/1668726053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14f0480 msgr2=0x55a3c14ff0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.299+0000 7f6c63fff640 1 --2- 172.21.15.27:0/1668726053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14f0480 0x55a3c14ff0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.299+0000 7f6c63fff640 1 -- 172.21.15.27:0/1668726053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14ec0f0 msgr2=0x55a3c15035e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.299+0000 7f6c63fff640 1 --2- 172.21.15.27:0/1668726053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14ec0f0 0x55a3c15035e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.299+0000 7f6c63fff640 1 -- 172.21.15.27:0/1668726053 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3c1574650 con 0x55a3c14efb60 2024-09-19T08:14:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.299+0000 7f6c637fe640 1 --2- 172.21.15.27:0/1668726053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14f0480 0x55a3c14ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:14:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.299+0000 7f6c63fff640 1 --2- 172.21.15.27:0/1668726053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14efb60 0x55a3c14fe910 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x55a3c14ecf50 tx=0x7f6c54009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c71b42b881107f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.299+0000 7f6c437fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:14:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.299+0000 7f6c437fe640 1 -- 172.21.15.27:0/1668726053 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c54040040 con 0x55a3c14efb60 2024-09-19T08:14:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.299+0000 7f6c437fe640 1 -- 172.21.15.27:0/1668726053 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f6c54004750 con 0x55a3c14efb60 2024-09-19T08:14:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.299+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1668726053 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c580056a0 con 0x55a3c14efb60 2024-09-19T08:14:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.300+0000 7f6c437fe640 1 -- 172.21.15.27:0/1668726053 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6c54035040 con 0x55a3c14efb60 2024-09-19T08:14:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.300+0000 7f6c6cc87740 10 client.15972 fetch_fsmap learned FSMap version 20 2024-09-19T08:14:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.300+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1668726053 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a3c15757f0 con 0x55a3c14efb60 2024-09-19T08:14:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.300+0000 7f6c437fe640 1 -- 172.21.15.27:0/1668726053 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c580056a0 con 0x55a3c14efb60 2024-09-19T08:14:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.300+0000 7f6c437fe640 1 -- 172.21.15.27:0/1668726053 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6c54003790 con 0x55a3c14efb60 2024-09-19T08:14:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.300+0000 7f6c6cc87740 10 client.15972 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:14:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.300+0000 7f6c6cc87740 10 client.15972 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:14:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.300+0000 7f6c6cc87740 20 client.15972 populate_metadata read hostname 'smithi027' 2024-09-19T08:14:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.300+0000 7f6c6cc87740 1 --2- 172.21.15.27:0/1668726053 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55a3c14fad40 0x55a3c1577c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.300+0000 7f6c6cc87740 4 client.15972 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:14:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.300+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1668726053 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a3c145cd00 con 0x55a3c14fad40 2024-09-19T08:14:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.300+0000 7f6c637fe640 1 --2- 172.21.15.27:0/1668726053 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55a3c14fad40 0x55a3c1577c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.301+0000 7f6c437fe640 10 client.15972 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.301+0000 7f6c637fe640 1 --2- 172.21.15.27:0/1668726053 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55a3c14fad40 0x55a3c1577c00 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7934015f25be08ad server_cookie=681f8c6b3dfb0afa in_seq=0 out_seq=0 2024-09-19T08:14:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.302+0000 7f6c437fe640 1 -- 172.21.15.27:0/1668726053 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a3c145cd00 con 0x55a3c14fad40 2024-09-19T08:14:21.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.302+0000 7f6c437fe640 10 client.15972 handle_command_reply: tid=0 2024-09-19T08:14:21.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.302+0000 7f6c6cc87740 1 client.15972 shutdown 2024-09-19T08:14:21.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.302+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1668726053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14efb60 msgr2=0x55a3c14fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:21.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.302+0000 7f6c6cc87740 1 --2- 172.21.15.27:0/1668726053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14efb60 0x55a3c14fe910 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x55a3c14ecf50 tx=0x7f6c54009640 comp rx=0 tx=0).stop 2024-09-19T08:14:21.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.302+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1668726053 shutdown_connections 2024-09-19T08:14:21.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.302+0000 7f6c6cc87740 1 --2- 172.21.15.27:0/1668726053 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55a3c14fad40 0x55a3c1577c00 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.302+0000 7f6c6cc87740 1 --2- 172.21.15.27:0/1668726053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a3c14f0480 0x55a3c14ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.302+0000 7f6c6cc87740 1 --2- 172.21.15.27:0/1668726053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a3c14efb60 0x55a3c14fe910 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.302+0000 7f6c6cc87740 1 --2- 172.21.15.27:0/1668726053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3c14ec0f0 0x55a3c15035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.302+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1668726053 >> 172.21.15.27:0/1668726053 conn(0x55a3c14f35c0 msgr2=0x55a3c14eb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:21.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.302+0000 7f6c437fe640 0 client.15972 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:21.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.302+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1668726053 shutdown_connections 2024-09-19T08:14:21.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.302+0000 7f6c6cc87740 1 -- 172.21.15.27:0/1668726053 wait complete. 2024-09-19T08:14:21.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.303+0000 7f6c6cc87740 20 client.15972 trim_cache size 0 max 16384 2024-09-19T08:14:21.308 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:14:21.308 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:14:21.308 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "63678eae-018e-402d-8f33-bdc290cc46a5", 2024-09-19T08:14:21.308 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:14:21.308 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:14:21.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.303+0000 7f6c6a8ae640 1 -- 172.21.15.27:0/114183229 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6c4c0a33b0 msgr2=0x7f6c4c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:21.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.303+0000 7f6c6a8ae640 1 --2- 172.21.15.27:0/114183229 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6c4c0a33b0 0x7f6c4c0a5870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0cd870 tx=0x7f6c5c005440 comp rx=0 tx=0).stop 2024-09-19T08:14:21.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.303+0000 7f6c6a8ae640 1 -- 172.21.15.27:0/114183229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c6410c2f0 msgr2=0x7f6c6419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:21.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.303+0000 7f6c6a8ae640 1 --2- 172.21.15.27:0/114183229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c6410c2f0 0x7f6c6419a630 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00e940 tx=0x7f6c5c00ee00 comp rx=0 tx=0).stop 2024-09-19T08:14:21.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.303+0000 7f6c6a8ae640 1 -- 172.21.15.27:0/114183229 shutdown_connections 2024-09-19T08:14:21.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.303+0000 7f6c6a8ae640 1 --2- 172.21.15.27:0/114183229 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6c4c0a33b0 0x7f6c4c0a5870 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.303+0000 7f6c6a8ae640 1 --2- 172.21.15.27:0/114183229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c6410c2f0 0x7f6c6419a630 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.303+0000 7f6c6a8ae640 1 --2- 172.21.15.27:0/114183229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c641037a0 0x7f6c641a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.303+0000 7f6c6a8ae640 1 --2- 172.21.15.27:0/114183229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c64102df0 0x7f6c641a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:21.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.303+0000 7f6c6a8ae640 1 -- 172.21.15.27:0/114183229 >> 172.21.15.27:0/114183229 conn(0x7f6c640fc7d0 msgr2=0x7f6c6410d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:21.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.304+0000 7f6c6a8ae640 1 -- 172.21.15.27:0/114183229 shutdown_connections 2024-09-19T08:14:21.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:21.304+0000 7f6c6a8ae640 1 -- 172.21.15.27:0/114183229 wait complete. 2024-09-19T08:14:22.124 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:14:22.385 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:14:22.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:22 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:14:22.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:22 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:14:22.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:22 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:14:22.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:22 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:14:22.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:22 smithi027 ceph-mon[31209]: pgmap v103: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T08:14:22.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.893+0000 7f64691ba640 1 -- 172.21.15.27:0/344607811 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6464101de0 msgr2=0x7f64641021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:22.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.893+0000 7f64691ba640 1 --2- 172.21.15.27:0/344607811 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6464101de0 0x7f64641021c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6454009900 tx=0x7f645402a410 comp rx=0 tx=0).stop 2024-09-19T08:14:22.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.893+0000 7f64691ba640 1 -- 172.21.15.27:0/344607811 shutdown_connections 2024-09-19T08:14:22.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.893+0000 7f64691ba640 1 --2- 172.21.15.27:0/344607811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6464106f10 0x7f646410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.893+0000 7f64691ba640 1 --2- 172.21.15.27:0/344607811 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6464102790 0x7f64641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.893+0000 7f64691ba640 1 --2- 172.21.15.27:0/344607811 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6464101de0 0x7f64641021c0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.893+0000 7f64691ba640 1 -- 172.21.15.27:0/344607811 >> 172.21.15.27:0/344607811 conn(0x7f64640fd8c0 msgr2=0x7f64640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:22.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.893+0000 7f64691ba640 1 -- 172.21.15.27:0/344607811 shutdown_connections 2024-09-19T08:14:22.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.893+0000 7f64691ba640 1 -- 172.21.15.27:0/344607811 wait complete. 2024-09-19T08:14:22.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.894+0000 7f64691ba640 1 Processor -- start 2024-09-19T08:14:22.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.894+0000 7f64691ba640 1 -- start start 2024-09-19T08:14:22.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.894+0000 7f64691ba640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6464101de0 0x7f64640744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:22.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.894+0000 7f64691ba640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6464102790 0x7f6464074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:22.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.894+0000 7f64691ba640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6464106f10 0x7f6464074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:22.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.894+0000 7f64691ba640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6464111f70 con 0x7f6464106f10 2024-09-19T08:14:22.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.894+0000 7f64691ba640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6464111df0 con 0x7f6464102790 2024-09-19T08:14:22.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.894+0000 7f64691ba640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f64641120f0 con 0x7f6464101de0 2024-09-19T08:14:22.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.895+0000 7f646359e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6464106f10 0x7f6464074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:22.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.895+0000 7f646359e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6464106f10 0x7f6464074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43588/0 (socket says 172.21.15.27:43588) 2024-09-19T08:14:22.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.895+0000 7f646359e640 1 -- 172.21.15.27:0/3854226667 learned_addr learned my addr 172.21.15.27:0/3854226667 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:22.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.895+0000 7f6462d9d640 1 --2- 172.21.15.27:0/3854226667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6464101de0 0x7f64640744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:22.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.895+0000 7f645bfff640 1 --2- 172.21.15.27:0/3854226667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6464102790 0x7f6464074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:22.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.895+0000 7f646359e640 1 -- 172.21.15.27:0/3854226667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6464101de0 msgr2=0x7f64640744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:22.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.895+0000 7f646359e640 1 --2- 172.21.15.27:0/3854226667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6464101de0 0x7f64640744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.895+0000 7f646359e640 1 -- 172.21.15.27:0/3854226667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6464102790 msgr2=0x7f6464074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:22.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.895+0000 7f646359e640 1 --2- 172.21.15.27:0/3854226667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6464102790 0x7f6464074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.895+0000 7f646359e640 1 -- 172.21.15.27:0/3854226667 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64641a68f0 con 0x7f6464106f10 2024-09-19T08:14:22.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.895+0000 7f646359e640 1 --2- 172.21.15.27:0/3854226667 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6464106f10 0x7f6464074f70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f645c00cad0 tx=0x7f645c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:22.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.895+0000 7f6460d99640 1 -- 172.21.15.27:0/3854226667 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c00ae20 con 0x7f6464106f10 2024-09-19T08:14:22.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.895+0000 7f6460d99640 1 -- 172.21.15.27:0/3854226667 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f645c005020 con 0x7f6464106f10 2024-09-19T08:14:22.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.895+0000 7f64691ba640 1 -- 172.21.15.27:0/3854226667 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64641a6be0 con 0x7f6464106f10 2024-09-19T08:14:22.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.895+0000 7f6460d99640 1 -- 172.21.15.27:0/3854226667 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c00f6f0 con 0x7f6464106f10 2024-09-19T08:14:22.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.895+0000 7f64691ba640 1 -- 172.21.15.27:0/3854226667 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64641a7170 con 0x7f6464106f10 2024-09-19T08:14:22.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.898+0000 7f6460d99640 1 -- 172.21.15.27:0/3854226667 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f645c0051d0 con 0x7f6464106f10 2024-09-19T08:14:22.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.898+0000 7f646b593740 1 Processor -- start 2024-09-19T08:14:22.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.898+0000 7f646b593740 1 -- start start 2024-09-19T08:14:22.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.898+0000 7f646b593740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c439e44a0 0x562c439e4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:22.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.898+0000 7f646b593740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 0x562c439ef140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:22.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.898+0000 7f646b593740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439ef680 0x562c439f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:22.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.899+0000 7f646b593740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x562c4394a2e0 con 0x562c439e4dc0 2024-09-19T08:14:22.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.899+0000 7f646b593740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x562c438f1ce0 con 0x562c439ef680 2024-09-19T08:14:22.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.899+0000 7f646b593740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562c439462a0 con 0x562c439e44a0 2024-09-19T08:14:22.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.899+0000 7f6460d99640 1 --2- 172.21.15.27:0/3854226667 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f64500a3430 0x7f64500a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:22.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.899+0000 7f6462d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 0x562c439ef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:22.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.899+0000 7f6462d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 0x562c439ef140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43600/0 (socket says 172.21.15.27:43600) 2024-09-19T08:14:22.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.899+0000 7f6462d9d640 1 -- 172.21.15.27:0/1152378144 learned_addr learned my addr 172.21.15.27:0/1152378144 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:22.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.899+0000 7f646359e640 1 --2- 172.21.15.27:0/3854226667 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f64500a3430 0x7f64500a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:22.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.899+0000 7f6460d99640 1 -- 172.21.15.27:0/3854226667 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f645c0cff30 con 0x7f6464106f10 2024-09-19T08:14:22.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.899+0000 7f645bfff640 1 --2- 172.21.15.27:0/1152378144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c439e44a0 0x562c439e4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:22.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.899+0000 7f645bfff640 1 --2- 172.21.15.27:0/1152378144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439ef680 0x562c439f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:22.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.899+0000 7f6462d9d640 1 -- 172.21.15.27:0/1152378144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c439e44a0 msgr2=0x562c439e4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:22.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.899+0000 7f6462d9d640 1 --2- 172.21.15.27:0/1152378144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c439e44a0 0x562c439e4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.899+0000 7f6462d9d640 1 -- 172.21.15.27:0/1152378144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439ef680 msgr2=0x562c439f1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:22.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.899+0000 7f6462d9d640 1 --2- 172.21.15.27:0/1152378144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439ef680 0x562c439f1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.899+0000 7f6462d9d640 1 -- 172.21.15.27:0/1152378144 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c438d6440 con 0x562c439e4dc0 2024-09-19T08:14:22.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.899+0000 7f645bfff640 1 --2- 172.21.15.27:0/1152378144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439ef680 0x562c439f1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:14:22.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.899+0000 7f646359e640 1 --2- 172.21.15.27:0/3854226667 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f64500a3430 0x7f64500a58f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f645c09bf60 tx=0x7f645c066c50 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:22.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.899+0000 7f6462d9d640 1 --2- 172.21.15.27:0/1152378144 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 0x562c439ef140 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6454009900 tx=0x7f6454031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f73efa96b286c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:22.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.900+0000 7f64597fa640 1 -- 172.21.15.27:0/1152378144 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454040070 con 0x562c439e4dc0 2024-09-19T08:14:22.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.900+0000 7f64597fa640 1 -- 172.21.15.27:0/1152378144 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6454005020 con 0x562c439e4dc0 2024-09-19T08:14:22.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.900+0000 7f64597fa640 1 -- 172.21.15.27:0/1152378144 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454035040 con 0x562c439e4dc0 2024-09-19T08:14:22.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.900+0000 7f646b593740 1 -- 172.21.15.27:0/1152378144 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 msgr2=0x562c439ef140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:22.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.900+0000 7f646b593740 1 --2- 172.21.15.27:0/1152378144 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 0x562c439ef140 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6454009900 tx=0x7f6454031630 comp rx=0 tx=0).stop 2024-09-19T08:14:22.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.900+0000 7f646b593740 1 -- 172.21.15.27:0/1152378144 shutdown_connections 2024-09-19T08:14:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.900+0000 7f646b593740 1 --2- 172.21.15.27:0/1152378144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439ef680 0x562c439f1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.900+0000 7f646b593740 1 --2- 172.21.15.27:0/1152378144 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 0x562c439ef140 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.900+0000 7f646b593740 1 --2- 172.21.15.27:0/1152378144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c439e44a0 0x562c439e4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.900+0000 7f646b593740 1 -- 172.21.15.27:0/1152378144 >> 172.21.15.27:0/1152378144 conn(0x562c439e0a30 msgr2=0x562c439e0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.900+0000 7f646b593740 1 -- 172.21.15.27:0/1152378144 shutdown_connections 2024-09-19T08:14:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.901+0000 7f646b593740 1 -- 172.21.15.27:0/1152378144 wait complete. 2024-09-19T08:14:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.901+0000 7f646b593740 1 -- start start 2024-09-19T08:14:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.901+0000 7f646b593740 1 Processor -- start 2024-09-19T08:14:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.901+0000 7f646b593740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439e44a0 0x562c439eeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.901+0000 7f646b593740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c439e4dc0 0x562c439ec190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.901+0000 7f646b593740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439ef680 0x562c439ec6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.901+0000 7f646b593740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x562c439f2250 con 0x562c439ef680 2024-09-19T08:14:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.901+0000 7f646b593740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x562c43905050 con 0x562c439e44a0 2024-09-19T08:14:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.901+0000 7f646b593740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562c439f23d0 con 0x562c439e4dc0 2024-09-19T08:14:22.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.901+0000 7f646b593740 10 client.0 _ll_register_callbacks cb 0x562c43945160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:14:22.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.901+0000 7f645bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439ef680 0x562c439ec6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:22.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.901+0000 7f645bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439ef680 0x562c439ec6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43604/0 (socket says 172.21.15.27:43604) 2024-09-19T08:14:22.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.901+0000 7f645bfff640 1 -- 172.21.15.27:0/593615500 learned_addr learned my addr 172.21.15.27:0/593615500 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:22.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.901+0000 7f6462d9d640 1 --2- 172.21.15.27:0/593615500 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c439e4dc0 0x562c439ec190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:22.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.901+0000 7f645bfff640 1 --2- 172.21.15.27:0/593615500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439e44a0 0x562c439eeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:22.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.902+0000 7f645bfff640 1 -- 172.21.15.27:0/593615500 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c439e4dc0 msgr2=0x562c439ec190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:22.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.902+0000 7f645bfff640 1 --2- 172.21.15.27:0/593615500 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c439e4dc0 0x562c439ec190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.902+0000 7f645bfff640 1 -- 172.21.15.27:0/593615500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439e44a0 msgr2=0x562c439eeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:22.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.902+0000 7f645bfff640 1 --2- 172.21.15.27:0/593615500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439e44a0 0x562c439eeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.902+0000 7f645bfff640 1 -- 172.21.15.27:0/593615500 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c436bb3c0 con 0x562c439ef680 2024-09-19T08:14:22.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.902+0000 7f645bfff640 1 --2- 172.21.15.27:0/593615500 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439ef680 0x562c439ec6d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f644c012d30 tx=0x7f644c00cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90e6c409f93fced server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:22.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.902+0000 7f644a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:14:22.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.902+0000 7f644a7fc640 1 -- 172.21.15.27:0/593615500 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c00f440 con 0x562c439ef680 2024-09-19T08:14:22.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.902+0000 7f644a7fc640 1 -- 172.21.15.27:0/593615500 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f644c00f5e0 con 0x562c439ef680 2024-09-19T08:14:22.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.902+0000 7f646b593740 1 -- 172.21.15.27:0/593615500 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6454005020 con 0x562c439ef680 2024-09-19T08:14:22.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.902+0000 7f644a7fc640 1 -- 172.21.15.27:0/593615500 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f644c027050 con 0x562c439ef680 2024-09-19T08:14:22.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.902+0000 7f646b593740 10 client.15984 fetch_fsmap learned FSMap version 20 2024-09-19T08:14:22.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.902+0000 7f646b593740 1 -- 172.21.15.27:0/593615500 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562c439fdbd0 con 0x562c439ef680 2024-09-19T08:14:22.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.902+0000 7f644a7fc640 1 -- 172.21.15.27:0/593615500 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6454005020 con 0x562c439ef680 2024-09-19T08:14:22.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.903+0000 7f644a7fc640 1 -- 172.21.15.27:0/593615500 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f644c022890 con 0x562c439ef680 2024-09-19T08:14:22.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.903+0000 7f646b593740 10 client.15984 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:14:22.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.903+0000 7f646b593740 10 client.15984 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:14:22.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.903+0000 7f646b593740 20 client.15984 populate_metadata read hostname 'smithi027' 2024-09-19T08:14:22.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.903+0000 7f646b593740 1 --2- 172.21.15.27:0/593615500 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x562c439ff090 0x562c43a01480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:22.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.903+0000 7f646b593740 4 client.15984 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:14:22.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.903+0000 7f646b593740 1 -- 172.21.15.27:0/593615500 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c43957850 con 0x562c439ff090 2024-09-19T08:14:22.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.903+0000 7f6462d9d640 1 --2- 172.21.15.27:0/593615500 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x562c439ff090 0x562c43a01480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:22.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.904+0000 7f644a7fc640 10 client.15984 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:22.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.904+0000 7f6462d9d640 1 --2- 172.21.15.27:0/593615500 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x562c439ff090 0x562c43a01480 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4aab058c9947d34d server_cookie=5bd64a0d33d7b534 in_seq=0 out_seq=0 2024-09-19T08:14:22.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.904+0000 7f644a7fc640 1 -- 172.21.15.27:0/593615500 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c43957850 con 0x562c439ff090 2024-09-19T08:14:22.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.904+0000 7f644a7fc640 10 client.15984 handle_command_reply: tid=0 2024-09-19T08:14:22.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.904+0000 7f646b593740 1 client.15984 shutdown 2024-09-19T08:14:22.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.904+0000 7f646b593740 1 -- 172.21.15.27:0/593615500 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439ef680 msgr2=0x562c439ec6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:22.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.904+0000 7f646b593740 1 --2- 172.21.15.27:0/593615500 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439ef680 0x562c439ec6d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f644c012d30 tx=0x7f644c00cb50 comp rx=0 tx=0).stop 2024-09-19T08:14:22.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.904+0000 7f646b593740 1 -- 172.21.15.27:0/593615500 shutdown_connections 2024-09-19T08:14:22.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.904+0000 7f646b593740 1 --2- 172.21.15.27:0/593615500 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439ef680 0x562c439ec6d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.904+0000 7f646b593740 1 --2- 172.21.15.27:0/593615500 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x562c439ff090 0x562c43a01480 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.904+0000 7f646b593740 1 --2- 172.21.15.27:0/593615500 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c439e4dc0 0x562c439ec190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.904+0000 7f644a7fc640 0 client.15984 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:22.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.904+0000 7f646b593740 1 --2- 172.21.15.27:0/593615500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439e44a0 0x562c439eeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.904+0000 7f646b593740 1 -- 172.21.15.27:0/593615500 >> 172.21.15.27:0/593615500 conn(0x562c439e0a30 msgr2=0x562c439e6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:22.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.905+0000 7f646b593740 1 -- 172.21.15.27:0/593615500 shutdown_connections 2024-09-19T08:14:22.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.905+0000 7f646b593740 1 -- 172.21.15.27:0/593615500 wait complete. 2024-09-19T08:14:22.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.905+0000 7f646b593740 20 client.15984 trim_cache size 0 max 16384 2024-09-19T08:14:22.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.922+0000 7f646b593740 1 Processor -- start 2024-09-19T08:14:22.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.922+0000 7f646b593740 1 -- start start 2024-09-19T08:14:22.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.922+0000 7f646b593740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c439e0a30 0x562c439ee100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:22.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.922+0000 7f646b593740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439e44a0 0x562c43a06ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:22.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.922+0000 7f646b593740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 0x562c43a07220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:22.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.922+0000 7f646b593740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f64641ad9e0 con 0x562c439e4dc0 2024-09-19T08:14:22.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.922+0000 7f646b593740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f64641b0260 con 0x562c439e44a0 2024-09-19T08:14:22.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.922+0000 7f646b593740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f64641ae050 con 0x562c439e0a30 2024-09-19T08:14:22.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.922+0000 7f645bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 0x562c43a07220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:22.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.922+0000 7f645bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 0x562c43a07220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43616/0 (socket says 172.21.15.27:43616) 2024-09-19T08:14:22.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.922+0000 7f645bfff640 1 -- 172.21.15.27:0/675590978 learned_addr learned my addr 172.21.15.27:0/675590978 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:22.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.922+0000 7f6462d9d640 1 --2- 172.21.15.27:0/675590978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439e44a0 0x562c43a06ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:22.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.922+0000 7f645bfff640 1 --2- 172.21.15.27:0/675590978 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c439e0a30 0x562c439ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:22.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.922+0000 7f645bfff640 1 -- 172.21.15.27:0/675590978 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c439e0a30 msgr2=0x562c439ee100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:22.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.922+0000 7f645bfff640 1 --2- 172.21.15.27:0/675590978 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c439e0a30 0x562c439ee100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.923+0000 7f645bfff640 1 -- 172.21.15.27:0/675590978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439e44a0 msgr2=0x562c43a06ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:22.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.923+0000 7f645bfff640 1 --2- 172.21.15.27:0/675590978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439e44a0 0x562c43a06ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.923+0000 7f645bfff640 1 -- 172.21.15.27:0/675590978 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c439e4bf0 con 0x562c439e4dc0 2024-09-19T08:14:22.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.923+0000 7f645bfff640 1 --2- 172.21.15.27:0/675590978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 0x562c43a07220 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f644c0058c0 tx=0x7f644c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca2fa08ed10a9b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:22.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.923+0000 7f6458ff9640 1 -- 172.21.15.27:0/675590978 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c011ea0 con 0x562c439e4dc0 2024-09-19T08:14:22.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.923+0000 7f6458ff9640 1 -- 172.21.15.27:0/675590978 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f644c022900 con 0x562c439e4dc0 2024-09-19T08:14:22.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.923+0000 7f6458ff9640 1 -- 172.21.15.27:0/675590978 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c00fc70 con 0x562c439e4dc0 2024-09-19T08:14:22.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.924+0000 7f646b593740 1 -- 172.21.15.27:0/675590978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 msgr2=0x562c43a07220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:22.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.924+0000 7f646b593740 1 --2- 172.21.15.27:0/675590978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 0x562c43a07220 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f644c0058c0 tx=0x7f644c005850 comp rx=0 tx=0).stop 2024-09-19T08:14:22.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.924+0000 7f646b593740 1 -- 172.21.15.27:0/675590978 shutdown_connections 2024-09-19T08:14:22.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.924+0000 7f646b593740 1 --2- 172.21.15.27:0/675590978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 0x562c43a07220 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.924+0000 7f646b593740 1 --2- 172.21.15.27:0/675590978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439e44a0 0x562c43a06ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.924+0000 7f646b593740 1 --2- 172.21.15.27:0/675590978 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c439e0a30 0x562c439ee100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.924+0000 7f646b593740 1 -- 172.21.15.27:0/675590978 >> 172.21.15.27:0/675590978 conn(0x562c439ec830 msgr2=0x562c439ed9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:22.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.924+0000 7f646b593740 1 -- 172.21.15.27:0/675590978 shutdown_connections 2024-09-19T08:14:22.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.924+0000 7f646b593740 1 -- 172.21.15.27:0/675590978 wait complete. 2024-09-19T08:14:22.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.924+0000 7f646b593740 1 -- start start 2024-09-19T08:14:22.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.924+0000 7f646b593740 1 Processor -- start 2024-09-19T08:14:22.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.924+0000 7f646b593740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439e0a30 0x562c439f7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:22.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.924+0000 7f646b593740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c439e44a0 0x562c439f5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:22.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.924+0000 7f646b593740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 0x562c439f5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:22.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.924+0000 7f646b593740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f64641ae720 con 0x562c439e4dc0 2024-09-19T08:14:22.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.924+0000 7f646b593740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f64641afb90 con 0x562c439e0a30 2024-09-19T08:14:22.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.924+0000 7f646b593740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f64641aedf0 con 0x562c439e44a0 2024-09-19T08:14:22.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.925+0000 7f646b593740 10 client.0 _ll_register_callbacks cb 0x7f644c00c810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:14:22.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.925+0000 7f645bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 0x562c439f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:22.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.925+0000 7f645bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 0x562c439f5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43632/0 (socket says 172.21.15.27:43632) 2024-09-19T08:14:22.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.925+0000 7f645bfff640 1 -- 172.21.15.27:0/3244642214 learned_addr learned my addr 172.21.15.27:0/3244642214 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:22.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.925+0000 7f6462d9d640 1 --2- 172.21.15.27:0/3244642214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c439e44a0 0x562c439f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:22.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.925+0000 7f645bfff640 1 --2- 172.21.15.27:0/3244642214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439e0a30 0x562c439f7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:22.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.925+0000 7f645bfff640 1 -- 172.21.15.27:0/3244642214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c439e44a0 msgr2=0x562c439f5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:22.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.925+0000 7f645bfff640 1 --2- 172.21.15.27:0/3244642214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c439e44a0 0x562c439f5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.925+0000 7f645bfff640 1 -- 172.21.15.27:0/3244642214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439e0a30 msgr2=0x562c439f7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:22.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.925+0000 7f645bfff640 1 --2- 172.21.15.27:0/3244642214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439e0a30 0x562c439f7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.925+0000 7f645bfff640 1 -- 172.21.15.27:0/3244642214 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c439ef250 con 0x562c439e4dc0 2024-09-19T08:14:22.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.925+0000 7f645bfff640 1 --2- 172.21.15.27:0/3244642214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 0x562c439f5850 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f644c0128d0 tx=0x7f644c00f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454a9ceb35deea9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:22.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.925+0000 7f644a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:14:22.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.925+0000 7f644a7fc640 1 -- 172.21.15.27:0/3244642214 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c040060 con 0x562c439e4dc0 2024-09-19T08:14:22.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.925+0000 7f646b593740 1 -- 172.21.15.27:0/3244642214 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f644c022900 con 0x562c439e4dc0 2024-09-19T08:14:22.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.925+0000 7f644a7fc640 1 -- 172.21.15.27:0/3244642214 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f644c022420 con 0x562c439e4dc0 2024-09-19T08:14:22.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.926+0000 7f644a7fc640 1 -- 172.21.15.27:0/3244642214 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f644c00f640 con 0x562c439e4dc0 2024-09-19T08:14:22.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.926+0000 7f646b593740 10 client.15990 fetch_fsmap learned FSMap version 20 2024-09-19T08:14:22.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.926+0000 7f646b593740 1 -- 172.21.15.27:0/3244642214 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562c43a69c10 con 0x562c439e4dc0 2024-09-19T08:14:22.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.926+0000 7f644a7fc640 1 -- 172.21.15.27:0/3244642214 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f644c022900 con 0x562c439e4dc0 2024-09-19T08:14:22.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.926+0000 7f644a7fc640 1 -- 172.21.15.27:0/3244642214 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f644c037070 con 0x562c439e4dc0 2024-09-19T08:14:22.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.926+0000 7f646b593740 10 client.15990 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:14:22.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.926+0000 7f646b593740 10 client.15990 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:14:22.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.926+0000 7f646b593740 20 client.15990 populate_metadata read hostname 'smithi027' 2024-09-19T08:14:22.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.926+0000 7f646b593740 1 --2- 172.21.15.27:0/3244642214 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x562c439ef680 0x562c43a6c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:22.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.926+0000 7f646b593740 4 client.15990 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:14:22.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.926+0000 7f646b593740 1 -- 172.21.15.27:0/3244642214 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562c43951d60 con 0x562c439ef680 2024-09-19T08:14:22.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.926+0000 7f6462d9d640 1 --2- 172.21.15.27:0/3244642214 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x562c439ef680 0x562c43a6c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:22.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.927+0000 7f6462d9d640 1 --2- 172.21.15.27:0/3244642214 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x562c439ef680 0x562c43a6c1d0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bda503a442a853a server_cookie=d8e0310a69e9fb7c in_seq=0 out_seq=0 2024-09-19T08:14:22.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.927+0000 7f644a7fc640 10 client.15990 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:22.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.927+0000 7f644a7fc640 1 -- 172.21.15.27:0/3244642214 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562c43951d60 con 0x562c439ef680 2024-09-19T08:14:22.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.927+0000 7f644a7fc640 10 client.15990 handle_command_reply: tid=0 2024-09-19T08:14:22.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.927+0000 7f646b593740 1 client.15990 shutdown 2024-09-19T08:14:22.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.927+0000 7f646b593740 1 -- 172.21.15.27:0/3244642214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 msgr2=0x562c439f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:22.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.927+0000 7f646b593740 1 --2- 172.21.15.27:0/3244642214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 0x562c439f5850 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f644c0128d0 tx=0x7f644c00f810 comp rx=0 tx=0).stop 2024-09-19T08:14:22.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.927+0000 7f646b593740 1 -- 172.21.15.27:0/3244642214 shutdown_connections 2024-09-19T08:14:22.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.927+0000 7f646b593740 1 --2- 172.21.15.27:0/3244642214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562c439e4dc0 0x562c439f5850 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.927+0000 7f646b593740 1 --2- 172.21.15.27:0/3244642214 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x562c439ef680 0x562c43a6c1d0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.927+0000 7f646b593740 1 --2- 172.21.15.27:0/3244642214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c439e44a0 0x562c439f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.927+0000 7f646b593740 1 --2- 172.21.15.27:0/3244642214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c439e0a30 0x562c439f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.927+0000 7f646b593740 1 -- 172.21.15.27:0/3244642214 >> 172.21.15.27:0/3244642214 conn(0x562c439ec830 msgr2=0x562c439ee210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:22.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.927+0000 7f644a7fc640 0 client.15990 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:22.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.928+0000 7f646b593740 1 -- 172.21.15.27:0/3244642214 shutdown_connections 2024-09-19T08:14:22.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.928+0000 7f646b593740 1 -- 172.21.15.27:0/3244642214 wait complete. 2024-09-19T08:14:22.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.928+0000 7f646b593740 20 client.15990 trim_cache size 0 max 16384 2024-09-19T08:14:22.933 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:14:22.933 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:14:22.933 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": { 2024-09-19T08:14:22.933 INFO:teuthology.orchestra.run.smithi027.stdout: "63678eae-018e-402d-8f33-bdc290cc46a5": { 2024-09-19T08:14:22.933 INFO:teuthology.orchestra.run.smithi027.stdout: "path": "/", 2024-09-19T08:14:22.933 INFO:teuthology.orchestra.run.smithi027.stdout: "tag": "63678eae-018e-402d-8f33-bdc290cc46a5", 2024-09-19T08:14:22.933 INFO:teuthology.orchestra.run.smithi027.stdout: "options": "recursive,force" 2024-09-19T08:14:22.934 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:14:22.934 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:14:22.934 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:14:22.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.928+0000 7f64691ba640 1 -- 172.21.15.27:0/3854226667 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f64500a3430 msgr2=0x7f64500a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:22.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.928+0000 7f64691ba640 1 --2- 172.21.15.27:0/3854226667 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f64500a3430 0x7f64500a58f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f645c09bf60 tx=0x7f645c066c50 comp rx=0 tx=0).stop 2024-09-19T08:14:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.928+0000 7f64691ba640 1 -- 172.21.15.27:0/3854226667 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6464106f10 msgr2=0x7f6464074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.928+0000 7f64691ba640 1 --2- 172.21.15.27:0/3854226667 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6464106f10 0x7f6464074f70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f645c00cad0 tx=0x7f645c00cf90 comp rx=0 tx=0).stop 2024-09-19T08:14:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.928+0000 7f64691ba640 1 -- 172.21.15.27:0/3854226667 shutdown_connections 2024-09-19T08:14:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.928+0000 7f64691ba640 1 --2- 172.21.15.27:0/3854226667 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f64500a3430 0x7f64500a58f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.928+0000 7f64691ba640 1 --2- 172.21.15.27:0/3854226667 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6464106f10 0x7f6464074f70 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.928+0000 7f64691ba640 1 --2- 172.21.15.27:0/3854226667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6464102790 0x7f6464074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.928+0000 7f64691ba640 1 --2- 172.21.15.27:0/3854226667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6464101de0 0x7f64640744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.928+0000 7f64691ba640 1 -- 172.21.15.27:0/3854226667 >> 172.21.15.27:0/3854226667 conn(0x7f64640fd8c0 msgr2=0x7f64640fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.928+0000 7f64691ba640 1 -- 172.21.15.27:0/3854226667 shutdown_connections 2024-09-19T08:14:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:22.928+0000 7f64691ba640 1 -- 172.21.15.27:0/3854226667 wait complete. 2024-09-19T08:14:22.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:22 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:14:22.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:22 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:14:22.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:22 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:14:22.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:22 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:14:22.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:22 smithi155 ceph-mon[35362]: pgmap v103: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T08:14:23.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:22 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:14:23.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:22 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:14:23.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:22 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:14:23.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:22 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:14:23.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:22 smithi203 ceph-mon[35198]: pgmap v103: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T08:14:23.868 INFO:tasks.cephfs.filesystem:scrub status for tag:63678eae-018e-402d-8f33-bdc290cc46a5 - {'path': '/', 'tag': '63678eae-018e-402d-8f33-bdc290cc46a5', 'options': 'recursive,force'} 2024-09-19T08:14:24.810 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:24 smithi203 ceph-mon[35198]: pgmap v104: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T08:14:24.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:24 smithi155 ceph-mon[35362]: pgmap v104: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T08:14:25.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:24 smithi027 ceph-mon[31209]: pgmap v104: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T08:14:25.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:25 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:14:26.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:25 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:14:26.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:25 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:14:26.888 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:26 smithi155 ceph-mon[35362]: pgmap v105: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:14:27.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:26 smithi027 ceph-mon[31209]: pgmap v105: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:14:27.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:26 smithi203 ceph-mon[35198]: pgmap v105: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:14:28.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:28 smithi155 ceph-mon[35362]: pgmap v106: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:14:29.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:28 smithi027 ceph-mon[31209]: pgmap v106: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:14:29.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:28 smithi203 ceph-mon[35198]: pgmap v106: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:14:30.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:30 smithi155 ceph-mon[35362]: pgmap v107: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:14:31.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:30 smithi027 ceph-mon[31209]: pgmap v107: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:14:31.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:30 smithi203 ceph-mon[35198]: pgmap v107: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:14:32.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:32 smithi155 ceph-mon[35362]: pgmap v108: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:14:33.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:32 smithi027 ceph-mon[31209]: pgmap v108: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:14:33.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:32 smithi203 ceph-mon[35198]: pgmap v108: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:14:34.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:34 smithi155 ceph-mon[35362]: pgmap v109: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:14:35.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:34 smithi027 ceph-mon[31209]: pgmap v109: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:14:35.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:34 smithi203 ceph-mon[35198]: pgmap v109: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:14:36.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:36 smithi155 ceph-mon[35362]: pgmap v110: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:14:37.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:36 smithi027 ceph-mon[31209]: pgmap v110: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:14:37.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:36 smithi203 ceph-mon[35198]: pgmap v110: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:14:38.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:38 smithi155 ceph-mon[35362]: pgmap v111: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:14:39.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:38 smithi027 ceph-mon[31209]: pgmap v111: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:14:39.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:38 smithi203 ceph-mon[35198]: pgmap v111: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:14:40.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:40 smithi155 ceph-mon[35362]: pgmap v112: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:14:41.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:40 smithi027 ceph-mon[31209]: pgmap v112: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:14:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:40 smithi203 ceph-mon[35198]: pgmap v112: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:14:42.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:42 smithi155 ceph-mon[35362]: pgmap v113: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:14:43.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:42 smithi027 ceph-mon[31209]: pgmap v113: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:14:43.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:42 smithi203 ceph-mon[35198]: pgmap v113: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:14:44.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:44 smithi155 ceph-mon[35362]: pgmap v114: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:14:45.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:44 smithi027 ceph-mon[31209]: pgmap v114: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:14:45.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:44 smithi203 ceph-mon[35198]: pgmap v114: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:14:46.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:46 smithi155 ceph-mon[35362]: pgmap v115: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:14:47.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:46 smithi027 ceph-mon[31209]: pgmap v115: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:14:47.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:46 smithi203 ceph-mon[35198]: pgmap v115: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:14:48.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:48 smithi155 ceph-mon[35362]: pgmap v116: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:14:49.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:48 smithi027 ceph-mon[31209]: pgmap v116: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:14:49.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:48 smithi203 ceph-mon[35198]: pgmap v116: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:14:50.820 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:50 smithi027 ceph-mon[31209]: pgmap v117: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T08:14:50.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:50 smithi155 ceph-mon[35362]: pgmap v117: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T08:14:51.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:50 smithi203 ceph-mon[35198]: pgmap v117: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T08:14:52.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:52 smithi155 ceph-mon[35362]: pgmap v118: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T08:14:53.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:52 smithi027 ceph-mon[31209]: pgmap v118: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T08:14:53.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:52 smithi203 ceph-mon[35198]: pgmap v118: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T08:14:53.870 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:14:54.147 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:14:54.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.679+0000 7f3dec461640 1 -- 172.21.15.27:0/3464617494 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3de41082a0 msgr2=0x7f3de410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:54.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.679+0000 7f3dec461640 1 --2- 172.21.15.27:0/3464617494 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3de41082a0 0x7f3de410ec40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009930 tx=0x7f3ddc02a420 comp rx=0 tx=0).stop 2024-09-19T08:14:54.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.679+0000 7f3dec461640 1 -- 172.21.15.27:0/3464617494 shutdown_connections 2024-09-19T08:14:54.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.679+0000 7f3dec461640 1 --2- 172.21.15.27:0/3464617494 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3de41082a0 0x7f3de410ec40 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.679+0000 7f3dec461640 1 --2- 172.21.15.27:0/3464617494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3de41036e0 0x7f3de4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.679+0000 7f3dec461640 1 --2- 172.21.15.27:0/3464617494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3de4102d30 0x7f3de4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.679+0000 7f3dec461640 1 -- 172.21.15.27:0/3464617494 >> 172.21.15.27:0/3464617494 conn(0x7f3de40fc7d0 msgr2=0x7f3de40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:54.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.679+0000 7f3dec461640 1 -- 172.21.15.27:0/3464617494 shutdown_connections 2024-09-19T08:14:54.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.679+0000 7f3dec461640 1 -- 172.21.15.27:0/3464617494 wait complete. 2024-09-19T08:14:54.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.680+0000 7f3dec461640 1 Processor -- start 2024-09-19T08:14:54.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.680+0000 7f3dec461640 1 -- start start 2024-09-19T08:14:54.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.680+0000 7f3dec461640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3de4102d30 0x7f3de4198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:54.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.680+0000 7f3dec461640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3de41036e0 0x7f3de4198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:54.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.680+0000 7f3dec461640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3de41082a0 0x7f3de419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:54.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.680+0000 7f3dec461640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3de41120a0 con 0x7f3de41036e0 2024-09-19T08:14:54.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.680+0000 7f3dec461640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3de4111f20 con 0x7f3de41082a0 2024-09-19T08:14:54.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.680+0000 7f3dec461640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3de4112220 con 0x7f3de4102d30 2024-09-19T08:14:54.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.680+0000 7f3de99fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3de41036e0 0x7f3de4198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:54.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.680+0000 7f3de99fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3de41036e0 0x7f3de4198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45014/0 (socket says 172.21.15.27:45014) 2024-09-19T08:14:54.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.680+0000 7f3de99fc640 1 -- 172.21.15.27:0/3274397286 learned_addr learned my addr 172.21.15.27:0/3274397286 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:54.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.680+0000 7f3dea1fd640 1 --2- 172.21.15.27:0/3274397286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3de4102d30 0x7f3de4198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:54.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.680+0000 7f3dea9fe640 1 --2- 172.21.15.27:0/3274397286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3de41082a0 0x7f3de419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:54.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.680+0000 7f3de99fc640 1 -- 172.21.15.27:0/3274397286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3de4102d30 msgr2=0x7f3de4198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:54.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.680+0000 7f3de99fc640 1 --2- 172.21.15.27:0/3274397286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3de4102d30 0x7f3de4198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.680+0000 7f3de99fc640 1 -- 172.21.15.27:0/3274397286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3de41082a0 msgr2=0x7f3de419ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:54.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.680+0000 7f3de99fc640 1 --2- 172.21.15.27:0/3274397286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3de41082a0 0x7f3de419ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.680+0000 7f3de99fc640 1 -- 172.21.15.27:0/3274397286 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de419d4e0 con 0x7f3de41036e0 2024-09-19T08:14:54.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.681+0000 7f3de99fc640 1 --2- 172.21.15.27:0/3274397286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3de41036e0 0x7f3de4198a70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800c970 tx=0x7f3dd800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:54.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.681+0000 7f3de37fe640 1 -- 172.21.15.27:0/3274397286 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8007bb0 con 0x7f3de41036e0 2024-09-19T08:14:54.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.681+0000 7f3de37fe640 1 -- 172.21.15.27:0/3274397286 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dd8007d50 con 0x7f3de41036e0 2024-09-19T08:14:54.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.681+0000 7f3dec461640 1 -- 172.21.15.27:0/3274397286 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de419d7d0 con 0x7f3de41036e0 2024-09-19T08:14:54.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.681+0000 7f3de37fe640 1 -- 172.21.15.27:0/3274397286 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd800f450 con 0x7f3de41036e0 2024-09-19T08:14:54.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.681+0000 7f3dec461640 1 -- 172.21.15.27:0/3274397286 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de41a50b0 con 0x7f3de41036e0 2024-09-19T08:14:54.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.683+0000 7f3de37fe640 1 -- 172.21.15.27:0/3274397286 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3dd8004f60 con 0x7f3de41036e0 2024-09-19T08:14:54.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.684+0000 7f3dee83a740 1 Processor -- start 2024-09-19T08:14:54.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.684+0000 7f3dee83a740 1 -- start start 2024-09-19T08:14:54.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.684+0000 7f3dee83a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e74e4a0 0x55ce4e74e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:54.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.684+0000 7f3dee83a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e74edc0 0x55ce4e759140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:54.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.684+0000 7f3dee83a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e759680 0x55ce4e75ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:54.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.684+0000 7f3dee83a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55ce4e6b42e0 con 0x55ce4e759680 2024-09-19T08:14:54.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.684+0000 7f3dee83a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ce4e65bce0 con 0x55ce4e74e4a0 2024-09-19T08:14:54.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.684+0000 7f3dee83a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ce4e6b02a0 con 0x55ce4e74edc0 2024-09-19T08:14:54.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.684+0000 7f3de99fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e759680 0x55ce4e75ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:54.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.684+0000 7f3de99fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e759680 0x55ce4e75ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45016/0 (socket says 172.21.15.27:45016) 2024-09-19T08:14:54.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.684+0000 7f3de99fc640 1 -- 172.21.15.27:0/3720309660 learned_addr learned my addr 172.21.15.27:0/3720309660 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:54.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.684+0000 7f3dea1fd640 1 --2- 172.21.15.27:0/3720309660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e74edc0 0x55ce4e759140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:54.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.684+0000 7f3de37fe640 1 --2- 172.21.15.27:0/3274397286 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3dcc0a33b0 0x7f3dcc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:54.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.685+0000 7f3dea9fe640 1 --2- 172.21.15.27:0/3720309660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e74e4a0 0x55ce4e74e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:54.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.685+0000 7f3dea9fe640 1 --2- 172.21.15.27:0/3274397286 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3dcc0a33b0 0x7f3dcc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:54.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.685+0000 7f3de37fe640 1 -- 172.21.15.27:0/3274397286 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f3dd80cf980 con 0x7f3de41036e0 2024-09-19T08:14:54.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.685+0000 7f3de99fc640 1 -- 172.21.15.27:0/3720309660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e74edc0 msgr2=0x55ce4e759140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:54.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.685+0000 7f3de99fc640 1 --2- 172.21.15.27:0/3720309660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e74edc0 0x55ce4e759140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.685+0000 7f3de99fc640 1 -- 172.21.15.27:0/3720309660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e74e4a0 msgr2=0x55ce4e74e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:54.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.685+0000 7f3de99fc640 1 --2- 172.21.15.27:0/3720309660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e74e4a0 0x55ce4e74e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.685+0000 7f3de99fc640 1 -- 172.21.15.27:0/3720309660 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce4e640440 con 0x55ce4e759680 2024-09-19T08:14:54.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.685+0000 7f3de99fc640 1 --2- 172.21.15.27:0/3720309660 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e759680 0x55ce4e75ba70 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8063b20 tx=0x7f3dd8004980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce46d2ccde5b3a56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:54.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.685+0000 7f3de0dea640 1 -- 172.21.15.27:0/3720309660 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd801d070 con 0x55ce4e759680 2024-09-19T08:14:54.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.685+0000 7f3dea9fe640 1 --2- 172.21.15.27:0/3274397286 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3dcc0a33b0 0x7f3dcc0a5870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc006010 tx=0x7f3ddc009260 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:54.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.685+0000 7f3de0dea640 1 -- 172.21.15.27:0/3720309660 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dd809bd00 con 0x55ce4e759680 2024-09-19T08:14:54.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.685+0000 7f3de0dea640 1 -- 172.21.15.27:0/3720309660 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8098500 con 0x55ce4e759680 2024-09-19T08:14:54.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.686+0000 7f3dee83a740 1 -- 172.21.15.27:0/3720309660 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e759680 msgr2=0x55ce4e75ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:54.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.686+0000 7f3dee83a740 1 --2- 172.21.15.27:0/3720309660 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e759680 0x55ce4e75ba70 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8063b20 tx=0x7f3dd8004980 comp rx=0 tx=0).stop 2024-09-19T08:14:54.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.686+0000 7f3dee83a740 1 -- 172.21.15.27:0/3720309660 shutdown_connections 2024-09-19T08:14:54.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.686+0000 7f3dee83a740 1 --2- 172.21.15.27:0/3720309660 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e759680 0x55ce4e75ba70 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.686+0000 7f3dee83a740 1 --2- 172.21.15.27:0/3720309660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e74edc0 0x55ce4e759140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.686+0000 7f3dee83a740 1 --2- 172.21.15.27:0/3720309660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e74e4a0 0x55ce4e74e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.686+0000 7f3dee83a740 1 -- 172.21.15.27:0/3720309660 >> 172.21.15.27:0/3720309660 conn(0x55ce4e74aa30 msgr2=0x55ce4e74ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:54.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.686+0000 7f3dee83a740 1 -- 172.21.15.27:0/3720309660 shutdown_connections 2024-09-19T08:14:54.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.686+0000 7f3dee83a740 1 -- 172.21.15.27:0/3720309660 wait complete. 2024-09-19T08:14:54.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.687+0000 7f3dee83a740 1 -- start start 2024-09-19T08:14:54.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.687+0000 7f3dee83a740 1 Processor -- start 2024-09-19T08:14:54.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.687+0000 7f3dee83a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e74e4a0 0x55ce4e758fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:54.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.687+0000 7f3dee83a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74edc0 0x55ce4e756290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:54.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.687+0000 7f3dee83a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e759680 0x55ce4e7567f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:54.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.687+0000 7f3dee83a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55ce4e75c1f0 con 0x55ce4e74edc0 2024-09-19T08:14:54.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.687+0000 7f3dee83a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ce4e66f050 con 0x55ce4e759680 2024-09-19T08:14:54.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.687+0000 7f3dee83a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ce4e75c370 con 0x55ce4e74e4a0 2024-09-19T08:14:54.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.687+0000 7f3dee83a740 10 client.0 _ll_register_callbacks cb 0x55ce4e6af160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:14:54.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.687+0000 7f3de99fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74edc0 0x55ce4e756290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:54.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.687+0000 7f3de99fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74edc0 0x55ce4e756290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45032/0 (socket says 172.21.15.27:45032) 2024-09-19T08:14:54.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.687+0000 7f3de99fc640 1 -- 172.21.15.27:0/520401129 learned_addr learned my addr 172.21.15.27:0/520401129 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:54.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.687+0000 7f3dea9fe640 1 --2- 172.21.15.27:0/520401129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e759680 0x55ce4e7567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:54.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.687+0000 7f3dea1fd640 1 --2- 172.21.15.27:0/520401129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e74e4a0 0x55ce4e758fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:54.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.687+0000 7f3de99fc640 1 -- 172.21.15.27:0/520401129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e74e4a0 msgr2=0x55ce4e758fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:54.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.687+0000 7f3de99fc640 1 --2- 172.21.15.27:0/520401129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e74e4a0 0x55ce4e758fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.687+0000 7f3de99fc640 1 -- 172.21.15.27:0/520401129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e759680 msgr2=0x55ce4e7567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:54.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.687+0000 7f3de99fc640 1 --2- 172.21.15.27:0/520401129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e759680 0x55ce4e7567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.687+0000 7f3de99fc640 1 -- 172.21.15.27:0/520401129 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce4e4253c0 con 0x55ce4e74edc0 2024-09-19T08:14:54.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.688+0000 7f3de99fc640 1 --2- 172.21.15.27:0/520401129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74edc0 0x55ce4e756290 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3dd809bc90 tx=0x7f3dd80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf2120c9d38ffd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:54.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.688+0000 7f3dc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:14:54.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.688+0000 7f3dc9ffb640 1 -- 172.21.15.27:0/520401129 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd80b1020 con 0x55ce4e74edc0 2024-09-19T08:14:54.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.688+0000 7f3dc9ffb640 1 -- 172.21.15.27:0/520401129 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f3dd809b150 con 0x55ce4e74edc0 2024-09-19T08:14:54.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.688+0000 7f3dee83a740 1 -- 172.21.15.27:0/520401129 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dd809bd00 con 0x55ce4e74edc0 2024-09-19T08:14:54.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.688+0000 7f3dc9ffb640 1 -- 172.21.15.27:0/520401129 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3dd80b8020 con 0x55ce4e74edc0 2024-09-19T08:14:54.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.688+0000 7f3dee83a740 10 client.16002 fetch_fsmap learned FSMap version 20 2024-09-19T08:14:54.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.688+0000 7f3dee83a740 1 -- 172.21.15.27:0/520401129 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ce4e767bc0 con 0x55ce4e74edc0 2024-09-19T08:14:54.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.688+0000 7f3dc9ffb640 1 -- 172.21.15.27:0/520401129 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dd809bd00 con 0x55ce4e74edc0 2024-09-19T08:14:54.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.688+0000 7f3dc9ffb640 1 -- 172.21.15.27:0/520401129 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3dd80ba3e0 con 0x55ce4e74edc0 2024-09-19T08:14:54.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.688+0000 7f3dee83a740 10 client.16002 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:14:54.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.688+0000 7f3dee83a740 10 client.16002 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:14:54.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.688+0000 7f3dee83a740 20 client.16002 populate_metadata read hostname 'smithi027' 2024-09-19T08:14:54.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.688+0000 7f3dee83a740 1 --2- 172.21.15.27:0/520401129 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ce4e768f10 0x55ce4e76b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:54.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.688+0000 7f3dee83a740 4 client.16002 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:14:54.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.688+0000 7f3dee83a740 1 -- 172.21.15.27:0/520401129 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce4e6c1850 con 0x55ce4e768f10 2024-09-19T08:14:54.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.689+0000 7f3dea1fd640 1 --2- 172.21.15.27:0/520401129 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ce4e768f10 0x55ce4e76b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:54.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.689+0000 7f3dea1fd640 1 --2- 172.21.15.27:0/520401129 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ce4e768f10 0x55ce4e76b300 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6de2e2eeddf2589 server_cookie=7cf3da4fe735d38a in_seq=0 out_seq=0 2024-09-19T08:14:54.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.689+0000 7f3dc9ffb640 10 client.16002 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:54.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.690+0000 7f3dc9ffb640 1 -- 172.21.15.27:0/520401129 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce4e6c1850 con 0x55ce4e768f10 2024-09-19T08:14:54.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.690+0000 7f3dc9ffb640 10 client.16002 handle_command_reply: tid=0 2024-09-19T08:14:54.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.690+0000 7f3dee83a740 1 client.16002 shutdown 2024-09-19T08:14:54.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.690+0000 7f3dee83a740 1 -- 172.21.15.27:0/520401129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74edc0 msgr2=0x55ce4e756290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:54.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.690+0000 7f3dee83a740 1 --2- 172.21.15.27:0/520401129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74edc0 0x55ce4e756290 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3dd809bc90 tx=0x7f3dd80048f0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.690+0000 7f3dee83a740 1 -- 172.21.15.27:0/520401129 shutdown_connections 2024-09-19T08:14:54.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.690+0000 7f3dee83a740 1 --2- 172.21.15.27:0/520401129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e759680 0x55ce4e7567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.690+0000 7f3dee83a740 1 --2- 172.21.15.27:0/520401129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74edc0 0x55ce4e756290 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.690+0000 7f3dee83a740 1 --2- 172.21.15.27:0/520401129 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ce4e768f10 0x55ce4e76b300 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.690+0000 7f3dee83a740 1 --2- 172.21.15.27:0/520401129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e74e4a0 0x55ce4e758fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.690+0000 7f3dee83a740 1 -- 172.21.15.27:0/520401129 >> 172.21.15.27:0/520401129 conn(0x55ce4e74aa30 msgr2=0x55ce4e750710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:54.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.690+0000 7f3dc9ffb640 0 client.16002 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:54.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.690+0000 7f3dee83a740 1 -- 172.21.15.27:0/520401129 shutdown_connections 2024-09-19T08:14:54.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.690+0000 7f3dee83a740 1 -- 172.21.15.27:0/520401129 wait complete. 2024-09-19T08:14:54.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.690+0000 7f3dee83a740 20 client.16002 trim_cache size 0 max 16384 2024-09-19T08:14:54.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.707+0000 7f3dee83a740 1 Processor -- start 2024-09-19T08:14:54.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3dee83a740 1 -- start start 2024-09-19T08:14:54.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3dee83a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e74e4a0 0x55ce4e76e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:54.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3dee83a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74edc0 0x55ce4e76e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:54.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3dee83a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e759680 0x55ce4e753510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:54.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3dee83a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3de41ab870 con 0x55ce4e74edc0 2024-09-19T08:14:54.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3dee83a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3de41ae0f0 con 0x55ce4e74e4a0 2024-09-19T08:14:54.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3dee83a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3de41abee0 con 0x55ce4e759680 2024-09-19T08:14:54.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3de99fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74edc0 0x55ce4e76e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:54.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3de99fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74edc0 0x55ce4e76e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45048/0 (socket says 172.21.15.27:45048) 2024-09-19T08:14:54.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3de99fc640 1 -- 172.21.15.27:0/1829646062 learned_addr learned my addr 172.21.15.27:0/1829646062 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:54.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3dea9fe640 1 --2- 172.21.15.27:0/1829646062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e759680 0x55ce4e753510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:54.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3dea1fd640 1 --2- 172.21.15.27:0/1829646062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e74e4a0 0x55ce4e76e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:54.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3de99fc640 1 -- 172.21.15.27:0/1829646062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e759680 msgr2=0x55ce4e753510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:54.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3de99fc640 1 --2- 172.21.15.27:0/1829646062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e759680 0x55ce4e753510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3de99fc640 1 -- 172.21.15.27:0/1829646062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e74e4a0 msgr2=0x55ce4e76e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:54.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3de99fc640 1 --2- 172.21.15.27:0/1829646062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e74e4a0 0x55ce4e76e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3de99fc640 1 -- 172.21.15.27:0/1829646062 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce4e7547e0 con 0x55ce4e74edc0 2024-09-19T08:14:54.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3dea9fe640 1 --2- 172.21.15.27:0/1829646062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e759680 0x55ce4e753510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:14:54.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3dea1fd640 1 --2- 172.21.15.27:0/1829646062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e74e4a0 0x55ce4e76e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:14:54.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3de99fc640 1 --2- 172.21.15.27:0/1829646062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74edc0 0x55ce4e76e860 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8099fb0 tx=0x7f3dd809ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c9f2416f599c83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:54.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.708+0000 7f3dcbfff640 1 -- 172.21.15.27:0/1829646062 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd80b1030 con 0x55ce4e74edc0 2024-09-19T08:14:54.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.709+0000 7f3dcbfff640 1 -- 172.21.15.27:0/1829646062 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dd80d5070 con 0x55ce4e74edc0 2024-09-19T08:14:54.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.709+0000 7f3dcbfff640 1 -- 172.21.15.27:0/1829646062 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd801d070 con 0x55ce4e74edc0 2024-09-19T08:14:54.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.709+0000 7f3dee83a740 1 -- 172.21.15.27:0/1829646062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74edc0 msgr2=0x55ce4e76e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:54.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.709+0000 7f3dee83a740 1 --2- 172.21.15.27:0/1829646062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74edc0 0x55ce4e76e860 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8099fb0 tx=0x7f3dd809ad30 comp rx=0 tx=0).stop 2024-09-19T08:14:54.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.709+0000 7f3dee83a740 1 -- 172.21.15.27:0/1829646062 shutdown_connections 2024-09-19T08:14:54.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.709+0000 7f3dee83a740 1 --2- 172.21.15.27:0/1829646062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e759680 0x55ce4e753510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.709+0000 7f3dee83a740 1 --2- 172.21.15.27:0/1829646062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74edc0 0x55ce4e76e860 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.709+0000 7f3dee83a740 1 --2- 172.21.15.27:0/1829646062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e74e4a0 0x55ce4e76e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.709+0000 7f3dee83a740 1 -- 172.21.15.27:0/1829646062 >> 172.21.15.27:0/1829646062 conn(0x55ce4e74aa30 msgr2=0x55ce4e755380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:54.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.709+0000 7f3dee83a740 1 -- 172.21.15.27:0/1829646062 shutdown_connections 2024-09-19T08:14:54.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.709+0000 7f3dee83a740 1 -- 172.21.15.27:0/1829646062 wait complete. 2024-09-19T08:14:54.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.710+0000 7f3dee83a740 1 -- start start 2024-09-19T08:14:54.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.710+0000 7f3dee83a740 1 Processor -- start 2024-09-19T08:14:54.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.710+0000 7f3dee83a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74e4a0 0x55ce4e76e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:54.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.710+0000 7f3dee83a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e74edc0 0x55ce4e76bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:54.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.710+0000 7f3dee83a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e759680 0x55ce4e76c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:54.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.710+0000 7f3dee83a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3de41ac5b0 con 0x55ce4e74e4a0 2024-09-19T08:14:54.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.710+0000 7f3dee83a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3de41ada20 con 0x55ce4e74edc0 2024-09-19T08:14:54.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.710+0000 7f3dee83a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3de41acc80 con 0x55ce4e759680 2024-09-19T08:14:54.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.710+0000 7f3dee83a740 10 client.0 _ll_register_callbacks cb 0x7f3dd4009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:14:54.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.710+0000 7f3dea1fd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74e4a0 0x55ce4e76e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:54.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.710+0000 7f3dea1fd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74e4a0 0x55ce4e76e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45064/0 (socket says 172.21.15.27:45064) 2024-09-19T08:14:54.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.710+0000 7f3dea1fd640 1 -- 172.21.15.27:0/2782049560 learned_addr learned my addr 172.21.15.27:0/2782049560 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:54.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.710+0000 7f3de99fc640 1 --2- 172.21.15.27:0/2782049560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e74edc0 0x55ce4e76bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:54.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.710+0000 7f3dea9fe640 1 --2- 172.21.15.27:0/2782049560 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e759680 0x55ce4e76c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:54.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.710+0000 7f3dea1fd640 1 -- 172.21.15.27:0/2782049560 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e759680 msgr2=0x55ce4e76c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:54.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.710+0000 7f3dea1fd640 1 --2- 172.21.15.27:0/2782049560 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e759680 0x55ce4e76c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.710+0000 7f3dea1fd640 1 -- 172.21.15.27:0/2782049560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e74edc0 msgr2=0x55ce4e76bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:54.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.710+0000 7f3dea1fd640 1 --2- 172.21.15.27:0/2782049560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e74edc0 0x55ce4e76bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.710+0000 7f3dea1fd640 1 -- 172.21.15.27:0/2782049560 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce4e76cae0 con 0x55ce4e74e4a0 2024-09-19T08:14:54.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.710+0000 7f3dea9fe640 1 --2- 172.21.15.27:0/2782049560 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e759680 0x55ce4e76c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:14:54.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.711+0000 7f3dea1fd640 1 --2- 172.21.15.27:0/2782049560 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74e4a0 0x55ce4e76e9f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x55ce4e75c4c0 tx=0x7f3dd40128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42791b2bafea67db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:54.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.711+0000 7f3dc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:14:54.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.711+0000 7f3dc9ffb640 1 -- 172.21.15.27:0/2782049560 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd401b850 con 0x55ce4e74e4a0 2024-09-19T08:14:54.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.711+0000 7f3dc9ffb640 1 -- 172.21.15.27:0/2782049560 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f3dd401b9f0 con 0x55ce4e74e4a0 2024-09-19T08:14:54.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.711+0000 7f3dee83a740 1 -- 172.21.15.27:0/2782049560 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dd80d5070 con 0x55ce4e74e4a0 2024-09-19T08:14:54.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.711+0000 7f3dc9ffb640 1 -- 172.21.15.27:0/2782049560 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3dd4028020 con 0x55ce4e74e4a0 2024-09-19T08:14:54.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.711+0000 7f3dee83a740 10 client.16008 fetch_fsmap learned FSMap version 20 2024-09-19T08:14:54.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.711+0000 7f3dee83a740 1 -- 172.21.15.27:0/2782049560 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ce4e7d37a0 con 0x55ce4e74e4a0 2024-09-19T08:14:54.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.711+0000 7f3dc9ffb640 1 -- 172.21.15.27:0/2782049560 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dd80d5070 con 0x55ce4e74e4a0 2024-09-19T08:14:54.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.711+0000 7f3dc9ffb640 1 -- 172.21.15.27:0/2782049560 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3dd402c030 con 0x55ce4e74e4a0 2024-09-19T08:14:54.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.712+0000 7f3dee83a740 10 client.16008 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:14:54.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.712+0000 7f3dee83a740 10 client.16008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:14:54.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.712+0000 7f3dee83a740 20 client.16008 populate_metadata read hostname 'smithi027' 2024-09-19T08:14:54.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.712+0000 7f3dee83a740 1 --2- 172.21.15.27:0/2782049560 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ce4e7d3e70 0x55ce4e7d6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:54.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.712+0000 7f3dee83a740 4 client.16008 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:14:54.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.712+0000 7f3dee83a740 1 -- 172.21.15.27:0/2782049560 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ce4e6bbd60 con 0x55ce4e7d3e70 2024-09-19T08:14:54.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.712+0000 7f3de99fc640 1 --2- 172.21.15.27:0/2782049560 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ce4e7d3e70 0x55ce4e7d6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:54.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.712+0000 7f3de99fc640 1 --2- 172.21.15.27:0/2782049560 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ce4e7d3e70 0x55ce4e7d6260 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b689d636cc78d954 server_cookie=a0c72f05e6a61a32 in_seq=0 out_seq=0 2024-09-19T08:14:54.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.712+0000 7f3dc9ffb640 10 client.16008 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:54.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.712+0000 7f3dc9ffb640 1 -- 172.21.15.27:0/2782049560 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ce4e6bbd60 con 0x55ce4e7d3e70 2024-09-19T08:14:54.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.712+0000 7f3dc9ffb640 10 client.16008 handle_command_reply: tid=0 2024-09-19T08:14:54.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.712+0000 7f3dee83a740 1 client.16008 shutdown 2024-09-19T08:14:54.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.713+0000 7f3dee83a740 1 -- 172.21.15.27:0/2782049560 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74e4a0 msgr2=0x55ce4e76e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:54.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.713+0000 7f3dee83a740 1 --2- 172.21.15.27:0/2782049560 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74e4a0 0x55ce4e76e9f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x55ce4e75c4c0 tx=0x7f3dd40128e0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.713+0000 7f3dee83a740 1 -- 172.21.15.27:0/2782049560 shutdown_connections 2024-09-19T08:14:54.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.713+0000 7f3dee83a740 1 --2- 172.21.15.27:0/2782049560 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55ce4e7d3e70 0x55ce4e7d6260 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.713+0000 7f3dee83a740 1 --2- 172.21.15.27:0/2782049560 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce4e759680 0x55ce4e76c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.713+0000 7f3dee83a740 1 --2- 172.21.15.27:0/2782049560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ce4e74edc0 0x55ce4e76bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.713+0000 7f3dee83a740 1 --2- 172.21.15.27:0/2782049560 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ce4e74e4a0 0x55ce4e76e9f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.713+0000 7f3dee83a740 1 -- 172.21.15.27:0/2782049560 >> 172.21.15.27:0/2782049560 conn(0x55ce4e74aa30 msgr2=0x55ce4e751090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:54.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.713+0000 7f3dc9ffb640 0 client.16008 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:54.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.713+0000 7f3dee83a740 1 -- 172.21.15.27:0/2782049560 shutdown_connections 2024-09-19T08:14:54.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.713+0000 7f3dee83a740 1 -- 172.21.15.27:0/2782049560 wait complete. 2024-09-19T08:14:54.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.713+0000 7f3dee83a740 20 client.16008 trim_cache size 0 max 16384 2024-09-19T08:14:54.719 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:14:54.719 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:14:54.720 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:14:54.720 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:14:54.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.713+0000 7f3dec461640 1 -- 172.21.15.27:0/3274397286 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3dcc0a33b0 msgr2=0x7f3dcc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:54.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.714+0000 7f3dec461640 1 --2- 172.21.15.27:0/3274397286 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3dcc0a33b0 0x7f3dcc0a5870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc006010 tx=0x7f3ddc009260 comp rx=0 tx=0).stop 2024-09-19T08:14:54.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.714+0000 7f3dec461640 1 -- 172.21.15.27:0/3274397286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3de41036e0 msgr2=0x7f3de4198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:54.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.714+0000 7f3dec461640 1 --2- 172.21.15.27:0/3274397286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3de41036e0 0x7f3de4198a70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800c970 tx=0x7f3dd800ce30 comp rx=0 tx=0).stop 2024-09-19T08:14:54.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.714+0000 7f3dec461640 1 -- 172.21.15.27:0/3274397286 shutdown_connections 2024-09-19T08:14:54.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.714+0000 7f3dec461640 1 --2- 172.21.15.27:0/3274397286 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3dcc0a33b0 0x7f3dcc0a5870 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.714+0000 7f3dec461640 1 --2- 172.21.15.27:0/3274397286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3de41082a0 0x7f3de419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.714+0000 7f3dec461640 1 --2- 172.21.15.27:0/3274397286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3de41036e0 0x7f3de4198a70 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.714+0000 7f3dec461640 1 --2- 172.21.15.27:0/3274397286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3de4102d30 0x7f3de4198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:54.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.714+0000 7f3dec461640 1 -- 172.21.15.27:0/3274397286 >> 172.21.15.27:0/3274397286 conn(0x7f3de40fc7d0 msgr2=0x7f3de4105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:54.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.714+0000 7f3dec461640 1 -- 172.21.15.27:0/3274397286 shutdown_connections 2024-09-19T08:14:54.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:54.714+0000 7f3dec461640 1 -- 172.21.15.27:0/3274397286 wait complete. 2024-09-19T08:14:54.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:54 smithi155 ceph-mon[35362]: pgmap v119: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:14:55.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:54 smithi027 ceph-mon[31209]: pgmap v119: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:14:55.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:54 smithi203 ceph-mon[35198]: pgmap v119: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:14:55.628 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:14:55.628 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:14:55.894 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:14:56.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.372+0000 7f7f0f937640 1 -- 172.21.15.27:0/1461504741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f0810e480 msgr2=0x7f7f08110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:56.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.372+0000 7f7f0f937640 1 --2- 172.21.15.27:0/1461504741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f0810e480 0x7f7f08110870 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7f00009ca0 tx=0x7f7f0002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:14:56.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.372+0000 7f7f0f937640 1 -- 172.21.15.27:0/1461504741 shutdown_connections 2024-09-19T08:14:56.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.372+0000 7f7f0f937640 1 --2- 172.21.15.27:0/1461504741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f0810e480 0x7f7f08110870 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:56.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.372+0000 7f7f0f937640 1 --2- 172.21.15.27:0/1461504741 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f08101280 0x7f7f0810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:56.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.372+0000 7f7f0f937640 1 --2- 172.21.15.27:0/1461504741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f081008d0 0x7f7f08100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:56.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.372+0000 7f7f0f937640 1 -- 172.21.15.27:0/1461504741 >> 172.21.15.27:0/1461504741 conn(0x7f7f080fc7a0 msgr2=0x7f7f080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:56.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.372+0000 7f7f0f937640 1 -- 172.21.15.27:0/1461504741 shutdown_connections 2024-09-19T08:14:56.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.372+0000 7f7f0f937640 1 -- 172.21.15.27:0/1461504741 wait complete. 2024-09-19T08:14:56.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.372+0000 7f7f0f937640 1 Processor -- start 2024-09-19T08:14:56.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.372+0000 7f7f0f937640 1 -- start start 2024-09-19T08:14:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.372+0000 7f7f0f937640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f081008d0 0x7f7f0819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.373+0000 7f7f0f937640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f08101280 0x7f7f0819abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.373+0000 7f7f0f937640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f0810e480 0x7f7f0819ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.373+0000 7f7f0f937640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7f08114160 con 0x7f7f0810e480 2024-09-19T08:14:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.373+0000 7f7f0f937640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7f08113fe0 con 0x7f7f081008d0 2024-09-19T08:14:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.373+0000 7f7f0f937640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7f081142e0 con 0x7f7f08101280 2024-09-19T08:14:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.373+0000 7f7f0ded4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f0810e480 0x7f7f0819ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.373+0000 7f7f0ded4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f0810e480 0x7f7f0819ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45084/0 (socket says 172.21.15.27:45084) 2024-09-19T08:14:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.373+0000 7f7f0ded4640 1 -- 172.21.15.27:0/336769177 learned_addr learned my addr 172.21.15.27:0/336769177 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.373+0000 7f7f0ced2640 1 --2- 172.21.15.27:0/336769177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f08101280 0x7f7f0819abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.373+0000 7f7f0d6d3640 1 --2- 172.21.15.27:0/336769177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f081008d0 0x7f7f0819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.373+0000 7f7f0ded4640 1 -- 172.21.15.27:0/336769177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f08101280 msgr2=0x7f7f0819abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.373+0000 7f7f0ded4640 1 --2- 172.21.15.27:0/336769177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f08101280 0x7f7f0819abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.373+0000 7f7f0ded4640 1 -- 172.21.15.27:0/336769177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f081008d0 msgr2=0x7f7f0819a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.373+0000 7f7f0ded4640 1 --2- 172.21.15.27:0/336769177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f081008d0 0x7f7f0819a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.373+0000 7f7f0ded4640 1 -- 172.21.15.27:0/336769177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0819f630 con 0x7f7f0810e480 2024-09-19T08:14:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.373+0000 7f7f0ded4640 1 --2- 172.21.15.27:0/336769177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f0810e480 0x7f7f0819ef50 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7f0002ade0 tx=0x7f7f000319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.373+0000 7f7efe7fc640 1 -- 172.21.15.27:0/336769177 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f00003c30 con 0x7f7f0810e480 2024-09-19T08:14:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.373+0000 7f7efe7fc640 1 -- 172.21.15.27:0/336769177 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f00003dd0 con 0x7f7f0810e480 2024-09-19T08:14:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.373+0000 7f7f0f937640 1 -- 172.21.15.27:0/336769177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0819f8c0 con 0x7f7f0810e480 2024-09-19T08:14:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.373+0000 7f7efe7fc640 1 -- 172.21.15.27:0/336769177 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0002fd60 con 0x7f7f0810e480 2024-09-19T08:14:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.374+0000 7f7f0f937640 1 -- 172.21.15.27:0/336769177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f081a7200 con 0x7f7f0810e480 2024-09-19T08:14:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.374+0000 7f7f0f937640 1 -- 172.21.15.27:0/336769177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f08100cb0 con 0x7f7f0810e480 2024-09-19T08:14:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.376+0000 7f7efe7fc640 1 -- 172.21.15.27:0/336769177 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7f00004050 con 0x7f7f0810e480 2024-09-19T08:14:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.376+0000 7f7efe7fc640 1 --2- 172.21.15.27:0/336769177 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7ef40a3430 0x7f7ef40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.376+0000 7f7f0d6d3640 1 --2- 172.21.15.27:0/336769177 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7ef40a3430 0x7f7ef40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.377+0000 7f7efe7fc640 1 -- 172.21.15.27:0/336769177 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f7f000f10e0 con 0x7f7f0810e480 2024-09-19T08:14:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.377+0000 7f7f0d6d3640 1 --2- 172.21.15.27:0/336769177 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7ef40a3430 0x7f7ef40a58f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400bbe0 tx=0x7f7f0400b390 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:56.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.380+0000 7f7efe7fc640 1 -- 172.21.15.27:0/336769177 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7f0007f210 con 0x7f7f0810e480 2024-09-19T08:14:56.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.595+0000 7f7f0f937640 1 -- 172.21.15.27:0/336769177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f0819b9e0 con 0x7f7f0810e480 2024-09-19T08:14:56.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.596+0000 7f7efe7fc640 1 -- 172.21.15.27:0/336769177 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f7f0819b9e0 con 0x7f7f0810e480 2024-09-19T08:14:56.597 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:14:56.597 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:14:56.597 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:14:56.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.598+0000 7f7f0f937640 1 -- 172.21.15.27:0/336769177 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7ef40a3430 msgr2=0x7f7ef40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:56.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.598+0000 7f7f0f937640 1 --2- 172.21.15.27:0/336769177 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7ef40a3430 0x7f7ef40a58f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400bbe0 tx=0x7f7f0400b390 comp rx=0 tx=0).stop 2024-09-19T08:14:56.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.598+0000 7f7f0f937640 1 -- 172.21.15.27:0/336769177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f0810e480 msgr2=0x7f7f0819ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:56.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.598+0000 7f7f0f937640 1 --2- 172.21.15.27:0/336769177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f0810e480 0x7f7f0819ef50 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7f0002ade0 tx=0x7f7f000319f0 comp rx=0 tx=0).stop 2024-09-19T08:14:56.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.598+0000 7f7f0f937640 1 -- 172.21.15.27:0/336769177 shutdown_connections 2024-09-19T08:14:56.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.598+0000 7f7f0f937640 1 --2- 172.21.15.27:0/336769177 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7ef40a3430 0x7f7ef40a58f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:56.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.598+0000 7f7f0f937640 1 --2- 172.21.15.27:0/336769177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f0810e480 0x7f7f0819ef50 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:56.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.598+0000 7f7f0f937640 1 --2- 172.21.15.27:0/336769177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f08101280 0x7f7f0819abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:56.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.598+0000 7f7f0f937640 1 --2- 172.21.15.27:0/336769177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f081008d0 0x7f7f0819a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:56.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.598+0000 7f7f0f937640 1 -- 172.21.15.27:0/336769177 >> 172.21.15.27:0/336769177 conn(0x7f7f080fc7a0 msgr2=0x7f7f080feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:56.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.598+0000 7f7f0f937640 1 -- 172.21.15.27:0/336769177 shutdown_connections 2024-09-19T08:14:56.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:56.598+0000 7f7f0f937640 1 -- 172.21.15.27:0/336769177 wait complete. 2024-09-19T08:14:56.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:56 smithi027 ceph-mon[31209]: pgmap v120: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T08:14:56.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:56 smithi155 ceph-mon[35362]: pgmap v120: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T08:14:57.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:56 smithi203 ceph-mon[35198]: pgmap v120: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T08:14:57.422 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:14:57.685 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:14:57.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:57 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/336769177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:14:57.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:57 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/336769177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:14:58.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:57 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/336769177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:14:58.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.208+0000 7fe462686640 1 -- 172.21.15.27:0/1296994677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe45c101de0 msgr2=0x7fe45c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:58.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.208+0000 7fe462686640 1 --2- 172.21.15.27:0/1296994677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe45c101de0 0x7fe45c1021c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009900 tx=0x7fe44c02a3f0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.208+0000 7fe462686640 1 -- 172.21.15.27:0/1296994677 shutdown_connections 2024-09-19T08:14:58.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.208+0000 7fe462686640 1 --2- 172.21.15.27:0/1296994677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe45c106f10 0x7fe45c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.208+0000 7fe462686640 1 --2- 172.21.15.27:0/1296994677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe45c102790 0x7fe45c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.208+0000 7fe462686640 1 --2- 172.21.15.27:0/1296994677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe45c101de0 0x7fe45c1021c0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.208+0000 7fe462686640 1 -- 172.21.15.27:0/1296994677 >> 172.21.15.27:0/1296994677 conn(0x7fe45c0fd8c0 msgr2=0x7fe45c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:58.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.208+0000 7fe462686640 1 -- 172.21.15.27:0/1296994677 shutdown_connections 2024-09-19T08:14:58.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.208+0000 7fe462686640 1 -- 172.21.15.27:0/1296994677 wait complete. 2024-09-19T08:14:58.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.209+0000 7fe462686640 1 Processor -- start 2024-09-19T08:14:58.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.209+0000 7fe462686640 1 -- start start 2024-09-19T08:14:58.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.210+0000 7fe462686640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe45c101de0 0x7fe45c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:58.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.210+0000 7fe462686640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe45c102790 0x7fe45c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:58.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.210+0000 7fe462686640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe45c106f10 0x7fe45c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:58.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.210+0000 7fe462686640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c111f70 con 0x7fe45c102790 2024-09-19T08:14:58.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.210+0000 7fe462686640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c111df0 con 0x7fe45c101de0 2024-09-19T08:14:58.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.210+0000 7fe462686640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c1120f0 con 0x7fe45c106f10 2024-09-19T08:14:58.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.210+0000 7fe45b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe45c102790 0x7fe45c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:58.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.210+0000 7fe45b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe45c102790 0x7fe45c198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45114/0 (socket says 172.21.15.27:45114) 2024-09-19T08:14:58.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.210+0000 7fe45b7fe640 1 -- 172.21.15.27:0/475353115 learned_addr learned my addr 172.21.15.27:0/475353115 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:58.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.210+0000 7fe45bfff640 1 --2- 172.21.15.27:0/475353115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe45c101de0 0x7fe45c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:58.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.210+0000 7fe460c23640 1 --2- 172.21.15.27:0/475353115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe45c106f10 0x7fe45c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:58.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.210+0000 7fe45b7fe640 1 -- 172.21.15.27:0/475353115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe45c106f10 msgr2=0x7fe45c19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:58.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.210+0000 7fe45b7fe640 1 --2- 172.21.15.27:0/475353115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe45c106f10 0x7fe45c19cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.210+0000 7fe45b7fe640 1 -- 172.21.15.27:0/475353115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe45c101de0 msgr2=0x7fe45c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:58.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.210+0000 7fe45b7fe640 1 --2- 172.21.15.27:0/475353115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe45c101de0 0x7fe45c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.210+0000 7fe45b7fe640 1 -- 172.21.15.27:0/475353115 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe45c19d380 con 0x7fe45c102790 2024-09-19T08:14:58.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.210+0000 7fe45bfff640 1 --2- 172.21.15.27:0/475353115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe45c101de0 0x7fe45c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:14:58.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.210+0000 7fe45b7fe640 1 --2- 172.21.15.27:0/475353115 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe45c102790 0x7fe45c198910 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe45000c970 tx=0x7fe45000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:58.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.211+0000 7fe4597fa640 1 -- 172.21.15.27:0/475353115 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe450007bb0 con 0x7fe45c102790 2024-09-19T08:14:58.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.211+0000 7fe4597fa640 1 -- 172.21.15.27:0/475353115 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe450007d50 con 0x7fe45c102790 2024-09-19T08:14:58.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.211+0000 7fe462686640 1 -- 172.21.15.27:0/475353115 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe45c19d670 con 0x7fe45c102790 2024-09-19T08:14:58.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.211+0000 7fe4597fa640 1 -- 172.21.15.27:0/475353115 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45000f450 con 0x7fe45c102790 2024-09-19T08:14:58.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.211+0000 7fe462686640 1 -- 172.21.15.27:0/475353115 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe45c1a4f50 con 0x7fe45c102790 2024-09-19T08:14:58.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.213+0000 7fe4597fa640 1 -- 172.21.15.27:0/475353115 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe450005020 con 0x7fe45c102790 2024-09-19T08:14:58.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.213+0000 7fe464a5f740 1 Processor -- start 2024-09-19T08:14:58.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.213+0000 7fe464a5f740 1 -- start start 2024-09-19T08:14:58.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.213+0000 7fe464a5f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006768b40 0x565006767090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:58.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.213+0000 7fe464a5f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 0x565006767a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:58.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.213+0000 7fe464a5f740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006776780 0x565006778b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:58.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.213+0000 7fe464a5f740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5650066cd2f0 con 0x565006776780 2024-09-19T08:14:58.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.213+0000 7fe464a5f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x565006674cf0 con 0x565006768b40 2024-09-19T08:14:58.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.213+0000 7fe464a5f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5650066c92b0 con 0x5650067675d0 2024-09-19T08:14:58.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.214+0000 7fe45b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006776780 0x565006778b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:58.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.214+0000 7fe45b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006776780 0x565006778b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45116/0 (socket says 172.21.15.27:45116) 2024-09-19T08:14:58.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.214+0000 7fe45b7fe640 1 -- 172.21.15.27:0/950141900 learned_addr learned my addr 172.21.15.27:0/950141900 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:58.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.214+0000 7fe4597fa640 1 --2- 172.21.15.27:0/475353115 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe4440a33b0 0x7fe4440a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:58.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.214+0000 7fe460c23640 1 --2- 172.21.15.27:0/950141900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006768b40 0x565006767090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:58.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.214+0000 7fe45bfff640 1 --2- 172.21.15.27:0/950141900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 0x565006767a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:58.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.214+0000 7fe460c23640 1 --2- 172.21.15.27:0/475353115 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe4440a33b0 0x7fe4440a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:58.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.214+0000 7fe4597fa640 1 -- 172.21.15.27:0/475353115 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fe4500cfb60 con 0x7fe45c102790 2024-09-19T08:14:58.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.214+0000 7fe45b7fe640 1 -- 172.21.15.27:0/950141900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 msgr2=0x565006767a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:58.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.214+0000 7fe45b7fe640 1 --2- 172.21.15.27:0/950141900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 0x565006767a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.214+0000 7fe45b7fe640 1 -- 172.21.15.27:0/950141900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006768b40 msgr2=0x565006767090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:58.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.214+0000 7fe45b7fe640 1 --2- 172.21.15.27:0/950141900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006768b40 0x565006767090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.214+0000 7fe45b7fe640 1 -- 172.21.15.27:0/950141900 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650066593a0 con 0x565006776780 2024-09-19T08:14:58.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.214+0000 7fe45b7fe640 1 --2- 172.21.15.27:0/950141900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006776780 0x565006778b70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe45009bb90 tx=0x7fe450004a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7f5f74e0ab3726 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:58.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.215+0000 7fe460c23640 1 --2- 172.21.15.27:0/475353115 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe4440a33b0 0x7fe4440a5870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe454012a70 tx=0x7fe454004ab0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:58.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.215+0000 7fe4427fc640 1 -- 172.21.15.27:0/950141900 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45001d050 con 0x565006776780 2024-09-19T08:14:58.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.215+0000 7fe4427fc640 1 -- 172.21.15.27:0/950141900 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe45009be90 con 0x565006776780 2024-09-19T08:14:58.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.215+0000 7fe4427fc640 1 -- 172.21.15.27:0/950141900 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4500ccb40 con 0x565006776780 2024-09-19T08:14:58.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.215+0000 7fe464a5f740 1 -- 172.21.15.27:0/950141900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006776780 msgr2=0x565006778b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:58.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.215+0000 7fe464a5f740 1 --2- 172.21.15.27:0/950141900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006776780 0x565006778b70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe45009bb90 tx=0x7fe450004a20 comp rx=0 tx=0).stop 2024-09-19T08:14:58.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.215+0000 7fe464a5f740 1 -- 172.21.15.27:0/950141900 shutdown_connections 2024-09-19T08:14:58.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.215+0000 7fe464a5f740 1 --2- 172.21.15.27:0/950141900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006776780 0x565006778b70 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.215+0000 7fe464a5f740 1 --2- 172.21.15.27:0/950141900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 0x565006767a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.215+0000 7fe464a5f740 1 --2- 172.21.15.27:0/950141900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006768b40 0x565006767090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.215+0000 7fe464a5f740 1 -- 172.21.15.27:0/950141900 >> 172.21.15.27:0/950141900 conn(0x565006730310 msgr2=0x565006763c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:58.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.215+0000 7fe464a5f740 1 -- 172.21.15.27:0/950141900 shutdown_connections 2024-09-19T08:14:58.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.215+0000 7fe464a5f740 1 -- 172.21.15.27:0/950141900 wait complete. 2024-09-19T08:14:58.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.216+0000 7fe464a5f740 1 -- start start 2024-09-19T08:14:58.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.216+0000 7fe464a5f740 1 Processor -- start 2024-09-19T08:14:58.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.216+0000 7fe464a5f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 0x5650067761a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:58.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.216+0000 7fe464a5f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006768b40 0x565006773450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:58.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.216+0000 7fe464a5f740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006776780 0x565006773a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:58.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.216+0000 7fe464a5f740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x565006779420 con 0x565006776780 2024-09-19T08:14:58.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.216+0000 7fe464a5f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x565006688060 con 0x565006768b40 2024-09-19T08:14:58.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.216+0000 7fe464a5f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5650067795a0 con 0x5650067675d0 2024-09-19T08:14:58.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.216+0000 7fe464a5f740 10 client.0 _ll_register_callbacks cb 0x5650063db8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:14:58.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.216+0000 7fe460c23640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006776780 0x565006773a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:58.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.216+0000 7fe460c23640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006776780 0x565006773a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45132/0 (socket says 172.21.15.27:45132) 2024-09-19T08:14:58.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.216+0000 7fe460c23640 1 -- 172.21.15.27:0/2033385932 learned_addr learned my addr 172.21.15.27:0/2033385932 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:58.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.217+0000 7fe45bfff640 1 --2- 172.21.15.27:0/2033385932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 0x5650067761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:58.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.217+0000 7fe45b7fe640 1 --2- 172.21.15.27:0/2033385932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006768b40 0x565006773450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:58.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.217+0000 7fe460c23640 1 -- 172.21.15.27:0/2033385932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 msgr2=0x5650067761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:58.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.217+0000 7fe460c23640 1 --2- 172.21.15.27:0/2033385932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 0x5650067761a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.217+0000 7fe460c23640 1 -- 172.21.15.27:0/2033385932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006768b40 msgr2=0x565006773450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:58.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.217+0000 7fe460c23640 1 --2- 172.21.15.27:0/2033385932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006768b40 0x565006773450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.217+0000 7fe460c23640 1 -- 172.21.15.27:0/2033385932 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56500643e3c0 con 0x565006776780 2024-09-19T08:14:58.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.217+0000 7fe460c23640 1 --2- 172.21.15.27:0/2033385932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006776780 0x565006773a60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe454013010 tx=0x7fe454004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8d34c5d6d356b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:58.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.217+0000 7fe43b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:14:58.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.217+0000 7fe43b7fe640 1 -- 172.21.15.27:0/2033385932 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe454024070 con 0x565006776780 2024-09-19T08:14:58.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.217+0000 7fe43b7fe640 1 -- 172.21.15.27:0/2033385932 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fe454004250 con 0x565006776780 2024-09-19T08:14:58.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.217+0000 7fe464a5f740 1 -- 172.21.15.27:0/2033385932 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe45009be90 con 0x565006776780 2024-09-19T08:14:58.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.217+0000 7fe43b7fe640 1 -- 172.21.15.27:0/2033385932 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe454030050 con 0x565006776780 2024-09-19T08:14:58.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.217+0000 7fe464a5f740 10 client.16026 fetch_fsmap learned FSMap version 20 2024-09-19T08:14:58.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.217+0000 7fe464a5f740 1 -- 172.21.15.27:0/2033385932 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x565006784f50 con 0x565006776780 2024-09-19T08:14:58.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.218+0000 7fe43b7fe640 1 -- 172.21.15.27:0/2033385932 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe45009be90 con 0x565006776780 2024-09-19T08:14:58.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.218+0000 7fe43b7fe640 1 -- 172.21.15.27:0/2033385932 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe454020c70 con 0x565006776780 2024-09-19T08:14:58.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.218+0000 7fe464a5f740 10 client.16026 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:14:58.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.218+0000 7fe464a5f740 10 client.16026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:14:58.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.218+0000 7fe464a5f740 20 client.16026 populate_metadata read hostname 'smithi027' 2024-09-19T08:14:58.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.218+0000 7fe464a5f740 1 --2- 172.21.15.27:0/2033385932 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x565006786630 0x565006788a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:58.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.218+0000 7fe464a5f740 4 client.16026 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:14:58.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.218+0000 7fe464a5f740 1 -- 172.21.15.27:0/2033385932 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650066da860 con 0x565006786630 2024-09-19T08:14:58.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.218+0000 7fe45bfff640 1 --2- 172.21.15.27:0/2033385932 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x565006786630 0x565006788a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:58.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.219+0000 7fe45bfff640 1 --2- 172.21.15.27:0/2033385932 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x565006786630 0x565006788a20 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7779ee7dee4b2d38 server_cookie=e43f710971324582 in_seq=0 out_seq=0 2024-09-19T08:14:58.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.219+0000 7fe43b7fe640 10 client.16026 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:58.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.219+0000 7fe43b7fe640 1 -- 172.21.15.27:0/2033385932 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5650066da860 con 0x565006786630 2024-09-19T08:14:58.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.219+0000 7fe43b7fe640 10 client.16026 handle_command_reply: tid=0 2024-09-19T08:14:58.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.219+0000 7fe464a5f740 1 client.16026 shutdown 2024-09-19T08:14:58.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.219+0000 7fe464a5f740 1 -- 172.21.15.27:0/2033385932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006776780 msgr2=0x565006773a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:58.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.219+0000 7fe464a5f740 1 --2- 172.21.15.27:0/2033385932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006776780 0x565006773a60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe454013010 tx=0x7fe454004a40 comp rx=0 tx=0).stop 2024-09-19T08:14:58.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.219+0000 7fe464a5f740 1 -- 172.21.15.27:0/2033385932 shutdown_connections 2024-09-19T08:14:58.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.219+0000 7fe464a5f740 1 --2- 172.21.15.27:0/2033385932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006776780 0x565006773a60 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.219+0000 7fe464a5f740 1 --2- 172.21.15.27:0/2033385932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006768b40 0x565006773450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.219+0000 7fe464a5f740 1 --2- 172.21.15.27:0/2033385932 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x565006786630 0x565006788a20 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.219+0000 7fe464a5f740 1 --2- 172.21.15.27:0/2033385932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 0x5650067761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.220+0000 7fe464a5f740 1 -- 172.21.15.27:0/2033385932 >> 172.21.15.27:0/2033385932 conn(0x565006730310 msgr2=0x565006769990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:58.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.220+0000 7fe43b7fe640 0 client.16026 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:58.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.220+0000 7fe464a5f740 1 -- 172.21.15.27:0/2033385932 shutdown_connections 2024-09-19T08:14:58.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.220+0000 7fe464a5f740 1 -- 172.21.15.27:0/2033385932 wait complete. 2024-09-19T08:14:58.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.220+0000 7fe464a5f740 20 client.16026 trim_cache size 0 max 16384 2024-09-19T08:14:58.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.233+0000 7fe464a5f740 1 Processor -- start 2024-09-19T08:14:58.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.233+0000 7fe464a5f740 1 -- start start 2024-09-19T08:14:58.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.233+0000 7fe464a5f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 0x5650067826c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:58.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.233+0000 7fe464a5f740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006768b40 0x565006763700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:58.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.233+0000 7fe464a5f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006776780 0x565006763c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:58.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.233+0000 7fe464a5f740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c1a95a0 con 0x565006768b40 2024-09-19T08:14:58.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.233+0000 7fe464a5f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c1abe20 con 0x565006776780 2024-09-19T08:14:58.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.233+0000 7fe464a5f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c1a9c10 con 0x5650067675d0 2024-09-19T08:14:58.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.233+0000 7fe45b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006768b40 0x565006763700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:58.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.233+0000 7fe45b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006768b40 0x565006763700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45148/0 (socket says 172.21.15.27:45148) 2024-09-19T08:14:58.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.233+0000 7fe45b7fe640 1 -- 172.21.15.27:0/13895662 learned_addr learned my addr 172.21.15.27:0/13895662 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:58.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.233+0000 7fe45bfff640 1 --2- 172.21.15.27:0/13895662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 0x5650067826c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:58.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.233+0000 7fe460c23640 1 --2- 172.21.15.27:0/13895662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006776780 0x565006763c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:58.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.233+0000 7fe45b7fe640 1 -- 172.21.15.27:0/13895662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 msgr2=0x5650067826c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:58.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.233+0000 7fe45b7fe640 1 --2- 172.21.15.27:0/13895662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 0x5650067826c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.233+0000 7fe45b7fe640 1 -- 172.21.15.27:0/13895662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006776780 msgr2=0x565006763c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:58.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.233+0000 7fe45b7fe640 1 --2- 172.21.15.27:0/13895662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006776780 0x565006763c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.233+0000 7fe45b7fe640 1 -- 172.21.15.27:0/13895662 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565006764180 con 0x565006768b40 2024-09-19T08:14:58.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.233+0000 7fe45bfff640 1 --2- 172.21.15.27:0/13895662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 0x5650067826c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:14:58.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.233+0000 7fe460c23640 1 --2- 172.21.15.27:0/13895662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006776780 0x565006763c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:14:58.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.234+0000 7fe45b7fe640 1 --2- 172.21.15.27:0/13895662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006768b40 0x565006763700 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe45009be20 tx=0x7fe4500d33e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95440168f2638801 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:58.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.234+0000 7fe441ffb640 1 -- 172.21.15.27:0/13895662 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4500d31a0 con 0x565006768b40 2024-09-19T08:14:58.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.234+0000 7fe441ffb640 1 -- 172.21.15.27:0/13895662 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe45009be90 con 0x565006768b40 2024-09-19T08:14:58.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.234+0000 7fe441ffb640 1 -- 172.21.15.27:0/13895662 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4500cc7c0 con 0x565006768b40 2024-09-19T08:14:58.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.234+0000 7fe464a5f740 1 -- 172.21.15.27:0/13895662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006768b40 msgr2=0x565006763700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:58.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.234+0000 7fe464a5f740 1 --2- 172.21.15.27:0/13895662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006768b40 0x565006763700 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe45009be20 tx=0x7fe4500d33e0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.234+0000 7fe464a5f740 1 -- 172.21.15.27:0/13895662 shutdown_connections 2024-09-19T08:14:58.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.234+0000 7fe464a5f740 1 --2- 172.21.15.27:0/13895662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006776780 0x565006763c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.234+0000 7fe464a5f740 1 --2- 172.21.15.27:0/13895662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006768b40 0x565006763700 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.234+0000 7fe464a5f740 1 --2- 172.21.15.27:0/13895662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 0x5650067826c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.234+0000 7fe464a5f740 1 -- 172.21.15.27:0/13895662 >> 172.21.15.27:0/13895662 conn(0x565006730310 msgr2=0x565006773410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:58.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.234+0000 7fe464a5f740 1 -- 172.21.15.27:0/13895662 shutdown_connections 2024-09-19T08:14:58.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.235+0000 7fe464a5f740 1 -- 172.21.15.27:0/13895662 wait complete. 2024-09-19T08:14:58.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.235+0000 7fe464a5f740 1 -- start start 2024-09-19T08:14:58.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.235+0000 7fe464a5f740 1 Processor -- start 2024-09-19T08:14:58.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.235+0000 7fe464a5f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 0x565006770570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:58.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.235+0000 7fe464a5f740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006768b40 0x565006770ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:58.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.235+0000 7fe464a5f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006776780 0x565006770ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:58.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.235+0000 7fe464a5f740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c1aa2e0 con 0x565006768b40 2024-09-19T08:14:58.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.235+0000 7fe464a5f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c1ab750 con 0x565006776780 2024-09-19T08:14:58.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.235+0000 7fe464a5f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c1aa9b0 con 0x5650067675d0 2024-09-19T08:14:58.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.235+0000 7fe464a5f740 10 client.0 _ll_register_callbacks cb 0x7fe454007940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:14:58.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.235+0000 7fe45b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006768b40 0x565006770ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:58.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.235+0000 7fe45b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006768b40 0x565006770ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45160/0 (socket says 172.21.15.27:45160) 2024-09-19T08:14:58.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.236+0000 7fe45b7fe640 1 -- 172.21.15.27:0/3498232293 learned_addr learned my addr 172.21.15.27:0/3498232293 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:14:58.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.236+0000 7fe460c23640 1 --2- 172.21.15.27:0/3498232293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006776780 0x565006770ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:58.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.236+0000 7fe45bfff640 1 --2- 172.21.15.27:0/3498232293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 0x565006770570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:58.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.236+0000 7fe45b7fe640 1 -- 172.21.15.27:0/3498232293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 msgr2=0x565006770570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:58.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.236+0000 7fe45b7fe640 1 --2- 172.21.15.27:0/3498232293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 0x565006770570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.236+0000 7fe45b7fe640 1 -- 172.21.15.27:0/3498232293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006776780 msgr2=0x565006770ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:14:58.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.236+0000 7fe45b7fe640 1 --2- 172.21.15.27:0/3498232293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006776780 0x565006770ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.236+0000 7fe45b7fe640 1 -- 172.21.15.27:0/3498232293 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650067f0210 con 0x565006768b40 2024-09-19T08:14:58.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.236+0000 7fe45bfff640 1 --2- 172.21.15.27:0/3498232293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 0x565006770570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:14:58.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.236+0000 7fe45b7fe640 1 --2- 172.21.15.27:0/3498232293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006768b40 0x565006770ab0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe4500049d0 tx=0x7fe4500cfe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be9826d8f3e1a6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:14:58.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.236+0000 7fe43b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:14:58.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.236+0000 7fe43b7fe640 1 -- 172.21.15.27:0/3498232293 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45001d070 con 0x565006768b40 2024-09-19T08:14:58.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.236+0000 7fe43b7fe640 1 -- 172.21.15.27:0/3498232293 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fe4500ccb40 con 0x565006768b40 2024-09-19T08:14:58.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.236+0000 7fe464a5f740 1 -- 172.21.15.27:0/3498232293 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe45009be90 con 0x565006768b40 2024-09-19T08:14:58.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.236+0000 7fe43b7fe640 1 -- 172.21.15.27:0/3498232293 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe4500d31a0 con 0x565006768b40 2024-09-19T08:14:58.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.236+0000 7fe464a5f740 10 client.16032 fetch_fsmap learned FSMap version 20 2024-09-19T08:14:58.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.236+0000 7fe464a5f740 1 -- 172.21.15.27:0/3498232293 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5650067f1420 con 0x565006768b40 2024-09-19T08:14:58.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.237+0000 7fe43b7fe640 1 -- 172.21.15.27:0/3498232293 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe45009be90 con 0x565006768b40 2024-09-19T08:14:58.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.237+0000 7fe43b7fe640 1 -- 172.21.15.27:0/3498232293 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe450005310 con 0x565006768b40 2024-09-19T08:14:58.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.237+0000 7fe464a5f740 10 client.16032 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:14:58.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.237+0000 7fe464a5f740 10 client.16032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:14:58.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.237+0000 7fe464a5f740 20 client.16032 populate_metadata read hostname 'smithi027' 2024-09-19T08:14:58.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.237+0000 7fe464a5f740 1 --2- 172.21.15.27:0/3498232293 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5650067f16a0 0x5650067f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:14:58.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.237+0000 7fe464a5f740 4 client.16032 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:14:58.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.237+0000 7fe464a5f740 1 -- 172.21.15.27:0/3498232293 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5650067687b0 con 0x5650067f16a0 2024-09-19T08:14:58.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.237+0000 7fe45bfff640 1 --2- 172.21.15.27:0/3498232293 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5650067f16a0 0x5650067f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:14:58.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.238+0000 7fe43b7fe640 10 client.16032 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:58.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.238+0000 7fe45bfff640 1 --2- 172.21.15.27:0/3498232293 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5650067f16a0 0x5650067f3a90 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7abbe57320bc3407 server_cookie=77ed056bf44b987a in_seq=0 out_seq=0 2024-09-19T08:14:58.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.238+0000 7fe43b7fe640 1 -- 172.21.15.27:0/3498232293 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5650067687b0 con 0x5650067f16a0 2024-09-19T08:14:58.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.238+0000 7fe43b7fe640 10 client.16032 handle_command_reply: tid=0 2024-09-19T08:14:58.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.238+0000 7fe464a5f740 1 client.16032 shutdown 2024-09-19T08:14:58.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.238+0000 7fe464a5f740 1 -- 172.21.15.27:0/3498232293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006768b40 msgr2=0x565006770ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:58.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.238+0000 7fe464a5f740 1 --2- 172.21.15.27:0/3498232293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006768b40 0x565006770ab0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe4500049d0 tx=0x7fe4500cfe60 comp rx=0 tx=0).stop 2024-09-19T08:14:58.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.238+0000 7fe464a5f740 1 -- 172.21.15.27:0/3498232293 shutdown_connections 2024-09-19T08:14:58.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.238+0000 7fe464a5f740 1 --2- 172.21.15.27:0/3498232293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565006776780 0x565006770ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.238+0000 7fe464a5f740 1 --2- 172.21.15.27:0/3498232293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565006768b40 0x565006770ab0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.238+0000 7fe464a5f740 1 --2- 172.21.15.27:0/3498232293 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5650067f16a0 0x5650067f3a90 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.238+0000 7fe464a5f740 1 --2- 172.21.15.27:0/3498232293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5650067675d0 0x565006770570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.238+0000 7fe43b7fe640 0 client.16032 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:14:58.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.238+0000 7fe464a5f740 1 -- 172.21.15.27:0/3498232293 >> 172.21.15.27:0/3498232293 conn(0x565006730310 msgr2=0x5650067718f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:58.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.238+0000 7fe464a5f740 1 -- 172.21.15.27:0/3498232293 shutdown_connections 2024-09-19T08:14:58.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.238+0000 7fe464a5f740 1 -- 172.21.15.27:0/3498232293 wait complete. 2024-09-19T08:14:58.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.238+0000 7fe464a5f740 20 client.16032 trim_cache size 0 max 16384 2024-09-19T08:14:58.245 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:14:58.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.239+0000 7fe462686640 1 -- 172.21.15.27:0/475353115 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe4440a33b0 msgr2=0x7fe4440a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:58.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.239+0000 7fe462686640 1 --2- 172.21.15.27:0/475353115 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe4440a33b0 0x7fe4440a5870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe454012a70 tx=0x7fe454004ab0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.239+0000 7fe462686640 1 -- 172.21.15.27:0/475353115 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe45c102790 msgr2=0x7fe45c198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:14:58.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.239+0000 7fe462686640 1 --2- 172.21.15.27:0/475353115 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe45c102790 0x7fe45c198910 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe45000c970 tx=0x7fe45000ce30 comp rx=0 tx=0).stop 2024-09-19T08:14:58.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.239+0000 7fe462686640 1 -- 172.21.15.27:0/475353115 shutdown_connections 2024-09-19T08:14:58.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.239+0000 7fe462686640 1 --2- 172.21.15.27:0/475353115 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe4440a33b0 0x7fe4440a5870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.239+0000 7fe462686640 1 --2- 172.21.15.27:0/475353115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe45c106f10 0x7fe45c19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.239+0000 7fe462686640 1 --2- 172.21.15.27:0/475353115 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe45c102790 0x7fe45c198910 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.239+0000 7fe462686640 1 --2- 172.21.15.27:0/475353115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe45c101de0 0x7fe45c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:14:58.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.239+0000 7fe462686640 1 -- 172.21.15.27:0/475353115 >> 172.21.15.27:0/475353115 conn(0x7fe45c0fd8c0 msgr2=0x7fe45c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:14:58.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.239+0000 7fe462686640 1 -- 172.21.15.27:0/475353115 shutdown_connections 2024-09-19T08:14:58.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:14:58.239+0000 7fe462686640 1 -- 172.21.15.27:0/475353115 wait complete. 2024-09-19T08:14:58.848 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:14:58 smithi027 ceph-mon[31209]: pgmap v121: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:14:58.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:14:58 smithi155 ceph-mon[35362]: pgmap v121: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:14:59.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:14:58 smithi203 ceph-mon[35198]: pgmap v121: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:14:59.968 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:14:59.968 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:15:00.239 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:15:00.658 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:00 smithi027 ceph-mon[31209]: pgmap v122: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:00.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.746+0000 7facf84fa640 1 -- 172.21.15.27:0/2643928553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facf01036e0 msgr2=0x7facf0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:00.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.746+0000 7facf84fa640 1 --2- 172.21.15.27:0/2643928553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facf01036e0 0x7facf0107b90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7face4009930 tx=0x7face402a420 comp rx=0 tx=0).stop 2024-09-19T08:15:00.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.746+0000 7facf84fa640 1 -- 172.21.15.27:0/2643928553 shutdown_connections 2024-09-19T08:15:00.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.746+0000 7facf84fa640 1 --2- 172.21.15.27:0/2643928553 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7facf01082a0 0x7facf010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.746+0000 7facf84fa640 1 --2- 172.21.15.27:0/2643928553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facf01036e0 0x7facf0107b90 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.746+0000 7facf84fa640 1 --2- 172.21.15.27:0/2643928553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf0102d30 0x7facf0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.746+0000 7facf84fa640 1 -- 172.21.15.27:0/2643928553 >> 172.21.15.27:0/2643928553 conn(0x7facf00fc7d0 msgr2=0x7facf00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:00.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.746+0000 7facf84fa640 1 -- 172.21.15.27:0/2643928553 shutdown_connections 2024-09-19T08:15:00.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.746+0000 7facf84fa640 1 -- 172.21.15.27:0/2643928553 wait complete. 2024-09-19T08:15:00.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.747+0000 7facf84fa640 1 Processor -- start 2024-09-19T08:15:00.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.747+0000 7facf84fa640 1 -- start start 2024-09-19T08:15:00.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.747+0000 7facf84fa640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7facf0102d30 0x7facf0198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:00.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.747+0000 7facf84fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf01036e0 0x7facf0198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:00.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.747+0000 7facf84fa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facf01082a0 0x7facf019cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:00.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.747+0000 7facf84fa640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7facf01120c0 con 0x7facf01082a0 2024-09-19T08:15:00.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.747+0000 7facf84fa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7facf0111f40 con 0x7facf01036e0 2024-09-19T08:15:00.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.747+0000 7facf84fa640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7facf0112240 con 0x7facf0102d30 2024-09-19T08:15:00.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.747+0000 7facf6a97640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facf01082a0 0x7facf019cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:00.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.747+0000 7facf6a97640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facf01082a0 0x7facf019cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49906/0 (socket says 172.21.15.27:49906) 2024-09-19T08:15:00.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.747+0000 7facf6a97640 1 -- 172.21.15.27:0/1800781962 learned_addr learned my addr 172.21.15.27:0/1800781962 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:00.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.747+0000 7facf5a95640 1 --2- 172.21.15.27:0/1800781962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf01036e0 0x7facf0198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:00.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.747+0000 7facf6296640 1 --2- 172.21.15.27:0/1800781962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7facf0102d30 0x7facf0198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:00.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.748+0000 7facf6a97640 1 -- 172.21.15.27:0/1800781962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7facf0102d30 msgr2=0x7facf0198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:00.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.748+0000 7facf6a97640 1 --2- 172.21.15.27:0/1800781962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7facf0102d30 0x7facf0198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.748+0000 7facf6a97640 1 -- 172.21.15.27:0/1800781962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf01036e0 msgr2=0x7facf0198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:00.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.748+0000 7facf6a97640 1 --2- 172.21.15.27:0/1800781962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf01036e0 0x7facf0198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.748+0000 7facf6a97640 1 -- 172.21.15.27:0/1800781962 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf019d5f0 con 0x7facf01082a0 2024-09-19T08:15:00.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.748+0000 7facf6a97640 1 --2- 172.21.15.27:0/1800781962 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facf01082a0 0x7facf019cf10 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7face000cce0 tx=0x7face000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:00.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.748+0000 7facef7fe640 1 -- 172.21.15.27:0/1800781962 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face000f450 con 0x7facf01082a0 2024-09-19T08:15:00.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.748+0000 7facef7fe640 1 -- 172.21.15.27:0/1800781962 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7face000fad0 con 0x7facf01082a0 2024-09-19T08:15:00.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.748+0000 7facf84fa640 1 -- 172.21.15.27:0/1800781962 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facf019d8e0 con 0x7facf01082a0 2024-09-19T08:15:00.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.748+0000 7facef7fe640 1 -- 172.21.15.27:0/1800781962 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face0018b60 con 0x7facf01082a0 2024-09-19T08:15:00.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.748+0000 7facf84fa640 1 -- 172.21.15.27:0/1800781962 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facf01a51c0 con 0x7facf01082a0 2024-09-19T08:15:00.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.751+0000 7facef7fe640 1 -- 172.21.15.27:0/1800781962 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7face000fc80 con 0x7facf01082a0 2024-09-19T08:15:00.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.751+0000 7facfa8d3740 1 Processor -- start 2024-09-19T08:15:00.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.751+0000 7facfa8d3740 1 -- start start 2024-09-19T08:15:00.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.751+0000 7facfa8d3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556290da3a80 0x556290da3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:00.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.751+0000 7facfa8d3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290db2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:00.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.751+0000 7facfa8d3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556290db3150 0x556290db5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:00.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.751+0000 7facfa8d3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556290d09280 con 0x556290da43a0 2024-09-19T08:15:00.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.751+0000 7facfa8d3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x556290cb0b10 con 0x556290db3150 2024-09-19T08:15:00.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.751+0000 7facfa8d3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556290d05240 con 0x556290da3a80 2024-09-19T08:15:00.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.751+0000 7facf6296640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290db2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:00.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.751+0000 7facf6296640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290db2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49916/0 (socket says 172.21.15.27:49916) 2024-09-19T08:15:00.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.751+0000 7facf6296640 1 -- 172.21.15.27:0/3942134639 learned_addr learned my addr 172.21.15.27:0/3942134639 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:00.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.751+0000 7facf5a95640 1 --2- 172.21.15.27:0/3942134639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556290db3150 0x556290db5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:00.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.752+0000 7facf5a95640 1 --2- 172.21.15.27:0/3942134639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556290da3a80 0x556290da3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:00.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.752+0000 7facf6296640 1 -- 172.21.15.27:0/3942134639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556290da3a80 msgr2=0x556290da3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:00.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.752+0000 7facf6296640 1 --2- 172.21.15.27:0/3942134639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556290da3a80 0x556290da3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.752+0000 7facf6296640 1 -- 172.21.15.27:0/3942134639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556290db3150 msgr2=0x556290db5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:00.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.752+0000 7facf6296640 1 --2- 172.21.15.27:0/3942134639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556290db3150 0x556290db5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.752+0000 7facf6296640 1 -- 172.21.15.27:0/3942134639 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556290cbd1f0 con 0x556290da43a0 2024-09-19T08:15:00.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.752+0000 7facf5a95640 1 --2- 172.21.15.27:0/3942134639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556290db3150 0x556290db5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:15:00.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.752+0000 7facf6296640 1 --2- 172.21.15.27:0/3942134639 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290db2c10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7face8009a70 tx=0x7face8009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff143ec1180bed1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:00.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.752+0000 7facef7fe640 1 --2- 172.21.15.27:0/1800781962 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7facd80a33b0 0x7facd80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:00.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.752+0000 7facecff9640 1 -- 172.21.15.27:0/3942134639 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8017070 con 0x556290da43a0 2024-09-19T08:15:00.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.752+0000 7facf5a95640 1 --2- 172.21.15.27:0/1800781962 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7facd80a33b0 0x7facd80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:00.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.752+0000 7facecff9640 1 -- 172.21.15.27:0/3942134639 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7face8013470 con 0x556290da43a0 2024-09-19T08:15:00.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.752+0000 7facecff9640 1 -- 172.21.15.27:0/3942134639 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face80125f0 con 0x556290da43a0 2024-09-19T08:15:00.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.752+0000 7facef7fe640 1 -- 172.21.15.27:0/1800781962 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7face00d0180 con 0x7facf01082a0 2024-09-19T08:15:00.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.753+0000 7facf5a95640 1 --2- 172.21.15.27:0/1800781962 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7facd80a33b0 0x7facd80a5870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7face4005940 tx=0x7face4005fd0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:00.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.753+0000 7facfa8d3740 1 -- 172.21.15.27:0/3942134639 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 msgr2=0x556290db2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:00.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.753+0000 7facfa8d3740 1 --2- 172.21.15.27:0/3942134639 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290db2c10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7face8009a70 tx=0x7face8009f30 comp rx=0 tx=0).stop 2024-09-19T08:15:00.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.753+0000 7facfa8d3740 1 -- 172.21.15.27:0/3942134639 shutdown_connections 2024-09-19T08:15:00.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.753+0000 7facfa8d3740 1 --2- 172.21.15.27:0/3942134639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556290db3150 0x556290db5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.753+0000 7facfa8d3740 1 --2- 172.21.15.27:0/3942134639 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290db2c10 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.753+0000 7facfa8d3740 1 --2- 172.21.15.27:0/3942134639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556290da3a80 0x556290da3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.753+0000 7facfa8d3740 1 -- 172.21.15.27:0/3942134639 >> 172.21.15.27:0/3942134639 conn(0x556290da00f0 msgr2=0x556290da04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:00.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.753+0000 7facfa8d3740 1 -- 172.21.15.27:0/3942134639 shutdown_connections 2024-09-19T08:15:00.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.753+0000 7facfa8d3740 1 -- 172.21.15.27:0/3942134639 wait complete. 2024-09-19T08:15:00.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.754+0000 7facfa8d3740 1 -- start start 2024-09-19T08:15:00.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.754+0000 7facfa8d3740 1 Processor -- start 2024-09-19T08:15:00.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.754+0000 7facfa8d3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556290da3a80 0x556290db00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:00.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.754+0000 7facfa8d3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290db0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:00.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.754+0000 7facfa8d3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556290db3150 0x556290db0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:00.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.754+0000 7facfa8d3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556290db5cc0 con 0x556290da43a0 2024-09-19T08:15:00.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.754+0000 7facfa8d3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x556290cc3f10 con 0x556290da3a80 2024-09-19T08:15:00.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.754+0000 7facfa8d3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556290db5e40 con 0x556290db3150 2024-09-19T08:15:00.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.754+0000 7facfa8d3740 10 client.0 _ll_register_callbacks cb 0x556290c8ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:15:00.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.754+0000 7facf5a95640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290db0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:00.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.754+0000 7facf5a95640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290db0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49924/0 (socket says 172.21.15.27:49924) 2024-09-19T08:15:00.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.754+0000 7facf5a95640 1 -- 172.21.15.27:0/2180500588 learned_addr learned my addr 172.21.15.27:0/2180500588 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:00.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.754+0000 7facf6a97640 1 --2- 172.21.15.27:0/2180500588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556290db3150 0x556290db0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:00.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.754+0000 7facf6296640 1 --2- 172.21.15.27:0/2180500588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556290da3a80 0x556290db00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:00.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.754+0000 7facf5a95640 1 -- 172.21.15.27:0/2180500588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556290db3150 msgr2=0x556290db0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:00.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.754+0000 7facf5a95640 1 --2- 172.21.15.27:0/2180500588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556290db3150 0x556290db0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.755+0000 7facf5a95640 1 -- 172.21.15.27:0/2180500588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556290da3a80 msgr2=0x556290db00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:00.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.755+0000 7facf5a95640 1 --2- 172.21.15.27:0/2180500588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556290da3a80 0x556290db00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.755+0000 7facf5a95640 1 -- 172.21.15.27:0/2180500588 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556290a7a6a0 con 0x556290da43a0 2024-09-19T08:15:00.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.755+0000 7facf5a95640 1 --2- 172.21.15.27:0/2180500588 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290db0600 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7face4004180 tx=0x7face40058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e69da31b5416bc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:00.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.755+0000 7facd5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:15:00.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.755+0000 7facd5ffb640 1 -- 172.21.15.27:0/2180500588 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4003cb0 con 0x556290da43a0 2024-09-19T08:15:00.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.755+0000 7facd5ffb640 1 -- 172.21.15.27:0/2180500588 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7face4053470 con 0x556290da43a0 2024-09-19T08:15:00.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.755+0000 7facfa8d3740 1 -- 172.21.15.27:0/2180500588 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7face8013470 con 0x556290da43a0 2024-09-19T08:15:00.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.755+0000 7facd5ffb640 1 -- 172.21.15.27:0/2180500588 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7face4003e50 con 0x556290da43a0 2024-09-19T08:15:00.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.755+0000 7facfa8d3740 10 client.16044 fetch_fsmap learned FSMap version 20 2024-09-19T08:15:00.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.755+0000 7facfa8d3740 1 -- 172.21.15.27:0/2180500588 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556290dc1990 con 0x556290da43a0 2024-09-19T08:15:00.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.755+0000 7facd5ffb640 1 -- 172.21.15.27:0/2180500588 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7face8013470 con 0x556290da43a0 2024-09-19T08:15:00.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.755+0000 7facd5ffb640 1 -- 172.21.15.27:0/2180500588 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7face4046030 con 0x556290da43a0 2024-09-19T08:15:00.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.756+0000 7facfa8d3740 10 client.16044 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:15:00.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.756+0000 7facfa8d3740 10 client.16044 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:15:00.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.756+0000 7facfa8d3740 20 client.16044 populate_metadata read hostname 'smithi027' 2024-09-19T08:15:00.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.756+0000 7facfa8d3740 1 --2- 172.21.15.27:0/2180500588 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556290dc2da0 0x556290dc51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:00.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.756+0000 7facfa8d3740 4 client.16044 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:15:00.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.756+0000 7facfa8d3740 1 -- 172.21.15.27:0/2180500588 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556290d167f0 con 0x556290dc2da0 2024-09-19T08:15:00.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.756+0000 7facf6296640 1 --2- 172.21.15.27:0/2180500588 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556290dc2da0 0x556290dc51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:00.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.756+0000 7facd5ffb640 10 client.16044 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:00.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.756+0000 7facf6296640 1 --2- 172.21.15.27:0/2180500588 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556290dc2da0 0x556290dc51d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8b0268e66a8caea server_cookie=942b3388efde6421 in_seq=0 out_seq=0 2024-09-19T08:15:00.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.757+0000 7facd5ffb640 1 -- 172.21.15.27:0/2180500588 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556290d167f0 con 0x556290dc2da0 2024-09-19T08:15:00.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.757+0000 7facd5ffb640 10 client.16044 handle_command_reply: tid=0 2024-09-19T08:15:00.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.757+0000 7facfa8d3740 1 client.16044 shutdown 2024-09-19T08:15:00.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.757+0000 7facfa8d3740 1 -- 172.21.15.27:0/2180500588 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 msgr2=0x556290db0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:00.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.757+0000 7facfa8d3740 1 --2- 172.21.15.27:0/2180500588 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290db0600 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7face4004180 tx=0x7face40058d0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.757+0000 7facfa8d3740 1 -- 172.21.15.27:0/2180500588 shutdown_connections 2024-09-19T08:15:00.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.757+0000 7facfa8d3740 1 --2- 172.21.15.27:0/2180500588 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556290dc2da0 0x556290dc51d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.757+0000 7facfa8d3740 1 --2- 172.21.15.27:0/2180500588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556290db3150 0x556290db0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.757+0000 7facfa8d3740 1 --2- 172.21.15.27:0/2180500588 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290db0600 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.757+0000 7facfa8d3740 1 --2- 172.21.15.27:0/2180500588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556290da3a80 0x556290db00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.757+0000 7facfa8d3740 1 -- 172.21.15.27:0/2180500588 >> 172.21.15.27:0/2180500588 conn(0x556290da00f0 msgr2=0x556290d9f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:00.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.757+0000 7facd5ffb640 0 client.16044 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:00.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.757+0000 7facfa8d3740 1 -- 172.21.15.27:0/2180500588 shutdown_connections 2024-09-19T08:15:00.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.757+0000 7facfa8d3740 1 -- 172.21.15.27:0/2180500588 wait complete. 2024-09-19T08:15:00.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.757+0000 7facfa8d3740 20 client.16044 trim_cache size 0 max 16384 2024-09-19T08:15:00.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.775+0000 7facfa8d3740 1 Processor -- start 2024-09-19T08:15:00.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.775+0000 7facfa8d3740 1 -- start start 2024-09-19T08:15:00.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.775+0000 7facfa8d3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556290da3a80 0x556290daf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:00.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.775+0000 7facfa8d3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290dcaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:00.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.775+0000 7facfa8d3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556290db3150 0x556290dcafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:00.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.775+0000 7facfa8d3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7facf01a9520 con 0x556290da43a0 2024-09-19T08:15:00.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.775+0000 7facfa8d3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7facf01abd60 con 0x556290db3150 2024-09-19T08:15:00.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.775+0000 7facfa8d3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7facf01a9b70 con 0x556290da3a80 2024-09-19T08:15:00.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.775+0000 7facf5a95640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290dcaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:00.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.775+0000 7facf5a95640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290dcaaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49934/0 (socket says 172.21.15.27:49934) 2024-09-19T08:15:00.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.775+0000 7facf5a95640 1 -- 172.21.15.27:0/2309368357 learned_addr learned my addr 172.21.15.27:0/2309368357 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:00.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.775+0000 7facf5a95640 1 -- 172.21.15.27:0/2309368357 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556290da3a80 msgr2=0x556290daf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:00.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.775+0000 7facf5a95640 1 --2- 172.21.15.27:0/2309368357 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556290da3a80 0x556290daf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.775+0000 7facf5a95640 1 -- 172.21.15.27:0/2309368357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556290db3150 msgr2=0x556290dcafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:00.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.775+0000 7facf5a95640 1 --2- 172.21.15.27:0/2309368357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556290db3150 0x556290dcafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.775+0000 7facf5a95640 1 -- 172.21.15.27:0/2309368357 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556290dbef60 con 0x556290da43a0 2024-09-19T08:15:00.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.775+0000 7facf5a95640 1 --2- 172.21.15.27:0/2309368357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290dcaaa0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7face403da30 tx=0x7face402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655e65341b148d41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:00.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.776+0000 7facd7fff640 1 -- 172.21.15.27:0/2309368357 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4031790 con 0x556290da43a0 2024-09-19T08:15:00.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.776+0000 7facd7fff640 1 -- 172.21.15.27:0/2309368357 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7face404e070 con 0x556290da43a0 2024-09-19T08:15:00.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.776+0000 7facd7fff640 1 -- 172.21.15.27:0/2309368357 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4053db0 con 0x556290da43a0 2024-09-19T08:15:00.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.776+0000 7facfa8d3740 1 -- 172.21.15.27:0/2309368357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 msgr2=0x556290dcaaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:00.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.776+0000 7facfa8d3740 1 --2- 172.21.15.27:0/2309368357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290dcaaa0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7face403da30 tx=0x7face402a420 comp rx=0 tx=0).stop 2024-09-19T08:15:00.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.776+0000 7facfa8d3740 1 -- 172.21.15.27:0/2309368357 shutdown_connections 2024-09-19T08:15:00.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.776+0000 7facfa8d3740 1 --2- 172.21.15.27:0/2309368357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556290db3150 0x556290dcafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.776+0000 7facfa8d3740 1 --2- 172.21.15.27:0/2309368357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290dcaaa0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.776+0000 7facfa8d3740 1 --2- 172.21.15.27:0/2309368357 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556290da3a80 0x556290daf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.776+0000 7facfa8d3740 1 -- 172.21.15.27:0/2309368357 >> 172.21.15.27:0/2309368357 conn(0x556290da00f0 msgr2=0x556290da5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:00.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.776+0000 7facfa8d3740 1 -- 172.21.15.27:0/2309368357 shutdown_connections 2024-09-19T08:15:00.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.776+0000 7facfa8d3740 1 -- 172.21.15.27:0/2309368357 wait complete. 2024-09-19T08:15:00.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.777+0000 7facfa8d3740 1 -- start start 2024-09-19T08:15:00.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.777+0000 7facfa8d3740 1 Processor -- start 2024-09-19T08:15:00.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.777+0000 7facfa8d3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556290da3a80 0x556290db7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:00.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.777+0000 7facfa8d3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290db7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:00.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.777+0000 7facfa8d3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556290db3150 0x556290e26ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:00.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.777+0000 7facfa8d3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7facf01aa220 con 0x556290da43a0 2024-09-19T08:15:00.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.777+0000 7facfa8d3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7facf01ab690 con 0x556290db3150 2024-09-19T08:15:00.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.777+0000 7facfa8d3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7facf01aa8f0 con 0x556290da3a80 2024-09-19T08:15:00.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.777+0000 7facfa8d3740 10 client.0 _ll_register_callbacks cb 0x7face4009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:15:00.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.777+0000 7facf5a95640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290db7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:00.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.777+0000 7facf5a95640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290db7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49946/0 (socket says 172.21.15.27:49946) 2024-09-19T08:15:00.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.777+0000 7facf5a95640 1 -- 172.21.15.27:0/1888765583 learned_addr learned my addr 172.21.15.27:0/1888765583 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:00.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.777+0000 7facf6a97640 1 --2- 172.21.15.27:0/1888765583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556290db3150 0x556290e26ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:00.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.777+0000 7facf6296640 1 --2- 172.21.15.27:0/1888765583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556290da3a80 0x556290db7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:00.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.777+0000 7facf5a95640 1 -- 172.21.15.27:0/1888765583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556290da3a80 msgr2=0x556290db7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:00.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.777+0000 7facf5a95640 1 --2- 172.21.15.27:0/1888765583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556290da3a80 0x556290db7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.777+0000 7facf5a95640 1 -- 172.21.15.27:0/1888765583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556290db3150 msgr2=0x556290e26ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:00.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.777+0000 7facf5a95640 1 --2- 172.21.15.27:0/1888765583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556290db3150 0x556290e26ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.777+0000 7facf5a95640 1 -- 172.21.15.27:0/1888765583 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556290e270f0 con 0x556290da43a0 2024-09-19T08:15:00.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.777+0000 7facf6296640 1 --2- 172.21.15.27:0/1888765583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556290da3a80 0x556290db7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:15:00.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.778+0000 7facf5a95640 1 --2- 172.21.15.27:0/1888765583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290db7c60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7face403d9b0 tx=0x7face4053d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f688f66559bab78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:00.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.778+0000 7facd5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:15:00.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.778+0000 7facd5ffb640 1 -- 172.21.15.27:0/1888765583 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4003e50 con 0x556290da43a0 2024-09-19T08:15:00.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.778+0000 7facd5ffb640 1 -- 172.21.15.27:0/1888765583 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7face4053680 con 0x556290da43a0 2024-09-19T08:15:00.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.778+0000 7facfa8d3740 1 -- 172.21.15.27:0/1888765583 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7face404e070 con 0x556290da43a0 2024-09-19T08:15:00.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.778+0000 7facd5ffb640 1 -- 172.21.15.27:0/1888765583 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7face40538c0 con 0x556290da43a0 2024-09-19T08:15:00.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.778+0000 7facfa8d3740 10 client.16050 fetch_fsmap learned FSMap version 20 2024-09-19T08:15:00.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.778+0000 7facfa8d3740 1 -- 172.21.15.27:0/1888765583 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556290e2e4a0 con 0x556290da43a0 2024-09-19T08:15:00.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.778+0000 7facd5ffb640 1 -- 172.21.15.27:0/1888765583 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7face404e070 con 0x556290da43a0 2024-09-19T08:15:00.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.778+0000 7facd5ffb640 1 -- 172.21.15.27:0/1888765583 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7face406b020 con 0x556290da43a0 2024-09-19T08:15:00.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.778+0000 7facfa8d3740 10 client.16050 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:15:00.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.778+0000 7facfa8d3740 10 client.16050 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:15:00.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.778+0000 7facfa8d3740 20 client.16050 populate_metadata read hostname 'smithi027' 2024-09-19T08:15:00.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.778+0000 7facfa8d3740 1 --2- 172.21.15.27:0/1888765583 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556290e2eb50 0x556290e30f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:00.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.778+0000 7facfa8d3740 4 client.16050 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:15:00.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.778+0000 7facfa8d3740 1 -- 172.21.15.27:0/1888765583 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556290d10d00 con 0x556290e2eb50 2024-09-19T08:15:00.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.779+0000 7facf6296640 1 --2- 172.21.15.27:0/1888765583 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556290e2eb50 0x556290e30f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:00.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.779+0000 7facd5ffb640 10 client.16050 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:00.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.779+0000 7facf6296640 1 --2- 172.21.15.27:0/1888765583 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556290e2eb50 0x556290e30f70 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=faefe9a1cdeb425d server_cookie=9e9e9d2d844a25e6 in_seq=0 out_seq=0 2024-09-19T08:15:00.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.780+0000 7facd5ffb640 1 -- 172.21.15.27:0/1888765583 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556290d10d00 con 0x556290e2eb50 2024-09-19T08:15:00.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.780+0000 7facd5ffb640 10 client.16050 handle_command_reply: tid=0 2024-09-19T08:15:00.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.780+0000 7facfa8d3740 1 client.16050 shutdown 2024-09-19T08:15:00.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.780+0000 7facfa8d3740 1 -- 172.21.15.27:0/1888765583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 msgr2=0x556290db7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:00.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.780+0000 7facfa8d3740 1 --2- 172.21.15.27:0/1888765583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290db7c60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7face403d9b0 tx=0x7face4053d20 comp rx=0 tx=0).stop 2024-09-19T08:15:00.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.780+0000 7facfa8d3740 1 -- 172.21.15.27:0/1888765583 shutdown_connections 2024-09-19T08:15:00.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.780+0000 7facfa8d3740 1 --2- 172.21.15.27:0/1888765583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556290db3150 0x556290e26ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.780+0000 7facfa8d3740 1 --2- 172.21.15.27:0/1888765583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556290da43a0 0x556290db7c60 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.780+0000 7facfa8d3740 1 --2- 172.21.15.27:0/1888765583 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556290e2eb50 0x556290e30f70 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.780+0000 7facfa8d3740 1 --2- 172.21.15.27:0/1888765583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556290da3a80 0x556290db7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.780+0000 7facfa8d3740 1 -- 172.21.15.27:0/1888765583 >> 172.21.15.27:0/1888765583 conn(0x556290da00f0 msgr2=0x556290d9ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:00.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.781+0000 7facd5ffb640 0 client.16050 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:00.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.781+0000 7facfa8d3740 1 -- 172.21.15.27:0/1888765583 shutdown_connections 2024-09-19T08:15:00.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.781+0000 7facfa8d3740 1 -- 172.21.15.27:0/1888765583 wait complete. 2024-09-19T08:15:00.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.781+0000 7facfa8d3740 20 client.16050 trim_cache size 0 max 16384 2024-09-19T08:15:00.785 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:15:00.785 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:15:00.785 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "cf5e1abc-f4b4-4845-ba4d-23cdffd9995f", 2024-09-19T08:15:00.785 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:15:00.785 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:15:00.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.781+0000 7facf84fa640 1 -- 172.21.15.27:0/1800781962 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7facd80a33b0 msgr2=0x7facd80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:00.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.781+0000 7facf84fa640 1 --2- 172.21.15.27:0/1800781962 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7facd80a33b0 0x7facd80a5870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7face4005940 tx=0x7face4005fd0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.781+0000 7facf84fa640 1 -- 172.21.15.27:0/1800781962 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facf01082a0 msgr2=0x7facf019cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:00.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.781+0000 7facf84fa640 1 --2- 172.21.15.27:0/1800781962 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facf01082a0 0x7facf019cf10 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7face000cce0 tx=0x7face000a620 comp rx=0 tx=0).stop 2024-09-19T08:15:00.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.781+0000 7facf84fa640 1 -- 172.21.15.27:0/1800781962 shutdown_connections 2024-09-19T08:15:00.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.781+0000 7facf84fa640 1 --2- 172.21.15.27:0/1800781962 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7facd80a33b0 0x7facd80a5870 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.781+0000 7facf84fa640 1 --2- 172.21.15.27:0/1800781962 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facf01082a0 0x7facf019cf10 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.782+0000 7facf84fa640 1 --2- 172.21.15.27:0/1800781962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf01036e0 0x7facf0198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.782+0000 7facf84fa640 1 --2- 172.21.15.27:0/1800781962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7facf0102d30 0x7facf0198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:00.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.782+0000 7facf84fa640 1 -- 172.21.15.27:0/1800781962 >> 172.21.15.27:0/1800781962 conn(0x7facf00fc7d0 msgr2=0x7facf0106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:00.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.782+0000 7facf84fa640 1 -- 172.21.15.27:0/1800781962 shutdown_connections 2024-09-19T08:15:00.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:00.782+0000 7facf84fa640 1 -- 172.21.15.27:0/1800781962 wait complete. 2024-09-19T08:15:00.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:00 smithi155 ceph-mon[35362]: pgmap v122: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:00 smithi203 ceph-mon[35198]: pgmap v122: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:01.637 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:15:01.894 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:15:01.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:01 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:15:01.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:01 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:15:01.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:01 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:15:01.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:01 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:15:02.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:01 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:15:02.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:01 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:15:02.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:01 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:15:02.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:01 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:15:02.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:01 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:15:02.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:01 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:15:02.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:01 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:15:02.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:01 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:15:02.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.399+0000 7f4743958640 1 -- 172.21.15.27:0/1833445515 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f473c102790 msgr2=0x7f473c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:02.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.399+0000 7f4743958640 1 --2- 172.21.15.27:0/1833445515 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f473c102790 0x7f473c1067e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4730009900 tx=0x7f473002a410 comp rx=0 tx=0).stop 2024-09-19T08:15:02.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.399+0000 7f4743958640 1 -- 172.21.15.27:0/1833445515 shutdown_connections 2024-09-19T08:15:02.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.399+0000 7f4743958640 1 --2- 172.21.15.27:0/1833445515 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f473c106f10 0x7f473c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.399+0000 7f4743958640 1 --2- 172.21.15.27:0/1833445515 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f473c102790 0x7f473c1067e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.399+0000 7f4743958640 1 --2- 172.21.15.27:0/1833445515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f473c101de0 0x7f473c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.399+0000 7f4743958640 1 -- 172.21.15.27:0/1833445515 >> 172.21.15.27:0/1833445515 conn(0x7f473c0fd8c0 msgr2=0x7f473c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:02.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.400+0000 7f4743958640 1 -- 172.21.15.27:0/1833445515 shutdown_connections 2024-09-19T08:15:02.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.400+0000 7f4743958640 1 -- 172.21.15.27:0/1833445515 wait complete. 2024-09-19T08:15:02.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.400+0000 7f4743958640 1 Processor -- start 2024-09-19T08:15:02.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.400+0000 7f4743958640 1 -- start start 2024-09-19T08:15:02.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.400+0000 7f4743958640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f473c101de0 0x7f473c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:02.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.400+0000 7f4743958640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f473c102790 0x7f473c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:02.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.400+0000 7f4743958640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f473c106f10 0x7f473c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:02.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.400+0000 7f4743958640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f473c112010 con 0x7f473c102790 2024-09-19T08:15:02.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.400+0000 7f4743958640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f473c111e90 con 0x7f473c106f10 2024-09-19T08:15:02.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.400+0000 7f4743958640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f473c112190 con 0x7f473c101de0 2024-09-19T08:15:02.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.401+0000 7f4740ef3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f473c102790 0x7f473c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:02.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.401+0000 7f4740ef3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f473c102790 0x7f473c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49974/0 (socket says 172.21.15.27:49974) 2024-09-19T08:15:02.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.401+0000 7f4740ef3640 1 -- 172.21.15.27:0/1143664765 learned_addr learned my addr 172.21.15.27:0/1143664765 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:02.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.401+0000 7f47416f4640 1 --2- 172.21.15.27:0/1143664765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f473c101de0 0x7f473c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:02.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.401+0000 7f4741ef5640 1 --2- 172.21.15.27:0/1143664765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f473c106f10 0x7f473c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:02.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.401+0000 7f4740ef3640 1 -- 172.21.15.27:0/1143664765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f473c101de0 msgr2=0x7f473c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:02.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.401+0000 7f4740ef3640 1 --2- 172.21.15.27:0/1143664765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f473c101de0 0x7f473c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.401+0000 7f4740ef3640 1 -- 172.21.15.27:0/1143664765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f473c106f10 msgr2=0x7f473c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:02.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.401+0000 7f4740ef3640 1 --2- 172.21.15.27:0/1143664765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f473c106f10 0x7f473c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.401+0000 7f4740ef3640 1 -- 172.21.15.27:0/1143664765 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473c1a6a70 con 0x7f473c102790 2024-09-19T08:15:02.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.401+0000 7f4741ef5640 1 --2- 172.21.15.27:0/1143664765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f473c106f10 0x7f473c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:15:02.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.401+0000 7f4740ef3640 1 --2- 172.21.15.27:0/1143664765 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f473c102790 0x7f473c074a30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4730005ab0 tx=0x7f47300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:02.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.401+0000 7f473a7fc640 1 -- 172.21.15.27:0/1143664765 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473003f030 con 0x7f473c102790 2024-09-19T08:15:02.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.401+0000 7f4743958640 1 -- 172.21.15.27:0/1143664765 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473c1a6d00 con 0x7f473c102790 2024-09-19T08:15:02.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.401+0000 7f473a7fc640 1 -- 172.21.15.27:0/1143664765 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4730003ce0 con 0x7f473c102790 2024-09-19T08:15:02.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.402+0000 7f473a7fc640 1 -- 172.21.15.27:0/1143664765 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4730035070 con 0x7f473c102790 2024-09-19T08:15:02.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.402+0000 7f4743958640 1 -- 172.21.15.27:0/1143664765 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f473c1a71d0 con 0x7f473c102790 2024-09-19T08:15:02.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.405+0000 7f4745d31740 1 Processor -- start 2024-09-19T08:15:02.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.405+0000 7f4745d31740 1 -- start start 2024-09-19T08:15:02.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.405+0000 7f473a7fc640 1 -- 172.21.15.27:0/1143664765 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f4730042030 con 0x7f473c102790 2024-09-19T08:15:02.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.405+0000 7f4745d31740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 0x55bfa32d7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:02.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.405+0000 7f4745d31740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32d7dc0 0x55bfa32e2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:02.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.405+0000 7f4745d31740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32e2680 0x55bfa32e4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:02.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.405+0000 7f4745d31740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55bfa323d2e0 con 0x55bfa32e2680 2024-09-19T08:15:02.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.405+0000 7f4745d31740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55bfa31e4ce0 con 0x55bfa32d74a0 2024-09-19T08:15:02.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.405+0000 7f4745d31740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55bfa32392a0 con 0x55bfa32d7dc0 2024-09-19T08:15:02.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.405+0000 7f4740ef3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32e2680 0x55bfa32e4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:02.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.405+0000 7f4741ef5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 0x55bfa32d7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:02.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.405+0000 7f4741ef5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 0x55bfa32d7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.27:43150/0 (socket says 172.21.15.27:43150) 2024-09-19T08:15:02.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.405+0000 7f4740ef3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32e2680 0x55bfa32e4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49990/0 (socket says 172.21.15.27:49990) 2024-09-19T08:15:02.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.405+0000 7f4741ef5640 1 -- 172.21.15.27:0/3747046455 learned_addr learned my addr 172.21.15.27:0/3747046455 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:02.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.405+0000 7f47416f4640 1 --2- 172.21.15.27:0/3747046455 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32d7dc0 0x55bfa32e2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:02.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.406+0000 7f4740ef3640 1 -- 172.21.15.27:0/3747046455 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32d7dc0 msgr2=0x55bfa32e2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:02.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.406+0000 7f4740ef3640 1 --2- 172.21.15.27:0/3747046455 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32d7dc0 0x55bfa32e2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.406+0000 7f4740ef3640 1 -- 172.21.15.27:0/3747046455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 msgr2=0x55bfa32d7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:02.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.406+0000 7f4740ef3640 1 --2- 172.21.15.27:0/3747046455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 0x55bfa32d7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.406+0000 7f4740ef3640 1 -- 172.21.15.27:0/3747046455 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfa31c9440 con 0x55bfa32e2680 2024-09-19T08:15:02.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.406+0000 7f4740ef3640 1 --2- 172.21.15.27:0/3747046455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32e2680 0x55bfa32e4a70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f47300edd00 tx=0x7f47300f6800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2018a991e610e98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:02.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.406+0000 7f473a7fc640 1 --2- 172.21.15.27:0/1143664765 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f47240a3430 0x7f47240a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:02.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.406+0000 7f4741ef5640 1 --2- 172.21.15.27:0/1143664765 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f47240a3430 0x7f47240a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:02.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.406+0000 7f47237fe640 1 -- 172.21.15.27:0/3747046455 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47300b8b30 con 0x55bfa32e2680 2024-09-19T08:15:02.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.406+0000 7f47237fe640 1 -- 172.21.15.27:0/3747046455 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47300fd030 con 0x55bfa32e2680 2024-09-19T08:15:02.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.406+0000 7f47237fe640 1 -- 172.21.15.27:0/3747046455 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47300bbce0 con 0x55bfa32e2680 2024-09-19T08:15:02.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.406+0000 7f473a7fc640 1 -- 172.21.15.27:0/1143664765 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f47300f0560 con 0x7f473c102790 2024-09-19T08:15:02.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.407+0000 7f4745d31740 1 -- 172.21.15.27:0/3747046455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32e2680 msgr2=0x55bfa32e4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:02.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.407+0000 7f4741ef5640 1 --2- 172.21.15.27:0/1143664765 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f47240a3430 0x7f47240a58f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4734006fd0 tx=0x7f4734008040 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:02.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.407+0000 7f4745d31740 1 --2- 172.21.15.27:0/3747046455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32e2680 0x55bfa32e4a70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f47300edd00 tx=0x7f47300f6800 comp rx=0 tx=0).stop 2024-09-19T08:15:02.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.407+0000 7f4745d31740 1 -- 172.21.15.27:0/3747046455 shutdown_connections 2024-09-19T08:15:02.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.407+0000 7f4745d31740 1 --2- 172.21.15.27:0/3747046455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32e2680 0x55bfa32e4a70 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.407+0000 7f4745d31740 1 --2- 172.21.15.27:0/3747046455 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32d7dc0 0x55bfa32e2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.407+0000 7f4745d31740 1 --2- 172.21.15.27:0/3747046455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 0x55bfa32d7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.407+0000 7f4745d31740 1 -- 172.21.15.27:0/3747046455 >> 172.21.15.27:0/3747046455 conn(0x55bfa32d3a30 msgr2=0x55bfa32d3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:02.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.407+0000 7f4745d31740 1 -- 172.21.15.27:0/3747046455 shutdown_connections 2024-09-19T08:15:02.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.407+0000 7f4745d31740 1 -- 172.21.15.27:0/3747046455 wait complete. 2024-09-19T08:15:02.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.407+0000 7f4745d31740 1 -- start start 2024-09-19T08:15:02.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.407+0000 7f4745d31740 1 Processor -- start 2024-09-19T08:15:02.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f4745d31740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 0x55bfa32e1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:02.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f4745d31740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 0x55bfa32df1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:02.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f4745d31740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32e2680 0x55bfa32df6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:02.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f4745d31740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55bfa32e5010 con 0x55bfa32d7dc0 2024-09-19T08:15:02.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f4745d31740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55bfa31f8050 con 0x55bfa32d74a0 2024-09-19T08:15:02.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f4745d31740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55bfa32e5190 con 0x55bfa32e2680 2024-09-19T08:15:02.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f4745d31740 10 client.0 _ll_register_callbacks cb 0x55bfa3238160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:15:02.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f4740ef3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 0x55bfa32df1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:02.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f4740ef3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 0x55bfa32df1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49998/0 (socket says 172.21.15.27:49998) 2024-09-19T08:15:02.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f4740ef3640 1 -- 172.21.15.27:0/2197464519 learned_addr learned my addr 172.21.15.27:0/2197464519 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:02.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f47416f4640 1 --2- 172.21.15.27:0/2197464519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 0x55bfa32e1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:02.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f4741ef5640 1 --2- 172.21.15.27:0/2197464519 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32e2680 0x55bfa32df6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:02.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f4740ef3640 1 -- 172.21.15.27:0/2197464519 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32e2680 msgr2=0x55bfa32df6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:02.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f4740ef3640 1 --2- 172.21.15.27:0/2197464519 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32e2680 0x55bfa32df6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f4740ef3640 1 -- 172.21.15.27:0/2197464519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 msgr2=0x55bfa32e1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:02.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f4740ef3640 1 --2- 172.21.15.27:0/2197464519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 0x55bfa32e1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f4740ef3640 1 -- 172.21.15.27:0/2197464519 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfa2fae3c0 con 0x55bfa32d7dc0 2024-09-19T08:15:02.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f47416f4640 1 --2- 172.21.15.27:0/2197464519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 0x55bfa32e1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:15:02.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f4741ef5640 1 --2- 172.21.15.27:0/2197464519 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32e2680 0x55bfa32df6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:15:02.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f4740ef3640 1 --2- 172.21.15.27:0/2197464519 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 0x55bfa32df1b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f47300b8cf0 tx=0x7f47300b91b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f064ffedac2c4bdf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:02.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.408+0000 7f4720ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:15:02.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.409+0000 7f4720ff9640 1 -- 172.21.15.27:0/2197464519 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4730049070 con 0x55bfa32d7dc0 2024-09-19T08:15:02.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.409+0000 7f4720ff9640 1 -- 172.21.15.27:0/2197464519 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f47300f6e40 con 0x55bfa32d7dc0 2024-09-19T08:15:02.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.409+0000 7f4745d31740 1 -- 172.21.15.27:0/2197464519 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47300fd030 con 0x55bfa32d7dc0 2024-09-19T08:15:02.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.409+0000 7f4720ff9640 1 -- 172.21.15.27:0/2197464519 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f47300bc010 con 0x55bfa32d7dc0 2024-09-19T08:15:02.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.409+0000 7f4745d31740 10 client.16062 fetch_fsmap learned FSMap version 20 2024-09-19T08:15:02.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.409+0000 7f4745d31740 1 -- 172.21.15.27:0/2197464519 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55bfa32e5010 con 0x55bfa32d7dc0 2024-09-19T08:15:02.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.409+0000 7f4720ff9640 1 -- 172.21.15.27:0/2197464519 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47300fd030 con 0x55bfa32d7dc0 2024-09-19T08:15:02.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.409+0000 7f4720ff9640 1 -- 172.21.15.27:0/2197464519 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f47300edf80 con 0x55bfa32d7dc0 2024-09-19T08:15:02.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.409+0000 7f4745d31740 10 client.16062 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:15:02.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.409+0000 7f4745d31740 10 client.16062 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:15:02.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.409+0000 7f4745d31740 20 client.16062 populate_metadata read hostname 'smithi027' 2024-09-19T08:15:02.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.409+0000 7f4745d31740 1 --2- 172.21.15.27:0/2197464519 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55bfa32f1b20 0x55bfa32f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:02.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.409+0000 7f4745d31740 4 client.16062 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:15:02.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.409+0000 7f4745d31740 1 -- 172.21.15.27:0/2197464519 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfa324a850 con 0x55bfa32f1b20 2024-09-19T08:15:02.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.410+0000 7f47416f4640 1 --2- 172.21.15.27:0/2197464519 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55bfa32f1b20 0x55bfa32f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:02.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.410+0000 7f4720ff9640 10 client.16062 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:02.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.410+0000 7f47416f4640 1 --2- 172.21.15.27:0/2197464519 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55bfa32f1b20 0x55bfa32f3f50 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35b4f64aa0580b6c server_cookie=7bf1bd6207cbabb5 in_seq=0 out_seq=0 2024-09-19T08:15:02.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.411+0000 7f4720ff9640 1 -- 172.21.15.27:0/2197464519 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bfa324a850 con 0x55bfa32f1b20 2024-09-19T08:15:02.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.411+0000 7f4720ff9640 10 client.16062 handle_command_reply: tid=0 2024-09-19T08:15:02.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.411+0000 7f4745d31740 1 client.16062 shutdown 2024-09-19T08:15:02.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.411+0000 7f4745d31740 1 -- 172.21.15.27:0/2197464519 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 msgr2=0x55bfa32df1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:02.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.411+0000 7f4745d31740 1 --2- 172.21.15.27:0/2197464519 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 0x55bfa32df1b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f47300b8cf0 tx=0x7f47300b91b0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.411+0000 7f4745d31740 1 -- 172.21.15.27:0/2197464519 shutdown_connections 2024-09-19T08:15:02.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.411+0000 7f4745d31740 1 --2- 172.21.15.27:0/2197464519 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55bfa32f1b20 0x55bfa32f3f50 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.411+0000 7f4745d31740 1 --2- 172.21.15.27:0/2197464519 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32e2680 0x55bfa32df6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.411+0000 7f4745d31740 1 --2- 172.21.15.27:0/2197464519 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 0x55bfa32df1b0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.411+0000 7f4745d31740 1 --2- 172.21.15.27:0/2197464519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 0x55bfa32e1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.411+0000 7f4720ff9640 0 client.16062 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:02.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.411+0000 7f4745d31740 1 -- 172.21.15.27:0/2197464519 >> 172.21.15.27:0/2197464519 conn(0x55bfa32d3a30 msgr2=0x55bfa32d9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:02.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.411+0000 7f4745d31740 1 -- 172.21.15.27:0/2197464519 shutdown_connections 2024-09-19T08:15:02.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.411+0000 7f4745d31740 1 -- 172.21.15.27:0/2197464519 wait complete. 2024-09-19T08:15:02.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.411+0000 7f4745d31740 20 client.16062 trim_cache size 0 max 16384 2024-09-19T08:15:02.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.429+0000 7f4745d31740 1 Processor -- start 2024-09-19T08:15:02.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.429+0000 7f4745d31740 1 -- start start 2024-09-19T08:15:02.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.429+0000 7f4745d31740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32d3a30 0x55bfa32ee170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:02.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.429+0000 7f4745d31740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 0x55bfa32f9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:02.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.429+0000 7f4745d31740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 0x55bfa32f9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:02.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.429+0000 7f4745d31740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f473c1ada20 con 0x55bfa32d7dc0 2024-09-19T08:15:02.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.429+0000 7f4745d31740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f473c1b0280 con 0x55bfa32d74a0 2024-09-19T08:15:02.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.429+0000 7f4745d31740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f473c1ae070 con 0x55bfa32d3a30 2024-09-19T08:15:02.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.429+0000 7f4741ef5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 0x55bfa32f9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:02.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.429+0000 7f4741ef5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 0x55bfa32f9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50004/0 (socket says 172.21.15.27:50004) 2024-09-19T08:15:02.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.429+0000 7f4741ef5640 1 -- 172.21.15.27:0/2867095740 learned_addr learned my addr 172.21.15.27:0/2867095740 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:02.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.429+0000 7f47416f4640 1 --2- 172.21.15.27:0/2867095740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32d3a30 0x55bfa32ee170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:02.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.430+0000 7f4740ef3640 1 --2- 172.21.15.27:0/2867095740 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 0x55bfa32f9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:02.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.430+0000 7f4741ef5640 1 -- 172.21.15.27:0/2867095740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32d3a30 msgr2=0x55bfa32ee170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:02.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.430+0000 7f4741ef5640 1 --2- 172.21.15.27:0/2867095740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32d3a30 0x55bfa32ee170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.430+0000 7f4741ef5640 1 -- 172.21.15.27:0/2867095740 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 msgr2=0x55bfa32f9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:02.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.430+0000 7f4741ef5640 1 --2- 172.21.15.27:0/2867095740 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 0x55bfa32f9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.430+0000 7f4741ef5640 1 -- 172.21.15.27:0/2867095740 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfa32d3860 con 0x55bfa32d7dc0 2024-09-19T08:15:02.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.430+0000 7f47416f4640 1 --2- 172.21.15.27:0/2867095740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32d3a30 0x55bfa32ee170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:15:02.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.430+0000 7f4740ef3640 1 --2- 172.21.15.27:0/2867095740 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 0x55bfa32f9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:15:02.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.430+0000 7f4741ef5640 1 --2- 172.21.15.27:0/2867095740 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 0x55bfa32f9d60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4734007910 tx=0x7f4734013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf81d97ecdda3de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:02.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.430+0000 7f4722ffd640 1 -- 172.21.15.27:0/2867095740 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473401c040 con 0x55bfa32d7dc0 2024-09-19T08:15:02.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.430+0000 7f4722ffd640 1 -- 172.21.15.27:0/2867095740 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4734026070 con 0x55bfa32d7dc0 2024-09-19T08:15:02.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.430+0000 7f4722ffd640 1 -- 172.21.15.27:0/2867095740 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734014cf0 con 0x55bfa32d7dc0 2024-09-19T08:15:02.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.431+0000 7f4745d31740 1 -- 172.21.15.27:0/2867095740 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 msgr2=0x55bfa32f9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:02.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.431+0000 7f4745d31740 1 --2- 172.21.15.27:0/2867095740 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 0x55bfa32f9d60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4734007910 tx=0x7f4734013000 comp rx=0 tx=0).stop 2024-09-19T08:15:02.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.431+0000 7f4745d31740 1 -- 172.21.15.27:0/2867095740 shutdown_connections 2024-09-19T08:15:02.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.431+0000 7f4745d31740 1 --2- 172.21.15.27:0/2867095740 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 0x55bfa32f9d60 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.431+0000 7f4745d31740 1 --2- 172.21.15.27:0/2867095740 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 0x55bfa32f9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.431+0000 7f4745d31740 1 --2- 172.21.15.27:0/2867095740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32d3a30 0x55bfa32ee170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.431+0000 7f4745d31740 1 -- 172.21.15.27:0/2867095740 >> 172.21.15.27:0/2867095740 conn(0x55bfa32df850 msgr2=0x55bfa32e1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:02.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.431+0000 7f4745d31740 1 -- 172.21.15.27:0/2867095740 shutdown_connections 2024-09-19T08:15:02.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.431+0000 7f4745d31740 1 -- 172.21.15.27:0/2867095740 wait complete. 2024-09-19T08:15:02.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.432+0000 7f4745d31740 1 -- start start 2024-09-19T08:15:02.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.432+0000 7f4745d31740 1 Processor -- start 2024-09-19T08:15:02.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.432+0000 7f4745d31740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32d3a30 0x55bfa32ea7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:02.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.432+0000 7f4745d31740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 0x55bfa32e6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:02.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.432+0000 7f4745d31740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 0x55bfa32e7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:02.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.432+0000 7f4745d31740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f473c1ae740 con 0x55bfa32d7dc0 2024-09-19T08:15:02.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.432+0000 7f4745d31740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f473c1afbb0 con 0x55bfa32d74a0 2024-09-19T08:15:02.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.432+0000 7f4745d31740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f473c1aee10 con 0x55bfa32d3a30 2024-09-19T08:15:02.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.432+0000 7f4745d31740 10 client.0 _ll_register_callbacks cb 0x7f4734007220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:15:02.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.432+0000 7f4741ef5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 0x55bfa32e7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:02.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.432+0000 7f4741ef5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 0x55bfa32e7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50012/0 (socket says 172.21.15.27:50012) 2024-09-19T08:15:02.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.432+0000 7f4741ef5640 1 -- 172.21.15.27:0/1880114574 learned_addr learned my addr 172.21.15.27:0/1880114574 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:02.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.432+0000 7f47416f4640 1 --2- 172.21.15.27:0/1880114574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32d3a30 0x55bfa32ea7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:02.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.432+0000 7f4740ef3640 1 --2- 172.21.15.27:0/1880114574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 0x55bfa32e6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:02.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.433+0000 7f4741ef5640 1 -- 172.21.15.27:0/1880114574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32d3a30 msgr2=0x55bfa32ea7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:02.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.433+0000 7f4741ef5640 1 --2- 172.21.15.27:0/1880114574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32d3a30 0x55bfa32ea7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.433+0000 7f4741ef5640 1 -- 172.21.15.27:0/1880114574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 msgr2=0x55bfa32e6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:02.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.433+0000 7f4741ef5640 1 --2- 172.21.15.27:0/1880114574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 0x55bfa32e6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.433+0000 7f4741ef5640 1 -- 172.21.15.27:0/1880114574 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfa32d46c0 con 0x55bfa32d7dc0 2024-09-19T08:15:02.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.433+0000 7f4741ef5640 1 --2- 172.21.15.27:0/1880114574 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 0x55bfa32e7060 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4734007110 tx=0x7f47340107f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853ce6afada8d171 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:02.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.433+0000 7f4720ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:15:02.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.433+0000 7f4720ff9640 1 -- 172.21.15.27:0/1880114574 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734030020 con 0x55bfa32d7dc0 2024-09-19T08:15:02.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.433+0000 7f4745d31740 1 -- 172.21.15.27:0/1880114574 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4734026070 con 0x55bfa32d7dc0 2024-09-19T08:15:02.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.433+0000 7f4720ff9640 1 -- 172.21.15.27:0/1880114574 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f4734016de0 con 0x55bfa32d7dc0 2024-09-19T08:15:02.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.433+0000 7f4720ff9640 1 -- 172.21.15.27:0/1880114574 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f473403b050 con 0x55bfa32d7dc0 2024-09-19T08:15:02.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.433+0000 7f4745d31740 10 client.16068 fetch_fsmap learned FSMap version 20 2024-09-19T08:15:02.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.433+0000 7f4745d31740 1 -- 172.21.15.27:0/1880114574 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55bfa335d3f0 con 0x55bfa32d7dc0 2024-09-19T08:15:02.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.433+0000 7f4720ff9640 1 -- 172.21.15.27:0/1880114574 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4734026070 con 0x55bfa32d7dc0 2024-09-19T08:15:02.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.434+0000 7f4720ff9640 1 -- 172.21.15.27:0/1880114574 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f473402a410 con 0x55bfa32d7dc0 2024-09-19T08:15:02.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.434+0000 7f4745d31740 10 client.16068 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:15:02.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.434+0000 7f4745d31740 10 client.16068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:15:02.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.434+0000 7f4745d31740 20 client.16068 populate_metadata read hostname 'smithi027' 2024-09-19T08:15:02.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.434+0000 7f4745d31740 1 --2- 172.21.15.27:0/1880114574 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55bfa32e2680 0x55bfa335fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:02.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.434+0000 7f4745d31740 4 client.16068 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:15:02.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.434+0000 7f4745d31740 1 -- 172.21.15.27:0/1880114574 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bfa3244d60 con 0x55bfa32e2680 2024-09-19T08:15:02.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.434+0000 7f47416f4640 1 --2- 172.21.15.27:0/1880114574 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55bfa32e2680 0x55bfa335fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:02.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.435+0000 7f4720ff9640 10 client.16068 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:02.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.435+0000 7f47416f4640 1 --2- 172.21.15.27:0/1880114574 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55bfa32e2680 0x55bfa335fa70 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4844d23b9b7a886d server_cookie=aba7b932f2435f02 in_seq=0 out_seq=0 2024-09-19T08:15:02.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.435+0000 7f4720ff9640 1 -- 172.21.15.27:0/1880114574 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55bfa3244d60 con 0x55bfa32e2680 2024-09-19T08:15:02.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.435+0000 7f4720ff9640 10 client.16068 handle_command_reply: tid=0 2024-09-19T08:15:02.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.435+0000 7f4745d31740 1 client.16068 shutdown 2024-09-19T08:15:02.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.435+0000 7f4745d31740 1 -- 172.21.15.27:0/1880114574 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 msgr2=0x55bfa32e7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:02.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.435+0000 7f4745d31740 1 --2- 172.21.15.27:0/1880114574 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 0x55bfa32e7060 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4734007110 tx=0x7f47340107f0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.435+0000 7f4745d31740 1 -- 172.21.15.27:0/1880114574 shutdown_connections 2024-09-19T08:15:02.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.435+0000 7f4745d31740 1 --2- 172.21.15.27:0/1880114574 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfa32d7dc0 0x55bfa32e7060 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.435+0000 7f4745d31740 1 --2- 172.21.15.27:0/1880114574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfa32d74a0 0x55bfa32e6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.435+0000 7f4745d31740 1 --2- 172.21.15.27:0/1880114574 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55bfa32e2680 0x55bfa335fa70 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.435+0000 7f4745d31740 1 --2- 172.21.15.27:0/1880114574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfa32d3a30 0x55bfa32ea7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.435+0000 7f4745d31740 1 -- 172.21.15.27:0/1880114574 >> 172.21.15.27:0/1880114574 conn(0x55bfa32df850 msgr2=0x55bfa32d8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:02.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.435+0000 7f4720ff9640 0 client.16068 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:02.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.435+0000 7f4745d31740 1 -- 172.21.15.27:0/1880114574 shutdown_connections 2024-09-19T08:15:02.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.435+0000 7f4745d31740 1 -- 172.21.15.27:0/1880114574 wait complete. 2024-09-19T08:15:02.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.436+0000 7f4745d31740 20 client.16068 trim_cache size 0 max 16384 2024-09-19T08:15:02.451 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:15:02.451 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:15:02.451 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": { 2024-09-19T08:15:02.451 INFO:teuthology.orchestra.run.smithi027.stdout: "cf5e1abc-f4b4-4845-ba4d-23cdffd9995f": { 2024-09-19T08:15:02.451 INFO:teuthology.orchestra.run.smithi027.stdout: "path": "/", 2024-09-19T08:15:02.452 INFO:teuthology.orchestra.run.smithi027.stdout: "tag": "cf5e1abc-f4b4-4845-ba4d-23cdffd9995f", 2024-09-19T08:15:02.452 INFO:teuthology.orchestra.run.smithi027.stdout: "options": "recursive,force" 2024-09-19T08:15:02.452 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:15:02.452 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:15:02.452 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:15:02.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.436+0000 7f4743958640 1 -- 172.21.15.27:0/1143664765 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f47240a3430 msgr2=0x7f47240a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:02.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.436+0000 7f4743958640 1 --2- 172.21.15.27:0/1143664765 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f47240a3430 0x7f47240a58f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4734006fd0 tx=0x7f4734008040 comp rx=0 tx=0).stop 2024-09-19T08:15:02.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.436+0000 7f4743958640 1 -- 172.21.15.27:0/1143664765 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f473c102790 msgr2=0x7f473c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:02.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.436+0000 7f4743958640 1 --2- 172.21.15.27:0/1143664765 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f473c102790 0x7f473c074a30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4730005ab0 tx=0x7f47300042f0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.436+0000 7f4743958640 1 -- 172.21.15.27:0/1143664765 shutdown_connections 2024-09-19T08:15:02.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.436+0000 7f4743958640 1 --2- 172.21.15.27:0/1143664765 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f47240a3430 0x7f47240a58f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.436+0000 7f4743958640 1 --2- 172.21.15.27:0/1143664765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f473c106f10 0x7f473c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.436+0000 7f4743958640 1 --2- 172.21.15.27:0/1143664765 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f473c102790 0x7f473c074a30 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.436+0000 7f4743958640 1 --2- 172.21.15.27:0/1143664765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f473c101de0 0x7f473c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:02.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.436+0000 7f4743958640 1 -- 172.21.15.27:0/1143664765 >> 172.21.15.27:0/1143664765 conn(0x7f473c0fd8c0 msgr2=0x7f473c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:02.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.436+0000 7f4743958640 1 -- 172.21.15.27:0/1143664765 shutdown_connections 2024-09-19T08:15:02.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:02.436+0000 7f4743958640 1 -- 172.21.15.27:0/1143664765 wait complete. 2024-09-19T08:15:02.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:02 smithi155 ceph-mon[35362]: pgmap v123: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:03.001 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:02 smithi027 ceph-mon[31209]: pgmap v123: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:03.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:02 smithi203 ceph-mon[35198]: pgmap v123: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:03.115 INFO:tasks.cephfs.filesystem:scrub status for tag:cf5e1abc-f4b4-4845-ba4d-23cdffd9995f - {'path': '/', 'tag': 'cf5e1abc-f4b4-4845-ba4d-23cdffd9995f', 'options': 'recursive,force'} 2024-09-19T08:15:04.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:04 smithi155 ceph-mon[35362]: pgmap v124: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:15:05.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:04 smithi027 ceph-mon[31209]: pgmap v124: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:15:05.007 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:04 smithi203 ceph-mon[35198]: pgmap v124: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:15:05.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:05 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:15:06.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:05 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:15:06.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:05 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:15:06.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:06 smithi155 ceph-mon[35362]: pgmap v125: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:15:07.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:06 smithi027 ceph-mon[31209]: pgmap v125: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:15:07.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:06 smithi203 ceph-mon[35198]: pgmap v125: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:15:08.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:08 smithi155 ceph-mon[35362]: pgmap v126: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:15:09.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:08 smithi027 ceph-mon[31209]: pgmap v126: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:15:09.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:08 smithi203 ceph-mon[35198]: pgmap v126: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:15:10.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:10 smithi155 ceph-mon[35362]: pgmap v127: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:15:11.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:10 smithi027 ceph-mon[31209]: pgmap v127: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:15:11.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:10 smithi203 ceph-mon[35198]: pgmap v127: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:15:11.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:11 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:15:12.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:11 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:15:12.007 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:11 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:15:12.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:12 smithi155 ceph-mon[35362]: pgmap v128: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:15:12.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:12 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:15:12.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:12 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:15:12.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:12 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:15:13.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:12 smithi027 ceph-mon[31209]: pgmap v128: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:15:13.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:12 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:15:13.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:12 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:15:13.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:12 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:15:13.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:12 smithi203 ceph-mon[35198]: pgmap v128: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:15:13.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:12 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:15:13.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:12 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:15:13.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:12 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:15:14.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:14 smithi155 ceph-mon[35362]: pgmap v129: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:15:15.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:14 smithi027 ceph-mon[31209]: pgmap v129: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:15:15.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:14 smithi203 ceph-mon[35198]: pgmap v129: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:15:16.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:16 smithi155 ceph-mon[35362]: pgmap v130: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T08:15:17.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:16 smithi027 ceph-mon[31209]: pgmap v130: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T08:15:17.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:16 smithi203 ceph-mon[35198]: pgmap v130: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T08:15:18.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:18 smithi155 ceph-mon[35362]: pgmap v131: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:15:19.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:18 smithi027 ceph-mon[31209]: pgmap v131: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:15:19.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:18 smithi203 ceph-mon[35198]: pgmap v131: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:15:20.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:20 smithi155 ceph-mon[35362]: pgmap v132: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T08:15:21.001 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:20 smithi027 ceph-mon[31209]: pgmap v132: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T08:15:21.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:20 smithi203 ceph-mon[35198]: pgmap v132: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T08:15:22.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:22 smithi155 ceph-mon[35362]: pgmap v133: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T08:15:23.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:22 smithi027 ceph-mon[31209]: pgmap v133: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T08:15:23.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:22 smithi203 ceph-mon[35198]: pgmap v133: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T08:15:24.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:24 smithi155 ceph-mon[35362]: pgmap v134: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T08:15:25.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:24 smithi027 ceph-mon[31209]: pgmap v134: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T08:15:25.086 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:24 smithi203 ceph-mon[35198]: pgmap v134: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T08:15:26.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:26 smithi155 ceph-mon[35362]: pgmap v135: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:27.001 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:26 smithi027 ceph-mon[31209]: pgmap v135: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:27.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:26 smithi203 ceph-mon[35198]: pgmap v135: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:28.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:28 smithi155 ceph-mon[35362]: pgmap v136: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:15:29.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:28 smithi027 ceph-mon[31209]: pgmap v136: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:15:29.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:28 smithi203 ceph-mon[35198]: pgmap v136: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:15:30.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:30 smithi155 ceph-mon[35362]: pgmap v137: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:31.001 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:30 smithi027 ceph-mon[31209]: pgmap v137: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:31.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:30 smithi203 ceph-mon[35198]: pgmap v137: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:32.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:32 smithi155 ceph-mon[35362]: pgmap v138: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:33.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:32 smithi027 ceph-mon[31209]: pgmap v138: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:33.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:32 smithi203 ceph-mon[35198]: pgmap v138: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:33.116 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:15:33.394 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:15:33.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.874+0000 7f5701d4b640 1 -- 172.21.15.27:0/2282183970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56fc1009d0 msgr2=0x7f56fc100db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:33.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.874+0000 7f5701d4b640 1 --2- 172.21.15.27:0/2282183970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56fc1009d0 0x7f56fc100db0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009900 tx=0x7f56ec02a410 comp rx=0 tx=0).stop 2024-09-19T08:15:33.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.875+0000 7f5701d4b640 1 -- 172.21.15.27:0/2282183970 shutdown_connections 2024-09-19T08:15:33.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.875+0000 7f5701d4b640 1 --2- 172.21.15.27:0/2282183970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56fc10e4f0 0x7f56fc110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.875+0000 7f5701d4b640 1 --2- 172.21.15.27:0/2282183970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56fc101380 0x7f56fc10dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.875+0000 7f5701d4b640 1 --2- 172.21.15.27:0/2282183970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56fc1009d0 0x7f56fc100db0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.875+0000 7f5701d4b640 1 -- 172.21.15.27:0/2282183970 >> 172.21.15.27:0/2282183970 conn(0x7f56fc0fc7d0 msgr2=0x7f56fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:33.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.875+0000 7f5701d4b640 1 -- 172.21.15.27:0/2282183970 shutdown_connections 2024-09-19T08:15:33.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.875+0000 7f5701d4b640 1 -- 172.21.15.27:0/2282183970 wait complete. 2024-09-19T08:15:33.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.875+0000 7f5701d4b640 1 Processor -- start 2024-09-19T08:15:33.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.875+0000 7f5701d4b640 1 -- start start 2024-09-19T08:15:33.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.876+0000 7f5701d4b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56fc1009d0 0x7f56fc1a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:33.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.876+0000 7f5701d4b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56fc101380 0x7f56fc1a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:33.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.876+0000 7f5701d4b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56fc10e4f0 0x7f56fc19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:33.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.876+0000 7f5701d4b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f56fc1142c0 con 0x7f56fc10e4f0 2024-09-19T08:15:33.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.876+0000 7f5701d4b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f56fc114140 con 0x7f56fc1009d0 2024-09-19T08:15:33.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.876+0000 7f5701d4b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f56fc114440 con 0x7f56fc101380 2024-09-19T08:15:33.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.876+0000 7f56fbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56fc10e4f0 0x7f56fc19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:33.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.876+0000 7f56fbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56fc10e4f0 0x7f56fc19a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54806/0 (socket says 172.21.15.27:54806) 2024-09-19T08:15:33.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.876+0000 7f56fbfff640 1 -- 172.21.15.27:0/867877224 learned_addr learned my addr 172.21.15.27:0/867877224 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:33.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.876+0000 7f56fb7fe640 1 --2- 172.21.15.27:0/867877224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56fc1009d0 0x7f56fc1a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:33.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.876+0000 7f56faffd640 1 --2- 172.21.15.27:0/867877224 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56fc101380 0x7f56fc1a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:33.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.876+0000 7f56fbfff640 1 -- 172.21.15.27:0/867877224 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56fc101380 msgr2=0x7f56fc1a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:33.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.876+0000 7f56fbfff640 1 --2- 172.21.15.27:0/867877224 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56fc101380 0x7f56fc1a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.876+0000 7f56fbfff640 1 -- 172.21.15.27:0/867877224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56fc1009d0 msgr2=0x7f56fc1a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:33.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.876+0000 7f56fbfff640 1 --2- 172.21.15.27:0/867877224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56fc1009d0 0x7f56fc1a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.876+0000 7f56fbfff640 1 -- 172.21.15.27:0/867877224 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56fc19ad00 con 0x7f56fc10e4f0 2024-09-19T08:15:33.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.876+0000 7f56fbfff640 1 --2- 172.21.15.27:0/867877224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56fc10e4f0 0x7f56fc19a5d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f56f400ccb0 tx=0x7f56f400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:33.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.877+0000 7f56f8ff9640 1 -- 172.21.15.27:0/867877224 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f400f450 con 0x7f56fc10e4f0 2024-09-19T08:15:33.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.877+0000 7f5701d4b640 1 -- 172.21.15.27:0/867877224 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56fc19aff0 con 0x7f56fc10e4f0 2024-09-19T08:15:33.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.877+0000 7f56f8ff9640 1 -- 172.21.15.27:0/867877224 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56f400fad0 con 0x7f56fc10e4f0 2024-09-19T08:15:33.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.877+0000 7f56f8ff9640 1 -- 172.21.15.27:0/867877224 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f4018bf0 con 0x7f56fc10e4f0 2024-09-19T08:15:33.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.877+0000 7f5701d4b640 1 -- 172.21.15.27:0/867877224 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56fc1a72e0 con 0x7f56fc10e4f0 2024-09-19T08:15:33.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.879+0000 7f56f8ff9640 1 -- 172.21.15.27:0/867877224 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f56f400f5f0 con 0x7f56fc10e4f0 2024-09-19T08:15:33.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.879+0000 7f5704124740 1 Processor -- start 2024-09-19T08:15:33.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.880+0000 7f5704124740 1 -- start start 2024-09-19T08:15:33.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.880+0000 7f5704124740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26a44a0 0x561cf26a4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:33.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.880+0000 7f5704124740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a4dc0 0x561cf26af140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:33.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.880+0000 7f5704124740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26af680 0x561cf26b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:33.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.880+0000 7f5704124740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x561cf260a2e0 con 0x561cf26a4dc0 2024-09-19T08:15:33.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.880+0000 7f5704124740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x561cf25b1ce0 con 0x561cf26af680 2024-09-19T08:15:33.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.880+0000 7f5704124740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561cf26062a0 con 0x561cf26a44a0 2024-09-19T08:15:33.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.880+0000 7f56fb7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a4dc0 0x561cf26af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:33.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.880+0000 7f56fb7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a4dc0 0x561cf26af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54808/0 (socket says 172.21.15.27:54808) 2024-09-19T08:15:33.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.880+0000 7f56fb7fe640 1 -- 172.21.15.27:0/2540015243 learned_addr learned my addr 172.21.15.27:0/2540015243 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:33.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.880+0000 7f56faffd640 1 --2- 172.21.15.27:0/2540015243 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26a44a0 0x561cf26a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:33.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.880+0000 7f56f8ff9640 1 --2- 172.21.15.27:0/867877224 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f56e80a33b0 0x7f56e80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:33.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.880+0000 7f56faffd640 1 --2- 172.21.15.27:0/2540015243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26af680 0x561cf26b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:33.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.881+0000 7f56f8ff9640 1 -- 172.21.15.27:0/867877224 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f56f40d03b0 con 0x7f56fc10e4f0 2024-09-19T08:15:33.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.881+0000 7f56faffd640 1 -- 172.21.15.27:0/2540015243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26af680 msgr2=0x561cf26b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:33.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.881+0000 7f56faffd640 1 --2- 172.21.15.27:0/2540015243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26af680 0x561cf26b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.881+0000 7f56faffd640 1 -- 172.21.15.27:0/2540015243 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a4dc0 msgr2=0x561cf26af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:33.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.881+0000 7f56faffd640 1 --2- 172.21.15.27:0/2540015243 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a4dc0 0x561cf26af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.881+0000 7f56faffd640 1 -- 172.21.15.27:0/2540015243 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf2596440 con 0x561cf26a44a0 2024-09-19T08:15:33.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.881+0000 7f56fb7fe640 1 --2- 172.21.15.27:0/2540015243 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a4dc0 0x561cf26af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:15:33.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.881+0000 7f56fbfff640 1 --2- 172.21.15.27:0/867877224 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f56e80a33b0 0x7f56e80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:33.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.881+0000 7f56faffd640 1 --2- 172.21.15.27:0/2540015243 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26a44a0 0x561cf26a4880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f56fc10ed60 tx=0x7f56e400a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ead3b9f43969e32 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:33.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.881+0000 7f56f1ffb640 1 -- 172.21.15.27:0/2540015243 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4016d90 con 0x561cf26a44a0 2024-09-19T08:15:33.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.881+0000 7f56f1ffb640 1 -- 172.21.15.27:0/2540015243 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56e4018910 con 0x561cf26a44a0 2024-09-19T08:15:33.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.881+0000 7f56f1ffb640 1 -- 172.21.15.27:0/2540015243 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e40178a0 con 0x561cf26a44a0 2024-09-19T08:15:33.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.882+0000 7f5704124740 1 -- 172.21.15.27:0/2540015243 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26a44a0 msgr2=0x561cf26a4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:33.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.882+0000 7f56fbfff640 1 --2- 172.21.15.27:0/867877224 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f56e80a33b0 0x7f56e80a5870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f56f40cdbb0 tx=0x7f56f400af30 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:33.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.882+0000 7f5704124740 1 --2- 172.21.15.27:0/2540015243 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26a44a0 0x561cf26a4880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f56fc10ed60 tx=0x7f56e400a230 comp rx=0 tx=0).stop 2024-09-19T08:15:33.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.882+0000 7f5704124740 1 -- 172.21.15.27:0/2540015243 shutdown_connections 2024-09-19T08:15:33.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.882+0000 7f5704124740 1 --2- 172.21.15.27:0/2540015243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26af680 0x561cf26b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.882+0000 7f5704124740 1 --2- 172.21.15.27:0/2540015243 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a4dc0 0x561cf26af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.882+0000 7f5704124740 1 --2- 172.21.15.27:0/2540015243 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26a44a0 0x561cf26a4880 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.882+0000 7f5704124740 1 -- 172.21.15.27:0/2540015243 >> 172.21.15.27:0/2540015243 conn(0x561cf26a0a30 msgr2=0x561cf26a0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:33.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.882+0000 7f5704124740 1 -- 172.21.15.27:0/2540015243 shutdown_connections 2024-09-19T08:15:33.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.882+0000 7f5704124740 1 -- 172.21.15.27:0/2540015243 wait complete. 2024-09-19T08:15:33.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.882+0000 7f5704124740 1 -- start start 2024-09-19T08:15:33.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.883+0000 7f5704124740 1 Processor -- start 2024-09-19T08:15:33.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.883+0000 7f5704124740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a44a0 0x561cf26af050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:33.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.883+0000 7f5704124740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26a4dc0 0x561cf26ac300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:33.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.883+0000 7f5704124740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26af680 0x561cf26ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:33.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.883+0000 7f5704124740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x561cf26b2250 con 0x561cf26a44a0 2024-09-19T08:15:33.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.883+0000 7f5704124740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x561cf25c5050 con 0x561cf26a4dc0 2024-09-19T08:15:33.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.883+0000 7f5704124740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561cf26b23d0 con 0x561cf26af680 2024-09-19T08:15:33.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.883+0000 7f5704124740 10 client.0 _ll_register_callbacks cb 0x561cf2605160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:15:33.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.883+0000 7f56faffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a44a0 0x561cf26af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:33.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.883+0000 7f56faffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a44a0 0x561cf26af050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54820/0 (socket says 172.21.15.27:54820) 2024-09-19T08:15:33.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.883+0000 7f56faffd640 1 -- 172.21.15.27:0/1146066245 learned_addr learned my addr 172.21.15.27:0/1146066245 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:33.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.883+0000 7f56fb7fe640 1 --2- 172.21.15.27:0/1146066245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26a4dc0 0x561cf26ac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:33.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.883+0000 7f56faffd640 1 --2- 172.21.15.27:0/1146066245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26af680 0x561cf26ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:33.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.883+0000 7f56faffd640 1 -- 172.21.15.27:0/1146066245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26af680 msgr2=0x561cf26ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:33.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.883+0000 7f56faffd640 1 --2- 172.21.15.27:0/1146066245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26af680 0x561cf26ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.883+0000 7f56faffd640 1 -- 172.21.15.27:0/1146066245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26a4dc0 msgr2=0x561cf26ac300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:33.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.883+0000 7f56faffd640 1 --2- 172.21.15.27:0/1146066245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26a4dc0 0x561cf26ac300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.883+0000 7f56faffd640 1 -- 172.21.15.27:0/1146066245 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cf237b3c0 con 0x561cf26a44a0 2024-09-19T08:15:33.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.884+0000 7f56faffd640 1 --2- 172.21.15.27:0/1146066245 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a44a0 0x561cf26af050 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f56e4016e90 tx=0x7f56e4017480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9982ab5c3f5127 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:33.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.884+0000 7f56daffd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:15:33.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.884+0000 7f56daffd640 1 -- 172.21.15.27:0/1146066245 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4018b80 con 0x561cf26a44a0 2024-09-19T08:15:33.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.884+0000 7f56daffd640 1 -- 172.21.15.27:0/1146066245 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f56e4018d20 con 0x561cf26a44a0 2024-09-19T08:15:33.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.884+0000 7f5704124740 1 -- 172.21.15.27:0/1146066245 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56e4018910 con 0x561cf26a44a0 2024-09-19T08:15:33.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.884+0000 7f56daffd640 1 -- 172.21.15.27:0/1146066245 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f56e40059c0 con 0x561cf26a44a0 2024-09-19T08:15:33.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.884+0000 7f5704124740 10 client.16080 fetch_fsmap learned FSMap version 20 2024-09-19T08:15:33.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.884+0000 7f5704124740 1 -- 172.21.15.27:0/1146066245 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x561cf26bdc80 con 0x561cf26a44a0 2024-09-19T08:15:33.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.884+0000 7f56daffd640 1 -- 172.21.15.27:0/1146066245 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56e4018910 con 0x561cf26a44a0 2024-09-19T08:15:33.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.884+0000 7f56daffd640 1 -- 172.21.15.27:0/1146066245 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f56e4012050 con 0x561cf26a44a0 2024-09-19T08:15:33.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.884+0000 7f5704124740 10 client.16080 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:15:33.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.885+0000 7f5704124740 10 client.16080 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:15:33.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.885+0000 7f5704124740 20 client.16080 populate_metadata read hostname 'smithi027' 2024-09-19T08:15:33.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.885+0000 7f5704124740 1 --2- 172.21.15.27:0/1146066245 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x561cf26befd0 0x561cf26c13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:33.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.885+0000 7f5704124740 4 client.16080 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:15:33.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.885+0000 7f5704124740 1 -- 172.21.15.27:0/1146066245 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cf2617850 con 0x561cf26befd0 2024-09-19T08:15:33.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.885+0000 7f56fb7fe640 1 --2- 172.21.15.27:0/1146066245 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x561cf26befd0 0x561cf26c13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:33.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.885+0000 7f56fb7fe640 1 --2- 172.21.15.27:0/1146066245 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x561cf26befd0 0x561cf26c13c0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5970791ce87e3bb9 server_cookie=ce67192cebb2b237 in_seq=0 out_seq=0 2024-09-19T08:15:33.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.885+0000 7f56daffd640 10 client.16080 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:33.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.886+0000 7f56daffd640 1 -- 172.21.15.27:0/1146066245 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561cf2617850 con 0x561cf26befd0 2024-09-19T08:15:33.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.886+0000 7f56daffd640 10 client.16080 handle_command_reply: tid=0 2024-09-19T08:15:33.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.886+0000 7f5704124740 1 client.16080 shutdown 2024-09-19T08:15:33.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.886+0000 7f5704124740 1 -- 172.21.15.27:0/1146066245 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a44a0 msgr2=0x561cf26af050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:33.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.886+0000 7f5704124740 1 --2- 172.21.15.27:0/1146066245 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a44a0 0x561cf26af050 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f56e4016e90 tx=0x7f56e4017480 comp rx=0 tx=0).stop 2024-09-19T08:15:33.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.886+0000 7f5704124740 1 -- 172.21.15.27:0/1146066245 shutdown_connections 2024-09-19T08:15:33.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.886+0000 7f5704124740 1 --2- 172.21.15.27:0/1146066245 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x561cf26befd0 0x561cf26c13c0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.886+0000 7f5704124740 1 --2- 172.21.15.27:0/1146066245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26af680 0x561cf26ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.886+0000 7f5704124740 1 --2- 172.21.15.27:0/1146066245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26a4dc0 0x561cf26ac300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.886+0000 7f5704124740 1 --2- 172.21.15.27:0/1146066245 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a44a0 0x561cf26af050 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.886+0000 7f56daffd640 0 client.16080 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:33.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.886+0000 7f5704124740 1 -- 172.21.15.27:0/1146066245 >> 172.21.15.27:0/1146066245 conn(0x561cf26a0a30 msgr2=0x561cf269fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:33.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.886+0000 7f5704124740 1 -- 172.21.15.27:0/1146066245 shutdown_connections 2024-09-19T08:15:33.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.886+0000 7f5704124740 1 -- 172.21.15.27:0/1146066245 wait complete. 2024-09-19T08:15:33.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.886+0000 7f5704124740 20 client.16080 trim_cache size 0 max 16384 2024-09-19T08:15:33.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.908+0000 7f5704124740 1 Processor -- start 2024-09-19T08:15:33.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.908+0000 7f5704124740 1 -- start start 2024-09-19T08:15:33.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.908+0000 7f5704124740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26a44a0 0x561cf26aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:33.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.908+0000 7f5704124740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26a4dc0 0x561cf26c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:33.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.908+0000 7f5704124740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26af680 0x561cf26c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:33.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.908+0000 7f5704124740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f56fc1ad9a0 con 0x561cf26af680 2024-09-19T08:15:33.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.908+0000 7f5704124740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f56fc1b0220 con 0x561cf26a4dc0 2024-09-19T08:15:33.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.908+0000 7f5704124740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f56fc1ae010 con 0x561cf26a44a0 2024-09-19T08:15:33.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.908+0000 7f56faffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26af680 0x561cf26c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:33.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.908+0000 7f56faffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26af680 0x561cf26c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54836/0 (socket says 172.21.15.27:54836) 2024-09-19T08:15:33.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.908+0000 7f56faffd640 1 -- 172.21.15.27:0/1190718622 learned_addr learned my addr 172.21.15.27:0/1190718622 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:33.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.908+0000 7f56faffd640 1 --2- 172.21.15.27:0/1190718622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26a44a0 0x561cf26aabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:33.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.909+0000 7f56fb7fe640 1 --2- 172.21.15.27:0/1190718622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26a4dc0 0x561cf26c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:33.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.909+0000 7f56faffd640 1 -- 172.21.15.27:0/1190718622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26a44a0 msgr2=0x561cf26aabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:33.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.909+0000 7f56faffd640 1 --2- 172.21.15.27:0/1190718622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26a44a0 0x561cf26aabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.909+0000 7f56faffd640 1 -- 172.21.15.27:0/1190718622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26a4dc0 msgr2=0x561cf26c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:33.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.909+0000 7f56faffd640 1 --2- 172.21.15.27:0/1190718622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26a4dc0 0x561cf26c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.909+0000 7f56faffd640 1 -- 172.21.15.27:0/1190718622 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf26ab2b0 con 0x561cf26af680 2024-09-19T08:15:33.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.909+0000 7f56faffd640 1 --2- 172.21.15.27:0/1190718622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26af680 0x561cf26c4920 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f56e4004700 tx=0x7f56e40047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a6e91eed8db8f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:33.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.909+0000 7f56f17fa640 1 -- 172.21.15.27:0/1190718622 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e40188f0 con 0x561cf26af680 2024-09-19T08:15:33.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.909+0000 7f56f17fa640 1 -- 172.21.15.27:0/1190718622 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56e400a640 con 0x561cf26af680 2024-09-19T08:15:33.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.909+0000 7f56f17fa640 1 -- 172.21.15.27:0/1190718622 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e40179d0 con 0x561cf26af680 2024-09-19T08:15:33.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.910+0000 7f5704124740 1 -- 172.21.15.27:0/1190718622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26af680 msgr2=0x561cf26c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:33.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.910+0000 7f5704124740 1 --2- 172.21.15.27:0/1190718622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26af680 0x561cf26c4920 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f56e4004700 tx=0x7f56e40047d0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.911+0000 7f5704124740 1 -- 172.21.15.27:0/1190718622 shutdown_connections 2024-09-19T08:15:33.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.911+0000 7f5704124740 1 --2- 172.21.15.27:0/1190718622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26af680 0x561cf26c4920 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.911+0000 7f5704124740 1 --2- 172.21.15.27:0/1190718622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26a4dc0 0x561cf26c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.911+0000 7f5704124740 1 --2- 172.21.15.27:0/1190718622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26a44a0 0x561cf26aabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.911+0000 7f5704124740 1 -- 172.21.15.27:0/1190718622 >> 172.21.15.27:0/1190718622 conn(0x561cf26a0a30 msgr2=0x561cf26a7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:33.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.911+0000 7f5704124740 1 -- 172.21.15.27:0/1190718622 shutdown_connections 2024-09-19T08:15:33.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.911+0000 7f5704124740 1 -- 172.21.15.27:0/1190718622 wait complete. 2024-09-19T08:15:33.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.911+0000 7f5704124740 1 -- start start 2024-09-19T08:15:33.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.911+0000 7f5704124740 1 Processor -- start 2024-09-19T08:15:33.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.912+0000 7f5704124740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a44a0 0x561cf26c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:33.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.912+0000 7f5704124740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26a4dc0 0x561cf26c1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:33.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.912+0000 7f5704124740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26af680 0x561cf26c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:33.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.912+0000 7f5704124740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f56fc1ae6e0 con 0x561cf26a44a0 2024-09-19T08:15:33.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.912+0000 7f5704124740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f56fc1afb50 con 0x561cf26a4dc0 2024-09-19T08:15:33.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.912+0000 7f5704124740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f56fc1aedb0 con 0x561cf26af680 2024-09-19T08:15:33.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.912+0000 7f5704124740 10 client.0 _ll_register_callbacks cb 0x7f56ec0314d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:15:33.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.912+0000 7f56faffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a44a0 0x561cf26c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:33.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.912+0000 7f56faffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a44a0 0x561cf26c4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54850/0 (socket says 172.21.15.27:54850) 2024-09-19T08:15:33.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.912+0000 7f56faffd640 1 -- 172.21.15.27:0/2715129422 learned_addr learned my addr 172.21.15.27:0/2715129422 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:33.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.912+0000 7f56fb7fe640 1 --2- 172.21.15.27:0/2715129422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26a4dc0 0x561cf26c1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:33.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.912+0000 7f56faffd640 1 --2- 172.21.15.27:0/2715129422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26af680 0x561cf26c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:33.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.912+0000 7f56faffd640 1 -- 172.21.15.27:0/2715129422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26af680 msgr2=0x561cf26c24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:33.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.912+0000 7f56faffd640 1 --2- 172.21.15.27:0/2715129422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26af680 0x561cf26c24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.912+0000 7f56faffd640 1 -- 172.21.15.27:0/2715129422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26a4dc0 msgr2=0x561cf26c1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:33.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.912+0000 7f56faffd640 1 --2- 172.21.15.27:0/2715129422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26a4dc0 0x561cf26c1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.912+0000 7f56faffd640 1 -- 172.21.15.27:0/2715129422 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cf26acc60 con 0x561cf26a44a0 2024-09-19T08:15:33.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.913+0000 7f56faffd640 1 --2- 172.21.15.27:0/2715129422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a44a0 0x561cf26c4be0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f56e400a520 tx=0x7f56e4025880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d677256cf6ae825 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:33.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.913+0000 7f56daffd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:15:33.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.913+0000 7f56daffd640 1 -- 172.21.15.27:0/2715129422 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e403f040 con 0x561cf26a44a0 2024-09-19T08:15:33.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.913+0000 7f56daffd640 1 -- 172.21.15.27:0/2715129422 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f56e4016fa0 con 0x561cf26a44a0 2024-09-19T08:15:33.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.913+0000 7f5704124740 1 -- 172.21.15.27:0/2715129422 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56e400a640 con 0x561cf26a44a0 2024-09-19T08:15:33.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.913+0000 7f56daffd640 1 -- 172.21.15.27:0/2715129422 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f56e403a430 con 0x561cf26a44a0 2024-09-19T08:15:33.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.913+0000 7f5704124740 10 client.16086 fetch_fsmap learned FSMap version 20 2024-09-19T08:15:33.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.913+0000 7f5704124740 1 -- 172.21.15.27:0/2715129422 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x561cf27297f0 con 0x561cf26a44a0 2024-09-19T08:15:33.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.913+0000 7f56daffd640 1 -- 172.21.15.27:0/2715129422 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56e400a640 con 0x561cf26a44a0 2024-09-19T08:15:33.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.913+0000 7f56daffd640 1 -- 172.21.15.27:0/2715129422 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f56e4012040 con 0x561cf26a44a0 2024-09-19T08:15:33.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.914+0000 7f5704124740 10 client.16086 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:15:33.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.914+0000 7f5704124740 10 client.16086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:15:33.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.914+0000 7f5704124740 20 client.16086 populate_metadata read hostname 'smithi027' 2024-09-19T08:15:33.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.914+0000 7f5704124740 1 --2- 172.21.15.27:0/2715129422 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x561cf26befd0 0x561cf272bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:33.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.914+0000 7f5704124740 4 client.16086 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:15:33.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.914+0000 7f5704124740 1 -- 172.21.15.27:0/2715129422 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561cf2611d60 con 0x561cf26befd0 2024-09-19T08:15:33.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.914+0000 7f56fb7fe640 1 --2- 172.21.15.27:0/2715129422 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x561cf26befd0 0x561cf272bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:33.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.914+0000 7f56fb7fe640 1 --2- 172.21.15.27:0/2715129422 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x561cf26befd0 0x561cf272bcd0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5526ad496816cb3 server_cookie=aa6c9bb6d718f47 in_seq=0 out_seq=0 2024-09-19T08:15:33.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.914+0000 7f56daffd640 10 client.16086 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:33.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.914+0000 7f56daffd640 1 -- 172.21.15.27:0/2715129422 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561cf2611d60 con 0x561cf26befd0 2024-09-19T08:15:33.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.914+0000 7f56daffd640 10 client.16086 handle_command_reply: tid=0 2024-09-19T08:15:33.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.915+0000 7f5704124740 1 client.16086 shutdown 2024-09-19T08:15:33.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.915+0000 7f5704124740 1 -- 172.21.15.27:0/2715129422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a44a0 msgr2=0x561cf26c4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:33.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.915+0000 7f5704124740 1 --2- 172.21.15.27:0/2715129422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a44a0 0x561cf26c4be0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f56e400a520 tx=0x7f56e4025880 comp rx=0 tx=0).stop 2024-09-19T08:15:33.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.915+0000 7f5704124740 1 -- 172.21.15.27:0/2715129422 shutdown_connections 2024-09-19T08:15:33.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.915+0000 7f5704124740 1 --2- 172.21.15.27:0/2715129422 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x561cf26befd0 0x561cf272bcd0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.915+0000 7f5704124740 1 --2- 172.21.15.27:0/2715129422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561cf26af680 0x561cf26c24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.915+0000 7f5704124740 1 --2- 172.21.15.27:0/2715129422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26a4dc0 0x561cf26c1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.915+0000 7f5704124740 1 --2- 172.21.15.27:0/2715129422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561cf26a44a0 0x561cf26c4be0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.915+0000 7f5704124740 1 -- 172.21.15.27:0/2715129422 >> 172.21.15.27:0/2715129422 conn(0x561cf26a0a30 msgr2=0x561cf26a78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:33.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.915+0000 7f56daffd640 0 client.16086 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:33.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.915+0000 7f5704124740 1 -- 172.21.15.27:0/2715129422 shutdown_connections 2024-09-19T08:15:33.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.915+0000 7f5704124740 1 -- 172.21.15.27:0/2715129422 wait complete. 2024-09-19T08:15:33.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.915+0000 7f5704124740 20 client.16086 trim_cache size 0 max 16384 2024-09-19T08:15:33.924 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:15:33.924 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:15:33.924 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:15:33.924 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:15:33.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.916+0000 7f5701d4b640 1 -- 172.21.15.27:0/867877224 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f56e80a33b0 msgr2=0x7f56e80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:33.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.916+0000 7f5701d4b640 1 --2- 172.21.15.27:0/867877224 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f56e80a33b0 0x7f56e80a5870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f56f40cdbb0 tx=0x7f56f400af30 comp rx=0 tx=0).stop 2024-09-19T08:15:33.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.916+0000 7f5701d4b640 1 -- 172.21.15.27:0/867877224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56fc10e4f0 msgr2=0x7f56fc19a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:33.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.916+0000 7f5701d4b640 1 --2- 172.21.15.27:0/867877224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56fc10e4f0 0x7f56fc19a5d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f56f400ccb0 tx=0x7f56f400a620 comp rx=0 tx=0).stop 2024-09-19T08:15:33.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.916+0000 7f5701d4b640 1 -- 172.21.15.27:0/867877224 shutdown_connections 2024-09-19T08:15:33.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.916+0000 7f5701d4b640 1 --2- 172.21.15.27:0/867877224 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f56e80a33b0 0x7f56e80a5870 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.916+0000 7f5701d4b640 1 --2- 172.21.15.27:0/867877224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56fc10e4f0 0x7f56fc19a5d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.916+0000 7f5701d4b640 1 --2- 172.21.15.27:0/867877224 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56fc101380 0x7f56fc1a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.916+0000 7f5701d4b640 1 --2- 172.21.15.27:0/867877224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56fc1009d0 0x7f56fc1a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:33.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.916+0000 7f5701d4b640 1 -- 172.21.15.27:0/867877224 >> 172.21.15.27:0/867877224 conn(0x7f56fc0fc7d0 msgr2=0x7f56fc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:33.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.916+0000 7f5701d4b640 1 -- 172.21.15.27:0/867877224 shutdown_connections 2024-09-19T08:15:33.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:33.916+0000 7f5701d4b640 1 -- 172.21.15.27:0/867877224 wait complete. 2024-09-19T08:15:34.741 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:15:34.741 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:15:34.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:34 smithi155 ceph-mon[35362]: pgmap v139: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:15:35.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:34 smithi027 ceph-mon[31209]: pgmap v139: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:15:35.007 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:15:35.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:34 smithi203 ceph-mon[35198]: pgmap v139: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:15:35.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.458+0000 7f6311ce6640 1 -- 172.21.15.27:0/3494625102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f630c101410 msgr2=0x7f630c10d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:35.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.458+0000 7f6311ce6640 1 --2- 172.21.15.27:0/3494625102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f630c101410 0x7f630c10d940 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6304009cd0 tx=0x7f630402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:15:35.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.458+0000 7f6311ce6640 1 -- 172.21.15.27:0/3494625102 shutdown_connections 2024-09-19T08:15:35.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.458+0000 7f6311ce6640 1 --2- 172.21.15.27:0/3494625102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f630c101410 0x7f630c10d940 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:35.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.458+0000 7f6311ce6640 1 --2- 172.21.15.27:0/3494625102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f630c100a70 0x7f630c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:35.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.458+0000 7f6311ce6640 1 --2- 172.21.15.27:0/3494625102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f630c106a70 0x7f630c106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:35.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.458+0000 7f6311ce6640 1 -- 172.21.15.27:0/3494625102 >> 172.21.15.27:0/3494625102 conn(0x7f630c0fc790 msgr2=0x7f630c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:35.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.458+0000 7f6311ce6640 1 -- 172.21.15.27:0/3494625102 shutdown_connections 2024-09-19T08:15:35.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.458+0000 7f6311ce6640 1 -- 172.21.15.27:0/3494625102 wait complete. 2024-09-19T08:15:35.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.458+0000 7f6311ce6640 1 Processor -- start 2024-09-19T08:15:35.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.459+0000 7f6311ce6640 1 -- start start 2024-09-19T08:15:35.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.459+0000 7f6311ce6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f630c100a70 0x7f630c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:35.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.459+0000 7f6311ce6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f630c101410 0x7f630c198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:35.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.459+0000 7f6311ce6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f630c106a70 0x7f630c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:35.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.459+0000 7f6311ce6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f630c110ee0 con 0x7f630c101410 2024-09-19T08:15:35.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.459+0000 7f6311ce6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f630c110d60 con 0x7f630c106a70 2024-09-19T08:15:35.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.459+0000 7f6311ce6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f630c111060 con 0x7f630c100a70 2024-09-19T08:15:35.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.459+0000 7f630affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f630c101410 0x7f630c198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:35.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.459+0000 7f630affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f630c101410 0x7f630c198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54866/0 (socket says 172.21.15.27:54866) 2024-09-19T08:15:35.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.459+0000 7f630affd640 1 -- 172.21.15.27:0/1795086547 learned_addr learned my addr 172.21.15.27:0/1795086547 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:35.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.459+0000 7f630b7fe640 1 --2- 172.21.15.27:0/1795086547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f630c100a70 0x7f630c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:35.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.459+0000 7f630affd640 1 -- 172.21.15.27:0/1795086547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f630c100a70 msgr2=0x7f630c198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:35.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.459+0000 7f630bfff640 1 --2- 172.21.15.27:0/1795086547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f630c106a70 0x7f630c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:35.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.459+0000 7f630affd640 1 --2- 172.21.15.27:0/1795086547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f630c100a70 0x7f630c198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:35.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.459+0000 7f630affd640 1 -- 172.21.15.27:0/1795086547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f630c106a70 msgr2=0x7f630c19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:35.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.459+0000 7f630affd640 1 --2- 172.21.15.27:0/1795086547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f630c106a70 0x7f630c19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:35.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.459+0000 7f630affd640 1 -- 172.21.15.27:0/1795086547 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f630c19d400 con 0x7f630c101410 2024-09-19T08:15:35.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.459+0000 7f630b7fe640 1 --2- 172.21.15.27:0/1795086547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f630c100a70 0x7f630c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:15:35.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.459+0000 7f630affd640 1 --2- 172.21.15.27:0/1795086547 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f630c101410 0x7f630c198990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f62f400d950 tx=0x7f62f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:35.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.460+0000 7f6308ff9640 1 -- 172.21.15.27:0/1795086547 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f4017070 con 0x7f630c101410 2024-09-19T08:15:35.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.460+0000 7f6311ce6640 1 -- 172.21.15.27:0/1795086547 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f630c19d6f0 con 0x7f630c101410 2024-09-19T08:15:35.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.460+0000 7f6308ff9640 1 -- 172.21.15.27:0/1795086547 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62f4009c30 con 0x7f630c101410 2024-09-19T08:15:35.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.460+0000 7f6308ff9640 1 -- 172.21.15.27:0/1795086547 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f400f6b0 con 0x7f630c101410 2024-09-19T08:15:35.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.460+0000 7f6311ce6640 1 -- 172.21.15.27:0/1795086547 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f630c1a4fd0 con 0x7f630c101410 2024-09-19T08:15:35.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.461+0000 7f6311ce6640 1 -- 172.21.15.27:0/1795086547 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f630c100ed0 con 0x7f630c101410 2024-09-19T08:15:35.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.462+0000 7f6308ff9640 1 -- 172.21.15.27:0/1795086547 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f62f40109d0 con 0x7f630c101410 2024-09-19T08:15:35.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.463+0000 7f6308ff9640 1 --2- 172.21.15.27:0/1795086547 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f62f80a33b0 0x7f62f80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:35.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.463+0000 7f6308ff9640 1 -- 172.21.15.27:0/1795086547 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f62f40cf9c0 con 0x7f630c101410 2024-09-19T08:15:35.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.463+0000 7f630b7fe640 1 --2- 172.21.15.27:0/1795086547 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f62f80a33b0 0x7f62f80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:35.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.463+0000 7f630b7fe640 1 --2- 172.21.15.27:0/1795086547 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f62f80a33b0 0x7f62f80a5870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f62fc009930 tx=0x7f62fc008040 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:35.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.466+0000 7f6308ff9640 1 -- 172.21.15.27:0/1795086547 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f62f4009de0 con 0x7f630c101410 2024-09-19T08:15:35.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.682+0000 7f6311ce6640 1 -- 172.21.15.27:0/1795086547 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f630c1997b0 con 0x7f630c101410 2024-09-19T08:15:35.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.683+0000 7f6308ff9640 1 -- 172.21.15.27:0/1795086547 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f630c1997b0 con 0x7f630c101410 2024-09-19T08:15:35.683 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:15:35.684 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:15:35.684 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:15:35.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.685+0000 7f6311ce6640 1 -- 172.21.15.27:0/1795086547 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f62f80a33b0 msgr2=0x7f62f80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:35.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.685+0000 7f6311ce6640 1 --2- 172.21.15.27:0/1795086547 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f62f80a33b0 0x7f62f80a5870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f62fc009930 tx=0x7f62fc008040 comp rx=0 tx=0).stop 2024-09-19T08:15:35.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.685+0000 7f6311ce6640 1 -- 172.21.15.27:0/1795086547 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f630c101410 msgr2=0x7f630c198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:35.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.685+0000 7f6311ce6640 1 --2- 172.21.15.27:0/1795086547 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f630c101410 0x7f630c198990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f62f400d950 tx=0x7f62f400de10 comp rx=0 tx=0).stop 2024-09-19T08:15:35.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.685+0000 7f6311ce6640 1 -- 172.21.15.27:0/1795086547 shutdown_connections 2024-09-19T08:15:35.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.685+0000 7f6311ce6640 1 --2- 172.21.15.27:0/1795086547 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f62f80a33b0 0x7f62f80a5870 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:35.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.685+0000 7f6311ce6640 1 --2- 172.21.15.27:0/1795086547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f630c106a70 0x7f630c19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:35.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.685+0000 7f6311ce6640 1 --2- 172.21.15.27:0/1795086547 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f630c101410 0x7f630c198990 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:35.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.685+0000 7f6311ce6640 1 --2- 172.21.15.27:0/1795086547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f630c100a70 0x7f630c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:35.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.685+0000 7f6311ce6640 1 -- 172.21.15.27:0/1795086547 >> 172.21.15.27:0/1795086547 conn(0x7f630c0fc790 msgr2=0x7f630c06a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:35.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.685+0000 7f6311ce6640 1 -- 172.21.15.27:0/1795086547 shutdown_connections 2024-09-19T08:15:35.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:35.685+0000 7f6311ce6640 1 -- 172.21.15.27:0/1795086547 wait complete. 2024-09-19T08:15:36.403 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:15:36.667 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:15:36.906 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:36 smithi027 ceph-mon[31209]: pgmap v140: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:36.906 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:36 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1795086547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:15:36.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:36 smithi155 ceph-mon[35362]: pgmap v140: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:36.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:36 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1795086547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:15:37.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:36 smithi203 ceph-mon[35198]: pgmap v140: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:37.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:36 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1795086547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:15:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.117+0000 7f43bb83d640 1 -- 172.21.15.27:0/3535334085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43b4106a80 msgr2=0x7f43b4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.117+0000 7f43bb83d640 1 --2- 172.21.15.27:0/3535334085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43b4106a80 0x7f43b4106e60 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009cd0 tx=0x7f43a802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.117+0000 7f43bb83d640 1 -- 172.21.15.27:0/3535334085 shutdown_connections 2024-09-19T08:15:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.117+0000 7f43bb83d640 1 --2- 172.21.15.27:0/3535334085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43b4101420 0x7f43b410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.117+0000 7f43bb83d640 1 --2- 172.21.15.27:0/3535334085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b4100a80 0x7f43b4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.117+0000 7f43bb83d640 1 --2- 172.21.15.27:0/3535334085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43b4106a80 0x7f43b4106e60 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.117+0000 7f43bb83d640 1 -- 172.21.15.27:0/3535334085 >> 172.21.15.27:0/3535334085 conn(0x7f43b40fc7a0 msgr2=0x7f43b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.117+0000 7f43bb83d640 1 -- 172.21.15.27:0/3535334085 shutdown_connections 2024-09-19T08:15:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.117+0000 7f43bb83d640 1 -- 172.21.15.27:0/3535334085 wait complete. 2024-09-19T08:15:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.118+0000 7f43bb83d640 1 Processor -- start 2024-09-19T08:15:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.118+0000 7f43bb83d640 1 -- start start 2024-09-19T08:15:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.118+0000 7f43bb83d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43b4100a80 0x7f43b40fce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.118+0000 7f43bb83d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43b4101420 0x7f43b40fd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.118+0000 7f43bb83d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b4106a80 0x7f43b40fd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.118+0000 7f43bb83d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f43b4110f20 con 0x7f43b4100a80 2024-09-19T08:15:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.118+0000 7f43bb83d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f43b4110da0 con 0x7f43b4106a80 2024-09-19T08:15:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.118+0000 7f43bb83d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f43b41110a0 con 0x7f43b4101420 2024-09-19T08:15:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.118+0000 7f43b95d9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43b4100a80 0x7f43b40fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.118+0000 7f43b95d9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43b4100a80 0x7f43b40fce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54876/0 (socket says 172.21.15.27:54876) 2024-09-19T08:15:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.118+0000 7f43b95d9640 1 -- 172.21.15.27:0/2621242378 learned_addr learned my addr 172.21.15.27:0/2621242378 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.118+0000 7f43b8dd8640 1 --2- 172.21.15.27:0/2621242378 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43b4101420 0x7f43b40fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.118+0000 7f43b9dda640 1 --2- 172.21.15.27:0/2621242378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b4106a80 0x7f43b40fd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:37.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.119+0000 7f43b95d9640 1 -- 172.21.15.27:0/2621242378 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43b4101420 msgr2=0x7f43b40fd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:37.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.119+0000 7f43b95d9640 1 --2- 172.21.15.27:0/2621242378 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43b4101420 0x7f43b40fd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.119+0000 7f43b95d9640 1 -- 172.21.15.27:0/2621242378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b4106a80 msgr2=0x7f43b40fd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:37.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.119+0000 7f43b95d9640 1 --2- 172.21.15.27:0/2621242378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b4106a80 0x7f43b40fd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.119+0000 7f43b95d9640 1 -- 172.21.15.27:0/2621242378 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b41a6ad0 con 0x7f43b4100a80 2024-09-19T08:15:37.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.119+0000 7f43b9dda640 1 --2- 172.21.15.27:0/2621242378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b4106a80 0x7f43b40fd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:15:37.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.119+0000 7f43b95d9640 1 --2- 172.21.15.27:0/2621242378 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43b4100a80 0x7f43b40fce50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f43a802ae00 tx=0x7f43a8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:37.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.119+0000 7f43a67fc640 1 -- 172.21.15.27:0/2621242378 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a8004240 con 0x7f43b4100a80 2024-09-19T08:15:37.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.119+0000 7f43a67fc640 1 -- 172.21.15.27:0/2621242378 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43a80305a0 con 0x7f43b4100a80 2024-09-19T08:15:37.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.119+0000 7f43bb83d640 1 -- 172.21.15.27:0/2621242378 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b41a6d60 con 0x7f43b4100a80 2024-09-19T08:15:37.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.119+0000 7f43a67fc640 1 -- 172.21.15.27:0/2621242378 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a803a660 con 0x7f43b4100a80 2024-09-19T08:15:37.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.119+0000 7f43bb83d640 1 -- 172.21.15.27:0/2621242378 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b41a7260 con 0x7f43b4100a80 2024-09-19T08:15:37.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.121+0000 7f43a67fc640 1 -- 172.21.15.27:0/2621242378 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f43a8030ac0 con 0x7f43b4100a80 2024-09-19T08:15:37.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.122+0000 7f43bdc16740 1 Processor -- start 2024-09-19T08:15:37.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.122+0000 7f43bdc16740 1 -- start start 2024-09-19T08:15:37.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.122+0000 7f43bdc16740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561e6d9a2b40 0x561e6d9a1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:37.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.122+0000 7f43bdc16740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a15d0 0x561e6d9a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:37.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.122+0000 7f43bdc16740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9ac370 0x561e6d9ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:37.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.122+0000 7f43bdc16740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x561e6d9072f0 con 0x561e6d9a15d0 2024-09-19T08:15:37.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.122+0000 7f43bdc16740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x561e6d8aecf0 con 0x561e6d9ac370 2024-09-19T08:15:37.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.122+0000 7f43bdc16740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561e6d9032b0 con 0x561e6d9a2b40 2024-09-19T08:15:37.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.122+0000 7f43b95d9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a15d0 0x561e6d9a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:37.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.122+0000 7f43b95d9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a15d0 0x561e6d9a1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54880/0 (socket says 172.21.15.27:54880) 2024-09-19T08:15:37.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.122+0000 7f43b95d9640 1 -- 172.21.15.27:0/288377594 learned_addr learned my addr 172.21.15.27:0/288377594 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:37.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.122+0000 7f43b9dda640 1 --2- 172.21.15.27:0/288377594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561e6d9a2b40 0x561e6d9a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:37.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.122+0000 7f43a67fc640 1 --2- 172.21.15.27:0/2621242378 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f43a00a3430 0x7f43a00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:37.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.122+0000 7f43b8dd8640 1 --2- 172.21.15.27:0/288377594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9ac370 0x561e6d9ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:37.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.122+0000 7f43b9dda640 1 --2- 172.21.15.27:0/2621242378 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f43a00a3430 0x7f43a00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:37.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.122+0000 7f43b95d9640 1 -- 172.21.15.27:0/288377594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561e6d9a2b40 msgr2=0x561e6d9a1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:37.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.122+0000 7f43b95d9640 1 --2- 172.21.15.27:0/288377594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561e6d9a2b40 0x561e6d9a1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.122+0000 7f43b95d9640 1 -- 172.21.15.27:0/288377594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9ac370 msgr2=0x561e6d9ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:37.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.122+0000 7f43b95d9640 1 --2- 172.21.15.27:0/288377594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9ac370 0x561e6d9ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.122+0000 7f43b95d9640 1 -- 172.21.15.27:0/288377594 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e6d8933a0 con 0x561e6d9a15d0 2024-09-19T08:15:37.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.123+0000 7f43a67fc640 1 -- 172.21.15.27:0/2621242378 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f43a802e030 con 0x7f43b4100a80 2024-09-19T08:15:37.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.123+0000 7f43b95d9640 1 --2- 172.21.15.27:0/288377594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a15d0 0x561e6d9a1a10 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f43a80b9ca0 tx=0x7f43a80bd1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24f27c00c3c882f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:37.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.123+0000 7f43b9dda640 1 --2- 172.21.15.27:0/2621242378 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f43a00a3430 0x7f43a00a58f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00bf00 tx=0x7f43ac0046c0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:37.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.123+0000 7f439f7fe640 1 -- 172.21.15.27:0/288377594 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a80bcc30 con 0x561e6d9a15d0 2024-09-19T08:15:37.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.123+0000 7f439f7fe640 1 -- 172.21.15.27:0/288377594 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43a8036070 con 0x561e6d9a15d0 2024-09-19T08:15:37.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.123+0000 7f439f7fe640 1 -- 172.21.15.27:0/288377594 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a804ddc0 con 0x561e6d9a15d0 2024-09-19T08:15:37.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.124+0000 7f43bdc16740 1 -- 172.21.15.27:0/288377594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a15d0 msgr2=0x561e6d9a1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:37.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.124+0000 7f43bdc16740 1 --2- 172.21.15.27:0/288377594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a15d0 0x561e6d9a1a10 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f43a80b9ca0 tx=0x7f43a80bd1d0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.124+0000 7f43bdc16740 1 -- 172.21.15.27:0/288377594 shutdown_connections 2024-09-19T08:15:37.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.124+0000 7f43bdc16740 1 --2- 172.21.15.27:0/288377594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9ac370 0x561e6d9ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.124+0000 7f43bdc16740 1 --2- 172.21.15.27:0/288377594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a15d0 0x561e6d9a1a10 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.124+0000 7f43bdc16740 1 --2- 172.21.15.27:0/288377594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561e6d9a2b40 0x561e6d9a1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.124+0000 7f43bdc16740 1 -- 172.21.15.27:0/288377594 >> 172.21.15.27:0/288377594 conn(0x561e6d96a310 msgr2=0x561e6d99dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:37.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.124+0000 7f43bdc16740 1 -- 172.21.15.27:0/288377594 shutdown_connections 2024-09-19T08:15:37.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.124+0000 7f43bdc16740 1 -- 172.21.15.27:0/288377594 wait complete. 2024-09-19T08:15:37.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.124+0000 7f43bdc16740 1 -- start start 2024-09-19T08:15:37.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.124+0000 7f43bdc16740 1 Processor -- start 2024-09-19T08:15:37.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f43bdc16740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9a15d0 0x561e6d9abd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:37.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f43bdc16740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a2b40 0x561e6d9a8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:37.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f43bdc16740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561e6d9ac370 0x561e6d9a9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:37.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f43bdc16740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x561e6d9aee30 con 0x561e6d9a2b40 2024-09-19T08:15:37.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f43bdc16740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x561e6d8c2060 con 0x561e6d9a15d0 2024-09-19T08:15:37.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f43bdc16740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561e6d9aefb0 con 0x561e6d9ac370 2024-09-19T08:15:37.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f43bdc16740 10 client.0 _ll_register_callbacks cb 0x561e6d6158c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:15:37.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f43b8dd8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a2b40 0x561e6d9a8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:37.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f43b8dd8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a2b40 0x561e6d9a8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54884/0 (socket says 172.21.15.27:54884) 2024-09-19T08:15:37.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f43b8dd8640 1 -- 172.21.15.27:0/59593924 learned_addr learned my addr 172.21.15.27:0/59593924 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:37.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f43b95d9640 1 --2- 172.21.15.27:0/59593924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9a15d0 0x561e6d9abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:37.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f43b8dd8640 1 -- 172.21.15.27:0/59593924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561e6d9ac370 msgr2=0x561e6d9a9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:37.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f43b8dd8640 1 --2- 172.21.15.27:0/59593924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561e6d9ac370 0x561e6d9a9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f43b8dd8640 1 -- 172.21.15.27:0/59593924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9a15d0 msgr2=0x561e6d9abd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:37.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f43b8dd8640 1 --2- 172.21.15.27:0/59593924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9a15d0 0x561e6d9abd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f43b8dd8640 1 -- 172.21.15.27:0/59593924 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e6d6783c0 con 0x561e6d9a2b40 2024-09-19T08:15:37.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f43b95d9640 1 --2- 172.21.15.27:0/59593924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9a15d0 0x561e6d9abd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:15:37.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f43b8dd8640 1 --2- 172.21.15.27:0/59593924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a2b40 0x561e6d9a8fd0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f43b0010500 tx=0x7f43b00109c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5d0d2baea4bb23 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:37.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f439cff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:15:37.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f439cff9640 1 -- 172.21.15.27:0/59593924 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b001a020 con 0x561e6d9a2b40 2024-09-19T08:15:37.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f439cff9640 1 -- 172.21.15.27:0/59593924 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f43b0016690 con 0x561e6d9a2b40 2024-09-19T08:15:37.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.125+0000 7f43bdc16740 1 -- 172.21.15.27:0/59593924 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43a8036070 con 0x561e6d9a2b40 2024-09-19T08:15:37.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.126+0000 7f439cff9640 1 -- 172.21.15.27:0/59593924 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f43b0025050 con 0x561e6d9a2b40 2024-09-19T08:15:37.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.126+0000 7f43bdc16740 10 client.16104 fetch_fsmap learned FSMap version 20 2024-09-19T08:15:37.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.126+0000 7f43bdc16740 1 -- 172.21.15.27:0/59593924 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x561e6d9ba860 con 0x561e6d9a2b40 2024-09-19T08:15:37.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.126+0000 7f439cff9640 1 -- 172.21.15.27:0/59593924 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43a8036070 con 0x561e6d9a2b40 2024-09-19T08:15:37.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.126+0000 7f439cff9640 1 -- 172.21.15.27:0/59593924 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f43b0014b30 con 0x561e6d9a2b40 2024-09-19T08:15:37.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.126+0000 7f43bdc16740 10 client.16104 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:15:37.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.126+0000 7f43bdc16740 10 client.16104 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:15:37.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.126+0000 7f43bdc16740 20 client.16104 populate_metadata read hostname 'smithi027' 2024-09-19T08:15:37.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.126+0000 7f43bdc16740 1 --2- 172.21.15.27:0/59593924 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x561e6d9bbe10 0x561e6d9be2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:37.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.126+0000 7f43bdc16740 4 client.16104 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:15:37.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.126+0000 7f43bdc16740 1 -- 172.21.15.27:0/59593924 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e6d914860 con 0x561e6d9bbe10 2024-09-19T08:15:37.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.126+0000 7f43b95d9640 1 --2- 172.21.15.27:0/59593924 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x561e6d9bbe10 0x561e6d9be2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:37.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.127+0000 7f43b95d9640 1 --2- 172.21.15.27:0/59593924 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x561e6d9bbe10 0x561e6d9be2b0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=916fa9e62e3d84b server_cookie=759093bef767330c in_seq=0 out_seq=0 2024-09-19T08:15:37.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.127+0000 7f439cff9640 10 client.16104 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:37.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.127+0000 7f439cff9640 1 -- 172.21.15.27:0/59593924 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561e6d914860 con 0x561e6d9bbe10 2024-09-19T08:15:37.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.127+0000 7f439cff9640 10 client.16104 handle_command_reply: tid=0 2024-09-19T08:15:37.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.128+0000 7f43bdc16740 1 client.16104 shutdown 2024-09-19T08:15:37.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.128+0000 7f43bdc16740 1 -- 172.21.15.27:0/59593924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a2b40 msgr2=0x561e6d9a8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:37.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.128+0000 7f43bdc16740 1 --2- 172.21.15.27:0/59593924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a2b40 0x561e6d9a8fd0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f43b0010500 tx=0x7f43b00109c0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.128+0000 7f43bdc16740 1 -- 172.21.15.27:0/59593924 shutdown_connections 2024-09-19T08:15:37.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.128+0000 7f43bdc16740 1 --2- 172.21.15.27:0/59593924 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x561e6d9bbe10 0x561e6d9be2b0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.128+0000 7f43bdc16740 1 --2- 172.21.15.27:0/59593924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561e6d9ac370 0x561e6d9a9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.128+0000 7f439cff9640 0 client.16104 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:37.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.128+0000 7f43bdc16740 1 --2- 172.21.15.27:0/59593924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a2b40 0x561e6d9a8fd0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.128+0000 7f43bdc16740 1 --2- 172.21.15.27:0/59593924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9a15d0 0x561e6d9abd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.128+0000 7f43bdc16740 1 -- 172.21.15.27:0/59593924 >> 172.21.15.27:0/59593924 conn(0x561e6d96a310 msgr2=0x561e6d9a3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:37.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.128+0000 7f43bdc16740 1 -- 172.21.15.27:0/59593924 shutdown_connections 2024-09-19T08:15:37.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.128+0000 7f43bdc16740 1 -- 172.21.15.27:0/59593924 wait complete. 2024-09-19T08:15:37.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.128+0000 7f43bdc16740 20 client.16104 trim_cache size 0 max 16384 2024-09-19T08:15:37.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f43bdc16740 1 Processor -- start 2024-09-19T08:15:37.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f43bdc16740 1 -- start start 2024-09-19T08:15:37.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f43bdc16740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a15d0 0x561e6d99de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:37.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f43bdc16740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561e6d9a2b40 0x561e6d9b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:37.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f43bdc16740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9ac370 0x561e6d9c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:37.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f43bdc16740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f43b41ad980 con 0x561e6d9a15d0 2024-09-19T08:15:37.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f43bdc16740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f43b41b01e0 con 0x561e6d9ac370 2024-09-19T08:15:37.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f43bdc16740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f43b41adfd0 con 0x561e6d9a2b40 2024-09-19T08:15:37.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f43b95d9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a15d0 0x561e6d99de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:37.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f43b95d9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a15d0 0x561e6d99de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54892/0 (socket says 172.21.15.27:54892) 2024-09-19T08:15:37.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f43b95d9640 1 -- 172.21.15.27:0/1271728192 learned_addr learned my addr 172.21.15.27:0/1271728192 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:37.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f43b9dda640 1 --2- 172.21.15.27:0/1271728192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9ac370 0x561e6d9c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:37.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f43b8dd8640 1 --2- 172.21.15.27:0/1271728192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561e6d9a2b40 0x561e6d9b7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:37.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f43b95d9640 1 -- 172.21.15.27:0/1271728192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561e6d9a2b40 msgr2=0x561e6d9b7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:37.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f43b95d9640 1 --2- 172.21.15.27:0/1271728192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561e6d9a2b40 0x561e6d9b7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f43b95d9640 1 -- 172.21.15.27:0/1271728192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9ac370 msgr2=0x561e6d9c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:37.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f43b95d9640 1 --2- 172.21.15.27:0/1271728192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9ac370 0x561e6d9c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f43b95d9640 1 -- 172.21.15.27:0/1271728192 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e6d9a7520 con 0x561e6d9a15d0 2024-09-19T08:15:37.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f43b95d9640 1 --2- 172.21.15.27:0/1271728192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a15d0 0x561e6d99de10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f43a80c5eb0 tx=0x7f43a80b96a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3402f4f58c35281d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:37.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f439effd640 1 -- 172.21.15.27:0/1271728192 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a80098b0 con 0x561e6d9a15d0 2024-09-19T08:15:37.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f439effd640 1 -- 172.21.15.27:0/1271728192 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43a8036040 con 0x561e6d9a15d0 2024-09-19T08:15:37.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.142+0000 7f439effd640 1 -- 172.21.15.27:0/1271728192 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a80f4050 con 0x561e6d9a15d0 2024-09-19T08:15:37.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.143+0000 7f43bdc16740 1 -- 172.21.15.27:0/1271728192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a15d0 msgr2=0x561e6d99de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:37.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.143+0000 7f43bdc16740 1 --2- 172.21.15.27:0/1271728192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a15d0 0x561e6d99de10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f43a80c5eb0 tx=0x7f43a80b96a0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.143+0000 7f43bdc16740 1 -- 172.21.15.27:0/1271728192 shutdown_connections 2024-09-19T08:15:37.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.143+0000 7f43bdc16740 1 --2- 172.21.15.27:0/1271728192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9ac370 0x561e6d9c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.143+0000 7f43bdc16740 1 --2- 172.21.15.27:0/1271728192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561e6d9a2b40 0x561e6d9b7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.143+0000 7f43bdc16740 1 --2- 172.21.15.27:0/1271728192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a15d0 0x561e6d99de10 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.143+0000 7f43bdc16740 1 -- 172.21.15.27:0/1271728192 >> 172.21.15.27:0/1271728192 conn(0x561e6d96a310 msgr2=0x561e6d99d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:37.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.143+0000 7f43bdc16740 1 -- 172.21.15.27:0/1271728192 shutdown_connections 2024-09-19T08:15:37.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.143+0000 7f43bdc16740 1 -- 172.21.15.27:0/1271728192 wait complete. 2024-09-19T08:15:37.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.143+0000 7f43bdc16740 1 -- start start 2024-09-19T08:15:37.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.144+0000 7f43bdc16740 1 Processor -- start 2024-09-19T08:15:37.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.144+0000 7f43bdc16740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561e6d9a15d0 0x561e6d9b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:37.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.144+0000 7f43bdc16740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a2b40 0x561e6d9b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:37.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.144+0000 7f43bdc16740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9ac370 0x561e6d9b1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:37.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.144+0000 7f43bdc16740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f43b41ae6a0 con 0x561e6d9a2b40 2024-09-19T08:15:37.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.144+0000 7f43bdc16740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f43b41afb10 con 0x561e6d9ac370 2024-09-19T08:15:37.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.144+0000 7f43bdc16740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f43b41aed70 con 0x561e6d9a15d0 2024-09-19T08:15:37.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.144+0000 7f43bdc16740 10 client.0 _ll_register_callbacks cb 0x7f43b000b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:15:37.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.144+0000 7f43b8dd8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a2b40 0x561e6d9b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:37.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.144+0000 7f43b8dd8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a2b40 0x561e6d9b4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54904/0 (socket says 172.21.15.27:54904) 2024-09-19T08:15:37.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.144+0000 7f43b8dd8640 1 -- 172.21.15.27:0/2037980317 learned_addr learned my addr 172.21.15.27:0/2037980317 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:37.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.144+0000 7f43b95d9640 1 --2- 172.21.15.27:0/2037980317 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561e6d9a15d0 0x561e6d9b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:37.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.144+0000 7f43b9dda640 1 --2- 172.21.15.27:0/2037980317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9ac370 0x561e6d9b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:37.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.144+0000 7f43b8dd8640 1 -- 172.21.15.27:0/2037980317 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561e6d9a15d0 msgr2=0x561e6d9b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:37.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.144+0000 7f43b8dd8640 1 --2- 172.21.15.27:0/2037980317 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561e6d9a15d0 0x561e6d9b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.144+0000 7f43b8dd8640 1 -- 172.21.15.27:0/2037980317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9ac370 msgr2=0x561e6d9b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:37.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.144+0000 7f43b8dd8640 1 --2- 172.21.15.27:0/2037980317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9ac370 0x561e6d9b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.144+0000 7f43b8dd8640 1 -- 172.21.15.27:0/2037980317 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e6d9b1550 con 0x561e6d9a2b40 2024-09-19T08:15:37.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.145+0000 7f43b8dd8640 1 --2- 172.21.15.27:0/2037980317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a2b40 0x561e6d9b4580 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f43b0008010 tx=0x7f43b0012840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e0ee2934e68e4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:37.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.145+0000 7f439cff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:15:37.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.145+0000 7f439cff9640 1 -- 172.21.15.27:0/2037980317 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b001a050 con 0x561e6d9a2b40 2024-09-19T08:15:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.145+0000 7f439cff9640 1 -- 172.21.15.27:0/2037980317 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f43b000f040 con 0x561e6d9a2b40 2024-09-19T08:15:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.145+0000 7f43bdc16740 1 -- 172.21.15.27:0/2037980317 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43a8036040 con 0x561e6d9a2b40 2024-09-19T08:15:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.145+0000 7f439cff9640 1 -- 172.21.15.27:0/2037980317 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f43b000bda0 con 0x561e6d9a2b40 2024-09-19T08:15:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.145+0000 7f43bdc16740 10 client.16110 fetch_fsmap learned FSMap version 20 2024-09-19T08:15:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.145+0000 7f43bdc16740 1 -- 172.21.15.27:0/2037980317 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x561e6da27260 con 0x561e6d9a2b40 2024-09-19T08:15:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.145+0000 7f439cff9640 1 -- 172.21.15.27:0/2037980317 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43a8036040 con 0x561e6d9a2b40 2024-09-19T08:15:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.145+0000 7f439cff9640 1 -- 172.21.15.27:0/2037980317 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f43b0014430 con 0x561e6d9a2b40 2024-09-19T08:15:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.145+0000 7f43bdc16740 10 client.16110 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:15:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.145+0000 7f43bdc16740 10 client.16110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:15:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.145+0000 7f43bdc16740 20 client.16110 populate_metadata read hostname 'smithi027' 2024-09-19T08:15:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.146+0000 7f43bdc16740 1 --2- 172.21.15.27:0/2037980317 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x561e6da279e0 0x561e6da29e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.146+0000 7f43bdc16740 4 client.16110 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:15:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.146+0000 7f43bdc16740 1 -- 172.21.15.27:0/2037980317 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561e6d90ed70 con 0x561e6da279e0 2024-09-19T08:15:37.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.146+0000 7f43b95d9640 1 --2- 172.21.15.27:0/2037980317 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x561e6da279e0 0x561e6da29e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:37.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.146+0000 7f43b95d9640 1 --2- 172.21.15.27:0/2037980317 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x561e6da279e0 0x561e6da29e00 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=485b45001eb242d1 server_cookie=92fae3475ed5ab7a in_seq=0 out_seq=0 2024-09-19T08:15:37.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.146+0000 7f439cff9640 10 client.16110 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:37.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.146+0000 7f439cff9640 1 -- 172.21.15.27:0/2037980317 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561e6d90ed70 con 0x561e6da279e0 2024-09-19T08:15:37.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.146+0000 7f439cff9640 10 client.16110 handle_command_reply: tid=0 2024-09-19T08:15:37.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.146+0000 7f43bdc16740 1 client.16110 shutdown 2024-09-19T08:15:37.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.146+0000 7f43bdc16740 1 -- 172.21.15.27:0/2037980317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a2b40 msgr2=0x561e6d9b4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:37.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.146+0000 7f43bdc16740 1 --2- 172.21.15.27:0/2037980317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a2b40 0x561e6d9b4580 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f43b0008010 tx=0x7f43b0012840 comp rx=0 tx=0).stop 2024-09-19T08:15:37.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f43bdc16740 1 -- 172.21.15.27:0/2037980317 shutdown_connections 2024-09-19T08:15:37.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f43bdc16740 1 --2- 172.21.15.27:0/2037980317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561e6d9ac370 0x561e6d9b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f43bdc16740 1 --2- 172.21.15.27:0/2037980317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6d9a2b40 0x561e6d9b4580 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f43bdc16740 1 --2- 172.21.15.27:0/2037980317 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x561e6da279e0 0x561e6da29e00 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f43bdc16740 1 --2- 172.21.15.27:0/2037980317 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561e6d9a15d0 0x561e6d9b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f43bdc16740 1 -- 172.21.15.27:0/2037980317 >> 172.21.15.27:0/2037980317 conn(0x561e6d96a310 msgr2=0x561e6d9aa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:37.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f439cff9640 0 client.16110 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:37.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f43bdc16740 1 -- 172.21.15.27:0/2037980317 shutdown_connections 2024-09-19T08:15:37.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f43bdc16740 1 -- 172.21.15.27:0/2037980317 wait complete. 2024-09-19T08:15:37.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f43bdc16740 20 client.16110 trim_cache size 0 max 16384 2024-09-19T08:15:37.160 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:15:37.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f43bb83d640 1 -- 172.21.15.27:0/2621242378 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f43a00a3430 msgr2=0x7f43a00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:37.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f43bb83d640 1 --2- 172.21.15.27:0/2621242378 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f43a00a3430 0x7f43a00a58f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00bf00 tx=0x7f43ac0046c0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f43bb83d640 1 -- 172.21.15.27:0/2621242378 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43b4100a80 msgr2=0x7f43b40fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:37.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f43bb83d640 1 --2- 172.21.15.27:0/2621242378 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43b4100a80 0x7f43b40fce50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f43a802ae00 tx=0x7f43a8003ba0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f43bb83d640 1 -- 172.21.15.27:0/2621242378 shutdown_connections 2024-09-19T08:15:37.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f43bb83d640 1 --2- 172.21.15.27:0/2621242378 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f43a00a3430 0x7f43a00a58f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f43bb83d640 1 --2- 172.21.15.27:0/2621242378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b4106a80 0x7f43b40fd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f43bb83d640 1 --2- 172.21.15.27:0/2621242378 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43b4101420 0x7f43b40fd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f43bb83d640 1 --2- 172.21.15.27:0/2621242378 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43b4100a80 0x7f43b40fce50 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:37.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f43bb83d640 1 -- 172.21.15.27:0/2621242378 >> 172.21.15.27:0/2621242378 conn(0x7f43b40fc7a0 msgr2=0x7f43b406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:37.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.147+0000 7f43bb83d640 1 -- 172.21.15.27:0/2621242378 shutdown_connections 2024-09-19T08:15:37.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:37.148+0000 7f43bb83d640 1 -- 172.21.15.27:0/2621242378 wait complete. 2024-09-19T08:15:38.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:38 smithi155 ceph-mon[35362]: pgmap v141: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:15:39.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:38 smithi027 ceph-mon[31209]: pgmap v141: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:15:39.136 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:15:39.136 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:15:39.137 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:38 smithi203 ceph-mon[35198]: pgmap v141: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:15:39.409 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:15:39.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.883+0000 7fee6aa67640 1 -- 172.21.15.27:0/1801835523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee64102790 msgr2=0x7fee641067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.883+0000 7fee6aa67640 1 --2- 172.21.15.27:0/1801835523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee64102790 0x7fee641067e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fee58009900 tx=0x7fee5802a410 comp rx=0 tx=0).stop 2024-09-19T08:15:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.883+0000 7fee6aa67640 1 -- 172.21.15.27:0/1801835523 shutdown_connections 2024-09-19T08:15:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.883+0000 7fee6aa67640 1 --2- 172.21.15.27:0/1801835523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee64106f10 0x7fee6410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.883+0000 7fee6aa67640 1 --2- 172.21.15.27:0/1801835523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee64102790 0x7fee641067e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.883+0000 7fee6aa67640 1 --2- 172.21.15.27:0/1801835523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee64101de0 0x7fee641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.883+0000 7fee6aa67640 1 -- 172.21.15.27:0/1801835523 >> 172.21.15.27:0/1801835523 conn(0x7fee640fd8c0 msgr2=0x7fee640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.883+0000 7fee6aa67640 1 -- 172.21.15.27:0/1801835523 shutdown_connections 2024-09-19T08:15:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.883+0000 7fee6aa67640 1 -- 172.21.15.27:0/1801835523 wait complete. 2024-09-19T08:15:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.883+0000 7fee6aa67640 1 Processor -- start 2024-09-19T08:15:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.883+0000 7fee6aa67640 1 -- start start 2024-09-19T08:15:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.884+0000 7fee6aa67640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee64101de0 0x7fee6419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.884+0000 7fee6aa67640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee64102790 0x7fee6419ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.884+0000 7fee6aa67640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee64106f10 0x7fee6419efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.884+0000 7fee6aa67640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fee64111f70 con 0x7fee64102790 2024-09-19T08:15:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.884+0000 7fee6aa67640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fee64111df0 con 0x7fee64101de0 2024-09-19T08:15:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.884+0000 7fee6aa67640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fee641120f0 con 0x7fee64106f10 2024-09-19T08:15:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.884+0000 7fee63fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee64102790 0x7fee6419ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.884+0000 7fee63fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee64102790 0x7fee6419ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54920/0 (socket says 172.21.15.27:54920) 2024-09-19T08:15:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.884+0000 7fee63fff640 1 -- 172.21.15.27:0/3008795907 learned_addr learned my addr 172.21.15.27:0/3008795907 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.884+0000 7fee68803640 1 --2- 172.21.15.27:0/3008795907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee64101de0 0x7fee6419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.884+0000 7fee63fff640 1 -- 172.21.15.27:0/3008795907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee64106f10 msgr2=0x7fee6419efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.884+0000 7fee69004640 1 --2- 172.21.15.27:0/3008795907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee64106f10 0x7fee6419efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.884+0000 7fee63fff640 1 --2- 172.21.15.27:0/3008795907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee64106f10 0x7fee6419efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.884+0000 7fee63fff640 1 -- 172.21.15.27:0/3008795907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee64101de0 msgr2=0x7fee6419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.884+0000 7fee63fff640 1 --2- 172.21.15.27:0/3008795907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee64101de0 0x7fee6419a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.884+0000 7fee63fff640 1 -- 172.21.15.27:0/3008795907 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6419f6a0 con 0x7fee64102790 2024-09-19T08:15:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.884+0000 7fee63fff640 1 --2- 172.21.15.27:0/3008795907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee64102790 0x7fee6419ac30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fee58006010 tx=0x7fee580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.884+0000 7fee61ffb640 1 -- 172.21.15.27:0/3008795907 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5803f030 con 0x7fee64102790 2024-09-19T08:15:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.884+0000 7fee61ffb640 1 -- 172.21.15.27:0/3008795907 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee58003ce0 con 0x7fee64102790 2024-09-19T08:15:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.885+0000 7fee6aa67640 1 -- 172.21.15.27:0/3008795907 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6419f930 con 0x7fee64102790 2024-09-19T08:15:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.885+0000 7fee61ffb640 1 -- 172.21.15.27:0/3008795907 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58035070 con 0x7fee64102790 2024-09-19T08:15:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.885+0000 7fee6aa67640 1 -- 172.21.15.27:0/3008795907 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee641a7270 con 0x7fee64102790 2024-09-19T08:15:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.887+0000 7fee61ffb640 1 -- 172.21.15.27:0/3008795907 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fee58042030 con 0x7fee64102790 2024-09-19T08:15:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.887+0000 7fee6ce40740 1 Processor -- start 2024-09-19T08:15:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.887+0000 7fee6ce40740 1 -- start start 2024-09-19T08:15:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.887+0000 7fee6ce40740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b956bb60 0x5572b956bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.887+0000 7fee6ce40740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956c480 0x5572b9576800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:39.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.888+0000 7fee6ce40740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b9576d40 0x5572b9579130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:39.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.888+0000 7fee6ce40740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5572b94d1280 con 0x5572b9576d40 2024-09-19T08:15:39.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.888+0000 7fee6ce40740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5572b9478b10 con 0x5572b956bb60 2024-09-19T08:15:39.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.888+0000 7fee6ce40740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5572b94cd240 con 0x5572b956c480 2024-09-19T08:15:39.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.888+0000 7fee63fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b9576d40 0x5572b9579130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:39.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.888+0000 7fee69004640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b956bb60 0x5572b956bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:39.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.888+0000 7fee63fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b9576d40 0x5572b9579130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54930/0 (socket says 172.21.15.27:54930) 2024-09-19T08:15:39.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.888+0000 7fee63fff640 1 -- 172.21.15.27:0/2185424770 learned_addr learned my addr 172.21.15.27:0/2185424770 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:39.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.888+0000 7fee68803640 1 --2- 172.21.15.27:0/2185424770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956c480 0x5572b9576800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:39.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.888+0000 7fee61ffb640 1 --2- 172.21.15.27:0/3008795907 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fee4c0a33b0 0x7fee4c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:39.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.888+0000 7fee69004640 1 -- 172.21.15.27:0/2185424770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956c480 msgr2=0x5572b9576800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:39.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.888+0000 7fee69004640 1 --2- 172.21.15.27:0/2185424770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956c480 0x5572b9576800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.888+0000 7fee61ffb640 1 -- 172.21.15.27:0/3008795907 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fee580f0390 con 0x7fee64102790 2024-09-19T08:15:39.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.888+0000 7fee69004640 1 -- 172.21.15.27:0/2185424770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b9576d40 msgr2=0x5572b9579130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:39.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.888+0000 7fee69004640 1 --2- 172.21.15.27:0/2185424770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b9576d40 0x5572b9579130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.888+0000 7fee69004640 1 -- 172.21.15.27:0/2185424770 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b94851f0 con 0x5572b956bb60 2024-09-19T08:15:39.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.888+0000 7fee63fff640 1 --2- 172.21.15.27:0/2185424770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b9576d40 0x5572b9579130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:15:39.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.888+0000 7fee69004640 1 --2- 172.21.15.27:0/3008795907 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fee4c0a33b0 0x7fee4c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:39.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.888+0000 7fee69004640 1 --2- 172.21.15.27:0/2185424770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b956bb60 0x5572b956bf40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00bd90 tx=0x7fee5c00d710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69f06224a1b6c0f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:39.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.889+0000 7fee4affd640 1 -- 172.21.15.27:0/2185424770 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c011de0 con 0x5572b956bb60 2024-09-19T08:15:39.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.889+0000 7fee4affd640 1 -- 172.21.15.27:0/2185424770 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee5c00ddc0 con 0x5572b956bb60 2024-09-19T08:15:39.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.889+0000 7fee4affd640 1 -- 172.21.15.27:0/2185424770 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c019c00 con 0x5572b956bb60 2024-09-19T08:15:39.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.889+0000 7fee69004640 1 --2- 172.21.15.27:0/3008795907 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fee4c0a33b0 0x7fee4c0a5870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fee5c01e000 tx=0x7fee5c01f000 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:39.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.889+0000 7fee6ce40740 1 -- 172.21.15.27:0/2185424770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b956bb60 msgr2=0x5572b956bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:39.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.889+0000 7fee6ce40740 1 --2- 172.21.15.27:0/2185424770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b956bb60 0x5572b956bf40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00bd90 tx=0x7fee5c00d710 comp rx=0 tx=0).stop 2024-09-19T08:15:39.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.889+0000 7fee6ce40740 1 -- 172.21.15.27:0/2185424770 shutdown_connections 2024-09-19T08:15:39.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.889+0000 7fee6ce40740 1 --2- 172.21.15.27:0/2185424770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b9576d40 0x5572b9579130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.889+0000 7fee6ce40740 1 --2- 172.21.15.27:0/2185424770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956c480 0x5572b9576800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.889+0000 7fee6ce40740 1 --2- 172.21.15.27:0/2185424770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b956bb60 0x5572b956bf40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.889+0000 7fee6ce40740 1 -- 172.21.15.27:0/2185424770 >> 172.21.15.27:0/2185424770 conn(0x5572b95680f0 msgr2=0x5572b95684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:39.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.889+0000 7fee6ce40740 1 -- 172.21.15.27:0/2185424770 shutdown_connections 2024-09-19T08:15:39.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.890+0000 7fee6ce40740 1 -- 172.21.15.27:0/2185424770 wait complete. 2024-09-19T08:15:39.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.890+0000 7fee6ce40740 1 -- start start 2024-09-19T08:15:39.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.890+0000 7fee6ce40740 1 Processor -- start 2024-09-19T08:15:39.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.890+0000 7fee6ce40740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956bb60 0x5572b9573c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:39.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.890+0000 7fee6ce40740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b956c480 0x5572b9574170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:39.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.890+0000 7fee6ce40740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b9576d40 0x5572b95746b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:39.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.890+0000 7fee6ce40740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5572b9579910 con 0x5572b956c480 2024-09-19T08:15:39.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.890+0000 7fee6ce40740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5572b948bf10 con 0x5572b9576d40 2024-09-19T08:15:39.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.890+0000 7fee6ce40740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5572b9579a90 con 0x5572b956bb60 2024-09-19T08:15:39.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.890+0000 7fee6ce40740 10 client.0 _ll_register_callbacks cb 0x5572b9454a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:15:39.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.890+0000 7fee63fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b956c480 0x5572b9574170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:39.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.890+0000 7fee63fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b956c480 0x5572b9574170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54936/0 (socket says 172.21.15.27:54936) 2024-09-19T08:15:39.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.890+0000 7fee63fff640 1 -- 172.21.15.27:0/337579807 learned_addr learned my addr 172.21.15.27:0/337579807 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:39.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.891+0000 7fee69004640 1 --2- 172.21.15.27:0/337579807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b9576d40 0x5572b95746b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:39.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.891+0000 7fee68803640 1 --2- 172.21.15.27:0/337579807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956bb60 0x5572b9573c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:39.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.891+0000 7fee63fff640 1 -- 172.21.15.27:0/337579807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956bb60 msgr2=0x5572b9573c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:39.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.891+0000 7fee63fff640 1 --2- 172.21.15.27:0/337579807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956bb60 0x5572b9573c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.891+0000 7fee63fff640 1 -- 172.21.15.27:0/337579807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b9576d40 msgr2=0x5572b95746b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:39.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.891+0000 7fee63fff640 1 --2- 172.21.15.27:0/337579807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b9576d40 0x5572b95746b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.891+0000 7fee63fff640 1 -- 172.21.15.27:0/337579807 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b92426a0 con 0x5572b956c480 2024-09-19T08:15:39.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.891+0000 7fee68803640 1 --2- 172.21.15.27:0/337579807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956bb60 0x5572b9573c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:15:39.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.891+0000 7fee63fff640 1 --2- 172.21.15.27:0/337579807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b956c480 0x5572b9574170 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fee580edad0 tx=0x7fee58005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbad85940b86267b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:39.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.891+0000 7fee43fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:15:39.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.891+0000 7fee43fff640 1 -- 172.21.15.27:0/337579807 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58049040 con 0x5572b956c480 2024-09-19T08:15:39.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.891+0000 7fee43fff640 1 -- 172.21.15.27:0/337579807 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fee580ecff0 con 0x5572b956c480 2024-09-19T08:15:39.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.891+0000 7fee6ce40740 1 -- 172.21.15.27:0/337579807 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee5c00ddc0 con 0x5572b956c480 2024-09-19T08:15:39.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.891+0000 7fee43fff640 1 -- 172.21.15.27:0/337579807 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fee580bc550 con 0x5572b956c480 2024-09-19T08:15:39.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.891+0000 7fee6ce40740 10 client.16122 fetch_fsmap learned FSMap version 20 2024-09-19T08:15:39.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.891+0000 7fee6ce40740 1 -- 172.21.15.27:0/337579807 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5572b9585520 con 0x5572b956c480 2024-09-19T08:15:39.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.892+0000 7fee43fff640 1 -- 172.21.15.27:0/337579807 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee5c00ddc0 con 0x5572b956c480 2024-09-19T08:15:39.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.892+0000 7fee43fff640 1 -- 172.21.15.27:0/337579807 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fee580ed370 con 0x5572b956c480 2024-09-19T08:15:39.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.892+0000 7fee6ce40740 10 client.16122 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:15:39.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.892+0000 7fee6ce40740 10 client.16122 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:15:39.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.892+0000 7fee6ce40740 20 client.16122 populate_metadata read hostname 'smithi027' 2024-09-19T08:15:39.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.892+0000 7fee6ce40740 1 --2- 172.21.15.27:0/337579807 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5572b9586870 0x5572b9588cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:39.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.892+0000 7fee6ce40740 4 client.16122 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:15:39.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.892+0000 7fee6ce40740 1 -- 172.21.15.27:0/337579807 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572b94de7f0 con 0x5572b9586870 2024-09-19T08:15:39.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.892+0000 7fee68803640 1 --2- 172.21.15.27:0/337579807 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5572b9586870 0x5572b9588cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:39.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.893+0000 7fee68803640 1 --2- 172.21.15.27:0/337579807 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5572b9586870 0x5572b9588cc0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f34cdff8aaef442 server_cookie=778b6895e4d2c03a in_seq=0 out_seq=0 2024-09-19T08:15:39.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.893+0000 7fee43fff640 10 client.16122 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:39.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.893+0000 7fee43fff640 1 -- 172.21.15.27:0/337579807 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5572b94de7f0 con 0x5572b9586870 2024-09-19T08:15:39.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.893+0000 7fee43fff640 10 client.16122 handle_command_reply: tid=0 2024-09-19T08:15:39.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.893+0000 7fee6ce40740 1 client.16122 shutdown 2024-09-19T08:15:39.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.893+0000 7fee6ce40740 1 -- 172.21.15.27:0/337579807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b956c480 msgr2=0x5572b9574170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:39.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.893+0000 7fee6ce40740 1 --2- 172.21.15.27:0/337579807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b956c480 0x5572b9574170 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fee580edad0 tx=0x7fee58005c90 comp rx=0 tx=0).stop 2024-09-19T08:15:39.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.893+0000 7fee6ce40740 1 -- 172.21.15.27:0/337579807 shutdown_connections 2024-09-19T08:15:39.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.893+0000 7fee6ce40740 1 --2- 172.21.15.27:0/337579807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b9576d40 0x5572b95746b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.893+0000 7fee6ce40740 1 --2- 172.21.15.27:0/337579807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b956c480 0x5572b9574170 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.893+0000 7fee6ce40740 1 --2- 172.21.15.27:0/337579807 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5572b9586870 0x5572b9588cc0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.893+0000 7fee6ce40740 1 --2- 172.21.15.27:0/337579807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956bb60 0x5572b9573c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.893+0000 7fee6ce40740 1 -- 172.21.15.27:0/337579807 >> 172.21.15.27:0/337579807 conn(0x5572b95680f0 msgr2=0x5572b9567270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:39.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.893+0000 7fee43fff640 0 client.16122 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:39.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.894+0000 7fee6ce40740 1 -- 172.21.15.27:0/337579807 shutdown_connections 2024-09-19T08:15:39.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.894+0000 7fee6ce40740 1 -- 172.21.15.27:0/337579807 wait complete. 2024-09-19T08:15:39.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.894+0000 7fee6ce40740 20 client.16122 trim_cache size 0 max 16384 2024-09-19T08:15:39.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.912+0000 7fee6ce40740 1 Processor -- start 2024-09-19T08:15:39.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.912+0000 7fee6ce40740 1 -- start start 2024-09-19T08:15:39.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.912+0000 7fee6ce40740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956bb60 0x5572b958e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:39.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.912+0000 7fee6ce40740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b956c480 0x5572b958eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:39.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.912+0000 7fee6ce40740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b9576d40 0x5572b9570eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:39.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.912+0000 7fee6ce40740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fee641ad980 con 0x5572b9576d40 2024-09-19T08:15:39.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.912+0000 7fee6ce40740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fee641b0200 con 0x5572b956c480 2024-09-19T08:15:39.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.912+0000 7fee6ce40740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fee641adff0 con 0x5572b956bb60 2024-09-19T08:15:39.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.912+0000 7fee69004640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b9576d40 0x5572b9570eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:39.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.912+0000 7fee69004640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b9576d40 0x5572b9570eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54950/0 (socket says 172.21.15.27:54950) 2024-09-19T08:15:39.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.912+0000 7fee69004640 1 -- 172.21.15.27:0/548787696 learned_addr learned my addr 172.21.15.27:0/548787696 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:39.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.912+0000 7fee68803640 1 --2- 172.21.15.27:0/548787696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956bb60 0x5572b958e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:39.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.912+0000 7fee63fff640 1 --2- 172.21.15.27:0/548787696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b956c480 0x5572b958eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:39.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.912+0000 7fee69004640 1 -- 172.21.15.27:0/548787696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956bb60 msgr2=0x5572b958e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:39.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.912+0000 7fee69004640 1 --2- 172.21.15.27:0/548787696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956bb60 0x5572b958e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.912+0000 7fee69004640 1 -- 172.21.15.27:0/548787696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b956c480 msgr2=0x5572b958eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:39.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.912+0000 7fee69004640 1 --2- 172.21.15.27:0/548787696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b956c480 0x5572b958eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.912+0000 7fee69004640 1 -- 172.21.15.27:0/548787696 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b9589340 con 0x5572b9576d40 2024-09-19T08:15:39.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.912+0000 7fee63fff640 1 --2- 172.21.15.27:0/548787696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b956c480 0x5572b958eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:15:39.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.913+0000 7fee69004640 1 --2- 172.21.15.27:0/548787696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b9576d40 0x5572b9570eb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0197b0 tx=0x7fee5c0197e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ffc2855e7885f61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:39.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.913+0000 7fee4a7fc640 1 -- 172.21.15.27:0/548787696 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c033070 con 0x5572b9576d40 2024-09-19T08:15:39.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.913+0000 7fee4a7fc640 1 -- 172.21.15.27:0/548787696 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee5c01ad40 con 0x5572b9576d40 2024-09-19T08:15:39.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.913+0000 7fee4a7fc640 1 -- 172.21.15.27:0/548787696 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c019c40 con 0x5572b9576d40 2024-09-19T08:15:39.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.914+0000 7fee6ce40740 1 -- 172.21.15.27:0/548787696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b9576d40 msgr2=0x5572b9570eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:39.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.914+0000 7fee6ce40740 1 --2- 172.21.15.27:0/548787696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b9576d40 0x5572b9570eb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0197b0 tx=0x7fee5c0197e0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.914+0000 7fee6ce40740 1 -- 172.21.15.27:0/548787696 shutdown_connections 2024-09-19T08:15:39.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.914+0000 7fee6ce40740 1 --2- 172.21.15.27:0/548787696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b9576d40 0x5572b9570eb0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.914+0000 7fee6ce40740 1 --2- 172.21.15.27:0/548787696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b956c480 0x5572b958eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.914+0000 7fee6ce40740 1 --2- 172.21.15.27:0/548787696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956bb60 0x5572b958e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.914+0000 7fee6ce40740 1 -- 172.21.15.27:0/548787696 >> 172.21.15.27:0/548787696 conn(0x5572b95680f0 msgr2=0x5572b9575ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:39.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.914+0000 7fee6ce40740 1 -- 172.21.15.27:0/548787696 shutdown_connections 2024-09-19T08:15:39.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.914+0000 7fee6ce40740 1 -- 172.21.15.27:0/548787696 wait complete. 2024-09-19T08:15:39.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.914+0000 7fee6ce40740 1 -- start start 2024-09-19T08:15:39.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.914+0000 7fee6ce40740 1 Processor -- start 2024-09-19T08:15:39.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee6ce40740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956bb60 0x5572b957ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:39.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee6ce40740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b956c480 0x5572b957f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:39.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee6ce40740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b9576d40 0x5572b957bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:39.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee6ce40740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fee641ae6c0 con 0x5572b956c480 2024-09-19T08:15:39.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee6ce40740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fee641afb30 con 0x5572b9576d40 2024-09-19T08:15:39.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee6ce40740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fee641aed90 con 0x5572b956bb60 2024-09-19T08:15:39.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee6ce40740 10 client.0 _ll_register_callbacks cb 0x7fee580b8370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:15:39.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee63fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b956c480 0x5572b957f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:39.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee63fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b956c480 0x5572b957f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54958/0 (socket says 172.21.15.27:54958) 2024-09-19T08:15:39.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee63fff640 1 -- 172.21.15.27:0/2716498159 learned_addr learned my addr 172.21.15.27:0/2716498159 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:39.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee68803640 1 --2- 172.21.15.27:0/2716498159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956bb60 0x5572b957ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:39.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee69004640 1 --2- 172.21.15.27:0/2716498159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b9576d40 0x5572b957bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:39.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee63fff640 1 -- 172.21.15.27:0/2716498159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956bb60 msgr2=0x5572b957ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:39.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee63fff640 1 --2- 172.21.15.27:0/2716498159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956bb60 0x5572b957ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee63fff640 1 -- 172.21.15.27:0/2716498159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b9576d40 msgr2=0x5572b957bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:39.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee63fff640 1 --2- 172.21.15.27:0/2716498159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b9576d40 0x5572b957bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee63fff640 1 -- 172.21.15.27:0/2716498159 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b957c2f0 con 0x5572b956c480 2024-09-19T08:15:39.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee63fff640 1 --2- 172.21.15.27:0/2716498159 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b956c480 0x5572b957f220 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fee580edbe0 tx=0x7fee58009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdfbd0dde6af5df3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:39.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee43fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:15:39.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee43fff640 1 -- 172.21.15.27:0/2716498159 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58049040 con 0x5572b956c480 2024-09-19T08:15:39.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.915+0000 7fee43fff640 1 -- 172.21.15.27:0/2716498159 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fee580b8df0 con 0x5572b956c480 2024-09-19T08:15:39.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.916+0000 7fee6ce40740 1 -- 172.21.15.27:0/2716498159 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee5c01ad40 con 0x5572b956c480 2024-09-19T08:15:39.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.916+0000 7fee43fff640 1 -- 172.21.15.27:0/2716498159 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fee580044e0 con 0x5572b956c480 2024-09-19T08:15:39.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.916+0000 7fee6ce40740 10 client.16128 fetch_fsmap learned FSMap version 20 2024-09-19T08:15:39.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.916+0000 7fee6ce40740 1 -- 172.21.15.27:0/2716498159 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5572b957c2f0 con 0x5572b956c480 2024-09-19T08:15:39.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.916+0000 7fee43fff640 1 -- 172.21.15.27:0/2716498159 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee5c01ad40 con 0x5572b956c480 2024-09-19T08:15:39.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.916+0000 7fee43fff640 1 -- 172.21.15.27:0/2716498159 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fee580ed6f0 con 0x5572b956c480 2024-09-19T08:15:39.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.916+0000 7fee6ce40740 10 client.16128 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:15:39.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.916+0000 7fee6ce40740 10 client.16128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:15:39.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.916+0000 7fee6ce40740 20 client.16128 populate_metadata read hostname 'smithi027' 2024-09-19T08:15:39.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.916+0000 7fee6ce40740 1 --2- 172.21.15.27:0/2716498159 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5572b95f2330 0x5572b95f4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:39.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.916+0000 7fee6ce40740 4 client.16128 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:15:39.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.916+0000 7fee6ce40740 1 -- 172.21.15.27:0/2716498159 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5572b94d8d00 con 0x5572b95f2330 2024-09-19T08:15:39.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.916+0000 7fee68803640 1 --2- 172.21.15.27:0/2716498159 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5572b95f2330 0x5572b95f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:39.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.917+0000 7fee43fff640 10 client.16128 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:39.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.917+0000 7fee68803640 1 --2- 172.21.15.27:0/2716498159 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5572b95f2330 0x5572b95f4750 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=765f14f7df38b95a server_cookie=cec9b86e7fb3400b in_seq=0 out_seq=0 2024-09-19T08:15:39.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.918+0000 7fee43fff640 1 -- 172.21.15.27:0/2716498159 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5572b94d8d00 con 0x5572b95f2330 2024-09-19T08:15:39.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.918+0000 7fee43fff640 10 client.16128 handle_command_reply: tid=0 2024-09-19T08:15:39.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.918+0000 7fee6ce40740 1 client.16128 shutdown 2024-09-19T08:15:39.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.918+0000 7fee6ce40740 1 -- 172.21.15.27:0/2716498159 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b956c480 msgr2=0x5572b957f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:39.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.918+0000 7fee6ce40740 1 --2- 172.21.15.27:0/2716498159 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b956c480 0x5572b957f220 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fee580edbe0 tx=0x7fee58009290 comp rx=0 tx=0).stop 2024-09-19T08:15:39.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.918+0000 7fee6ce40740 1 -- 172.21.15.27:0/2716498159 shutdown_connections 2024-09-19T08:15:39.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.918+0000 7fee6ce40740 1 --2- 172.21.15.27:0/2716498159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572b9576d40 0x5572b957bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.918+0000 7fee6ce40740 1 --2- 172.21.15.27:0/2716498159 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5572b956c480 0x5572b957f220 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.918+0000 7fee6ce40740 1 --2- 172.21.15.27:0/2716498159 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5572b95f2330 0x5572b95f4750 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.918+0000 7fee6ce40740 1 --2- 172.21.15.27:0/2716498159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572b956bb60 0x5572b957ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.918+0000 7fee43fff640 0 client.16128 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:39.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.918+0000 7fee6ce40740 1 -- 172.21.15.27:0/2716498159 >> 172.21.15.27:0/2716498159 conn(0x5572b95680f0 msgr2=0x5572b9573bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:39.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.918+0000 7fee6ce40740 1 -- 172.21.15.27:0/2716498159 shutdown_connections 2024-09-19T08:15:39.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.918+0000 7fee6ce40740 1 -- 172.21.15.27:0/2716498159 wait complete. 2024-09-19T08:15:39.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.919+0000 7fee6ce40740 20 client.16128 trim_cache size 0 max 16384 2024-09-19T08:15:39.923 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:15:39.923 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:15:39.923 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "5b8bbe79-5369-4f1e-bab4-7f8608706c16", 2024-09-19T08:15:39.923 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:15:39.923 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:15:39.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.919+0000 7fee6aa67640 1 -- 172.21.15.27:0/3008795907 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fee4c0a33b0 msgr2=0x7fee4c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:39.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.919+0000 7fee6aa67640 1 --2- 172.21.15.27:0/3008795907 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fee4c0a33b0 0x7fee4c0a5870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fee5c01e000 tx=0x7fee5c01f000 comp rx=0 tx=0).stop 2024-09-19T08:15:39.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.919+0000 7fee6aa67640 1 -- 172.21.15.27:0/3008795907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee64102790 msgr2=0x7fee6419ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:39.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.919+0000 7fee6aa67640 1 --2- 172.21.15.27:0/3008795907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee64102790 0x7fee6419ac30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fee58006010 tx=0x7fee580042f0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.919+0000 7fee6aa67640 1 -- 172.21.15.27:0/3008795907 shutdown_connections 2024-09-19T08:15:39.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.919+0000 7fee6aa67640 1 --2- 172.21.15.27:0/3008795907 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fee4c0a33b0 0x7fee4c0a5870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.919+0000 7fee6aa67640 1 --2- 172.21.15.27:0/3008795907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee64106f10 0x7fee6419efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.919+0000 7fee6aa67640 1 --2- 172.21.15.27:0/3008795907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee64102790 0x7fee6419ac30 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.919+0000 7fee6aa67640 1 --2- 172.21.15.27:0/3008795907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee64101de0 0x7fee6419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:39.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.919+0000 7fee6aa67640 1 -- 172.21.15.27:0/3008795907 >> 172.21.15.27:0/3008795907 conn(0x7fee640fd8c0 msgr2=0x7fee640fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:39.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.919+0000 7fee6aa67640 1 -- 172.21.15.27:0/3008795907 shutdown_connections 2024-09-19T08:15:39.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:39.919+0000 7fee6aa67640 1 -- 172.21.15.27:0/3008795907 wait complete. 2024-09-19T08:15:40.759 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:15:40.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:40 smithi155 ceph-mon[35362]: pgmap v142: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:40.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:40 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:15:40.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:40 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:15:40.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:40 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:15:40.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:40 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:15:40.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:40 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:15:41.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:40 smithi027 ceph-mon[31209]: pgmap v142: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:41.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:40 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:15:41.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:40 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:15:41.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:40 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:15:41.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:40 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:15:41.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:40 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:15:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:40 smithi203 ceph-mon[35198]: pgmap v142: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:40 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:15:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:40 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:15:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:40 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:15:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:40 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:15:41.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:40 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:15:41.019 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:15:41.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.467+0000 7f9289d9f640 1 -- 172.21.15.27:0/1238884965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9284107af0 msgr2=0x7f9284107ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:41.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.467+0000 7f9289d9f640 1 --2- 172.21.15.27:0/1238884965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9284107af0 0x7f9284107ed0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f9278009930 tx=0x7f927802a420 comp rx=0 tx=0).stop 2024-09-19T08:15:41.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.467+0000 7f9289d9f640 1 -- 172.21.15.27:0/1238884965 shutdown_connections 2024-09-19T08:15:41.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.467+0000 7f9289d9f640 1 --2- 172.21.15.27:0/1238884965 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9284102380 0x7f928410e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.467+0000 7f9289d9f640 1 --2- 172.21.15.27:0/1238884965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92841019e0 0x7f9284101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.467+0000 7f9289d9f640 1 --2- 172.21.15.27:0/1238884965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9284107af0 0x7f9284107ed0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.467+0000 7f9289d9f640 1 -- 172.21.15.27:0/1238884965 >> 172.21.15.27:0/1238884965 conn(0x7f92840fd700 msgr2=0x7f92840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:41.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.467+0000 7f9289d9f640 1 -- 172.21.15.27:0/1238884965 shutdown_connections 2024-09-19T08:15:41.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.467+0000 7f9289d9f640 1 -- 172.21.15.27:0/1238884965 wait complete. 2024-09-19T08:15:41.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.468+0000 7f9289d9f640 1 Processor -- start 2024-09-19T08:15:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.468+0000 7f9289d9f640 1 -- start start 2024-09-19T08:15:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.468+0000 7f9289d9f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92841019e0 0x7f92840744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.468+0000 7f9289d9f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9284102380 0x7f9284074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.468+0000 7f9289d9f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9284107af0 0x7f9284074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.468+0000 7f9289d9f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9284111f10 con 0x7f9284102380 2024-09-19T08:15:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.468+0000 7f9289d9f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9284111d90 con 0x7f9284107af0 2024-09-19T08:15:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.468+0000 7f9289d9f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9284112090 con 0x7f92841019e0 2024-09-19T08:15:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.469+0000 7f9283fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9284102380 0x7f9284074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.469+0000 7f9288d9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92841019e0 0x7f92840744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.469+0000 7f9283fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9284102380 0x7f9284074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52328/0 (socket says 172.21.15.27:52328) 2024-09-19T08:15:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.469+0000 7f9283fff640 1 -- 172.21.15.27:0/1781872245 learned_addr learned my addr 172.21.15.27:0/1781872245 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:41.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.469+0000 7f928959e640 1 --2- 172.21.15.27:0/1781872245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9284107af0 0x7f9284074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:41.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.469+0000 7f9283fff640 1 -- 172.21.15.27:0/1781872245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92841019e0 msgr2=0x7f92840744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:41.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.469+0000 7f9283fff640 1 --2- 172.21.15.27:0/1781872245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92841019e0 0x7f92840744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.469+0000 7f9283fff640 1 -- 172.21.15.27:0/1781872245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9284107af0 msgr2=0x7f9284074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:41.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.469+0000 7f9283fff640 1 --2- 172.21.15.27:0/1781872245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9284107af0 0x7f9284074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.469+0000 7f9283fff640 1 -- 172.21.15.27:0/1781872245 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92841a6870 con 0x7f9284102380 2024-09-19T08:15:41.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.469+0000 7f9283fff640 1 --2- 172.21.15.27:0/1781872245 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9284102380 0x7f9284074a30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f927000b4a0 tx=0x7f927000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:41.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.469+0000 7f9281ffb640 1 -- 172.21.15.27:0/1781872245 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9270014070 con 0x7f9284102380 2024-09-19T08:15:41.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.469+0000 7f9281ffb640 1 -- 172.21.15.27:0/1781872245 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9270010af0 con 0x7f9284102380 2024-09-19T08:15:41.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.469+0000 7f9289d9f640 1 -- 172.21.15.27:0/1781872245 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92841a6b60 con 0x7f9284102380 2024-09-19T08:15:41.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.469+0000 7f9281ffb640 1 -- 172.21.15.27:0/1781872245 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9270017d10 con 0x7f9284102380 2024-09-19T08:15:41.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.470+0000 7f9289d9f640 1 -- 172.21.15.27:0/1781872245 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92841a70a0 con 0x7f9284102380 2024-09-19T08:15:41.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.472+0000 7f9281ffb640 1 -- 172.21.15.27:0/1781872245 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9270017070 con 0x7f9284102380 2024-09-19T08:15:41.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.473+0000 7f928d3da740 1 Processor -- start 2024-09-19T08:15:41.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.473+0000 7f928d3da740 1 -- start start 2024-09-19T08:15:41.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.473+0000 7f928d3da740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb1ffa670 0x559bb1ffaa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:41.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.473+0000 7f928d3da740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb1ffaf90 0x559bb2005310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:41.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.473+0000 7f928d3da740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb2005850 0x559bb2007c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:41.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.473+0000 7f928d3da740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559bb1f602e0 con 0x559bb2005850 2024-09-19T08:15:41.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.473+0000 7f928d3da740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559bb1f07ce0 con 0x559bb1ffa670 2024-09-19T08:15:41.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.473+0000 7f928d3da740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559bb1f5c2a0 con 0x559bb1ffaf90 2024-09-19T08:15:41.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.473+0000 7f9281ffb640 1 --2- 172.21.15.27:0/1781872245 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f92740a33b0 0x7f92740a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:41.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.473+0000 7f9283fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb2005850 0x559bb2007c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:41.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.473+0000 7f9283fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb2005850 0x559bb2007c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52342/0 (socket says 172.21.15.27:52342) 2024-09-19T08:15:41.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.473+0000 7f9283fff640 1 -- 172.21.15.27:0/2712812988 learned_addr learned my addr 172.21.15.27:0/2712812988 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:41.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.473+0000 7f928959e640 1 --2- 172.21.15.27:0/2712812988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb1ffa670 0x559bb1ffaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:41.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.473+0000 7f9288d9d640 1 --2- 172.21.15.27:0/2712812988 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb1ffaf90 0x559bb2005310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:41.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.473+0000 7f928959e640 1 --2- 172.21.15.27:0/1781872245 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f92740a33b0 0x7f92740a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:41.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.474+0000 7f9281ffb640 1 -- 172.21.15.27:0/1781872245 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f92700cee80 con 0x7f9284102380 2024-09-19T08:15:41.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.474+0000 7f928959e640 1 -- 172.21.15.27:0/2712812988 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb1ffaf90 msgr2=0x559bb2005310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:41.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.474+0000 7f928959e640 1 --2- 172.21.15.27:0/2712812988 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb1ffaf90 0x559bb2005310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.474+0000 7f928959e640 1 -- 172.21.15.27:0/2712812988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb2005850 msgr2=0x559bb2007c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:41.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.474+0000 7f928959e640 1 --2- 172.21.15.27:0/2712812988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb2005850 0x559bb2007c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.474+0000 7f928959e640 1 -- 172.21.15.27:0/2712812988 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bb1eec440 con 0x559bb1ffa670 2024-09-19T08:15:41.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.474+0000 7f9283fff640 1 --2- 172.21.15.27:0/2712812988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb2005850 0x559bb2007c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:15:41.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.474+0000 7f928959e640 1 --2- 172.21.15.27:0/2712812988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb1ffa670 0x559bb1ffaa50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f927c014e60 tx=0x7f927c0117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4104170562f77fbb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:41.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.474+0000 7f928959e640 1 --2- 172.21.15.27:0/1781872245 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f92740a33b0 0x7f92740a5870 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f927c007fd0 tx=0x7f927c016000 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:41.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.474+0000 7f926effd640 1 -- 172.21.15.27:0/2712812988 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c014050 con 0x559bb1ffa670 2024-09-19T08:15:41.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.474+0000 7f926effd640 1 -- 172.21.15.27:0/2712812988 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f927c007c00 con 0x559bb1ffa670 2024-09-19T08:15:41.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.474+0000 7f926effd640 1 -- 172.21.15.27:0/2712812988 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c004020 con 0x559bb1ffa670 2024-09-19T08:15:41.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.475+0000 7f928d3da740 1 -- 172.21.15.27:0/2712812988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb1ffa670 msgr2=0x559bb1ffaa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:41.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.475+0000 7f928d3da740 1 --2- 172.21.15.27:0/2712812988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb1ffa670 0x559bb1ffaa50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f927c014e60 tx=0x7f927c0117b0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.475+0000 7f928d3da740 1 -- 172.21.15.27:0/2712812988 shutdown_connections 2024-09-19T08:15:41.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.475+0000 7f928d3da740 1 --2- 172.21.15.27:0/2712812988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb2005850 0x559bb2007c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.475+0000 7f928d3da740 1 --2- 172.21.15.27:0/2712812988 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb1ffaf90 0x559bb2005310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.475+0000 7f928d3da740 1 --2- 172.21.15.27:0/2712812988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb1ffa670 0x559bb1ffaa50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.475+0000 7f928d3da740 1 -- 172.21.15.27:0/2712812988 >> 172.21.15.27:0/2712812988 conn(0x559bb1ff6c00 msgr2=0x559bb1ff6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:41.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.475+0000 7f928d3da740 1 -- 172.21.15.27:0/2712812988 shutdown_connections 2024-09-19T08:15:41.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.475+0000 7f928d3da740 1 -- 172.21.15.27:0/2712812988 wait complete. 2024-09-19T08:15:41.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.476+0000 7f928d3da740 1 -- start start 2024-09-19T08:15:41.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.476+0000 7f928d3da740 1 Processor -- start 2024-09-19T08:15:41.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.476+0000 7f928d3da740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb1ffa670 0x559bb2005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:41.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.476+0000 7f928d3da740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb1ffaf90 0x559bb20024d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:41.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.476+0000 7f928d3da740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb2005850 0x559bb2002ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:41.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.476+0000 7f928d3da740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559bb2008420 con 0x559bb2005850 2024-09-19T08:15:41.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.476+0000 7f928d3da740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559bb1f1b050 con 0x559bb1ffaf90 2024-09-19T08:15:41.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.476+0000 7f928d3da740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559bb20085a0 con 0x559bb1ffa670 2024-09-19T08:15:41.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.476+0000 7f928d3da740 10 client.0 _ll_register_callbacks cb 0x559bb1f5b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:15:41.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.476+0000 7f928959e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb2005850 0x559bb2002ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:41.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.476+0000 7f928959e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb2005850 0x559bb2002ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52358/0 (socket says 172.21.15.27:52358) 2024-09-19T08:15:41.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.476+0000 7f928959e640 1 -- 172.21.15.27:0/3357319146 learned_addr learned my addr 172.21.15.27:0/3357319146 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:41.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.476+0000 7f9283fff640 1 --2- 172.21.15.27:0/3357319146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb1ffaf90 0x559bb20024d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:41.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.476+0000 7f9288d9d640 1 --2- 172.21.15.27:0/3357319146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb1ffa670 0x559bb2005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:41.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.477+0000 7f928959e640 1 -- 172.21.15.27:0/3357319146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb1ffa670 msgr2=0x559bb2005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:41.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.477+0000 7f928959e640 1 --2- 172.21.15.27:0/3357319146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb1ffa670 0x559bb2005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.477+0000 7f928959e640 1 -- 172.21.15.27:0/3357319146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb1ffaf90 msgr2=0x559bb20024d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:41.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.477+0000 7f928959e640 1 --2- 172.21.15.27:0/3357319146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb1ffaf90 0x559bb20024d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.477+0000 7f928959e640 1 -- 172.21.15.27:0/3357319146 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bb1cd13c0 con 0x559bb2005850 2024-09-19T08:15:41.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.477+0000 7f928959e640 1 --2- 172.21.15.27:0/3357319146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb2005850 0x559bb2002ac0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f927c007560 tx=0x7f927c003cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633453cff4055821 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:41.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.477+0000 7f9263fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:15:41.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.477+0000 7f9263fff640 1 -- 172.21.15.27:0/3357319146 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c014250 con 0x559bb2005850 2024-09-19T08:15:41.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.477+0000 7f9263fff640 1 -- 172.21.15.27:0/3357319146 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f927c0049e0 con 0x559bb2005850 2024-09-19T08:15:41.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.477+0000 7f928d3da740 1 -- 172.21.15.27:0/3357319146 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f927c007c00 con 0x559bb2005850 2024-09-19T08:15:41.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.477+0000 7f9263fff640 1 -- 172.21.15.27:0/3357319146 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f927c0143f0 con 0x559bb2005850 2024-09-19T08:15:41.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.477+0000 7f928d3da740 10 client.16140 fetch_fsmap learned FSMap version 20 2024-09-19T08:15:41.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.477+0000 7f928d3da740 1 -- 172.21.15.27:0/3357319146 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559bb2013e50 con 0x559bb2005850 2024-09-19T08:15:41.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.478+0000 7f9263fff640 1 -- 172.21.15.27:0/3357319146 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f927c007c00 con 0x559bb2005850 2024-09-19T08:15:41.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.478+0000 7f9263fff640 1 -- 172.21.15.27:0/3357319146 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f927c005040 con 0x559bb2005850 2024-09-19T08:15:41.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.478+0000 7f928d3da740 10 client.16140 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:15:41.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.478+0000 7f928d3da740 10 client.16140 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:15:41.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.478+0000 7f928d3da740 20 client.16140 populate_metadata read hostname 'smithi027' 2024-09-19T08:15:41.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.478+0000 7f928d3da740 1 --2- 172.21.15.27:0/3357319146 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559bb20152b0 0x559bb20176a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:41.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.478+0000 7f928d3da740 4 client.16140 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:15:41.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.478+0000 7f928d3da740 1 -- 172.21.15.27:0/3357319146 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bb1f6d850 con 0x559bb20152b0 2024-09-19T08:15:41.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.478+0000 7f9288d9d640 1 --2- 172.21.15.27:0/3357319146 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559bb20152b0 0x559bb20176a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:41.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.478+0000 7f9263fff640 10 client.16140 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:41.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.478+0000 7f9288d9d640 1 --2- 172.21.15.27:0/3357319146 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559bb20152b0 0x559bb20176a0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dc9c4471bc415d9 server_cookie=97bb79ddcb903b5b in_seq=0 out_seq=0 2024-09-19T08:15:41.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.479+0000 7f9263fff640 1 -- 172.21.15.27:0/3357319146 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559bb1f6d850 con 0x559bb20152b0 2024-09-19T08:15:41.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.479+0000 7f9263fff640 10 client.16140 handle_command_reply: tid=0 2024-09-19T08:15:41.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.479+0000 7f928d3da740 1 client.16140 shutdown 2024-09-19T08:15:41.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.479+0000 7f928d3da740 1 -- 172.21.15.27:0/3357319146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb2005850 msgr2=0x559bb2002ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:41.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.479+0000 7f928d3da740 1 --2- 172.21.15.27:0/3357319146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb2005850 0x559bb2002ac0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f927c007560 tx=0x7f927c003cf0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.479+0000 7f928d3da740 1 -- 172.21.15.27:0/3357319146 shutdown_connections 2024-09-19T08:15:41.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.479+0000 7f928d3da740 1 --2- 172.21.15.27:0/3357319146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb2005850 0x559bb2002ac0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.479+0000 7f928d3da740 1 --2- 172.21.15.27:0/3357319146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb1ffaf90 0x559bb20024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.479+0000 7f928d3da740 1 --2- 172.21.15.27:0/3357319146 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559bb20152b0 0x559bb20176a0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.479+0000 7f928d3da740 1 --2- 172.21.15.27:0/3357319146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb1ffa670 0x559bb2005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.479+0000 7f9263fff640 0 client.16140 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:41.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.479+0000 7f928d3da740 1 -- 172.21.15.27:0/3357319146 >> 172.21.15.27:0/3357319146 conn(0x559bb1ff6c00 msgr2=0x559bb1ffc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:41.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.480+0000 7f928d3da740 1 -- 172.21.15.27:0/3357319146 shutdown_connections 2024-09-19T08:15:41.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.480+0000 7f928d3da740 1 -- 172.21.15.27:0/3357319146 wait complete. 2024-09-19T08:15:41.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.480+0000 7f928d3da740 20 client.16140 trim_cache size 0 max 16384 2024-09-19T08:15:41.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.497+0000 7f928d3da740 1 Processor -- start 2024-09-19T08:15:41.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.497+0000 7f928d3da740 1 -- start start 2024-09-19T08:15:41.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.497+0000 7f928d3da740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb1ffa670 0x559bb2004440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:41.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.497+0000 7f928d3da740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb1ffaf90 0x559bb201ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:41.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.497+0000 7f928d3da740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb2005850 0x559bb201d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:41.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.497+0000 7f928d3da740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f92841ad740 con 0x559bb1ffaf90 2024-09-19T08:15:41.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.497+0000 7f928d3da740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f92841affc0 con 0x559bb2005850 2024-09-19T08:15:41.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.497+0000 7f928d3da740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f92841addb0 con 0x559bb1ffa670 2024-09-19T08:15:41.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.497+0000 7f9283fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb1ffaf90 0x559bb201ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:41.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.497+0000 7f9283fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb1ffaf90 0x559bb201ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52364/0 (socket says 172.21.15.27:52364) 2024-09-19T08:15:41.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.497+0000 7f9283fff640 1 -- 172.21.15.27:0/2104622508 learned_addr learned my addr 172.21.15.27:0/2104622508 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:41.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.497+0000 7f928959e640 1 --2- 172.21.15.27:0/2104622508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb2005850 0x559bb201d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:41.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.497+0000 7f9288d9d640 1 --2- 172.21.15.27:0/2104622508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb1ffa670 0x559bb2004440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:41.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.497+0000 7f9283fff640 1 -- 172.21.15.27:0/2104622508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb1ffa670 msgr2=0x559bb2004440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:41.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.498+0000 7f9283fff640 1 --2- 172.21.15.27:0/2104622508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb1ffa670 0x559bb2004440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.498+0000 7f9283fff640 1 -- 172.21.15.27:0/2104622508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb2005850 msgr2=0x559bb201d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:41.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.498+0000 7f9283fff640 1 --2- 172.21.15.27:0/2104622508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb2005850 0x559bb201d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.498+0000 7f9283fff640 1 -- 172.21.15.27:0/2104622508 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bb1ff7cb0 con 0x559bb1ffaf90 2024-09-19T08:15:41.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.498+0000 7f928959e640 1 --2- 172.21.15.27:0/2104622508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb2005850 0x559bb201d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:15:41.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.498+0000 7f9288d9d640 1 --2- 172.21.15.27:0/2104622508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb1ffa670 0x559bb2004440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:15:41.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.498+0000 7f9283fff640 1 --2- 172.21.15.27:0/2104622508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb1ffaf90 0x559bb201ce10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f927009b300 tx=0x7f9270097740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a075484a6914e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:41.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.498+0000 7f926e7fc640 1 -- 172.21.15.27:0/2104622508 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927001e040 con 0x559bb1ffaf90 2024-09-19T08:15:41.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.498+0000 7f926e7fc640 1 -- 172.21.15.27:0/2104622508 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92700a3f30 con 0x559bb1ffaf90 2024-09-19T08:15:41.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.498+0000 7f926e7fc640 1 -- 172.21.15.27:0/2104622508 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927009f160 con 0x559bb1ffaf90 2024-09-19T08:15:41.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.498+0000 7f928d3da740 1 -- 172.21.15.27:0/2104622508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb1ffaf90 msgr2=0x559bb201ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:41.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.498+0000 7f928d3da740 1 --2- 172.21.15.27:0/2104622508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb1ffaf90 0x559bb201ce10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f927009b300 tx=0x7f9270097740 comp rx=0 tx=0).stop 2024-09-19T08:15:41.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.498+0000 7f928d3da740 1 -- 172.21.15.27:0/2104622508 shutdown_connections 2024-09-19T08:15:41.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.498+0000 7f928d3da740 1 --2- 172.21.15.27:0/2104622508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb2005850 0x559bb201d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.498+0000 7f928d3da740 1 --2- 172.21.15.27:0/2104622508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb1ffaf90 0x559bb201ce10 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.498+0000 7f928d3da740 1 --2- 172.21.15.27:0/2104622508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb1ffa670 0x559bb2004440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.498+0000 7f928d3da740 1 -- 172.21.15.27:0/2104622508 >> 172.21.15.27:0/2104622508 conn(0x559bb1ff6c00 msgr2=0x559bb2003d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:41.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.499+0000 7f928d3da740 1 -- 172.21.15.27:0/2104622508 shutdown_connections 2024-09-19T08:15:41.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.499+0000 7f928d3da740 1 -- 172.21.15.27:0/2104622508 wait complete. 2024-09-19T08:15:41.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.499+0000 7f928d3da740 1 -- start start 2024-09-19T08:15:41.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.499+0000 7f928d3da740 1 Processor -- start 2024-09-19T08:15:41.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.499+0000 7f928d3da740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb1ffa670 0x559bb200af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:41.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.499+0000 7f928d3da740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb1ffaf90 0x559bb200b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:41.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.499+0000 7f928d3da740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb2005850 0x559bb2077db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:41.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.499+0000 7f928d3da740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f92841ae480 con 0x559bb1ffa670 2024-09-19T08:15:41.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.499+0000 7f928d3da740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f92841af8f0 con 0x559bb1ffaf90 2024-09-19T08:15:41.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.499+0000 7f928d3da740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f92841aeb50 con 0x559bb2005850 2024-09-19T08:15:41.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.499+0000 7f928d3da740 10 client.0 _ll_register_callbacks cb 0x7f9270017630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:15:41.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.499+0000 7f9288d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb1ffa670 0x559bb200af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:41.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.500+0000 7f9288d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb1ffa670 0x559bb200af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52380/0 (socket says 172.21.15.27:52380) 2024-09-19T08:15:41.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.500+0000 7f9288d9d640 1 -- 172.21.15.27:0/3651163889 learned_addr learned my addr 172.21.15.27:0/3651163889 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:41.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.500+0000 7f9283fff640 1 --2- 172.21.15.27:0/3651163889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb1ffaf90 0x559bb200b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:41.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.500+0000 7f928959e640 1 --2- 172.21.15.27:0/3651163889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb2005850 0x559bb2077db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:41.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.500+0000 7f9288d9d640 1 -- 172.21.15.27:0/3651163889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb2005850 msgr2=0x559bb2077db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:41.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.500+0000 7f9288d9d640 1 --2- 172.21.15.27:0/3651163889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb2005850 0x559bb2077db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.500+0000 7f9288d9d640 1 -- 172.21.15.27:0/3651163889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb1ffaf90 msgr2=0x559bb200b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:41.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.500+0000 7f9288d9d640 1 --2- 172.21.15.27:0/3651163889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb1ffaf90 0x559bb200b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.500+0000 7f9288d9d640 1 -- 172.21.15.27:0/3651163889 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bb20783f0 con 0x559bb1ffa670 2024-09-19T08:15:41.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.500+0000 7f9288d9d640 1 --2- 172.21.15.27:0/3651163889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb1ffa670 0x559bb200af40 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f927802a940 tx=0x7f9278031a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0187a200dad1dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:41.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.500+0000 7f9263fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:15:41.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.500+0000 7f9263fff640 1 -- 172.21.15.27:0/3651163889 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278035040 con 0x559bb1ffa670 2024-09-19T08:15:41.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.500+0000 7f9263fff640 1 -- 172.21.15.27:0/3651163889 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f9278004450 con 0x559bb1ffa670 2024-09-19T08:15:41.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.500+0000 7f928d3da740 1 -- 172.21.15.27:0/3651163889 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92700a3f30 con 0x559bb1ffa670 2024-09-19T08:15:41.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.500+0000 7f9263fff640 1 -- 172.21.15.27:0/3651163889 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9278055020 con 0x559bb1ffa670 2024-09-19T08:15:41.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.500+0000 7f928d3da740 10 client.16146 fetch_fsmap learned FSMap version 20 2024-09-19T08:15:41.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.500+0000 7f928d3da740 1 -- 172.21.15.27:0/3651163889 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559bb207f740 con 0x559bb1ffa670 2024-09-19T08:15:41.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.501+0000 7f9263fff640 1 -- 172.21.15.27:0/3651163889 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92700a3f30 con 0x559bb1ffa670 2024-09-19T08:15:41.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.501+0000 7f9263fff640 1 -- 172.21.15.27:0/3651163889 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f927c00ccb0 con 0x559bb1ffa670 2024-09-19T08:15:41.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.501+0000 7f928d3da740 10 client.16146 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:15:41.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.501+0000 7f928d3da740 10 client.16146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:15:41.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.501+0000 7f928d3da740 20 client.16146 populate_metadata read hostname 'smithi027' 2024-09-19T08:15:41.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.501+0000 7f928d3da740 1 --2- 172.21.15.27:0/3651163889 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559bb207fe90 0x559bb20822b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:41.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.501+0000 7f928d3da740 4 client.16146 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:15:41.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.501+0000 7f928d3da740 1 -- 172.21.15.27:0/3651163889 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559bb1f67d60 con 0x559bb207fe90 2024-09-19T08:15:41.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.501+0000 7f9283fff640 1 --2- 172.21.15.27:0/3651163889 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559bb207fe90 0x559bb20822b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:41.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.501+0000 7f9263fff640 10 client.16146 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:41.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.501+0000 7f9283fff640 1 --2- 172.21.15.27:0/3651163889 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559bb207fe90 0x559bb20822b0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=773aa091771ea11a server_cookie=b6a6a8779464a196 in_seq=0 out_seq=0 2024-09-19T08:15:41.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.502+0000 7f9263fff640 1 -- 172.21.15.27:0/3651163889 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559bb1f67d60 con 0x559bb207fe90 2024-09-19T08:15:41.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.502+0000 7f9263fff640 10 client.16146 handle_command_reply: tid=0 2024-09-19T08:15:41.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.502+0000 7f928d3da740 1 client.16146 shutdown 2024-09-19T08:15:41.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.502+0000 7f928d3da740 1 -- 172.21.15.27:0/3651163889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb1ffa670 msgr2=0x559bb200af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:41.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.502+0000 7f928d3da740 1 --2- 172.21.15.27:0/3651163889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb1ffa670 0x559bb200af40 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f927802a940 tx=0x7f9278031a00 comp rx=0 tx=0).stop 2024-09-19T08:15:41.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.502+0000 7f928d3da740 1 -- 172.21.15.27:0/3651163889 shutdown_connections 2024-09-19T08:15:41.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.502+0000 7f928d3da740 1 --2- 172.21.15.27:0/3651163889 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559bb207fe90 0x559bb20822b0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.502+0000 7f928d3da740 1 --2- 172.21.15.27:0/3651163889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb2005850 0x559bb2077db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.502+0000 7f928d3da740 1 --2- 172.21.15.27:0/3651163889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb1ffaf90 0x559bb200b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.502+0000 7f928d3da740 1 --2- 172.21.15.27:0/3651163889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb1ffa670 0x559bb200af40 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.502+0000 7f928d3da740 1 -- 172.21.15.27:0/3651163889 >> 172.21.15.27:0/3651163889 conn(0x559bb1ff6c00 msgr2=0x559bb2004550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:41.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.502+0000 7f9263fff640 0 client.16146 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:41.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.502+0000 7f928d3da740 1 -- 172.21.15.27:0/3651163889 shutdown_connections 2024-09-19T08:15:41.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.502+0000 7f928d3da740 1 -- 172.21.15.27:0/3651163889 wait complete. 2024-09-19T08:15:41.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.502+0000 7f928d3da740 20 client.16146 trim_cache size 0 max 16384 2024-09-19T08:15:41.520 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:15:41.520 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:15:41.520 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:15:41.520 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:15:41.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.503+0000 7f9289d9f640 1 -- 172.21.15.27:0/1781872245 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f92740a33b0 msgr2=0x7f92740a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:41.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.503+0000 7f9289d9f640 1 --2- 172.21.15.27:0/1781872245 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f92740a33b0 0x7f92740a5870 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f927c007fd0 tx=0x7f927c016000 comp rx=0 tx=0).stop 2024-09-19T08:15:41.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.503+0000 7f9289d9f640 1 -- 172.21.15.27:0/1781872245 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9284102380 msgr2=0x7f9284074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:41.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.503+0000 7f9289d9f640 1 --2- 172.21.15.27:0/1781872245 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9284102380 0x7f9284074a30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f927000b4a0 tx=0x7f927000b960 comp rx=0 tx=0).stop 2024-09-19T08:15:41.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.503+0000 7f9289d9f640 1 -- 172.21.15.27:0/1781872245 shutdown_connections 2024-09-19T08:15:41.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.503+0000 7f9289d9f640 1 --2- 172.21.15.27:0/1781872245 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f92740a33b0 0x7f92740a5870 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.503+0000 7f9289d9f640 1 --2- 172.21.15.27:0/1781872245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9284107af0 0x7f9284074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.503+0000 7f9289d9f640 1 --2- 172.21.15.27:0/1781872245 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9284102380 0x7f9284074a30 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.503+0000 7f9289d9f640 1 --2- 172.21.15.27:0/1781872245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92841019e0 0x7f92840744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:41.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.503+0000 7f9289d9f640 1 -- 172.21.15.27:0/1781872245 >> 172.21.15.27:0/1781872245 conn(0x7f92840fd700 msgr2=0x7f92840fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:41.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.503+0000 7f9289d9f640 1 -- 172.21.15.27:0/1781872245 shutdown_connections 2024-09-19T08:15:41.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:41.503+0000 7f9289d9f640 1 -- 172.21.15.27:0/1781872245 wait complete. 2024-09-19T08:15:42.198 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:15:42.199 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:15:42.456 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:15:42.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:42 smithi027 ceph-mon[31209]: pgmap v143: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:42.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.940+0000 7f4c6e566640 1 -- 172.21.15.27:0/1364857412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c6810c1a0 msgr2=0x7f4c6810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:42.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.940+0000 7f4c6e566640 1 --2- 172.21.15.27:0/1364857412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c6810c1a0 0x7f4c6810e610 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009ca0 tx=0x7f4c6002a950 comp rx=0 tx=0).stop 2024-09-19T08:15:42.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.940+0000 7f4c6e566640 1 -- 172.21.15.27:0/1364857412 shutdown_connections 2024-09-19T08:15:42.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.940+0000 7f4c6e566640 1 --2- 172.21.15.27:0/1364857412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c6810c1a0 0x7f4c6810e610 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:42.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.940+0000 7f4c6e566640 1 --2- 172.21.15.27:0/1364857412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4c68103720 0x7f4c6810bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:42.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.940+0000 7f4c6e566640 1 --2- 172.21.15.27:0/1364857412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c68102e00 0x7f4c681031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:42.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.940+0000 7f4c6e566640 1 -- 172.21.15.27:0/1364857412 >> 172.21.15.27:0/1364857412 conn(0x7f4c680fc7a0 msgr2=0x7f4c680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:42.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.940+0000 7f4c6e566640 1 -- 172.21.15.27:0/1364857412 shutdown_connections 2024-09-19T08:15:42.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.940+0000 7f4c6e566640 1 -- 172.21.15.27:0/1364857412 wait complete. 2024-09-19T08:15:42.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.940+0000 7f4c6e566640 1 Processor -- start 2024-09-19T08:15:42.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.940+0000 7f4c6e566640 1 -- start start 2024-09-19T08:15:42.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.941+0000 7f4c6e566640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4c68102e00 0x7f4c68100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:42.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.941+0000 7f4c6e566640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c68103720 0x7f4c68100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:42.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.941+0000 7f4c6e566640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c6810c1a0 0x7f4c681014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:42.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.941+0000 7f4c6e566640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4c68111f70 con 0x7f4c68103720 2024-09-19T08:15:42.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.941+0000 7f4c6e566640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4c68111df0 con 0x7f4c6810c1a0 2024-09-19T08:15:42.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.941+0000 7f4c6e566640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4c681120f0 con 0x7f4c68102e00 2024-09-19T08:15:42.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.941+0000 7f4c677fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c68103720 0x7f4c68100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:42.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.941+0000 7f4c677fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c68103720 0x7f4c68100fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52406/0 (socket says 172.21.15.27:52406) 2024-09-19T08:15:42.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.941+0000 7f4c677fe640 1 -- 172.21.15.27:0/3841706281 learned_addr learned my addr 172.21.15.27:0/3841706281 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:42.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.941+0000 7f4c6cb03640 1 --2- 172.21.15.27:0/3841706281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c6810c1a0 0x7f4c681014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:42.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.941+0000 7f4c67fff640 1 --2- 172.21.15.27:0/3841706281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4c68102e00 0x7f4c68100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:42.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.941+0000 7f4c677fe640 1 -- 172.21.15.27:0/3841706281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4c68102e00 msgr2=0x7f4c68100a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:42.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.941+0000 7f4c677fe640 1 --2- 172.21.15.27:0/3841706281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4c68102e00 0x7f4c68100a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:42.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.941+0000 7f4c677fe640 1 -- 172.21.15.27:0/3841706281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c6810c1a0 msgr2=0x7f4c681014e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:42.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.941+0000 7f4c677fe640 1 --2- 172.21.15.27:0/3841706281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c6810c1a0 0x7f4c681014e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:42.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.941+0000 7f4c677fe640 1 -- 172.21.15.27:0/3841706281 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c681a6890 con 0x7f4c68103720 2024-09-19T08:15:42.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.941+0000 7f4c67fff640 1 --2- 172.21.15.27:0/3841706281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4c68102e00 0x7f4c68100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:15:42.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.942+0000 7f4c677fe640 1 --2- 172.21.15.27:0/3841706281 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c68103720 0x7f4c68100fa0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c00c920 tx=0x7f4c5c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:42.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.942+0000 7f4c657fa640 1 -- 172.21.15.27:0/3841706281 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c007c70 con 0x7f4c68103720 2024-09-19T08:15:42.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.942+0000 7f4c6e566640 1 -- 172.21.15.27:0/3841706281 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c681a6b80 con 0x7f4c68103720 2024-09-19T08:15:42.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.942+0000 7f4c657fa640 1 -- 172.21.15.27:0/3841706281 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c5c007e10 con 0x7f4c68103720 2024-09-19T08:15:42.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.942+0000 7f4c657fa640 1 -- 172.21.15.27:0/3841706281 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c018890 con 0x7f4c68103720 2024-09-19T08:15:42.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.942+0000 7f4c6e566640 1 -- 172.21.15.27:0/3841706281 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c681a70c0 con 0x7f4c68103720 2024-09-19T08:15:42.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.943+0000 7f4c6e566640 1 -- 172.21.15.27:0/3841706281 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c681031e0 con 0x7f4c68103720 2024-09-19T08:15:42.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.944+0000 7f4c657fa640 1 -- 172.21.15.27:0/3841706281 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f4c5c018a50 con 0x7f4c68103720 2024-09-19T08:15:42.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.945+0000 7f4c657fa640 1 --2- 172.21.15.27:0/3841706281 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f4c500a33b0 0x7f4c500a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:42.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.945+0000 7f4c67fff640 1 --2- 172.21.15.27:0/3841706281 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f4c500a33b0 0x7f4c500a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:42.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.945+0000 7f4c657fa640 1 -- 172.21.15.27:0/3841706281 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f4c5c0d0020 con 0x7f4c68103720 2024-09-19T08:15:42.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.945+0000 7f4c67fff640 1 --2- 172.21.15.27:0/3841706281 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f4c500a33b0 0x7f4c500a5870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4c58005fd0 tx=0x7f4c5800b5f0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:42.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:42.948+0000 7f4c657fa640 1 -- 172.21.15.27:0/3841706281 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4c5c014030 con 0x7f4c68103720 2024-09-19T08:15:42.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:42 smithi155 ceph-mon[35362]: pgmap v143: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:43.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:42 smithi203 ceph-mon[35198]: pgmap v143: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:15:43.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:43.161+0000 7f4c6e566640 1 -- 172.21.15.27:0/3841706281 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c68101f90 con 0x7f4c68103720 2024-09-19T08:15:43.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:43.161+0000 7f4c657fa640 1 -- 172.21.15.27:0/3841706281 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f4c5c09cae0 con 0x7f4c68103720 2024-09-19T08:15:43.162 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:15:43.162 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:15:43.162 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:15:43.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:43.164+0000 7f4c6e566640 1 -- 172.21.15.27:0/3841706281 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f4c500a33b0 msgr2=0x7f4c500a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:43.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:43.164+0000 7f4c6e566640 1 --2- 172.21.15.27:0/3841706281 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f4c500a33b0 0x7f4c500a5870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4c58005fd0 tx=0x7f4c5800b5f0 comp rx=0 tx=0).stop 2024-09-19T08:15:43.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:43.164+0000 7f4c6e566640 1 -- 172.21.15.27:0/3841706281 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c68103720 msgr2=0x7f4c68100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:43.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:43.164+0000 7f4c6e566640 1 --2- 172.21.15.27:0/3841706281 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c68103720 0x7f4c68100fa0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c00c920 tx=0x7f4c5c00cde0 comp rx=0 tx=0).stop 2024-09-19T08:15:43.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:43.164+0000 7f4c6e566640 1 -- 172.21.15.27:0/3841706281 shutdown_connections 2024-09-19T08:15:43.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:43.164+0000 7f4c6e566640 1 --2- 172.21.15.27:0/3841706281 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f4c500a33b0 0x7f4c500a5870 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:43.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:43.164+0000 7f4c6e566640 1 --2- 172.21.15.27:0/3841706281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c6810c1a0 0x7f4c681014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:43.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:43.164+0000 7f4c6e566640 1 --2- 172.21.15.27:0/3841706281 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c68103720 0x7f4c68100fa0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:43.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:43.164+0000 7f4c6e566640 1 --2- 172.21.15.27:0/3841706281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4c68102e00 0x7f4c68100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:43.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:43.164+0000 7f4c6e566640 1 -- 172.21.15.27:0/3841706281 >> 172.21.15.27:0/3841706281 conn(0x7f4c680fc7a0 msgr2=0x7f4c680fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:43.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:43.164+0000 7f4c6e566640 1 -- 172.21.15.27:0/3841706281 shutdown_connections 2024-09-19T08:15:43.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:43.164+0000 7f4c6e566640 1 -- 172.21.15.27:0/3841706281 wait complete. 2024-09-19T08:15:43.922 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:43 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3841706281' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:15:43.952 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:15:43.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:43 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3841706281' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:15:44.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:43 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3841706281' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:15:44.209 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:15:44.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.695+0000 7f6ac86b9640 1 -- 172.21.15.27:0/2007217529 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ac0102d30 msgr2=0x7f6ac0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:44.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.695+0000 7f6ac86b9640 1 --2- 172.21.15.27:0/2007217529 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ac0102d30 0x7f6ac0103110 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009930 tx=0x7f6abc02a440 comp rx=0 tx=0).stop 2024-09-19T08:15:44.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.696+0000 7f6ac86b9640 1 -- 172.21.15.27:0/2007217529 shutdown_connections 2024-09-19T08:15:44.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.696+0000 7f6ac86b9640 1 --2- 172.21.15.27:0/2007217529 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ac01082a0 0x7f6ac010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.696+0000 7f6ac86b9640 1 --2- 172.21.15.27:0/2007217529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ac01036e0 0x7f6ac0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.696+0000 7f6ac86b9640 1 --2- 172.21.15.27:0/2007217529 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ac0102d30 0x7f6ac0103110 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.696+0000 7f6ac86b9640 1 -- 172.21.15.27:0/2007217529 >> 172.21.15.27:0/2007217529 conn(0x7f6ac00fc7d0 msgr2=0x7f6ac00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:44.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.696+0000 7f6ac86b9640 1 -- 172.21.15.27:0/2007217529 shutdown_connections 2024-09-19T08:15:44.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.696+0000 7f6ac86b9640 1 -- 172.21.15.27:0/2007217529 wait complete. 2024-09-19T08:15:44.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.696+0000 7f6ac86b9640 1 Processor -- start 2024-09-19T08:15:44.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.696+0000 7f6ac86b9640 1 -- start start 2024-09-19T08:15:44.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.696+0000 7f6ac86b9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ac0102d30 0x7f6ac0198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:44.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.696+0000 7f6ac86b9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ac01036e0 0x7f6ac0198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:44.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.696+0000 7f6ac86b9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ac01082a0 0x7f6ac019cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:44.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.696+0000 7f6ac86b9640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac0112160 con 0x7f6ac01036e0 2024-09-19T08:15:44.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.697+0000 7f6ac86b9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac0111fe0 con 0x7f6ac01082a0 2024-09-19T08:15:44.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.697+0000 7f6ac86b9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac01122e0 con 0x7f6ac0102d30 2024-09-19T08:15:44.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.697+0000 7f6ac5c54640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ac01036e0 0x7f6ac0198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:44.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.697+0000 7f6ac5c54640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ac01036e0 0x7f6ac0198c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52428/0 (socket says 172.21.15.27:52428) 2024-09-19T08:15:44.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.697+0000 7f6ac5c54640 1 -- 172.21.15.27:0/915528542 learned_addr learned my addr 172.21.15.27:0/915528542 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:44.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.697+0000 7f6ac5c54640 1 -- 172.21.15.27:0/915528542 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ac0102d30 msgr2=0x7f6ac0198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:44.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.697+0000 7f6ac5c54640 1 --2- 172.21.15.27:0/915528542 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ac0102d30 0x7f6ac0198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.697+0000 7f6ac5c54640 1 -- 172.21.15.27:0/915528542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ac01082a0 msgr2=0x7f6ac019cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:44.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.697+0000 7f6ac5c54640 1 --2- 172.21.15.27:0/915528542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ac01082a0 0x7f6ac019cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.697+0000 7f6ac5c54640 1 -- 172.21.15.27:0/915528542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac019d6d0 con 0x7f6ac01036e0 2024-09-19T08:15:44.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.697+0000 7f6ac5c54640 1 --2- 172.21.15.27:0/915528542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ac01036e0 0x7f6ac0198c60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0006fd0 tx=0x7f6ab000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:44.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.697+0000 7f6ab77fe640 1 -- 172.21.15.27:0/915528542 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0011830 con 0x7f6ac01036e0 2024-09-19T08:15:44.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.697+0000 7f6ac86b9640 1 -- 172.21.15.27:0/915528542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac019d9c0 con 0x7f6ac01036e0 2024-09-19T08:15:44.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.697+0000 7f6ab77fe640 1 -- 172.21.15.27:0/915528542 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ab0016070 con 0x7f6ac01036e0 2024-09-19T08:15:44.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.697+0000 7f6ab77fe640 1 -- 172.21.15.27:0/915528542 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab000f2e0 con 0x7f6ac01036e0 2024-09-19T08:15:44.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.697+0000 7f6ac86b9640 1 -- 172.21.15.27:0/915528542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac01a52a0 con 0x7f6ac01036e0 2024-09-19T08:15:44.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.699+0000 7f6ab77fe640 1 -- 172.21.15.27:0/915528542 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6ab001b460 con 0x7f6ac01036e0 2024-09-19T08:15:44.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.700+0000 7f6acaa92740 1 Processor -- start 2024-09-19T08:15:44.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.700+0000 7f6acaa92740 1 -- start start 2024-09-19T08:15:44.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.700+0000 7f6acaa92740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c23ab40 0x55805c239090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:44.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.700+0000 7f6acaa92740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c2395d0 0x55805c239a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:44.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.700+0000 7f6acaa92740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805c244370 0x55805c246760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:44.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.700+0000 7f6ab77fe640 1 --2- 172.21.15.27:0/915528542 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6aac0a33b0 0x7f6aac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:44.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.700+0000 7f6acaa92740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55805c19f2f0 con 0x55805c2395d0 2024-09-19T08:15:44.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.700+0000 7f6acaa92740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55805c146cf0 con 0x55805c23ab40 2024-09-19T08:15:44.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.700+0000 7f6acaa92740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55805c19b2b0 con 0x55805c244370 2024-09-19T08:15:44.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.700+0000 7f6ac6455640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c2395d0 0x55805c239a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:44.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.700+0000 7f6ac6455640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c2395d0 0x55805c239a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52436/0 (socket says 172.21.15.27:52436) 2024-09-19T08:15:44.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.700+0000 7f6ac6455640 1 -- 172.21.15.27:0/3458976209 learned_addr learned my addr 172.21.15.27:0/3458976209 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:44.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.701+0000 7f6ab77fe640 1 -- 172.21.15.27:0/915528542 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f6ab00cf360 con 0x7f6ac01036e0 2024-09-19T08:15:44.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.701+0000 7f6ac6c56640 1 --2- 172.21.15.27:0/915528542 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6aac0a33b0 0x7f6aac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:44.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.701+0000 7f6ac6c56640 1 --2- 172.21.15.27:0/3458976209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c23ab40 0x55805c239090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:44.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.701+0000 7f6ac6455640 1 -- 172.21.15.27:0/3458976209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805c244370 msgr2=0x55805c246760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:44.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.701+0000 7f6ac5c54640 1 --2- 172.21.15.27:0/3458976209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805c244370 0x55805c246760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:44.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.701+0000 7f6ac6455640 1 --2- 172.21.15.27:0/3458976209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805c244370 0x55805c246760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.701+0000 7f6ac6455640 1 -- 172.21.15.27:0/3458976209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c23ab40 msgr2=0x55805c239090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:44.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.701+0000 7f6ac6455640 1 --2- 172.21.15.27:0/3458976209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c23ab40 0x55805c239090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.701+0000 7f6ac6455640 1 -- 172.21.15.27:0/3458976209 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55805c12b3a0 con 0x55805c2395d0 2024-09-19T08:15:44.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.701+0000 7f6ac6455640 1 --2- 172.21.15.27:0/3458976209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c2395d0 0x55805c239a10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f6abc005e40 tx=0x7f6abc031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9eeffe56c0c2aef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:44.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.701+0000 7f6ac6c56640 1 --2- 172.21.15.27:0/915528542 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6aac0a33b0 0x7f6aac0a5870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8002230 tx=0x7f6ab80019d0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:44.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.701+0000 7f6ab4ff9640 1 -- 172.21.15.27:0/3458976209 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc040070 con 0x55805c2395d0 2024-09-19T08:15:44.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.701+0000 7f6ab4ff9640 1 -- 172.21.15.27:0/3458976209 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6abc0317b0 con 0x55805c2395d0 2024-09-19T08:15:44.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.701+0000 7f6ab4ff9640 1 -- 172.21.15.27:0/3458976209 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc035040 con 0x55805c2395d0 2024-09-19T08:15:44.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.702+0000 7f6acaa92740 1 -- 172.21.15.27:0/3458976209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c2395d0 msgr2=0x55805c239a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:44.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.702+0000 7f6acaa92740 1 --2- 172.21.15.27:0/3458976209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c2395d0 0x55805c239a10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f6abc005e40 tx=0x7f6abc031510 comp rx=0 tx=0).stop 2024-09-19T08:15:44.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.702+0000 7f6acaa92740 1 -- 172.21.15.27:0/3458976209 shutdown_connections 2024-09-19T08:15:44.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.702+0000 7f6acaa92740 1 --2- 172.21.15.27:0/3458976209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805c244370 0x55805c246760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.702+0000 7f6acaa92740 1 --2- 172.21.15.27:0/3458976209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c2395d0 0x55805c239a10 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.702+0000 7f6acaa92740 1 --2- 172.21.15.27:0/3458976209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c23ab40 0x55805c239090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.702+0000 7f6acaa92740 1 -- 172.21.15.27:0/3458976209 >> 172.21.15.27:0/3458976209 conn(0x55805c202310 msgr2=0x55805c235c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:44.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.702+0000 7f6acaa92740 1 -- 172.21.15.27:0/3458976209 shutdown_connections 2024-09-19T08:15:44.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.702+0000 7f6acaa92740 1 -- 172.21.15.27:0/3458976209 wait complete. 2024-09-19T08:15:44.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.702+0000 7f6acaa92740 1 -- start start 2024-09-19T08:15:44.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.702+0000 7f6acaa92740 1 Processor -- start 2024-09-19T08:15:44.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.703+0000 7f6acaa92740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c2395d0 0x55805c243d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:44.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.703+0000 7f6acaa92740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 0x55805c241010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:44.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.703+0000 7f6acaa92740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805c244370 0x55805c241600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:44.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.703+0000 7f6acaa92740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55805c247010 con 0x55805c23ab40 2024-09-19T08:15:44.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.703+0000 7f6acaa92740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55805c15a060 con 0x55805c2395d0 2024-09-19T08:15:44.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.703+0000 7f6acaa92740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55805c247190 con 0x55805c244370 2024-09-19T08:15:44.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.703+0000 7f6acaa92740 10 client.0 _ll_register_callbacks cb 0x55805bead8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:15:44.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.703+0000 7f6ac5c54640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 0x55805c241010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:44.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.703+0000 7f6ac5c54640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 0x55805c241010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52444/0 (socket says 172.21.15.27:52444) 2024-09-19T08:15:44.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.703+0000 7f6ac5c54640 1 -- 172.21.15.27:0/1470181775 learned_addr learned my addr 172.21.15.27:0/1470181775 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:44.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.703+0000 7f6ac6455640 1 --2- 172.21.15.27:0/1470181775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c2395d0 0x55805c243d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:44.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.703+0000 7f6ac5c54640 1 -- 172.21.15.27:0/1470181775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805c244370 msgr2=0x55805c241600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:44.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.703+0000 7f6ac5c54640 1 --2- 172.21.15.27:0/1470181775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805c244370 0x55805c241600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.703+0000 7f6ac5c54640 1 -- 172.21.15.27:0/1470181775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c2395d0 msgr2=0x55805c243d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:44.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.703+0000 7f6ac5c54640 1 --2- 172.21.15.27:0/1470181775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c2395d0 0x55805c243d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.703+0000 7f6ac5c54640 1 -- 172.21.15.27:0/1470181775 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55805bf103c0 con 0x55805c23ab40 2024-09-19T08:15:44.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.703+0000 7f6ac5c54640 1 --2- 172.21.15.27:0/1470181775 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 0x55805c241010 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000bde0 tx=0x7f6ab009b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e413a417fbf2fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:44.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.703+0000 7f6aa9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:15:44.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.703+0000 7f6aa9ffb640 1 -- 172.21.15.27:0/1470181775 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab009b740 con 0x55805c23ab40 2024-09-19T08:15:44.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.704+0000 7f6aa9ffb640 1 -- 172.21.15.27:0/1470181775 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f6ab0097db0 con 0x55805c23ab40 2024-09-19T08:15:44.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.704+0000 7f6acaa92740 1 -- 172.21.15.27:0/1470181775 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6abc0317b0 con 0x55805c23ab40 2024-09-19T08:15:44.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.704+0000 7f6aa9ffb640 1 -- 172.21.15.27:0/1470181775 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6ab009faf0 con 0x55805c23ab40 2024-09-19T08:15:44.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.704+0000 7f6acaa92740 10 client.16164 fetch_fsmap learned FSMap version 20 2024-09-19T08:15:44.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.704+0000 7f6acaa92740 1 -- 172.21.15.27:0/1470181775 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55805c252b10 con 0x55805c23ab40 2024-09-19T08:15:44.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.704+0000 7f6aa9ffb640 1 -- 172.21.15.27:0/1470181775 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6abc0317b0 con 0x55805c23ab40 2024-09-19T08:15:44.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.704+0000 7f6aa9ffb640 1 -- 172.21.15.27:0/1470181775 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6ab00c5860 con 0x55805c23ab40 2024-09-19T08:15:44.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.704+0000 7f6acaa92740 10 client.16164 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:15:44.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.704+0000 7f6acaa92740 10 client.16164 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:15:44.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.704+0000 7f6acaa92740 20 client.16164 populate_metadata read hostname 'smithi027' 2024-09-19T08:15:44.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.704+0000 7f6acaa92740 1 --2- 172.21.15.27:0/1470181775 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55805c253f20 0x55805c256330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:44.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.704+0000 7f6acaa92740 4 client.16164 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:15:44.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.704+0000 7f6acaa92740 1 -- 172.21.15.27:0/1470181775 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55805c1ac860 con 0x55805c253f20 2024-09-19T08:15:44.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.704+0000 7f6ac6455640 1 --2- 172.21.15.27:0/1470181775 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55805c253f20 0x55805c256330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:44.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.705+0000 7f6aa9ffb640 10 client.16164 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:44.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.705+0000 7f6ac6455640 1 --2- 172.21.15.27:0/1470181775 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55805c253f20 0x55805c256330 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a148c1b75a2b5686 server_cookie=96c361f30f9c0f6e in_seq=0 out_seq=0 2024-09-19T08:15:44.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.705+0000 7f6aa9ffb640 1 -- 172.21.15.27:0/1470181775 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55805c1ac860 con 0x55805c253f20 2024-09-19T08:15:44.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.705+0000 7f6aa9ffb640 10 client.16164 handle_command_reply: tid=0 2024-09-19T08:15:44.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.705+0000 7f6acaa92740 1 client.16164 shutdown 2024-09-19T08:15:44.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.706+0000 7f6acaa92740 1 -- 172.21.15.27:0/1470181775 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 msgr2=0x55805c241010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:44.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.706+0000 7f6acaa92740 1 --2- 172.21.15.27:0/1470181775 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 0x55805c241010 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000bde0 tx=0x7f6ab009b280 comp rx=0 tx=0).stop 2024-09-19T08:15:44.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.706+0000 7f6acaa92740 1 -- 172.21.15.27:0/1470181775 shutdown_connections 2024-09-19T08:15:44.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.706+0000 7f6acaa92740 1 --2- 172.21.15.27:0/1470181775 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55805c253f20 0x55805c256330 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.706+0000 7f6acaa92740 1 --2- 172.21.15.27:0/1470181775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805c244370 0x55805c241600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.706+0000 7f6aa9ffb640 0 client.16164 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:44.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.706+0000 7f6acaa92740 1 --2- 172.21.15.27:0/1470181775 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 0x55805c241010 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.706+0000 7f6acaa92740 1 --2- 172.21.15.27:0/1470181775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c2395d0 0x55805c243d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.706+0000 7f6acaa92740 1 -- 172.21.15.27:0/1470181775 >> 172.21.15.27:0/1470181775 conn(0x55805c202310 msgr2=0x55805c23b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:44.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.706+0000 7f6acaa92740 1 -- 172.21.15.27:0/1470181775 shutdown_connections 2024-09-19T08:15:44.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.706+0000 7f6acaa92740 1 -- 172.21.15.27:0/1470181775 wait complete. 2024-09-19T08:15:44.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.706+0000 7f6acaa92740 20 client.16164 trim_cache size 0 max 16384 2024-09-19T08:15:44.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.719+0000 7f6acaa92740 1 Processor -- start 2024-09-19T08:15:44.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.719+0000 7f6acaa92740 1 -- start start 2024-09-19T08:15:44.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.719+0000 7f6acaa92740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c2395d0 0x55805c235e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:44.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.719+0000 7f6acaa92740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 0x55805c2502b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:44.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.719+0000 7f6acaa92740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805c244370 0x55805c2408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:44.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.719+0000 7f6acaa92740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac01ab890 con 0x55805c23ab40 2024-09-19T08:15:44.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.719+0000 7f6acaa92740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac01ae0f0 con 0x55805c2395d0 2024-09-19T08:15:44.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.719+0000 7f6acaa92740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac01abee0 con 0x55805c244370 2024-09-19T08:15:44.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.720+0000 7f6ac5c54640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 0x55805c2502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:44.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.720+0000 7f6ac5c54640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 0x55805c2502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52454/0 (socket says 172.21.15.27:52454) 2024-09-19T08:15:44.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.720+0000 7f6ac5c54640 1 -- 172.21.15.27:0/3639844942 learned_addr learned my addr 172.21.15.27:0/3639844942 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:44.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.720+0000 7f6ac6455640 1 --2- 172.21.15.27:0/3639844942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c2395d0 0x55805c235e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:44.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.720+0000 7f6ac5c54640 1 -- 172.21.15.27:0/3639844942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805c244370 msgr2=0x55805c2408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:44.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.720+0000 7f6ac6c56640 1 --2- 172.21.15.27:0/3639844942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805c244370 0x55805c2408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:44.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.720+0000 7f6ac5c54640 1 --2- 172.21.15.27:0/3639844942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805c244370 0x55805c2408d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.720+0000 7f6ac5c54640 1 -- 172.21.15.27:0/3639844942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c2395d0 msgr2=0x55805c235e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:44.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.720+0000 7f6ac5c54640 1 --2- 172.21.15.27:0/3639844942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c2395d0 0x55805c235e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.720+0000 7f6ac5c54640 1 -- 172.21.15.27:0/3639844942 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55805c23a300 con 0x55805c23ab40 2024-09-19T08:15:44.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.720+0000 7f6ac6455640 1 --2- 172.21.15.27:0/3639844942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c2395d0 0x55805c235e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:15:44.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.720+0000 7f6ac5c54640 1 --2- 172.21.15.27:0/3639844942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 0x55805c2502b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0097ba0 tx=0x7f6ab001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a84eeeb30b1fc9e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:44.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.720+0000 7f6aabfff640 1 -- 172.21.15.27:0/3639844942 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab00979e0 con 0x55805c23ab40 2024-09-19T08:15:44.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.720+0000 7f6aabfff640 1 -- 172.21.15.27:0/3639844942 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ab009b740 con 0x55805c23ab40 2024-09-19T08:15:44.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.720+0000 7f6aabfff640 1 -- 172.21.15.27:0/3639844942 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab009b0a0 con 0x55805c23ab40 2024-09-19T08:15:44.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.721+0000 7f6acaa92740 1 -- 172.21.15.27:0/3639844942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 msgr2=0x55805c2502b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:44.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.721+0000 7f6acaa92740 1 --2- 172.21.15.27:0/3639844942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 0x55805c2502b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0097ba0 tx=0x7f6ab001b000 comp rx=0 tx=0).stop 2024-09-19T08:15:44.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.721+0000 7f6acaa92740 1 -- 172.21.15.27:0/3639844942 shutdown_connections 2024-09-19T08:15:44.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.721+0000 7f6acaa92740 1 --2- 172.21.15.27:0/3639844942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805c244370 0x55805c2408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.721+0000 7f6acaa92740 1 --2- 172.21.15.27:0/3639844942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 0x55805c2502b0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.721+0000 7f6acaa92740 1 --2- 172.21.15.27:0/3639844942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c2395d0 0x55805c235e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.721+0000 7f6acaa92740 1 -- 172.21.15.27:0/3639844942 >> 172.21.15.27:0/3639844942 conn(0x55805c202310 msgr2=0x55805c235700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:44.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.721+0000 7f6acaa92740 1 -- 172.21.15.27:0/3639844942 shutdown_connections 2024-09-19T08:15:44.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.721+0000 7f6acaa92740 1 -- 172.21.15.27:0/3639844942 wait complete. 2024-09-19T08:15:44.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.721+0000 7f6acaa92740 1 -- start start 2024-09-19T08:15:44.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.721+0000 7f6acaa92740 1 Processor -- start 2024-09-19T08:15:44.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6acaa92740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805c2395d0 0x55805c23d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:44.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6acaa92740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 0x55805c23d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:44.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6acaa92740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c244370 0x55805c23dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:44.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6acaa92740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac01ac5b0 con 0x55805c23ab40 2024-09-19T08:15:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6acaa92740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac01ada20 con 0x55805c244370 2024-09-19T08:15:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6acaa92740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac01acc80 con 0x55805c2395d0 2024-09-19T08:15:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6acaa92740 10 client.0 _ll_register_callbacks cb 0x7f6ab00107e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:15:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6ac5c54640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 0x55805c23d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6ac5c54640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 0x55805c23d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52462/0 (socket says 172.21.15.27:52462) 2024-09-19T08:15:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6ac5c54640 1 -- 172.21.15.27:0/155924844 learned_addr learned my addr 172.21.15.27:0/155924844 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6ac6455640 1 --2- 172.21.15.27:0/155924844 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805c2395d0 0x55805c23d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6ac6c56640 1 --2- 172.21.15.27:0/155924844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c244370 0x55805c23dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6ac5c54640 1 -- 172.21.15.27:0/155924844 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805c2395d0 msgr2=0x55805c23d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6ac5c54640 1 --2- 172.21.15.27:0/155924844 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805c2395d0 0x55805c23d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6ac5c54640 1 -- 172.21.15.27:0/155924844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c244370 msgr2=0x55805c23dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6ac5c54640 1 --2- 172.21.15.27:0/155924844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c244370 0x55805c23dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6ac5c54640 1 -- 172.21.15.27:0/155924844 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55805c23e520 con 0x55805c23ab40 2024-09-19T08:15:44.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6ac6c56640 1 --2- 172.21.15.27:0/155924844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c244370 0x55805c23dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:15:44.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6ac5c54640 1 --2- 172.21.15.27:0/155924844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 0x55805c23d7e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00cf2d0 tx=0x7f6ab009b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac18b53263e0bad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:44.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6aa9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:15:44.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.722+0000 7f6aa9ffb640 1 -- 172.21.15.27:0/155924844 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab00b9060 con 0x55805c23ab40 2024-09-19T08:15:44.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.723+0000 7f6acaa92740 1 -- 172.21.15.27:0/155924844 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ab009b740 con 0x55805c23ab40 2024-09-19T08:15:44.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.723+0000 7f6aa9ffb640 1 -- 172.21.15.27:0/155924844 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f6ab009ada0 con 0x55805c23ab40 2024-09-19T08:15:44.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.723+0000 7f6aa9ffb640 1 -- 172.21.15.27:0/155924844 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6ab00979e0 con 0x55805c23ab40 2024-09-19T08:15:44.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.723+0000 7f6acaa92740 10 client.16170 fetch_fsmap learned FSMap version 20 2024-09-19T08:15:44.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.723+0000 7f6acaa92740 1 -- 172.21.15.27:0/155924844 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55805c2c3060 con 0x55805c23ab40 2024-09-19T08:15:44.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.723+0000 7f6aa9ffb640 1 -- 172.21.15.27:0/155924844 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ab009b740 con 0x55805c23ab40 2024-09-19T08:15:44.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.723+0000 7f6aa9ffb640 1 -- 172.21.15.27:0/155924844 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6ab009a600 con 0x55805c23ab40 2024-09-19T08:15:44.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.723+0000 7f6acaa92740 10 client.16170 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:15:44.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.723+0000 7f6acaa92740 10 client.16170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:15:44.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.723+0000 7f6acaa92740 20 client.16170 populate_metadata read hostname 'smithi027' 2024-09-19T08:15:44.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.723+0000 7f6acaa92740 1 --2- 172.21.15.27:0/155924844 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55805c2c33f0 0x55805c2c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:44.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.723+0000 7f6acaa92740 4 client.16170 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:15:44.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.723+0000 7f6acaa92740 1 -- 172.21.15.27:0/155924844 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55805c1a6d70 con 0x55805c2c33f0 2024-09-19T08:15:44.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.723+0000 7f6ac6455640 1 --2- 172.21.15.27:0/155924844 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55805c2c33f0 0x55805c2c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:44.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.724+0000 7f6aa9ffb640 10 client.16170 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:44.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.724+0000 7f6ac6455640 1 --2- 172.21.15.27:0/155924844 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55805c2c33f0 0x55805c2c57e0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1783258d68209d2c server_cookie=7a900854a1e7ad89 in_seq=0 out_seq=0 2024-09-19T08:15:44.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.724+0000 7f6aa9ffb640 1 -- 172.21.15.27:0/155924844 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55805c1a6d70 con 0x55805c2c33f0 2024-09-19T08:15:44.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.724+0000 7f6aa9ffb640 10 client.16170 handle_command_reply: tid=0 2024-09-19T08:15:44.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.724+0000 7f6acaa92740 1 client.16170 shutdown 2024-09-19T08:15:44.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.724+0000 7f6acaa92740 1 -- 172.21.15.27:0/155924844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 msgr2=0x55805c23d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:44.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.724+0000 7f6acaa92740 1 --2- 172.21.15.27:0/155924844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 0x55805c23d7e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00cf2d0 tx=0x7f6ab009b3b0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.724+0000 7f6acaa92740 1 -- 172.21.15.27:0/155924844 shutdown_connections 2024-09-19T08:15:44.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.724+0000 7f6acaa92740 1 --2- 172.21.15.27:0/155924844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55805c244370 0x55805c23dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.724+0000 7f6acaa92740 1 --2- 172.21.15.27:0/155924844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55805c23ab40 0x55805c23d7e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.724+0000 7f6acaa92740 1 --2- 172.21.15.27:0/155924844 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55805c2c33f0 0x55805c2c57e0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.724+0000 7f6acaa92740 1 --2- 172.21.15.27:0/155924844 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805c2395d0 0x55805c23d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.724+0000 7f6acaa92740 1 -- 172.21.15.27:0/155924844 >> 172.21.15.27:0/155924844 conn(0x55805c202310 msgr2=0x55805c242870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.724+0000 7f6aa9ffb640 0 client.16170 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.724+0000 7f6acaa92740 1 -- 172.21.15.27:0/155924844 shutdown_connections 2024-09-19T08:15:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.724+0000 7f6acaa92740 1 -- 172.21.15.27:0/155924844 wait complete. 2024-09-19T08:15:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.725+0000 7f6acaa92740 20 client.16170 trim_cache size 0 max 16384 2024-09-19T08:15:44.735 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:15:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.725+0000 7f6ac86b9640 1 -- 172.21.15.27:0/915528542 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6aac0a33b0 msgr2=0x7f6aac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.725+0000 7f6ac86b9640 1 --2- 172.21.15.27:0/915528542 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6aac0a33b0 0x7f6aac0a5870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8002230 tx=0x7f6ab80019d0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.725+0000 7f6ac86b9640 1 -- 172.21.15.27:0/915528542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ac01036e0 msgr2=0x7f6ac0198c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.725+0000 7f6ac86b9640 1 --2- 172.21.15.27:0/915528542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ac01036e0 0x7f6ac0198c60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0006fd0 tx=0x7f6ab000b8e0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.725+0000 7f6ac86b9640 1 -- 172.21.15.27:0/915528542 shutdown_connections 2024-09-19T08:15:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.725+0000 7f6ac86b9640 1 --2- 172.21.15.27:0/915528542 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6aac0a33b0 0x7f6aac0a5870 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.725+0000 7f6ac86b9640 1 --2- 172.21.15.27:0/915528542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ac01082a0 0x7f6ac019cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.725+0000 7f6ac86b9640 1 --2- 172.21.15.27:0/915528542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ac01036e0 0x7f6ac0198c60 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.725+0000 7f6ac86b9640 1 --2- 172.21.15.27:0/915528542 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ac0102d30 0x7f6ac0198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:44.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.725+0000 7f6ac86b9640 1 -- 172.21.15.27:0/915528542 >> 172.21.15.27:0/915528542 conn(0x7f6ac00fc7d0 msgr2=0x7f6ac0105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:44.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.725+0000 7f6ac86b9640 1 -- 172.21.15.27:0/915528542 shutdown_connections 2024-09-19T08:15:44.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:44.725+0000 7f6ac86b9640 1 -- 172.21.15.27:0/915528542 wait complete. 2024-09-19T08:15:44.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:44 smithi155 ceph-mon[35362]: pgmap v144: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:15:45.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:44 smithi027 ceph-mon[31209]: pgmap v144: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:15:45.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:44 smithi203 ceph-mon[35198]: pgmap v144: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:15:46.538 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:15:46.538 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:15:46.811 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:15:46.932 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:46 smithi027 ceph-mon[31209]: pgmap v145: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:15:46.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:46 smithi155 ceph-mon[35362]: pgmap v145: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:15:47.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:46 smithi203 ceph-mon[35198]: pgmap v145: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:15:47.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.300+0000 7f7e79bf3640 1 -- 172.21.15.27:0/3008859120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e74101de0 msgr2=0x7f7e741021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:47.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.300+0000 7f7e79bf3640 1 --2- 172.21.15.27:0/3008859120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e74101de0 0x7f7e741021c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009900 tx=0x7f7e6402a410 comp rx=0 tx=0).stop 2024-09-19T08:15:47.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.300+0000 7f7e79bf3640 1 -- 172.21.15.27:0/3008859120 shutdown_connections 2024-09-19T08:15:47.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.300+0000 7f7e79bf3640 1 --2- 172.21.15.27:0/3008859120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e74106f10 0x7f7e7410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.300+0000 7f7e79bf3640 1 --2- 172.21.15.27:0/3008859120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e74102790 0x7f7e741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.300+0000 7f7e79bf3640 1 --2- 172.21.15.27:0/3008859120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e74101de0 0x7f7e741021c0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.300+0000 7f7e79bf3640 1 -- 172.21.15.27:0/3008859120 >> 172.21.15.27:0/3008859120 conn(0x7f7e740fd8c0 msgr2=0x7f7e740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:47.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.300+0000 7f7e79bf3640 1 -- 172.21.15.27:0/3008859120 shutdown_connections 2024-09-19T08:15:47.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.300+0000 7f7e79bf3640 1 -- 172.21.15.27:0/3008859120 wait complete. 2024-09-19T08:15:47.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.301+0000 7f7e79bf3640 1 Processor -- start 2024-09-19T08:15:47.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.301+0000 7f7e79bf3640 1 -- start start 2024-09-19T08:15:47.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.301+0000 7f7e79bf3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e74101de0 0x7f7e741983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:47.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.301+0000 7f7e79bf3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e74102790 0x7f7e74198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:47.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.301+0000 7f7e79bf3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e74106f10 0x7f7e7419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:47.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.301+0000 7f7e79bf3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7e74111f70 con 0x7f7e74106f10 2024-09-19T08:15:47.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.301+0000 7f7e79bf3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7e74111df0 con 0x7f7e74102790 2024-09-19T08:15:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.301+0000 7f7e79bf3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7e741120f0 con 0x7f7e74101de0 2024-09-19T08:15:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.301+0000 7f7e73fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e74106f10 0x7f7e7419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.301+0000 7f7e73fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e74106f10 0x7f7e7419cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52478/0 (socket says 172.21.15.27:52478) 2024-09-19T08:15:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.301+0000 7f7e73fff640 1 -- 172.21.15.27:0/1799993340 learned_addr learned my addr 172.21.15.27:0/1799993340 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.301+0000 7f7e737fe640 1 --2- 172.21.15.27:0/1799993340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e74101de0 0x7f7e741983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.301+0000 7f7e72ffd640 1 --2- 172.21.15.27:0/1799993340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e74102790 0x7f7e74198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.302+0000 7f7e73fff640 1 -- 172.21.15.27:0/1799993340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e74101de0 msgr2=0x7f7e741983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.302+0000 7f7e73fff640 1 --2- 172.21.15.27:0/1799993340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e74101de0 0x7f7e741983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.302+0000 7f7e73fff640 1 -- 172.21.15.27:0/1799993340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e74102790 msgr2=0x7f7e74198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.302+0000 7f7e73fff640 1 --2- 172.21.15.27:0/1799993340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e74102790 0x7f7e74198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.302+0000 7f7e73fff640 1 -- 172.21.15.27:0/1799993340 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7419d380 con 0x7f7e74106f10 2024-09-19T08:15:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.302+0000 7f7e73fff640 1 --2- 172.21.15.27:0/1799993340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e74106f10 0x7f7e7419cca0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00cad0 tx=0x7f7e6c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.302+0000 7f7e70ff9640 1 -- 172.21.15.27:0/1799993340 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00ae20 con 0x7f7e74106f10 2024-09-19T08:15:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.302+0000 7f7e70ff9640 1 -- 172.21.15.27:0/1799993340 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e6c005020 con 0x7f7e74106f10 2024-09-19T08:15:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.302+0000 7f7e79bf3640 1 -- 172.21.15.27:0/1799993340 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e7419d670 con 0x7f7e74106f10 2024-09-19T08:15:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.302+0000 7f7e70ff9640 1 -- 172.21.15.27:0/1799993340 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00f6f0 con 0x7f7e74106f10 2024-09-19T08:15:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.302+0000 7f7e79bf3640 1 -- 172.21.15.27:0/1799993340 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e741a4f50 con 0x7f7e74106f10 2024-09-19T08:15:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.304+0000 7f7e70ff9640 1 -- 172.21.15.27:0/1799993340 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7e6c0051d0 con 0x7f7e74106f10 2024-09-19T08:15:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.304+0000 7f7e7bfcc740 1 Processor -- start 2024-09-19T08:15:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.305+0000 7f7e7bfcc740 1 -- start start 2024-09-19T08:15:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.305+0000 7f7e7bfcc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3ca77db60 0x55d3ca77df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.305+0000 7f7e7bfcc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca77e480 0x55d3ca788800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.305+0000 7f7e7bfcc740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca788d40 0x55d3ca78b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.305+0000 7f7e7bfcc740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55d3ca6e3280 con 0x55d3ca788d40 2024-09-19T08:15:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.305+0000 7f7e7bfcc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d3ca68ab10 con 0x55d3ca77e480 2024-09-19T08:15:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.305+0000 7f7e7bfcc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d3ca6df240 con 0x55d3ca77db60 2024-09-19T08:15:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.305+0000 7f7e72ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca788d40 0x55d3ca78b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:47.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.305+0000 7f7e72ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca788d40 0x55d3ca78b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52486/0 (socket says 172.21.15.27:52486) 2024-09-19T08:15:47.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.305+0000 7f7e72ffd640 1 -- 172.21.15.27:0/2911537299 learned_addr learned my addr 172.21.15.27:0/2911537299 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:47.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.305+0000 7f7e737fe640 1 --2- 172.21.15.27:0/2911537299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca77e480 0x55d3ca788800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:47.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.305+0000 7f7e72ffd640 1 --2- 172.21.15.27:0/2911537299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3ca77db60 0x55d3ca77df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:47.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.305+0000 7f7e70ff9640 1 --2- 172.21.15.27:0/1799993340 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7e600a33b0 0x7f7e600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:47.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.305+0000 7f7e72ffd640 1 -- 172.21.15.27:0/2911537299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3ca77db60 msgr2=0x55d3ca77df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:47.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.305+0000 7f7e72ffd640 1 --2- 172.21.15.27:0/2911537299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3ca77db60 0x55d3ca77df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.305+0000 7f7e72ffd640 1 -- 172.21.15.27:0/2911537299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca77e480 msgr2=0x55d3ca788800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:47.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.305+0000 7f7e72ffd640 1 --2- 172.21.15.27:0/2911537299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca77e480 0x55d3ca788800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.305+0000 7f7e72ffd640 1 -- 172.21.15.27:0/2911537299 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3ca6971f0 con 0x55d3ca788d40 2024-09-19T08:15:47.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.306+0000 7f7e73fff640 1 --2- 172.21.15.27:0/1799993340 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7e600a33b0 0x7f7e600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:47.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.306+0000 7f7e72ffd640 1 --2- 172.21.15.27:0/2911537299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca788d40 0x55d3ca78b130 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00bfa0 tx=0x7f7e5c00b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84ee64fa6ad53f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:47.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.306+0000 7f7e70ff9640 1 -- 172.21.15.27:0/1799993340 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f7e6c0cfff0 con 0x7f7e74106f10 2024-09-19T08:15:47.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.306+0000 7f7e69ffb640 1 -- 172.21.15.27:0/2911537299 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c018030 con 0x55d3ca788d40 2024-09-19T08:15:47.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.306+0000 7f7e69ffb640 1 -- 172.21.15.27:0/2911537299 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e5c010c00 con 0x55d3ca788d40 2024-09-19T08:15:47.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.306+0000 7f7e69ffb640 1 -- 172.21.15.27:0/2911537299 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c00eaf0 con 0x55d3ca788d40 2024-09-19T08:15:47.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.307+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/2911537299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca788d40 msgr2=0x55d3ca78b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:47.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.307+0000 7f7e7bfcc740 1 --2- 172.21.15.27:0/2911537299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca788d40 0x55d3ca78b130 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00bfa0 tx=0x7f7e5c00b640 comp rx=0 tx=0).stop 2024-09-19T08:15:47.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.307+0000 7f7e73fff640 1 --2- 172.21.15.27:0/1799993340 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7e600a33b0 0x7f7e600a5870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c09c270 tx=0x7f7e6c01cb40 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:47.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.307+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/2911537299 shutdown_connections 2024-09-19T08:15:47.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.307+0000 7f7e7bfcc740 1 --2- 172.21.15.27:0/2911537299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca788d40 0x55d3ca78b130 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.307+0000 7f7e7bfcc740 1 --2- 172.21.15.27:0/2911537299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca77e480 0x55d3ca788800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.307+0000 7f7e7bfcc740 1 --2- 172.21.15.27:0/2911537299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3ca77db60 0x55d3ca77df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.307+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/2911537299 >> 172.21.15.27:0/2911537299 conn(0x55d3ca77a0f0 msgr2=0x55d3ca77a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:47.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.307+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/2911537299 shutdown_connections 2024-09-19T08:15:47.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.307+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/2911537299 wait complete. 2024-09-19T08:15:47.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.307+0000 7f7e7bfcc740 1 -- start start 2024-09-19T08:15:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.307+0000 7f7e7bfcc740 1 Processor -- start 2024-09-19T08:15:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.307+0000 7f7e7bfcc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3ca77db60 0x55d3ca785c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.307+0000 7f7e7bfcc740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77e480 0x55d3ca786180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e7bfcc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca788d40 0x55d3ca7866c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e7bfcc740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55d3ca78b910 con 0x55d3ca77e480 2024-09-19T08:15:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e7bfcc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d3ca69df10 con 0x55d3ca788d40 2024-09-19T08:15:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e7bfcc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d3ca78ba90 con 0x55d3ca77db60 2024-09-19T08:15:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e7bfcc740 10 client.0 _ll_register_callbacks cb 0x55d3ca666a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:15:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e737fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77e480 0x55d3ca786180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e737fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77e480 0x55d3ca786180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52490/0 (socket says 172.21.15.27:52490) 2024-09-19T08:15:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e737fe640 1 -- 172.21.15.27:0/2872685822 learned_addr learned my addr 172.21.15.27:0/2872685822 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e72ffd640 1 --2- 172.21.15.27:0/2872685822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3ca77db60 0x55d3ca785c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e72ffd640 1 --2- 172.21.15.27:0/2872685822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca788d40 0x55d3ca7866c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e737fe640 1 -- 172.21.15.27:0/2872685822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3ca77db60 msgr2=0x55d3ca785c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e737fe640 1 --2- 172.21.15.27:0/2872685822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3ca77db60 0x55d3ca785c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e737fe640 1 -- 172.21.15.27:0/2872685822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca788d40 msgr2=0x55d3ca7866c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e737fe640 1 --2- 172.21.15.27:0/2872685822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca788d40 0x55d3ca7866c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e737fe640 1 -- 172.21.15.27:0/2872685822 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3ca4546a0 con 0x55d3ca77e480 2024-09-19T08:15:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e72ffd640 1 --2- 172.21.15.27:0/2872685822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca788d40 0x55d3ca7866c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:15:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e737fe640 1 --2- 172.21.15.27:0/2872685822 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77e480 0x55d3ca786180 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f7e64033000 tx=0x7f7e64031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ecb6ca83f71e2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:15:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e52ffd640 1 -- 172.21.15.27:0/2872685822 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64035040 con 0x55d3ca77e480 2024-09-19T08:15:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e52ffd640 1 -- 172.21.15.27:0/2872685822 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f7e64004380 con 0x55d3ca77e480 2024-09-19T08:15:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.308+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/2872685822 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e5c010c00 con 0x55d3ca77e480 2024-09-19T08:15:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.309+0000 7f7e52ffd640 1 -- 172.21.15.27:0/2872685822 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7e64005020 con 0x55d3ca77e480 2024-09-19T08:15:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.309+0000 7f7e7bfcc740 10 client.16182 fetch_fsmap learned FSMap version 20 2024-09-19T08:15:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.309+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/2872685822 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d3ca797540 con 0x55d3ca77e480 2024-09-19T08:15:47.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.309+0000 7f7e52ffd640 1 -- 172.21.15.27:0/2872685822 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e5c010c00 con 0x55d3ca77e480 2024-09-19T08:15:47.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.309+0000 7f7e52ffd640 1 -- 172.21.15.27:0/2872685822 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7e640035f0 con 0x55d3ca77e480 2024-09-19T08:15:47.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.309+0000 7f7e7bfcc740 10 client.16182 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:15:47.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.309+0000 7f7e7bfcc740 10 client.16182 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:15:47.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.309+0000 7f7e7bfcc740 20 client.16182 populate_metadata read hostname 'smithi027' 2024-09-19T08:15:47.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.309+0000 7f7e7bfcc740 1 --2- 172.21.15.27:0/2872685822 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55d3ca798a10 0x55d3ca79ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:47.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.309+0000 7f7e7bfcc740 4 client.16182 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:15:47.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.309+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/2872685822 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3ca6f07f0 con 0x55d3ca798a10 2024-09-19T08:15:47.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.309+0000 7f7e72ffd640 1 --2- 172.21.15.27:0/2872685822 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55d3ca798a10 0x55d3ca79ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:47.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.310+0000 7f7e72ffd640 1 --2- 172.21.15.27:0/2872685822 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55d3ca798a10 0x55d3ca79ae70 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6428504914be3f15 server_cookie=cda41da66ca277f in_seq=0 out_seq=0 2024-09-19T08:15:47.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.310+0000 7f7e52ffd640 10 client.16182 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:47.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.311+0000 7f7e52ffd640 1 -- 172.21.15.27:0/2872685822 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d3ca6f07f0 con 0x55d3ca798a10 2024-09-19T08:15:47.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.311+0000 7f7e52ffd640 10 client.16182 handle_command_reply: tid=0 2024-09-19T08:15:47.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.311+0000 7f7e7bfcc740 1 client.16182 shutdown 2024-09-19T08:15:47.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.311+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/2872685822 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77e480 msgr2=0x55d3ca786180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:47.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.311+0000 7f7e7bfcc740 1 --2- 172.21.15.27:0/2872685822 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77e480 0x55d3ca786180 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f7e64033000 tx=0x7f7e64031a60 comp rx=0 tx=0).stop 2024-09-19T08:15:47.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.311+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/2872685822 shutdown_connections 2024-09-19T08:15:47.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.311+0000 7f7e7bfcc740 1 --2- 172.21.15.27:0/2872685822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca788d40 0x55d3ca7866c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.311+0000 7f7e7bfcc740 1 --2- 172.21.15.27:0/2872685822 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77e480 0x55d3ca786180 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.311+0000 7f7e7bfcc740 1 --2- 172.21.15.27:0/2872685822 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55d3ca798a10 0x55d3ca79ae70 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.311+0000 7f7e7bfcc740 1 --2- 172.21.15.27:0/2872685822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3ca77db60 0x55d3ca785c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.311+0000 7f7e52ffd640 0 client.16182 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:47.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.311+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/2872685822 >> 172.21.15.27:0/2872685822 conn(0x55d3ca77a0f0 msgr2=0x55d3ca77fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:47.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.311+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/2872685822 shutdown_connections 2024-09-19T08:15:47.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.311+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/2872685822 wait complete. 2024-09-19T08:15:47.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.311+0000 7f7e7bfcc740 20 client.16182 trim_cache size 0 max 16384 2024-09-19T08:15:47.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.328+0000 7f7e7bfcc740 1 Processor -- start 2024-09-19T08:15:47.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.328+0000 7f7e7bfcc740 1 -- start start 2024-09-19T08:15:47.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.329+0000 7f7e7bfcc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca77db60 0x55d3ca779160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:47.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.329+0000 7f7e7bfcc740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77e480 0x55d3ca7a0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:47.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.329+0000 7f7e7bfcc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3ca788d40 0x55d3ca7a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:47.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.329+0000 7f7e7bfcc740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7e741ab6b0 con 0x55d3ca77e480 2024-09-19T08:15:47.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.329+0000 7f7e7bfcc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7e741adf30 con 0x55d3ca77db60 2024-09-19T08:15:47.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.329+0000 7f7e7bfcc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7e741abd20 con 0x55d3ca788d40 2024-09-19T08:15:47.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.329+0000 7f7e737fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77e480 0x55d3ca7a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:47.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.329+0000 7f7e737fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77e480 0x55d3ca7a0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52498/0 (socket says 172.21.15.27:52498) 2024-09-19T08:15:47.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.329+0000 7f7e737fe640 1 -- 172.21.15.27:0/748479508 learned_addr learned my addr 172.21.15.27:0/748479508 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:47.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.329+0000 7f7e72ffd640 1 --2- 172.21.15.27:0/748479508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca77db60 0x55d3ca779160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:47.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.329+0000 7f7e72ffd640 1 --2- 172.21.15.27:0/748479508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3ca788d40 0x55d3ca7a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:47.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.329+0000 7f7e737fe640 1 -- 172.21.15.27:0/748479508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3ca788d40 msgr2=0x55d3ca7a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:47.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.329+0000 7f7e737fe640 1 --2- 172.21.15.27:0/748479508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3ca788d40 0x55d3ca7a0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.329+0000 7f7e737fe640 1 -- 172.21.15.27:0/748479508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca77db60 msgr2=0x55d3ca779160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:47.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.329+0000 7f7e737fe640 1 --2- 172.21.15.27:0/748479508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca77db60 0x55d3ca779160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.329+0000 7f7e737fe640 1 -- 172.21.15.27:0/748479508 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3ca779b90 con 0x55d3ca77e480 2024-09-19T08:15:47.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.329+0000 7f7e72ffd640 1 --2- 172.21.15.27:0/748479508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca77db60 0x55d3ca779160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:15:47.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.329+0000 7f7e737fe640 1 --2- 172.21.15.27:0/748479508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77e480 0x55d3ca7a0740 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7e64003b30 tx=0x7f7e64003dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558043a359b19610 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:47.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.329+0000 7f7e697fa640 1 -- 172.21.15.27:0/748479508 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64035070 con 0x55d3ca77e480 2024-09-19T08:15:47.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.330+0000 7f7e697fa640 1 -- 172.21.15.27:0/748479508 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e640051c0 con 0x55d3ca77e480 2024-09-19T08:15:47.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.330+0000 7f7e697fa640 1 -- 172.21.15.27:0/748479508 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64004a00 con 0x55d3ca77e480 2024-09-19T08:15:47.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.330+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/748479508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77e480 msgr2=0x55d3ca7a0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:47.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.330+0000 7f7e7bfcc740 1 --2- 172.21.15.27:0/748479508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77e480 0x55d3ca7a0740 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7e64003b30 tx=0x7f7e64003dc0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.330+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/748479508 shutdown_connections 2024-09-19T08:15:47.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.330+0000 7f7e7bfcc740 1 --2- 172.21.15.27:0/748479508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3ca788d40 0x55d3ca7a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.330+0000 7f7e7bfcc740 1 --2- 172.21.15.27:0/748479508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77e480 0x55d3ca7a0740 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.330+0000 7f7e7bfcc740 1 --2- 172.21.15.27:0/748479508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca77db60 0x55d3ca779160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.330+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/748479508 >> 172.21.15.27:0/748479508 conn(0x55d3ca77a0f0 msgr2=0x55d3ca778a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:47.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.330+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/748479508 shutdown_connections 2024-09-19T08:15:47.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.330+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/748479508 wait complete. 2024-09-19T08:15:47.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.331+0000 7f7e7bfcc740 1 -- start start 2024-09-19T08:15:47.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.331+0000 7f7e7bfcc740 1 Processor -- start 2024-09-19T08:15:47.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.331+0000 7f7e7bfcc740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77db60 0x55d3ca78ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:47.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.331+0000 7f7e7bfcc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca77e480 0x55d3ca78cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:47.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.331+0000 7f7e7bfcc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3ca788d40 0x55d3ca78d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:47.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.331+0000 7f7e7bfcc740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7e741ac3f0 con 0x55d3ca77db60 2024-09-19T08:15:47.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.331+0000 7f7e7bfcc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7e741ad860 con 0x55d3ca77e480 2024-09-19T08:15:47.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.331+0000 7f7e7bfcc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7e741acac0 con 0x55d3ca788d40 2024-09-19T08:15:47.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.331+0000 7f7e7bfcc740 10 client.0 _ll_register_callbacks cb 0x7f7e64009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:15:47.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.331+0000 7f7e72ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77db60 0x55d3ca78ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:47.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.331+0000 7f7e72ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77db60 0x55d3ca78ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52510/0 (socket says 172.21.15.27:52510) 2024-09-19T08:15:47.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.331+0000 7f7e72ffd640 1 -- 172.21.15.27:0/44438621 learned_addr learned my addr 172.21.15.27:0/44438621 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:47.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.331+0000 7f7e737fe640 1 --2- 172.21.15.27:0/44438621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca77e480 0x55d3ca78cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:47.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.332+0000 7f7e72ffd640 1 -- 172.21.15.27:0/44438621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3ca788d40 msgr2=0x55d3ca78d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:47.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.332+0000 7f7e72ffd640 1 --2- 172.21.15.27:0/44438621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3ca788d40 0x55d3ca78d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.332+0000 7f7e72ffd640 1 -- 172.21.15.27:0/44438621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca77e480 msgr2=0x55d3ca78cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:47.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.332+0000 7f7e72ffd640 1 --2- 172.21.15.27:0/44438621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca77e480 0x55d3ca78cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.332+0000 7f7e72ffd640 1 -- 172.21.15.27:0/44438621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3ca802710 con 0x55d3ca77db60 2024-09-19T08:15:47.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.332+0000 7f7e737fe640 1 --2- 172.21.15.27:0/44438621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca77e480 0x55d3ca78cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:15:47.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.332+0000 7f7e72ffd640 1 --2- 172.21.15.27:0/44438621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77db60 0x55d3ca78ca00 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00bfa0 tx=0x7f7e5c00e430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d92349f3d31e920 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:47.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.332+0000 7f7e52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:15:47.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.332+0000 7f7e52ffd640 1 -- 172.21.15.27:0/44438621 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c02f060 con 0x55d3ca77db60 2024-09-19T08:15:47.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.332+0000 7f7e52ffd640 1 -- 172.21.15.27:0/44438621 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f7e5c02be80 con 0x55d3ca77db60 2024-09-19T08:15:47.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.332+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/44438621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e640051c0 con 0x55d3ca77db60 2024-09-19T08:15:47.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.332+0000 7f7e52ffd640 1 -- 172.21.15.27:0/44438621 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7e5c018040 con 0x55d3ca77db60 2024-09-19T08:15:47.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.332+0000 7f7e7bfcc740 10 client.16188 fetch_fsmap learned FSMap version 20 2024-09-19T08:15:47.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.332+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/44438621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d3ca803920 con 0x55d3ca77db60 2024-09-19T08:15:47.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.332+0000 7f7e52ffd640 1 -- 172.21.15.27:0/44438621 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e640051c0 con 0x55d3ca77db60 2024-09-19T08:15:47.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.332+0000 7f7e52ffd640 1 -- 172.21.15.27:0/44438621 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7e5c005200 con 0x55d3ca77db60 2024-09-19T08:15:47.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.332+0000 7f7e7bfcc740 10 client.16188 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:15:47.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.332+0000 7f7e7bfcc740 10 client.16188 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:15:47.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.332+0000 7f7e7bfcc740 20 client.16188 populate_metadata read hostname 'smithi027' 2024-09-19T08:15:47.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.333+0000 7f7e7bfcc740 1 --2- 172.21.15.27:0/44438621 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55d3ca803f50 0x55d3ca806340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:47.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.333+0000 7f7e7bfcc740 4 client.16188 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:15:47.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.333+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/44438621 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d3ca6ead00 con 0x55d3ca803f50 2024-09-19T08:15:47.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.333+0000 7f7e737fe640 1 --2- 172.21.15.27:0/44438621 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55d3ca803f50 0x55d3ca806340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:47.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.333+0000 7f7e52ffd640 10 client.16188 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:47.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.333+0000 7f7e737fe640 1 --2- 172.21.15.27:0/44438621 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55d3ca803f50 0x55d3ca806340 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31b88227c9f0cddd server_cookie=684196bfb31e58e in_seq=0 out_seq=0 2024-09-19T08:15:47.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.335+0000 7f7e52ffd640 1 -- 172.21.15.27:0/44438621 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d3ca6ead00 con 0x55d3ca803f50 2024-09-19T08:15:47.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.335+0000 7f7e52ffd640 10 client.16188 handle_command_reply: tid=0 2024-09-19T08:15:47.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.335+0000 7f7e7bfcc740 1 client.16188 shutdown 2024-09-19T08:15:47.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.335+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/44438621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77db60 msgr2=0x55d3ca78ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:47.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.335+0000 7f7e7bfcc740 1 --2- 172.21.15.27:0/44438621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77db60 0x55d3ca78ca00 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00bfa0 tx=0x7f7e5c00e430 comp rx=0 tx=0).stop 2024-09-19T08:15:47.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.335+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/44438621 shutdown_connections 2024-09-19T08:15:47.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.335+0000 7f7e7bfcc740 1 --2- 172.21.15.27:0/44438621 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55d3ca803f50 0x55d3ca806340 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.335+0000 7f7e7bfcc740 1 --2- 172.21.15.27:0/44438621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3ca788d40 0x55d3ca78d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.335+0000 7f7e7bfcc740 1 --2- 172.21.15.27:0/44438621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3ca77e480 0x55d3ca78cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.335+0000 7f7e7bfcc740 1 --2- 172.21.15.27:0/44438621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3ca77db60 0x55d3ca78ca00 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.335+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/44438621 >> 172.21.15.27:0/44438621 conn(0x55d3ca77a0f0 msgr2=0x55d3ca77fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:47.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.335+0000 7f7e52ffd640 0 client.16188 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:47.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.335+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/44438621 shutdown_connections 2024-09-19T08:15:47.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.335+0000 7f7e7bfcc740 1 -- 172.21.15.27:0/44438621 wait complete. 2024-09-19T08:15:47.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.335+0000 7f7e7bfcc740 20 client.16188 trim_cache size 0 max 16384 2024-09-19T08:15:47.340 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:15:47.340 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:15:47.340 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "e0816e28-f854-42b0-9e54-1fffc528a0de", 2024-09-19T08:15:47.340 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:15:47.340 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:15:47.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.336+0000 7f7e79bf3640 1 -- 172.21.15.27:0/1799993340 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7e600a33b0 msgr2=0x7f7e600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:47.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.336+0000 7f7e79bf3640 1 --2- 172.21.15.27:0/1799993340 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7e600a33b0 0x7f7e600a5870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c09c270 tx=0x7f7e6c01cb40 comp rx=0 tx=0).stop 2024-09-19T08:15:47.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.336+0000 7f7e79bf3640 1 -- 172.21.15.27:0/1799993340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e74106f10 msgr2=0x7f7e7419cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:47.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.336+0000 7f7e79bf3640 1 --2- 172.21.15.27:0/1799993340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e74106f10 0x7f7e7419cca0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00cad0 tx=0x7f7e6c00cf90 comp rx=0 tx=0).stop 2024-09-19T08:15:47.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.336+0000 7f7e79bf3640 1 -- 172.21.15.27:0/1799993340 shutdown_connections 2024-09-19T08:15:47.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.336+0000 7f7e79bf3640 1 --2- 172.21.15.27:0/1799993340 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f7e600a33b0 0x7f7e600a5870 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.336+0000 7f7e79bf3640 1 --2- 172.21.15.27:0/1799993340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e74106f10 0x7f7e7419cca0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.336+0000 7f7e79bf3640 1 --2- 172.21.15.27:0/1799993340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e74102790 0x7f7e74198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.336+0000 7f7e79bf3640 1 --2- 172.21.15.27:0/1799993340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e74101de0 0x7f7e741983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:47.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.336+0000 7f7e79bf3640 1 -- 172.21.15.27:0/1799993340 >> 172.21.15.27:0/1799993340 conn(0x7f7e740fd8c0 msgr2=0x7f7e740feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:47.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.336+0000 7f7e79bf3640 1 -- 172.21.15.27:0/1799993340 shutdown_connections 2024-09-19T08:15:47.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:47.336+0000 7f7e79bf3640 1 -- 172.21.15.27:0/1799993340 wait complete. 2024-09-19T08:15:48.172 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:15:48.436 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:15:48.810 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:48 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:15:48.810 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:48 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:15:48.810 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:48 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:15:48.810 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:48 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:15:48.810 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:48 smithi027 ceph-mon[31209]: pgmap v146: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-19T08:15:48.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.891+0000 7fd6803e4640 1 -- 172.21.15.27:0/4197229049 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd678102570 msgr2=0x7fd6781029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:48.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.891+0000 7fd6803e4640 1 --2- 172.21.15.27:0/4197229049 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd678102570 0x7fd6781029b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009900 tx=0x7fd66c02a480 comp rx=0 tx=0).stop 2024-09-19T08:15:48.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.891+0000 7fd6803e4640 1 -- 172.21.15.27:0/4197229049 shutdown_connections 2024-09-19T08:15:48.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.891+0000 7fd6803e4640 1 --2- 172.21.15.27:0/4197229049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd678102ef0 0x7fd67810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.891+0000 7fd6803e4640 1 --2- 172.21.15.27:0/4197229049 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd678102570 0x7fd6781029b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.891+0000 7fd6803e4640 1 --2- 172.21.15.27:0/4197229049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd678100e20 0x7fd678101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.891+0000 7fd6803e4640 1 -- 172.21.15.27:0/4197229049 >> 172.21.15.27:0/4197229049 conn(0x7fd6780fc7d0 msgr2=0x7fd6780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:48.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.891+0000 7fd6803e4640 1 -- 172.21.15.27:0/4197229049 shutdown_connections 2024-09-19T08:15:48.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.891+0000 7fd6803e4640 1 -- 172.21.15.27:0/4197229049 wait complete. 2024-09-19T08:15:48.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.891+0000 7fd6803e4640 1 Processor -- start 2024-09-19T08:15:48.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.892+0000 7fd6803e4640 1 -- start start 2024-09-19T08:15:48.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.892+0000 7fd6803e4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd678100e20 0x7fd6781984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:48.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.892+0000 7fd6803e4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd678102570 0x7fd678198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:48.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.892+0000 7fd6803e4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd678102ef0 0x7fd67819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:48.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.892+0000 7fd6803e4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd6781120a0 con 0x7fd678102ef0 2024-09-19T08:15:48.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.892+0000 7fd6803e4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd678111f20 con 0x7fd678102570 2024-09-19T08:15:48.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.892+0000 7fd6803e4640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd678112220 con 0x7fd678100e20 2024-09-19T08:15:48.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.892+0000 7fd67e981640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd678102ef0 0x7fd67819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:48.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.892+0000 7fd67e981640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd678102ef0 0x7fd67819cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52532/0 (socket says 172.21.15.27:52532) 2024-09-19T08:15:48.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.892+0000 7fd67e981640 1 -- 172.21.15.27:0/3975325796 learned_addr learned my addr 172.21.15.27:0/3975325796 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:48.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.892+0000 7fd67e180640 1 --2- 172.21.15.27:0/3975325796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd678100e20 0x7fd6781984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:48.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.892+0000 7fd67d97f640 1 --2- 172.21.15.27:0/3975325796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd678102570 0x7fd678198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:48.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.892+0000 7fd67e981640 1 -- 172.21.15.27:0/3975325796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd678100e20 msgr2=0x7fd6781984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:48.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.892+0000 7fd67e981640 1 --2- 172.21.15.27:0/3975325796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd678100e20 0x7fd6781984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.892+0000 7fd67e981640 1 -- 172.21.15.27:0/3975325796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd678102570 msgr2=0x7fd678198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:48.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.892+0000 7fd67e981640 1 --2- 172.21.15.27:0/3975325796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd678102570 0x7fd678198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.892+0000 7fd67e981640 1 -- 172.21.15.27:0/3975325796 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67819d490 con 0x7fd678102ef0 2024-09-19T08:15:48.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.892+0000 7fd67d97f640 1 --2- 172.21.15.27:0/3975325796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd678102570 0x7fd678198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:15:48.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.892+0000 7fd67e981640 1 --2- 172.21.15.27:0/3975325796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd678102ef0 0x7fd67819cdb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd66800b970 tx=0x7fd66800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:48.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.893+0000 7fd6777fe640 1 -- 172.21.15.27:0/3975325796 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd668019070 con 0x7fd678102ef0 2024-09-19T08:15:48.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.893+0000 7fd6803e4640 1 -- 172.21.15.27:0/3975325796 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67819d780 con 0x7fd678102ef0 2024-09-19T08:15:48.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.893+0000 7fd6777fe640 1 -- 172.21.15.27:0/3975325796 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd66800cb40 con 0x7fd678102ef0 2024-09-19T08:15:48.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.893+0000 7fd6777fe640 1 -- 172.21.15.27:0/3975325796 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd668007650 con 0x7fd678102ef0 2024-09-19T08:15:48.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.893+0000 7fd6803e4640 1 -- 172.21.15.27:0/3975325796 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6781a5060 con 0x7fd678102ef0 2024-09-19T08:15:48.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.895+0000 7fd6777fe640 1 -- 172.21.15.27:0/3975325796 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fd66801c070 con 0x7fd678102ef0 2024-09-19T08:15:48.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.895+0000 7fd6827bd740 1 Processor -- start 2024-09-19T08:15:48.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.895+0000 7fd6827bd740 1 -- start start 2024-09-19T08:15:48.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.896+0000 7fd6827bd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f316ca6360 0x55f316ca6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:48.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.896+0000 7fd6827bd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f316ca6c80 0x55f316cb5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:48.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.896+0000 7fd6827bd740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316cb5a90 0x55f316cb7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:48.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.896+0000 7fd6827bd740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f316c0c2e0 con 0x55f316cb5a90 2024-09-19T08:15:48.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.896+0000 7fd6827bd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f316bb3ce0 con 0x55f316ca6360 2024-09-19T08:15:48.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.896+0000 7fd6827bd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f316c082a0 con 0x55f316ca6c80 2024-09-19T08:15:48.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.896+0000 7fd67d97f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316cb5a90 0x55f316cb7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:48.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.896+0000 7fd67d97f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316cb5a90 0x55f316cb7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52546/0 (socket says 172.21.15.27:52546) 2024-09-19T08:15:48.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.896+0000 7fd67d97f640 1 -- 172.21.15.27:0/928313697 learned_addr learned my addr 172.21.15.27:0/928313697 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:48.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.896+0000 7fd67d97f640 1 --2- 172.21.15.27:0/928313697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f316ca6360 0x55f316ca6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:48.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.896+0000 7fd67e180640 1 --2- 172.21.15.27:0/928313697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f316ca6c80 0x55f316cb5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:48.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.896+0000 7fd6777fe640 1 --2- 172.21.15.27:0/3975325796 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd6600a33b0 0x7fd6600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:48.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.896+0000 7fd67e981640 1 --2- 172.21.15.27:0/3975325796 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd6600a33b0 0x7fd6600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:48.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.896+0000 7fd67d97f640 1 -- 172.21.15.27:0/928313697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f316ca6c80 msgr2=0x55f316cb5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:48.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.896+0000 7fd67d97f640 1 --2- 172.21.15.27:0/928313697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f316ca6c80 0x55f316cb5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.896+0000 7fd67d97f640 1 -- 172.21.15.27:0/928313697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f316ca6360 msgr2=0x55f316ca6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:48.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.896+0000 7fd67d97f640 1 --2- 172.21.15.27:0/928313697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f316ca6360 0x55f316ca6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.896+0000 7fd67d97f640 1 -- 172.21.15.27:0/928313697 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f316b98440 con 0x55f316cb5a90 2024-09-19T08:15:48.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.896+0000 7fd6777fe640 1 -- 172.21.15.27:0/3975325796 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fd6680cf260 con 0x7fd678102ef0 2024-09-19T08:15:48.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.896+0000 7fd67d97f640 1 --2- 172.21.15.27:0/928313697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316cb5a90 0x55f316cb7e80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd66c005ea0 tx=0x7fd66c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af62d47b454f5f4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:48.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.897+0000 7fd674dea640 1 -- 172.21.15.27:0/928313697 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c045070 con 0x55f316cb5a90 2024-09-19T08:15:48.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.897+0000 7fd67e981640 1 --2- 172.21.15.27:0/3975325796 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd6600a33b0 0x7fd6600a5870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd6680ccbc0 tx=0x7fd66806d420 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:48.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.897+0000 7fd674dea640 1 -- 172.21.15.27:0/928313697 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd66c0046c0 con 0x55f316cb5a90 2024-09-19T08:15:48.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.897+0000 7fd674dea640 1 -- 172.21.15.27:0/928313697 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c035040 con 0x55f316cb5a90 2024-09-19T08:15:48.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.897+0000 7fd6827bd740 1 -- 172.21.15.27:0/928313697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316cb5a90 msgr2=0x55f316cb7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:48.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.897+0000 7fd6827bd740 1 --2- 172.21.15.27:0/928313697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316cb5a90 0x55f316cb7e80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd66c005ea0 tx=0x7fd66c000bc0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.898+0000 7fd6827bd740 1 -- 172.21.15.27:0/928313697 shutdown_connections 2024-09-19T08:15:48.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.898+0000 7fd6827bd740 1 --2- 172.21.15.27:0/928313697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316cb5a90 0x55f316cb7e80 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.898+0000 7fd6827bd740 1 --2- 172.21.15.27:0/928313697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f316ca6c80 0x55f316cb5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.898+0000 7fd6827bd740 1 --2- 172.21.15.27:0/928313697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f316ca6360 0x55f316ca6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.898+0000 7fd6827bd740 1 -- 172.21.15.27:0/928313697 >> 172.21.15.27:0/928313697 conn(0x55f316ca2a30 msgr2=0x55f316ca2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:48.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.898+0000 7fd6827bd740 1 -- 172.21.15.27:0/928313697 shutdown_connections 2024-09-19T08:15:48.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.898+0000 7fd6827bd740 1 -- 172.21.15.27:0/928313697 wait complete. 2024-09-19T08:15:48.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.898+0000 7fd6827bd740 1 -- start start 2024-09-19T08:15:48.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.898+0000 7fd6827bd740 1 Processor -- start 2024-09-19T08:15:48.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.898+0000 7fd6827bd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f316ca6360 0x55f316cb5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:48.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.899+0000 7fd6827bd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f316ca6c80 0x55f316cb2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:48.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.899+0000 7fd6827bd740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316cb5a90 0x55f316cb2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:48.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.899+0000 7fd6827bd740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f316cb8600 con 0x55f316cb5a90 2024-09-19T08:15:48.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.899+0000 7fd6827bd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f316bc7050 con 0x55f316ca6360 2024-09-19T08:15:48.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.899+0000 7fd6827bd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f316cb8780 con 0x55f316ca6c80 2024-09-19T08:15:48.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.899+0000 7fd6827bd740 10 client.0 _ll_register_callbacks cb 0x55f316c07160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:15:48.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.899+0000 7fd67d97f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316cb5a90 0x55f316cb2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:48.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.899+0000 7fd67d97f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316cb5a90 0x55f316cb2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52556/0 (socket says 172.21.15.27:52556) 2024-09-19T08:15:48.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.899+0000 7fd67d97f640 1 -- 172.21.15.27:0/2586141148 learned_addr learned my addr 172.21.15.27:0/2586141148 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:48.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.899+0000 7fd67d97f640 1 --2- 172.21.15.27:0/2586141148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f316ca6360 0x55f316cb5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:48.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.899+0000 7fd67e180640 1 --2- 172.21.15.27:0/2586141148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f316ca6c80 0x55f316cb2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:48.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.899+0000 7fd67d97f640 1 -- 172.21.15.27:0/2586141148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f316ca6c80 msgr2=0x55f316cb2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:48.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.899+0000 7fd67d97f640 1 --2- 172.21.15.27:0/2586141148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f316ca6c80 0x55f316cb2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.899+0000 7fd67d97f640 1 -- 172.21.15.27:0/2586141148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f316ca6360 msgr2=0x55f316cb5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:48.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.899+0000 7fd67d97f640 1 --2- 172.21.15.27:0/2586141148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f316ca6360 0x55f316cb5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.899+0000 7fd67d97f640 1 -- 172.21.15.27:0/2586141148 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f31697d3c0 con 0x55f316cb5a90 2024-09-19T08:15:48.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.899+0000 7fd67e180640 1 --2- 172.21.15.27:0/2586141148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f316ca6c80 0x55f316cb2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:15:48.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.899+0000 7fd67d97f640 1 --2- 172.21.15.27:0/2586141148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316cb5a90 0x55f316cb2cf0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd66c001eb0 tx=0x7fd66c003670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0b2301f82480cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:48.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.899+0000 7fd65dffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:15:48.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.900+0000 7fd65dffb640 1 -- 172.21.15.27:0/2586141148 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c035030 con 0x55f316cb5a90 2024-09-19T08:15:48.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.900+0000 7fd6827bd740 1 -- 172.21.15.27:0/2586141148 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd66c0046c0 con 0x55f316cb5a90 2024-09-19T08:15:48.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.900+0000 7fd65dffb640 1 -- 172.21.15.27:0/2586141148 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fd66c005430 con 0x55f316cb5a90 2024-09-19T08:15:48.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.900+0000 7fd65dffb640 1 -- 172.21.15.27:0/2586141148 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd66c045040 con 0x55f316cb5a90 2024-09-19T08:15:48.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.900+0000 7fd6827bd740 10 client.16200 fetch_fsmap learned FSMap version 20 2024-09-19T08:15:48.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.900+0000 7fd6827bd740 1 -- 172.21.15.27:0/2586141148 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f316cc4080 con 0x55f316cb5a90 2024-09-19T08:15:48.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.900+0000 7fd65dffb640 1 -- 172.21.15.27:0/2586141148 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd66c0046c0 con 0x55f316cb5a90 2024-09-19T08:15:48.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.900+0000 7fd65dffb640 1 -- 172.21.15.27:0/2586141148 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd66c048070 con 0x55f316cb5a90 2024-09-19T08:15:48.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.900+0000 7fd6827bd740 10 client.16200 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:15:48.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.900+0000 7fd6827bd740 10 client.16200 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:15:48.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.900+0000 7fd6827bd740 20 client.16200 populate_metadata read hostname 'smithi027' 2024-09-19T08:15:48.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.900+0000 7fd6827bd740 1 --2- 172.21.15.27:0/2586141148 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f316cc53d0 0x55f316cc77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:48.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.900+0000 7fd6827bd740 4 client.16200 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:15:48.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.900+0000 7fd6827bd740 1 -- 172.21.15.27:0/2586141148 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f316c19850 con 0x55f316cc53d0 2024-09-19T08:15:48.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.901+0000 7fd67e180640 1 --2- 172.21.15.27:0/2586141148 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f316cc53d0 0x55f316cc77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:48.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.901+0000 7fd65dffb640 10 client.16200 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:48.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.901+0000 7fd67e180640 1 --2- 172.21.15.27:0/2586141148 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f316cc53d0 0x55f316cc77c0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c9df30b9909d1aa server_cookie=a88a5fad86f82ab9 in_seq=0 out_seq=0 2024-09-19T08:15:48.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.902+0000 7fd65dffb640 1 -- 172.21.15.27:0/2586141148 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f316c19850 con 0x55f316cc53d0 2024-09-19T08:15:48.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.902+0000 7fd65dffb640 10 client.16200 handle_command_reply: tid=0 2024-09-19T08:15:48.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.902+0000 7fd6827bd740 1 client.16200 shutdown 2024-09-19T08:15:48.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.902+0000 7fd6827bd740 1 -- 172.21.15.27:0/2586141148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316cb5a90 msgr2=0x55f316cb2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:48.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.902+0000 7fd6827bd740 1 --2- 172.21.15.27:0/2586141148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316cb5a90 0x55f316cb2cf0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd66c001eb0 tx=0x7fd66c003670 comp rx=0 tx=0).stop 2024-09-19T08:15:48.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.902+0000 7fd6827bd740 1 -- 172.21.15.27:0/2586141148 shutdown_connections 2024-09-19T08:15:48.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.902+0000 7fd6827bd740 1 --2- 172.21.15.27:0/2586141148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316cb5a90 0x55f316cb2cf0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.902+0000 7fd6827bd740 1 --2- 172.21.15.27:0/2586141148 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f316cc53d0 0x55f316cc77c0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.902+0000 7fd6827bd740 1 --2- 172.21.15.27:0/2586141148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f316ca6c80 0x55f316cb2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.902+0000 7fd6827bd740 1 --2- 172.21.15.27:0/2586141148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f316ca6360 0x55f316cb5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.902+0000 7fd65dffb640 0 client.16200 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:48.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.902+0000 7fd6827bd740 1 -- 172.21.15.27:0/2586141148 >> 172.21.15.27:0/2586141148 conn(0x55f316ca2a30 msgr2=0x55f316ca8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:48.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.902+0000 7fd6827bd740 1 -- 172.21.15.27:0/2586141148 shutdown_connections 2024-09-19T08:15:48.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.902+0000 7fd6827bd740 1 -- 172.21.15.27:0/2586141148 wait complete. 2024-09-19T08:15:48.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.902+0000 7fd6827bd740 20 client.16200 trim_cache size 0 max 16384 2024-09-19T08:15:48.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.920+0000 7fd6827bd740 1 Processor -- start 2024-09-19T08:15:48.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.920+0000 7fd6827bd740 1 -- start start 2024-09-19T08:15:48.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.920+0000 7fd6827bd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f316ca2a30 0x55f316cca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:48.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.920+0000 7fd6827bd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f316ca6360 0x55f316ccad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:48.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.920+0000 7fd6827bd740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316ca6c80 0x55f316caf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:48.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.920+0000 7fd6827bd740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd6781a9520 con 0x55f316ca6c80 2024-09-19T08:15:48.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.920+0000 7fd6827bd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd6781abd80 con 0x55f316ca6360 2024-09-19T08:15:48.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.920+0000 7fd6827bd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd6781a9b70 con 0x55f316ca2a30 2024-09-19T08:15:48.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.920+0000 7fd67d97f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316ca6c80 0x55f316caf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:48.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.920+0000 7fd67d97f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316ca6c80 0x55f316caf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52566/0 (socket says 172.21.15.27:52566) 2024-09-19T08:15:48.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.920+0000 7fd67d97f640 1 -- 172.21.15.27:0/2238307774 learned_addr learned my addr 172.21.15.27:0/2238307774 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:48.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.920+0000 7fd67e180640 1 --2- 172.21.15.27:0/2238307774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f316ca6360 0x55f316ccad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.920+0000 7fd67d97f640 1 -- 172.21.15.27:0/2238307774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f316ca2a30 msgr2=0x55f316cca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.920+0000 7fd67d97f640 1 --2- 172.21.15.27:0/2238307774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f316ca2a30 0x55f316cca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.920+0000 7fd67d97f640 1 -- 172.21.15.27:0/2238307774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f316ca6360 msgr2=0x55f316ccad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.920+0000 7fd67d97f640 1 --2- 172.21.15.27:0/2238307774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f316ca6360 0x55f316ccad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.920+0000 7fd67d97f640 1 -- 172.21.15.27:0/2238307774 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f316ca6ab0 con 0x55f316ca6c80 2024-09-19T08:15:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.921+0000 7fd67d97f640 1 --2- 172.21.15.27:0/2238307774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316ca6c80 0x55f316caf980 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd66c02ac30 tx=0x7fd66c031c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f34d6bd0f309b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.921+0000 7fd65ffff640 1 -- 172.21.15.27:0/2238307774 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c05c070 con 0x55f316ca6c80 2024-09-19T08:15:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.921+0000 7fd65ffff640 1 -- 172.21.15.27:0/2238307774 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd66c0048c0 con 0x55f316ca6c80 2024-09-19T08:15:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.921+0000 7fd65ffff640 1 -- 172.21.15.27:0/2238307774 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c035040 con 0x55f316ca6c80 2024-09-19T08:15:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.921+0000 7fd6827bd740 1 -- 172.21.15.27:0/2238307774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316ca6c80 msgr2=0x55f316caf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.921+0000 7fd6827bd740 1 --2- 172.21.15.27:0/2238307774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316ca6c80 0x55f316caf980 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd66c02ac30 tx=0x7fd66c031c20 comp rx=0 tx=0).stop 2024-09-19T08:15:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.921+0000 7fd6827bd740 1 -- 172.21.15.27:0/2238307774 shutdown_connections 2024-09-19T08:15:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.921+0000 7fd6827bd740 1 --2- 172.21.15.27:0/2238307774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316ca6c80 0x55f316caf980 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.921+0000 7fd6827bd740 1 --2- 172.21.15.27:0/2238307774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f316ca6360 0x55f316ccad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.921+0000 7fd6827bd740 1 --2- 172.21.15.27:0/2238307774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f316ca2a30 0x55f316cca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.921+0000 7fd6827bd740 1 -- 172.21.15.27:0/2238307774 >> 172.21.15.27:0/2238307774 conn(0x55f316cae110 msgr2=0x55f316cb0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.921+0000 7fd6827bd740 1 -- 172.21.15.27:0/2238307774 shutdown_connections 2024-09-19T08:15:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.921+0000 7fd6827bd740 1 -- 172.21.15.27:0/2238307774 wait complete. 2024-09-19T08:15:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.922+0000 7fd6827bd740 1 -- start start 2024-09-19T08:15:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.922+0000 7fd6827bd740 1 Processor -- start 2024-09-19T08:15:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.922+0000 7fd6827bd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f316ca2a30 0x55f316ccb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.922+0000 7fd6827bd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f316ca6360 0x55f316cc83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.922+0000 7fd6827bd740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316ca6c80 0x55f316cc8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.922+0000 7fd6827bd740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd6781aa240 con 0x55f316ca6c80 2024-09-19T08:15:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.922+0000 7fd6827bd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd6781ab6b0 con 0x55f316ca6360 2024-09-19T08:15:48.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.922+0000 7fd6827bd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd6781aa910 con 0x55f316ca2a30 2024-09-19T08:15:48.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.922+0000 7fd6827bd740 10 client.0 _ll_register_callbacks cb 0x7fd66c043070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:15:48.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.922+0000 7fd67d97f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316ca6c80 0x55f316cc8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:48.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.922+0000 7fd67d97f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316ca6c80 0x55f316cc8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52570/0 (socket says 172.21.15.27:52570) 2024-09-19T08:15:48.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.922+0000 7fd67d97f640 1 -- 172.21.15.27:0/2601216204 learned_addr learned my addr 172.21.15.27:0/2601216204 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:15:48.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.922+0000 7fd67e180640 1 --2- 172.21.15.27:0/2601216204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f316ca6360 0x55f316cc83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:48.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.922+0000 7fd67d97f640 1 --2- 172.21.15.27:0/2601216204 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f316ca2a30 0x55f316ccb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:48.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.923+0000 7fd67d97f640 1 -- 172.21.15.27:0/2601216204 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f316ca2a30 msgr2=0x55f316ccb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:48.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.923+0000 7fd67d97f640 1 --2- 172.21.15.27:0/2601216204 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f316ca2a30 0x55f316ccb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.923+0000 7fd67d97f640 1 -- 172.21.15.27:0/2601216204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f316ca6360 msgr2=0x55f316cc83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:15:48.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.923+0000 7fd67d97f640 1 --2- 172.21.15.27:0/2601216204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f316ca6360 0x55f316cc83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.923+0000 7fd67d97f640 1 -- 172.21.15.27:0/2601216204 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f316d2ed10 con 0x55f316ca6c80 2024-09-19T08:15:48.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.923+0000 7fd67d97f640 1 --2- 172.21.15.27:0/2601216204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316ca6c80 0x55f316cc8b80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd66c006010 tx=0x7fd66c050040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abfcec1da3f216a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:15:48.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.923+0000 7fd65dffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:15:48.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.923+0000 7fd65dffb640 1 -- 172.21.15.27:0/2601216204 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c05c040 con 0x55f316ca6c80 2024-09-19T08:15:48.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.923+0000 7fd65dffb640 1 -- 172.21.15.27:0/2601216204 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fd66c031540 con 0x55f316ca6c80 2024-09-19T08:15:48.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.923+0000 7fd6827bd740 1 -- 172.21.15.27:0/2601216204 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd66c0048c0 con 0x55f316ca6c80 2024-09-19T08:15:48.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.923+0000 7fd65dffb640 1 -- 172.21.15.27:0/2601216204 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd66c035040 con 0x55f316ca6c80 2024-09-19T08:15:48.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.923+0000 7fd6827bd740 10 client.16206 fetch_fsmap learned FSMap version 20 2024-09-19T08:15:48.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.923+0000 7fd6827bd740 1 -- 172.21.15.27:0/2601216204 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f316d2fe80 con 0x55f316ca6c80 2024-09-19T08:15:48.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.923+0000 7fd65dffb640 1 -- 172.21.15.27:0/2601216204 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd66c0048c0 con 0x55f316ca6c80 2024-09-19T08:15:48.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.923+0000 7fd65dffb640 1 -- 172.21.15.27:0/2601216204 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd66c062020 con 0x55f316ca6c80 2024-09-19T08:15:48.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.924+0000 7fd6827bd740 10 client.16206 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:15:48.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.924+0000 7fd6827bd740 10 client.16206 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:15:48.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.924+0000 7fd6827bd740 20 client.16206 populate_metadata read hostname 'smithi027' 2024-09-19T08:15:48.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.924+0000 7fd6827bd740 1 --2- 172.21.15.27:0/2601216204 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f316cb5a90 0x55f316d32440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:15:48.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.924+0000 7fd6827bd740 4 client.16206 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:15:48.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.924+0000 7fd6827bd740 1 -- 172.21.15.27:0/2601216204 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f316c13d60 con 0x55f316cb5a90 2024-09-19T08:15:48.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.924+0000 7fd67e180640 1 --2- 172.21.15.27:0/2601216204 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f316cb5a90 0x55f316d32440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:15:48.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.924+0000 7fd65dffb640 10 client.16206 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:48.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.924+0000 7fd67e180640 1 --2- 172.21.15.27:0/2601216204 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f316cb5a90 0x55f316d32440 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b3e323473ad2756 server_cookie=ccd280a16caf35c5 in_seq=0 out_seq=0 2024-09-19T08:15:48.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.924+0000 7fd65dffb640 1 -- 172.21.15.27:0/2601216204 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f316c13d60 con 0x55f316cb5a90 2024-09-19T08:15:48.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.924+0000 7fd65dffb640 10 client.16206 handle_command_reply: tid=0 2024-09-19T08:15:48.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.925+0000 7fd6827bd740 1 client.16206 shutdown 2024-09-19T08:15:48.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.925+0000 7fd6827bd740 1 -- 172.21.15.27:0/2601216204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316ca6c80 msgr2=0x55f316cc8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:48.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.925+0000 7fd6827bd740 1 --2- 172.21.15.27:0/2601216204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316ca6c80 0x55f316cc8b80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd66c006010 tx=0x7fd66c050040 comp rx=0 tx=0).stop 2024-09-19T08:15:48.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.925+0000 7fd6827bd740 1 -- 172.21.15.27:0/2601216204 shutdown_connections 2024-09-19T08:15:48.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.925+0000 7fd6827bd740 1 --2- 172.21.15.27:0/2601216204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f316ca6c80 0x55f316cc8b80 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.925+0000 7fd6827bd740 1 --2- 172.21.15.27:0/2601216204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f316ca6360 0x55f316cc83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.925+0000 7fd6827bd740 1 --2- 172.21.15.27:0/2601216204 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f316cb5a90 0x55f316d32440 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.925+0000 7fd6827bd740 1 --2- 172.21.15.27:0/2601216204 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f316ca2a30 0x55f316ccb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.925+0000 7fd6827bd740 1 -- 172.21.15.27:0/2601216204 >> 172.21.15.27:0/2601216204 conn(0x55f316cae110 msgr2=0x55f316cb47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:48.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.925+0000 7fd65dffb640 0 client.16206 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:15:48.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.925+0000 7fd6827bd740 1 -- 172.21.15.27:0/2601216204 shutdown_connections 2024-09-19T08:15:48.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.925+0000 7fd6827bd740 1 -- 172.21.15.27:0/2601216204 wait complete. 2024-09-19T08:15:48.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.925+0000 7fd6827bd740 20 client.16206 trim_cache size 0 max 16384 2024-09-19T08:15:48.938 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:15:48.938 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:15:48.938 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": { 2024-09-19T08:15:48.939 INFO:teuthology.orchestra.run.smithi027.stdout: "e0816e28-f854-42b0-9e54-1fffc528a0de": { 2024-09-19T08:15:48.939 INFO:teuthology.orchestra.run.smithi027.stdout: "path": "/", 2024-09-19T08:15:48.939 INFO:teuthology.orchestra.run.smithi027.stdout: "tag": "e0816e28-f854-42b0-9e54-1fffc528a0de", 2024-09-19T08:15:48.939 INFO:teuthology.orchestra.run.smithi027.stdout: "options": "recursive,force" 2024-09-19T08:15:48.939 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:15:48.939 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:15:48.939 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:15:48.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.925+0000 7fd6803e4640 1 -- 172.21.15.27:0/3975325796 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd6600a33b0 msgr2=0x7fd6600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:48.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.925+0000 7fd6803e4640 1 --2- 172.21.15.27:0/3975325796 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd6600a33b0 0x7fd6600a5870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd6680ccbc0 tx=0x7fd66806d420 comp rx=0 tx=0).stop 2024-09-19T08:15:48.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.925+0000 7fd6803e4640 1 -- 172.21.15.27:0/3975325796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd678102ef0 msgr2=0x7fd67819cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:15:48.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.925+0000 7fd6803e4640 1 --2- 172.21.15.27:0/3975325796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd678102ef0 0x7fd67819cdb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd66800b970 tx=0x7fd66800be30 comp rx=0 tx=0).stop 2024-09-19T08:15:48.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.925+0000 7fd6803e4640 1 -- 172.21.15.27:0/3975325796 shutdown_connections 2024-09-19T08:15:48.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.925+0000 7fd6803e4640 1 --2- 172.21.15.27:0/3975325796 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd6600a33b0 0x7fd6600a5870 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.926+0000 7fd6803e4640 1 --2- 172.21.15.27:0/3975325796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd678102ef0 0x7fd67819cdb0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.926+0000 7fd6803e4640 1 --2- 172.21.15.27:0/3975325796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd678102570 0x7fd678198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.926+0000 7fd6803e4640 1 --2- 172.21.15.27:0/3975325796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd678100e20 0x7fd6781984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:15:48.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.926+0000 7fd6803e4640 1 -- 172.21.15.27:0/3975325796 >> 172.21.15.27:0/3975325796 conn(0x7fd6780fc7d0 msgr2=0x7fd678106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:15:48.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.926+0000 7fd6803e4640 1 -- 172.21.15.27:0/3975325796 shutdown_connections 2024-09-19T08:15:48.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:15:48.926+0000 7fd6803e4640 1 -- 172.21.15.27:0/3975325796 wait complete. 2024-09-19T08:15:48.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:48 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:15:48.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:48 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:15:48.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:48 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:15:48.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:48 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:15:48.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:48 smithi155 ceph-mon[35362]: pgmap v146: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-19T08:15:49.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:48 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:15:49.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:48 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:15:49.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:48 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:15:49.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:48 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:15:49.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:48 smithi203 ceph-mon[35198]: pgmap v146: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-19T08:15:49.801 INFO:tasks.cephfs.filesystem:scrub status for tag:e0816e28-f854-42b0-9e54-1fffc528a0de - {'path': '/', 'tag': 'e0816e28-f854-42b0-9e54-1fffc528a0de', 'options': 'recursive,force'} 2024-09-19T08:15:50.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:50 smithi155 ceph-mon[35362]: pgmap v147: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-19T08:15:50.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:50 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:15:51.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:50 smithi027 ceph-mon[31209]: pgmap v147: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-19T08:15:51.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:50 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:15:51.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:50 smithi203 ceph-mon[35198]: pgmap v147: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-19T08:15:51.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:50 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:15:52.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:52 smithi155 ceph-mon[35362]: pgmap v148: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-19T08:15:53.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:52 smithi027 ceph-mon[31209]: pgmap v148: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-19T08:15:53.007 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:52 smithi203 ceph-mon[35198]: pgmap v148: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-19T08:15:54.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:54 smithi155 ceph-mon[35362]: pgmap v149: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-19T08:15:55.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:54 smithi027 ceph-mon[31209]: pgmap v149: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-19T08:15:55.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:54 smithi203 ceph-mon[35198]: pgmap v149: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-19T08:15:56.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:56 smithi155 ceph-mon[35362]: pgmap v150: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:15:57.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:56 smithi027 ceph-mon[31209]: pgmap v150: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:15:57.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:56 smithi203 ceph-mon[35198]: pgmap v150: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:15:58.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:15:58 smithi155 ceph-mon[35362]: pgmap v151: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:15:59.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:15:58 smithi027 ceph-mon[31209]: pgmap v151: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:15:59.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:15:58 smithi203 ceph-mon[35198]: pgmap v151: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:16:00.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:00 smithi155 ceph-mon[35362]: pgmap v152: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:01.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:00 smithi027 ceph-mon[31209]: pgmap v152: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:00 smithi203 ceph-mon[35198]: pgmap v152: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:02.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:02 smithi155 ceph-mon[35362]: pgmap v153: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:03.001 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:02 smithi027 ceph-mon[31209]: pgmap v153: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:03.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:02 smithi203 ceph-mon[35198]: pgmap v153: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:04.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:04 smithi155 ceph-mon[35362]: pgmap v154: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:16:05.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:04 smithi027 ceph-mon[31209]: pgmap v154: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:16:05.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:04 smithi203 ceph-mon[35198]: pgmap v154: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:16:06.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:06 smithi155 ceph-mon[35362]: pgmap v155: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:16:07.001 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:06 smithi027 ceph-mon[31209]: pgmap v155: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:16:07.007 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:06 smithi203 ceph-mon[35198]: pgmap v155: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:16:08.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:08 smithi155 ceph-mon[35362]: pgmap v156: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:16:09.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:08 smithi027 ceph-mon[31209]: pgmap v156: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:16:09.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:08 smithi203 ceph-mon[35198]: pgmap v156: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:16:10.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:10 smithi155 ceph-mon[35362]: pgmap v157: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:16:11.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:10 smithi027 ceph-mon[31209]: pgmap v157: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:16:11.007 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:10 smithi203 ceph-mon[35198]: pgmap v157: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:16:12.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:12 smithi155 ceph-mon[35362]: pgmap v158: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:16:12.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:12 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:16:12.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:12 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:16:12.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:12 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:16:12.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:12 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:16:13.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:12 smithi027 ceph-mon[31209]: pgmap v158: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:16:13.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:12 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:16:13.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:12 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:16:13.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:12 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:16:13.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:12 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:16:13.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:12 smithi203 ceph-mon[35198]: pgmap v158: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:16:13.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:12 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:16:13.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:12 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:16:13.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:12 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:16:13.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:12 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:16:14.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:14 smithi155 ceph-mon[35362]: pgmap v159: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:16:15.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:14 smithi027 ceph-mon[31209]: pgmap v159: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:16:15.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:14 smithi203 ceph-mon[35198]: pgmap v159: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:16:16.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:16 smithi155 ceph-mon[35362]: pgmap v160: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T08:16:17.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:16 smithi027 ceph-mon[31209]: pgmap v160: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T08:16:17.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:16 smithi203 ceph-mon[35198]: pgmap v160: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T08:16:18.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:18 smithi155 ceph-mon[35362]: pgmap v161: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:16:19.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:18 smithi027 ceph-mon[31209]: pgmap v161: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:16:19.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:18 smithi203 ceph-mon[35198]: pgmap v161: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:16:19.802 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:16:20.075 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:16:20.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.572+0000 7ff27e080640 1 -- 172.21.15.27:0/2892939359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff278100e20 msgr2=0x7ff278101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:20.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.572+0000 7ff27e080640 1 --2- 172.21.15.27:0/2892939359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff278100e20 0x7ff278101200 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff268009900 tx=0x7ff26802a480 comp rx=0 tx=0).stop 2024-09-19T08:16:20.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.572+0000 7ff27e080640 1 -- 172.21.15.27:0/2892939359 shutdown_connections 2024-09-19T08:16:20.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.572+0000 7ff27e080640 1 --2- 172.21.15.27:0/2892939359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff278102ef0 0x7ff27810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.572+0000 7ff27e080640 1 --2- 172.21.15.27:0/2892939359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff278102570 0x7ff2781029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.572+0000 7ff27e080640 1 --2- 172.21.15.27:0/2892939359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff278100e20 0x7ff278101200 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.572+0000 7ff27e080640 1 -- 172.21.15.27:0/2892939359 >> 172.21.15.27:0/2892939359 conn(0x7ff2780fc7d0 msgr2=0x7ff2780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:20.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.572+0000 7ff27e080640 1 -- 172.21.15.27:0/2892939359 shutdown_connections 2024-09-19T08:16:20.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.572+0000 7ff27e080640 1 -- 172.21.15.27:0/2892939359 wait complete. 2024-09-19T08:16:20.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.572+0000 7ff27e080640 1 Processor -- start 2024-09-19T08:16:20.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.573+0000 7ff27e080640 1 -- start start 2024-09-19T08:16:20.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.573+0000 7ff27e080640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff278100e20 0x7ff2780fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:20.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.573+0000 7ff27e080640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff278102570 0x7ff2780fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:20.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.573+0000 7ff27e080640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff278102ef0 0x7ff2780fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:20.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.573+0000 7ff27e080640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff278110fd0 con 0x7ff278102570 2024-09-19T08:16:20.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.573+0000 7ff27e080640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff278110e50 con 0x7ff278102ef0 2024-09-19T08:16:20.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.573+0000 7ff27e080640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff278111150 con 0x7ff278100e20 2024-09-19T08:16:20.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.573+0000 7ff276ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff278102570 0x7ff2780fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:20.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.573+0000 7ff276ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff278102570 0x7ff2780fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40274/0 (socket says 172.21.15.27:40274) 2024-09-19T08:16:20.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.573+0000 7ff276ffd640 1 -- 172.21.15.27:0/493550093 learned_addr learned my addr 172.21.15.27:0/493550093 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:20.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.573+0000 7ff277fff640 1 --2- 172.21.15.27:0/493550093 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff278102ef0 0x7ff2780fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:20.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.573+0000 7ff2777fe640 1 --2- 172.21.15.27:0/493550093 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff278100e20 0x7ff2780fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.573+0000 7ff276ffd640 1 -- 172.21.15.27:0/493550093 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff278100e20 msgr2=0x7ff2780fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.573+0000 7ff276ffd640 1 --2- 172.21.15.27:0/493550093 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff278100e20 0x7ff2780fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.573+0000 7ff276ffd640 1 -- 172.21.15.27:0/493550093 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff278102ef0 msgr2=0x7ff2780fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.573+0000 7ff276ffd640 1 --2- 172.21.15.27:0/493550093 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff278102ef0 0x7ff2780fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.573+0000 7ff276ffd640 1 -- 172.21.15.27:0/493550093 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2781a6980 con 0x7ff278102570 2024-09-19T08:16:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.574+0000 7ff276ffd640 1 --2- 172.21.15.27:0/493550093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff278102570 0x7ff2780fd1c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00c890 tx=0x7ff26c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.574+0000 7ff274ff9640 1 -- 172.21.15.27:0/493550093 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c004220 con 0x7ff278102570 2024-09-19T08:16:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.574+0000 7ff27e080640 1 -- 172.21.15.27:0/493550093 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2781a6c70 con 0x7ff278102570 2024-09-19T08:16:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.574+0000 7ff274ff9640 1 -- 172.21.15.27:0/493550093 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff26c0043c0 con 0x7ff278102570 2024-09-19T08:16:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.574+0000 7ff274ff9640 1 -- 172.21.15.27:0/493550093 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c004a00 con 0x7ff278102570 2024-09-19T08:16:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.574+0000 7ff27e080640 1 -- 172.21.15.27:0/493550093 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2781a71b0 con 0x7ff278102570 2024-09-19T08:16:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.576+0000 7ff274ff9640 1 -- 172.21.15.27:0/493550093 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff26c0079b0 con 0x7ff278102570 2024-09-19T08:16:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.577+0000 7ff274ff9640 1 --2- 172.21.15.27:0/493550093 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff2600a33b0 0x7ff2600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:20.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.577+0000 7ff2777fe640 1 --2- 172.21.15.27:0/493550093 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff2600a33b0 0x7ff2600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:20.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.577+0000 7ff274ff9640 1 -- 172.21.15.27:0/493550093 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff26c0cf920 con 0x7ff278102570 2024-09-19T08:16:20.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.578+0000 7ff2777fe640 1 --2- 172.21.15.27:0/493550093 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff2600a33b0 0x7ff2600a5870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff268000c00 tx=0x7ff268005b50 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:20.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.578+0000 7ff280459740 1 Processor -- start 2024-09-19T08:16:20.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.578+0000 7ff280459740 1 -- start start 2024-09-19T08:16:20.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.578+0000 7ff280459740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c313a184a0 0x55c313a18880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:20.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.578+0000 7ff280459740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a18dc0 0x55c313a23140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:20.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.578+0000 7ff280459740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a23680 0x55c313a25a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:20.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.578+0000 7ff280459740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c31397e2e0 con 0x55c313a18dc0 2024-09-19T08:16:20.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.578+0000 7ff280459740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c313925ce0 con 0x55c313a184a0 2024-09-19T08:16:20.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.578+0000 7ff280459740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c31397a2a0 con 0x55c313a23680 2024-09-19T08:16:20.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.578+0000 7ff276ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a18dc0 0x55c313a23140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:20.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.578+0000 7ff276ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a18dc0 0x55c313a23140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40290/0 (socket says 172.21.15.27:40290) 2024-09-19T08:16:20.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.578+0000 7ff276ffd640 1 -- 172.21.15.27:0/2564636499 learned_addr learned my addr 172.21.15.27:0/2564636499 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:20.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.578+0000 7ff2777fe640 1 --2- 172.21.15.27:0/2564636499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c313a184a0 0x55c313a18880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:20.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.578+0000 7ff277fff640 1 --2- 172.21.15.27:0/2564636499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a23680 0x55c313a25a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:20.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.579+0000 7ff276ffd640 1 -- 172.21.15.27:0/2564636499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a23680 msgr2=0x55c313a25a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:20.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.579+0000 7ff276ffd640 1 --2- 172.21.15.27:0/2564636499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a23680 0x55c313a25a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.579+0000 7ff276ffd640 1 -- 172.21.15.27:0/2564636499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c313a184a0 msgr2=0x55c313a18880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:20.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.579+0000 7ff276ffd640 1 --2- 172.21.15.27:0/2564636499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c313a184a0 0x55c313a18880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.579+0000 7ff276ffd640 1 -- 172.21.15.27:0/2564636499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31390a440 con 0x55c313a18dc0 2024-09-19T08:16:20.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.579+0000 7ff276ffd640 1 --2- 172.21.15.27:0/2564636499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a18dc0 0x55c313a23140 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff26c098160 tx=0x7ff26c09b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148e4dacc2e251bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:20.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.579+0000 7ff25dffb640 1 -- 172.21.15.27:0/2564636499 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0b1070 con 0x55c313a18dc0 2024-09-19T08:16:20.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.579+0000 7ff25dffb640 1 -- 172.21.15.27:0/2564636499 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff26c0cd340 con 0x55c313a18dc0 2024-09-19T08:16:20.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.579+0000 7ff25dffb640 1 -- 172.21.15.27:0/2564636499 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c01d040 con 0x55c313a18dc0 2024-09-19T08:16:20.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.580+0000 7ff280459740 1 -- 172.21.15.27:0/2564636499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a18dc0 msgr2=0x55c313a23140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.580+0000 7ff280459740 1 --2- 172.21.15.27:0/2564636499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a18dc0 0x55c313a23140 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff26c098160 tx=0x7ff26c09b760 comp rx=0 tx=0).stop 2024-09-19T08:16:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.580+0000 7ff280459740 1 -- 172.21.15.27:0/2564636499 shutdown_connections 2024-09-19T08:16:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.580+0000 7ff280459740 1 --2- 172.21.15.27:0/2564636499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a23680 0x55c313a25a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.580+0000 7ff280459740 1 --2- 172.21.15.27:0/2564636499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a18dc0 0x55c313a23140 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.580+0000 7ff280459740 1 --2- 172.21.15.27:0/2564636499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c313a184a0 0x55c313a18880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.580+0000 7ff280459740 1 -- 172.21.15.27:0/2564636499 >> 172.21.15.27:0/2564636499 conn(0x55c313a14a30 msgr2=0x55c313a14e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.580+0000 7ff280459740 1 -- 172.21.15.27:0/2564636499 shutdown_connections 2024-09-19T08:16:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.580+0000 7ff280459740 1 -- 172.21.15.27:0/2564636499 wait complete. 2024-09-19T08:16:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.580+0000 7ff280459740 1 -- start start 2024-09-19T08:16:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.580+0000 7ff280459740 1 Processor -- start 2024-09-19T08:16:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.581+0000 7ff280459740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a184a0 0x55c313a23050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.581+0000 7ff280459740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a18dc0 0x55c313a20300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.581+0000 7ff280459740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c313a23680 0x55c313a208f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.581+0000 7ff280459740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c313a26250 con 0x55c313a184a0 2024-09-19T08:16:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.581+0000 7ff280459740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c313939050 con 0x55c313a23680 2024-09-19T08:16:20.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.581+0000 7ff280459740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c313a263d0 con 0x55c313a18dc0 2024-09-19T08:16:20.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.581+0000 7ff280459740 10 client.0 _ll_register_callbacks cb 0x55c313979160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:16:20.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.581+0000 7ff2777fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a184a0 0x55c313a23050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:20.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.581+0000 7ff2777fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a184a0 0x55c313a23050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40296/0 (socket says 172.21.15.27:40296) 2024-09-19T08:16:20.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.581+0000 7ff2777fe640 1 -- 172.21.15.27:0/1778929218 learned_addr learned my addr 172.21.15.27:0/1778929218 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:20.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.581+0000 7ff276ffd640 1 --2- 172.21.15.27:0/1778929218 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a18dc0 0x55c313a20300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:20.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.581+0000 7ff277fff640 1 --2- 172.21.15.27:0/1778929218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c313a23680 0x55c313a208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:20.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.581+0000 7ff2777fe640 1 -- 172.21.15.27:0/1778929218 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a18dc0 msgr2=0x55c313a20300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:20.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.581+0000 7ff2777fe640 1 --2- 172.21.15.27:0/1778929218 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a18dc0 0x55c313a20300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.581+0000 7ff2777fe640 1 -- 172.21.15.27:0/1778929218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c313a23680 msgr2=0x55c313a208f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:20.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.581+0000 7ff2777fe640 1 --2- 172.21.15.27:0/1778929218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c313a23680 0x55c313a208f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.581+0000 7ff2777fe640 1 -- 172.21.15.27:0/1778929218 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3136ef3c0 con 0x55c313a184a0 2024-09-19T08:16:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.581+0000 7ff2777fe640 1 --2- 172.21.15.27:0/1778929218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a184a0 0x55c313a23050 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff268009230 tx=0x7ff268009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ec875f49a67047 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.581+0000 7ff256ffd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:16:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.581+0000 7ff256ffd640 1 -- 172.21.15.27:0/1778929218 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268035040 con 0x55c313a184a0 2024-09-19T08:16:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.582+0000 7ff256ffd640 1 -- 172.21.15.27:0/1778929218 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff268004c50 con 0x55c313a184a0 2024-09-19T08:16:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.582+0000 7ff280459740 1 -- 172.21.15.27:0/1778929218 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff26c0cd340 con 0x55c313a184a0 2024-09-19T08:16:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.582+0000 7ff256ffd640 1 -- 172.21.15.27:0/1778929218 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff268004e50 con 0x55c313a184a0 2024-09-19T08:16:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.582+0000 7ff280459740 10 client.16218 fetch_fsmap learned FSMap version 20 2024-09-19T08:16:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.582+0000 7ff280459740 1 -- 172.21.15.27:0/1778929218 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c313a31c80 con 0x55c313a184a0 2024-09-19T08:16:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.582+0000 7ff256ffd640 1 -- 172.21.15.27:0/1778929218 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff26c0cd340 con 0x55c313a184a0 2024-09-19T08:16:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.582+0000 7ff256ffd640 1 -- 172.21.15.27:0/1778929218 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff2680328b0 con 0x55c313a184a0 2024-09-19T08:16:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.582+0000 7ff280459740 10 client.16218 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:16:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.582+0000 7ff280459740 10 client.16218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:16:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.582+0000 7ff280459740 20 client.16218 populate_metadata read hostname 'smithi027' 2024-09-19T08:16:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.582+0000 7ff280459740 1 --2- 172.21.15.27:0/1778929218 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c313a33090 0x55c313a35480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:20.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.582+0000 7ff280459740 4 client.16218 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:16:20.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.582+0000 7ff280459740 1 -- 172.21.15.27:0/1778929218 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c31398b850 con 0x55c313a33090 2024-09-19T08:16:20.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.583+0000 7ff276ffd640 1 --2- 172.21.15.27:0/1778929218 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c313a33090 0x55c313a35480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:20.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.583+0000 7ff256ffd640 10 client.16218 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:16:20.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.583+0000 7ff276ffd640 1 --2- 172.21.15.27:0/1778929218 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c313a33090 0x55c313a35480 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af5f238360af4f97 server_cookie=4ea83527cfd42cd8 in_seq=0 out_seq=0 2024-09-19T08:16:20.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.584+0000 7ff256ffd640 1 -- 172.21.15.27:0/1778929218 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c31398b850 con 0x55c313a33090 2024-09-19T08:16:20.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.584+0000 7ff256ffd640 10 client.16218 handle_command_reply: tid=0 2024-09-19T08:16:20.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.584+0000 7ff280459740 1 client.16218 shutdown 2024-09-19T08:16:20.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.584+0000 7ff280459740 1 -- 172.21.15.27:0/1778929218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a184a0 msgr2=0x55c313a23050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:20.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.584+0000 7ff280459740 1 --2- 172.21.15.27:0/1778929218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a184a0 0x55c313a23050 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff268009230 tx=0x7ff268009260 comp rx=0 tx=0).stop 2024-09-19T08:16:20.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.584+0000 7ff280459740 1 -- 172.21.15.27:0/1778929218 shutdown_connections 2024-09-19T08:16:20.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.584+0000 7ff280459740 1 --2- 172.21.15.27:0/1778929218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c313a23680 0x55c313a208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.584+0000 7ff280459740 1 --2- 172.21.15.27:0/1778929218 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c313a33090 0x55c313a35480 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.584+0000 7ff280459740 1 --2- 172.21.15.27:0/1778929218 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a18dc0 0x55c313a20300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.584+0000 7ff256ffd640 0 client.16218 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:16:20.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.584+0000 7ff280459740 1 --2- 172.21.15.27:0/1778929218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a184a0 0x55c313a23050 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.584+0000 7ff280459740 1 -- 172.21.15.27:0/1778929218 >> 172.21.15.27:0/1778929218 conn(0x55c313a14a30 msgr2=0x55c313a13b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:20.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.584+0000 7ff280459740 1 -- 172.21.15.27:0/1778929218 shutdown_connections 2024-09-19T08:16:20.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.584+0000 7ff280459740 1 -- 172.21.15.27:0/1778929218 wait complete. 2024-09-19T08:16:20.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.584+0000 7ff280459740 20 client.16218 trim_cache size 0 max 16384 2024-09-19T08:16:20.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.622+0000 7ff280459740 1 Processor -- start 2024-09-19T08:16:20.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.622+0000 7ff280459740 1 -- start start 2024-09-19T08:16:20.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.622+0000 7ff280459740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a184a0 0x55c313a3ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:20.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.622+0000 7ff280459740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c313a18dc0 0x55c313a3b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:20.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.622+0000 7ff280459740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a23680 0x55c313a1d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:20.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.622+0000 7ff280459740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff2781ad9f0 con 0x55c313a23680 2024-09-19T08:16:20.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.622+0000 7ff280459740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff2781b0270 con 0x55c313a18dc0 2024-09-19T08:16:20.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.622+0000 7ff280459740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff2781ae060 con 0x55c313a184a0 2024-09-19T08:16:20.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.622+0000 7ff277fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a23680 0x55c313a1d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:20.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.622+0000 7ff277fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a23680 0x55c313a1d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40300/0 (socket says 172.21.15.27:40300) 2024-09-19T08:16:20.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.622+0000 7ff277fff640 1 -- 172.21.15.27:0/3521467848 learned_addr learned my addr 172.21.15.27:0/3521467848 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:20.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.622+0000 7ff2777fe640 1 --2- 172.21.15.27:0/3521467848 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a184a0 0x55c313a3ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:20.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.622+0000 7ff276ffd640 1 --2- 172.21.15.27:0/3521467848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c313a18dc0 0x55c313a3b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:20.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.623+0000 7ff277fff640 1 -- 172.21.15.27:0/3521467848 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a184a0 msgr2=0x55c313a3ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:20.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.623+0000 7ff277fff640 1 --2- 172.21.15.27:0/3521467848 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a184a0 0x55c313a3ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.623+0000 7ff277fff640 1 -- 172.21.15.27:0/3521467848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c313a18dc0 msgr2=0x55c313a3b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:20.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.623+0000 7ff277fff640 1 --2- 172.21.15.27:0/3521467848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c313a18dc0 0x55c313a3b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.623+0000 7ff277fff640 1 -- 172.21.15.27:0/3521467848 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c313a142e0 con 0x55c313a23680 2024-09-19T08:16:20.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.623+0000 7ff277fff640 1 --2- 172.21.15.27:0/3521467848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a23680 0x55c313a1d560 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff270009f60 tx=0x7ff270009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66d58f530241fc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:20.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.623+0000 7ff25d7fa640 1 -- 172.21.15.27:0/3521467848 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270003b70 con 0x55c313a23680 2024-09-19T08:16:20.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.623+0000 7ff25d7fa640 1 -- 172.21.15.27:0/3521467848 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff270003d10 con 0x55c313a23680 2024-09-19T08:16:20.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.623+0000 7ff25d7fa640 1 -- 172.21.15.27:0/3521467848 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27001caa0 con 0x55c313a23680 2024-09-19T08:16:20.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.624+0000 7ff280459740 1 -- 172.21.15.27:0/3521467848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a23680 msgr2=0x55c313a1d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:20.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.624+0000 7ff280459740 1 --2- 172.21.15.27:0/3521467848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a23680 0x55c313a1d560 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff270009f60 tx=0x7ff270009f90 comp rx=0 tx=0).stop 2024-09-19T08:16:20.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.624+0000 7ff280459740 1 -- 172.21.15.27:0/3521467848 shutdown_connections 2024-09-19T08:16:20.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.624+0000 7ff280459740 1 --2- 172.21.15.27:0/3521467848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a23680 0x55c313a1d560 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.624+0000 7ff280459740 1 --2- 172.21.15.27:0/3521467848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c313a18dc0 0x55c313a3b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.624+0000 7ff280459740 1 --2- 172.21.15.27:0/3521467848 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a184a0 0x55c313a3ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.624+0000 7ff280459740 1 -- 172.21.15.27:0/3521467848 >> 172.21.15.27:0/3521467848 conn(0x55c313a14a30 msgr2=0x55c313a13b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:20.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.624+0000 7ff280459740 1 -- 172.21.15.27:0/3521467848 shutdown_connections 2024-09-19T08:16:20.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.624+0000 7ff280459740 1 -- 172.21.15.27:0/3521467848 wait complete. 2024-09-19T08:16:20.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.624+0000 7ff280459740 1 -- start start 2024-09-19T08:16:20.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.625+0000 7ff280459740 1 Processor -- start 2024-09-19T08:16:20.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.625+0000 7ff280459740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a184a0 0x55c313a29b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:20.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.625+0000 7ff280459740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a18dc0 0x55c313a2a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:20.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.625+0000 7ff280459740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c313a23680 0x55c313aa5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:20.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.625+0000 7ff280459740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff2781ae730 con 0x55c313a184a0 2024-09-19T08:16:20.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.625+0000 7ff280459740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff2781afba0 con 0x55c313a23680 2024-09-19T08:16:20.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.625+0000 7ff280459740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff2781aee00 con 0x55c313a18dc0 2024-09-19T08:16:20.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.625+0000 7ff280459740 10 client.0 _ll_register_callbacks cb 0x7ff2680043b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:16:20.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.625+0000 7ff2777fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a184a0 0x55c313a29b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:20.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.625+0000 7ff2777fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a184a0 0x55c313a29b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40306/0 (socket says 172.21.15.27:40306) 2024-09-19T08:16:20.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.625+0000 7ff2777fe640 1 -- 172.21.15.27:0/1236589282 learned_addr learned my addr 172.21.15.27:0/1236589282 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:20.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.625+0000 7ff276ffd640 1 --2- 172.21.15.27:0/1236589282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a18dc0 0x55c313a2a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:20.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.626+0000 7ff277fff640 1 --2- 172.21.15.27:0/1236589282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c313a23680 0x55c313aa5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:20.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.626+0000 7ff2777fe640 1 -- 172.21.15.27:0/1236589282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a18dc0 msgr2=0x55c313a2a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:20.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.626+0000 7ff2777fe640 1 --2- 172.21.15.27:0/1236589282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a18dc0 0x55c313a2a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.626+0000 7ff2777fe640 1 -- 172.21.15.27:0/1236589282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c313a23680 msgr2=0x55c313aa5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:20.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.626+0000 7ff2777fe640 1 --2- 172.21.15.27:0/1236589282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c313a23680 0x55c313aa5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.626+0000 7ff2777fe640 1 -- 172.21.15.27:0/1236589282 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c313a1f2b0 con 0x55c313a184a0 2024-09-19T08:16:20.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.626+0000 7ff276ffd640 1 --2- 172.21.15.27:0/1236589282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a18dc0 0x55c313a2a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:16:20.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.626+0000 7ff2777fe640 1 --2- 172.21.15.27:0/1236589282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a184a0 0x55c313a29b70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff26802a9a0 tx=0x7ff268004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65394b0113f2e15d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:20.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.626+0000 7ff256ffd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:16:20.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.626+0000 7ff256ffd640 1 -- 172.21.15.27:0/1236589282 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268069060 con 0x55c313a184a0 2024-09-19T08:16:20.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.626+0000 7ff280459740 1 -- 172.21.15.27:0/1236589282 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff270003d10 con 0x55c313a184a0 2024-09-19T08:16:20.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.626+0000 7ff256ffd640 1 -- 172.21.15.27:0/1236589282 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff2680035f0 con 0x55c313a184a0 2024-09-19T08:16:20.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.626+0000 7ff256ffd640 1 -- 172.21.15.27:0/1236589282 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff268032e70 con 0x55c313a184a0 2024-09-19T08:16:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.626+0000 7ff280459740 10 client.16224 fetch_fsmap learned FSMap version 20 2024-09-19T08:16:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.626+0000 7ff280459740 1 -- 172.21.15.27:0/1236589282 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c313a20c60 con 0x55c313a184a0 2024-09-19T08:16:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.627+0000 7ff256ffd640 1 -- 172.21.15.27:0/1236589282 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff270003d10 con 0x55c313a184a0 2024-09-19T08:16:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.627+0000 7ff256ffd640 1 -- 172.21.15.27:0/1236589282 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff26803c440 con 0x55c313a184a0 2024-09-19T08:16:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.627+0000 7ff280459740 10 client.16224 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:16:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.627+0000 7ff280459740 10 client.16224 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:16:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.627+0000 7ff280459740 20 client.16224 populate_metadata read hostname 'smithi027' 2024-09-19T08:16:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.627+0000 7ff280459740 1 --2- 172.21.15.27:0/1236589282 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c313aa7130 0x55c313aa9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.627+0000 7ff280459740 4 client.16224 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:16:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.627+0000 7ff280459740 1 -- 172.21.15.27:0/1236589282 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c313985d60 con 0x55c313aa7130 2024-09-19T08:16:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.627+0000 7ff276ffd640 1 --2- 172.21.15.27:0/1236589282 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c313aa7130 0x55c313aa9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.628+0000 7ff256ffd640 10 client.16224 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:16:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.628+0000 7ff276ffd640 1 --2- 172.21.15.27:0/1236589282 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c313aa7130 0x55c313aa9540 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cde3a951837709bd server_cookie=2cc24f2bdeaf17ee in_seq=0 out_seq=0 2024-09-19T08:16:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.628+0000 7ff256ffd640 1 -- 172.21.15.27:0/1236589282 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c313985d60 con 0x55c313aa7130 2024-09-19T08:16:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.628+0000 7ff256ffd640 10 client.16224 handle_command_reply: tid=0 2024-09-19T08:16:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.628+0000 7ff280459740 1 client.16224 shutdown 2024-09-19T08:16:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.628+0000 7ff280459740 1 -- 172.21.15.27:0/1236589282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a184a0 msgr2=0x55c313a29b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.628+0000 7ff280459740 1 --2- 172.21.15.27:0/1236589282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a184a0 0x55c313a29b70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff26802a9a0 tx=0x7ff268004d00 comp rx=0 tx=0).stop 2024-09-19T08:16:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.628+0000 7ff280459740 1 -- 172.21.15.27:0/1236589282 shutdown_connections 2024-09-19T08:16:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.628+0000 7ff280459740 1 --2- 172.21.15.27:0/1236589282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c313a23680 0x55c313aa5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.628+0000 7ff280459740 1 --2- 172.21.15.27:0/1236589282 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55c313aa7130 0x55c313aa9540 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.628+0000 7ff256ffd640 0 client.16224 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:16:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.628+0000 7ff280459740 1 --2- 172.21.15.27:0/1236589282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c313a18dc0 0x55c313a2a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.628+0000 7ff280459740 1 --2- 172.21.15.27:0/1236589282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c313a184a0 0x55c313a29b70 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.628+0000 7ff280459740 1 -- 172.21.15.27:0/1236589282 >> 172.21.15.27:0/1236589282 conn(0x55c313a14a30 msgr2=0x55c313a21b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.628+0000 7ff280459740 1 -- 172.21.15.27:0/1236589282 shutdown_connections 2024-09-19T08:16:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.628+0000 7ff280459740 1 -- 172.21.15.27:0/1236589282 wait complete. 2024-09-19T08:16:20.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.629+0000 7ff280459740 20 client.16224 trim_cache size 0 max 16384 2024-09-19T08:16:20.633 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:16:20.633 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:16:20.633 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:16:20.633 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:16:20.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.629+0000 7ff27e080640 1 -- 172.21.15.27:0/493550093 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff2600a33b0 msgr2=0x7ff2600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:20.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.629+0000 7ff27e080640 1 --2- 172.21.15.27:0/493550093 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff2600a33b0 0x7ff2600a5870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff268000c00 tx=0x7ff268005b50 comp rx=0 tx=0).stop 2024-09-19T08:16:20.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.629+0000 7ff27e080640 1 -- 172.21.15.27:0/493550093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff278102570 msgr2=0x7ff2780fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:20.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.629+0000 7ff27e080640 1 --2- 172.21.15.27:0/493550093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff278102570 0x7ff2780fd1c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00c890 tx=0x7ff26c00cd50 comp rx=0 tx=0).stop 2024-09-19T08:16:20.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.629+0000 7ff27e080640 1 -- 172.21.15.27:0/493550093 shutdown_connections 2024-09-19T08:16:20.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.629+0000 7ff27e080640 1 --2- 172.21.15.27:0/493550093 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff2600a33b0 0x7ff2600a5870 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.629+0000 7ff27e080640 1 --2- 172.21.15.27:0/493550093 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff278102ef0 0x7ff2780fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.629+0000 7ff27e080640 1 --2- 172.21.15.27:0/493550093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff278102570 0x7ff2780fd1c0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.629+0000 7ff27e080640 1 --2- 172.21.15.27:0/493550093 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff278100e20 0x7ff2780fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:20.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.629+0000 7ff27e080640 1 -- 172.21.15.27:0/493550093 >> 172.21.15.27:0/493550093 conn(0x7ff2780fc7d0 msgr2=0x7ff27806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:20.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.629+0000 7ff27e080640 1 -- 172.21.15.27:0/493550093 shutdown_connections 2024-09-19T08:16:20.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:20.629+0000 7ff27e080640 1 -- 172.21.15.27:0/493550093 wait complete. 2024-09-19T08:16:20.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:20 smithi027 ceph-mon[31209]: pgmap v162: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T08:16:20.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:20 smithi155 ceph-mon[35362]: pgmap v162: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T08:16:21.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:20 smithi203 ceph-mon[35198]: pgmap v162: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T08:16:21.438 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:16:21.438 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:16:21.699 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:16:22.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.329+0000 7f3887479640 1 -- 172.21.15.27:0/1792692066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38801027c0 msgr2=0x7f3880106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:22.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.329+0000 7f3887479640 1 --2- 172.21.15.27:0/1792692066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38801027c0 0x7f3880106810 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3870009900 tx=0x7f387002a410 comp rx=0 tx=0).stop 2024-09-19T08:16:22.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.329+0000 7f3887479640 1 -- 172.21.15.27:0/1792692066 shutdown_connections 2024-09-19T08:16:22.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.329+0000 7f3887479640 1 --2- 172.21.15.27:0/1792692066 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3880106f40 0x7f388010eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:22.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.329+0000 7f3887479640 1 --2- 172.21.15.27:0/1792692066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38801027c0 0x7f3880106810 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:22.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.329+0000 7f3887479640 1 --2- 172.21.15.27:0/1792692066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880101e10 0x7f38801021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:22.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.329+0000 7f3887479640 1 -- 172.21.15.27:0/1792692066 >> 172.21.15.27:0/1792692066 conn(0x7f38800fd8d0 msgr2=0x7f38800ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:22.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.330+0000 7f3887479640 1 -- 172.21.15.27:0/1792692066 shutdown_connections 2024-09-19T08:16:22.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.330+0000 7f3887479640 1 -- 172.21.15.27:0/1792692066 wait complete. 2024-09-19T08:16:22.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.330+0000 7f3887479640 1 Processor -- start 2024-09-19T08:16:22.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.330+0000 7f3887479640 1 -- start start 2024-09-19T08:16:22.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.331+0000 7f3887479640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880101e10 0x7f38800744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:22.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.331+0000 7f3887479640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38801027c0 0x7f3880074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:22.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.331+0000 7f3887479640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3880106f40 0x7f3880074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:22.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.331+0000 7f3887479640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3880111fa0 con 0x7f3880106f40 2024-09-19T08:16:22.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.331+0000 7f3887479640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3880111e20 con 0x7f3880101e10 2024-09-19T08:16:22.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.331+0000 7f3887479640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3880112120 con 0x7f38801027c0 2024-09-19T08:16:22.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.331+0000 7f3885a16640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3880106f40 0x7f3880074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:22.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.331+0000 7f3885a16640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3880106f40 0x7f3880074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40332/0 (socket says 172.21.15.27:40332) 2024-09-19T08:16:22.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.331+0000 7f3885a16640 1 -- 172.21.15.27:0/1224831372 learned_addr learned my addr 172.21.15.27:0/1224831372 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:22.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.331+0000 7f3885215640 1 --2- 172.21.15.27:0/1224831372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880101e10 0x7f38800744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:22.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.331+0000 7f3884a14640 1 --2- 172.21.15.27:0/1224831372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38801027c0 0x7f3880074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:22.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.331+0000 7f3885a16640 1 -- 172.21.15.27:0/1224831372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38801027c0 msgr2=0x7f3880074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:22.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.331+0000 7f3885a16640 1 --2- 172.21.15.27:0/1224831372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38801027c0 0x7f3880074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:22.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.331+0000 7f3885a16640 1 -- 172.21.15.27:0/1224831372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880101e10 msgr2=0x7f38800744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:22.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.331+0000 7f3885a16640 1 --2- 172.21.15.27:0/1224831372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880101e10 0x7f38800744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:22.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.331+0000 7f3885a16640 1 -- 172.21.15.27:0/1224831372 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38801a68c0 con 0x7f3880106f40 2024-09-19T08:16:22.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.331+0000 7f3885a16640 1 --2- 172.21.15.27:0/1224831372 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3880106f40 0x7f3880074f70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f387800cce0 tx=0x7f387800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:22.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.332+0000 7f38767fc640 1 -- 172.21.15.27:0/1224831372 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387800f450 con 0x7f3880106f40 2024-09-19T08:16:22.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.332+0000 7f38767fc640 1 -- 172.21.15.27:0/1224831372 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f387800fad0 con 0x7f3880106f40 2024-09-19T08:16:22.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.332+0000 7f3887479640 1 -- 172.21.15.27:0/1224831372 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38801a6bb0 con 0x7f3880106f40 2024-09-19T08:16:22.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.332+0000 7f38767fc640 1 -- 172.21.15.27:0/1224831372 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878018c10 con 0x7f3880106f40 2024-09-19T08:16:22.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.332+0000 7f3887479640 1 -- 172.21.15.27:0/1224831372 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38801a70f0 con 0x7f3880106f40 2024-09-19T08:16:22.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.333+0000 7f3887479640 1 -- 172.21.15.27:0/1224831372 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38801021f0 con 0x7f3880106f40 2024-09-19T08:16:22.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.334+0000 7f38767fc640 1 -- 172.21.15.27:0/1224831372 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f387800f5f0 con 0x7f3880106f40 2024-09-19T08:16:22.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.335+0000 7f38767fc640 1 --2- 172.21.15.27:0/1224831372 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f386c0a3430 0x7f386c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:22.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.335+0000 7f3885215640 1 --2- 172.21.15.27:0/1224831372 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f386c0a3430 0x7f386c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:22.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.335+0000 7f38767fc640 1 -- 172.21.15.27:0/1224831372 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f38780d0280 con 0x7f3880106f40 2024-09-19T08:16:22.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.335+0000 7f3885215640 1 --2- 172.21.15.27:0/1224831372 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f386c0a3430 0x7f386c0a58f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f387c00bbe0 tx=0x7f387c00b390 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:22.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.339+0000 7f38767fc640 1 -- 172.21.15.27:0/1224831372 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3878014030 con 0x7f3880106f40 2024-09-19T08:16:22.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.551+0000 7f3887479640 1 -- 172.21.15.27:0/1224831372 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f388010a180 con 0x7f3880106f40 2024-09-19T08:16:22.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.551+0000 7f38767fc640 1 -- 172.21.15.27:0/1224831372 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f387809ccb0 con 0x7f3880106f40 2024-09-19T08:16:22.551 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:16:22.551 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:16:22.552 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:16:22.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.553+0000 7f3887479640 1 -- 172.21.15.27:0/1224831372 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f386c0a3430 msgr2=0x7f386c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:22.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.553+0000 7f3887479640 1 --2- 172.21.15.27:0/1224831372 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f386c0a3430 0x7f386c0a58f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f387c00bbe0 tx=0x7f387c00b390 comp rx=0 tx=0).stop 2024-09-19T08:16:22.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.553+0000 7f3887479640 1 -- 172.21.15.27:0/1224831372 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3880106f40 msgr2=0x7f3880074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:22.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.553+0000 7f3887479640 1 --2- 172.21.15.27:0/1224831372 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3880106f40 0x7f3880074f70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f387800cce0 tx=0x7f387800a620 comp rx=0 tx=0).stop 2024-09-19T08:16:22.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.553+0000 7f3887479640 1 -- 172.21.15.27:0/1224831372 shutdown_connections 2024-09-19T08:16:22.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.553+0000 7f3887479640 1 --2- 172.21.15.27:0/1224831372 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f386c0a3430 0x7f386c0a58f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:22.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.553+0000 7f3887479640 1 --2- 172.21.15.27:0/1224831372 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3880106f40 0x7f3880074f70 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:22.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.553+0000 7f3887479640 1 --2- 172.21.15.27:0/1224831372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38801027c0 0x7f3880074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:22.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.553+0000 7f3887479640 1 --2- 172.21.15.27:0/1224831372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880101e10 0x7f38800744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:22.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.553+0000 7f3887479640 1 -- 172.21.15.27:0/1224831372 >> 172.21.15.27:0/1224831372 conn(0x7f38800fd8d0 msgr2=0x7f38800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:22.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.554+0000 7f3887479640 1 -- 172.21.15.27:0/1224831372 shutdown_connections 2024-09-19T08:16:22.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:22.554+0000 7f3887479640 1 -- 172.21.15.27:0/1224831372 wait complete. 2024-09-19T08:16:22.866 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:22 smithi027 ceph-mon[31209]: pgmap v163: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T08:16:22.867 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:22 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1224831372' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:16:22.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:22 smithi155 ceph-mon[35362]: pgmap v163: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T08:16:22.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:22 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1224831372' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:16:23.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:22 smithi203 ceph-mon[35198]: pgmap v163: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T08:16:23.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:22 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1224831372' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:16:23.293 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:16:23.558 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:16:24.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.079+0000 7ff73bf49640 1 -- 172.21.15.27:0/5225441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7341036c0 msgr2=0x7ff73410bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:24.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.079+0000 7ff73bf49640 1 --2- 172.21.15.27:0/5225441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7341036c0 0x7ff73410bbb0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff730009900 tx=0x7ff73002a480 comp rx=0 tx=0).stop 2024-09-19T08:16:24.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.079+0000 7ff73bf49640 1 -- 172.21.15.27:0/5225441 shutdown_connections 2024-09-19T08:16:24.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.079+0000 7ff73bf49640 1 --2- 172.21.15.27:0/5225441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff73410c180 0x7ff73410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.079+0000 7ff73bf49640 1 --2- 172.21.15.27:0/5225441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7341036c0 0x7ff73410bbb0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.079+0000 7ff73bf49640 1 --2- 172.21.15.27:0/5225441 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff734102da0 0x7ff734103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.079+0000 7ff73bf49640 1 -- 172.21.15.27:0/5225441 >> 172.21.15.27:0/5225441 conn(0x7ff7340fc7a0 msgr2=0x7ff7340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:24.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.079+0000 7ff73bf49640 1 -- 172.21.15.27:0/5225441 shutdown_connections 2024-09-19T08:16:24.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.079+0000 7ff73bf49640 1 -- 172.21.15.27:0/5225441 wait complete. 2024-09-19T08:16:24.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.080+0000 7ff73bf49640 1 Processor -- start 2024-09-19T08:16:24.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.080+0000 7ff73bf49640 1 -- start start 2024-09-19T08:16:24.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.080+0000 7ff73bf49640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff734102da0 0x7ff7341984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:24.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.080+0000 7ff73bf49640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7341036c0 0x7ff7341989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:24.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.080+0000 7ff73bf49640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff73410c180 0x7ff73419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:24.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.080+0000 7ff73bf49640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff734111fa0 con 0x7ff734102da0 2024-09-19T08:16:24.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.080+0000 7ff73bf49640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff734111e20 con 0x7ff73410c180 2024-09-19T08:16:24.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.080+0000 7ff73bf49640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff734112120 con 0x7ff7341036c0 2024-09-19T08:16:24.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.080+0000 7ff739ce5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff734102da0 0x7ff7341984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:24.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.080+0000 7ff739ce5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff734102da0 0x7ff7341984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40342/0 (socket says 172.21.15.27:40342) 2024-09-19T08:16:24.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.080+0000 7ff739ce5640 1 -- 172.21.15.27:0/542002394 learned_addr learned my addr 172.21.15.27:0/542002394 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:24.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.080+0000 7ff73a4e6640 1 --2- 172.21.15.27:0/542002394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff73410c180 0x7ff73419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:24.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.080+0000 7ff7394e4640 1 --2- 172.21.15.27:0/542002394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7341036c0 0x7ff7341989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:24.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.080+0000 7ff739ce5640 1 -- 172.21.15.27:0/542002394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7341036c0 msgr2=0x7ff7341989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:24.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.080+0000 7ff739ce5640 1 --2- 172.21.15.27:0/542002394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7341036c0 0x7ff7341989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.080+0000 7ff739ce5640 1 -- 172.21.15.27:0/542002394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff73410c180 msgr2=0x7ff73419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:24.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.080+0000 7ff739ce5640 1 --2- 172.21.15.27:0/542002394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff73410c180 0x7ff73419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.080+0000 7ff739ce5640 1 -- 172.21.15.27:0/542002394 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff73419d460 con 0x7ff734102da0 2024-09-19T08:16:24.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.080+0000 7ff7394e4640 1 --2- 172.21.15.27:0/542002394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7341036c0 0x7ff7341989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:16:24.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.080+0000 7ff73a4e6640 1 --2- 172.21.15.27:0/542002394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff73410c180 0x7ff73419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:16:24.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.081+0000 7ff739ce5640 1 --2- 172.21.15.27:0/542002394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff734102da0 0x7ff7341984b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff72400b4a0 tx=0x7ff72400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:24.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.081+0000 7ff72affd640 1 -- 172.21.15.27:0/542002394 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff724014070 con 0x7ff734102da0 2024-09-19T08:16:24.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.081+0000 7ff73bf49640 1 -- 172.21.15.27:0/542002394 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff73419d750 con 0x7ff734102da0 2024-09-19T08:16:24.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.081+0000 7ff72affd640 1 -- 172.21.15.27:0/542002394 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff724010af0 con 0x7ff734102da0 2024-09-19T08:16:24.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.081+0000 7ff72affd640 1 -- 172.21.15.27:0/542002394 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff724017d10 con 0x7ff734102da0 2024-09-19T08:16:24.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.081+0000 7ff73bf49640 1 -- 172.21.15.27:0/542002394 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7341a5030 con 0x7ff734102da0 2024-09-19T08:16:24.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.083+0000 7ff72affd640 1 -- 172.21.15.27:0/542002394 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff724017070 con 0x7ff734102da0 2024-09-19T08:16:24.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.083+0000 7ff73e322740 1 Processor -- start 2024-09-19T08:16:24.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.084+0000 7ff73e322740 1 -- start start 2024-09-19T08:16:24.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.084+0000 7ff73e322740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e79e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:24.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.084+0000 7ff73e322740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55682e79e5d0 0x55682e79ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:24.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.084+0000 7ff73e322740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e7a9370 0x55682e7ab760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:24.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.084+0000 7ff73e322740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55682e7042f0 con 0x55682e79fb40 2024-09-19T08:16:24.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.084+0000 7ff73e322740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55682e6abcf0 con 0x55682e7a9370 2024-09-19T08:16:24.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.084+0000 7ff73e322740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55682e7002b0 con 0x55682e79e5d0 2024-09-19T08:16:24.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.084+0000 7ff73a4e6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e79e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:24.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.084+0000 7ff73a4e6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e79e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40354/0 (socket says 172.21.15.27:40354) 2024-09-19T08:16:24.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.084+0000 7ff73a4e6640 1 -- 172.21.15.27:0/984007590 learned_addr learned my addr 172.21.15.27:0/984007590 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:24.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.084+0000 7ff72affd640 1 --2- 172.21.15.27:0/542002394 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff7200a33b0 0x7ff7200a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:24.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.084+0000 7ff739ce5640 1 --2- 172.21.15.27:0/984007590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55682e79e5d0 0x55682e79ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:24.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.084+0000 7ff7394e4640 1 --2- 172.21.15.27:0/984007590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e7a9370 0x55682e7ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:24.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.084+0000 7ff73a4e6640 1 --2- 172.21.15.27:0/542002394 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff7200a33b0 0x7ff7200a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:24.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.085+0000 7ff72affd640 1 -- 172.21.15.27:0/542002394 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff7240cf0a0 con 0x7ff734102da0 2024-09-19T08:16:24.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.085+0000 7ff73a4e6640 1 -- 172.21.15.27:0/984007590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55682e79e5d0 msgr2=0x55682e79ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:24.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.085+0000 7ff73a4e6640 1 --2- 172.21.15.27:0/984007590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55682e79e5d0 0x55682e79ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.085+0000 7ff73a4e6640 1 -- 172.21.15.27:0/984007590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e7a9370 msgr2=0x55682e7ab760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:24.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.085+0000 7ff73a4e6640 1 --2- 172.21.15.27:0/984007590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e7a9370 0x55682e7ab760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.085+0000 7ff73a4e6640 1 -- 172.21.15.27:0/984007590 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55682e6903a0 con 0x55682e79fb40 2024-09-19T08:16:24.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.085+0000 7ff73a4e6640 1 --2- 172.21.15.27:0/984007590 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e79e090 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff72c014a90 tx=0x7ff72c014f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339083c9db39bf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:24.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.085+0000 7ff71ffff640 1 -- 172.21.15.27:0/984007590 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c014530 con 0x55682e79fb40 2024-09-19T08:16:24.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.085+0000 7ff71ffff640 1 -- 172.21.15.27:0/984007590 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff72c023070 con 0x55682e79fb40 2024-09-19T08:16:24.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.085+0000 7ff71ffff640 1 -- 172.21.15.27:0/984007590 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c00cde0 con 0x55682e79fb40 2024-09-19T08:16:24.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.086+0000 7ff73e322740 1 -- 172.21.15.27:0/984007590 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 msgr2=0x55682e79e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:24.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.086+0000 7ff73e322740 1 --2- 172.21.15.27:0/984007590 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e79e090 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff72c014a90 tx=0x7ff72c014f50 comp rx=0 tx=0).stop 2024-09-19T08:16:24.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.086+0000 7ff73a4e6640 1 --2- 172.21.15.27:0/542002394 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff7200a33b0 0x7ff7200a5870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff72c022000 tx=0x7ff72c020000 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:24.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.086+0000 7ff73e322740 1 -- 172.21.15.27:0/984007590 shutdown_connections 2024-09-19T08:16:24.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.086+0000 7ff73e322740 1 --2- 172.21.15.27:0/984007590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e7a9370 0x55682e7ab760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.086+0000 7ff73e322740 1 --2- 172.21.15.27:0/984007590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55682e79e5d0 0x55682e79ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.086+0000 7ff73e322740 1 --2- 172.21.15.27:0/984007590 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e79e090 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.086+0000 7ff73e322740 1 -- 172.21.15.27:0/984007590 >> 172.21.15.27:0/984007590 conn(0x55682e767310 msgr2=0x55682e79ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:24.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.086+0000 7ff73e322740 1 -- 172.21.15.27:0/984007590 shutdown_connections 2024-09-19T08:16:24.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.086+0000 7ff73e322740 1 -- 172.21.15.27:0/984007590 wait complete. 2024-09-19T08:16:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.086+0000 7ff73e322740 1 -- start start 2024-09-19T08:16:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.086+0000 7ff73e322740 1 Processor -- start 2024-09-19T08:16:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.087+0000 7ff73e322740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55682e79e5d0 0x55682e7a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.087+0000 7ff73e322740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e7a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.087+0000 7ff73e322740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e7a9370 0x55682e7a6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.087+0000 7ff73e322740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55682e7ac070 con 0x55682e79fb40 2024-09-19T08:16:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.087+0000 7ff73e322740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55682e6bf060 con 0x55682e7a9370 2024-09-19T08:16:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.087+0000 7ff73e322740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55682e7ac1f0 con 0x55682e79e5d0 2024-09-19T08:16:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.087+0000 7ff73e322740 10 client.0 _ll_register_callbacks cb 0x55682e4128c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:16:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.087+0000 7ff7394e4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e7a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.087+0000 7ff7394e4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e7a5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40368/0 (socket says 172.21.15.27:40368) 2024-09-19T08:16:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.087+0000 7ff7394e4640 1 -- 172.21.15.27:0/2708919557 learned_addr learned my addr 172.21.15.27:0/2708919557 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.087+0000 7ff73a4e6640 1 --2- 172.21.15.27:0/2708919557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e7a9370 0x55682e7a6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.087+0000 7ff739ce5640 1 --2- 172.21.15.27:0/2708919557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55682e79e5d0 0x55682e7a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:24.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.087+0000 7ff7394e4640 1 -- 172.21.15.27:0/2708919557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55682e79e5d0 msgr2=0x55682e7a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:24.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.087+0000 7ff7394e4640 1 --2- 172.21.15.27:0/2708919557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55682e79e5d0 0x55682e7a8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.087+0000 7ff7394e4640 1 -- 172.21.15.27:0/2708919557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e7a9370 msgr2=0x55682e7a6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:24.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.087+0000 7ff7394e4640 1 --2- 172.21.15.27:0/2708919557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e7a9370 0x55682e7a6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.087+0000 7ff7394e4640 1 -- 172.21.15.27:0/2708919557 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55682e4753c0 con 0x55682e79fb40 2024-09-19T08:16:24.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.087+0000 7ff73a4e6640 1 --2- 172.21.15.27:0/2708919557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e7a9370 0x55682e7a6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:16:24.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.087+0000 7ff7394e4640 1 --2- 172.21.15.27:0/2708919557 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e7a5fd0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff730009900 tx=0x7ff7300317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34be779db6452713 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:24.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.087+0000 7ff71d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:16:24.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.088+0000 7ff71d7fa640 1 -- 172.21.15.27:0/2708919557 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730040070 con 0x55682e79fb40 2024-09-19T08:16:24.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.088+0000 7ff71d7fa640 1 -- 172.21.15.27:0/2708919557 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff730004250 con 0x55682e79fb40 2024-09-19T08:16:24.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.088+0000 7ff73e322740 1 -- 172.21.15.27:0/2708919557 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff72c023070 con 0x55682e79fb40 2024-09-19T08:16:24.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.088+0000 7ff71d7fa640 1 -- 172.21.15.27:0/2708919557 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff730035040 con 0x55682e79fb40 2024-09-19T08:16:24.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.088+0000 7ff73e322740 10 client.16242 fetch_fsmap learned FSMap version 20 2024-09-19T08:16:24.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.088+0000 7ff73e322740 1 -- 172.21.15.27:0/2708919557 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55682e7b7ac0 con 0x55682e79fb40 2024-09-19T08:16:24.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.088+0000 7ff71d7fa640 1 -- 172.21.15.27:0/2708919557 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff72c023070 con 0x55682e79fb40 2024-09-19T08:16:24.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.088+0000 7ff71d7fa640 1 -- 172.21.15.27:0/2708919557 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff7300049c0 con 0x55682e79fb40 2024-09-19T08:16:24.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.088+0000 7ff73e322740 10 client.16242 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:16:24.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.088+0000 7ff73e322740 10 client.16242 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:16:24.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.088+0000 7ff73e322740 20 client.16242 populate_metadata read hostname 'smithi027' 2024-09-19T08:16:24.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.088+0000 7ff73e322740 1 --2- 172.21.15.27:0/2708919557 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55682e7b8f20 0x55682e7bb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:24.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.088+0000 7ff73e322740 4 client.16242 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:16:24.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.088+0000 7ff73e322740 1 -- 172.21.15.27:0/2708919557 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55682e711860 con 0x55682e7b8f20 2024-09-19T08:16:24.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.089+0000 7ff739ce5640 1 --2- 172.21.15.27:0/2708919557 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55682e7b8f20 0x55682e7bb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:24.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.089+0000 7ff739ce5640 1 --2- 172.21.15.27:0/2708919557 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55682e7b8f20 0x55682e7bb360 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cec68204d9ed8909 server_cookie=d8e44ebe864dad88 in_seq=0 out_seq=0 2024-09-19T08:16:24.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.089+0000 7ff71d7fa640 10 client.16242 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:16:24.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.090+0000 7ff71d7fa640 1 -- 172.21.15.27:0/2708919557 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55682e711860 con 0x55682e7b8f20 2024-09-19T08:16:24.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.090+0000 7ff71d7fa640 10 client.16242 handle_command_reply: tid=0 2024-09-19T08:16:24.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.090+0000 7ff73e322740 1 client.16242 shutdown 2024-09-19T08:16:24.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.090+0000 7ff73e322740 1 -- 172.21.15.27:0/2708919557 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 msgr2=0x55682e7a5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:24.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.090+0000 7ff73e322740 1 --2- 172.21.15.27:0/2708919557 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e7a5fd0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff730009900 tx=0x7ff7300317e0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.090+0000 7ff73e322740 1 -- 172.21.15.27:0/2708919557 shutdown_connections 2024-09-19T08:16:24.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.090+0000 7ff73e322740 1 --2- 172.21.15.27:0/2708919557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e7a9370 0x55682e7a6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.090+0000 7ff73e322740 1 --2- 172.21.15.27:0/2708919557 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e7a5fd0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.090+0000 7ff73e322740 1 --2- 172.21.15.27:0/2708919557 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55682e7b8f20 0x55682e7bb360 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.090+0000 7ff73e322740 1 --2- 172.21.15.27:0/2708919557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55682e79e5d0 0x55682e7a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.090+0000 7ff73e322740 1 -- 172.21.15.27:0/2708919557 >> 172.21.15.27:0/2708919557 conn(0x55682e767310 msgr2=0x55682e7a0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:24.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.090+0000 7ff71d7fa640 0 client.16242 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:16:24.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.090+0000 7ff73e322740 1 -- 172.21.15.27:0/2708919557 shutdown_connections 2024-09-19T08:16:24.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.090+0000 7ff73e322740 1 -- 172.21.15.27:0/2708919557 wait complete. 2024-09-19T08:16:24.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.090+0000 7ff73e322740 20 client.16242 trim_cache size 0 max 16384 2024-09-19T08:16:24.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.103+0000 7ff73e322740 1 Processor -- start 2024-09-19T08:16:24.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.103+0000 7ff73e322740 1 -- start start 2024-09-19T08:16:24.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.103+0000 7ff73e322740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e79e5d0 0x55682e7b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:24.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.104+0000 7ff73e322740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e7a5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:24.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.104+0000 7ff73e322740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55682e7a9370 0x55682e795ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:24.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.104+0000 7ff73e322740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341ab8f0 con 0x55682e79fb40 2024-09-19T08:16:24.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.104+0000 7ff73e322740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341ae170 con 0x55682e79e5d0 2024-09-19T08:16:24.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.104+0000 7ff73e322740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341abf60 con 0x55682e7a9370 2024-09-19T08:16:24.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.104+0000 7ff7394e4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e7a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:24.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.104+0000 7ff7394e4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e7a5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40370/0 (socket says 172.21.15.27:40370) 2024-09-19T08:16:24.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.104+0000 7ff7394e4640 1 -- 172.21.15.27:0/860272743 learned_addr learned my addr 172.21.15.27:0/860272743 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:24.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.104+0000 7ff73a4e6640 1 --2- 172.21.15.27:0/860272743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55682e7a9370 0x55682e795ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:24.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.104+0000 7ff7394e4640 1 -- 172.21.15.27:0/860272743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55682e7a9370 msgr2=0x55682e795ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:24.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.104+0000 7ff7394e4640 1 --2- 172.21.15.27:0/860272743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55682e7a9370 0x55682e795ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.104+0000 7ff739ce5640 1 --2- 172.21.15.27:0/860272743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e79e5d0 0x55682e7b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:24.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.104+0000 7ff7394e4640 1 -- 172.21.15.27:0/860272743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e79e5d0 msgr2=0x55682e7b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:24.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.104+0000 7ff7394e4640 1 --2- 172.21.15.27:0/860272743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e79e5d0 0x55682e7b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.104+0000 7ff7394e4640 1 -- 172.21.15.27:0/860272743 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55682e79b960 con 0x55682e79fb40 2024-09-19T08:16:24.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.104+0000 7ff739ce5640 1 --2- 172.21.15.27:0/860272743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e79e5d0 0x55682e7b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:16:24.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.104+0000 7ff7394e4640 1 --2- 172.21.15.27:0/860272743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e7a5890 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff730006010 tx=0x7ff73002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f1577063855252 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:24.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.104+0000 7ff71f7fe640 1 -- 172.21.15.27:0/860272743 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730040070 con 0x55682e79fb40 2024-09-19T08:16:24.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.104+0000 7ff71f7fe640 1 -- 172.21.15.27:0/860272743 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff730009520 con 0x55682e79fb40 2024-09-19T08:16:24.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.104+0000 7ff71f7fe640 1 -- 172.21.15.27:0/860272743 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730003bf0 con 0x55682e79fb40 2024-09-19T08:16:24.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.105+0000 7ff73e322740 1 -- 172.21.15.27:0/860272743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 msgr2=0x55682e7a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:24.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.105+0000 7ff73e322740 1 --2- 172.21.15.27:0/860272743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e7a5890 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff730006010 tx=0x7ff73002a480 comp rx=0 tx=0).stop 2024-09-19T08:16:24.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.105+0000 7ff73e322740 1 -- 172.21.15.27:0/860272743 shutdown_connections 2024-09-19T08:16:24.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.105+0000 7ff73e322740 1 --2- 172.21.15.27:0/860272743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55682e7a9370 0x55682e795ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.105+0000 7ff73e322740 1 --2- 172.21.15.27:0/860272743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e7a5890 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.105+0000 7ff73e322740 1 --2- 172.21.15.27:0/860272743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e79e5d0 0x55682e7b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.105+0000 7ff73e322740 1 -- 172.21.15.27:0/860272743 >> 172.21.15.27:0/860272743 conn(0x55682e767310 msgr2=0x55682e7a50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:24.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.105+0000 7ff73e322740 1 -- 172.21.15.27:0/860272743 shutdown_connections 2024-09-19T08:16:24.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.105+0000 7ff73e322740 1 -- 172.21.15.27:0/860272743 wait complete. 2024-09-19T08:16:24.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.105+0000 7ff73e322740 1 -- start start 2024-09-19T08:16:24.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.105+0000 7ff73e322740 1 Processor -- start 2024-09-19T08:16:24.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.106+0000 7ff73e322740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55682e79e5d0 0x55682e7aca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:24.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.106+0000 7ff73e322740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e7acf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:24.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.106+0000 7ff73e322740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e7a9370 0x55682e821bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:24.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.106+0000 7ff73e322740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341ac630 con 0x55682e79fb40 2024-09-19T08:16:24.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.106+0000 7ff73e322740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341adaa0 con 0x55682e7a9370 2024-09-19T08:16:24.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.106+0000 7ff73e322740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341acd00 con 0x55682e79e5d0 2024-09-19T08:16:24.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.106+0000 7ff73e322740 10 client.0 _ll_register_callbacks cb 0x7ff730005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:16:24.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.106+0000 7ff7394e4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e7acf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:24.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.106+0000 7ff7394e4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e7acf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40378/0 (socket says 172.21.15.27:40378) 2024-09-19T08:16:24.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.106+0000 7ff7394e4640 1 -- 172.21.15.27:0/2946548155 learned_addr learned my addr 172.21.15.27:0/2946548155 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:24.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.106+0000 7ff739ce5640 1 --2- 172.21.15.27:0/2946548155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55682e79e5d0 0x55682e7aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:24.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.106+0000 7ff73a4e6640 1 --2- 172.21.15.27:0/2946548155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e7a9370 0x55682e821bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:24.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.106+0000 7ff7394e4640 1 -- 172.21.15.27:0/2946548155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55682e79e5d0 msgr2=0x55682e7aca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:24.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.106+0000 7ff7394e4640 1 --2- 172.21.15.27:0/2946548155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55682e79e5d0 0x55682e7aca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.106+0000 7ff7394e4640 1 -- 172.21.15.27:0/2946548155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e7a9370 msgr2=0x55682e821bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:24.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.106+0000 7ff7394e4640 1 --2- 172.21.15.27:0/2946548155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e7a9370 0x55682e821bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.106+0000 7ff7394e4640 1 -- 172.21.15.27:0/2946548155 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55682e8221b0 con 0x55682e79fb40 2024-09-19T08:16:24.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.107+0000 7ff7394e4640 1 --2- 172.21.15.27:0/2946548155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e7acf40 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7ff730009900 tx=0x7ff7300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b062d21f91d0c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:24.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.107+0000 7ff71d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:16:24.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.107+0000 7ff71d7fa640 1 -- 172.21.15.27:0/2946548155 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730040070 con 0x55682e79fb40 2024-09-19T08:16:24.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.107+0000 7ff71d7fa640 1 -- 172.21.15.27:0/2946548155 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff7300053c0 con 0x55682e79fb40 2024-09-19T08:16:24.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.107+0000 7ff73e322740 1 -- 172.21.15.27:0/2946548155 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff730009520 con 0x55682e79fb40 2024-09-19T08:16:24.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.107+0000 7ff71d7fa640 1 -- 172.21.15.27:0/2946548155 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff730065020 con 0x55682e79fb40 2024-09-19T08:16:24.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.107+0000 7ff73e322740 10 client.16248 fetch_fsmap learned FSMap version 20 2024-09-19T08:16:24.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.107+0000 7ff73e322740 1 -- 172.21.15.27:0/2946548155 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55682e823400 con 0x55682e79fb40 2024-09-19T08:16:24.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.107+0000 7ff71d7fa640 1 -- 172.21.15.27:0/2946548155 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff730009520 con 0x55682e79fb40 2024-09-19T08:16:24.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.107+0000 7ff71d7fa640 1 -- 172.21.15.27:0/2946548155 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff73004e5a0 con 0x55682e79fb40 2024-09-19T08:16:24.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.107+0000 7ff73e322740 10 client.16248 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:16:24.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.107+0000 7ff73e322740 10 client.16248 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:16:24.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.107+0000 7ff73e322740 20 client.16248 populate_metadata read hostname 'smithi027' 2024-09-19T08:16:24.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.107+0000 7ff73e322740 1 --2- 172.21.15.27:0/2946548155 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55682e823a10 0x55682e825e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:24.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.107+0000 7ff73e322740 4 client.16248 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:16:24.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.107+0000 7ff73e322740 1 -- 172.21.15.27:0/2946548155 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55682e70bd70 con 0x55682e823a10 2024-09-19T08:16:24.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.108+0000 7ff739ce5640 1 --2- 172.21.15.27:0/2946548155 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55682e823a10 0x55682e825e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:24.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.108+0000 7ff739ce5640 1 --2- 172.21.15.27:0/2946548155 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55682e823a10 0x55682e825e00 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77068b06410a45b7 server_cookie=401514144f5f521c in_seq=0 out_seq=0 2024-09-19T08:16:24.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.108+0000 7ff71d7fa640 10 client.16248 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:16:24.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.108+0000 7ff71d7fa640 1 -- 172.21.15.27:0/2946548155 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55682e70bd70 con 0x55682e823a10 2024-09-19T08:16:24.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.108+0000 7ff71d7fa640 10 client.16248 handle_command_reply: tid=0 2024-09-19T08:16:24.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.108+0000 7ff73e322740 1 client.16248 shutdown 2024-09-19T08:16:24.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.108+0000 7ff73e322740 1 -- 172.21.15.27:0/2946548155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 msgr2=0x55682e7acf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:24.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.108+0000 7ff73e322740 1 --2- 172.21.15.27:0/2946548155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e7acf40 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7ff730009900 tx=0x7ff7300048f0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.108+0000 7ff73e322740 1 -- 172.21.15.27:0/2946548155 shutdown_connections 2024-09-19T08:16:24.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.108+0000 7ff73e322740 1 --2- 172.21.15.27:0/2946548155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55682e7a9370 0x55682e821bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.108+0000 7ff73e322740 1 --2- 172.21.15.27:0/2946548155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55682e79fb40 0x55682e7acf40 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.109+0000 7ff73e322740 1 --2- 172.21.15.27:0/2946548155 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55682e823a10 0x55682e825e00 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.109+0000 7ff73e322740 1 --2- 172.21.15.27:0/2946548155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55682e79e5d0 0x55682e7aca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.109+0000 7ff71d7fa640 0 client.16248 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:16:24.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.109+0000 7ff73e322740 1 -- 172.21.15.27:0/2946548155 >> 172.21.15.27:0/2946548155 conn(0x55682e767310 msgr2=0x55682e7a8050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:24.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.109+0000 7ff73e322740 1 -- 172.21.15.27:0/2946548155 shutdown_connections 2024-09-19T08:16:24.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.109+0000 7ff73e322740 1 -- 172.21.15.27:0/2946548155 wait complete. 2024-09-19T08:16:24.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.109+0000 7ff73e322740 20 client.16248 trim_cache size 0 max 16384 2024-09-19T08:16:24.114 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:16:24.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.109+0000 7ff73bf49640 1 -- 172.21.15.27:0/542002394 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff7200a33b0 msgr2=0x7ff7200a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:24.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.109+0000 7ff73bf49640 1 --2- 172.21.15.27:0/542002394 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff7200a33b0 0x7ff7200a5870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff72c022000 tx=0x7ff72c020000 comp rx=0 tx=0).stop 2024-09-19T08:16:24.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.109+0000 7ff73bf49640 1 -- 172.21.15.27:0/542002394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff734102da0 msgr2=0x7ff7341984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:24.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.109+0000 7ff73bf49640 1 --2- 172.21.15.27:0/542002394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff734102da0 0x7ff7341984b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff72400b4a0 tx=0x7ff72400b960 comp rx=0 tx=0).stop 2024-09-19T08:16:24.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.109+0000 7ff73bf49640 1 -- 172.21.15.27:0/542002394 shutdown_connections 2024-09-19T08:16:24.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.109+0000 7ff73bf49640 1 --2- 172.21.15.27:0/542002394 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7ff7200a33b0 0x7ff7200a5870 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.109+0000 7ff73bf49640 1 --2- 172.21.15.27:0/542002394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff73410c180 0x7ff73419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.109+0000 7ff73bf49640 1 --2- 172.21.15.27:0/542002394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7341036c0 0x7ff7341989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.109+0000 7ff73bf49640 1 --2- 172.21.15.27:0/542002394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff734102da0 0x7ff7341984b0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:24.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.109+0000 7ff73bf49640 1 -- 172.21.15.27:0/542002394 >> 172.21.15.27:0/542002394 conn(0x7ff7340fc7a0 msgr2=0x7ff7340fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:24.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.110+0000 7ff73bf49640 1 -- 172.21.15.27:0/542002394 shutdown_connections 2024-09-19T08:16:24.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:24.110+0000 7ff73bf49640 1 -- 172.21.15.27:0/542002394 wait complete. 2024-09-19T08:16:24.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:24 smithi155 ceph-mon[35362]: pgmap v164: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T08:16:25.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:24 smithi027 ceph-mon[31209]: pgmap v164: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T08:16:25.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:24 smithi203 ceph-mon[35198]: pgmap v164: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T08:16:25.907 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:16:25.907 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:16:26.178 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:16:26.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.687+0000 7faf3e48c640 1 -- 172.21.15.27:0/2538534443 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf3810c170 msgr2=0x7faf3810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:26.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.687+0000 7faf3e48c640 1 --2- 172.21.15.27:0/2538534443 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf3810c170 0x7faf3810e610 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7faf30009ca0 tx=0x7faf3002a950 comp rx=0 tx=0).stop 2024-09-19T08:16:26.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.687+0000 7faf3e48c640 1 -- 172.21.15.27:0/2538534443 shutdown_connections 2024-09-19T08:16:26.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.687+0000 7faf3e48c640 1 --2- 172.21.15.27:0/2538534443 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf3810c170 0x7faf3810e610 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.687+0000 7faf3e48c640 1 --2- 172.21.15.27:0/2538534443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf38103660 0x7faf3810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.687+0000 7faf3e48c640 1 --2- 172.21.15.27:0/2538534443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf38102d40 0x7faf38103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.687+0000 7faf3e48c640 1 -- 172.21.15.27:0/2538534443 >> 172.21.15.27:0/2538534443 conn(0x7faf380fc7a0 msgr2=0x7faf380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:26.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.687+0000 7faf3e48c640 1 -- 172.21.15.27:0/2538534443 shutdown_connections 2024-09-19T08:16:26.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.687+0000 7faf3e48c640 1 -- 172.21.15.27:0/2538534443 wait complete. 2024-09-19T08:16:26.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.688+0000 7faf3e48c640 1 Processor -- start 2024-09-19T08:16:26.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.688+0000 7faf3e48c640 1 -- start start 2024-09-19T08:16:26.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.688+0000 7faf3e48c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf38102d40 0x7faf38198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:26.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.688+0000 7faf3e48c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf38103660 0x7faf38198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:26.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.688+0000 7faf3e48c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf3810c170 0x7faf3819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:26.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.688+0000 7faf3e48c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7faf38111f70 con 0x7faf38103660 2024-09-19T08:16:26.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.688+0000 7faf3e48c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faf38111df0 con 0x7faf3810c170 2024-09-19T08:16:26.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.688+0000 7faf3e48c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faf381120f0 con 0x7faf38102d40 2024-09-19T08:16:26.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.688+0000 7faf377fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf38103660 0x7faf38198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:26.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.689+0000 7faf377fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf38103660 0x7faf38198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40390/0 (socket says 172.21.15.27:40390) 2024-09-19T08:16:26.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.689+0000 7faf377fe640 1 -- 172.21.15.27:0/2946614669 learned_addr learned my addr 172.21.15.27:0/2946614669 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:26.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.689+0000 7faf37fff640 1 --2- 172.21.15.27:0/2946614669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf38102d40 0x7faf38198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:26.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.689+0000 7faf377fe640 1 -- 172.21.15.27:0/2946614669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf38102d40 msgr2=0x7faf38198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:26.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.689+0000 7faf377fe640 1 --2- 172.21.15.27:0/2946614669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf38102d40 0x7faf38198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.689+0000 7faf3ca29640 1 --2- 172.21.15.27:0/2946614669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf3810c170 0x7faf3819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:26.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.689+0000 7faf377fe640 1 -- 172.21.15.27:0/2946614669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf3810c170 msgr2=0x7faf3819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:26.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.689+0000 7faf377fe640 1 --2- 172.21.15.27:0/2946614669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf3810c170 0x7faf3819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.689+0000 7faf377fe640 1 -- 172.21.15.27:0/2946614669 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3819d3c0 con 0x7faf38103660 2024-09-19T08:16:26.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.689+0000 7faf3ca29640 1 --2- 172.21.15.27:0/2946614669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf3810c170 0x7faf3819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:16:26.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.689+0000 7faf377fe640 1 --2- 172.21.15.27:0/2946614669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf38103660 0x7faf38198950 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00c940 tx=0x7faf2c00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:26.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.689+0000 7faf357fa640 1 -- 172.21.15.27:0/2946614669 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c004220 con 0x7faf38103660 2024-09-19T08:16:26.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.689+0000 7faf357fa640 1 -- 172.21.15.27:0/2946614669 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf2c0043c0 con 0x7faf38103660 2024-09-19T08:16:26.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.689+0000 7faf3e48c640 1 -- 172.21.15.27:0/2946614669 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf3819d6b0 con 0x7faf38103660 2024-09-19T08:16:26.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.689+0000 7faf357fa640 1 -- 172.21.15.27:0/2946614669 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c004a00 con 0x7faf38103660 2024-09-19T08:16:26.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.689+0000 7faf3e48c640 1 -- 172.21.15.27:0/2946614669 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf381a4f90 con 0x7faf38103660 2024-09-19T08:16:26.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.691+0000 7faf357fa640 1 -- 172.21.15.27:0/2946614669 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7faf2c0079b0 con 0x7faf38103660 2024-09-19T08:16:26.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.692+0000 7faf40865740 1 Processor -- start 2024-09-19T08:16:26.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.692+0000 7faf40865740 1 -- start start 2024-09-19T08:16:26.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.692+0000 7faf40865740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561468483a40 0x561468483e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:26.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.692+0000 7faf40865740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561468484360 0x561468492c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:26.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.692+0000 7faf40865740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468493150 0x561468495540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:26.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.692+0000 7faf40865740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5614683e9280 con 0x561468493150 2024-09-19T08:16:26.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.692+0000 7faf40865740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x561468390b10 con 0x561468484360 2024-09-19T08:16:26.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.692+0000 7faf40865740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5614683e5240 con 0x561468483a40 2024-09-19T08:16:26.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.692+0000 7faf357fa640 1 --2- 172.21.15.27:0/2946614669 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7faf200a33b0 0x7faf200a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:26.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.692+0000 7faf377fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468493150 0x561468495540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:26.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.692+0000 7faf377fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468493150 0x561468495540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40398/0 (socket says 172.21.15.27:40398) 2024-09-19T08:16:26.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.692+0000 7faf377fe640 1 -- 172.21.15.27:0/3507818712 learned_addr learned my addr 172.21.15.27:0/3507818712 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:26.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.692+0000 7faf3ca29640 1 --2- 172.21.15.27:0/2946614669 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7faf200a33b0 0x7faf200a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:26.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.692+0000 7faf357fa640 1 -- 172.21.15.27:0/2946614669 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7faf2c0cfcd0 con 0x7faf38103660 2024-09-19T08:16:26.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.692+0000 7faf3ca29640 1 --2- 172.21.15.27:0/3507818712 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561468483a40 0x561468483e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:26.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.692+0000 7faf37fff640 1 --2- 172.21.15.27:0/3507818712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561468484360 0x561468492c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:26.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.693+0000 7faf377fe640 1 -- 172.21.15.27:0/3507818712 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561468483a40 msgr2=0x561468483e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:26.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.693+0000 7faf377fe640 1 --2- 172.21.15.27:0/3507818712 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561468483a40 0x561468483e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.693+0000 7faf377fe640 1 -- 172.21.15.27:0/3507818712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561468484360 msgr2=0x561468492c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.693+0000 7faf377fe640 1 --2- 172.21.15.27:0/3507818712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561468484360 0x561468492c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.693+0000 7faf377fe640 1 -- 172.21.15.27:0/3507818712 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56146839d1f0 con 0x561468493150 2024-09-19T08:16:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.693+0000 7faf377fe640 1 --2- 172.21.15.27:0/3507818712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468493150 0x561468495540 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0a4740 tx=0x7faf2c06ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f49a090d8745750 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.693+0000 7faf3ca29640 1 --2- 172.21.15.27:0/2946614669 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7faf200a33b0 0x7faf200a5870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faf3002fd90 tx=0x7faf30004a40 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.693+0000 7faf1e7fc640 1 -- 172.21.15.27:0/3507818712 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c01d040 con 0x561468493150 2024-09-19T08:16:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.693+0000 7faf1e7fc640 1 -- 172.21.15.27:0/3507818712 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf2c09c700 con 0x561468493150 2024-09-19T08:16:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.693+0000 7faf1e7fc640 1 -- 172.21.15.27:0/3507818712 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0cd6f0 con 0x561468493150 2024-09-19T08:16:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.694+0000 7faf40865740 1 -- 172.21.15.27:0/3507818712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468493150 msgr2=0x561468495540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.694+0000 7faf40865740 1 --2- 172.21.15.27:0/3507818712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468493150 0x561468495540 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0a4740 tx=0x7faf2c06ee30 comp rx=0 tx=0).stop 2024-09-19T08:16:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.694+0000 7faf40865740 1 -- 172.21.15.27:0/3507818712 shutdown_connections 2024-09-19T08:16:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.694+0000 7faf40865740 1 --2- 172.21.15.27:0/3507818712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468493150 0x561468495540 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.694+0000 7faf40865740 1 --2- 172.21.15.27:0/3507818712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561468484360 0x561468492c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.694+0000 7faf40865740 1 --2- 172.21.15.27:0/3507818712 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561468483a40 0x561468483e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.694+0000 7faf40865740 1 -- 172.21.15.27:0/3507818712 >> 172.21.15.27:0/3507818712 conn(0x5614684800f0 msgr2=0x5614684804d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:26.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.694+0000 7faf40865740 1 -- 172.21.15.27:0/3507818712 shutdown_connections 2024-09-19T08:16:26.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.694+0000 7faf40865740 1 -- 172.21.15.27:0/3507818712 wait complete. 2024-09-19T08:16:26.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.694+0000 7faf40865740 1 -- start start 2024-09-19T08:16:26.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.695+0000 7faf40865740 1 Processor -- start 2024-09-19T08:16:26.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.695+0000 7faf40865740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468483a40 0x5614684900c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:26.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.695+0000 7faf40865740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561468484360 0x561468490600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:26.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.695+0000 7faf40865740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561468493150 0x561468490b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:26.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.695+0000 7faf40865740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x561468495d20 con 0x561468483a40 2024-09-19T08:16:26.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.695+0000 7faf40865740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5614683a3f10 con 0x561468484360 2024-09-19T08:16:26.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.695+0000 7faf40865740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561468495ea0 con 0x561468493150 2024-09-19T08:16:26.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.695+0000 7faf40865740 10 client.0 _ll_register_callbacks cb 0x56146836ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:16:26.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.695+0000 7faf37fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468483a40 0x5614684900c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:26.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.695+0000 7faf37fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468483a40 0x5614684900c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40402/0 (socket says 172.21.15.27:40402) 2024-09-19T08:16:26.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.695+0000 7faf37fff640 1 -- 172.21.15.27:0/2950148111 learned_addr learned my addr 172.21.15.27:0/2950148111 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:26.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.695+0000 7faf3ca29640 1 --2- 172.21.15.27:0/2950148111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561468493150 0x561468490b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:26.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.695+0000 7faf377fe640 1 --2- 172.21.15.27:0/2950148111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561468484360 0x561468490600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:26.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.695+0000 7faf37fff640 1 -- 172.21.15.27:0/2950148111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561468493150 msgr2=0x561468490b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:26.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.695+0000 7faf37fff640 1 --2- 172.21.15.27:0/2950148111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561468493150 0x561468490b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.695+0000 7faf37fff640 1 -- 172.21.15.27:0/2950148111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561468484360 msgr2=0x561468490600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:26.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.695+0000 7faf37fff640 1 --2- 172.21.15.27:0/2950148111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561468484360 0x561468490600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.695+0000 7faf37fff640 1 -- 172.21.15.27:0/2950148111 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56146815a6a0 con 0x561468483a40 2024-09-19T08:16:26.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.695+0000 7faf37fff640 1 --2- 172.21.15.27:0/2950148111 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468483a40 0x5614684900c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7faf28011830 tx=0x7faf28011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6392b048da2e4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:26.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.695+0000 7faf177fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:16:26.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.696+0000 7faf177fe640 1 -- 172.21.15.27:0/2950148111 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2801e060 con 0x561468483a40 2024-09-19T08:16:26.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.696+0000 7faf177fe640 1 -- 172.21.15.27:0/2950148111 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7faf2800fdb0 con 0x561468483a40 2024-09-19T08:16:26.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.696+0000 7faf40865740 1 -- 172.21.15.27:0/2950148111 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf2c09c700 con 0x561468483a40 2024-09-19T08:16:26.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.696+0000 7faf177fe640 1 -- 172.21.15.27:0/2950148111 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7faf28023460 con 0x561468483a40 2024-09-19T08:16:26.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.696+0000 7faf40865740 10 client.16260 fetch_fsmap learned FSMap version 20 2024-09-19T08:16:26.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.696+0000 7faf40865740 1 -- 172.21.15.27:0/2950148111 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5614684a1a50 con 0x561468483a40 2024-09-19T08:16:26.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.696+0000 7faf177fe640 1 -- 172.21.15.27:0/2950148111 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf2c09c700 con 0x561468483a40 2024-09-19T08:16:26.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.696+0000 7faf177fe640 1 -- 172.21.15.27:0/2950148111 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7faf28018030 con 0x561468483a40 2024-09-19T08:16:26.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.696+0000 7faf40865740 10 client.16260 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:16:26.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.696+0000 7faf40865740 10 client.16260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:16:26.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.696+0000 7faf40865740 20 client.16260 populate_metadata read hostname 'smithi027' 2024-09-19T08:16:26.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.696+0000 7faf40865740 1 --2- 172.21.15.27:0/2950148111 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5614684a2f10 0x5614684a5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:26.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.696+0000 7faf40865740 4 client.16260 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:16:26.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.696+0000 7faf40865740 1 -- 172.21.15.27:0/2950148111 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614683f67f0 con 0x5614684a2f10 2024-09-19T08:16:26.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.696+0000 7faf377fe640 1 --2- 172.21.15.27:0/2950148111 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5614684a2f10 0x5614684a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:26.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.697+0000 7faf177fe640 10 client.16260 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:16:26.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.697+0000 7faf377fe640 1 --2- 172.21.15.27:0/2950148111 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5614684a2f10 0x5614684a5380 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ab2d26d1960f452 server_cookie=4782925ffca6bfb3 in_seq=0 out_seq=0 2024-09-19T08:16:26.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.698+0000 7faf177fe640 1 -- 172.21.15.27:0/2950148111 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5614683f67f0 con 0x5614684a2f10 2024-09-19T08:16:26.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.698+0000 7faf177fe640 10 client.16260 handle_command_reply: tid=0 2024-09-19T08:16:26.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.698+0000 7faf40865740 1 client.16260 shutdown 2024-09-19T08:16:26.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.698+0000 7faf40865740 1 -- 172.21.15.27:0/2950148111 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468483a40 msgr2=0x5614684900c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:26.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.698+0000 7faf40865740 1 --2- 172.21.15.27:0/2950148111 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468483a40 0x5614684900c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7faf28011830 tx=0x7faf28011cf0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.698+0000 7faf40865740 1 -- 172.21.15.27:0/2950148111 shutdown_connections 2024-09-19T08:16:26.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.698+0000 7faf40865740 1 --2- 172.21.15.27:0/2950148111 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5614684a2f10 0x5614684a5380 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.698+0000 7faf40865740 1 --2- 172.21.15.27:0/2950148111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561468493150 0x561468490b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.698+0000 7faf40865740 1 --2- 172.21.15.27:0/2950148111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561468484360 0x561468490600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.698+0000 7faf40865740 1 --2- 172.21.15.27:0/2950148111 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468483a40 0x5614684900c0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.698+0000 7faf177fe640 0 client.16260 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:16:26.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.698+0000 7faf40865740 1 -- 172.21.15.27:0/2950148111 >> 172.21.15.27:0/2950148111 conn(0x5614684800f0 msgr2=0x561468485e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:26.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.698+0000 7faf40865740 1 -- 172.21.15.27:0/2950148111 shutdown_connections 2024-09-19T08:16:26.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.698+0000 7faf40865740 1 -- 172.21.15.27:0/2950148111 wait complete. 2024-09-19T08:16:26.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.698+0000 7faf40865740 20 client.16260 trim_cache size 0 max 16384 2024-09-19T08:16:26.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.716+0000 7faf40865740 1 Processor -- start 2024-09-19T08:16:26.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.716+0000 7faf40865740 1 -- start start 2024-09-19T08:16:26.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.716+0000 7faf40865740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468483a40 0x56146847f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:26.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.716+0000 7faf40865740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561468484360 0x5614684aac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:26.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.716+0000 7faf40865740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561468493150 0x5614684ab190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:26.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.716+0000 7faf40865740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7faf381a9580 con 0x561468483a40 2024-09-19T08:16:26.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.716+0000 7faf40865740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faf381abe00 con 0x561468493150 2024-09-19T08:16:26.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.716+0000 7faf40865740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faf381a9bf0 con 0x561468484360 2024-09-19T08:16:26.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.716+0000 7faf37fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468483a40 0x56146847f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:26.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.716+0000 7faf37fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468483a40 0x56146847f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40414/0 (socket says 172.21.15.27:40414) 2024-09-19T08:16:26.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.716+0000 7faf37fff640 1 -- 172.21.15.27:0/1435394581 learned_addr learned my addr 172.21.15.27:0/1435394581 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:26.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.716+0000 7faf377fe640 1 --2- 172.21.15.27:0/1435394581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561468484360 0x5614684aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:26.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.716+0000 7faf37fff640 1 -- 172.21.15.27:0/1435394581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561468484360 msgr2=0x5614684aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:26.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.716+0000 7faf37fff640 1 --2- 172.21.15.27:0/1435394581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561468484360 0x5614684aac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.716+0000 7faf37fff640 1 -- 172.21.15.27:0/1435394581 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561468493150 msgr2=0x5614684ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:26.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.716+0000 7faf37fff640 1 --2- 172.21.15.27:0/1435394581 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561468493150 0x5614684ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.716+0000 7faf37fff640 1 -- 172.21.15.27:0/1435394581 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56146847a680 con 0x561468483a40 2024-09-19T08:16:26.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.716+0000 7faf37fff640 1 --2- 172.21.15.27:0/1435394581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468483a40 0x56146847f160 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7faf2800cfd0 tx=0x7faf28005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a13272676c88d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:26.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.717+0000 7faf1dffb640 1 -- 172.21.15.27:0/1435394581 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2800fdb0 con 0x561468483a40 2024-09-19T08:16:26.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.717+0000 7faf1dffb640 1 -- 172.21.15.27:0/1435394581 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf2800f790 con 0x561468483a40 2024-09-19T08:16:26.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.717+0000 7faf1dffb640 1 -- 172.21.15.27:0/1435394581 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28023860 con 0x561468483a40 2024-09-19T08:16:26.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.717+0000 7faf40865740 1 -- 172.21.15.27:0/1435394581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468483a40 msgr2=0x56146847f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:26.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.717+0000 7faf40865740 1 --2- 172.21.15.27:0/1435394581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468483a40 0x56146847f160 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7faf2800cfd0 tx=0x7faf28005670 comp rx=0 tx=0).stop 2024-09-19T08:16:26.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.717+0000 7faf40865740 1 -- 172.21.15.27:0/1435394581 shutdown_connections 2024-09-19T08:16:26.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.717+0000 7faf40865740 1 --2- 172.21.15.27:0/1435394581 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561468493150 0x5614684ab190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.717+0000 7faf40865740 1 --2- 172.21.15.27:0/1435394581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561468484360 0x5614684aac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.717+0000 7faf40865740 1 --2- 172.21.15.27:0/1435394581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468483a40 0x56146847f160 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.717+0000 7faf40865740 1 -- 172.21.15.27:0/1435394581 >> 172.21.15.27:0/1435394581 conn(0x5614684800f0 msgr2=0x56146847ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:26.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.717+0000 7faf40865740 1 -- 172.21.15.27:0/1435394581 shutdown_connections 2024-09-19T08:16:26.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.717+0000 7faf40865740 1 -- 172.21.15.27:0/1435394581 wait complete. 2024-09-19T08:16:26.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.718+0000 7faf40865740 1 -- start start 2024-09-19T08:16:26.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.718+0000 7faf40865740 1 Processor -- start 2024-09-19T08:16:26.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.718+0000 7faf40865740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561468483a40 0x5614684972b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:26.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.718+0000 7faf40865740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561468484360 0x5614684977f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:26.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.718+0000 7faf40865740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468493150 0x56146850cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.718+0000 7faf40865740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7faf381aa2c0 con 0x561468493150 2024-09-19T08:16:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.718+0000 7faf40865740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faf381ab730 con 0x561468483a40 2024-09-19T08:16:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.718+0000 7faf40865740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faf381aa990 con 0x561468484360 2024-09-19T08:16:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.718+0000 7faf40865740 10 client.0 _ll_register_callbacks cb 0x7faf2800c6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:16:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.718+0000 7faf3ca29640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468493150 0x56146850cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.718+0000 7faf3ca29640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468493150 0x56146850cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40430/0 (socket says 172.21.15.27:40430) 2024-09-19T08:16:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.718+0000 7faf3ca29640 1 -- 172.21.15.27:0/2269947854 learned_addr learned my addr 172.21.15.27:0/2269947854 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.719+0000 7faf37fff640 1 --2- 172.21.15.27:0/2269947854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561468483a40 0x5614684972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.719+0000 7faf377fe640 1 --2- 172.21.15.27:0/2269947854 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561468484360 0x5614684977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.719+0000 7faf3ca29640 1 -- 172.21.15.27:0/2269947854 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561468484360 msgr2=0x5614684977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.719+0000 7faf3ca29640 1 --2- 172.21.15.27:0/2269947854 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561468484360 0x5614684977f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.719+0000 7faf3ca29640 1 -- 172.21.15.27:0/2269947854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561468483a40 msgr2=0x5614684972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:26.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.719+0000 7faf3ca29640 1 --2- 172.21.15.27:0/2269947854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561468483a40 0x5614684972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.719+0000 7faf3ca29640 1 -- 172.21.15.27:0/2269947854 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56146850d160 con 0x561468493150 2024-09-19T08:16:26.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.719+0000 7faf3ca29640 1 --2- 172.21.15.27:0/2269947854 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468493150 0x56146850cc20 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7faf30035000 tx=0x7faf30009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110652e5a83fb9f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:26.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.719+0000 7faf177fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:16:26.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.719+0000 7faf177fe640 1 -- 172.21.15.27:0/2269947854 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf30050070 con 0x561468493150 2024-09-19T08:16:26.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.719+0000 7faf177fe640 1 -- 172.21.15.27:0/2269947854 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7faf30004440 con 0x561468493150 2024-09-19T08:16:26.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.719+0000 7faf40865740 1 -- 172.21.15.27:0/2269947854 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf2800f790 con 0x561468493150 2024-09-19T08:16:26.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.719+0000 7faf177fe640 1 -- 172.21.15.27:0/2269947854 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7faf30034040 con 0x561468493150 2024-09-19T08:16:26.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.719+0000 7faf40865740 10 client.16266 fetch_fsmap learned FSMap version 20 2024-09-19T08:16:26.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.719+0000 7faf40865740 1 -- 172.21.15.27:0/2269947854 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56146850e360 con 0x561468493150 2024-09-19T08:16:26.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.720+0000 7faf177fe640 1 -- 172.21.15.27:0/2269947854 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf2800f790 con 0x561468493150 2024-09-19T08:16:26.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.720+0000 7faf177fe640 1 -- 172.21.15.27:0/2269947854 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7faf3003b440 con 0x561468493150 2024-09-19T08:16:26.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.720+0000 7faf40865740 10 client.16266 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:16:26.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.720+0000 7faf40865740 10 client.16266 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:16:26.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.720+0000 7faf40865740 20 client.16266 populate_metadata read hostname 'smithi027' 2024-09-19T08:16:26.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.720+0000 7faf40865740 1 --2- 172.21.15.27:0/2269947854 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56146850eac0 0x561468510ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:26.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.720+0000 7faf40865740 4 client.16266 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:16:26.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.720+0000 7faf40865740 1 -- 172.21.15.27:0/2269947854 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5614683f0d00 con 0x56146850eac0 2024-09-19T08:16:26.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.720+0000 7faf37fff640 1 --2- 172.21.15.27:0/2269947854 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56146850eac0 0x561468510ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:26.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.721+0000 7faf177fe640 10 client.16266 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:16:26.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.721+0000 7faf37fff640 1 --2- 172.21.15.27:0/2269947854 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56146850eac0 0x561468510ee0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df34166eac8cbe87 server_cookie=f21e78129443f756 in_seq=0 out_seq=0 2024-09-19T08:16:26.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.722+0000 7faf177fe640 1 -- 172.21.15.27:0/2269947854 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5614683f0d00 con 0x56146850eac0 2024-09-19T08:16:26.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.722+0000 7faf177fe640 10 client.16266 handle_command_reply: tid=0 2024-09-19T08:16:26.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.722+0000 7faf40865740 1 client.16266 shutdown 2024-09-19T08:16:26.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.722+0000 7faf40865740 1 -- 172.21.15.27:0/2269947854 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468493150 msgr2=0x56146850cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:26.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.722+0000 7faf40865740 1 --2- 172.21.15.27:0/2269947854 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468493150 0x56146850cc20 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7faf30035000 tx=0x7faf30009880 comp rx=0 tx=0).stop 2024-09-19T08:16:26.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.722+0000 7faf40865740 1 -- 172.21.15.27:0/2269947854 shutdown_connections 2024-09-19T08:16:26.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.722+0000 7faf40865740 1 --2- 172.21.15.27:0/2269947854 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561468493150 0x56146850cc20 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.722+0000 7faf40865740 1 --2- 172.21.15.27:0/2269947854 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56146850eac0 0x561468510ee0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.722+0000 7faf40865740 1 --2- 172.21.15.27:0/2269947854 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561468484360 0x5614684977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.722+0000 7faf40865740 1 --2- 172.21.15.27:0/2269947854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561468483a40 0x5614684972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.722+0000 7faf177fe640 0 client.16266 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:16:26.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.722+0000 7faf40865740 1 -- 172.21.15.27:0/2269947854 >> 172.21.15.27:0/2269947854 conn(0x5614684800f0 msgr2=0x561468490880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:26.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.722+0000 7faf40865740 1 -- 172.21.15.27:0/2269947854 shutdown_connections 2024-09-19T08:16:26.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.722+0000 7faf40865740 1 -- 172.21.15.27:0/2269947854 wait complete. 2024-09-19T08:16:26.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.722+0000 7faf40865740 20 client.16266 trim_cache size 0 max 16384 2024-09-19T08:16:26.727 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:16:26.727 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:16:26.727 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "9c6bddd2-1ae5-499b-8fe5-d6d9feda6fe6", 2024-09-19T08:16:26.727 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:16:26.728 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:16:26.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.723+0000 7faf3e48c640 1 -- 172.21.15.27:0/2946614669 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7faf200a33b0 msgr2=0x7faf200a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:26.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.723+0000 7faf3e48c640 1 --2- 172.21.15.27:0/2946614669 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7faf200a33b0 0x7faf200a5870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faf3002fd90 tx=0x7faf30004a40 comp rx=0 tx=0).stop 2024-09-19T08:16:26.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.723+0000 7faf3e48c640 1 -- 172.21.15.27:0/2946614669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf38103660 msgr2=0x7faf38198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:26.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.723+0000 7faf3e48c640 1 --2- 172.21.15.27:0/2946614669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf38103660 0x7faf38198950 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00c940 tx=0x7faf2c00ce00 comp rx=0 tx=0).stop 2024-09-19T08:16:26.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.723+0000 7faf3e48c640 1 -- 172.21.15.27:0/2946614669 shutdown_connections 2024-09-19T08:16:26.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.723+0000 7faf3e48c640 1 --2- 172.21.15.27:0/2946614669 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7faf200a33b0 0x7faf200a5870 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.723+0000 7faf3e48c640 1 --2- 172.21.15.27:0/2946614669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf3810c170 0x7faf3819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.723+0000 7faf3e48c640 1 --2- 172.21.15.27:0/2946614669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf38103660 0x7faf38198950 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.723+0000 7faf3e48c640 1 --2- 172.21.15.27:0/2946614669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf38102d40 0x7faf38198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:26.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.723+0000 7faf3e48c640 1 -- 172.21.15.27:0/2946614669 >> 172.21.15.27:0/2946614669 conn(0x7faf380fc7a0 msgr2=0x7faf380fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:26.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.723+0000 7faf3e48c640 1 -- 172.21.15.27:0/2946614669 shutdown_connections 2024-09-19T08:16:26.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:26.723+0000 7faf3e48c640 1 -- 172.21.15.27:0/2946614669 wait complete. 2024-09-19T08:16:26.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:26 smithi155 ceph-mon[35362]: pgmap v165: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:27.003 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:26 smithi027 ceph-mon[31209]: pgmap v165: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:27.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:26 smithi203 ceph-mon[35198]: pgmap v165: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:27.586 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:16:27.845 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:16:27.967 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:27 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:16:27.967 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:27 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:16:27.967 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:27 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:16:27.967 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:27 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:16:27.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:27 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:16:27.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:27 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:16:27.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:27 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:16:27.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:27 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:16:28.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:27 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:16:28.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:27 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:16:28.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:27 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:16:28.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:27 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:16:28.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.363+0000 7f96b99c9640 1 -- 172.21.15.27:0/3517833236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96b4102790 msgr2=0x7f96b41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:28.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.363+0000 7f96b99c9640 1 --2- 172.21.15.27:0/3517833236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96b4102790 0x7f96b41067e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f96a4009900 tx=0x7f96a402a410 comp rx=0 tx=0).stop 2024-09-19T08:16:28.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.363+0000 7f96b99c9640 1 -- 172.21.15.27:0/3517833236 shutdown_connections 2024-09-19T08:16:28.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.363+0000 7f96b99c9640 1 --2- 172.21.15.27:0/3517833236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96b4106f10 0x7f96b410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.363+0000 7f96b99c9640 1 --2- 172.21.15.27:0/3517833236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96b4102790 0x7f96b41067e0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.363+0000 7f96b99c9640 1 --2- 172.21.15.27:0/3517833236 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96b4101de0 0x7f96b41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.363+0000 7f96b99c9640 1 -- 172.21.15.27:0/3517833236 >> 172.21.15.27:0/3517833236 conn(0x7f96b40fd8c0 msgr2=0x7f96b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:28.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.363+0000 7f96b99c9640 1 -- 172.21.15.27:0/3517833236 shutdown_connections 2024-09-19T08:16:28.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.363+0000 7f96b99c9640 1 -- 172.21.15.27:0/3517833236 wait complete. 2024-09-19T08:16:28.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.363+0000 7f96b99c9640 1 Processor -- start 2024-09-19T08:16:28.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.364+0000 7f96b99c9640 1 -- start start 2024-09-19T08:16:28.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.364+0000 7f96b99c9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96b4101de0 0x7f96b41985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:28.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.364+0000 7f96b99c9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96b4102790 0x7f96b4198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:28.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.364+0000 7f96b99c9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96b4106f10 0x7f96b419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:28.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.364+0000 7f96b99c9640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f96b4112010 con 0x7f96b4102790 2024-09-19T08:16:28.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.364+0000 7f96b99c9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f96b4111e90 con 0x7f96b4101de0 2024-09-19T08:16:28.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.364+0000 7f96b99c9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f96b4112190 con 0x7f96b4106f10 2024-09-19T08:16:28.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.364+0000 7f96b27fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96b4102790 0x7f96b4198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:28.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.364+0000 7f96b27fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96b4102790 0x7f96b4198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40446/0 (socket says 172.21.15.27:40446) 2024-09-19T08:16:28.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.364+0000 7f96b27fc640 1 -- 172.21.15.27:0/3112477751 learned_addr learned my addr 172.21.15.27:0/3112477751 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:28.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.364+0000 7f96b37fe640 1 --2- 172.21.15.27:0/3112477751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96b4106f10 0x7f96b419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:28.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.364+0000 7f96b2ffd640 1 --2- 172.21.15.27:0/3112477751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96b4101de0 0x7f96b41985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:28.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.364+0000 7f96b27fc640 1 -- 172.21.15.27:0/3112477751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96b4106f10 msgr2=0x7f96b419ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:28.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.364+0000 7f96b27fc640 1 --2- 172.21.15.27:0/3112477751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96b4106f10 0x7f96b419ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.364+0000 7f96b27fc640 1 -- 172.21.15.27:0/3112477751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96b4101de0 msgr2=0x7f96b41985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:28.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.364+0000 7f96b27fc640 1 --2- 172.21.15.27:0/3112477751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96b4101de0 0x7f96b41985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.364+0000 7f96b27fc640 1 -- 172.21.15.27:0/3112477751 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b419d560 con 0x7f96b4102790 2024-09-19T08:16:28.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.365+0000 7f96b27fc640 1 --2- 172.21.15.27:0/3112477751 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96b4102790 0x7f96b4198af0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f96a4005ab0 tx=0x7f96a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:28.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.365+0000 7f96b89c7640 1 -- 172.21.15.27:0/3112477751 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a403f030 con 0x7f96b4102790 2024-09-19T08:16:28.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.365+0000 7f96b89c7640 1 -- 172.21.15.27:0/3112477751 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96a4003ce0 con 0x7f96b4102790 2024-09-19T08:16:28.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.365+0000 7f96b89c7640 1 -- 172.21.15.27:0/3112477751 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a4035070 con 0x7f96b4102790 2024-09-19T08:16:28.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.365+0000 7f96b99c9640 1 -- 172.21.15.27:0/3112477751 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b419d7f0 con 0x7f96b4102790 2024-09-19T08:16:28.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.365+0000 7f96b99c9640 1 -- 172.21.15.27:0/3112477751 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b419dc80 con 0x7f96b4102790 2024-09-19T08:16:28.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.367+0000 7f96b89c7640 1 -- 172.21.15.27:0/3112477751 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f96a4042030 con 0x7f96b4102790 2024-09-19T08:16:28.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.367+0000 7f96bbda2740 1 Processor -- start 2024-09-19T08:16:28.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.368+0000 7f96bbda2740 1 -- start start 2024-09-19T08:16:28.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.368+0000 7f96bbda2740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5565deb884a0 0x5565deb88880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:28.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.368+0000 7f96bbda2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5565deb88dc0 0x5565deb93140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:28.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.368+0000 7f96bbda2740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb93680 0x5565deb95a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:28.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.368+0000 7f96bbda2740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5565deaee2e0 con 0x5565deb93680 2024-09-19T08:16:28.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.368+0000 7f96bbda2740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5565dea95ce0 con 0x5565deb884a0 2024-09-19T08:16:28.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.368+0000 7f96bbda2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5565deaea2a0 con 0x5565deb88dc0 2024-09-19T08:16:28.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.368+0000 7f96b89c7640 1 --2- 172.21.15.27:0/3112477751 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f96a00a33b0 0x7f96a00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:28.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.368+0000 7f96b27fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb93680 0x5565deb95a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:28.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.368+0000 7f96b27fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb93680 0x5565deb95a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40452/0 (socket says 172.21.15.27:40452) 2024-09-19T08:16:28.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.368+0000 7f96b27fc640 1 -- 172.21.15.27:0/1963994435 learned_addr learned my addr 172.21.15.27:0/1963994435 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:28.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.368+0000 7f96b37fe640 1 --2- 172.21.15.27:0/3112477751 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f96a00a33b0 0x7f96a00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:28.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.368+0000 7f96b37fe640 1 --2- 172.21.15.27:0/1963994435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5565deb884a0 0x5565deb88880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:28.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.368+0000 7f96b2ffd640 1 --2- 172.21.15.27:0/1963994435 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5565deb88dc0 0x5565deb93140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:28.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.368+0000 7f96b89c7640 1 -- 172.21.15.27:0/3112477751 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f96a40f01e0 con 0x7f96b4102790 2024-09-19T08:16:28.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.368+0000 7f96b27fc640 1 -- 172.21.15.27:0/1963994435 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5565deb88dc0 msgr2=0x5565deb93140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:28.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.368+0000 7f96b27fc640 1 --2- 172.21.15.27:0/1963994435 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5565deb88dc0 0x5565deb93140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.368+0000 7f96b27fc640 1 -- 172.21.15.27:0/1963994435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5565deb884a0 msgr2=0x5565deb88880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:28.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.368+0000 7f96b27fc640 1 --2- 172.21.15.27:0/1963994435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5565deb884a0 0x5565deb88880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.368+0000 7f96b27fc640 1 -- 172.21.15.27:0/1963994435 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565dea7a440 con 0x5565deb93680 2024-09-19T08:16:28.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.369+0000 7f96b27fc640 1 --2- 172.21.15.27:0/1963994435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb93680 0x5565deb95a70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f96a40ed980 tx=0x7f96a403b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1858583fbeb29d20 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:28.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.369+0000 7f96b37fe640 1 --2- 172.21.15.27:0/3112477751 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f96a00a33b0 0x7f96a00a5870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f96ac009fd0 tx=0x7f96ac007040 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:28.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.369+0000 7f96a9ffb640 1 -- 172.21.15.27:0/1963994435 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a4049070 con 0x5565deb93680 2024-09-19T08:16:28.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.369+0000 7f96a9ffb640 1 -- 172.21.15.27:0/1963994435 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96a40ebe50 con 0x5565deb93680 2024-09-19T08:16:28.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.369+0000 7f96a9ffb640 1 -- 172.21.15.27:0/1963994435 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a40b8b20 con 0x5565deb93680 2024-09-19T08:16:28.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.369+0000 7f96bbda2740 1 -- 172.21.15.27:0/1963994435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb93680 msgr2=0x5565deb95a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:28.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.369+0000 7f96bbda2740 1 --2- 172.21.15.27:0/1963994435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb93680 0x5565deb95a70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f96a40ed980 tx=0x7f96a403b790 comp rx=0 tx=0).stop 2024-09-19T08:16:28.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.369+0000 7f96bbda2740 1 -- 172.21.15.27:0/1963994435 shutdown_connections 2024-09-19T08:16:28.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.369+0000 7f96bbda2740 1 --2- 172.21.15.27:0/1963994435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb93680 0x5565deb95a70 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.369+0000 7f96bbda2740 1 --2- 172.21.15.27:0/1963994435 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5565deb88dc0 0x5565deb93140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.369+0000 7f96bbda2740 1 --2- 172.21.15.27:0/1963994435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5565deb884a0 0x5565deb88880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.369+0000 7f96bbda2740 1 -- 172.21.15.27:0/1963994435 >> 172.21.15.27:0/1963994435 conn(0x5565deb84a30 msgr2=0x5565deb84e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:28.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.369+0000 7f96bbda2740 1 -- 172.21.15.27:0/1963994435 shutdown_connections 2024-09-19T08:16:28.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.369+0000 7f96bbda2740 1 -- 172.21.15.27:0/1963994435 wait complete. 2024-09-19T08:16:28.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.370+0000 7f96bbda2740 1 -- start start 2024-09-19T08:16:28.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.370+0000 7f96bbda2740 1 Processor -- start 2024-09-19T08:16:28.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.370+0000 7f96bbda2740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5565deb884a0 0x5565deb92ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:28.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.370+0000 7f96bbda2740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb88dc0 0x5565deb902a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:28.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.370+0000 7f96bbda2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5565deb93680 0x5565deb90800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:28.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.370+0000 7f96bbda2740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5565deb96010 con 0x5565deb88dc0 2024-09-19T08:16:28.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.370+0000 7f96bbda2740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5565deaa9050 con 0x5565deb884a0 2024-09-19T08:16:28.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.370+0000 7f96bbda2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5565deb96190 con 0x5565deb93680 2024-09-19T08:16:28.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.370+0000 7f96bbda2740 10 client.0 _ll_register_callbacks cb 0x5565deae9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:16:28.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.370+0000 7f96b27fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb88dc0 0x5565deb902a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:28.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.370+0000 7f96b27fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb88dc0 0x5565deb902a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40460/0 (socket says 172.21.15.27:40460) 2024-09-19T08:16:28.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.371+0000 7f96b27fc640 1 -- 172.21.15.27:0/1198703884 learned_addr learned my addr 172.21.15.27:0/1198703884 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:28.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.371+0000 7f96b2ffd640 1 --2- 172.21.15.27:0/1198703884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5565deb884a0 0x5565deb92ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:28.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.371+0000 7f96b37fe640 1 --2- 172.21.15.27:0/1198703884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5565deb93680 0x5565deb90800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:28.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.371+0000 7f96b27fc640 1 -- 172.21.15.27:0/1198703884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5565deb93680 msgr2=0x5565deb90800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:28.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.371+0000 7f96b27fc640 1 --2- 172.21.15.27:0/1198703884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5565deb93680 0x5565deb90800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.371+0000 7f96b27fc640 1 -- 172.21.15.27:0/1198703884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5565deb884a0 msgr2=0x5565deb92ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:28.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.371+0000 7f96b27fc640 1 --2- 172.21.15.27:0/1198703884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5565deb884a0 0x5565deb92ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.371+0000 7f96b27fc640 1 -- 172.21.15.27:0/1198703884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565de85f3c0 con 0x5565deb88dc0 2024-09-19T08:16:28.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.371+0000 7f96b27fc640 1 --2- 172.21.15.27:0/1198703884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb88dc0 0x5565deb902a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f96a40bc1b0 tx=0x7f96a402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6503806f7dbdde97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:28.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.371+0000 7f9692ffd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:16:28.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.371+0000 7f9692ffd640 1 -- 172.21.15.27:0/1198703884 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a4049040 con 0x5565deb88dc0 2024-09-19T08:16:28.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.371+0000 7f9692ffd640 1 -- 172.21.15.27:0/1198703884 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f96a40edba0 con 0x5565deb88dc0 2024-09-19T08:16:28.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.371+0000 7f96bbda2740 1 -- 172.21.15.27:0/1198703884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96a40ebe50 con 0x5565deb88dc0 2024-09-19T08:16:28.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.371+0000 7f9692ffd640 1 -- 172.21.15.27:0/1198703884 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f96a403bd00 con 0x5565deb88dc0 2024-09-19T08:16:28.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.371+0000 7f96bbda2740 10 client.16278 fetch_fsmap learned FSMap version 20 2024-09-19T08:16:28.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.371+0000 7f96bbda2740 1 -- 172.21.15.27:0/1198703884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5565deb96010 con 0x5565deb88dc0 2024-09-19T08:16:28.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.371+0000 7f9692ffd640 1 -- 172.21.15.27:0/1198703884 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96a40ebe50 con 0x5565deb88dc0 2024-09-19T08:16:28.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.372+0000 7f9692ffd640 1 -- 172.21.15.27:0/1198703884 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f96a40c4c90 con 0x5565deb88dc0 2024-09-19T08:16:28.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.372+0000 7f96bbda2740 10 client.16278 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:16:28.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.372+0000 7f96bbda2740 10 client.16278 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:16:28.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.372+0000 7f96bbda2740 20 client.16278 populate_metadata read hostname 'smithi027' 2024-09-19T08:16:28.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.372+0000 7f96bbda2740 1 --2- 172.21.15.27:0/1198703884 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5565deba2ad0 0x5565deba4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:28.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.372+0000 7f96bbda2740 4 client.16278 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:16:28.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.372+0000 7f96bbda2740 1 -- 172.21.15.27:0/1198703884 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565deafb850 con 0x5565deba2ad0 2024-09-19T08:16:28.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.372+0000 7f96b2ffd640 1 --2- 172.21.15.27:0/1198703884 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5565deba2ad0 0x5565deba4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:28.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.372+0000 7f9692ffd640 10 client.16278 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:16:28.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.372+0000 7f96b2ffd640 1 --2- 172.21.15.27:0/1198703884 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5565deba2ad0 0x5565deba4ec0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3549863906f0b16f server_cookie=849e34ea4ad15d37 in_seq=0 out_seq=0 2024-09-19T08:16:28.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.373+0000 7f9692ffd640 1 -- 172.21.15.27:0/1198703884 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5565deafb850 con 0x5565deba2ad0 2024-09-19T08:16:28.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.373+0000 7f9692ffd640 10 client.16278 handle_command_reply: tid=0 2024-09-19T08:16:28.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.373+0000 7f96bbda2740 1 client.16278 shutdown 2024-09-19T08:16:28.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.373+0000 7f96bbda2740 1 -- 172.21.15.27:0/1198703884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb88dc0 msgr2=0x5565deb902a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:28.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.373+0000 7f96bbda2740 1 --2- 172.21.15.27:0/1198703884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb88dc0 0x5565deb902a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f96a40bc1b0 tx=0x7f96a402a410 comp rx=0 tx=0).stop 2024-09-19T08:16:28.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.373+0000 7f96bbda2740 1 -- 172.21.15.27:0/1198703884 shutdown_connections 2024-09-19T08:16:28.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.373+0000 7f96bbda2740 1 --2- 172.21.15.27:0/1198703884 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5565deba2ad0 0x5565deba4ec0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.373+0000 7f96bbda2740 1 --2- 172.21.15.27:0/1198703884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5565deb93680 0x5565deb90800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.373+0000 7f96bbda2740 1 --2- 172.21.15.27:0/1198703884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb88dc0 0x5565deb902a0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.373+0000 7f96bbda2740 1 --2- 172.21.15.27:0/1198703884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5565deb884a0 0x5565deb92ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.373+0000 7f96bbda2740 1 -- 172.21.15.27:0/1198703884 >> 172.21.15.27:0/1198703884 conn(0x5565deb84a30 msgr2=0x5565deb8a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:28.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.373+0000 7f9692ffd640 0 client.16278 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:16:28.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.374+0000 7f96bbda2740 1 -- 172.21.15.27:0/1198703884 shutdown_connections 2024-09-19T08:16:28.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.374+0000 7f96bbda2740 1 -- 172.21.15.27:0/1198703884 wait complete. 2024-09-19T08:16:28.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.374+0000 7f96bbda2740 20 client.16278 trim_cache size 0 max 16384 2024-09-19T08:16:28.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.391+0000 7f96bbda2740 1 Processor -- start 2024-09-19T08:16:28.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.391+0000 7f96bbda2740 1 -- start start 2024-09-19T08:16:28.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.391+0000 7f96bbda2740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb884a0 0x5565deb9f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:28.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.391+0000 7f96bbda2740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5565deb88dc0 0x5565debaa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:28.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.391+0000 7f96bbda2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5565deb93680 0x5565debaabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:28.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.391+0000 7f96bbda2740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f96b41a9690 con 0x5565deb884a0 2024-09-19T08:16:28.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.391+0000 7f96bbda2740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f96b41abf10 con 0x5565deb88dc0 2024-09-19T08:16:28.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.391+0000 7f96bbda2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f96b41a9d00 con 0x5565deb93680 2024-09-19T08:16:28.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.391+0000 7f96b2ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb884a0 0x5565deb9f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:28.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.391+0000 7f96b2ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb884a0 0x5565deb9f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40474/0 (socket says 172.21.15.27:40474) 2024-09-19T08:16:28.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.391+0000 7f96b2ffd640 1 -- 172.21.15.27:0/2781369359 learned_addr learned my addr 172.21.15.27:0/2781369359 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:28.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.392+0000 7f96b37fe640 1 --2- 172.21.15.27:0/2781369359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5565deb93680 0x5565debaabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:28.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.392+0000 7f96b2ffd640 1 -- 172.21.15.27:0/2781369359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5565deb93680 msgr2=0x5565debaabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:28.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.392+0000 7f96b2ffd640 1 --2- 172.21.15.27:0/2781369359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5565deb93680 0x5565debaabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.392+0000 7f96b2ffd640 1 -- 172.21.15.27:0/2781369359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5565deb88dc0 msgr2=0x5565debaa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:28.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.392+0000 7f96b2ffd640 1 --2- 172.21.15.27:0/2781369359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5565deb88dc0 0x5565debaa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.392+0000 7f96b2ffd640 1 -- 172.21.15.27:0/2781369359 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565deb92b10 con 0x5565deb884a0 2024-09-19T08:16:28.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.392+0000 7f96b2ffd640 1 --2- 172.21.15.27:0/2781369359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb884a0 0x5565deb9f1e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f969c010d70 tx=0x7f969c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c531315d2d9a5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:28.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.392+0000 7f96a97fa640 1 -- 172.21.15.27:0/2781369359 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c02b070 con 0x5565deb884a0 2024-09-19T08:16:28.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.392+0000 7f96a97fa640 1 -- 172.21.15.27:0/2781369359 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f969c026ad0 con 0x5565deb884a0 2024-09-19T08:16:28.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.392+0000 7f96a97fa640 1 -- 172.21.15.27:0/2781369359 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c01eb40 con 0x5565deb884a0 2024-09-19T08:16:28.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.393+0000 7f96bbda2740 1 -- 172.21.15.27:0/2781369359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb884a0 msgr2=0x5565deb9f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:28.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.393+0000 7f96bbda2740 1 --2- 172.21.15.27:0/2781369359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb884a0 0x5565deb9f1e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f969c010d70 tx=0x7f969c014040 comp rx=0 tx=0).stop 2024-09-19T08:16:28.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.393+0000 7f96bbda2740 1 -- 172.21.15.27:0/2781369359 shutdown_connections 2024-09-19T08:16:28.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.393+0000 7f96bbda2740 1 --2- 172.21.15.27:0/2781369359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5565deb93680 0x5565debaabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.393+0000 7f96bbda2740 1 --2- 172.21.15.27:0/2781369359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5565deb88dc0 0x5565debaa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.393+0000 7f96bbda2740 1 --2- 172.21.15.27:0/2781369359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb884a0 0x5565deb9f1e0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.393+0000 7f96bbda2740 1 -- 172.21.15.27:0/2781369359 >> 172.21.15.27:0/2781369359 conn(0x5565deb84a30 msgr2=0x5565deb8b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:28.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.393+0000 7f96bbda2740 1 -- 172.21.15.27:0/2781369359 shutdown_connections 2024-09-19T08:16:28.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.393+0000 7f96bbda2740 1 -- 172.21.15.27:0/2781369359 wait complete. 2024-09-19T08:16:28.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.393+0000 7f96bbda2740 1 -- start start 2024-09-19T08:16:28.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.393+0000 7f96bbda2740 1 Processor -- start 2024-09-19T08:16:28.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.393+0000 7f96bbda2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5565deb884a0 0x5565deb9b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:28.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.393+0000 7f96bbda2740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5565deb88dc0 0x5565deb9bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:28.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.393+0000 7f96bbda2740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb93680 0x5565deb96a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:28.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.393+0000 7f96bbda2740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f96b41aa3d0 con 0x5565deb93680 2024-09-19T08:16:28.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.393+0000 7f96bbda2740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f96b41ab840 con 0x5565deb88dc0 2024-09-19T08:16:28.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.393+0000 7f96bbda2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f96b41aaaa0 con 0x5565deb884a0 2024-09-19T08:16:28.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.394+0000 7f96bbda2740 10 client.0 _ll_register_callbacks cb 0x7f96ac00b410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:16:28.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.394+0000 7f96b37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb93680 0x5565deb96a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:28.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.394+0000 7f96b37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb93680 0x5565deb96a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40484/0 (socket says 172.21.15.27:40484) 2024-09-19T08:16:28.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.394+0000 7f96b37fe640 1 -- 172.21.15.27:0/2827179849 learned_addr learned my addr 172.21.15.27:0/2827179849 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:16:28.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.394+0000 7f96b2ffd640 1 --2- 172.21.15.27:0/2827179849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5565deb884a0 0x5565deb9b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:28.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.394+0000 7f96b27fc640 1 --2- 172.21.15.27:0/2827179849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5565deb88dc0 0x5565deb9bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:28.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.394+0000 7f96b37fe640 1 -- 172.21.15.27:0/2827179849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5565deb884a0 msgr2=0x5565deb9b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:28.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.394+0000 7f96b37fe640 1 --2- 172.21.15.27:0/2827179849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5565deb884a0 0x5565deb9b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.394+0000 7f96b37fe640 1 -- 172.21.15.27:0/2827179849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5565deb88dc0 msgr2=0x5565deb9bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:16:28.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.394+0000 7f96b37fe640 1 --2- 172.21.15.27:0/2827179849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5565deb88dc0 0x5565deb9bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.394+0000 7f96b37fe640 1 -- 172.21.15.27:0/2827179849 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565deb97290 con 0x5565deb93680 2024-09-19T08:16:28.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.394+0000 7f96b37fe640 1 --2- 172.21.15.27:0/2827179849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb93680 0x5565deb96a60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f96ac00bfd0 tx=0x7f96ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403d5014f1b4ebea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:16:28.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.394+0000 7f9692ffd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:16:28.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.394+0000 7f9692ffd640 1 -- 172.21.15.27:0/2827179849 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac029070 con 0x5565deb93680 2024-09-19T08:16:28.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.394+0000 7f96bbda2740 1 -- 172.21.15.27:0/2827179849 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f969c026ad0 con 0x5565deb93680 2024-09-19T08:16:28.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.394+0000 7f9692ffd640 1 -- 172.21.15.27:0/2827179849 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f96ac024480 con 0x5565deb93680 2024-09-19T08:16:28.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.394+0000 7f9692ffd640 1 -- 172.21.15.27:0/2827179849 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f96ac035050 con 0x5565deb93680 2024-09-19T08:16:28.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.394+0000 7f96bbda2740 10 client.16284 fetch_fsmap learned FSMap version 20 2024-09-19T08:16:28.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.394+0000 7f96bbda2740 1 -- 172.21.15.27:0/2827179849 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5565dec0d320 con 0x5565deb93680 2024-09-19T08:16:28.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.395+0000 7f9692ffd640 1 -- 172.21.15.27:0/2827179849 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f969c026ad0 con 0x5565deb93680 2024-09-19T08:16:28.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.395+0000 7f9692ffd640 1 -- 172.21.15.27:0/2827179849 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f96ac025670 con 0x5565deb93680 2024-09-19T08:16:28.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.395+0000 7f96bbda2740 10 client.16284 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:16:28.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.395+0000 7f96bbda2740 10 client.16284 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:16:28.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.395+0000 7f96bbda2740 20 client.16284 populate_metadata read hostname 'smithi027' 2024-09-19T08:16:28.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.395+0000 7f96bbda2740 1 --2- 172.21.15.27:0/2827179849 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5565dec0d9f0 0x5565dec0fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:16:28.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.395+0000 7f96bbda2740 4 client.16284 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:16:28.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.395+0000 7f96bbda2740 1 -- 172.21.15.27:0/2827179849 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5565deaf5d60 con 0x5565dec0d9f0 2024-09-19T08:16:28.512 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:16:28.512 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:16:28.512 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": { 2024-09-19T08:16:28.512 INFO:teuthology.orchestra.run.smithi027.stdout: "9c6bddd2-1ae5-499b-8fe5-d6d9feda6fe6": { 2024-09-19T08:16:28.512 INFO:teuthology.orchestra.run.smithi027.stdout: "path": "/", 2024-09-19T08:16:28.512 INFO:teuthology.orchestra.run.smithi027.stdout: "tag": "9c6bddd2-1ae5-499b-8fe5-d6d9feda6fe6", 2024-09-19T08:16:28.512 INFO:teuthology.orchestra.run.smithi027.stdout: "options": "recursive,force" 2024-09-19T08:16:28.513 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:16:28.513 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:16:28.513 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:16:28.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.395+0000 7f96b2ffd640 1 --2- 172.21.15.27:0/2827179849 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5565dec0d9f0 0x5565dec0fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:16:28.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.396+0000 7f96b2ffd640 1 --2- 172.21.15.27:0/2827179849 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5565dec0d9f0 0x5565dec0fde0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb236a9737cc2a09 server_cookie=7fa5e445c9c5996a in_seq=0 out_seq=0 2024-09-19T08:16:28.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.396+0000 7f9692ffd640 10 client.16284 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:16:28.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.396+0000 7f9692ffd640 1 -- 172.21.15.27:0/2827179849 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5565deaf5d60 con 0x5565dec0d9f0 2024-09-19T08:16:28.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.396+0000 7f9692ffd640 10 client.16284 handle_command_reply: tid=0 2024-09-19T08:16:28.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.396+0000 7f96bbda2740 1 client.16284 shutdown 2024-09-19T08:16:28.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.396+0000 7f96bbda2740 1 -- 172.21.15.27:0/2827179849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb93680 msgr2=0x5565deb96a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:28.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.396+0000 7f96bbda2740 1 --2- 172.21.15.27:0/2827179849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb93680 0x5565deb96a60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f96ac00bfd0 tx=0x7f96ac004a40 comp rx=0 tx=0).stop 2024-09-19T08:16:28.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.396+0000 7f96bbda2740 1 -- 172.21.15.27:0/2827179849 shutdown_connections 2024-09-19T08:16:28.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.396+0000 7f96bbda2740 1 --2- 172.21.15.27:0/2827179849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5565deb93680 0x5565deb96a60 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.396+0000 7f96bbda2740 1 --2- 172.21.15.27:0/2827179849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5565deb88dc0 0x5565deb9bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.396+0000 7f96bbda2740 1 --2- 172.21.15.27:0/2827179849 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5565dec0d9f0 0x5565dec0fde0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.396+0000 7f96bbda2740 1 --2- 172.21.15.27:0/2827179849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5565deb884a0 0x5565deb9b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.396+0000 7f96bbda2740 1 -- 172.21.15.27:0/2827179849 >> 172.21.15.27:0/2827179849 conn(0x5565deb84a30 msgr2=0x5565deb8ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:28.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.396+0000 7f9692ffd640 0 client.16284 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:16:28.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.396+0000 7f96bbda2740 1 -- 172.21.15.27:0/2827179849 shutdown_connections 2024-09-19T08:16:28.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.396+0000 7f96bbda2740 1 -- 172.21.15.27:0/2827179849 wait complete. 2024-09-19T08:16:28.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.396+0000 7f96bbda2740 20 client.16284 trim_cache size 0 max 16384 2024-09-19T08:16:28.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.397+0000 7f96b99c9640 1 -- 172.21.15.27:0/3112477751 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f96a00a33b0 msgr2=0x7f96a00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:28.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.397+0000 7f96b99c9640 1 --2- 172.21.15.27:0/3112477751 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f96a00a33b0 0x7f96a00a5870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f96ac009fd0 tx=0x7f96ac007040 comp rx=0 tx=0).stop 2024-09-19T08:16:28.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.397+0000 7f96b99c9640 1 -- 172.21.15.27:0/3112477751 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96b4102790 msgr2=0x7f96b4198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:16:28.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.397+0000 7f96b99c9640 1 --2- 172.21.15.27:0/3112477751 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96b4102790 0x7f96b4198af0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f96a4005ab0 tx=0x7f96a40042f0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.397+0000 7f96b99c9640 1 -- 172.21.15.27:0/3112477751 shutdown_connections 2024-09-19T08:16:28.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.397+0000 7f96b99c9640 1 --2- 172.21.15.27:0/3112477751 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f96a00a33b0 0x7f96a00a5870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.397+0000 7f96b99c9640 1 --2- 172.21.15.27:0/3112477751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96b4106f10 0x7f96b419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.397+0000 7f96b99c9640 1 --2- 172.21.15.27:0/3112477751 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96b4102790 0x7f96b4198af0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.397+0000 7f96b99c9640 1 --2- 172.21.15.27:0/3112477751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96b4101de0 0x7f96b41985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:16:28.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.397+0000 7f96b99c9640 1 -- 172.21.15.27:0/3112477751 >> 172.21.15.27:0/3112477751 conn(0x7f96b40fd8c0 msgr2=0x7f96b40fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:16:28.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.397+0000 7f96b99c9640 1 -- 172.21.15.27:0/3112477751 shutdown_connections 2024-09-19T08:16:28.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:16:28.397+0000 7f96b99c9640 1 -- 172.21.15.27:0/3112477751 wait complete. 2024-09-19T08:16:28.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:28 smithi155 ceph-mon[35362]: pgmap v166: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:16:29.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:28 smithi027 ceph-mon[31209]: pgmap v166: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:16:29.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:28 smithi203 ceph-mon[35198]: pgmap v166: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:16:29.317 INFO:tasks.cephfs.filesystem:scrub status for tag:9c6bddd2-1ae5-499b-8fe5-d6d9feda6fe6 - {'path': '/', 'tag': '9c6bddd2-1ae5-499b-8fe5-d6d9feda6fe6', 'options': 'recursive,force'} 2024-09-19T08:16:30.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:30 smithi155 ceph-mon[35362]: pgmap v167: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:16:30.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:30 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:16:31.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:30 smithi027 ceph-mon[31209]: pgmap v167: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:16:31.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:30 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:16:31.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:30 smithi203 ceph-mon[35198]: pgmap v167: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:16:31.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:30 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:16:33.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:32 smithi027 ceph-mon[31209]: pgmap v168: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:16:33.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:32 smithi203 ceph-mon[35198]: pgmap v168: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:16:33.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:32 smithi155 ceph-mon[35362]: pgmap v168: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:16:35.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:34 smithi027 ceph-mon[31209]: pgmap v169: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:16:35.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:34 smithi203 ceph-mon[35198]: pgmap v169: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:16:35.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:34 smithi155 ceph-mon[35362]: pgmap v169: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:16:37.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:36 smithi027 ceph-mon[31209]: pgmap v170: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:16:37.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:36 smithi203 ceph-mon[35198]: pgmap v170: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:16:37.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:36 smithi155 ceph-mon[35362]: pgmap v170: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:16:39.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:38 smithi027 ceph-mon[31209]: pgmap v171: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:16:39.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:38 smithi203 ceph-mon[35198]: pgmap v171: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:16:39.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:38 smithi155 ceph-mon[35362]: pgmap v171: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:16:41.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:40 smithi155 ceph-mon[35362]: pgmap v172: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:41.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:40 smithi027 ceph-mon[31209]: pgmap v172: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:41.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:40 smithi203 ceph-mon[35198]: pgmap v172: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:43.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:42 smithi155 ceph-mon[35362]: pgmap v173: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:43.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:42 smithi027 ceph-mon[31209]: pgmap v173: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:43.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:42 smithi203 ceph-mon[35198]: pgmap v173: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:45.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:44 smithi155 ceph-mon[35362]: pgmap v174: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:16:45.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:44 smithi027 ceph-mon[31209]: pgmap v174: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:16:45.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:44 smithi203 ceph-mon[35198]: pgmap v174: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:16:47.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:46 smithi155 ceph-mon[35362]: pgmap v175: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:47.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:46 smithi027 ceph-mon[31209]: pgmap v175: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:47.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:46 smithi203 ceph-mon[35198]: pgmap v175: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:49.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:48 smithi155 ceph-mon[35362]: pgmap v176: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:16:49.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:48 smithi027 ceph-mon[31209]: pgmap v176: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:16:49.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:48 smithi203 ceph-mon[35198]: pgmap v176: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:16:51.055 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:50 smithi027 ceph-mon[31209]: pgmap v177: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:51.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:50 smithi155 ceph-mon[35362]: pgmap v177: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:51.263 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:50 smithi203 ceph-mon[35198]: pgmap v177: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:53.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:52 smithi155 ceph-mon[35362]: pgmap v178: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:53.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:52 smithi027 ceph-mon[31209]: pgmap v178: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:53.257 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:52 smithi203 ceph-mon[35198]: pgmap v178: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:55.060 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:54 smithi203 ceph-mon[35198]: pgmap v179: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:16:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:54 smithi155 ceph-mon[35362]: pgmap v179: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:16:55.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:54 smithi027 ceph-mon[31209]: pgmap v179: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:16:57.039 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:56 smithi155 ceph-mon[35362]: pgmap v180: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:57.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:56 smithi027 ceph-mon[31209]: pgmap v180: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:57.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:56 smithi203 ceph-mon[35198]: pgmap v180: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:16:59.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:16:58 smithi155 ceph-mon[35362]: pgmap v181: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:16:59.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:16:58 smithi027 ceph-mon[31209]: pgmap v181: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:16:59.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:16:58 smithi203 ceph-mon[35198]: pgmap v181: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:16:59.319 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:16:59.598 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:17:00.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.091+0000 7f48d2e50640 1 -- 172.21.15.27:0/2867847468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48cc100a80 msgr2=0x7f48cc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:00.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.091+0000 7f48d2e50640 1 --2- 172.21.15.27:0/2867847468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48cc100a80 0x7f48cc100ee0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f48b8009930 tx=0x7f48b802a420 comp rx=0 tx=0).stop 2024-09-19T08:17:00.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.091+0000 7f48d2e50640 1 -- 172.21.15.27:0/2867847468 shutdown_connections 2024-09-19T08:17:00.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.091+0000 7f48d2e50640 1 --2- 172.21.15.27:0/2867847468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48cc101420 0x7f48cc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.091+0000 7f48d2e50640 1 --2- 172.21.15.27:0/2867847468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48cc100a80 0x7f48cc100ee0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.091+0000 7f48d2e50640 1 --2- 172.21.15.27:0/2867847468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48cc106a80 0x7f48cc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.091+0000 7f48d2e50640 1 -- 172.21.15.27:0/2867847468 >> 172.21.15.27:0/2867847468 conn(0x7f48cc0fc7a0 msgr2=0x7f48cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:00.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.091+0000 7f48d2e50640 1 -- 172.21.15.27:0/2867847468 shutdown_connections 2024-09-19T08:17:00.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.091+0000 7f48d2e50640 1 -- 172.21.15.27:0/2867847468 wait complete. 2024-09-19T08:17:00.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.091+0000 7f48d2e50640 1 Processor -- start 2024-09-19T08:17:00.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.092+0000 7f48d2e50640 1 -- start start 2024-09-19T08:17:00.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.092+0000 7f48d2e50640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48cc100a80 0x7f48cc19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:00.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.092+0000 7f48d2e50640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48cc101420 0x7f48cc19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:00.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.092+0000 7f48d2e50640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48cc106a80 0x7f48cc19ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.092+0000 7f48d2e50640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc110e40 con 0x7f48cc100a80 2024-09-19T08:17:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.092+0000 7f48d2e50640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc110cc0 con 0x7f48cc101420 2024-09-19T08:17:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.092+0000 7f48d2e50640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc110fc0 con 0x7f48cc106a80 2024-09-19T08:17:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.092+0000 7f48d0bec640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48cc100a80 0x7f48cc19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.092+0000 7f48d0bec640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48cc100a80 0x7f48cc19a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39786/0 (socket says 172.21.15.27:39786) 2024-09-19T08:17:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.092+0000 7f48d0bec640 1 -- 172.21.15.27:0/3763876769 learned_addr learned my addr 172.21.15.27:0/3763876769 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.092+0000 7f48d13ed640 1 --2- 172.21.15.27:0/3763876769 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48cc106a80 0x7f48cc19ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.092+0000 7f48cbfff640 1 --2- 172.21.15.27:0/3763876769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48cc101420 0x7f48cc19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.092+0000 7f48d0bec640 1 -- 172.21.15.27:0/3763876769 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48cc106a80 msgr2=0x7f48cc19ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.092+0000 7f48d0bec640 1 --2- 172.21.15.27:0/3763876769 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48cc106a80 0x7f48cc19ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.092+0000 7f48d0bec640 1 -- 172.21.15.27:0/3763876769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48cc101420 msgr2=0x7f48cc19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:00.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.092+0000 7f48d0bec640 1 --2- 172.21.15.27:0/3763876769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48cc101420 0x7f48cc19aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.092+0000 7f48d0bec640 1 -- 172.21.15.27:0/3763876769 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48cc19f560 con 0x7f48cc100a80 2024-09-19T08:17:00.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.092+0000 7f48cbfff640 1 --2- 172.21.15.27:0/3763876769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48cc101420 0x7f48cc19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:17:00.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.092+0000 7f48d0bec640 1 --2- 172.21.15.27:0/3763876769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48cc100a80 0x7f48cc19a5b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f48c000c920 tx=0x7f48c000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:00.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.092+0000 7f48c9ffb640 1 -- 172.21.15.27:0/3763876769 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c0007c70 con 0x7f48cc100a80 2024-09-19T08:17:00.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.093+0000 7f48d2e50640 1 -- 172.21.15.27:0/3763876769 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48cc19f850 con 0x7f48cc100a80 2024-09-19T08:17:00.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.093+0000 7f48c9ffb640 1 -- 172.21.15.27:0/3763876769 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48c0007e10 con 0x7f48cc100a80 2024-09-19T08:17:00.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.093+0000 7f48c9ffb640 1 -- 172.21.15.27:0/3763876769 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c0018890 con 0x7f48cc100a80 2024-09-19T08:17:00.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.093+0000 7f48d2e50640 1 -- 172.21.15.27:0/3763876769 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48cc1a7130 con 0x7f48cc100a80 2024-09-19T08:17:00.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.095+0000 7f48c9ffb640 1 -- 172.21.15.27:0/3763876769 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f48c0018b10 con 0x7f48cc100a80 2024-09-19T08:17:00.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.095+0000 7f48d5229740 1 Processor -- start 2024-09-19T08:17:00.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.095+0000 7f48d5229740 1 -- start start 2024-09-19T08:17:00.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48d5229740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6cc4a0 0x557dea6cc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:00.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48d5229740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6ccdc0 0x557dea6d7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:00.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48d5229740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6d7680 0x557dea6d9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:00.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48d5229740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x557dea6322e0 con 0x557dea6d7680 2024-09-19T08:17:00.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48d5229740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557dea5d9ce0 con 0x557dea6cc4a0 2024-09-19T08:17:00.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48d5229740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557dea62e2a0 con 0x557dea6ccdc0 2024-09-19T08:17:00.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48cbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6d7680 0x557dea6d9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:00.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48cbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6d7680 0x557dea6d9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39800/0 (socket says 172.21.15.27:39800) 2024-09-19T08:17:00.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48cbfff640 1 -- 172.21.15.27:0/2641099305 learned_addr learned my addr 172.21.15.27:0/2641099305 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:00.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48c9ffb640 1 --2- 172.21.15.27:0/3763876769 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f48bc0a33b0 0x7f48bc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:00.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48d0bec640 1 --2- 172.21.15.27:0/2641099305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6ccdc0 0x557dea6d7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:00.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48d13ed640 1 --2- 172.21.15.27:0/2641099305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6cc4a0 0x557dea6cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:00.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48d13ed640 1 --2- 172.21.15.27:0/3763876769 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f48bc0a33b0 0x7f48bc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:00.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48cbfff640 1 -- 172.21.15.27:0/2641099305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6ccdc0 msgr2=0x557dea6d7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:00.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48cbfff640 1 --2- 172.21.15.27:0/2641099305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6ccdc0 0x557dea6d7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48cbfff640 1 -- 172.21.15.27:0/2641099305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6cc4a0 msgr2=0x557dea6cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:00.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48cbfff640 1 --2- 172.21.15.27:0/2641099305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6cc4a0 0x557dea6cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48cbfff640 1 -- 172.21.15.27:0/2641099305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dea5be440 con 0x557dea6d7680 2024-09-19T08:17:00.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48d13ed640 1 --2- 172.21.15.27:0/2641099305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6cc4a0 0x557dea6cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:17:00.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48d0bec640 1 --2- 172.21.15.27:0/2641099305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6ccdc0 0x557dea6d7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:17:00.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.096+0000 7f48c9ffb640 1 -- 172.21.15.27:0/3763876769 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f48c00cfe40 con 0x7f48cc100a80 2024-09-19T08:17:00.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.097+0000 7f48cbfff640 1 --2- 172.21.15.27:0/2641099305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6d7680 0x557dea6d9a70 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f48b8005ab0 tx=0x7f48b8009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b523d781b771fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:00.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.097+0000 7f48b6ffd640 1 -- 172.21.15.27:0/2641099305 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b803f070 con 0x557dea6d7680 2024-09-19T08:17:00.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.097+0000 7f48d13ed640 1 --2- 172.21.15.27:0/3763876769 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f48bc0a33b0 0x7f48bc0a5870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f48c4013600 tx=0x7f48c4004a40 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:00.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.097+0000 7f48b6ffd640 1 -- 172.21.15.27:0/2641099305 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48b80317b0 con 0x557dea6d7680 2024-09-19T08:17:00.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.097+0000 7f48b6ffd640 1 -- 172.21.15.27:0/2641099305 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b8035070 con 0x557dea6d7680 2024-09-19T08:17:00.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.097+0000 7f48d5229740 1 -- 172.21.15.27:0/2641099305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6d7680 msgr2=0x557dea6d9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:00.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.097+0000 7f48d5229740 1 --2- 172.21.15.27:0/2641099305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6d7680 0x557dea6d9a70 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f48b8005ab0 tx=0x7f48b8009680 comp rx=0 tx=0).stop 2024-09-19T08:17:00.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.098+0000 7f48d5229740 1 -- 172.21.15.27:0/2641099305 shutdown_connections 2024-09-19T08:17:00.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.098+0000 7f48d5229740 1 --2- 172.21.15.27:0/2641099305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6d7680 0x557dea6d9a70 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.098+0000 7f48d5229740 1 --2- 172.21.15.27:0/2641099305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6ccdc0 0x557dea6d7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.098+0000 7f48d5229740 1 --2- 172.21.15.27:0/2641099305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6cc4a0 0x557dea6cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.098+0000 7f48d5229740 1 -- 172.21.15.27:0/2641099305 >> 172.21.15.27:0/2641099305 conn(0x557dea6c8a30 msgr2=0x557dea6c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:00.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.098+0000 7f48d5229740 1 -- 172.21.15.27:0/2641099305 shutdown_connections 2024-09-19T08:17:00.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.098+0000 7f48d5229740 1 -- 172.21.15.27:0/2641099305 wait complete. 2024-09-19T08:17:00.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.098+0000 7f48d5229740 1 -- start start 2024-09-19T08:17:00.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.098+0000 7f48d5229740 1 Processor -- start 2024-09-19T08:17:00.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48d5229740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 0x557dea6d6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:00.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48d5229740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6ccdc0 0x557dea6d4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:00.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48d5229740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6d7680 0x557dea6d46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:00.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48d5229740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x557dea6da250 con 0x557dea6cc4a0 2024-09-19T08:17:00.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48d5229740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557dea5ed050 con 0x557dea6d7680 2024-09-19T08:17:00.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48d5229740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557dea6da3d0 con 0x557dea6ccdc0 2024-09-19T08:17:00.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48d5229740 10 client.0 _ll_register_callbacks cb 0x557dea62d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:00.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48d0bec640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 0x557dea6d6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:00.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48d0bec640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 0x557dea6d6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39814/0 (socket says 172.21.15.27:39814) 2024-09-19T08:17:00.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48d0bec640 1 -- 172.21.15.27:0/1701650349 learned_addr learned my addr 172.21.15.27:0/1701650349 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:00.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48d13ed640 1 --2- 172.21.15.27:0/1701650349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6d7680 0x557dea6d46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:00.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48cbfff640 1 --2- 172.21.15.27:0/1701650349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6ccdc0 0x557dea6d4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:00.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48d0bec640 1 -- 172.21.15.27:0/1701650349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6ccdc0 msgr2=0x557dea6d4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:00.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48d0bec640 1 --2- 172.21.15.27:0/1701650349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6ccdc0 0x557dea6d4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48d0bec640 1 -- 172.21.15.27:0/1701650349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6d7680 msgr2=0x557dea6d46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:00.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48d0bec640 1 --2- 172.21.15.27:0/1701650349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6d7680 0x557dea6d46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48d0bec640 1 -- 172.21.15.27:0/1701650349 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dea3a33c0 con 0x557dea6cc4a0 2024-09-19T08:17:00.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48d13ed640 1 --2- 172.21.15.27:0/1701650349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6d7680 0x557dea6d46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:17:00.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48d0bec640 1 --2- 172.21.15.27:0/1701650349 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 0x557dea6d6ee0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f48c0007590 tx=0x7f48c006bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349e56f2bc443484 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:00.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48abfff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:00.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48abfff640 1 -- 172.21.15.27:0/1701650349 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c009c170 con 0x557dea6cc4a0 2024-09-19T08:17:00.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48abfff640 1 -- 172.21.15.27:0/1701650349 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f48c0018e00 con 0x557dea6cc4a0 2024-09-19T08:17:00.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.099+0000 7f48d5229740 1 -- 172.21.15.27:0/1701650349 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48b80317b0 con 0x557dea6cc4a0 2024-09-19T08:17:00.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.100+0000 7f48abfff640 1 -- 172.21.15.27:0/1701650349 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f48c00a0520 con 0x557dea6cc4a0 2024-09-19T08:17:00.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.100+0000 7f48d5229740 10 client.16296 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:00.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.100+0000 7f48d5229740 1 -- 172.21.15.27:0/1701650349 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557dea6e5ba0 con 0x557dea6cc4a0 2024-09-19T08:17:00.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.100+0000 7f48abfff640 1 -- 172.21.15.27:0/1701650349 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48b80317b0 con 0x557dea6cc4a0 2024-09-19T08:17:00.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.100+0000 7f48abfff640 1 -- 172.21.15.27:0/1701650349 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f48c00d1030 con 0x557dea6cc4a0 2024-09-19T08:17:00.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.100+0000 7f48d5229740 10 client.16296 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:00.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.100+0000 7f48d5229740 10 client.16296 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:00.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.100+0000 7f48d5229740 20 client.16296 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:00.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.100+0000 7f48d5229740 1 --2- 172.21.15.27:0/1701650349 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x557dea6e7060 0x557dea6e9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:00.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.100+0000 7f48d5229740 4 client.16296 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:17:00.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.100+0000 7f48d5229740 1 -- 172.21.15.27:0/1701650349 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557dea63f850 con 0x557dea6e7060 2024-09-19T08:17:00.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.100+0000 7f48cbfff640 1 --2- 172.21.15.27:0/1701650349 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x557dea6e7060 0x557dea6e9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:00.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.101+0000 7f48cbfff640 1 --2- 172.21.15.27:0/1701650349 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x557dea6e7060 0x557dea6e9490 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=595c3f4f09111c18 server_cookie=e9464e2fe858eb4b in_seq=0 out_seq=0 2024-09-19T08:17:00.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.101+0000 7f48abfff640 10 client.16296 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:00.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.101+0000 7f48abfff640 1 -- 172.21.15.27:0/1701650349 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557dea63f850 con 0x557dea6e7060 2024-09-19T08:17:00.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.101+0000 7f48abfff640 10 client.16296 handle_command_reply: tid=0 2024-09-19T08:17:00.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.102+0000 7f48d5229740 1 client.16296 shutdown 2024-09-19T08:17:00.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.102+0000 7f48d5229740 1 -- 172.21.15.27:0/1701650349 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 msgr2=0x557dea6d6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:00.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.102+0000 7f48d5229740 1 --2- 172.21.15.27:0/1701650349 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 0x557dea6d6ee0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f48c0007590 tx=0x7f48c006bd90 comp rx=0 tx=0).stop 2024-09-19T08:17:00.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.102+0000 7f48d5229740 1 -- 172.21.15.27:0/1701650349 shutdown_connections 2024-09-19T08:17:00.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.102+0000 7f48d5229740 1 --2- 172.21.15.27:0/1701650349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6d7680 0x557dea6d46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.102+0000 7f48d5229740 1 --2- 172.21.15.27:0/1701650349 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x557dea6e7060 0x557dea6e9490 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.102+0000 7f48abfff640 0 client.16296 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:00.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.102+0000 7f48d5229740 1 --2- 172.21.15.27:0/1701650349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6ccdc0 0x557dea6d4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.102+0000 7f48d5229740 1 --2- 172.21.15.27:0/1701650349 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 0x557dea6d6ee0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.102+0000 7f48d5229740 1 -- 172.21.15.27:0/1701650349 >> 172.21.15.27:0/1701650349 conn(0x557dea6c8a30 msgr2=0x557dea6ce710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:00.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.102+0000 7f48d5229740 1 -- 172.21.15.27:0/1701650349 shutdown_connections 2024-09-19T08:17:00.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.102+0000 7f48d5229740 1 -- 172.21.15.27:0/1701650349 wait complete. 2024-09-19T08:17:00.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.102+0000 7f48d5229740 20 client.16296 trim_cache size 0 max 16384 2024-09-19T08:17:00.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.119+0000 7f48d5229740 1 Processor -- start 2024-09-19T08:17:00.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.119+0000 7f48d5229740 1 -- start start 2024-09-19T08:17:00.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.119+0000 7f48d5229740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 0x557dea6cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:00.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.119+0000 7f48d5229740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6ccdc0 0x557dea6eed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:00.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.119+0000 7f48d5229740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6d7680 0x557dea6ef240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:00.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.119+0000 7f48d5229740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc1ad890 con 0x557dea6cc4a0 2024-09-19T08:17:00.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.119+0000 7f48d5229740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc1b0130 con 0x557dea6ccdc0 2024-09-19T08:17:00.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.119+0000 7f48d5229740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc1adf20 con 0x557dea6d7680 2024-09-19T08:17:00.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.120+0000 7f48d0bec640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 0x557dea6cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:00.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.120+0000 7f48d0bec640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 0x557dea6cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39818/0 (socket says 172.21.15.27:39818) 2024-09-19T08:17:00.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.120+0000 7f48d0bec640 1 -- 172.21.15.27:0/851620188 learned_addr learned my addr 172.21.15.27:0/851620188 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:00.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.120+0000 7f48d13ed640 1 --2- 172.21.15.27:0/851620188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6d7680 0x557dea6ef240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:00.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.120+0000 7f48d0bec640 1 -- 172.21.15.27:0/851620188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6d7680 msgr2=0x557dea6ef240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:00.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.120+0000 7f48d0bec640 1 --2- 172.21.15.27:0/851620188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6d7680 0x557dea6ef240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.120+0000 7f48d0bec640 1 -- 172.21.15.27:0/851620188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6ccdc0 msgr2=0x557dea6eed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:00.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.120+0000 7f48d0bec640 1 --2- 172.21.15.27:0/851620188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6ccdc0 0x557dea6eed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.120+0000 7f48d0bec640 1 -- 172.21.15.27:0/851620188 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dea6c8860 con 0x557dea6cc4a0 2024-09-19T08:17:00.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.120+0000 7f48d13ed640 1 --2- 172.21.15.27:0/851620188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6d7680 0x557dea6ef240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:17:00.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.120+0000 7f48d0bec640 1 --2- 172.21.15.27:0/851620188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 0x557dea6cf7f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f48c009c100 tx=0x7f48c00076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2563e050ee410f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:00.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.120+0000 7f48b67fc640 1 -- 172.21.15.27:0/851620188 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c00b4030 con 0x557dea6cc4a0 2024-09-19T08:17:00.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.120+0000 7f48b67fc640 1 -- 172.21.15.27:0/851620188 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48c00a4de0 con 0x557dea6cc4a0 2024-09-19T08:17:00.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.120+0000 7f48b67fc640 1 -- 172.21.15.27:0/851620188 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c00987e0 con 0x557dea6cc4a0 2024-09-19T08:17:00.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.121+0000 7f48d5229740 1 -- 172.21.15.27:0/851620188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 msgr2=0x557dea6cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:00.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.121+0000 7f48d5229740 1 --2- 172.21.15.27:0/851620188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 0x557dea6cf7f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f48c009c100 tx=0x7f48c00076c0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.121+0000 7f48d5229740 1 -- 172.21.15.27:0/851620188 shutdown_connections 2024-09-19T08:17:00.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.121+0000 7f48d5229740 1 --2- 172.21.15.27:0/851620188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6d7680 0x557dea6ef240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.121+0000 7f48d5229740 1 --2- 172.21.15.27:0/851620188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6ccdc0 0x557dea6eed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.121+0000 7f48d5229740 1 --2- 172.21.15.27:0/851620188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 0x557dea6cf7f0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.121+0000 7f48d5229740 1 -- 172.21.15.27:0/851620188 >> 172.21.15.27:0/851620188 conn(0x557dea6c8a30 msgr2=0x557dea6cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:00.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.121+0000 7f48d5229740 1 -- 172.21.15.27:0/851620188 shutdown_connections 2024-09-19T08:17:00.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.121+0000 7f48d5229740 1 -- 172.21.15.27:0/851620188 wait complete. 2024-09-19T08:17:00.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.121+0000 7f48d5229740 1 -- start start 2024-09-19T08:17:00.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.121+0000 7f48d5229740 1 Processor -- start 2024-09-19T08:17:00.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.122+0000 7f48d5229740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 0x557dea6dfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:00.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.122+0000 7f48d5229740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6ccdc0 0x557dea6dafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:00.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.122+0000 7f48d5229740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6d7680 0x557dea6db520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:00.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.122+0000 7f48d5229740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc1ae5f0 con 0x557dea6cc4a0 2024-09-19T08:17:00.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.122+0000 7f48d5229740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc1afa60 con 0x557dea6d7680 2024-09-19T08:17:00.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.122+0000 7f48d5229740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc1aecc0 con 0x557dea6ccdc0 2024-09-19T08:17:00.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.122+0000 7f48d5229740 10 client.0 _ll_register_callbacks cb 0x7f48c000c870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:00.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.122+0000 7f48d0bec640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 0x557dea6dfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:00.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.122+0000 7f48d0bec640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 0x557dea6dfcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39826/0 (socket says 172.21.15.27:39826) 2024-09-19T08:17:00.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.122+0000 7f48d0bec640 1 -- 172.21.15.27:0/3080613318 learned_addr learned my addr 172.21.15.27:0/3080613318 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:00.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.122+0000 7f48cbfff640 1 --2- 172.21.15.27:0/3080613318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6ccdc0 0x557dea6dafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:00.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.122+0000 7f48d13ed640 1 --2- 172.21.15.27:0/3080613318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6d7680 0x557dea6db520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:00.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.122+0000 7f48d0bec640 1 -- 172.21.15.27:0/3080613318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6ccdc0 msgr2=0x557dea6dafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:00.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.122+0000 7f48d0bec640 1 --2- 172.21.15.27:0/3080613318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6ccdc0 0x557dea6dafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.122+0000 7f48d0bec640 1 -- 172.21.15.27:0/3080613318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6d7680 msgr2=0x557dea6db520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:00.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.122+0000 7f48d0bec640 1 --2- 172.21.15.27:0/3080613318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6d7680 0x557dea6db520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.122+0000 7f48d0bec640 1 -- 172.21.15.27:0/3080613318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dea6dbd00 con 0x557dea6cc4a0 2024-09-19T08:17:00.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.123+0000 7f48d0bec640 1 --2- 172.21.15.27:0/3080613318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 0x557dea6dfcb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f48c00cdbe0 tx=0x7f48c000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ed3215b5353bc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:00.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.123+0000 7f48abfff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:00.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.123+0000 7f48abfff640 1 -- 172.21.15.27:0/3080613318 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c00b4070 con 0x557dea6cc4a0 2024-09-19T08:17:00.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.123+0000 7f48abfff640 1 -- 172.21.15.27:0/3080613318 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f48c009b5c0 con 0x557dea6cc4a0 2024-09-19T08:17:00.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.123+0000 7f48d5229740 1 -- 172.21.15.27:0/3080613318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48c00a4de0 con 0x557dea6cc4a0 2024-09-19T08:17:00.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.123+0000 7f48abfff640 1 -- 172.21.15.27:0/3080613318 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f48c0065070 con 0x557dea6cc4a0 2024-09-19T08:17:00.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.123+0000 7f48d5229740 10 client.16302 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:00.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.123+0000 7f48d5229740 1 -- 172.21.15.27:0/3080613318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557dea751ba0 con 0x557dea6cc4a0 2024-09-19T08:17:00.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.123+0000 7f48abfff640 1 -- 172.21.15.27:0/3080613318 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48c00a4de0 con 0x557dea6cc4a0 2024-09-19T08:17:00.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.123+0000 7f48abfff640 1 -- 172.21.15.27:0/3080613318 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f48c0096ce0 con 0x557dea6cc4a0 2024-09-19T08:17:00.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.123+0000 7f48d5229740 10 client.16302 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:00.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.123+0000 7f48d5229740 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:00.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.123+0000 7f48d5229740 20 client.16302 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:00.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.123+0000 7f48d5229740 1 --2- 172.21.15.27:0/3080613318 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x557dea751fd0 0x557dea7543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:00.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.123+0000 7f48d5229740 4 client.16302 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:17:00.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.123+0000 7f48d5229740 1 -- 172.21.15.27:0/3080613318 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557dea639d60 con 0x557dea751fd0 2024-09-19T08:17:00.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.124+0000 7f48cbfff640 1 --2- 172.21.15.27:0/3080613318 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x557dea751fd0 0x557dea7543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:00.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.124+0000 7f48cbfff640 1 --2- 172.21.15.27:0/3080613318 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x557dea751fd0 0x557dea7543c0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8973682d49ad7c8a server_cookie=a1a63583c7707583 in_seq=0 out_seq=0 2024-09-19T08:17:00.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.124+0000 7f48abfff640 10 client.16302 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:00.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.125+0000 7f48abfff640 1 -- 172.21.15.27:0/3080613318 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557dea639d60 con 0x557dea751fd0 2024-09-19T08:17:00.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.125+0000 7f48abfff640 10 client.16302 handle_command_reply: tid=0 2024-09-19T08:17:00.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.125+0000 7f48d5229740 1 client.16302 shutdown 2024-09-19T08:17:00.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.125+0000 7f48d5229740 1 -- 172.21.15.27:0/3080613318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 msgr2=0x557dea6dfcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:00.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.125+0000 7f48d5229740 1 --2- 172.21.15.27:0/3080613318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 0x557dea6dfcb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f48c00cdbe0 tx=0x7f48c000cf90 comp rx=0 tx=0).stop 2024-09-19T08:17:00.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.125+0000 7f48d5229740 1 -- 172.21.15.27:0/3080613318 shutdown_connections 2024-09-19T08:17:00.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.125+0000 7f48d5229740 1 --2- 172.21.15.27:0/3080613318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557dea6d7680 0x557dea6db520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.125+0000 7f48d5229740 1 --2- 172.21.15.27:0/3080613318 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x557dea751fd0 0x557dea7543c0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.125+0000 7f48d5229740 1 --2- 172.21.15.27:0/3080613318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557dea6ccdc0 0x557dea6dafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.125+0000 7f48abfff640 0 client.16302 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:00.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.125+0000 7f48d5229740 1 --2- 172.21.15.27:0/3080613318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557dea6cc4a0 0x557dea6dfcb0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.125+0000 7f48d5229740 1 -- 172.21.15.27:0/3080613318 >> 172.21.15.27:0/3080613318 conn(0x557dea6c8a30 msgr2=0x557dea6c7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:00.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.125+0000 7f48d5229740 1 -- 172.21.15.27:0/3080613318 shutdown_connections 2024-09-19T08:17:00.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.125+0000 7f48d5229740 1 -- 172.21.15.27:0/3080613318 wait complete. 2024-09-19T08:17:00.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.125+0000 7f48d5229740 20 client.16302 trim_cache size 0 max 16384 2024-09-19T08:17:00.133 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:17:00.133 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:17:00.134 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:17:00.134 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:17:00.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.126+0000 7f48d2e50640 1 -- 172.21.15.27:0/3763876769 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f48bc0a33b0 msgr2=0x7f48bc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:00.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.126+0000 7f48d2e50640 1 --2- 172.21.15.27:0/3763876769 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f48bc0a33b0 0x7f48bc0a5870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f48c4013600 tx=0x7f48c4004a40 comp rx=0 tx=0).stop 2024-09-19T08:17:00.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.126+0000 7f48d2e50640 1 -- 172.21.15.27:0/3763876769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48cc100a80 msgr2=0x7f48cc19a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:00.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.126+0000 7f48d2e50640 1 --2- 172.21.15.27:0/3763876769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48cc100a80 0x7f48cc19a5b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f48c000c920 tx=0x7f48c000cde0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.126+0000 7f48d2e50640 1 -- 172.21.15.27:0/3763876769 shutdown_connections 2024-09-19T08:17:00.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.126+0000 7f48d2e50640 1 --2- 172.21.15.27:0/3763876769 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f48bc0a33b0 0x7f48bc0a5870 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.126+0000 7f48d2e50640 1 --2- 172.21.15.27:0/3763876769 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48cc106a80 0x7f48cc19ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.126+0000 7f48d2e50640 1 --2- 172.21.15.27:0/3763876769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48cc101420 0x7f48cc19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.126+0000 7f48d2e50640 1 --2- 172.21.15.27:0/3763876769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48cc100a80 0x7f48cc19a5b0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:00.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.126+0000 7f48d2e50640 1 -- 172.21.15.27:0/3763876769 >> 172.21.15.27:0/3763876769 conn(0x7f48cc0fc7a0 msgr2=0x7f48cc10c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:00.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.126+0000 7f48d2e50640 1 -- 172.21.15.27:0/3763876769 shutdown_connections 2024-09-19T08:17:00.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:00.126+0000 7f48d2e50640 1 -- 172.21.15.27:0/3763876769 wait complete. 2024-09-19T08:17:01.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:00 smithi027 ceph-mon[31209]: pgmap v182: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:01.060 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:17:01.060 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:17:01.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:00 smithi155 ceph-mon[35362]: pgmap v182: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:01.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:00 smithi203 ceph-mon[35198]: pgmap v182: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:01.323 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:17:01.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.825+0000 7fdc2846a640 1 -- 172.21.15.27:0/1251949287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc20100a80 msgr2=0x7fdc20100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:01.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.825+0000 7fdc2846a640 1 --2- 172.21.15.27:0/1251949287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc20100a80 0x7fdc20100ee0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c009930 tx=0x7fdc1c02a420 comp rx=0 tx=0).stop 2024-09-19T08:17:01.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.825+0000 7fdc2846a640 1 -- 172.21.15.27:0/1251949287 shutdown_connections 2024-09-19T08:17:01.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.825+0000 7fdc2846a640 1 --2- 172.21.15.27:0/1251949287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc20101420 0x7fdc2010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:01.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.825+0000 7fdc2846a640 1 --2- 172.21.15.27:0/1251949287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc20100a80 0x7fdc20100ee0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:01.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.825+0000 7fdc2846a640 1 --2- 172.21.15.27:0/1251949287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdc20106a80 0x7fdc20106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:01.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.825+0000 7fdc2846a640 1 -- 172.21.15.27:0/1251949287 >> 172.21.15.27:0/1251949287 conn(0x7fdc200fc7a0 msgr2=0x7fdc200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:01.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.825+0000 7fdc2846a640 1 -- 172.21.15.27:0/1251949287 shutdown_connections 2024-09-19T08:17:01.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.825+0000 7fdc2846a640 1 -- 172.21.15.27:0/1251949287 wait complete. 2024-09-19T08:17:01.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.825+0000 7fdc2846a640 1 Processor -- start 2024-09-19T08:17:01.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.825+0000 7fdc2846a640 1 -- start start 2024-09-19T08:17:01.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.826+0000 7fdc2846a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc20100a80 0x7fdc20199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:01.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.826+0000 7fdc2846a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc20101420 0x7fdc20199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:01.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.826+0000 7fdc2846a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdc20106a80 0x7fdc201a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:01.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.826+0000 7fdc2846a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fdc20110e80 con 0x7fdc20101420 2024-09-19T08:17:01.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.826+0000 7fdc2846a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdc20110d00 con 0x7fdc20100a80 2024-09-19T08:17:01.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.826+0000 7fdc2846a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdc20111000 con 0x7fdc20106a80 2024-09-19T08:17:01.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.826+0000 7fdc25a05640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc20101420 0x7fdc20199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:01.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.826+0000 7fdc25a05640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc20101420 0x7fdc20199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33862/0 (socket says 172.21.15.27:33862) 2024-09-19T08:17:01.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.826+0000 7fdc25a05640 1 -- 172.21.15.27:0/3334200162 learned_addr learned my addr 172.21.15.27:0/3334200162 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:01.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.826+0000 7fdc26206640 1 --2- 172.21.15.27:0/3334200162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc20100a80 0x7fdc20199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:01.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.826+0000 7fdc26a07640 1 --2- 172.21.15.27:0/3334200162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdc20106a80 0x7fdc201a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:01.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.826+0000 7fdc25a05640 1 -- 172.21.15.27:0/3334200162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdc20106a80 msgr2=0x7fdc201a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:01.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.826+0000 7fdc25a05640 1 --2- 172.21.15.27:0/3334200162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdc20106a80 0x7fdc201a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:01.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.826+0000 7fdc25a05640 1 -- 172.21.15.27:0/3334200162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc20100a80 msgr2=0x7fdc20199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:01.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.826+0000 7fdc25a05640 1 --2- 172.21.15.27:0/3334200162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc20100a80 0x7fdc20199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:01.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.826+0000 7fdc25a05640 1 -- 172.21.15.27:0/3334200162 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc201a48d0 con 0x7fdc20101420 2024-09-19T08:17:01.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.826+0000 7fdc26a07640 1 --2- 172.21.15.27:0/3334200162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdc20106a80 0x7fdc201a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:17:01.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.826+0000 7fdc25a05640 1 --2- 172.21.15.27:0/3334200162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc20101420 0x7fdc20199850 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c009230 tx=0x7fdc1c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:01.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.827+0000 7fdc177fe640 1 -- 172.21.15.27:0/3334200162 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c03f030 con 0x7fdc20101420 2024-09-19T08:17:01.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.827+0000 7fdc2846a640 1 -- 172.21.15.27:0/3334200162 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc201a4aa0 con 0x7fdc20101420 2024-09-19T08:17:01.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.827+0000 7fdc177fe640 1 -- 172.21.15.27:0/3334200162 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc1c003ad0 con 0x7fdc20101420 2024-09-19T08:17:01.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.827+0000 7fdc177fe640 1 -- 172.21.15.27:0/3334200162 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c035070 con 0x7fdc20101420 2024-09-19T08:17:01.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.827+0000 7fdc2846a640 1 -- 172.21.15.27:0/3334200162 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc201a4f50 con 0x7fdc20101420 2024-09-19T08:17:01.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.828+0000 7fdc2846a640 1 -- 172.21.15.27:0/3334200162 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc20100ee0 con 0x7fdc20101420 2024-09-19T08:17:01.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.829+0000 7fdc177fe640 1 -- 172.21.15.27:0/3334200162 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fdc1c042030 con 0x7fdc20101420 2024-09-19T08:17:01.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.830+0000 7fdc177fe640 1 --2- 172.21.15.27:0/3334200162 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fdc0c0a33b0 0x7fdc0c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:01.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.830+0000 7fdc26206640 1 --2- 172.21.15.27:0/3334200162 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fdc0c0a33b0 0x7fdc0c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:01.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.830+0000 7fdc177fe640 1 -- 172.21.15.27:0/3334200162 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fdc1c0f0600 con 0x7fdc20101420 2024-09-19T08:17:01.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.830+0000 7fdc26206640 1 --2- 172.21.15.27:0/3334200162 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fdc0c0a33b0 0x7fdc0c0a5870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdc10005fd0 tx=0x7fdc1000b390 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:01.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:01.833+0000 7fdc177fe640 1 -- 172.21.15.27:0/3334200162 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdc1c0bd030 con 0x7fdc20101420 2024-09-19T08:17:02.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:02.045+0000 7fdc2846a640 1 -- 172.21.15.27:0/3334200162 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc20108ff0 con 0x7fdc20101420 2024-09-19T08:17:02.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:02.046+0000 7fdc177fe640 1 -- 172.21.15.27:0/3334200162 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7fdc1c0bc930 con 0x7fdc20101420 2024-09-19T08:17:02.045 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:17:02.045 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:17:02.046 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:17:02.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:02.048+0000 7fdc2846a640 1 -- 172.21.15.27:0/3334200162 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fdc0c0a33b0 msgr2=0x7fdc0c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:02.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:02.048+0000 7fdc2846a640 1 --2- 172.21.15.27:0/3334200162 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fdc0c0a33b0 0x7fdc0c0a5870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdc10005fd0 tx=0x7fdc1000b390 comp rx=0 tx=0).stop 2024-09-19T08:17:02.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:02.048+0000 7fdc2846a640 1 -- 172.21.15.27:0/3334200162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc20101420 msgr2=0x7fdc20199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:02.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:02.048+0000 7fdc2846a640 1 --2- 172.21.15.27:0/3334200162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc20101420 0x7fdc20199850 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c009230 tx=0x7fdc1c004270 comp rx=0 tx=0).stop 2024-09-19T08:17:02.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:02.048+0000 7fdc2846a640 1 -- 172.21.15.27:0/3334200162 shutdown_connections 2024-09-19T08:17:02.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:02.048+0000 7fdc2846a640 1 --2- 172.21.15.27:0/3334200162 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fdc0c0a33b0 0x7fdc0c0a5870 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:02.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:02.048+0000 7fdc2846a640 1 --2- 172.21.15.27:0/3334200162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdc20106a80 0x7fdc201a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:02.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:02.048+0000 7fdc2846a640 1 --2- 172.21.15.27:0/3334200162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc20101420 0x7fdc20199850 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:02.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:02.048+0000 7fdc2846a640 1 --2- 172.21.15.27:0/3334200162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc20100a80 0x7fdc20199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:02.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:02.048+0000 7fdc2846a640 1 -- 172.21.15.27:0/3334200162 >> 172.21.15.27:0/3334200162 conn(0x7fdc200fc7a0 msgr2=0x7fdc200fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:02.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:02.048+0000 7fdc2846a640 1 -- 172.21.15.27:0/3334200162 shutdown_connections 2024-09-19T08:17:02.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:02.048+0000 7fdc2846a640 1 -- 172.21.15.27:0/3334200162 wait complete. 2024-09-19T08:17:02.796 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:17:03.056 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:17:03.177 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:02 smithi027 ceph-mon[31209]: pgmap v183: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:03.178 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:02 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3334200162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:17:03.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:02 smithi155 ceph-mon[35362]: pgmap v183: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:03.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:02 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3334200162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:17:03.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:02 smithi203 ceph-mon[35198]: pgmap v183: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:03.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:02 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3334200162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:17:03.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.544+0000 7f76f524e640 1 -- 172.21.15.27:0/3703928698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76f0100a80 msgr2=0x7f76f0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:03.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.544+0000 7f76f524e640 1 --2- 172.21.15.27:0/3703928698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76f0100a80 0x7f76f0100ee0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f76d8009930 tx=0x7f76d802a420 comp rx=0 tx=0).stop 2024-09-19T08:17:03.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.544+0000 7f76f524e640 1 -- 172.21.15.27:0/3703928698 shutdown_connections 2024-09-19T08:17:03.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.544+0000 7f76f524e640 1 --2- 172.21.15.27:0/3703928698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76f0101420 0x7f76f010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.544+0000 7f76f524e640 1 --2- 172.21.15.27:0/3703928698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76f0100a80 0x7f76f0100ee0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.544+0000 7f76f524e640 1 --2- 172.21.15.27:0/3703928698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76f0106a80 0x7f76f0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.544+0000 7f76f524e640 1 -- 172.21.15.27:0/3703928698 >> 172.21.15.27:0/3703928698 conn(0x7f76f00fc7a0 msgr2=0x7f76f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:03.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.544+0000 7f76f524e640 1 -- 172.21.15.27:0/3703928698 shutdown_connections 2024-09-19T08:17:03.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.544+0000 7f76f524e640 1 -- 172.21.15.27:0/3703928698 wait complete. 2024-09-19T08:17:03.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.545+0000 7f76f524e640 1 Processor -- start 2024-09-19T08:17:03.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.545+0000 7f76f524e640 1 -- start start 2024-09-19T08:17:03.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.545+0000 7f76f524e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76f0100a80 0x7f76f0199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:03.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.545+0000 7f76f524e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76f0101420 0x7f76f0199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:03.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.545+0000 7f76f524e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76f0106a80 0x7f76f01a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:03.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.545+0000 7f76f524e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f76f0110ea0 con 0x7f76f0100a80 2024-09-19T08:17:03.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.545+0000 7f76f524e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f76f0110d20 con 0x7f76f0101420 2024-09-19T08:17:03.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.545+0000 7f76f524e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f76f0111020 con 0x7f76f0106a80 2024-09-19T08:17:03.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.545+0000 7f76eed9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76f0100a80 0x7f76f0199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:03.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.545+0000 7f76eed9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76f0100a80 0x7f76f0199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33878/0 (socket says 172.21.15.27:33878) 2024-09-19T08:17:03.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.545+0000 7f76eed9d640 1 -- 172.21.15.27:0/709780776 learned_addr learned my addr 172.21.15.27:0/709780776 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:03.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.545+0000 7f76ee59c640 1 --2- 172.21.15.27:0/709780776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76f0101420 0x7f76f0199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:03.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.546+0000 7f76ef59e640 1 --2- 172.21.15.27:0/709780776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76f0106a80 0x7f76f01a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:03.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.546+0000 7f76eed9d640 1 -- 172.21.15.27:0/709780776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76f0106a80 msgr2=0x7f76f01a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:03.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.546+0000 7f76eed9d640 1 --2- 172.21.15.27:0/709780776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76f0106a80 0x7f76f01a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.546+0000 7f76eed9d640 1 -- 172.21.15.27:0/709780776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76f0101420 msgr2=0x7f76f0199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:03.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.546+0000 7f76eed9d640 1 --2- 172.21.15.27:0/709780776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76f0101420 0x7f76f0199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.546+0000 7f76eed9d640 1 -- 172.21.15.27:0/709780776 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f01a4910 con 0x7f76f0100a80 2024-09-19T08:17:03.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.546+0000 7f76ee59c640 1 --2- 172.21.15.27:0/709780776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76f0101420 0x7f76f0199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:17:03.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.546+0000 7f76eed9d640 1 --2- 172.21.15.27:0/709780776 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76f0100a80 0x7f76f0199350 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f76e000ba50 tx=0x7f76e000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:03.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.546+0000 7f76e7fff640 1 -- 172.21.15.27:0/709780776 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e0019070 con 0x7f76f0100a80 2024-09-19T08:17:03.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.546+0000 7f76f524e640 1 -- 172.21.15.27:0/709780776 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f01a4ae0 con 0x7f76f0100a80 2024-09-19T08:17:03.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.546+0000 7f76e7fff640 1 -- 172.21.15.27:0/709780776 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76e000cbe0 con 0x7f76f0100a80 2024-09-19T08:17:03.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.546+0000 7f76e7fff640 1 -- 172.21.15.27:0/709780776 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e00076e0 con 0x7f76f0100a80 2024-09-19T08:17:03.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.546+0000 7f76f524e640 1 -- 172.21.15.27:0/709780776 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f01a4ff0 con 0x7f76f0100a80 2024-09-19T08:17:03.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.548+0000 7f76e7fff640 1 -- 172.21.15.27:0/709780776 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f76e001c070 con 0x7f76f0100a80 2024-09-19T08:17:03.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.549+0000 7f76f7627740 1 Processor -- start 2024-09-19T08:17:03.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.549+0000 7f76f7627740 1 -- start start 2024-09-19T08:17:03.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.549+0000 7f76f7627740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563d7d41eb40 0x563d7d41d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:03.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.549+0000 7f76f7627740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d41d5d0 0x563d7d41da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:03.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.549+0000 7f76f7627740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d428370 0x563d7d42a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:03.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.549+0000 7f76f7627740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x563d7d3832f0 con 0x563d7d428370 2024-09-19T08:17:03.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.549+0000 7f76f7627740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563d7d32acf0 con 0x563d7d41d5d0 2024-09-19T08:17:03.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.549+0000 7f76f7627740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563d7d37f2b0 con 0x563d7d41eb40 2024-09-19T08:17:03.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.549+0000 7f76ee59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d428370 0x563d7d42a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:03.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.549+0000 7f76ef59e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563d7d41eb40 0x563d7d41d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:03.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.549+0000 7f76ee59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d428370 0x563d7d42a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33892/0 (socket says 172.21.15.27:33892) 2024-09-19T08:17:03.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.549+0000 7f76ee59c640 1 -- 172.21.15.27:0/61796116 learned_addr learned my addr 172.21.15.27:0/61796116 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:03.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.549+0000 7f76eed9d640 1 --2- 172.21.15.27:0/61796116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d41d5d0 0x563d7d41da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:03.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.550+0000 7f76ef59e640 1 -- 172.21.15.27:0/61796116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d41d5d0 msgr2=0x563d7d41da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:03.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.550+0000 7f76ef59e640 1 --2- 172.21.15.27:0/61796116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d41d5d0 0x563d7d41da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.550+0000 7f76ef59e640 1 -- 172.21.15.27:0/61796116 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d428370 msgr2=0x563d7d42a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:03.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.550+0000 7f76ef59e640 1 --2- 172.21.15.27:0/61796116 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d428370 0x563d7d42a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.550+0000 7f76ef59e640 1 -- 172.21.15.27:0/61796116 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d7d30f3a0 con 0x563d7d41eb40 2024-09-19T08:17:03.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.550+0000 7f76ee59c640 1 --2- 172.21.15.27:0/61796116 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d428370 0x563d7d42a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:17:03.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.550+0000 7f76e7fff640 1 --2- 172.21.15.27:0/709780776 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f76dc0a33b0 0x7f76dc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:03.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.550+0000 7f76eed9d640 1 --2- 172.21.15.27:0/709780776 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f76dc0a33b0 0x7f76dc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:03.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.550+0000 7f76ef59e640 1 --2- 172.21.15.27:0/61796116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563d7d41eb40 0x563d7d41d090 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f76e800bb60 tx=0x7f76e800f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c73b330e624048e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:03.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.550+0000 7f76e7fff640 1 -- 172.21.15.27:0/709780776 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f76e00cf250 con 0x7f76f0100a80 2024-09-19T08:17:03.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.550+0000 7f76e57fa640 1 -- 172.21.15.27:0/61796116 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8015070 con 0x563d7d41eb40 2024-09-19T08:17:03.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.550+0000 7f76e57fa640 1 -- 172.21.15.27:0/61796116 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76e800be50 con 0x563d7d41eb40 2024-09-19T08:17:03.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.550+0000 7f76e57fa640 1 -- 172.21.15.27:0/61796116 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8011440 con 0x563d7d41eb40 2024-09-19T08:17:03.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.551+0000 7f76f7627740 1 -- 172.21.15.27:0/61796116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563d7d41eb40 msgr2=0x563d7d41d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:03.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.551+0000 7f76f7627740 1 --2- 172.21.15.27:0/61796116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563d7d41eb40 0x563d7d41d090 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f76e800bb60 tx=0x7f76e800f730 comp rx=0 tx=0).stop 2024-09-19T08:17:03.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.551+0000 7f76eed9d640 1 --2- 172.21.15.27:0/709780776 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f76dc0a33b0 0x7f76dc0a5870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f76e00ccbb0 tx=0x7f76e00d2da0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:03.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.551+0000 7f76f7627740 1 -- 172.21.15.27:0/61796116 shutdown_connections 2024-09-19T08:17:03.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.551+0000 7f76f7627740 1 --2- 172.21.15.27:0/61796116 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d428370 0x563d7d42a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.551+0000 7f76f7627740 1 --2- 172.21.15.27:0/61796116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d41d5d0 0x563d7d41da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.551+0000 7f76f7627740 1 --2- 172.21.15.27:0/61796116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563d7d41eb40 0x563d7d41d090 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.551+0000 7f76f7627740 1 -- 172.21.15.27:0/61796116 >> 172.21.15.27:0/61796116 conn(0x563d7d3e6310 msgr2=0x563d7d419c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:03.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.551+0000 7f76f7627740 1 -- 172.21.15.27:0/61796116 shutdown_connections 2024-09-19T08:17:03.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.551+0000 7f76f7627740 1 -- 172.21.15.27:0/61796116 wait complete. 2024-09-19T08:17:03.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.551+0000 7f76f7627740 1 -- start start 2024-09-19T08:17:03.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.551+0000 7f76f7627740 1 Processor -- start 2024-09-19T08:17:03.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.552+0000 7f76f7627740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563d7d41d5d0 0x563d7d427d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:03.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.552+0000 7f76f7627740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d41eb40 0x563d7d425030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:03.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.552+0000 7f76f7627740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d428370 0x563d7d425640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:03.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.552+0000 7f76f7627740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x563d7d42b070 con 0x563d7d428370 2024-09-19T08:17:03.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.552+0000 7f76f7627740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563d7d33e060 con 0x563d7d41eb40 2024-09-19T08:17:03.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.552+0000 7f76f7627740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563d7d42b1f0 con 0x563d7d41d5d0 2024-09-19T08:17:03.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.552+0000 7f76f7627740 10 client.0 _ll_register_callbacks cb 0x563d7d0918c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:03.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.552+0000 7f76ef59e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d428370 0x563d7d425640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:03.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.552+0000 7f76ef59e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d428370 0x563d7d425640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33908/0 (socket says 172.21.15.27:33908) 2024-09-19T08:17:03.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.552+0000 7f76ef59e640 1 -- 172.21.15.27:0/3450898250 learned_addr learned my addr 172.21.15.27:0/3450898250 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:03.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.552+0000 7f76ef59e640 1 --2- 172.21.15.27:0/3450898250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563d7d41d5d0 0x563d7d427d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:03.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.552+0000 7f76ee59c640 1 --2- 172.21.15.27:0/3450898250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d41eb40 0x563d7d425030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:03.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.552+0000 7f76ef59e640 1 -- 172.21.15.27:0/3450898250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563d7d41d5d0 msgr2=0x563d7d427d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:03.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.552+0000 7f76ef59e640 1 --2- 172.21.15.27:0/3450898250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563d7d41d5d0 0x563d7d427d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.552+0000 7f76ef59e640 1 -- 172.21.15.27:0/3450898250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d41eb40 msgr2=0x563d7d425030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:03.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.552+0000 7f76ef59e640 1 --2- 172.21.15.27:0/3450898250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d41eb40 0x563d7d425030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.552+0000 7f76ef59e640 1 -- 172.21.15.27:0/3450898250 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d7d0f43c0 con 0x563d7d428370 2024-09-19T08:17:03.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.552+0000 7f76ef59e640 1 --2- 172.21.15.27:0/3450898250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d428370 0x563d7d425640 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f76e8004a30 tx=0x7f76e8005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6c288f0e06a0df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:03.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.552+0000 7f76d67fc640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:03.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.552+0000 7f76d67fc640 1 -- 172.21.15.27:0/3450898250 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8015030 con 0x563d7d428370 2024-09-19T08:17:03.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.553+0000 7f76f7627740 1 -- 172.21.15.27:0/3450898250 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76e800be50 con 0x563d7d428370 2024-09-19T08:17:03.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.553+0000 7f76d67fc640 1 -- 172.21.15.27:0/3450898250 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f76e8011820 con 0x563d7d428370 2024-09-19T08:17:03.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.553+0000 7f76d67fc640 1 -- 172.21.15.27:0/3450898250 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f76e8022040 con 0x563d7d428370 2024-09-19T08:17:03.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.553+0000 7f76f7627740 10 client.16320 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:03.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.553+0000 7f76f7627740 1 -- 172.21.15.27:0/3450898250 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x563d7d436b40 con 0x563d7d428370 2024-09-19T08:17:03.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.553+0000 7f76d67fc640 1 -- 172.21.15.27:0/3450898250 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76e800be50 con 0x563d7d428370 2024-09-19T08:17:03.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.553+0000 7f76d67fc640 1 -- 172.21.15.27:0/3450898250 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f76e8005350 con 0x563d7d428370 2024-09-19T08:17:03.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.553+0000 7f76f7627740 10 client.16320 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:03.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.553+0000 7f76f7627740 10 client.16320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:03.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.553+0000 7f76f7627740 20 client.16320 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:03.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.553+0000 7f76f7627740 1 --2- 172.21.15.27:0/3450898250 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x563d7d437fa0 0x563d7d43a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:03.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.553+0000 7f76f7627740 4 client.16320 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:17:03.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.553+0000 7f76f7627740 1 -- 172.21.15.27:0/3450898250 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d7d390860 con 0x563d7d437fa0 2024-09-19T08:17:03.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.553+0000 7f76ee59c640 1 --2- 172.21.15.27:0/3450898250 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x563d7d437fa0 0x563d7d43a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:03.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.554+0000 7f76ee59c640 1 --2- 172.21.15.27:0/3450898250 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x563d7d437fa0 0x563d7d43a390 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d610cd4279fd94f server_cookie=bfdb87e64c030e1e in_seq=0 out_seq=0 2024-09-19T08:17:03.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.554+0000 7f76d67fc640 10 client.16320 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:03.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.555+0000 7f76d67fc640 1 -- 172.21.15.27:0/3450898250 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d7d390860 con 0x563d7d437fa0 2024-09-19T08:17:03.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.555+0000 7f76d67fc640 10 client.16320 handle_command_reply: tid=0 2024-09-19T08:17:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.555+0000 7f76f7627740 1 client.16320 shutdown 2024-09-19T08:17:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.555+0000 7f76f7627740 1 -- 172.21.15.27:0/3450898250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d428370 msgr2=0x563d7d425640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.555+0000 7f76f7627740 1 --2- 172.21.15.27:0/3450898250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d428370 0x563d7d425640 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f76e8004a30 tx=0x7f76e8005c70 comp rx=0 tx=0).stop 2024-09-19T08:17:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.555+0000 7f76f7627740 1 -- 172.21.15.27:0/3450898250 shutdown_connections 2024-09-19T08:17:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.555+0000 7f76f7627740 1 --2- 172.21.15.27:0/3450898250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d428370 0x563d7d425640 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.555+0000 7f76f7627740 1 --2- 172.21.15.27:0/3450898250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d41eb40 0x563d7d425030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.555+0000 7f76f7627740 1 --2- 172.21.15.27:0/3450898250 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x563d7d437fa0 0x563d7d43a390 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.555+0000 7f76d67fc640 0 client.16320 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.555+0000 7f76f7627740 1 --2- 172.21.15.27:0/3450898250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563d7d41d5d0 0x563d7d427d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.555+0000 7f76f7627740 1 -- 172.21.15.27:0/3450898250 >> 172.21.15.27:0/3450898250 conn(0x563d7d3e6310 msgr2=0x563d7d41f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.555+0000 7f76f7627740 1 -- 172.21.15.27:0/3450898250 shutdown_connections 2024-09-19T08:17:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.555+0000 7f76f7627740 1 -- 172.21.15.27:0/3450898250 wait complete. 2024-09-19T08:17:03.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.555+0000 7f76f7627740 20 client.16320 trim_cache size 0 max 16384 2024-09-19T08:17:03.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.568+0000 7f76f7627740 1 Processor -- start 2024-09-19T08:17:03.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.568+0000 7f76f7627740 1 -- start start 2024-09-19T08:17:03.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.569+0000 7f76f7627740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563d7d41d5d0 0x563d7d434310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.569+0000 7f76f7627740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d41eb40 0x563d7d420120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.569+0000 7f76f7627740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d428370 0x563d7d420660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.569+0000 7f76f7627740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f76f01ab920 con 0x563d7d41eb40 2024-09-19T08:17:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.569+0000 7f76f7627740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f76f01ae1a0 con 0x563d7d428370 2024-09-19T08:17:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.569+0000 7f76f7627740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f76f01abf90 con 0x563d7d41d5d0 2024-09-19T08:17:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.569+0000 7f76ee59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d41eb40 0x563d7d420120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.569+0000 7f76ee59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d41eb40 0x563d7d420120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33912/0 (socket says 172.21.15.27:33912) 2024-09-19T08:17:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.569+0000 7f76ee59c640 1 -- 172.21.15.27:0/2069833156 learned_addr learned my addr 172.21.15.27:0/2069833156 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.569+0000 7f76ef59e640 1 --2- 172.21.15.27:0/2069833156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563d7d41d5d0 0x563d7d434310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.569+0000 7f76ef59e640 1 --2- 172.21.15.27:0/2069833156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d428370 0x563d7d420660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.569+0000 7f76ee59c640 1 -- 172.21.15.27:0/2069833156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563d7d41d5d0 msgr2=0x563d7d434310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.569+0000 7f76ee59c640 1 --2- 172.21.15.27:0/2069833156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563d7d41d5d0 0x563d7d434310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.569+0000 7f76ee59c640 1 -- 172.21.15.27:0/2069833156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d428370 msgr2=0x563d7d420660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:03.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.569+0000 7f76ee59c640 1 --2- 172.21.15.27:0/2069833156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d428370 0x563d7d420660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.569+0000 7f76ee59c640 1 -- 172.21.15.27:0/2069833156 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d7d41dbe0 con 0x563d7d41eb40 2024-09-19T08:17:03.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.569+0000 7f76ef59e640 1 --2- 172.21.15.27:0/2069833156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d428370 0x563d7d420660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:17:03.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.569+0000 7f76ee59c640 1 --2- 172.21.15.27:0/2069833156 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d41eb40 0x563d7d420120 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f76d8032fd0 tx=0x7f76d8031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f039eb839446270f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:03.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.570+0000 7f76e4ff9640 1 -- 172.21.15.27:0/2069833156 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8035040 con 0x563d7d41eb40 2024-09-19T08:17:03.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.570+0000 7f76e4ff9640 1 -- 172.21.15.27:0/2069833156 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76d8049070 con 0x563d7d41eb40 2024-09-19T08:17:03.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.570+0000 7f76e4ff9640 1 -- 172.21.15.27:0/2069833156 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8004920 con 0x563d7d41eb40 2024-09-19T08:17:03.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.570+0000 7f76f7627740 1 -- 172.21.15.27:0/2069833156 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d41eb40 msgr2=0x563d7d420120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:03.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.570+0000 7f76f7627740 1 --2- 172.21.15.27:0/2069833156 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d41eb40 0x563d7d420120 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f76d8032fd0 tx=0x7f76d8031400 comp rx=0 tx=0).stop 2024-09-19T08:17:03.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.570+0000 7f76f7627740 1 -- 172.21.15.27:0/2069833156 shutdown_connections 2024-09-19T08:17:03.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.570+0000 7f76f7627740 1 --2- 172.21.15.27:0/2069833156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d428370 0x563d7d420660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.570+0000 7f76f7627740 1 --2- 172.21.15.27:0/2069833156 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d41eb40 0x563d7d420120 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.570+0000 7f76f7627740 1 --2- 172.21.15.27:0/2069833156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563d7d41d5d0 0x563d7d434310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.570+0000 7f76f7627740 1 -- 172.21.15.27:0/2069833156 >> 172.21.15.27:0/2069833156 conn(0x563d7d3e6310 msgr2=0x563d7d424120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:03.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.570+0000 7f76f7627740 1 -- 172.21.15.27:0/2069833156 shutdown_connections 2024-09-19T08:17:03.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.570+0000 7f76f7627740 1 -- 172.21.15.27:0/2069833156 wait complete. 2024-09-19T08:17:03.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.571+0000 7f76f7627740 1 -- start start 2024-09-19T08:17:03.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.571+0000 7f76f7627740 1 Processor -- start 2024-09-19T08:17:03.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.571+0000 7f76f7627740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d41d5d0 0x563d7d430b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:03.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.571+0000 7f76f7627740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d41eb40 0x563d7d42bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:03.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.571+0000 7f76f7627740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563d7d428370 0x563d7d42c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:03.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.571+0000 7f76f7627740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f76f01ac660 con 0x563d7d41d5d0 2024-09-19T08:17:03.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.571+0000 7f76f7627740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f76f01adad0 con 0x563d7d41eb40 2024-09-19T08:17:03.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.571+0000 7f76f7627740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f76f01acd30 con 0x563d7d428370 2024-09-19T08:17:03.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.571+0000 7f76f7627740 10 client.0 _ll_register_callbacks cb 0x7f76d8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:03.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.571+0000 7f76ef59e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d41d5d0 0x563d7d430b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:03.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.571+0000 7f76ef59e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d41d5d0 0x563d7d430b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33926/0 (socket says 172.21.15.27:33926) 2024-09-19T08:17:03.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.571+0000 7f76ef59e640 1 -- 172.21.15.27:0/3044453066 learned_addr learned my addr 172.21.15.27:0/3044453066 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:03.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.572+0000 7f76ee59c640 1 --2- 172.21.15.27:0/3044453066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d41eb40 0x563d7d42bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:03.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.572+0000 7f76ef59e640 1 -- 172.21.15.27:0/3044453066 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563d7d428370 msgr2=0x563d7d42c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:03.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.572+0000 7f76ef59e640 1 --2- 172.21.15.27:0/3044453066 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563d7d428370 0x563d7d42c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.572+0000 7f76ef59e640 1 -- 172.21.15.27:0/3044453066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d41eb40 msgr2=0x563d7d42bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:03.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.572+0000 7f76ef59e640 1 --2- 172.21.15.27:0/3044453066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d41eb40 0x563d7d42bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.572+0000 7f76ef59e640 1 -- 172.21.15.27:0/3044453066 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d7d42cc00 con 0x563d7d41d5d0 2024-09-19T08:17:03.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.572+0000 7f76ef59e640 1 --2- 172.21.15.27:0/3044453066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d41d5d0 0x563d7d430b90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f76e8005720 tx=0x7f76e8005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b604e74f1fd4d06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:03.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.572+0000 7f76d67fc640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:03.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.572+0000 7f76d67fc640 1 -- 172.21.15.27:0/3044453066 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8039060 con 0x563d7d41d5d0 2024-09-19T08:17:03.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.572+0000 7f76d67fc640 1 -- 172.21.15.27:0/3044453066 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f76e80289b0 con 0x563d7d41d5d0 2024-09-19T08:17:03.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.572+0000 7f76f7627740 1 -- 172.21.15.27:0/3044453066 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76d8049070 con 0x563d7d41d5d0 2024-09-19T08:17:03.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.572+0000 7f76d67fc640 1 -- 172.21.15.27:0/3044453066 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f76e8015040 con 0x563d7d41d5d0 2024-09-19T08:17:03.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.572+0000 7f76f7627740 10 client.16326 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:03.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.572+0000 7f76f7627740 1 -- 172.21.15.27:0/3044453066 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x563d7d4a29e0 con 0x563d7d41d5d0 2024-09-19T08:17:03.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.572+0000 7f76d67fc640 1 -- 172.21.15.27:0/3044453066 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76d8049070 con 0x563d7d41d5d0 2024-09-19T08:17:03.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.573+0000 7f76d67fc640 1 -- 172.21.15.27:0/3044453066 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f76e8033030 con 0x563d7d41d5d0 2024-09-19T08:17:03.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.573+0000 7f76f7627740 10 client.16326 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:03.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.573+0000 7f76f7627740 10 client.16326 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:03.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.573+0000 7f76f7627740 20 client.16326 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:03.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.573+0000 7f76f7627740 1 --2- 172.21.15.27:0/3044453066 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x563d7d437fa0 0x563d7d4a5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:03.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.573+0000 7f76f7627740 4 client.16326 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:17:03.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.573+0000 7f76f7627740 1 -- 172.21.15.27:0/3044453066 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563d7d38ad70 con 0x563d7d437fa0 2024-09-19T08:17:03.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.573+0000 7f76ee59c640 1 --2- 172.21.15.27:0/3044453066 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x563d7d437fa0 0x563d7d4a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:03.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.574+0000 7f76ee59c640 1 --2- 172.21.15.27:0/3044453066 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x563d7d437fa0 0x563d7d4a5080 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfcbdaf741fcc3f8 server_cookie=4fbd4be06a8d28c9 in_seq=0 out_seq=0 2024-09-19T08:17:03.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.574+0000 7f76d67fc640 10 client.16326 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:03.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.574+0000 7f76d67fc640 1 -- 172.21.15.27:0/3044453066 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563d7d38ad70 con 0x563d7d437fa0 2024-09-19T08:17:03.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.574+0000 7f76d67fc640 10 client.16326 handle_command_reply: tid=0 2024-09-19T08:17:03.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.574+0000 7f76f7627740 1 client.16326 shutdown 2024-09-19T08:17:03.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.574+0000 7f76f7627740 1 -- 172.21.15.27:0/3044453066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d41d5d0 msgr2=0x563d7d430b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:03.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.574+0000 7f76f7627740 1 --2- 172.21.15.27:0/3044453066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d41d5d0 0x563d7d430b90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f76e8005720 tx=0x7f76e8005fa0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.574+0000 7f76f7627740 1 -- 172.21.15.27:0/3044453066 shutdown_connections 2024-09-19T08:17:03.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.574+0000 7f76f7627740 1 --2- 172.21.15.27:0/3044453066 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x563d7d437fa0 0x563d7d4a5080 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.574+0000 7f76f7627740 1 --2- 172.21.15.27:0/3044453066 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563d7d428370 0x563d7d42c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.574+0000 7f76d67fc640 0 client.16326 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:03.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.574+0000 7f76f7627740 1 --2- 172.21.15.27:0/3044453066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563d7d41eb40 0x563d7d42bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.574+0000 7f76f7627740 1 --2- 172.21.15.27:0/3044453066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d7d41d5d0 0x563d7d430b90 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.574+0000 7f76f7627740 1 -- 172.21.15.27:0/3044453066 >> 172.21.15.27:0/3044453066 conn(0x563d7d3e6310 msgr2=0x563d7d426890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:03.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.574+0000 7f76f7627740 1 -- 172.21.15.27:0/3044453066 shutdown_connections 2024-09-19T08:17:03.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.574+0000 7f76f7627740 1 -- 172.21.15.27:0/3044453066 wait complete. 2024-09-19T08:17:03.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.574+0000 7f76f7627740 20 client.16326 trim_cache size 0 max 16384 2024-09-19T08:17:03.585 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:17:03.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.575+0000 7f76f524e640 1 -- 172.21.15.27:0/709780776 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f76dc0a33b0 msgr2=0x7f76dc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:03.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.575+0000 7f76f524e640 1 --2- 172.21.15.27:0/709780776 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f76dc0a33b0 0x7f76dc0a5870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f76e00ccbb0 tx=0x7f76e00d2da0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.575+0000 7f76f524e640 1 -- 172.21.15.27:0/709780776 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76f0100a80 msgr2=0x7f76f0199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:03.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.575+0000 7f76f524e640 1 --2- 172.21.15.27:0/709780776 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76f0100a80 0x7f76f0199350 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f76e000ba50 tx=0x7f76e000bf10 comp rx=0 tx=0).stop 2024-09-19T08:17:03.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.575+0000 7f76f524e640 1 -- 172.21.15.27:0/709780776 shutdown_connections 2024-09-19T08:17:03.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.575+0000 7f76f524e640 1 --2- 172.21.15.27:0/709780776 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f76dc0a33b0 0x7f76dc0a5870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.575+0000 7f76f524e640 1 --2- 172.21.15.27:0/709780776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76f0106a80 0x7f76f01a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.575+0000 7f76f524e640 1 --2- 172.21.15.27:0/709780776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76f0101420 0x7f76f0199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.575+0000 7f76f524e640 1 --2- 172.21.15.27:0/709780776 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76f0100a80 0x7f76f0199350 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:03.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.575+0000 7f76f524e640 1 -- 172.21.15.27:0/709780776 >> 172.21.15.27:0/709780776 conn(0x7f76f00fc7a0 msgr2=0x7f76f00fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:03.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.575+0000 7f76f524e640 1 -- 172.21.15.27:0/709780776 shutdown_connections 2024-09-19T08:17:03.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:03.575+0000 7f76f524e640 1 -- 172.21.15.27:0/709780776 wait complete. 2024-09-19T08:17:05.237 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:17:05.237 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:17:05.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:04 smithi155 ceph-mon[35362]: pgmap v184: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:17:05.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:04 smithi027 ceph-mon[31209]: pgmap v184: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:17:05.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:04 smithi203 ceph-mon[35198]: pgmap v184: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:17:05.510 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:17:06.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.990+0000 7f2b764ce640 1 -- 172.21.15.27:0/3071829215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b70101420 msgr2=0x7f2b7010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:06.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.990+0000 7f2b764ce640 1 --2- 172.21.15.27:0/3071829215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b70101420 0x7f2b7010d950 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009cd0 tx=0x7f2b6802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.990+0000 7f2b764ce640 1 -- 172.21.15.27:0/3071829215 shutdown_connections 2024-09-19T08:17:06.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.990+0000 7f2b764ce640 1 --2- 172.21.15.27:0/3071829215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b70101420 0x7f2b7010d950 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.990+0000 7f2b764ce640 1 --2- 172.21.15.27:0/3071829215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b70100a80 0x7f2b70100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.990+0000 7f2b764ce640 1 --2- 172.21.15.27:0/3071829215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b70106a80 0x7f2b70106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.990+0000 7f2b764ce640 1 -- 172.21.15.27:0/3071829215 >> 172.21.15.27:0/3071829215 conn(0x7f2b700fc7a0 msgr2=0x7f2b700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:06.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.990+0000 7f2b764ce640 1 -- 172.21.15.27:0/3071829215 shutdown_connections 2024-09-19T08:17:06.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.990+0000 7f2b764ce640 1 -- 172.21.15.27:0/3071829215 wait complete. 2024-09-19T08:17:06.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.990+0000 7f2b764ce640 1 Processor -- start 2024-09-19T08:17:06.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.991+0000 7f2b764ce640 1 -- start start 2024-09-19T08:17:06.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.991+0000 7f2b764ce640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b70100a80 0x7f2b70198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:06.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.991+0000 7f2b764ce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b70101420 0x7f2b70198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:06.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.991+0000 7f2b764ce640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b70106a80 0x7f2b7019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:06.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.991+0000 7f2b764ce640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70110ea0 con 0x7f2b70106a80 2024-09-19T08:17:06.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.991+0000 7f2b764ce640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70110d20 con 0x7f2b70101420 2024-09-19T08:17:06.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.991+0000 7f2b764ce640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70111020 con 0x7f2b70100a80 2024-09-19T08:17:06.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.991+0000 7f2b74a6b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b70106a80 0x7f2b7019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:06.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.991+0000 7f2b74a6b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b70106a80 0x7f2b7019ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33932/0 (socket says 172.21.15.27:33932) 2024-09-19T08:17:06.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.991+0000 7f2b74a6b640 1 -- 172.21.15.27:0/1473246471 learned_addr learned my addr 172.21.15.27:0/1473246471 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:06.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.991+0000 7f2b67fff640 1 --2- 172.21.15.27:0/1473246471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b70101420 0x7f2b70198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:06.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.991+0000 7f2b6ffff640 1 --2- 172.21.15.27:0/1473246471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b70100a80 0x7f2b70198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:06.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.991+0000 7f2b74a6b640 1 -- 172.21.15.27:0/1473246471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b70100a80 msgr2=0x7f2b70198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:06.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.991+0000 7f2b74a6b640 1 --2- 172.21.15.27:0/1473246471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b70100a80 0x7f2b70198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.991+0000 7f2b74a6b640 1 -- 172.21.15.27:0/1473246471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b70101420 msgr2=0x7f2b70198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:06.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.991+0000 7f2b74a6b640 1 --2- 172.21.15.27:0/1473246471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b70101420 0x7f2b70198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.991+0000 7f2b74a6b640 1 -- 172.21.15.27:0/1473246471 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b7019d3b0 con 0x7f2b70106a80 2024-09-19T08:17:06.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.991+0000 7f2b6ffff640 1 --2- 172.21.15.27:0/1473246471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b70100a80 0x7f2b70198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:17:06.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.992+0000 7f2b74a6b640 1 --2- 172.21.15.27:0/1473246471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b70106a80 0x7f2b7019ccd0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f2b68006010 tx=0x7f2b68003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:06.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.992+0000 7f2b6dffb640 1 -- 172.21.15.27:0/1473246471 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b68004450 con 0x7f2b70106a80 2024-09-19T08:17:06.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.992+0000 7f2b6dffb640 1 -- 172.21.15.27:0/1473246471 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b68003e10 con 0x7f2b70106a80 2024-09-19T08:17:06.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.992+0000 7f2b764ce640 1 -- 172.21.15.27:0/1473246471 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b7019d640 con 0x7f2b70106a80 2024-09-19T08:17:06.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.992+0000 7f2b6dffb640 1 -- 172.21.15.27:0/1473246471 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b68046480 con 0x7f2b70106a80 2024-09-19T08:17:06.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.992+0000 7f2b764ce640 1 -- 172.21.15.27:0/1473246471 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b701a4f80 con 0x7f2b70106a80 2024-09-19T08:17:06.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.994+0000 7f2b6dffb640 1 -- 172.21.15.27:0/1473246471 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2b680045f0 con 0x7f2b70106a80 2024-09-19T08:17:06.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.994+0000 7f2b788a7740 1 Processor -- start 2024-09-19T08:17:06.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.994+0000 7f2b788a7740 1 -- start start 2024-09-19T08:17:06.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.995+0000 7f2b788a7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5571a2b6aa40 0x5571a2b6ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:06.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.995+0000 7f2b788a7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6b360 0x5571a2b79c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:06.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.995+0000 7f2b788a7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571a2b7a150 0x5571a2b7c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:06.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.995+0000 7f2b788a7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5571a2ad0280 con 0x5571a2b6b360 2024-09-19T08:17:06.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.995+0000 7f2b788a7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5571a2a77b10 con 0x5571a2b6aa40 2024-09-19T08:17:06.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.995+0000 7f2b788a7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5571a2acc240 con 0x5571a2b7a150 2024-09-19T08:17:06.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.995+0000 7f2b6ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6b360 0x5571a2b79c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:06.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.995+0000 7f2b6ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6b360 0x5571a2b79c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33936/0 (socket says 172.21.15.27:33936) 2024-09-19T08:17:06.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.995+0000 7f2b6ffff640 1 -- 172.21.15.27:0/2464671 learned_addr learned my addr 172.21.15.27:0/2464671 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:06.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.995+0000 7f2b6dffb640 1 --2- 172.21.15.27:0/1473246471 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2b5c0a3430 0x7f2b5c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:06.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.995+0000 7f2b67fff640 1 --2- 172.21.15.27:0/2464671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5571a2b6aa40 0x5571a2b6ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:06.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.995+0000 7f2b67fff640 1 --2- 172.21.15.27:0/2464671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571a2b7a150 0x5571a2b7c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:06.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.995+0000 7f2b74a6b640 1 --2- 172.21.15.27:0/1473246471 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2b5c0a3430 0x7f2b5c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:06.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.995+0000 7f2b6ffff640 1 -- 172.21.15.27:0/2464671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571a2b7a150 msgr2=0x5571a2b7c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:06.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.995+0000 7f2b6ffff640 1 --2- 172.21.15.27:0/2464671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571a2b7a150 0x5571a2b7c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.995+0000 7f2b6ffff640 1 -- 172.21.15.27:0/2464671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5571a2b6aa40 msgr2=0x5571a2b6ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:06.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.995+0000 7f2b6ffff640 1 --2- 172.21.15.27:0/2464671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5571a2b6aa40 0x5571a2b6ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.995+0000 7f2b6ffff640 1 -- 172.21.15.27:0/2464671 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571a2a841f0 con 0x5571a2b6b360 2024-09-19T08:17:06.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.995+0000 7f2b6dffb640 1 -- 172.21.15.27:0/1473246471 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f2b6802e030 con 0x7f2b70106a80 2024-09-19T08:17:06.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.995+0000 7f2b6ffff640 1 --2- 172.21.15.27:0/2464671 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6b360 0x5571a2b79c10 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f2b60007850 tx=0x7f2b60007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318cf043f1b0f5c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:06.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.996+0000 7f2b667fc640 1 -- 172.21.15.27:0/2464671 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6000d950 con 0x5571a2b6b360 2024-09-19T08:17:06.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.996+0000 7f2b667fc640 1 -- 172.21.15.27:0/2464671 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b60018070 con 0x5571a2b6b360 2024-09-19T08:17:06.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.996+0000 7f2b667fc640 1 -- 172.21.15.27:0/2464671 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b600123e0 con 0x5571a2b6b360 2024-09-19T08:17:06.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.996+0000 7f2b788a7740 1 -- 172.21.15.27:0/2464671 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6b360 msgr2=0x5571a2b79c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:06.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.996+0000 7f2b788a7740 1 --2- 172.21.15.27:0/2464671 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6b360 0x5571a2b79c10 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f2b60007850 tx=0x7f2b60007d10 comp rx=0 tx=0).stop 2024-09-19T08:17:06.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.996+0000 7f2b74a6b640 1 --2- 172.21.15.27:0/1473246471 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2b5c0a3430 0x7f2b5c0a58f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2b680bd360 tx=0x7f2b6808c350 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:06.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.996+0000 7f2b788a7740 1 -- 172.21.15.27:0/2464671 shutdown_connections 2024-09-19T08:17:06.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.996+0000 7f2b788a7740 1 --2- 172.21.15.27:0/2464671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571a2b7a150 0x5571a2b7c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.996+0000 7f2b788a7740 1 --2- 172.21.15.27:0/2464671 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6b360 0x5571a2b79c10 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.996+0000 7f2b788a7740 1 --2- 172.21.15.27:0/2464671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5571a2b6aa40 0x5571a2b6ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.996+0000 7f2b788a7740 1 -- 172.21.15.27:0/2464671 >> 172.21.15.27:0/2464671 conn(0x5571a2b670f0 msgr2=0x5571a2b674d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:06.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.996+0000 7f2b788a7740 1 -- 172.21.15.27:0/2464671 shutdown_connections 2024-09-19T08:17:06.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.996+0000 7f2b788a7740 1 -- 172.21.15.27:0/2464671 wait complete. 2024-09-19T08:17:06.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.997+0000 7f2b788a7740 1 -- start start 2024-09-19T08:17:06.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.997+0000 7f2b788a7740 1 Processor -- start 2024-09-19T08:17:06.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.997+0000 7f2b788a7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6aa40 0x5571a2b77030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:06.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.997+0000 7f2b788a7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571a2b6b360 0x5571a2b77570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:06.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.997+0000 7f2b788a7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5571a2b7a150 0x5571a2b77ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:06.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.997+0000 7f2b788a7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5571a2b7cd20 con 0x5571a2b6aa40 2024-09-19T08:17:06.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.997+0000 7f2b788a7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5571a2a8af10 con 0x5571a2b7a150 2024-09-19T08:17:06.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.997+0000 7f2b788a7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5571a2b7cea0 con 0x5571a2b6b360 2024-09-19T08:17:06.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.997+0000 7f2b788a7740 10 client.0 _ll_register_callbacks cb 0x5571a2a53a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:06.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.997+0000 7f2b67fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6aa40 0x5571a2b77030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:06.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.997+0000 7f2b67fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6aa40 0x5571a2b77030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33938/0 (socket says 172.21.15.27:33938) 2024-09-19T08:17:06.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.997+0000 7f2b67fff640 1 -- 172.21.15.27:0/29740751 learned_addr learned my addr 172.21.15.27:0/29740751 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:06.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.997+0000 7f2b67fff640 1 --2- 172.21.15.27:0/29740751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5571a2b7a150 0x5571a2b77ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:06.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.998+0000 7f2b6ffff640 1 --2- 172.21.15.27:0/29740751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571a2b6b360 0x5571a2b77570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:06.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.998+0000 7f2b67fff640 1 -- 172.21.15.27:0/29740751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571a2b6b360 msgr2=0x5571a2b77570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:06.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.998+0000 7f2b67fff640 1 --2- 172.21.15.27:0/29740751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571a2b6b360 0x5571a2b77570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.998+0000 7f2b67fff640 1 -- 172.21.15.27:0/29740751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5571a2b7a150 msgr2=0x5571a2b77ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.998+0000 7f2b67fff640 1 --2- 172.21.15.27:0/29740751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5571a2b7a150 0x5571a2b77ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.998+0000 7f2b67fff640 1 -- 172.21.15.27:0/29740751 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571a28416a0 con 0x5571a2b6aa40 2024-09-19T08:17:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.998+0000 7f2b67fff640 1 --2- 172.21.15.27:0/29740751 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6aa40 0x5571a2b77030 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800afb0 tx=0x7f2b58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6891742ea9696a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.998+0000 7f2b4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.998+0000 7f2b4f7fe640 1 -- 172.21.15.27:0/29740751 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b58005020 con 0x5571a2b6aa40 2024-09-19T08:17:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.998+0000 7f2b4f7fe640 1 -- 172.21.15.27:0/29740751 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f2b580051c0 con 0x5571a2b6aa40 2024-09-19T08:17:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.998+0000 7f2b788a7740 1 -- 172.21.15.27:0/29740751 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b60018070 con 0x5571a2b6aa40 2024-09-19T08:17:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.998+0000 7f2b4f7fe640 1 -- 172.21.15.27:0/29740751 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2b580053c0 con 0x5571a2b6aa40 2024-09-19T08:17:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.998+0000 7f2b788a7740 10 client.16338 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.998+0000 7f2b788a7740 1 -- 172.21.15.27:0/29740751 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5571a2b88a10 con 0x5571a2b6aa40 2024-09-19T08:17:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.998+0000 7f2b4f7fe640 1 -- 172.21.15.27:0/29740751 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b60018070 con 0x5571a2b6aa40 2024-09-19T08:17:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.998+0000 7f2b4f7fe640 1 -- 172.21.15.27:0/29740751 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2b5802a720 con 0x5571a2b6aa40 2024-09-19T08:17:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.999+0000 7f2b788a7740 10 client.16338 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.999+0000 7f2b788a7740 10 client.16338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.999+0000 7f2b788a7740 20 client.16338 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.999+0000 7f2b788a7740 1 --2- 172.21.15.27:0/29740751 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5571a2b89e20 0x5571a2b8c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.999+0000 7f2b788a7740 4 client.16338 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:17:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.999+0000 7f2b788a7740 1 -- 172.21.15.27:0/29740751 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571a2add7f0 con 0x5571a2b89e20 2024-09-19T08:17:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.999+0000 7f2b6ffff640 1 --2- 172.21.15.27:0/29740751 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5571a2b89e20 0x5571a2b8c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.999+0000 7f2b4f7fe640 10 client.16338 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:05.999+0000 7f2b6ffff640 1 --2- 172.21.15.27:0/29740751 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5571a2b89e20 0x5571a2b8c230 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38a9d5184923e001 server_cookie=719b66355c3aa8be in_seq=0 out_seq=0 2024-09-19T08:17:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.000+0000 7f2b4f7fe640 1 -- 172.21.15.27:0/29740751 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5571a2add7f0 con 0x5571a2b89e20 2024-09-19T08:17:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.000+0000 7f2b4f7fe640 10 client.16338 handle_command_reply: tid=0 2024-09-19T08:17:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.000+0000 7f2b788a7740 1 client.16338 shutdown 2024-09-19T08:17:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.001+0000 7f2b788a7740 1 -- 172.21.15.27:0/29740751 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6aa40 msgr2=0x5571a2b77030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.001+0000 7f2b788a7740 1 --2- 172.21.15.27:0/29740751 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6aa40 0x5571a2b77030 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800afb0 tx=0x7f2b58004730 comp rx=0 tx=0).stop 2024-09-19T08:17:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.001+0000 7f2b788a7740 1 -- 172.21.15.27:0/29740751 shutdown_connections 2024-09-19T08:17:06.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.001+0000 7f2b788a7740 1 --2- 172.21.15.27:0/29740751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5571a2b7a150 0x5571a2b77ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.001+0000 7f2b788a7740 1 --2- 172.21.15.27:0/29740751 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5571a2b89e20 0x5571a2b8c230 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.001+0000 7f2b788a7740 1 --2- 172.21.15.27:0/29740751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571a2b6b360 0x5571a2b77570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.001+0000 7f2b788a7740 1 --2- 172.21.15.27:0/29740751 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6aa40 0x5571a2b77030 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.001+0000 7f2b4f7fe640 0 client.16338 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:06.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.001+0000 7f2b788a7740 1 -- 172.21.15.27:0/29740751 >> 172.21.15.27:0/29740751 conn(0x5571a2b670f0 msgr2=0x5571a2b6ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:06.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.001+0000 7f2b788a7740 1 -- 172.21.15.27:0/29740751 shutdown_connections 2024-09-19T08:17:06.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.001+0000 7f2b788a7740 1 -- 172.21.15.27:0/29740751 wait complete. 2024-09-19T08:17:06.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.001+0000 7f2b788a7740 20 client.16338 trim_cache size 0 max 16384 2024-09-19T08:17:06.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.018+0000 7f2b788a7740 1 Processor -- start 2024-09-19T08:17:06.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.018+0000 7f2b788a7740 1 -- start start 2024-09-19T08:17:06.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.018+0000 7f2b788a7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6aa40 0x5571a2b66160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:06.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.018+0000 7f2b788a7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5571a2b6b360 0x5571a2b91b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.018+0000 7f2b788a7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571a2b7a150 0x5571a2b92040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.018+0000 7f2b788a7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2b701a9490 con 0x5571a2b6aa40 2024-09-19T08:17:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.018+0000 7f2b788a7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2b701abcf0 con 0x5571a2b6b360 2024-09-19T08:17:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.018+0000 7f2b788a7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2b701a9ae0 con 0x5571a2b7a150 2024-09-19T08:17:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.019+0000 7f2b67fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6aa40 0x5571a2b66160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.019+0000 7f2b67fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6aa40 0x5571a2b66160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33940/0 (socket says 172.21.15.27:33940) 2024-09-19T08:17:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.019+0000 7f2b67fff640 1 -- 172.21.15.27:0/1973125302 learned_addr learned my addr 172.21.15.27:0/1973125302 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.019+0000 7f2b6ffff640 1 --2- 172.21.15.27:0/1973125302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5571a2b6b360 0x5571a2b91b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.019+0000 7f2b67fff640 1 -- 172.21.15.27:0/1973125302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571a2b7a150 msgr2=0x5571a2b92040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.019+0000 7f2b67fff640 1 --2- 172.21.15.27:0/1973125302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571a2b7a150 0x5571a2b92040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.019+0000 7f2b67fff640 1 -- 172.21.15.27:0/1973125302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5571a2b6b360 msgr2=0x5571a2b91b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.019+0000 7f2b67fff640 1 --2- 172.21.15.27:0/1973125302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5571a2b6b360 0x5571a2b91b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.019+0000 7f2b67fff640 1 -- 172.21.15.27:0/1973125302 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571a2b66f20 con 0x5571a2b6aa40 2024-09-19T08:17:06.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.019+0000 7f2b67fff640 1 --2- 172.21.15.27:0/1973125302 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6aa40 0x5571a2b66160 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800a690 tx=0x7f2b5800a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4552c10d62b6c276 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:06.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.019+0000 7f2b65ffb640 1 -- 172.21.15.27:0/1973125302 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b58005560 con 0x5571a2b6aa40 2024-09-19T08:17:06.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.019+0000 7f2b65ffb640 1 -- 172.21.15.27:0/1973125302 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b5800a2d0 con 0x5571a2b6aa40 2024-09-19T08:17:06.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.019+0000 7f2b65ffb640 1 -- 172.21.15.27:0/1973125302 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b58020cf0 con 0x5571a2b6aa40 2024-09-19T08:17:06.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.020+0000 7f2b788a7740 1 -- 172.21.15.27:0/1973125302 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6aa40 msgr2=0x5571a2b66160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:06.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.020+0000 7f2b788a7740 1 --2- 172.21.15.27:0/1973125302 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6aa40 0x5571a2b66160 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800a690 tx=0x7f2b5800a6c0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.020+0000 7f2b788a7740 1 -- 172.21.15.27:0/1973125302 shutdown_connections 2024-09-19T08:17:06.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.020+0000 7f2b788a7740 1 --2- 172.21.15.27:0/1973125302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571a2b7a150 0x5571a2b92040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.020+0000 7f2b788a7740 1 --2- 172.21.15.27:0/1973125302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5571a2b6b360 0x5571a2b91b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.020+0000 7f2b788a7740 1 --2- 172.21.15.27:0/1973125302 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b6aa40 0x5571a2b66160 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.020+0000 7f2b788a7740 1 -- 172.21.15.27:0/1973125302 >> 172.21.15.27:0/1973125302 conn(0x5571a2b670f0 msgr2=0x5571a2b65a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:06.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.020+0000 7f2b788a7740 1 -- 172.21.15.27:0/1973125302 shutdown_connections 2024-09-19T08:17:06.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.020+0000 7f2b788a7740 1 -- 172.21.15.27:0/1973125302 wait complete. 2024-09-19T08:17:06.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.020+0000 7f2b788a7740 1 -- start start 2024-09-19T08:17:06.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.021+0000 7f2b788a7740 1 Processor -- start 2024-09-19T08:17:06.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.021+0000 7f2b788a7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5571a2b6aa40 0x5571a2b7e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:06.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.021+0000 7f2b788a7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571a2b6b360 0x5571a2b7e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:06.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.021+0000 7f2b788a7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b7a150 0x5571a2bf3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:06.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.021+0000 7f2b788a7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2b701aa1b0 con 0x5571a2b7a150 2024-09-19T08:17:06.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.021+0000 7f2b788a7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2b701ab620 con 0x5571a2b6aa40 2024-09-19T08:17:06.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.021+0000 7f2b788a7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2b701aa880 con 0x5571a2b6b360 2024-09-19T08:17:06.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.021+0000 7f2b788a7740 10 client.0 _ll_register_callbacks cb 0x7f2b5800acf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:06.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.021+0000 7f2b67fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b7a150 0x5571a2bf3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:06.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.021+0000 7f2b67fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b7a150 0x5571a2bf3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33948/0 (socket says 172.21.15.27:33948) 2024-09-19T08:17:06.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.021+0000 7f2b67fff640 1 -- 172.21.15.27:0/3851032861 learned_addr learned my addr 172.21.15.27:0/3851032861 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:06.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.021+0000 7f2b67fff640 1 --2- 172.21.15.27:0/3851032861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5571a2b6aa40 0x5571a2b7e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:06.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.021+0000 7f2b6ffff640 1 --2- 172.21.15.27:0/3851032861 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571a2b6b360 0x5571a2b7e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:06.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.021+0000 7f2b67fff640 1 -- 172.21.15.27:0/3851032861 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571a2b6b360 msgr2=0x5571a2b7e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:06.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.021+0000 7f2b67fff640 1 --2- 172.21.15.27:0/3851032861 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571a2b6b360 0x5571a2b7e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.021+0000 7f2b67fff640 1 -- 172.21.15.27:0/3851032861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5571a2b6aa40 msgr2=0x5571a2b7e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:06.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.021+0000 7f2b67fff640 1 --2- 172.21.15.27:0/3851032861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5571a2b6aa40 0x5571a2b7e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.021+0000 7f2b67fff640 1 -- 172.21.15.27:0/3851032861 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571a2b7eff0 con 0x5571a2b7a150 2024-09-19T08:17:06.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.022+0000 7f2b67fff640 1 --2- 172.21.15.27:0/3851032861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b7a150 0x5571a2bf3ad0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f2b58020650 tx=0x7f2b58019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906e9651d6e5c966 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:06.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.022+0000 7f2b4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:06.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.022+0000 7f2b4f7fe640 1 -- 172.21.15.27:0/3851032861 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b58020e30 con 0x5571a2b7a150 2024-09-19T08:17:06.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.022+0000 7f2b4f7fe640 1 -- 172.21.15.27:0/3851032861 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f2b5802a690 con 0x5571a2b7a150 2024-09-19T08:17:06.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.022+0000 7f2b788a7740 1 -- 172.21.15.27:0/3851032861 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b5800a2d0 con 0x5571a2b7a150 2024-09-19T08:17:06.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.022+0000 7f2b4f7fe640 1 -- 172.21.15.27:0/3851032861 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2b58047050 con 0x5571a2b7a150 2024-09-19T08:17:06.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.022+0000 7f2b788a7740 10 client.16344 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:06.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.022+0000 7f2b788a7740 1 -- 172.21.15.27:0/3851032861 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5571a2bf5130 con 0x5571a2b7a150 2024-09-19T08:17:06.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.022+0000 7f2b4f7fe640 1 -- 172.21.15.27:0/3851032861 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b5800a2d0 con 0x5571a2b7a150 2024-09-19T08:17:06.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.022+0000 7f2b4f7fe640 1 -- 172.21.15.27:0/3851032861 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2b58042c10 con 0x5571a2b7a150 2024-09-19T08:17:06.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.022+0000 7f2b788a7740 10 client.16344 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:06.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.022+0000 7f2b788a7740 10 client.16344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:06.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.022+0000 7f2b788a7740 20 client.16344 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:06.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.022+0000 7f2b788a7740 1 --2- 172.21.15.27:0/3851032861 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5571a2bf5730 0x5571a2bf7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:06.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.022+0000 7f2b788a7740 4 client.16344 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:17:06.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.022+0000 7f2b788a7740 1 -- 172.21.15.27:0/3851032861 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5571a2ad7d00 con 0x5571a2bf5730 2024-09-19T08:17:06.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.023+0000 7f2b6ffff640 1 --2- 172.21.15.27:0/3851032861 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5571a2bf5730 0x5571a2bf7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:06.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.023+0000 7f2b6ffff640 1 --2- 172.21.15.27:0/3851032861 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5571a2bf5730 0x5571a2bf7b20 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=144b6b0075921d4 server_cookie=dd46d7b136dda146 in_seq=0 out_seq=0 2024-09-19T08:17:06.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.023+0000 7f2b4f7fe640 10 client.16344 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:06.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.024+0000 7f2b4f7fe640 1 -- 172.21.15.27:0/3851032861 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5571a2ad7d00 con 0x5571a2bf5730 2024-09-19T08:17:06.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.024+0000 7f2b4f7fe640 10 client.16344 handle_command_reply: tid=0 2024-09-19T08:17:06.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.024+0000 7f2b788a7740 1 client.16344 shutdown 2024-09-19T08:17:06.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.024+0000 7f2b788a7740 1 -- 172.21.15.27:0/3851032861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b7a150 msgr2=0x5571a2bf3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:06.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.024+0000 7f2b788a7740 1 --2- 172.21.15.27:0/3851032861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b7a150 0x5571a2bf3ad0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f2b58020650 tx=0x7f2b58019040 comp rx=0 tx=0).stop 2024-09-19T08:17:06.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.025+0000 7f2b788a7740 1 -- 172.21.15.27:0/3851032861 shutdown_connections 2024-09-19T08:17:06.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.025+0000 7f2b788a7740 1 --2- 172.21.15.27:0/3851032861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5571a2b7a150 0x5571a2bf3ad0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.025+0000 7f2b788a7740 1 --2- 172.21.15.27:0/3851032861 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5571a2bf5730 0x5571a2bf7b20 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.025+0000 7f2b788a7740 1 --2- 172.21.15.27:0/3851032861 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571a2b6b360 0x5571a2b7e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.025+0000 7f2b788a7740 1 --2- 172.21.15.27:0/3851032861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5571a2b6aa40 0x5571a2b7e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.025+0000 7f2b788a7740 1 -- 172.21.15.27:0/3851032861 >> 172.21.15.27:0/3851032861 conn(0x5571a2b670f0 msgr2=0x5571a2b6cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:06.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.025+0000 7f2b4f7fe640 0 client.16344 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:06.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.025+0000 7f2b788a7740 1 -- 172.21.15.27:0/3851032861 shutdown_connections 2024-09-19T08:17:06.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.025+0000 7f2b788a7740 1 -- 172.21.15.27:0/3851032861 wait complete. 2024-09-19T08:17:06.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.025+0000 7f2b788a7740 20 client.16344 trim_cache size 0 max 16384 2024-09-19T08:17:06.035 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:17:06.035 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:17:06.035 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "1c53d063-753f-4926-9d19-69535eb554a5", 2024-09-19T08:17:06.035 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:17:06.036 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:17:06.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.025+0000 7f2b764ce640 1 -- 172.21.15.27:0/1473246471 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2b5c0a3430 msgr2=0x7f2b5c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:06.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.025+0000 7f2b764ce640 1 --2- 172.21.15.27:0/1473246471 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2b5c0a3430 0x7f2b5c0a58f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2b680bd360 tx=0x7f2b6808c350 comp rx=0 tx=0).stop 2024-09-19T08:17:06.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.025+0000 7f2b764ce640 1 -- 172.21.15.27:0/1473246471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b70106a80 msgr2=0x7f2b7019ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:06.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.025+0000 7f2b764ce640 1 --2- 172.21.15.27:0/1473246471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b70106a80 0x7f2b7019ccd0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f2b68006010 tx=0x7f2b68003c20 comp rx=0 tx=0).stop 2024-09-19T08:17:06.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.025+0000 7f2b764ce640 1 -- 172.21.15.27:0/1473246471 shutdown_connections 2024-09-19T08:17:06.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.025+0000 7f2b764ce640 1 --2- 172.21.15.27:0/1473246471 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2b5c0a3430 0x7f2b5c0a58f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.025+0000 7f2b764ce640 1 --2- 172.21.15.27:0/1473246471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b70106a80 0x7f2b7019ccd0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.025+0000 7f2b764ce640 1 --2- 172.21.15.27:0/1473246471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b70101420 0x7f2b70198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.025+0000 7f2b764ce640 1 --2- 172.21.15.27:0/1473246471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b70100a80 0x7f2b70198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:06.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.025+0000 7f2b764ce640 1 -- 172.21.15.27:0/1473246471 >> 172.21.15.27:0/1473246471 conn(0x7f2b700fc7a0 msgr2=0x7f2b70104790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:06.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.026+0000 7f2b764ce640 1 -- 172.21.15.27:0/1473246471 shutdown_connections 2024-09-19T08:17:06.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:06.026+0000 7f2b764ce640 1 -- 172.21.15.27:0/1473246471 wait complete. 2024-09-19T08:17:06.880 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:17:06.945 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:06 smithi027 ceph-mon[31209]: pgmap v185: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:17:06.945 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:06 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:17:06.946 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:06 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:17:06.946 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:06 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:17:06.946 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:06 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:17:07.183 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:17:07.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:06 smithi155 ceph-mon[35362]: pgmap v185: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:17:07.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:06 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:17:07.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:06 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:17:07.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:06 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:17:07.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:06 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:17:07.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:06 smithi203 ceph-mon[35198]: pgmap v185: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:17:07.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:06 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:17:07.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:06 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:17:07.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:06 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:17:07.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:06 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:17:07.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.673+0000 7fe28f1cd640 1 -- 172.21.15.27:0/1159338912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe288102ef0 msgr2=0x7fe28810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:07.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.673+0000 7fe28f1cd640 1 --2- 172.21.15.27:0/1159338912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe288102ef0 0x7fe28810da40 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fe280009ca0 tx=0x7fe28002a950 comp rx=0 tx=0).stop 2024-09-19T08:17:07.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.674+0000 7fe28f1cd640 1 -- 172.21.15.27:0/1159338912 shutdown_connections 2024-09-19T08:17:07.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.674+0000 7fe28f1cd640 1 --2- 172.21.15.27:0/1159338912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe288102ef0 0x7fe28810da40 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.674+0000 7fe28f1cd640 1 --2- 172.21.15.27:0/1159338912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe288102570 0x7fe2881029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.674+0000 7fe28f1cd640 1 --2- 172.21.15.27:0/1159338912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe288100e20 0x7fe288101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.674+0000 7fe28f1cd640 1 -- 172.21.15.27:0/1159338912 >> 172.21.15.27:0/1159338912 conn(0x7fe2880fc7d0 msgr2=0x7fe2880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:07.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.674+0000 7fe28f1cd640 1 -- 172.21.15.27:0/1159338912 shutdown_connections 2024-09-19T08:17:07.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.674+0000 7fe28f1cd640 1 -- 172.21.15.27:0/1159338912 wait complete. 2024-09-19T08:17:07.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.674+0000 7fe28f1cd640 1 Processor -- start 2024-09-19T08:17:07.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.674+0000 7fe28f1cd640 1 -- start start 2024-09-19T08:17:07.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.674+0000 7fe28f1cd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe288100e20 0x7fe288199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:07.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.674+0000 7fe28f1cd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe288102570 0x7fe288199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:07.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.674+0000 7fe28f1cd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe288102ef0 0x7fe2881a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:07.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.674+0000 7fe28f1cd640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe288110fa0 con 0x7fe288100e20 2024-09-19T08:17:07.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.674+0000 7fe28f1cd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe288110e20 con 0x7fe288102ef0 2024-09-19T08:17:07.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.674+0000 7fe28f1cd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe288111120 con 0x7fe288102570 2024-09-19T08:17:07.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.675+0000 7fe28cf69640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe288100e20 0x7fe288199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:07.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.675+0000 7fe28cf69640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe288100e20 0x7fe288199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33972/0 (socket says 172.21.15.27:33972) 2024-09-19T08:17:07.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.675+0000 7fe28cf69640 1 -- 172.21.15.27:0/1768110755 learned_addr learned my addr 172.21.15.27:0/1768110755 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:07.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.675+0000 7fe28d76a640 1 --2- 172.21.15.27:0/1768110755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe288102ef0 0x7fe2881a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:07.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.675+0000 7fe287fff640 1 --2- 172.21.15.27:0/1768110755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe288102570 0x7fe288199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:07.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.675+0000 7fe28cf69640 1 -- 172.21.15.27:0/1768110755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe288102570 msgr2=0x7fe288199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:07.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.675+0000 7fe28cf69640 1 --2- 172.21.15.27:0/1768110755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe288102570 0x7fe288199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.675+0000 7fe28cf69640 1 -- 172.21.15.27:0/1768110755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe288102ef0 msgr2=0x7fe2881a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:07.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.675+0000 7fe28cf69640 1 --2- 172.21.15.27:0/1768110755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe288102ef0 0x7fe2881a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.675+0000 7fe28cf69640 1 -- 172.21.15.27:0/1768110755 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2881a4910 con 0x7fe288100e20 2024-09-19T08:17:07.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.675+0000 7fe28cf69640 1 --2- 172.21.15.27:0/1768110755 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe288100e20 0x7fe288199350 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fe27800d950 tx=0x7fe27800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:07.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.675+0000 7fe285ffb640 1 -- 172.21.15.27:0/1768110755 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe278017070 con 0x7fe288100e20 2024-09-19T08:17:07.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.675+0000 7fe285ffb640 1 -- 172.21.15.27:0/1768110755 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe278009c30 con 0x7fe288100e20 2024-09-19T08:17:07.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.675+0000 7fe28f1cd640 1 -- 172.21.15.27:0/1768110755 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2881a4ae0 con 0x7fe288100e20 2024-09-19T08:17:07.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.675+0000 7fe285ffb640 1 -- 172.21.15.27:0/1768110755 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27800f6b0 con 0x7fe288100e20 2024-09-19T08:17:07.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.676+0000 7fe28f1cd640 1 -- 172.21.15.27:0/1768110755 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2881a4ff0 con 0x7fe288100e20 2024-09-19T08:17:07.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.677+0000 7fe285ffb640 1 -- 172.21.15.27:0/1768110755 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe2780109d0 con 0x7fe288100e20 2024-09-19T08:17:07.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.678+0000 7fe2915a6740 1 Processor -- start 2024-09-19T08:17:07.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.678+0000 7fe2915a6740 1 -- start start 2024-09-19T08:17:07.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.678+0000 7fe2915a6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 0x558f2dc32880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:07.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.678+0000 7fe2915a6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f2dc32dc0 0x558f2dc3d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:07.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.678+0000 7fe2915a6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc3d680 0x558f2dc3fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:07.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.678+0000 7fe2915a6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x558f2db982e0 con 0x558f2dc324a0 2024-09-19T08:17:07.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.678+0000 7fe285ffb640 1 --2- 172.21.15.27:0/1768110755 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe2700a33b0 0x7fe2700a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:07.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.678+0000 7fe2915a6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558f2db3fce0 con 0x558f2dc3d680 2024-09-19T08:17:07.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.678+0000 7fe2915a6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558f2db942a0 con 0x558f2dc32dc0 2024-09-19T08:17:07.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.678+0000 7fe28d76a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 0x558f2dc32880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:07.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.678+0000 7fe28d76a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 0x558f2dc32880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33974/0 (socket says 172.21.15.27:33974) 2024-09-19T08:17:07.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.678+0000 7fe28d76a640 1 -- 172.21.15.27:0/3928396414 learned_addr learned my addr 172.21.15.27:0/3928396414 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:07.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.679+0000 7fe28d76a640 1 --2- 172.21.15.27:0/1768110755 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe2700a33b0 0x7fe2700a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:07.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.679+0000 7fe285ffb640 1 -- 172.21.15.27:0/1768110755 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fe2780cf980 con 0x7fe288100e20 2024-09-19T08:17:07.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.679+0000 7fe287fff640 1 --2- 172.21.15.27:0/3928396414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc3d680 0x558f2dc3fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:07.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.679+0000 7fe28cf69640 1 --2- 172.21.15.27:0/3928396414 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f2dc32dc0 0x558f2dc3d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:07.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.679+0000 7fe28d76a640 1 -- 172.21.15.27:0/3928396414 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f2dc32dc0 msgr2=0x558f2dc3d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:07.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.679+0000 7fe28d76a640 1 --2- 172.21.15.27:0/3928396414 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f2dc32dc0 0x558f2dc3d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.679+0000 7fe28d76a640 1 -- 172.21.15.27:0/3928396414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc3d680 msgr2=0x558f2dc3fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:07.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.679+0000 7fe28d76a640 1 --2- 172.21.15.27:0/3928396414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc3d680 0x558f2dc3fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.679+0000 7fe28d76a640 1 -- 172.21.15.27:0/3928396414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f2db24440 con 0x558f2dc324a0 2024-09-19T08:17:07.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.679+0000 7fe287fff640 1 --2- 172.21.15.27:0/3928396414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc3d680 0x558f2dc3fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:17:07.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.679+0000 7fe28d76a640 1 --2- 172.21.15.27:0/3928396414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 0x558f2dc32880 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fe280035000 tx=0x7fe28002f620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a321a923633c83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:07.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.679+0000 7fe28d76a640 1 --2- 172.21.15.27:0/1768110755 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe2700a33b0 0x7fe2700a5870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe28002f690 tx=0x7fe280043000 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:07.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.679+0000 7fe26effd640 1 -- 172.21.15.27:0/3928396414 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28004d070 con 0x558f2dc324a0 2024-09-19T08:17:07.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.679+0000 7fe26effd640 1 -- 172.21.15.27:0/3928396414 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe28002fbf0 con 0x558f2dc324a0 2024-09-19T08:17:07.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.679+0000 7fe26effd640 1 -- 172.21.15.27:0/3928396414 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe280034040 con 0x558f2dc324a0 2024-09-19T08:17:07.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.680+0000 7fe2915a6740 1 -- 172.21.15.27:0/3928396414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 msgr2=0x558f2dc32880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:07.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.680+0000 7fe2915a6740 1 --2- 172.21.15.27:0/3928396414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 0x558f2dc32880 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fe280035000 tx=0x7fe28002f620 comp rx=0 tx=0).stop 2024-09-19T08:17:07.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.680+0000 7fe2915a6740 1 -- 172.21.15.27:0/3928396414 shutdown_connections 2024-09-19T08:17:07.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.680+0000 7fe2915a6740 1 --2- 172.21.15.27:0/3928396414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc3d680 0x558f2dc3fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.680+0000 7fe2915a6740 1 --2- 172.21.15.27:0/3928396414 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f2dc32dc0 0x558f2dc3d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.680+0000 7fe2915a6740 1 --2- 172.21.15.27:0/3928396414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 0x558f2dc32880 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.680+0000 7fe2915a6740 1 -- 172.21.15.27:0/3928396414 >> 172.21.15.27:0/3928396414 conn(0x558f2dc2ea30 msgr2=0x558f2dc2ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:07.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.680+0000 7fe2915a6740 1 -- 172.21.15.27:0/3928396414 shutdown_connections 2024-09-19T08:17:07.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.680+0000 7fe2915a6740 1 -- 172.21.15.27:0/3928396414 wait complete. 2024-09-19T08:17:07.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.680+0000 7fe2915a6740 1 -- start start 2024-09-19T08:17:07.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.681+0000 7fe2915a6740 1 Processor -- start 2024-09-19T08:17:07.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.681+0000 7fe2915a6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 0x558f2dc3cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:07.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.681+0000 7fe2915a6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc32dc0 0x558f2dc3a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:07.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.681+0000 7fe2915a6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f2dc3d680 0x558f2dc3a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:07.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.681+0000 7fe2915a6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x558f2dc40250 con 0x558f2dc324a0 2024-09-19T08:17:07.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.681+0000 7fe2915a6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558f2db53050 con 0x558f2dc32dc0 2024-09-19T08:17:07.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.681+0000 7fe2915a6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558f2dc403d0 con 0x558f2dc3d680 2024-09-19T08:17:07.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.681+0000 7fe2915a6740 10 client.0 _ll_register_callbacks cb 0x558f2db93160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:07.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.681+0000 7fe28cf69640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 0x558f2dc3cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:07.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.681+0000 7fe28cf69640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 0x558f2dc3cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33982/0 (socket says 172.21.15.27:33982) 2024-09-19T08:17:07.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.681+0000 7fe28cf69640 1 -- 172.21.15.27:0/3862516910 learned_addr learned my addr 172.21.15.27:0/3862516910 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:07.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.681+0000 7fe28d76a640 1 --2- 172.21.15.27:0/3862516910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f2dc3d680 0x558f2dc3a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:07.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.681+0000 7fe287fff640 1 --2- 172.21.15.27:0/3862516910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc32dc0 0x558f2dc3a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:07.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.681+0000 7fe28cf69640 1 -- 172.21.15.27:0/3862516910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f2dc3d680 msgr2=0x558f2dc3a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:07.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.681+0000 7fe28cf69640 1 --2- 172.21.15.27:0/3862516910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f2dc3d680 0x558f2dc3a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.681+0000 7fe28cf69640 1 -- 172.21.15.27:0/3862516910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc32dc0 msgr2=0x558f2dc3a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:07.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.681+0000 7fe28cf69640 1 --2- 172.21.15.27:0/3862516910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc32dc0 0x558f2dc3a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.681+0000 7fe28cf69640 1 -- 172.21.15.27:0/3862516910 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f2d9093c0 con 0x558f2dc324a0 2024-09-19T08:17:07.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.682+0000 7fe28cf69640 1 --2- 172.21.15.27:0/3862516910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 0x558f2dc3cf90 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe278097930 tx=0x7fe2780cfc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464bb1a80dcba144 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:07.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.682+0000 7fe267fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:07.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.682+0000 7fe267fff640 1 -- 172.21.15.27:0/3862516910 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe278020040 con 0x558f2dc324a0 2024-09-19T08:17:07.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.682+0000 7fe267fff640 1 -- 172.21.15.27:0/3862516910 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fe27809a730 con 0x558f2dc324a0 2024-09-19T08:17:07.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.682+0000 7fe2915a6740 1 -- 172.21.15.27:0/3862516910 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558f2dba5850 con 0x558f2dc324a0 2024-09-19T08:17:07.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.682+0000 7fe267fff640 1 -- 172.21.15.27:0/3862516910 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe2780cd540 con 0x558f2dc324a0 2024-09-19T08:17:07.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.682+0000 7fe2915a6740 10 client.16356 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:07.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.682+0000 7fe2915a6740 1 -- 172.21.15.27:0/3862516910 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558f2dc4bbd0 con 0x558f2dc324a0 2024-09-19T08:17:07.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.682+0000 7fe267fff640 1 -- 172.21.15.27:0/3862516910 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x558f2dba5850 con 0x558f2dc324a0 2024-09-19T08:17:07.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.682+0000 7fe267fff640 1 -- 172.21.15.27:0/3862516910 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe278099890 con 0x558f2dc324a0 2024-09-19T08:17:07.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.682+0000 7fe2915a6740 10 client.16356 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:07.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.682+0000 7fe2915a6740 10 client.16356 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:07.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.682+0000 7fe2915a6740 20 client.16356 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:07.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.682+0000 7fe2915a6740 1 --2- 172.21.15.27:0/3862516910 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558f2dc4d030 0x558f2dc4f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:07.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.682+0000 7fe2915a6740 4 client.16356 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:17:07.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.682+0000 7fe2915a6740 1 -- 172.21.15.27:0/3862516910 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f2db9fd60 con 0x558f2dc4d030 2024-09-19T08:17:07.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.683+0000 7fe287fff640 1 --2- 172.21.15.27:0/3862516910 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558f2dc4d030 0x558f2dc4f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:07.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.683+0000 7fe287fff640 1 --2- 172.21.15.27:0/3862516910 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558f2dc4d030 0x558f2dc4f460 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfeee8e4dc3fe6f9 server_cookie=bbff151bdf8c3c1f in_seq=0 out_seq=0 2024-09-19T08:17:07.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.683+0000 7fe267fff640 10 client.16356 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:07.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.684+0000 7fe267fff640 1 -- 172.21.15.27:0/3862516910 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558f2db9fd60 con 0x558f2dc4d030 2024-09-19T08:17:07.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.684+0000 7fe267fff640 10 client.16356 handle_command_reply: tid=0 2024-09-19T08:17:07.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.684+0000 7fe2915a6740 1 client.16356 shutdown 2024-09-19T08:17:07.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.684+0000 7fe2915a6740 1 -- 172.21.15.27:0/3862516910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 msgr2=0x558f2dc3cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:07.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.684+0000 7fe2915a6740 1 --2- 172.21.15.27:0/3862516910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 0x558f2dc3cf90 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe278097930 tx=0x7fe2780cfc20 comp rx=0 tx=0).stop 2024-09-19T08:17:07.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.684+0000 7fe2915a6740 1 -- 172.21.15.27:0/3862516910 shutdown_connections 2024-09-19T08:17:07.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.684+0000 7fe2915a6740 1 --2- 172.21.15.27:0/3862516910 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558f2dc4d030 0x558f2dc4f460 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.684+0000 7fe2915a6740 1 --2- 172.21.15.27:0/3862516910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f2dc3d680 0x558f2dc3a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.684+0000 7fe2915a6740 1 --2- 172.21.15.27:0/3862516910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc32dc0 0x558f2dc3a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.684+0000 7fe2915a6740 1 --2- 172.21.15.27:0/3862516910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 0x558f2dc3cf90 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.684+0000 7fe267fff640 0 client.16356 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:07.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.684+0000 7fe2915a6740 1 -- 172.21.15.27:0/3862516910 >> 172.21.15.27:0/3862516910 conn(0x558f2dc2ea30 msgr2=0x558f2dc34710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:07.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.684+0000 7fe2915a6740 1 -- 172.21.15.27:0/3862516910 shutdown_connections 2024-09-19T08:17:07.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.684+0000 7fe2915a6740 1 -- 172.21.15.27:0/3862516910 wait complete. 2024-09-19T08:17:07.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.684+0000 7fe2915a6740 20 client.16356 trim_cache size 0 max 16384 2024-09-19T08:17:07.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.702+0000 7fe2915a6740 1 Processor -- start 2024-09-19T08:17:07.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.702+0000 7fe2915a6740 1 -- start start 2024-09-19T08:17:07.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.702+0000 7fe2915a6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f2dc324a0 0x558f2dc2da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:07.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.702+0000 7fe2915a6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc32dc0 0x558f2dc54ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:07.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.702+0000 7fe2915a6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc3d680 0x558f2dc55220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:07.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.702+0000 7fe2915a6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881ab6b0 con 0x558f2dc32dc0 2024-09-19T08:17:07.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.702+0000 7fe2915a6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881adf30 con 0x558f2dc3d680 2024-09-19T08:17:07.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.702+0000 7fe2915a6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881abd20 con 0x558f2dc324a0 2024-09-19T08:17:07.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.702+0000 7fe287fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc32dc0 0x558f2dc54ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:07.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.702+0000 7fe287fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc32dc0 0x558f2dc54ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33988/0 (socket says 172.21.15.27:33988) 2024-09-19T08:17:07.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.702+0000 7fe287fff640 1 -- 172.21.15.27:0/2093961713 learned_addr learned my addr 172.21.15.27:0/2093961713 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:07.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.702+0000 7fe28cf69640 1 --2- 172.21.15.27:0/2093961713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f2dc324a0 0x558f2dc2da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:07.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.702+0000 7fe28d76a640 1 --2- 172.21.15.27:0/2093961713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc3d680 0x558f2dc55220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:07.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.702+0000 7fe287fff640 1 -- 172.21.15.27:0/2093961713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f2dc324a0 msgr2=0x558f2dc2da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:07.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.702+0000 7fe287fff640 1 --2- 172.21.15.27:0/2093961713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f2dc324a0 0x558f2dc2da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.702+0000 7fe287fff640 1 -- 172.21.15.27:0/2093961713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc3d680 msgr2=0x558f2dc55220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:07.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.702+0000 7fe287fff640 1 --2- 172.21.15.27:0/2093961713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc3d680 0x558f2dc55220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.702+0000 7fe287fff640 1 -- 172.21.15.27:0/2093961713 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f2dc33330 con 0x558f2dc32dc0 2024-09-19T08:17:07.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.702+0000 7fe28d76a640 1 --2- 172.21.15.27:0/2093961713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc3d680 0x558f2dc55220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:17:07.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.703+0000 7fe287fff640 1 --2- 172.21.15.27:0/2093961713 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc32dc0 0x558f2dc54ce0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fe27c000c00 tx=0x7fe27c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2000a05d123e9602 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:07.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.703+0000 7fe26e7fc640 1 -- 172.21.15.27:0/2093961713 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c028070 con 0x558f2dc32dc0 2024-09-19T08:17:07.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.703+0000 7fe26e7fc640 1 -- 172.21.15.27:0/2093961713 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe27c018d50 con 0x558f2dc32dc0 2024-09-19T08:17:07.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.703+0000 7fe26e7fc640 1 -- 172.21.15.27:0/2093961713 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c019770 con 0x558f2dc32dc0 2024-09-19T08:17:07.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.703+0000 7fe2915a6740 1 -- 172.21.15.27:0/2093961713 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc32dc0 msgr2=0x558f2dc54ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:07.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.703+0000 7fe2915a6740 1 --2- 172.21.15.27:0/2093961713 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc32dc0 0x558f2dc54ce0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fe27c000c00 tx=0x7fe27c008040 comp rx=0 tx=0).stop 2024-09-19T08:17:07.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.703+0000 7fe2915a6740 1 -- 172.21.15.27:0/2093961713 shutdown_connections 2024-09-19T08:17:07.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.703+0000 7fe2915a6740 1 --2- 172.21.15.27:0/2093961713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc3d680 0x558f2dc55220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.703+0000 7fe2915a6740 1 --2- 172.21.15.27:0/2093961713 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc32dc0 0x558f2dc54ce0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.703+0000 7fe2915a6740 1 --2- 172.21.15.27:0/2093961713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f2dc324a0 0x558f2dc2da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.703+0000 7fe2915a6740 1 -- 172.21.15.27:0/2093961713 >> 172.21.15.27:0/2093961713 conn(0x558f2dc2ea30 msgr2=0x558f2dc2d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:07.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.703+0000 7fe2915a6740 1 -- 172.21.15.27:0/2093961713 shutdown_connections 2024-09-19T08:17:07.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.703+0000 7fe2915a6740 1 -- 172.21.15.27:0/2093961713 wait complete. 2024-09-19T08:17:07.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.704+0000 7fe2915a6740 1 -- start start 2024-09-19T08:17:07.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.704+0000 7fe2915a6740 1 Processor -- start 2024-09-19T08:17:07.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.704+0000 7fe2915a6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 0x558f2dc45eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:07.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.704+0000 7fe2915a6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f2dc32dc0 0x558f2dc43200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:07.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.704+0000 7fe2915a6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc3d680 0x558f2dc43810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:07.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.704+0000 7fe2915a6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881ac3f0 con 0x558f2dc324a0 2024-09-19T08:17:07.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.704+0000 7fe2915a6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881ad860 con 0x558f2dc3d680 2024-09-19T08:17:07.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.704+0000 7fe2915a6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881acac0 con 0x558f2dc32dc0 2024-09-19T08:17:07.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.704+0000 7fe2915a6740 10 client.0 _ll_register_callbacks cb 0x7fe27809ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:07.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.704+0000 7fe28cf69640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 0x558f2dc45eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:07.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.704+0000 7fe28cf69640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 0x558f2dc45eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34002/0 (socket says 172.21.15.27:34002) 2024-09-19T08:17:07.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.704+0000 7fe28cf69640 1 -- 172.21.15.27:0/2704488239 learned_addr learned my addr 172.21.15.27:0/2704488239 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:07.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.705+0000 7fe28d76a640 1 --2- 172.21.15.27:0/2704488239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc3d680 0x558f2dc43810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:07.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.705+0000 7fe287fff640 1 --2- 172.21.15.27:0/2704488239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f2dc32dc0 0x558f2dc43200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:07.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.705+0000 7fe28cf69640 1 -- 172.21.15.27:0/2704488239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f2dc32dc0 msgr2=0x558f2dc43200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:07.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.705+0000 7fe28cf69640 1 --2- 172.21.15.27:0/2704488239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f2dc32dc0 0x558f2dc43200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.705+0000 7fe28cf69640 1 -- 172.21.15.27:0/2704488239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc3d680 msgr2=0x558f2dc43810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:07.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.705+0000 7fe28cf69640 1 --2- 172.21.15.27:0/2704488239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc3d680 0x558f2dc43810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.705+0000 7fe28cf69640 1 -- 172.21.15.27:0/2704488239 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f2dc33a20 con 0x558f2dc324a0 2024-09-19T08:17:07.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.705+0000 7fe28d76a640 1 --2- 172.21.15.27:0/2704488239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc3d680 0x558f2dc43810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:17:07.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.705+0000 7fe28cf69640 1 --2- 172.21.15.27:0/2704488239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 0x558f2dc45eb0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fe27800dfe0 tx=0x7fe27809a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1cde35ac0de0ce1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:07.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.705+0000 7fe267fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:07.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.705+0000 7fe267fff640 1 -- 172.21.15.27:0/2704488239 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2780b1020 con 0x558f2dc324a0 2024-09-19T08:17:07.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.705+0000 7fe267fff640 1 -- 172.21.15.27:0/2704488239 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fe27809b170 con 0x558f2dc324a0 2024-09-19T08:17:07.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.705+0000 7fe2915a6740 1 -- 172.21.15.27:0/2704488239 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe27c018d50 con 0x558f2dc324a0 2024-09-19T08:17:07.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.705+0000 7fe267fff640 1 -- 172.21.15.27:0/2704488239 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe2780cd540 con 0x558f2dc324a0 2024-09-19T08:17:07.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.705+0000 7fe2915a6740 10 client.16362 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:07.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.705+0000 7fe2915a6740 1 -- 172.21.15.27:0/2704488239 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558f2dcb7bb0 con 0x558f2dc324a0 2024-09-19T08:17:07.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.705+0000 7fe267fff640 1 -- 172.21.15.27:0/2704488239 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe27c018d50 con 0x558f2dc324a0 2024-09-19T08:17:07.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.706+0000 7fe267fff640 1 -- 172.21.15.27:0/2704488239 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe27809a690 con 0x558f2dc324a0 2024-09-19T08:17:07.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.706+0000 7fe2915a6740 10 client.16362 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:07.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.706+0000 7fe2915a6740 10 client.16362 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:07.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.706+0000 7fe2915a6740 20 client.16362 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:07.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.706+0000 7fe2915a6740 1 --2- 172.21.15.27:0/2704488239 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558f2dcb8140 0x558f2dcba550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:07.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.706+0000 7fe2915a6740 4 client.16362 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:17:07.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.706+0000 7fe2915a6740 1 -- 172.21.15.27:0/2704488239 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558f2db1c210 con 0x558f2dcb8140 2024-09-19T08:17:07.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.706+0000 7fe287fff640 1 --2- 172.21.15.27:0/2704488239 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558f2dcb8140 0x558f2dcba550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:07.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.706+0000 7fe287fff640 1 --2- 172.21.15.27:0/2704488239 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558f2dcb8140 0x558f2dcba550 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dff650b7c88ca4e server_cookie=25577c859002f8b1 in_seq=0 out_seq=0 2024-09-19T08:17:07.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.706+0000 7fe267fff640 10 client.16362 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:07.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.707+0000 7fe267fff640 1 -- 172.21.15.27:0/2704488239 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x558f2db1c210 con 0x558f2dcb8140 2024-09-19T08:17:07.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.707+0000 7fe267fff640 10 client.16362 handle_command_reply: tid=0 2024-09-19T08:17:07.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.707+0000 7fe2915a6740 1 client.16362 shutdown 2024-09-19T08:17:07.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.707+0000 7fe2915a6740 1 -- 172.21.15.27:0/2704488239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 msgr2=0x558f2dc45eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:07.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.707+0000 7fe2915a6740 1 --2- 172.21.15.27:0/2704488239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 0x558f2dc45eb0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fe27800dfe0 tx=0x7fe27809a160 comp rx=0 tx=0).stop 2024-09-19T08:17:07.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.707+0000 7fe2915a6740 1 -- 172.21.15.27:0/2704488239 shutdown_connections 2024-09-19T08:17:07.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.707+0000 7fe2915a6740 1 --2- 172.21.15.27:0/2704488239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f2dc3d680 0x558f2dc43810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.707+0000 7fe2915a6740 1 --2- 172.21.15.27:0/2704488239 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558f2dcb8140 0x558f2dcba550 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.707+0000 7fe2915a6740 1 --2- 172.21.15.27:0/2704488239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f2dc32dc0 0x558f2dc43200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.707+0000 7fe2915a6740 1 --2- 172.21.15.27:0/2704488239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558f2dc324a0 0x558f2dc45eb0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.707+0000 7fe267fff640 0 client.16362 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:07.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.707+0000 7fe2915a6740 1 -- 172.21.15.27:0/2704488239 >> 172.21.15.27:0/2704488239 conn(0x558f2dc2ea30 msgr2=0x558f2dc2db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:07.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.707+0000 7fe2915a6740 1 -- 172.21.15.27:0/2704488239 shutdown_connections 2024-09-19T08:17:07.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.707+0000 7fe2915a6740 1 -- 172.21.15.27:0/2704488239 wait complete. 2024-09-19T08:17:07.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.707+0000 7fe2915a6740 20 client.16362 trim_cache size 0 max 16384 2024-09-19T08:17:07.713 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:17:07.713 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:17:07.713 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": { 2024-09-19T08:17:07.713 INFO:teuthology.orchestra.run.smithi027.stdout: "1c53d063-753f-4926-9d19-69535eb554a5": { 2024-09-19T08:17:07.713 INFO:teuthology.orchestra.run.smithi027.stdout: "path": "/", 2024-09-19T08:17:07.713 INFO:teuthology.orchestra.run.smithi027.stdout: "tag": "1c53d063-753f-4926-9d19-69535eb554a5", 2024-09-19T08:17:07.713 INFO:teuthology.orchestra.run.smithi027.stdout: "options": "recursive,force" 2024-09-19T08:17:07.714 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:17:07.714 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:17:07.714 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:17:07.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.708+0000 7fe28f1cd640 1 -- 172.21.15.27:0/1768110755 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe2700a33b0 msgr2=0x7fe2700a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:07.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.708+0000 7fe28f1cd640 1 --2- 172.21.15.27:0/1768110755 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe2700a33b0 0x7fe2700a5870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe28002f690 tx=0x7fe280043000 comp rx=0 tx=0).stop 2024-09-19T08:17:07.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.708+0000 7fe28f1cd640 1 -- 172.21.15.27:0/1768110755 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe288100e20 msgr2=0x7fe288199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:07.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.708+0000 7fe28f1cd640 1 --2- 172.21.15.27:0/1768110755 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe288100e20 0x7fe288199350 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fe27800d950 tx=0x7fe27800de10 comp rx=0 tx=0).stop 2024-09-19T08:17:07.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.708+0000 7fe28f1cd640 1 -- 172.21.15.27:0/1768110755 shutdown_connections 2024-09-19T08:17:07.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.708+0000 7fe28f1cd640 1 --2- 172.21.15.27:0/1768110755 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe2700a33b0 0x7fe2700a5870 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.708+0000 7fe28f1cd640 1 --2- 172.21.15.27:0/1768110755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe288102ef0 0x7fe2881a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.708+0000 7fe28f1cd640 1 --2- 172.21.15.27:0/1768110755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe288102570 0x7fe288199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.708+0000 7fe28f1cd640 1 --2- 172.21.15.27:0/1768110755 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe288100e20 0x7fe288199350 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:07.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.708+0000 7fe28f1cd640 1 -- 172.21.15.27:0/1768110755 >> 172.21.15.27:0/1768110755 conn(0x7fe2880fc7d0 msgr2=0x7fe288106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:07.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.708+0000 7fe28f1cd640 1 -- 172.21.15.27:0/1768110755 shutdown_connections 2024-09-19T08:17:07.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:07.708+0000 7fe28f1cd640 1 -- 172.21.15.27:0/1768110755 wait complete. 2024-09-19T08:17:08.442 INFO:tasks.cephfs.filesystem:scrub status for tag:1c53d063-753f-4926-9d19-69535eb554a5 - {'path': '/', 'tag': '1c53d063-753f-4926-9d19-69535eb554a5', 'options': 'recursive,force'} 2024-09-19T08:17:09.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:08 smithi155 ceph-mon[35362]: pgmap v186: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:17:09.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:08 smithi027 ceph-mon[31209]: pgmap v186: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:17:09.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:08 smithi203 ceph-mon[35198]: pgmap v186: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:17:11.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:10 smithi155 ceph-mon[35362]: pgmap v187: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:17:11.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:10 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:17:11.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:10 smithi027 ceph-mon[31209]: pgmap v187: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:17:11.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:10 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:17:11.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:10 smithi203 ceph-mon[35198]: pgmap v187: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:17:11.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:10 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:17:13.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:12 smithi155 ceph-mon[35362]: pgmap v188: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:17:13.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:12 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:17:13.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:12 smithi027 ceph-mon[31209]: pgmap v188: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:17:13.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:12 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:17:13.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:12 smithi203 ceph-mon[35198]: pgmap v188: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T08:17:13.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:12 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:17:14.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:13 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:17:14.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:13 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:17:14.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:13 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:17:14.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:13 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:17:14.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:13 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:17:14.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:13 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:17:14.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:13 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:17:14.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:13 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:17:14.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:13 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:17:15.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:14 smithi155 ceph-mon[35362]: pgmap v189: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:17:15.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:14 smithi027 ceph-mon[31209]: pgmap v189: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:17:15.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:14 smithi203 ceph-mon[35198]: pgmap v189: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T08:17:17.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:16 smithi155 ceph-mon[35362]: pgmap v190: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-19T08:17:17.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:16 smithi027 ceph-mon[31209]: pgmap v190: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-19T08:17:17.257 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:16 smithi203 ceph-mon[35198]: pgmap v190: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-19T08:17:19.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:18 smithi155 ceph-mon[35362]: pgmap v191: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T08:17:19.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:18 smithi027 ceph-mon[31209]: pgmap v191: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T08:17:19.257 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:18 smithi203 ceph-mon[35198]: pgmap v191: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T08:17:21.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:20 smithi155 ceph-mon[35362]: pgmap v192: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:21.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:20 smithi027 ceph-mon[31209]: pgmap v192: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:21.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:20 smithi203 ceph-mon[35198]: pgmap v192: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:23.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:22 smithi155 ceph-mon[35362]: pgmap v193: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:23.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:22 smithi027 ceph-mon[31209]: pgmap v193: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:23.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:22 smithi203 ceph-mon[35198]: pgmap v193: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:25.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:24 smithi155 ceph-mon[35362]: pgmap v194: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:17:25.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:24 smithi027 ceph-mon[31209]: pgmap v194: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:17:25.257 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:24 smithi203 ceph-mon[35198]: pgmap v194: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:17:27.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:26 smithi155 ceph-mon[35362]: pgmap v195: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:27.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:26 smithi027 ceph-mon[31209]: pgmap v195: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:27.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:26 smithi203 ceph-mon[35198]: pgmap v195: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:29.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:28 smithi155 ceph-mon[35362]: pgmap v196: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:17:29.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:28 smithi027 ceph-mon[31209]: pgmap v196: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:17:29.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:28 smithi203 ceph-mon[35198]: pgmap v196: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:17:31.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:30 smithi155 ceph-mon[35362]: pgmap v197: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:31.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:30 smithi027 ceph-mon[31209]: pgmap v197: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:31.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:30 smithi203 ceph-mon[35198]: pgmap v197: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:33.242 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:32 smithi155 ceph-mon[35362]: pgmap v198: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:33.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:32 smithi027 ceph-mon[31209]: pgmap v198: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:33.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:32 smithi203 ceph-mon[35198]: pgmap v198: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:35.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:34 smithi155 ceph-mon[35362]: pgmap v199: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:17:35.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:34 smithi027 ceph-mon[31209]: pgmap v199: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:17:35.257 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:34 smithi203 ceph-mon[35198]: pgmap v199: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:17:37.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:36 smithi155 ceph-mon[35362]: pgmap v200: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:37.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:36 smithi027 ceph-mon[31209]: pgmap v200: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:37.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:36 smithi203 ceph-mon[35198]: pgmap v200: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:38.444 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:17:38.720 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:17:39.118 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:38 smithi027 ceph-mon[31209]: pgmap v201: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:17:39.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.204+0000 7f68582df640 1 -- 172.21.15.27:0/757927231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6850106a80 msgr2=0x7f6850106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:39.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.204+0000 7f68582df640 1 --2- 172.21.15.27:0/757927231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6850106a80 0x7f6850106e60 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f684c009930 tx=0x7f684c02a420 comp rx=0 tx=0).stop 2024-09-19T08:17:39.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.204+0000 7f68582df640 1 -- 172.21.15.27:0/757927231 shutdown_connections 2024-09-19T08:17:39.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.204+0000 7f68582df640 1 --2- 172.21.15.27:0/757927231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6850101420 0x7f685010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.204+0000 7f68582df640 1 --2- 172.21.15.27:0/757927231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6850100a80 0x7f6850100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.204+0000 7f68582df640 1 --2- 172.21.15.27:0/757927231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6850106a80 0x7f6850106e60 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.204+0000 7f68582df640 1 -- 172.21.15.27:0/757927231 >> 172.21.15.27:0/757927231 conn(0x7f68500fc7a0 msgr2=0x7f68500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:39.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.204+0000 7f68582df640 1 -- 172.21.15.27:0/757927231 shutdown_connections 2024-09-19T08:17:39.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.204+0000 7f68582df640 1 -- 172.21.15.27:0/757927231 wait complete. 2024-09-19T08:17:39.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.205+0000 7f68582df640 1 Processor -- start 2024-09-19T08:17:39.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.205+0000 7f68582df640 1 -- start start 2024-09-19T08:17:39.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.205+0000 7f68582df640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6850100a80 0x7f68501984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:39.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.205+0000 7f68582df640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6850101420 0x7f68501989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:39.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.205+0000 7f68582df640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6850106a80 0x7f685019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:39.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.205+0000 7f68582df640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6850111fa0 con 0x7f6850101420 2024-09-19T08:17:39.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.205+0000 7f68582df640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6850111e20 con 0x7f6850100a80 2024-09-19T08:17:39.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.205+0000 7f68582df640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6850112120 con 0x7f6850106a80 2024-09-19T08:17:39.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.206+0000 7f685587a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6850101420 0x7f68501989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:39.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.206+0000 7f685587a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6850101420 0x7f68501989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54772/0 (socket says 172.21.15.27:54772) 2024-09-19T08:17:39.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.206+0000 7f685587a640 1 -- 172.21.15.27:0/2675903232 learned_addr learned my addr 172.21.15.27:0/2675903232 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:39.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.206+0000 7f685687c640 1 --2- 172.21.15.27:0/2675903232 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6850106a80 0x7f685019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:39.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.206+0000 7f685607b640 1 --2- 172.21.15.27:0/2675903232 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6850100a80 0x7f68501984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:39.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.206+0000 7f685587a640 1 -- 172.21.15.27:0/2675903232 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6850106a80 msgr2=0x7f685019cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:39.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.206+0000 7f685587a640 1 --2- 172.21.15.27:0/2675903232 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6850106a80 0x7f685019cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.206+0000 7f685587a640 1 -- 172.21.15.27:0/2675903232 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6850100a80 msgr2=0x7f68501984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:39.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.206+0000 7f685587a640 1 --2- 172.21.15.27:0/2675903232 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6850100a80 0x7f68501984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.206+0000 7f685587a640 1 -- 172.21.15.27:0/2675903232 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f685019d450 con 0x7f6850101420 2024-09-19T08:17:39.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.206+0000 7f685587a640 1 --2- 172.21.15.27:0/2675903232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6850101420 0x7f68501989e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f684000d770 tx=0x7f684000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:39.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.206+0000 7f68477fe640 1 -- 172.21.15.27:0/2675903232 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6840017070 con 0x7f6850101420 2024-09-19T08:17:39.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.206+0000 7f68582df640 1 -- 172.21.15.27:0/2675903232 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f685019d740 con 0x7f6850101420 2024-09-19T08:17:39.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.206+0000 7f68477fe640 1 -- 172.21.15.27:0/2675903232 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6840005500 con 0x7f6850101420 2024-09-19T08:17:39.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.206+0000 7f68582df640 1 -- 172.21.15.27:0/2675903232 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68501a5020 con 0x7f6850101420 2024-09-19T08:17:39.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.206+0000 7f68477fe640 1 -- 172.21.15.27:0/2675903232 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6840020060 con 0x7f6850101420 2024-09-19T08:17:39.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.209+0000 7f68477fe640 1 -- 172.21.15.27:0/2675903232 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6840004da0 con 0x7f6850101420 2024-09-19T08:17:39.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.209+0000 7f685a6b8740 1 Processor -- start 2024-09-19T08:17:39.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.209+0000 7f685a6b8740 1 -- start start 2024-09-19T08:17:39.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.209+0000 7f685a6b8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06dee8b0 0x558b06deec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:39.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.209+0000 7f685a6b8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b06def1d0 0x558b06df9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:39.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.209+0000 7f685a6b8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06df9a90 0x558b06dfbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:39.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.209+0000 7f685a6b8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x558b06d502e0 con 0x558b06df9a90 2024-09-19T08:17:39.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.209+0000 7f685a6b8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558b06cf7ce0 con 0x558b06dee8b0 2024-09-19T08:17:39.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.210+0000 7f685a6b8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558b06d4c2a0 con 0x558b06def1d0 2024-09-19T08:17:39.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.210+0000 7f685587a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06df9a90 0x558b06dfbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:39.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.210+0000 7f685587a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06df9a90 0x558b06dfbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54782/0 (socket says 172.21.15.27:54782) 2024-09-19T08:17:39.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.210+0000 7f685587a640 1 -- 172.21.15.27:0/1314419216 learned_addr learned my addr 172.21.15.27:0/1314419216 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:39.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.210+0000 7f685687c640 1 --2- 172.21.15.27:0/1314419216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06dee8b0 0x558b06deec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:39.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.210+0000 7f685607b640 1 --2- 172.21.15.27:0/1314419216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b06def1d0 0x558b06df9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:39.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.210+0000 7f68477fe640 1 --2- 172.21.15.27:0/2675903232 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f683c0a33b0 0x7f683c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:39.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.210+0000 7f685587a640 1 -- 172.21.15.27:0/1314419216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b06def1d0 msgr2=0x558b06df9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:39.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.210+0000 7f685587a640 1 --2- 172.21.15.27:0/1314419216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b06def1d0 0x558b06df9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.210+0000 7f685587a640 1 -- 172.21.15.27:0/1314419216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06dee8b0 msgr2=0x558b06deec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:39.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.210+0000 7f685587a640 1 --2- 172.21.15.27:0/1314419216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06dee8b0 0x558b06deec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.210+0000 7f685587a640 1 -- 172.21.15.27:0/1314419216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b06cdc440 con 0x558b06df9a90 2024-09-19T08:17:39.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.210+0000 7f685687c640 1 --2- 172.21.15.27:0/2675903232 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f683c0a33b0 0x7f683c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:39.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.210+0000 7f68477fe640 1 -- 172.21.15.27:0/2675903232 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f68400cf6c0 con 0x7f6850101420 2024-09-19T08:17:39.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.210+0000 7f685587a640 1 --2- 172.21.15.27:0/1314419216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06df9a90 0x558b06dfbe80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f68400ccdd0 tx=0x7f6840066490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777ee49379a74ff4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:39.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.210+0000 7f6844dea640 1 -- 172.21.15.27:0/1314419216 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6840014070 con 0x558b06df9a90 2024-09-19T08:17:39.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.211+0000 7f6844dea640 1 -- 172.21.15.27:0/1314419216 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68400046c0 con 0x558b06df9a90 2024-09-19T08:17:39.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.211+0000 7f6844dea640 1 -- 172.21.15.27:0/1314419216 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684006a5a0 con 0x558b06df9a90 2024-09-19T08:17:39.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.211+0000 7f685a6b8740 1 -- 172.21.15.27:0/1314419216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06df9a90 msgr2=0x558b06dfbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:39.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.211+0000 7f685687c640 1 --2- 172.21.15.27:0/2675903232 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f683c0a33b0 0x7f683c0a5870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6848005fd0 tx=0x7f6848004a40 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:39.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.211+0000 7f685a6b8740 1 --2- 172.21.15.27:0/1314419216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06df9a90 0x558b06dfbe80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f68400ccdd0 tx=0x7f6840066490 comp rx=0 tx=0).stop 2024-09-19T08:17:39.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.211+0000 7f685a6b8740 1 -- 172.21.15.27:0/1314419216 shutdown_connections 2024-09-19T08:17:39.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.211+0000 7f685a6b8740 1 --2- 172.21.15.27:0/1314419216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06df9a90 0x558b06dfbe80 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.211+0000 7f685a6b8740 1 --2- 172.21.15.27:0/1314419216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b06def1d0 0x558b06df9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.211+0000 7f685a6b8740 1 --2- 172.21.15.27:0/1314419216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06dee8b0 0x558b06deec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.211+0000 7f685a6b8740 1 -- 172.21.15.27:0/1314419216 >> 172.21.15.27:0/1314419216 conn(0x558b06deae40 msgr2=0x558b06deb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:39.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.211+0000 7f685a6b8740 1 -- 172.21.15.27:0/1314419216 shutdown_connections 2024-09-19T08:17:39.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.211+0000 7f685a6b8740 1 -- 172.21.15.27:0/1314419216 wait complete. 2024-09-19T08:17:39.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.212+0000 7f685a6b8740 1 -- start start 2024-09-19T08:17:39.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.212+0000 7f685a6b8740 1 Processor -- start 2024-09-19T08:17:39.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.212+0000 7f685a6b8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b06dee8b0 0x558b06df9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:39.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.212+0000 7f685a6b8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06def1d0 0x558b06df6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:39.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.212+0000 7f685a6b8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06df9a90 0x558b06df6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:39.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.212+0000 7f685a6b8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x558b06dfc660 con 0x558b06df9a90 2024-09-19T08:17:39.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.212+0000 7f685a6b8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558b06d0b050 con 0x558b06def1d0 2024-09-19T08:17:39.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.212+0000 7f685a6b8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558b06dfc7e0 con 0x558b06dee8b0 2024-09-19T08:17:39.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.212+0000 7f685a6b8740 10 client.0 _ll_register_callbacks cb 0x558b06d4b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:39.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.212+0000 7f685687c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06df9a90 0x558b06df6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:39.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.212+0000 7f685687c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06df9a90 0x558b06df6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54790/0 (socket says 172.21.15.27:54790) 2024-09-19T08:17:39.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.212+0000 7f685687c640 1 -- 172.21.15.27:0/2014784219 learned_addr learned my addr 172.21.15.27:0/2014784219 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:39.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.212+0000 7f685607b640 1 --2- 172.21.15.27:0/2014784219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b06dee8b0 0x558b06df9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:39.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.212+0000 7f685587a640 1 --2- 172.21.15.27:0/2014784219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06def1d0 0x558b06df6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:39.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.213+0000 7f685687c640 1 -- 172.21.15.27:0/2014784219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b06dee8b0 msgr2=0x558b06df9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:39.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.213+0000 7f685687c640 1 --2- 172.21.15.27:0/2014784219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b06dee8b0 0x558b06df9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.213+0000 7f685687c640 1 -- 172.21.15.27:0/2014784219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06def1d0 msgr2=0x558b06df6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:39.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.213+0000 7f685687c640 1 --2- 172.21.15.27:0/2014784219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06def1d0 0x558b06df6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.213+0000 7f685687c640 1 -- 172.21.15.27:0/2014784219 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b06ac13c0 con 0x558b06df9a90 2024-09-19T08:17:39.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.213+0000 7f685587a640 1 --2- 172.21.15.27:0/2014784219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06def1d0 0x558b06df6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:17:39.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.213+0000 7f685687c640 1 --2- 172.21.15.27:0/2014784219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06df9a90 0x558b06df6b40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f68480126f0 tx=0x7f6848004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398bd1f92ede1cf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:39.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.213+0000 7f6839ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:39.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.213+0000 7f6839ffb640 1 -- 172.21.15.27:0/2014784219 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68480107d0 con 0x558b06df9a90 2024-09-19T08:17:39.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.213+0000 7f6839ffb640 1 -- 172.21.15.27:0/2014784219 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f6848010970 con 0x558b06df9a90 2024-09-19T08:17:39.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.213+0000 7f685a6b8740 1 -- 172.21.15.27:0/2014784219 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558b06d5d850 con 0x558b06df9a90 2024-09-19T08:17:39.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.213+0000 7f6839ffb640 1 -- 172.21.15.27:0/2014784219 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6848030050 con 0x558b06df9a90 2024-09-19T08:17:39.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.213+0000 7f685a6b8740 10 client.16374 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:39.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.213+0000 7f685a6b8740 1 -- 172.21.15.27:0/2014784219 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558b06e08060 con 0x558b06df9a90 2024-09-19T08:17:39.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.213+0000 7f6839ffb640 1 -- 172.21.15.27:0/2014784219 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x558b06d5d850 con 0x558b06df9a90 2024-09-19T08:17:39.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.213+0000 7f6839ffb640 1 -- 172.21.15.27:0/2014784219 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f684800f040 con 0x558b06df9a90 2024-09-19T08:17:39.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.213+0000 7f685a6b8740 10 client.16374 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:39.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.213+0000 7f685a6b8740 10 client.16374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:39.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.213+0000 7f685a6b8740 20 client.16374 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:39.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.214+0000 7f685a6b8740 1 --2- 172.21.15.27:0/2014784219 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558b06e09520 0x558b06e0b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:39.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.214+0000 7f685a6b8740 4 client.16374 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:17:39.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.214+0000 7f685a6b8740 1 -- 172.21.15.27:0/2014784219 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b06d57d60 con 0x558b06e09520 2024-09-19T08:17:39.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.214+0000 7f685607b640 1 --2- 172.21.15.27:0/2014784219 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558b06e09520 0x558b06e0b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:39.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.214+0000 7f685607b640 1 --2- 172.21.15.27:0/2014784219 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558b06e09520 0x558b06e0b9a0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3af047effe455b21 server_cookie=6414dcf81b1c7697 in_seq=0 out_seq=0 2024-09-19T08:17:39.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.214+0000 7f6839ffb640 10 client.16374 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:39.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.215+0000 7f6839ffb640 1 -- 172.21.15.27:0/2014784219 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b06d57d60 con 0x558b06e09520 2024-09-19T08:17:39.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.215+0000 7f6839ffb640 10 client.16374 handle_command_reply: tid=0 2024-09-19T08:17:39.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.215+0000 7f685a6b8740 1 client.16374 shutdown 2024-09-19T08:17:39.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.215+0000 7f685a6b8740 1 -- 172.21.15.27:0/2014784219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06df9a90 msgr2=0x558b06df6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:39.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.215+0000 7f685a6b8740 1 --2- 172.21.15.27:0/2014784219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06df9a90 0x558b06df6b40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f68480126f0 tx=0x7f6848004ab0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.215+0000 7f685a6b8740 1 -- 172.21.15.27:0/2014784219 shutdown_connections 2024-09-19T08:17:39.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.216+0000 7f685a6b8740 1 --2- 172.21.15.27:0/2014784219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06df9a90 0x558b06df6b40 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.216+0000 7f685a6b8740 1 --2- 172.21.15.27:0/2014784219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06def1d0 0x558b06df6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.216+0000 7f685a6b8740 1 --2- 172.21.15.27:0/2014784219 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558b06e09520 0x558b06e0b9a0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.216+0000 7f685a6b8740 1 --2- 172.21.15.27:0/2014784219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b06dee8b0 0x558b06df9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.216+0000 7f685a6b8740 1 -- 172.21.15.27:0/2014784219 >> 172.21.15.27:0/2014784219 conn(0x558b06deae40 msgr2=0x558b06df0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:39.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.216+0000 7f6839ffb640 0 client.16374 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:39.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.216+0000 7f685a6b8740 1 -- 172.21.15.27:0/2014784219 shutdown_connections 2024-09-19T08:17:39.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.216+0000 7f685a6b8740 1 -- 172.21.15.27:0/2014784219 wait complete. 2024-09-19T08:17:39.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.216+0000 7f685a6b8740 20 client.16374 trim_cache size 0 max 16384 2024-09-19T08:17:39.241 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:38 smithi155 ceph-mon[35362]: pgmap v201: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:17:39.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.233+0000 7f685a6b8740 1 Processor -- start 2024-09-19T08:17:39.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.233+0000 7f685a6b8740 1 -- start start 2024-09-19T08:17:39.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.233+0000 7f685a6b8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06deae40 0x558b06e058c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:39.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.233+0000 7f685a6b8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06dee8b0 0x558b06df65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:39.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.233+0000 7f685a6b8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b06def1d0 0x558b06df1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:39.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.233+0000 7f685a6b8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f68501a94e0 con 0x558b06deae40 2024-09-19T08:17:39.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.233+0000 7f685a6b8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f68501abd40 con 0x558b06dee8b0 2024-09-19T08:17:39.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.233+0000 7f685a6b8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f68501a9b30 con 0x558b06def1d0 2024-09-19T08:17:39.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.233+0000 7f685607b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06deae40 0x558b06e058c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:39.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.233+0000 7f685607b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06deae40 0x558b06e058c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54806/0 (socket says 172.21.15.27:54806) 2024-09-19T08:17:39.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.233+0000 7f685607b640 1 -- 172.21.15.27:0/1888762602 learned_addr learned my addr 172.21.15.27:0/1888762602 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:39.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.234+0000 7f685687c640 1 --2- 172.21.15.27:0/1888762602 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b06def1d0 0x558b06df1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:39.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.234+0000 7f685607b640 1 -- 172.21.15.27:0/1888762602 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b06def1d0 msgr2=0x558b06df1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:39.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.234+0000 7f685587a640 1 --2- 172.21.15.27:0/1888762602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06dee8b0 0x558b06df65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:39.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.234+0000 7f685607b640 1 --2- 172.21.15.27:0/1888762602 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b06def1d0 0x558b06df1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.234+0000 7f685607b640 1 -- 172.21.15.27:0/1888762602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06dee8b0 msgr2=0x558b06df65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:39.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.234+0000 7f685607b640 1 --2- 172.21.15.27:0/1888762602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06dee8b0 0x558b06df65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.234+0000 7f685607b640 1 -- 172.21.15.27:0/1888762602 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b06df55b0 con 0x558b06deae40 2024-09-19T08:17:39.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.234+0000 7f685687c640 1 --2- 172.21.15.27:0/1888762602 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b06def1d0 0x558b06df1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:17:39.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.234+0000 7f685587a640 1 --2- 172.21.15.27:0/1888762602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06dee8b0 0x558b06df65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:17:39.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.234+0000 7f685607b640 1 --2- 172.21.15.27:0/1888762602 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06deae40 0x558b06e058c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f684c02a940 tx=0x7f684c031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818926012019cfb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:39.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.234+0000 7f683bfff640 1 -- 172.21.15.27:0/1888762602 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684c035040 con 0x558b06deae40 2024-09-19T08:17:39.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.234+0000 7f683bfff640 1 -- 172.21.15.27:0/1888762602 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f684c005500 con 0x558b06deae40 2024-09-19T08:17:39.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.234+0000 7f683bfff640 1 -- 172.21.15.27:0/1888762602 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684c004ca0 con 0x558b06deae40 2024-09-19T08:17:39.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.235+0000 7f685a6b8740 1 -- 172.21.15.27:0/1888762602 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06deae40 msgr2=0x558b06e058c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:39.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.235+0000 7f685a6b8740 1 --2- 172.21.15.27:0/1888762602 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06deae40 0x558b06e058c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f684c02a940 tx=0x7f684c031b10 comp rx=0 tx=0).stop 2024-09-19T08:17:39.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.235+0000 7f685a6b8740 1 -- 172.21.15.27:0/1888762602 shutdown_connections 2024-09-19T08:17:39.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.235+0000 7f685a6b8740 1 --2- 172.21.15.27:0/1888762602 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b06def1d0 0x558b06df1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.235+0000 7f685a6b8740 1 --2- 172.21.15.27:0/1888762602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06dee8b0 0x558b06df65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.235+0000 7f685a6b8740 1 --2- 172.21.15.27:0/1888762602 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06deae40 0x558b06e058c0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.235+0000 7f685a6b8740 1 -- 172.21.15.27:0/1888762602 >> 172.21.15.27:0/1888762602 conn(0x558b06df6ca0 msgr2=0x558b06df14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:39.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.235+0000 7f685a6b8740 1 -- 172.21.15.27:0/1888762602 shutdown_connections 2024-09-19T08:17:39.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.235+0000 7f685a6b8740 1 -- 172.21.15.27:0/1888762602 wait complete. 2024-09-19T08:17:39.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.235+0000 7f685a6b8740 1 -- start start 2024-09-19T08:17:39.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.235+0000 7f685a6b8740 1 Processor -- start 2024-09-19T08:17:39.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.235+0000 7f685a6b8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06deae40 0x558b06e01ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:39.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.235+0000 7f685a6b8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06dee8b0 0x558b06dfd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:39.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.235+0000 7f685a6b8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b06def1d0 0x558b06dfd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:39.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.235+0000 7f685a6b8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f68501aa200 con 0x558b06dee8b0 2024-09-19T08:17:39.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.235+0000 7f685a6b8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f68501ab670 con 0x558b06deae40 2024-09-19T08:17:39.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.235+0000 7f685a6b8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f68501aa8d0 con 0x558b06def1d0 2024-09-19T08:17:39.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.236+0000 7f685a6b8740 10 client.0 _ll_register_callbacks cb 0x7f6848004860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:39.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.236+0000 7f685587a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06dee8b0 0x558b06dfd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:39.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.236+0000 7f685587a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06dee8b0 0x558b06dfd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54812/0 (socket says 172.21.15.27:54812) 2024-09-19T08:17:39.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.236+0000 7f685587a640 1 -- 172.21.15.27:0/4033159173 learned_addr learned my addr 172.21.15.27:0/4033159173 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:39.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.236+0000 7f685607b640 1 --2- 172.21.15.27:0/4033159173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06deae40 0x558b06e01ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:39.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.236+0000 7f685587a640 1 -- 172.21.15.27:0/4033159173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b06def1d0 msgr2=0x558b06dfd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:39.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.236+0000 7f685587a640 1 --2- 172.21.15.27:0/4033159173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b06def1d0 0x558b06dfd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.236+0000 7f685587a640 1 -- 172.21.15.27:0/4033159173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06deae40 msgr2=0x558b06e01ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:39.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.236+0000 7f685587a640 1 --2- 172.21.15.27:0/4033159173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06deae40 0x558b06e01ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.236+0000 7f685587a640 1 -- 172.21.15.27:0/4033159173 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b06dfdcd0 con 0x558b06dee8b0 2024-09-19T08:17:39.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.236+0000 7f685587a640 1 --2- 172.21.15.27:0/4033159173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06dee8b0 0x558b06dfd220 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f68400cd460 tx=0x7f684009b470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686303a8d7828c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:39.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.236+0000 7f6839ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:39.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.236+0000 7f6839ffb640 1 -- 172.21.15.27:0/4033159173 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6840014040 con 0x558b06dee8b0 2024-09-19T08:17:39.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.236+0000 7f6839ffb640 1 -- 172.21.15.27:0/4033159173 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f6840009cc0 con 0x558b06dee8b0 2024-09-19T08:17:39.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.236+0000 7f685a6b8740 1 -- 172.21.15.27:0/4033159173 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f684c005500 con 0x558b06dee8b0 2024-09-19T08:17:39.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.236+0000 7f6839ffb640 1 -- 172.21.15.27:0/4033159173 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f684009b5e0 con 0x558b06dee8b0 2024-09-19T08:17:39.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.236+0000 7f685a6b8740 10 client.16380 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:39.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.236+0000 7f685a6b8740 1 -- 172.21.15.27:0/4033159173 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558b06e73f70 con 0x558b06dee8b0 2024-09-19T08:17:39.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.237+0000 7f6839ffb640 1 -- 172.21.15.27:0/4033159173 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f684c005500 con 0x558b06dee8b0 2024-09-19T08:17:39.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.237+0000 7f6839ffb640 1 -- 172.21.15.27:0/4033159173 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6840064ce0 con 0x558b06dee8b0 2024-09-19T08:17:39.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.237+0000 7f685a6b8740 10 client.16380 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:39.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.237+0000 7f685a6b8740 10 client.16380 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:39.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.237+0000 7f685a6b8740 20 client.16380 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:39.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.237+0000 7f685a6b8740 1 --2- 172.21.15.27:0/4033159173 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558b06df9a90 0x558b06e762d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:39.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.237+0000 7f685a6b8740 4 client.16380 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:17:39.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.237+0000 7f685a6b8740 1 -- 172.21.15.27:0/4033159173 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558b06cd4210 con 0x558b06df9a90 2024-09-19T08:17:39.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.237+0000 7f685607b640 1 --2- 172.21.15.27:0/4033159173 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558b06df9a90 0x558b06e762d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.237+0000 7f6839ffb640 10 client.16380 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.237+0000 7f685607b640 1 --2- 172.21.15.27:0/4033159173 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558b06df9a90 0x558b06e762d0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1e47d4f582eab25 server_cookie=8cd86107f0358054 in_seq=0 out_seq=0 2024-09-19T08:17:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.238+0000 7f6839ffb640 1 -- 172.21.15.27:0/4033159173 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558b06cd4210 con 0x558b06df9a90 2024-09-19T08:17:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.238+0000 7f6839ffb640 10 client.16380 handle_command_reply: tid=0 2024-09-19T08:17:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.238+0000 7f685a6b8740 1 client.16380 shutdown 2024-09-19T08:17:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.238+0000 7f685a6b8740 1 -- 172.21.15.27:0/4033159173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06dee8b0 msgr2=0x558b06dfd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.238+0000 7f685a6b8740 1 --2- 172.21.15.27:0/4033159173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06dee8b0 0x558b06dfd220 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f68400cd460 tx=0x7f684009b470 comp rx=0 tx=0).stop 2024-09-19T08:17:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.238+0000 7f685a6b8740 1 -- 172.21.15.27:0/4033159173 shutdown_connections 2024-09-19T08:17:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.238+0000 7f685a6b8740 1 --2- 172.21.15.27:0/4033159173 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558b06df9a90 0x558b06e762d0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.238+0000 7f685a6b8740 1 --2- 172.21.15.27:0/4033159173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b06def1d0 0x558b06dfd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.238+0000 7f6839ffb640 0 client.16380 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.238+0000 7f685a6b8740 1 --2- 172.21.15.27:0/4033159173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b06dee8b0 0x558b06dfd220 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.238+0000 7f685a6b8740 1 --2- 172.21.15.27:0/4033159173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b06deae40 0x558b06e01ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.238+0000 7f685a6b8740 1 -- 172.21.15.27:0/4033159173 >> 172.21.15.27:0/4033159173 conn(0x558b06df6ca0 msgr2=0x558b06df1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:39.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.238+0000 7f685a6b8740 1 -- 172.21.15.27:0/4033159173 shutdown_connections 2024-09-19T08:17:39.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.238+0000 7f685a6b8740 1 -- 172.21.15.27:0/4033159173 wait complete. 2024-09-19T08:17:39.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.238+0000 7f685a6b8740 20 client.16380 trim_cache size 0 max 16384 2024-09-19T08:17:39.252 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:17:39.252 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:17:39.252 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:17:39.252 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:17:39.253 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.239+0000 7f68582df640 1 -- 172.21.15.27:0/2675903232 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f683c0a33b0 msgr2=0x7f683c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:39.253 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.239+0000 7f68582df640 1 --2- 172.21.15.27:0/2675903232 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f683c0a33b0 0x7f683c0a5870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6848005fd0 tx=0x7f6848004a40 comp rx=0 tx=0).stop 2024-09-19T08:17:39.253 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.239+0000 7f68582df640 1 -- 172.21.15.27:0/2675903232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6850101420 msgr2=0x7f68501989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:39.253 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.239+0000 7f68582df640 1 --2- 172.21.15.27:0/2675903232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6850101420 0x7f68501989e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f684000d770 tx=0x7f684000dc30 comp rx=0 tx=0).stop 2024-09-19T08:17:39.253 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.239+0000 7f68582df640 1 -- 172.21.15.27:0/2675903232 shutdown_connections 2024-09-19T08:17:39.253 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.239+0000 7f68582df640 1 --2- 172.21.15.27:0/2675903232 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f683c0a33b0 0x7f683c0a5870 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.253 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.239+0000 7f68582df640 1 --2- 172.21.15.27:0/2675903232 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6850106a80 0x7f685019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.239+0000 7f68582df640 1 --2- 172.21.15.27:0/2675903232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6850101420 0x7f68501989e0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.239+0000 7f68582df640 1 --2- 172.21.15.27:0/2675903232 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6850100a80 0x7f68501984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:39.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.239+0000 7f68582df640 1 -- 172.21.15.27:0/2675903232 >> 172.21.15.27:0/2675903232 conn(0x7f68500fc7a0 msgr2=0x7f68500fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:39.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.239+0000 7f68582df640 1 -- 172.21.15.27:0/2675903232 shutdown_connections 2024-09-19T08:17:39.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:39.239+0000 7f68582df640 1 -- 172.21.15.27:0/2675903232 wait complete. 2024-09-19T08:17:39.257 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:38 smithi203 ceph-mon[35198]: pgmap v201: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:17:40.076 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:17:40.076 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:17:40.342 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:17:40.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.828+0000 7f8bb1195640 1 -- 172.21.15.27:0/129475068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac101de0 msgr2=0x7f8bac1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:40.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.828+0000 7f8bb1195640 1 --2- 172.21.15.27:0/129475068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac101de0 0x7f8bac1021c0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c009900 tx=0x7f8b9c02a410 comp rx=0 tx=0).stop 2024-09-19T08:17:40.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.828+0000 7f8bb1195640 1 -- 172.21.15.27:0/129475068 shutdown_connections 2024-09-19T08:17:40.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.828+0000 7f8bb1195640 1 --2- 172.21.15.27:0/129475068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bac106f10 0x7f8bac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:40.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.828+0000 7f8bb1195640 1 --2- 172.21.15.27:0/129475068 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8bac102790 0x7f8bac1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:40.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.828+0000 7f8bb1195640 1 --2- 172.21.15.27:0/129475068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac101de0 0x7f8bac1021c0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:40.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.828+0000 7f8bb1195640 1 -- 172.21.15.27:0/129475068 >> 172.21.15.27:0/129475068 conn(0x7f8bac0fd8c0 msgr2=0x7f8bac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:40.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.828+0000 7f8bb1195640 1 -- 172.21.15.27:0/129475068 shutdown_connections 2024-09-19T08:17:40.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.828+0000 7f8bb1195640 1 -- 172.21.15.27:0/129475068 wait complete. 2024-09-19T08:17:40.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.829+0000 7f8bb1195640 1 Processor -- start 2024-09-19T08:17:40.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.829+0000 7f8bb1195640 1 -- start start 2024-09-19T08:17:40.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.830+0000 7f8bb1195640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac101de0 0x7f8bac19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:40.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.830+0000 7f8bb1195640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bac102790 0x7f8bac19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:40.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.830+0000 7f8bb1195640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8bac106f10 0x7f8bac19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:40.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.830+0000 7f8bb1195640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac111f70 con 0x7f8bac101de0 2024-09-19T08:17:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.830+0000 7f8bb1195640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac111df0 con 0x7f8bac102790 2024-09-19T08:17:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.830+0000 7f8bb1195640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac1120f0 con 0x7f8bac106f10 2024-09-19T08:17:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.830+0000 7f8baad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac101de0 0x7f8bac19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.830+0000 7f8baad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac101de0 0x7f8bac19a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37628/0 (socket says 172.21.15.27:37628) 2024-09-19T08:17:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.830+0000 7f8baad9d640 1 -- 172.21.15.27:0/1539227202 learned_addr learned my addr 172.21.15.27:0/1539227202 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.830+0000 7f8baa59c640 1 --2- 172.21.15.27:0/1539227202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bac102790 0x7f8bac19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.830+0000 7f8bab59e640 1 --2- 172.21.15.27:0/1539227202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8bac106f10 0x7f8bac19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.830+0000 7f8baad9d640 1 -- 172.21.15.27:0/1539227202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8bac106f10 msgr2=0x7f8bac19ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.830+0000 7f8baad9d640 1 --2- 172.21.15.27:0/1539227202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8bac106f10 0x7f8bac19ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.830+0000 7f8baad9d640 1 -- 172.21.15.27:0/1539227202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bac102790 msgr2=0x7f8bac19ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.830+0000 7f8baad9d640 1 --2- 172.21.15.27:0/1539227202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bac102790 0x7f8bac19ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.830+0000 7f8baad9d640 1 -- 172.21.15.27:0/1539227202 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bac19f600 con 0x7f8bac101de0 2024-09-19T08:17:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.830+0000 7f8baa59c640 1 --2- 172.21.15.27:0/1539227202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bac102790 0x7f8bac19ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:17:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.830+0000 7f8bab59e640 1 --2- 172.21.15.27:0/1539227202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8bac106f10 0x7f8bac19ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:17:40.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.830+0000 7f8baad9d640 1 --2- 172.21.15.27:0/1539227202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac101de0 0x7f8bac19a650 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c006010 tx=0x7f8b9c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:40.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.831+0000 7f8b93fff640 1 -- 172.21.15.27:0/1539227202 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c03f030 con 0x7f8bac101de0 2024-09-19T08:17:40.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.831+0000 7f8b93fff640 1 -- 172.21.15.27:0/1539227202 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b9c003ce0 con 0x7f8bac101de0 2024-09-19T08:17:40.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.831+0000 7f8bb1195640 1 -- 172.21.15.27:0/1539227202 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bac19f890 con 0x7f8bac101de0 2024-09-19T08:17:40.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.831+0000 7f8b93fff640 1 -- 172.21.15.27:0/1539227202 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c035070 con 0x7f8bac101de0 2024-09-19T08:17:40.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.831+0000 7f8bb1195640 1 -- 172.21.15.27:0/1539227202 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bac1a71d0 con 0x7f8bac101de0 2024-09-19T08:17:40.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.832+0000 7f8b91ffb640 1 -- 172.21.15.27:0/1539227202 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b8c005290 con 0x7f8bac101de0 2024-09-19T08:17:40.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.833+0000 7f8b93fff640 1 -- 172.21.15.27:0/1539227202 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f8b9c042030 con 0x7f8bac101de0 2024-09-19T08:17:40.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.833+0000 7f8b93fff640 1 --2- 172.21.15.27:0/1539227202 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8b940a33b0 0x7f8b940a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:40.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.834+0000 7f8baa59c640 1 --2- 172.21.15.27:0/1539227202 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8b940a33b0 0x7f8b940a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:40.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.834+0000 7f8b93fff640 1 -- 172.21.15.27:0/1539227202 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f8b9c0f0360 con 0x7f8bac101de0 2024-09-19T08:17:40.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.834+0000 7f8baa59c640 1 --2- 172.21.15.27:0/1539227202 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8b940a33b0 0x7f8b940a5870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8bac0ff770 tx=0x7f8ba0005f90 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:40.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:40.838+0000 7f8b93fff640 1 -- 172.21.15.27:0/1539227202 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8b9c0bce50 con 0x7f8bac101de0 2024-09-19T08:17:41.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:40 smithi027 ceph-mon[31209]: pgmap v202: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:41.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:41.051+0000 7f8b91ffb640 1 -- 172.21.15.27:0/1539227202 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b8c005850 con 0x7f8bac101de0 2024-09-19T08:17:41.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:41.052+0000 7f8b93fff640 1 -- 172.21.15.27:0/1539227202 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f8b9c0bc750 con 0x7f8bac101de0 2024-09-19T08:17:41.052 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:17:41.052 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:17:41.052 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:17:41.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:41.054+0000 7f8b91ffb640 1 -- 172.21.15.27:0/1539227202 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8b940a33b0 msgr2=0x7f8b940a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:41.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:41.054+0000 7f8b91ffb640 1 --2- 172.21.15.27:0/1539227202 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8b940a33b0 0x7f8b940a5870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8bac0ff770 tx=0x7f8ba0005f90 comp rx=0 tx=0).stop 2024-09-19T08:17:41.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:41.054+0000 7f8b91ffb640 1 -- 172.21.15.27:0/1539227202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac101de0 msgr2=0x7f8bac19a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:41.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:41.054+0000 7f8b91ffb640 1 --2- 172.21.15.27:0/1539227202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac101de0 0x7f8bac19a650 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c006010 tx=0x7f8b9c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:17:41.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:41.054+0000 7f8b91ffb640 1 -- 172.21.15.27:0/1539227202 shutdown_connections 2024-09-19T08:17:41.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:41.054+0000 7f8b91ffb640 1 --2- 172.21.15.27:0/1539227202 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8b940a33b0 0x7f8b940a5870 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:41.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:41.054+0000 7f8b91ffb640 1 --2- 172.21.15.27:0/1539227202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8bac106f10 0x7f8bac19ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:41.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:41.054+0000 7f8b91ffb640 1 --2- 172.21.15.27:0/1539227202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bac102790 0x7f8bac19ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:41.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:41.054+0000 7f8b91ffb640 1 --2- 172.21.15.27:0/1539227202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac101de0 0x7f8bac19a650 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:41.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:41.054+0000 7f8b91ffb640 1 -- 172.21.15.27:0/1539227202 >> 172.21.15.27:0/1539227202 conn(0x7f8bac0fd8c0 msgr2=0x7f8bac0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:41.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:41.054+0000 7f8b91ffb640 1 -- 172.21.15.27:0/1539227202 shutdown_connections 2024-09-19T08:17:41.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:41.054+0000 7f8b91ffb640 1 -- 172.21.15.27:0/1539227202 wait complete. 2024-09-19T08:17:41.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:40 smithi155 ceph-mon[35362]: pgmap v202: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:41.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:40 smithi203 ceph-mon[35198]: pgmap v202: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:41.672 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:17:41.931 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:17:42.224 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:41 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1539227202' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:17:42.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:41 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1539227202' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:17:42.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:41 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1539227202' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:17:42.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.448+0000 7f1fbc5a3640 1 -- 172.21.15.27:0/1834963424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fb4102790 msgr2=0x7f1fb41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:42.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.448+0000 7f1fbc5a3640 1 --2- 172.21.15.27:0/1834963424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fb4102790 0x7f1fb41067e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8009900 tx=0x7f1fa802a410 comp rx=0 tx=0).stop 2024-09-19T08:17:42.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.448+0000 7f1fbc5a3640 1 -- 172.21.15.27:0/1834963424 shutdown_connections 2024-09-19T08:17:42.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.448+0000 7f1fbc5a3640 1 --2- 172.21.15.27:0/1834963424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fb4106f10 0x7f1fb410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.448+0000 7f1fbc5a3640 1 --2- 172.21.15.27:0/1834963424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fb4102790 0x7f1fb41067e0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.448+0000 7f1fbc5a3640 1 --2- 172.21.15.27:0/1834963424 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1fb4101de0 0x7f1fb41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.448+0000 7f1fbc5a3640 1 -- 172.21.15.27:0/1834963424 >> 172.21.15.27:0/1834963424 conn(0x7f1fb40fd8c0 msgr2=0x7f1fb40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:42.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.448+0000 7f1fbc5a3640 1 -- 172.21.15.27:0/1834963424 shutdown_connections 2024-09-19T08:17:42.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.448+0000 7f1fbc5a3640 1 -- 172.21.15.27:0/1834963424 wait complete. 2024-09-19T08:17:42.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.448+0000 7f1fbc5a3640 1 Processor -- start 2024-09-19T08:17:42.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.448+0000 7f1fbc5a3640 1 -- start start 2024-09-19T08:17:42.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.449+0000 7f1fbc5a3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fb4101de0 0x7f1fb41984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:42.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.449+0000 7f1fbc5a3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fb4102790 0x7f1fb41989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:42.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.449+0000 7f1fbc5a3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1fb4106f10 0x7f1fb419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:42.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.449+0000 7f1fbc5a3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb4111f70 con 0x7f1fb4101de0 2024-09-19T08:17:42.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.449+0000 7f1fbc5a3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb4111df0 con 0x7f1fb4102790 2024-09-19T08:17:42.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.449+0000 7f1fbc5a3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb41120f0 con 0x7f1fb4106f10 2024-09-19T08:17:42.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.449+0000 7f1fba33f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fb4101de0 0x7f1fb41984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:42.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.449+0000 7f1fba33f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fb4101de0 0x7f1fb41984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37654/0 (socket says 172.21.15.27:37654) 2024-09-19T08:17:42.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.449+0000 7f1fba33f640 1 -- 172.21.15.27:0/4023399808 learned_addr learned my addr 172.21.15.27:0/4023399808 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:42.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.449+0000 7f1fbab40640 1 --2- 172.21.15.27:0/4023399808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1fb4106f10 0x7f1fb419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:42.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.449+0000 7f1fb9b3e640 1 --2- 172.21.15.27:0/4023399808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fb4102790 0x7f1fb41989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:42.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.449+0000 7f1fba33f640 1 -- 172.21.15.27:0/4023399808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1fb4106f10 msgr2=0x7f1fb419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:42.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.449+0000 7f1fba33f640 1 --2- 172.21.15.27:0/4023399808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1fb4106f10 0x7f1fb419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.449+0000 7f1fba33f640 1 -- 172.21.15.27:0/4023399808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fb4102790 msgr2=0x7f1fb41989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:42.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.449+0000 7f1fba33f640 1 --2- 172.21.15.27:0/4023399808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fb4102790 0x7f1fb41989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.449+0000 7f1fba33f640 1 -- 172.21.15.27:0/4023399808 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb419d460 con 0x7f1fb4101de0 2024-09-19T08:17:42.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.449+0000 7f1fb9b3e640 1 --2- 172.21.15.27:0/4023399808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fb4102790 0x7f1fb41989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:17:42.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.449+0000 7f1fba33f640 1 --2- 172.21.15.27:0/4023399808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fb4101de0 0x7f1fb41984b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000e9f0 tx=0x7f1fb000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:42.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.449+0000 7f1fa77fe640 1 -- 172.21.15.27:0/4023399808 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb000cd80 con 0x7f1fb4101de0 2024-09-19T08:17:42.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.450+0000 7f1fa77fe640 1 -- 172.21.15.27:0/4023399808 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fb0005500 con 0x7f1fb4101de0 2024-09-19T08:17:42.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.450+0000 7f1fbc5a3640 1 -- 172.21.15.27:0/4023399808 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb419d750 con 0x7f1fb4101de0 2024-09-19T08:17:42.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.450+0000 7f1fa77fe640 1 -- 172.21.15.27:0/4023399808 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0010690 con 0x7f1fb4101de0 2024-09-19T08:17:42.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.450+0000 7f1fbc5a3640 1 -- 172.21.15.27:0/4023399808 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb41a5030 con 0x7f1fb4101de0 2024-09-19T08:17:42.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.452+0000 7f1fa77fe640 1 -- 172.21.15.27:0/4023399808 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f1fb00046c0 con 0x7f1fb4101de0 2024-09-19T08:17:42.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.452+0000 7f1fbe97c740 1 Processor -- start 2024-09-19T08:17:42.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.453+0000 7f1fbe97c740 1 -- start start 2024-09-19T08:17:42.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.453+0000 7f1fbe97c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6cb40 0x555944e6b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:42.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.453+0000 7f1fbe97c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e6b5d0 0x555944e6ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:42.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.453+0000 7f1fbe97c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555944e76370 0x555944e78760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:42.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.453+0000 7f1fbe97c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x555944dd12f0 con 0x555944e6cb40 2024-09-19T08:17:42.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.453+0000 7f1fbe97c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x555944d78cf0 con 0x555944e6b5d0 2024-09-19T08:17:42.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.453+0000 7f1fbe97c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555944dcd2b0 con 0x555944e76370 2024-09-19T08:17:42.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.453+0000 7f1fa77fe640 1 --2- 172.21.15.27:0/4023399808 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1fa00a3430 0x7f1fa00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:42.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.453+0000 7f1fbab40640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6cb40 0x555944e6b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:42.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.453+0000 7f1fbab40640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6cb40 0x555944e6b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37662/0 (socket says 172.21.15.27:37662) 2024-09-19T08:17:42.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.453+0000 7f1fbab40640 1 -- 172.21.15.27:0/3950922084 learned_addr learned my addr 172.21.15.27:0/3950922084 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:42.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.453+0000 7f1fba33f640 1 --2- 172.21.15.27:0/3950922084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e6b5d0 0x555944e6ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:42.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.453+0000 7f1fb9b3e640 1 --2- 172.21.15.27:0/3950922084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555944e76370 0x555944e78760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:42.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.453+0000 7f1fbab40640 1 --2- 172.21.15.27:0/4023399808 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1fa00a3430 0x7f1fa00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:42.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.453+0000 7f1fa77fe640 1 -- 172.21.15.27:0/4023399808 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f1fb00d0200 con 0x7f1fb4101de0 2024-09-19T08:17:42.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.454+0000 7f1fbab40640 1 -- 172.21.15.27:0/3950922084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555944e76370 msgr2=0x555944e78760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:42.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.454+0000 7f1fbab40640 1 --2- 172.21.15.27:0/3950922084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555944e76370 0x555944e78760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.454+0000 7f1fbab40640 1 -- 172.21.15.27:0/3950922084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e6b5d0 msgr2=0x555944e6ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:42.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.454+0000 7f1fbab40640 1 --2- 172.21.15.27:0/3950922084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e6b5d0 0x555944e6ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.454+0000 7f1fbab40640 1 -- 172.21.15.27:0/3950922084 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555944d5d3a0 con 0x555944e6cb40 2024-09-19T08:17:42.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.454+0000 7f1fba33f640 1 --2- 172.21.15.27:0/3950922084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e6b5d0 0x555944e6ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:17:42.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.454+0000 7f1fbab40640 1 --2- 172.21.15.27:0/3950922084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6cb40 0x555944e6b090 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0094d0 tx=0x7f1fac0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97da57e6a05641e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:42.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.454+0000 7f1fbab40640 1 --2- 172.21.15.27:0/4023399808 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1fa00a3430 0x7f1fa00a58f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1fac005c40 tx=0x7f1fac01d000 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:42.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.454+0000 7f1fa4ff9640 1 -- 172.21.15.27:0/3950922084 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac012840 con 0x555944e6cb40 2024-09-19T08:17:42.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.454+0000 7f1fa4ff9640 1 -- 172.21.15.27:0/3950922084 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fac003e50 con 0x555944e6cb40 2024-09-19T08:17:42.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.454+0000 7f1fa4ff9640 1 -- 172.21.15.27:0/3950922084 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac00de00 con 0x555944e6cb40 2024-09-19T08:17:42.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.455+0000 7f1fbe97c740 1 -- 172.21.15.27:0/3950922084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6cb40 msgr2=0x555944e6b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:42.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.455+0000 7f1fbe97c740 1 --2- 172.21.15.27:0/3950922084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6cb40 0x555944e6b090 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0094d0 tx=0x7f1fac0107a0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.455+0000 7f1fbe97c740 1 -- 172.21.15.27:0/3950922084 shutdown_connections 2024-09-19T08:17:42.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.455+0000 7f1fbe97c740 1 --2- 172.21.15.27:0/3950922084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555944e76370 0x555944e78760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.455+0000 7f1fbe97c740 1 --2- 172.21.15.27:0/3950922084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e6b5d0 0x555944e6ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.455+0000 7f1fbe97c740 1 --2- 172.21.15.27:0/3950922084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6cb40 0x555944e6b090 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.455+0000 7f1fbe97c740 1 -- 172.21.15.27:0/3950922084 >> 172.21.15.27:0/3950922084 conn(0x555944e34310 msgr2=0x555944e67c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.455+0000 7f1fbe97c740 1 -- 172.21.15.27:0/3950922084 shutdown_connections 2024-09-19T08:17:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.455+0000 7f1fbe97c740 1 -- 172.21.15.27:0/3950922084 wait complete. 2024-09-19T08:17:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.455+0000 7f1fbe97c740 1 -- start start 2024-09-19T08:17:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.455+0000 7f1fbe97c740 1 Processor -- start 2024-09-19T08:17:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1fbe97c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6b5d0 0x555944e75de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1fbe97c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555944e6cb40 0x555944e73090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1fbe97c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e76370 0x555944e737d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1fbe97c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x555944e79010 con 0x555944e6b5d0 2024-09-19T08:17:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1fbe97c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x555944d8c060 con 0x555944e76370 2024-09-19T08:17:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1fbe97c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555944e79190 con 0x555944e6cb40 2024-09-19T08:17:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1fbe97c740 10 client.0 _ll_register_callbacks cb 0x555944adf8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1fba33f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6b5d0 0x555944e75de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1fba33f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6b5d0 0x555944e75de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37676/0 (socket says 172.21.15.27:37676) 2024-09-19T08:17:42.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1fba33f640 1 -- 172.21.15.27:0/4255187670 learned_addr learned my addr 172.21.15.27:0/4255187670 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:42.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1fba33f640 1 -- 172.21.15.27:0/4255187670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555944e6cb40 msgr2=0x555944e73090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:42.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1fbab40640 1 --2- 172.21.15.27:0/4255187670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e76370 0x555944e737d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:42.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1fba33f640 1 --2- 172.21.15.27:0/4255187670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555944e6cb40 0x555944e73090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1fba33f640 1 -- 172.21.15.27:0/4255187670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e76370 msgr2=0x555944e737d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:42.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1fba33f640 1 --2- 172.21.15.27:0/4255187670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e76370 0x555944e737d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1fba33f640 1 -- 172.21.15.27:0/4255187670 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555944b423c0 con 0x555944e6b5d0 2024-09-19T08:17:42.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1fbab40640 1 --2- 172.21.15.27:0/4255187670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e76370 0x555944e737d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:17:42.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1fba33f640 1 --2- 172.21.15.27:0/4255187670 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6b5d0 0x555944e75de0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0098ea0 tx=0x7f1fb0007820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a994f5d64208a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:42.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1f9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:42.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1f9dffb640 1 -- 172.21.15.27:0/4255187670 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb006b020 con 0x555944e6b5d0 2024-09-19T08:17:42.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1f9dffb640 1 -- 172.21.15.27:0/4255187670 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f1fb009c730 con 0x555944e6b5d0 2024-09-19T08:17:42.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.456+0000 7f1fbe97c740 1 -- 172.21.15.27:0/4255187670 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fac003e50 con 0x555944e6b5d0 2024-09-19T08:17:42.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.457+0000 7f1f9dffb640 1 -- 172.21.15.27:0/4255187670 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1fb00cddc0 con 0x555944e6b5d0 2024-09-19T08:17:42.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.457+0000 7f1fbe97c740 10 client.16398 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:42.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.457+0000 7f1fbe97c740 1 -- 172.21.15.27:0/4255187670 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555944e84ba0 con 0x555944e6b5d0 2024-09-19T08:17:42.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.457+0000 7f1f9dffb640 1 -- 172.21.15.27:0/4255187670 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fac003e50 con 0x555944e6b5d0 2024-09-19T08:17:42.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.457+0000 7f1f9dffb640 1 -- 172.21.15.27:0/4255187670 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1fb0066f40 con 0x555944e6b5d0 2024-09-19T08:17:42.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.457+0000 7f1fbe97c740 10 client.16398 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:42.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.457+0000 7f1fbe97c740 10 client.16398 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:42.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.457+0000 7f1fbe97c740 20 client.16398 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:42.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.457+0000 7f1fbe97c740 1 --2- 172.21.15.27:0/4255187670 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555944e860b0 0x555944e88500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:42.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.457+0000 7f1fbe97c740 4 client.16398 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:17:42.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.457+0000 7f1fbe97c740 1 -- 172.21.15.27:0/4255187670 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555944dde860 con 0x555944e860b0 2024-09-19T08:17:42.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.457+0000 7f1fb9b3e640 1 --2- 172.21.15.27:0/4255187670 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555944e860b0 0x555944e88500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:42.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.458+0000 7f1fb9b3e640 1 --2- 172.21.15.27:0/4255187670 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555944e860b0 0x555944e88500 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c22dcfe592c785b server_cookie=1e42e1147882ee1e in_seq=0 out_seq=0 2024-09-19T08:17:42.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.458+0000 7f1f9dffb640 10 client.16398 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:42.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.459+0000 7f1f9dffb640 1 -- 172.21.15.27:0/4255187670 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555944dde860 con 0x555944e860b0 2024-09-19T08:17:42.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.459+0000 7f1f9dffb640 10 client.16398 handle_command_reply: tid=0 2024-09-19T08:17:42.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.459+0000 7f1fbe97c740 1 client.16398 shutdown 2024-09-19T08:17:42.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.459+0000 7f1fbe97c740 1 -- 172.21.15.27:0/4255187670 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6b5d0 msgr2=0x555944e75de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:42.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.459+0000 7f1fbe97c740 1 --2- 172.21.15.27:0/4255187670 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6b5d0 0x555944e75de0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0098ea0 tx=0x7f1fb0007820 comp rx=0 tx=0).stop 2024-09-19T08:17:42.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.459+0000 7f1fbe97c740 1 -- 172.21.15.27:0/4255187670 shutdown_connections 2024-09-19T08:17:42.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.459+0000 7f1fbe97c740 1 --2- 172.21.15.27:0/4255187670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e76370 0x555944e737d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.459+0000 7f1fbe97c740 1 --2- 172.21.15.27:0/4255187670 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555944e860b0 0x555944e88500 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.459+0000 7f1fbe97c740 1 --2- 172.21.15.27:0/4255187670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555944e6cb40 0x555944e73090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.459+0000 7f1fbe97c740 1 --2- 172.21.15.27:0/4255187670 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6b5d0 0x555944e75de0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.459+0000 7f1fbe97c740 1 -- 172.21.15.27:0/4255187670 >> 172.21.15.27:0/4255187670 conn(0x555944e34310 msgr2=0x555944e6d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:42.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.459+0000 7f1f9dffb640 0 client.16398 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:42.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.459+0000 7f1fbe97c740 1 -- 172.21.15.27:0/4255187670 shutdown_connections 2024-09-19T08:17:42.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.459+0000 7f1fbe97c740 1 -- 172.21.15.27:0/4255187670 wait complete. 2024-09-19T08:17:42.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.459+0000 7f1fbe97c740 20 client.16398 trim_cache size 0 max 16384 2024-09-19T08:17:42.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.472+0000 7f1fbe97c740 1 Processor -- start 2024-09-19T08:17:42.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.472+0000 7f1fbe97c740 1 -- start start 2024-09-19T08:17:42.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.472+0000 7f1fbe97c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e6b5d0 0x555944e822b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:42.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.472+0000 7f1fbe97c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555944e6cb40 0x555944e6e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:42.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.472+0000 7f1fbe97c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e76370 0x555944e6e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:42.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.472+0000 7f1fbe97c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb41a9570 con 0x555944e76370 2024-09-19T08:17:42.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.472+0000 7f1fbe97c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb41abdf0 con 0x555944e6b5d0 2024-09-19T08:17:42.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.472+0000 7f1fbe97c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb41a9be0 con 0x555944e6cb40 2024-09-19T08:17:42.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.473+0000 7f1fbab40640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e76370 0x555944e6e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:42.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.473+0000 7f1fbab40640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e76370 0x555944e6e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37678/0 (socket says 172.21.15.27:37678) 2024-09-19T08:17:42.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.473+0000 7f1fbab40640 1 -- 172.21.15.27:0/217852486 learned_addr learned my addr 172.21.15.27:0/217852486 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:42.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.473+0000 7f1fba33f640 1 --2- 172.21.15.27:0/217852486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e6b5d0 0x555944e822b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:42.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.473+0000 7f1fb9b3e640 1 --2- 172.21.15.27:0/217852486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555944e6cb40 0x555944e6e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:42.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.473+0000 7f1fbab40640 1 -- 172.21.15.27:0/217852486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555944e6cb40 msgr2=0x555944e6e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:42.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.473+0000 7f1fbab40640 1 --2- 172.21.15.27:0/217852486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555944e6cb40 0x555944e6e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.473+0000 7f1fbab40640 1 -- 172.21.15.27:0/217852486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e6b5d0 msgr2=0x555944e822b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:42.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.473+0000 7f1fbab40640 1 --2- 172.21.15.27:0/217852486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e6b5d0 0x555944e822b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.473+0000 7f1fbab40640 1 -- 172.21.15.27:0/217852486 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555944e78ad0 con 0x555944e76370 2024-09-19T08:17:42.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.473+0000 7f1fbab40640 1 --2- 172.21.15.27:0/217852486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e76370 0x555944e6e660 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009fa0 tx=0x7f1fac0099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d48fa762f4f24e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:42.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.473+0000 7f1f9ffff640 1 -- 172.21.15.27:0/217852486 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac012550 con 0x555944e76370 2024-09-19T08:17:42.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.473+0000 7f1f9ffff640 1 -- 172.21.15.27:0/217852486 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fac003e50 con 0x555944e76370 2024-09-19T08:17:42.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.473+0000 7f1f9ffff640 1 -- 172.21.15.27:0/217852486 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac00de90 con 0x555944e76370 2024-09-19T08:17:42.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.474+0000 7f1fbe97c740 1 -- 172.21.15.27:0/217852486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e76370 msgr2=0x555944e6e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:42.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.474+0000 7f1fbe97c740 1 --2- 172.21.15.27:0/217852486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e76370 0x555944e6e660 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009fa0 tx=0x7f1fac0099c0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.474+0000 7f1fbe97c740 1 -- 172.21.15.27:0/217852486 shutdown_connections 2024-09-19T08:17:42.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.474+0000 7f1fbe97c740 1 --2- 172.21.15.27:0/217852486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e76370 0x555944e6e660 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.474+0000 7f1fbe97c740 1 --2- 172.21.15.27:0/217852486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555944e6cb40 0x555944e6e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.474+0000 7f1fbe97c740 1 --2- 172.21.15.27:0/217852486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e6b5d0 0x555944e822b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.474+0000 7f1fbe97c740 1 -- 172.21.15.27:0/217852486 >> 172.21.15.27:0/217852486 conn(0x555944e34310 msgr2=0x555944e72180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:42.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.474+0000 7f1fbe97c740 1 -- 172.21.15.27:0/217852486 shutdown_connections 2024-09-19T08:17:42.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.474+0000 7f1fbe97c740 1 -- 172.21.15.27:0/217852486 wait complete. 2024-09-19T08:17:42.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.474+0000 7f1fbe97c740 1 -- start start 2024-09-19T08:17:42.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.474+0000 7f1fbe97c740 1 Processor -- start 2024-09-19T08:17:42.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.475+0000 7f1fbe97c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e6b5d0 0x555944e79980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:42.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.475+0000 7f1fbe97c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6cb40 0x555944e79ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:42.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.475+0000 7f1fbe97c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555944e76370 0x555944eeed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:42.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.475+0000 7f1fbe97c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb41aa2b0 con 0x555944e6cb40 2024-09-19T08:17:42.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.475+0000 7f1fbe97c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb41ab720 con 0x555944e6b5d0 2024-09-19T08:17:42.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.475+0000 7f1fbe97c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb41aa980 con 0x555944e76370 2024-09-19T08:17:42.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.475+0000 7f1fbe97c740 10 client.0 _ll_register_callbacks cb 0x7f1fb0009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:42.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.475+0000 7f1fb9b3e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6cb40 0x555944e79ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:42.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.475+0000 7f1fb9b3e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6cb40 0x555944e79ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37694/0 (socket says 172.21.15.27:37694) 2024-09-19T08:17:42.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.475+0000 7f1fb9b3e640 1 -- 172.21.15.27:0/2928756079 learned_addr learned my addr 172.21.15.27:0/2928756079 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:42.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.475+0000 7f1fba33f640 1 --2- 172.21.15.27:0/2928756079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e6b5d0 0x555944e79980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:42.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.475+0000 7f1fbab40640 1 --2- 172.21.15.27:0/2928756079 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555944e76370 0x555944eeed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:42.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.475+0000 7f1fb9b3e640 1 -- 172.21.15.27:0/2928756079 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555944e76370 msgr2=0x555944eeed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:42.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.475+0000 7f1fb9b3e640 1 --2- 172.21.15.27:0/2928756079 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555944e76370 0x555944eeed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.475+0000 7f1fb9b3e640 1 -- 172.21.15.27:0/2928756079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e6b5d0 msgr2=0x555944e79980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:42.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.475+0000 7f1fb9b3e640 1 --2- 172.21.15.27:0/2928756079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e6b5d0 0x555944e79980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.475+0000 7f1fb9b3e640 1 -- 172.21.15.27:0/2928756079 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555944eef350 con 0x555944e6cb40 2024-09-19T08:17:42.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.475+0000 7f1fba33f640 1 --2- 172.21.15.27:0/2928756079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e6b5d0 0x555944e79980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:17:42.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.476+0000 7f1fb9b3e640 1 --2- 172.21.15.27:0/2928756079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6cb40 0x555944e79ec0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1fa802a450 tx=0x7f1fa8032d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8347c6c1adb0bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:42.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.476+0000 7f1f9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:42.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.476+0000 7f1f9dffb640 1 -- 172.21.15.27:0/2928756079 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8035040 con 0x555944e6cb40 2024-09-19T08:17:42.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.476+0000 7f1f9dffb640 1 -- 172.21.15.27:0/2928756079 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f1fa8004250 con 0x555944e6cb40 2024-09-19T08:17:42.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.476+0000 7f1fbe97c740 1 -- 172.21.15.27:0/2928756079 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fac003e50 con 0x555944e6cb40 2024-09-19T08:17:42.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.476+0000 7f1f9dffb640 1 -- 172.21.15.27:0/2928756079 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1fa8052050 con 0x555944e6cb40 2024-09-19T08:17:42.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.476+0000 7f1fbe97c740 10 client.16404 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:42.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.476+0000 7f1fbe97c740 1 -- 172.21.15.27:0/2928756079 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555944ef06c0 con 0x555944e6cb40 2024-09-19T08:17:42.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.476+0000 7f1f9dffb640 1 -- 172.21.15.27:0/2928756079 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fac003e50 con 0x555944e6cb40 2024-09-19T08:17:42.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.476+0000 7f1f9dffb640 1 -- 172.21.15.27:0/2928756079 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1fa8004a90 con 0x555944e6cb40 2024-09-19T08:17:42.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.476+0000 7f1fbe97c740 10 client.16404 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:42.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.476+0000 7f1fbe97c740 10 client.16404 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:42.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.476+0000 7f1fbe97c740 20 client.16404 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:42.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.476+0000 7f1fbe97c740 1 --2- 172.21.15.27:0/2928756079 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555944ef0e70 0x555944ef3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:42.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.476+0000 7f1fbe97c740 4 client.16404 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:17:42.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.476+0000 7f1fbe97c740 1 -- 172.21.15.27:0/2928756079 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555944dd8d70 con 0x555944ef0e70 2024-09-19T08:17:42.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.477+0000 7f1fba33f640 1 --2- 172.21.15.27:0/2928756079 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555944ef0e70 0x555944ef3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:42.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.477+0000 7f1fba33f640 1 --2- 172.21.15.27:0/2928756079 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555944ef0e70 0x555944ef3290 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=141047ac216211f3 server_cookie=b2cb7c124f521970 in_seq=0 out_seq=0 2024-09-19T08:17:42.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.477+0000 7f1f9dffb640 10 client.16404 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:42.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.477+0000 7f1f9dffb640 1 -- 172.21.15.27:0/2928756079 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555944dd8d70 con 0x555944ef0e70 2024-09-19T08:17:42.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.477+0000 7f1f9dffb640 10 client.16404 handle_command_reply: tid=0 2024-09-19T08:17:42.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.477+0000 7f1fbe97c740 1 client.16404 shutdown 2024-09-19T08:17:42.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.477+0000 7f1fbe97c740 1 -- 172.21.15.27:0/2928756079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6cb40 msgr2=0x555944e79ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:42.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.477+0000 7f1fbe97c740 1 --2- 172.21.15.27:0/2928756079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6cb40 0x555944e79ec0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1fa802a450 tx=0x7f1fa8032d70 comp rx=0 tx=0).stop 2024-09-19T08:17:42.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.478+0000 7f1fbe97c740 1 -- 172.21.15.27:0/2928756079 shutdown_connections 2024-09-19T08:17:42.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.478+0000 7f1fbe97c740 1 --2- 172.21.15.27:0/2928756079 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555944ef0e70 0x555944ef3290 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.478+0000 7f1fbe97c740 1 --2- 172.21.15.27:0/2928756079 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555944e76370 0x555944eeed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.478+0000 7f1fbe97c740 1 --2- 172.21.15.27:0/2928756079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555944e6cb40 0x555944e79ec0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.478+0000 7f1fbe97c740 1 --2- 172.21.15.27:0/2928756079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555944e6b5d0 0x555944e79980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.478+0000 7f1fbe97c740 1 -- 172.21.15.27:0/2928756079 >> 172.21.15.27:0/2928756079 conn(0x555944e34310 msgr2=0x555944e748f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:42.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.478+0000 7f1f9dffb640 0 client.16404 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:42.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.478+0000 7f1fbe97c740 1 -- 172.21.15.27:0/2928756079 shutdown_connections 2024-09-19T08:17:42.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.478+0000 7f1fbe97c740 1 -- 172.21.15.27:0/2928756079 wait complete. 2024-09-19T08:17:42.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.478+0000 7f1fbe97c740 20 client.16404 trim_cache size 0 max 16384 2024-09-19T08:17:42.492 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:17:42.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.478+0000 7f1fbc5a3640 1 -- 172.21.15.27:0/4023399808 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1fa00a3430 msgr2=0x7f1fa00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:42.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.478+0000 7f1fbc5a3640 1 --2- 172.21.15.27:0/4023399808 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1fa00a3430 0x7f1fa00a58f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1fac005c40 tx=0x7f1fac01d000 comp rx=0 tx=0).stop 2024-09-19T08:17:42.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.478+0000 7f1fbc5a3640 1 -- 172.21.15.27:0/4023399808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fb4101de0 msgr2=0x7f1fb41984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:42.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.478+0000 7f1fbc5a3640 1 --2- 172.21.15.27:0/4023399808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fb4101de0 0x7f1fb41984b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000e9f0 tx=0x7f1fb000edf0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.479+0000 7f1fbc5a3640 1 -- 172.21.15.27:0/4023399808 shutdown_connections 2024-09-19T08:17:42.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.479+0000 7f1fbc5a3640 1 --2- 172.21.15.27:0/4023399808 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1fa00a3430 0x7f1fa00a58f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.479+0000 7f1fbc5a3640 1 --2- 172.21.15.27:0/4023399808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1fb4106f10 0x7f1fb419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.479+0000 7f1fbc5a3640 1 --2- 172.21.15.27:0/4023399808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fb4102790 0x7f1fb41989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.479+0000 7f1fbc5a3640 1 --2- 172.21.15.27:0/4023399808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fb4101de0 0x7f1fb41984b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:42.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.479+0000 7f1fbc5a3640 1 -- 172.21.15.27:0/4023399808 >> 172.21.15.27:0/4023399808 conn(0x7f1fb40fd8c0 msgr2=0x7f1fb40fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:42.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.479+0000 7f1fbc5a3640 1 -- 172.21.15.27:0/4023399808 shutdown_connections 2024-09-19T08:17:42.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:42.479+0000 7f1fbc5a3640 1 -- 172.21.15.27:0/4023399808 wait complete. 2024-09-19T08:17:43.168 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:42 smithi027 ceph-mon[31209]: pgmap v203: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:43.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:42 smithi155 ceph-mon[35362]: pgmap v203: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:43.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:42 smithi203 ceph-mon[35198]: pgmap v203: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:44.198 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:17:44.199 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:17:44.470 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:17:44.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.932+0000 7f3eb9095640 1 -- 172.21.15.27:0/589832040 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb4106a60 msgr2=0x7f3eb4106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:44.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.932+0000 7f3eb9095640 1 --2- 172.21.15.27:0/589832040 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb4106a60 0x7f3eb4106e40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009930 tx=0x7f3ea402a420 comp rx=0 tx=0).stop 2024-09-19T08:17:44.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.933+0000 7f3eb9095640 1 -- 172.21.15.27:0/589832040 shutdown_connections 2024-09-19T08:17:44.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.933+0000 7f3eb9095640 1 --2- 172.21.15.27:0/589832040 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3eb4101400 0x7f3eb410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.933+0000 7f3eb9095640 1 --2- 172.21.15.27:0/589832040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3eb4100a60 0x7f3eb4100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.933+0000 7f3eb9095640 1 --2- 172.21.15.27:0/589832040 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb4106a60 0x7f3eb4106e40 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.933+0000 7f3eb9095640 1 -- 172.21.15.27:0/589832040 >> 172.21.15.27:0/589832040 conn(0x7f3eb40fc780 msgr2=0x7f3eb40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:44.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.933+0000 7f3eb9095640 1 -- 172.21.15.27:0/589832040 shutdown_connections 2024-09-19T08:17:44.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.933+0000 7f3eb9095640 1 -- 172.21.15.27:0/589832040 wait complete. 2024-09-19T08:17:44.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.933+0000 7f3eb9095640 1 Processor -- start 2024-09-19T08:17:44.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.934+0000 7f3eb9095640 1 -- start start 2024-09-19T08:17:44.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.934+0000 7f3eb9095640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3eb4100a60 0x7f3eb4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:44.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.934+0000 7f3eb9095640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3eb4101400 0x7f3eb4199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:44.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.934+0000 7f3eb9095640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb4106a60 0x7f3eb41a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:44.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.934+0000 7f3eb9095640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb4110e70 con 0x7f3eb4106a60 2024-09-19T08:17:44.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.934+0000 7f3eb9095640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb4110cf0 con 0x7f3eb4100a60 2024-09-19T08:17:44.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.934+0000 7f3eb9095640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb4110ff0 con 0x7f3eb4101400 2024-09-19T08:17:44.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.934+0000 7f3eb359e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb4106a60 0x7f3eb41a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:44.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.934+0000 7f3eb359e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb4106a60 0x7f3eb41a4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37706/0 (socket says 172.21.15.27:37706) 2024-09-19T08:17:44.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.934+0000 7f3eb359e640 1 -- 172.21.15.27:0/2344025211 learned_addr learned my addr 172.21.15.27:0/2344025211 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:44.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.934+0000 7f3eb2d9d640 1 --2- 172.21.15.27:0/2344025211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3eb4100a60 0x7f3eb4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:44.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.934+0000 7f3eb259c640 1 --2- 172.21.15.27:0/2344025211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3eb4101400 0x7f3eb4199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:44.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.934+0000 7f3eb359e640 1 -- 172.21.15.27:0/2344025211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3eb4101400 msgr2=0x7f3eb4199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:44.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.934+0000 7f3eb359e640 1 --2- 172.21.15.27:0/2344025211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3eb4101400 0x7f3eb4199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.934+0000 7f3eb359e640 1 -- 172.21.15.27:0/2344025211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3eb4100a60 msgr2=0x7f3eb4199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:44.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.934+0000 7f3eb359e640 1 --2- 172.21.15.27:0/2344025211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3eb4100a60 0x7f3eb4199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.934+0000 7f3eb359e640 1 -- 172.21.15.27:0/2344025211 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb41a48c0 con 0x7f3eb4106a60 2024-09-19T08:17:44.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.934+0000 7f3eb259c640 1 --2- 172.21.15.27:0/2344025211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3eb4101400 0x7f3eb4199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:17:44.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.934+0000 7f3eb359e640 1 --2- 172.21.15.27:0/2344025211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb4106a60 0x7f3eb41a4380 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00eaa0 tx=0x7f3eac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:44.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.935+0000 7f3e9bfff640 1 -- 172.21.15.27:0/2344025211 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac00cdb0 con 0x7f3eb4106a60 2024-09-19T08:17:44.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.935+0000 7f3e9bfff640 1 -- 172.21.15.27:0/2344025211 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3eac005020 con 0x7f3eb4106a60 2024-09-19T08:17:44.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.935+0000 7f3eb9095640 1 -- 172.21.15.27:0/2344025211 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eb41a4a90 con 0x7f3eb4106a60 2024-09-19T08:17:44.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.935+0000 7f3e9bfff640 1 -- 172.21.15.27:0/2344025211 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0116b0 con 0x7f3eb4106a60 2024-09-19T08:17:44.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.935+0000 7f3eb9095640 1 -- 172.21.15.27:0/2344025211 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eb41a4f50 con 0x7f3eb4106a60 2024-09-19T08:17:44.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.937+0000 7f3e9bfff640 1 -- 172.21.15.27:0/2344025211 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3eac005560 con 0x7f3eb4106a60 2024-09-19T08:17:44.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.937+0000 7f3ebb46e740 1 Processor -- start 2024-09-19T08:17:44.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.937+0000 7f3ebb46e740 1 -- start start 2024-09-19T08:17:44.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.938+0000 7f3ebb46e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841eb60 0x55731841ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:44.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.938+0000 7f3e9bfff640 1 --2- 172.21.15.27:0/2344025211 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3e9c0a33b0 0x7f3e9c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:44.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.938+0000 7f3ebb46e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55731841f480 0x557318429800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:44.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.938+0000 7f3ebb46e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 0x55731842c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:44.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.938+0000 7f3ebb46e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x557318384280 con 0x557318429d40 2024-09-19T08:17:44.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.938+0000 7f3ebb46e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55731832bb10 con 0x55731841eb60 2024-09-19T08:17:44.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.938+0000 7f3ebb46e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557318380240 con 0x55731841f480 2024-09-19T08:17:44.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.938+0000 7f3eb2d9d640 1 --2- 172.21.15.27:0/2344025211 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3e9c0a33b0 0x7f3e9c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:44.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.938+0000 7f3eb359e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 0x55731842c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:44.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.938+0000 7f3eb359e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 0x55731842c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37718/0 (socket says 172.21.15.27:37718) 2024-09-19T08:17:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.938+0000 7f3eb359e640 1 -- 172.21.15.27:0/875162205 learned_addr learned my addr 172.21.15.27:0/875162205 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.938+0000 7f3e9bfff640 1 -- 172.21.15.27:0/2344025211 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f3eac0cfec0 con 0x7f3eb4106a60 2024-09-19T08:17:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.938+0000 7f3eb259c640 1 --2- 172.21.15.27:0/875162205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841eb60 0x55731841ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.938+0000 7f3eb259c640 1 --2- 172.21.15.27:0/875162205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55731841f480 0x557318429800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.938+0000 7f3eb359e640 1 -- 172.21.15.27:0/875162205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55731841f480 msgr2=0x557318429800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.938+0000 7f3eb359e640 1 --2- 172.21.15.27:0/875162205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55731841f480 0x557318429800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.938+0000 7f3eb359e640 1 -- 172.21.15.27:0/875162205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841eb60 msgr2=0x55731841ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.938+0000 7f3eb359e640 1 --2- 172.21.15.27:0/875162205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841eb60 0x55731841ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.938+0000 7f3eb359e640 1 -- 172.21.15.27:0/875162205 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573183381f0 con 0x557318429d40 2024-09-19T08:17:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.938+0000 7f3eb2d9d640 1 --2- 172.21.15.27:0/2344025211 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3e9c0a33b0 0x7f3e9c0a5870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4006010 tx=0x7f3ea4000bc0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.939+0000 7f3eb359e640 1 --2- 172.21.15.27:0/875162205 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 0x55731842c130 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f3eac098650 tx=0x7f3eac007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a03511077719f13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.939+0000 7f3e997fa640 1 -- 172.21.15.27:0/875162205 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac09c1f0 con 0x557318429d40 2024-09-19T08:17:44.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.939+0000 7f3e997fa640 1 -- 172.21.15.27:0/875162205 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3eac0a05a0 con 0x557318429d40 2024-09-19T08:17:44.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.939+0000 7f3e997fa640 1 -- 172.21.15.27:0/875162205 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0cd8e0 con 0x557318429d40 2024-09-19T08:17:44.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.939+0000 7f3ebb46e740 1 -- 172.21.15.27:0/875162205 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 msgr2=0x55731842c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:44.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.939+0000 7f3ebb46e740 1 --2- 172.21.15.27:0/875162205 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 0x55731842c130 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f3eac098650 tx=0x7f3eac007590 comp rx=0 tx=0).stop 2024-09-19T08:17:44.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.940+0000 7f3ebb46e740 1 -- 172.21.15.27:0/875162205 shutdown_connections 2024-09-19T08:17:44.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.940+0000 7f3ebb46e740 1 --2- 172.21.15.27:0/875162205 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 0x55731842c130 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.940+0000 7f3ebb46e740 1 --2- 172.21.15.27:0/875162205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55731841f480 0x557318429800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.940+0000 7f3ebb46e740 1 --2- 172.21.15.27:0/875162205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841eb60 0x55731841ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.940+0000 7f3ebb46e740 1 -- 172.21.15.27:0/875162205 >> 172.21.15.27:0/875162205 conn(0x55731841b0f0 msgr2=0x55731841b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:44.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.940+0000 7f3ebb46e740 1 -- 172.21.15.27:0/875162205 shutdown_connections 2024-09-19T08:17:44.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.940+0000 7f3ebb46e740 1 -- 172.21.15.27:0/875162205 wait complete. 2024-09-19T08:17:44.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.940+0000 7f3ebb46e740 1 -- start start 2024-09-19T08:17:44.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.940+0000 7f3ebb46e740 1 Processor -- start 2024-09-19T08:17:44.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.940+0000 7f3ebb46e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841eb60 0x557318426c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:44.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.940+0000 7f3ebb46e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55731841f480 0x557318427160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:44.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.940+0000 7f3ebb46e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 0x5573184276a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:44.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.940+0000 7f3ebb46e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55731842c910 con 0x557318429d40 2024-09-19T08:17:44.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.940+0000 7f3ebb46e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55731833ef10 con 0x55731841eb60 2024-09-19T08:17:44.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.940+0000 7f3ebb46e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55731842ca90 con 0x55731841f480 2024-09-19T08:17:44.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.940+0000 7f3ebb46e740 10 client.0 _ll_register_callbacks cb 0x557318307a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:44.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.940+0000 7f3eb359e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 0x5573184276a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:44.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.940+0000 7f3eb359e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 0x5573184276a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37732/0 (socket says 172.21.15.27:37732) 2024-09-19T08:17:44.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.940+0000 7f3eb359e640 1 -- 172.21.15.27:0/699838077 learned_addr learned my addr 172.21.15.27:0/699838077 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:44.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.941+0000 7f3eb2d9d640 1 --2- 172.21.15.27:0/699838077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841eb60 0x557318426c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:44.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.941+0000 7f3eb259c640 1 --2- 172.21.15.27:0/699838077 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55731841f480 0x557318427160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:44.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.941+0000 7f3eb359e640 1 -- 172.21.15.27:0/699838077 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55731841f480 msgr2=0x557318427160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:44.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.941+0000 7f3eb359e640 1 --2- 172.21.15.27:0/699838077 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55731841f480 0x557318427160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.941+0000 7f3eb359e640 1 -- 172.21.15.27:0/699838077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841eb60 msgr2=0x557318426c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:44.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.941+0000 7f3eb359e640 1 --2- 172.21.15.27:0/699838077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841eb60 0x557318426c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.941+0000 7f3eb359e640 1 -- 172.21.15.27:0/699838077 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573180f56a0 con 0x557318429d40 2024-09-19T08:17:44.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.941+0000 7f3eb2d9d640 1 --2- 172.21.15.27:0/699838077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841eb60 0x557318426c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:17:44.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.941+0000 7f3eb259c640 1 --2- 172.21.15.27:0/699838077 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55731841f480 0x557318427160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:17:44.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.941+0000 7f3eb359e640 1 --2- 172.21.15.27:0/699838077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 0x5573184276a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f3eac097ed0 tx=0x7f3eac0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82bd11b38ab84a09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:44.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.941+0000 7f3e96ff5640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:44.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.941+0000 7f3e96ff5640 1 -- 172.21.15.27:0/699838077 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0b4020 con 0x557318429d40 2024-09-19T08:17:44.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.941+0000 7f3e96ff5640 1 -- 172.21.15.27:0/699838077 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f3eac098860 con 0x557318429d40 2024-09-19T08:17:44.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.941+0000 7f3ebb46e740 1 -- 172.21.15.27:0/699838077 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3eac0a05a0 con 0x557318429d40 2024-09-19T08:17:44.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.941+0000 7f3e96ff5640 1 -- 172.21.15.27:0/699838077 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3eac01f040 con 0x557318429d40 2024-09-19T08:17:44.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.941+0000 7f3ebb46e740 10 client.16416 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:44.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.941+0000 7f3ebb46e740 1 -- 172.21.15.27:0/699838077 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557318438510 con 0x557318429d40 2024-09-19T08:17:44.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.941+0000 7f3e96ff5640 1 -- 172.21.15.27:0/699838077 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3eac0a05a0 con 0x557318429d40 2024-09-19T08:17:44.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.942+0000 7f3e96ff5640 1 -- 172.21.15.27:0/699838077 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3eac00f040 con 0x557318429d40 2024-09-19T08:17:44.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.942+0000 7f3ebb46e740 10 client.16416 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:44.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.942+0000 7f3ebb46e740 10 client.16416 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:44.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.942+0000 7f3ebb46e740 20 client.16416 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:44.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.942+0000 7f3ebb46e740 1 --2- 172.21.15.27:0/699838077 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x557318439860 0x55731843bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:44.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.942+0000 7f3ebb46e740 4 client.16416 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:17:44.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.942+0000 7f3ebb46e740 1 -- 172.21.15.27:0/699838077 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573183917f0 con 0x557318439860 2024-09-19T08:17:44.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.942+0000 7f3eb2d9d640 1 --2- 172.21.15.27:0/699838077 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x557318439860 0x55731843bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:44.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.943+0000 7f3e96ff5640 10 client.16416 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:44.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.942+0000 7f3eb2d9d640 1 --2- 172.21.15.27:0/699838077 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x557318439860 0x55731843bc50 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffa8e505d4081e1d server_cookie=b109fa7ac8121b58 in_seq=0 out_seq=0 2024-09-19T08:17:44.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.943+0000 7f3e96ff5640 1 -- 172.21.15.27:0/699838077 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5573183917f0 con 0x557318439860 2024-09-19T08:17:44.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.943+0000 7f3e96ff5640 10 client.16416 handle_command_reply: tid=0 2024-09-19T08:17:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.943+0000 7f3ebb46e740 1 client.16416 shutdown 2024-09-19T08:17:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.943+0000 7f3ebb46e740 1 -- 172.21.15.27:0/699838077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 msgr2=0x5573184276a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.943+0000 7f3ebb46e740 1 --2- 172.21.15.27:0/699838077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 0x5573184276a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f3eac097ed0 tx=0x7f3eac0058d0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.943+0000 7f3ebb46e740 1 -- 172.21.15.27:0/699838077 shutdown_connections 2024-09-19T08:17:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.943+0000 7f3ebb46e740 1 --2- 172.21.15.27:0/699838077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 0x5573184276a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.943+0000 7f3ebb46e740 1 --2- 172.21.15.27:0/699838077 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x557318439860 0x55731843bc50 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.943+0000 7f3ebb46e740 1 --2- 172.21.15.27:0/699838077 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55731841f480 0x557318427160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.943+0000 7f3e96ff5640 0 client.16416 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.943+0000 7f3ebb46e740 1 --2- 172.21.15.27:0/699838077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841eb60 0x557318426c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.943+0000 7f3ebb46e740 1 -- 172.21.15.27:0/699838077 >> 172.21.15.27:0/699838077 conn(0x55731841b0f0 msgr2=0x557318420e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.944+0000 7f3ebb46e740 1 -- 172.21.15.27:0/699838077 shutdown_connections 2024-09-19T08:17:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.944+0000 7f3ebb46e740 1 -- 172.21.15.27:0/699838077 wait complete. 2024-09-19T08:17:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.944+0000 7f3ebb46e740 20 client.16416 trim_cache size 0 max 16384 2024-09-19T08:17:44.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.961+0000 7f3ebb46e740 1 Processor -- start 2024-09-19T08:17:44.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.961+0000 7f3ebb46e740 1 -- start start 2024-09-19T08:17:44.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.961+0000 7f3ebb46e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55731841eb60 0x5573184274f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:44.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.961+0000 7f3ebb46e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841f480 0x55731843ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:44.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.961+0000 7f3ebb46e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 0x55731843f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:44.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.961+0000 7f3ebb46e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb41ab830 con 0x557318429d40 2024-09-19T08:17:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.961+0000 7f3ebb46e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb41ae0b0 con 0x55731841f480 2024-09-19T08:17:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.961+0000 7f3ebb46e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb41abea0 con 0x55731841eb60 2024-09-19T08:17:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.962+0000 7f3eb359e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 0x55731843f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.962+0000 7f3eb359e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 0x55731843f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37744/0 (socket says 172.21.15.27:37744) 2024-09-19T08:17:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.962+0000 7f3eb359e640 1 -- 172.21.15.27:0/262649147 learned_addr learned my addr 172.21.15.27:0/262649147 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.962+0000 7f3eb259c640 1 --2- 172.21.15.27:0/262649147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841f480 0x55731843ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.962+0000 7f3eb2d9d640 1 --2- 172.21.15.27:0/262649147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55731841eb60 0x5573184274f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.962+0000 7f3eb359e640 1 -- 172.21.15.27:0/262649147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55731841eb60 msgr2=0x5573184274f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.962+0000 7f3eb359e640 1 --2- 172.21.15.27:0/262649147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55731841eb60 0x5573184274f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.962+0000 7f3eb359e640 1 -- 172.21.15.27:0/262649147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841f480 msgr2=0x55731843ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.962+0000 7f3eb359e640 1 --2- 172.21.15.27:0/262649147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841f480 0x55731843ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.962+0000 7f3eb359e640 1 -- 172.21.15.27:0/262649147 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557318425170 con 0x557318429d40 2024-09-19T08:17:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.962+0000 7f3eb359e640 1 --2- 172.21.15.27:0/262649147 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 0x55731843f1b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0c9040 tx=0x7f3eac09a700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48aafaed7fd5624a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.962+0000 7f3e98ff9640 1 -- 172.21.15.27:0/262649147 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0b4030 con 0x557318429d40 2024-09-19T08:17:44.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.962+0000 7f3e98ff9640 1 -- 172.21.15.27:0/262649147 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3eac0a0170 con 0x557318429d40 2024-09-19T08:17:44.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.962+0000 7f3e98ff9640 1 -- 172.21.15.27:0/262649147 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0cd2a0 con 0x557318429d40 2024-09-19T08:17:44.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.963+0000 7f3ebb46e740 1 -- 172.21.15.27:0/262649147 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 msgr2=0x55731843f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:44.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.963+0000 7f3ebb46e740 1 --2- 172.21.15.27:0/262649147 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 0x55731843f1b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0c9040 tx=0x7f3eac09a700 comp rx=0 tx=0).stop 2024-09-19T08:17:44.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.963+0000 7f3ebb46e740 1 -- 172.21.15.27:0/262649147 shutdown_connections 2024-09-19T08:17:44.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.963+0000 7f3ebb46e740 1 --2- 172.21.15.27:0/262649147 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557318429d40 0x55731843f1b0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.963+0000 7f3ebb46e740 1 --2- 172.21.15.27:0/262649147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841f480 0x55731843ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.963+0000 7f3ebb46e740 1 --2- 172.21.15.27:0/262649147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55731841eb60 0x5573184274f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.963+0000 7f3ebb46e740 1 -- 172.21.15.27:0/262649147 >> 172.21.15.27:0/262649147 conn(0x55731841b0f0 msgr2=0x557318428b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:44.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.963+0000 7f3ebb46e740 1 -- 172.21.15.27:0/262649147 shutdown_connections 2024-09-19T08:17:44.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.963+0000 7f3ebb46e740 1 -- 172.21.15.27:0/262649147 wait complete. 2024-09-19T08:17:44.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.964+0000 7f3ebb46e740 1 -- start start 2024-09-19T08:17:44.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.964+0000 7f3ebb46e740 1 Processor -- start 2024-09-19T08:17:44.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.964+0000 7f3ebb46e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55731841eb60 0x55731849d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:44.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.964+0000 7f3ebb46e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841f480 0x55731849d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:44.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.964+0000 7f3ebb46e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557318429d40 0x55731849db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:44.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.964+0000 7f3ebb46e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb41ac570 con 0x55731841eb60 2024-09-19T08:17:44.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.964+0000 7f3ebb46e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb41ad9e0 con 0x55731841f480 2024-09-19T08:17:44.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.964+0000 7f3ebb46e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb41acc40 con 0x557318429d40 2024-09-19T08:17:44.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.964+0000 7f3ebb46e740 10 client.0 _ll_register_callbacks cb 0x7f3ea800d900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:44.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.964+0000 7f3eb2d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55731841eb60 0x55731849d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:44.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.964+0000 7f3eb2d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55731841eb60 0x55731849d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37754/0 (socket says 172.21.15.27:37754) 2024-09-19T08:17:44.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.964+0000 7f3eb2d9d640 1 -- 172.21.15.27:0/1261819147 learned_addr learned my addr 172.21.15.27:0/1261819147 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:44.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.964+0000 7f3eb259c640 1 --2- 172.21.15.27:0/1261819147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841f480 0x55731849d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:44.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.964+0000 7f3eb359e640 1 --2- 172.21.15.27:0/1261819147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557318429d40 0x55731849db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:44.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.964+0000 7f3eb2d9d640 1 -- 172.21.15.27:0/1261819147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557318429d40 msgr2=0x55731849db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:44.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.964+0000 7f3eb2d9d640 1 --2- 172.21.15.27:0/1261819147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557318429d40 0x55731849db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.964+0000 7f3eb2d9d640 1 -- 172.21.15.27:0/1261819147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841f480 msgr2=0x55731849d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:44.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.964+0000 7f3eb2d9d640 1 --2- 172.21.15.27:0/1261819147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841f480 0x55731849d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.964+0000 7f3eb2d9d640 1 -- 172.21.15.27:0/1261819147 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55731843d670 con 0x55731841eb60 2024-09-19T08:17:44.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.965+0000 7f3eb2d9d640 1 --2- 172.21.15.27:0/1261819147 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55731841eb60 0x55731849d100 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4031550 tx=0x7f3ea402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18cf9c51e90180ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:44.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.965+0000 7f3e96ff5640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:44.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.965+0000 7f3e96ff5640 1 -- 172.21.15.27:0/1261819147 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4035040 con 0x55731841eb60 2024-09-19T08:17:44.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.965+0000 7f3e96ff5640 1 -- 172.21.15.27:0/1261819147 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f3ea4004980 con 0x55731841eb60 2024-09-19T08:17:44.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.965+0000 7f3ebb46e740 1 -- 172.21.15.27:0/1261819147 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55731838bd00 con 0x55731841eb60 2024-09-19T08:17:44.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.965+0000 7f3e96ff5640 1 -- 172.21.15.27:0/1261819147 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3ea4004b80 con 0x55731841eb60 2024-09-19T08:17:44.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.965+0000 7f3ebb46e740 10 client.16422 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:44.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.965+0000 7f3ebb46e740 1 -- 172.21.15.27:0/1261819147 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5573184a8b00 con 0x55731841eb60 2024-09-19T08:17:44.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.965+0000 7f3e96ff5640 1 -- 172.21.15.27:0/1261819147 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55731838bd00 con 0x55731841eb60 2024-09-19T08:17:44.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.965+0000 7f3e96ff5640 1 -- 172.21.15.27:0/1261819147 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3ea4058070 con 0x55731841eb60 2024-09-19T08:17:44.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.966+0000 7f3ebb46e740 10 client.16422 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:44.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.966+0000 7f3ebb46e740 10 client.16422 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:44.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.966+0000 7f3ebb46e740 20 client.16422 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:44.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.966+0000 7f3ebb46e740 1 --2- 172.21.15.27:0/1261819147 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5573184a9230 0x5573184ab650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:44.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.966+0000 7f3ebb46e740 4 client.16422 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:17:44.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.966+0000 7f3ebb46e740 1 -- 172.21.15.27:0/1261819147 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557318308110 con 0x5573184a9230 2024-09-19T08:17:44.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.966+0000 7f3eb259c640 1 --2- 172.21.15.27:0/1261819147 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5573184a9230 0x5573184ab650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:44.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.966+0000 7f3eb259c640 1 --2- 172.21.15.27:0/1261819147 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5573184a9230 0x5573184ab650 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1967f4ae8a4261a7 server_cookie=bc5130d77b793326 in_seq=0 out_seq=0 2024-09-19T08:17:44.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.966+0000 7f3e96ff5640 10 client.16422 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:44.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.968+0000 7f3e96ff5640 1 -- 172.21.15.27:0/1261819147 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557318308110 con 0x5573184a9230 2024-09-19T08:17:44.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.968+0000 7f3e96ff5640 10 client.16422 handle_command_reply: tid=0 2024-09-19T08:17:44.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.968+0000 7f3ebb46e740 1 client.16422 shutdown 2024-09-19T08:17:44.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.968+0000 7f3ebb46e740 1 -- 172.21.15.27:0/1261819147 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55731841eb60 msgr2=0x55731849d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.968+0000 7f3ebb46e740 1 --2- 172.21.15.27:0/1261819147 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55731841eb60 0x55731849d100 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4031550 tx=0x7f3ea402a420 comp rx=0 tx=0).stop 2024-09-19T08:17:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.968+0000 7f3ebb46e740 1 -- 172.21.15.27:0/1261819147 shutdown_connections 2024-09-19T08:17:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.968+0000 7f3ebb46e740 1 --2- 172.21.15.27:0/1261819147 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5573184a9230 0x5573184ab650 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.968+0000 7f3ebb46e740 1 --2- 172.21.15.27:0/1261819147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557318429d40 0x55731849db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.968+0000 7f3ebb46e740 1 --2- 172.21.15.27:0/1261819147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55731841f480 0x55731849d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.968+0000 7f3ebb46e740 1 --2- 172.21.15.27:0/1261819147 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55731841eb60 0x55731849d100 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.968+0000 7f3ebb46e740 1 -- 172.21.15.27:0/1261819147 >> 172.21.15.27:0/1261819147 conn(0x55731841b0f0 msgr2=0x557318419a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.968+0000 7f3e96ff5640 0 client.16422 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.968+0000 7f3ebb46e740 1 -- 172.21.15.27:0/1261819147 shutdown_connections 2024-09-19T08:17:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.968+0000 7f3ebb46e740 1 -- 172.21.15.27:0/1261819147 wait complete. 2024-09-19T08:17:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.968+0000 7f3ebb46e740 20 client.16422 trim_cache size 0 max 16384 2024-09-19T08:17:44.974 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:17:44.974 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:17:44.974 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "11236fb0-2a78-4999-b06a-3b9789afa91c", 2024-09-19T08:17:44.974 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:17:44.974 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:17:44.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.969+0000 7f3eb9095640 1 -- 172.21.15.27:0/2344025211 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3e9c0a33b0 msgr2=0x7f3e9c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:44.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.969+0000 7f3eb9095640 1 --2- 172.21.15.27:0/2344025211 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3e9c0a33b0 0x7f3e9c0a5870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4006010 tx=0x7f3ea4000bc0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.969+0000 7f3eb9095640 1 -- 172.21.15.27:0/2344025211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb4106a60 msgr2=0x7f3eb41a4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:44.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.969+0000 7f3eb9095640 1 --2- 172.21.15.27:0/2344025211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb4106a60 0x7f3eb41a4380 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00eaa0 tx=0x7f3eac00ef60 comp rx=0 tx=0).stop 2024-09-19T08:17:44.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.969+0000 7f3eb9095640 1 -- 172.21.15.27:0/2344025211 shutdown_connections 2024-09-19T08:17:44.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.969+0000 7f3eb9095640 1 --2- 172.21.15.27:0/2344025211 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3e9c0a33b0 0x7f3e9c0a5870 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.969+0000 7f3eb9095640 1 --2- 172.21.15.27:0/2344025211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb4106a60 0x7f3eb41a4380 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.969+0000 7f3eb9095640 1 --2- 172.21.15.27:0/2344025211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3eb4101400 0x7f3eb4199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.969+0000 7f3eb9095640 1 --2- 172.21.15.27:0/2344025211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3eb4100a60 0x7f3eb4199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:44.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.969+0000 7f3eb9095640 1 -- 172.21.15.27:0/2344025211 >> 172.21.15.27:0/2344025211 conn(0x7f3eb40fc780 msgr2=0x7f3eb40fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:44.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.969+0000 7f3eb9095640 1 -- 172.21.15.27:0/2344025211 shutdown_connections 2024-09-19T08:17:44.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:44.969+0000 7f3eb9095640 1 -- 172.21.15.27:0/2344025211 wait complete. 2024-09-19T08:17:45.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:44 smithi155 ceph-mon[35362]: pgmap v204: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:17:45.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:44 smithi027 ceph-mon[31209]: pgmap v204: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:17:45.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:44 smithi203 ceph-mon[35198]: pgmap v204: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:17:45.716 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:17:47.049 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:45 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:17:47.050 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:45 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:17:47.050 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:45 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:17:47.050 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:45 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:17:47.050 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:45 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:17:47.050 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:45 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:17:47.050 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:45 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:17:47.050 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:45 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:17:47.050 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:45 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:17:47.050 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:45 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:17:47.050 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:45 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:17:47.050 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:45 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:17:47.051 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:45 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:17:47.051 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:45 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:17:47.051 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:45 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:17:47.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:46 smithi155 ceph-mon[35362]: pgmap v205: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:47.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:46 smithi027 ceph-mon[31209]: pgmap v205: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:47.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:46 smithi203 ceph-mon[35198]: pgmap v205: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:17:47.322 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:17:47.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.827+0000 7fcfef081640 1 -- 172.21.15.27:0/1131740015 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe8112b90 msgr2=0x7fcfe8114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:47.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.827+0000 7fcfef081640 1 --2- 172.21.15.27:0/1131740015 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe8112b90 0x7fcfe8114f80 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009900 tx=0x7fcfd802a480 comp rx=0 tx=0).stop 2024-09-19T08:17:47.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.827+0000 7fcfef081640 1 -- 172.21.15.27:0/1131740015 shutdown_connections 2024-09-19T08:17:47.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.827+0000 7fcfef081640 1 --2- 172.21.15.27:0/1131740015 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe8112b90 0x7fcfe8114f80 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.827+0000 7fcfef081640 1 --2- 172.21.15.27:0/1131740015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfe8074eb0 0x7fcfe8112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.827+0000 7fcfef081640 1 --2- 172.21.15.27:0/1131740015 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfe8074590 0x7fcfe8074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.827+0000 7fcfef081640 1 -- 172.21.15.27:0/1131740015 >> 172.21.15.27:0/1131740015 conn(0x7fcfe80fd8c0 msgr2=0x7fcfe80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:47.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.827+0000 7fcfef081640 1 -- 172.21.15.27:0/1131740015 shutdown_connections 2024-09-19T08:17:47.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.827+0000 7fcfef081640 1 -- 172.21.15.27:0/1131740015 wait complete. 2024-09-19T08:17:47.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.828+0000 7fcfef081640 1 Processor -- start 2024-09-19T08:17:47.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.828+0000 7fcfef081640 1 -- start start 2024-09-19T08:17:47.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.828+0000 7fcfef081640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe8074590 0x7fcfe81a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:47.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.828+0000 7fcfef081640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfe8074eb0 0x7fcfe81a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:47.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.828+0000 7fcfef081640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfe8112b90 0x7fcfe819e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:47.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.828+0000 7fcfef081640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe81185e0 con 0x7fcfe8074590 2024-09-19T08:17:47.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.828+0000 7fcfef081640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe8118460 con 0x7fcfe8112b90 2024-09-19T08:17:47.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.828+0000 7fcfef081640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe8118760 con 0x7fcfe8074eb0 2024-09-19T08:17:47.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.828+0000 7fcfece1d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe8074590 0x7fcfe81a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:47.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.828+0000 7fcfece1d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe8074590 0x7fcfe81a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37768/0 (socket says 172.21.15.27:37768) 2024-09-19T08:17:47.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.828+0000 7fcfece1d640 1 -- 172.21.15.27:0/207473190 learned_addr learned my addr 172.21.15.27:0/207473190 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:47.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.828+0000 7fcfed61e640 1 --2- 172.21.15.27:0/207473190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfe8112b90 0x7fcfe819e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:47.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.828+0000 7fcfe7fff640 1 --2- 172.21.15.27:0/207473190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfe8074eb0 0x7fcfe81a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:47.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.829+0000 7fcfece1d640 1 -- 172.21.15.27:0/207473190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfe8074eb0 msgr2=0x7fcfe81a4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:47.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.829+0000 7fcfece1d640 1 --2- 172.21.15.27:0/207473190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfe8074eb0 0x7fcfe81a4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.829+0000 7fcfece1d640 1 -- 172.21.15.27:0/207473190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfe8112b90 msgr2=0x7fcfe819e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:47.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.829+0000 7fcfece1d640 1 --2- 172.21.15.27:0/207473190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfe8112b90 0x7fcfe819e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.829+0000 7fcfece1d640 1 -- 172.21.15.27:0/207473190 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe819f040 con 0x7fcfe8074590 2024-09-19T08:17:47.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.829+0000 7fcfe7fff640 1 --2- 172.21.15.27:0/207473190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfe8074eb0 0x7fcfe81a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:17:47.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.829+0000 7fcfece1d640 1 --2- 172.21.15.27:0/207473190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe8074590 0x7fcfe81a4750 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000ba50 tx=0x7fcfe000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:47.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.829+0000 7fcfe5ffb640 1 -- 172.21.15.27:0/207473190 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0019070 con 0x7fcfe8074590 2024-09-19T08:17:47.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.829+0000 7fcfe5ffb640 1 -- 172.21.15.27:0/207473190 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfe000cbe0 con 0x7fcfe8074590 2024-09-19T08:17:47.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.829+0000 7fcfef081640 1 -- 172.21.15.27:0/207473190 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe819f330 con 0x7fcfe8074590 2024-09-19T08:17:47.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.829+0000 7fcfe5ffb640 1 -- 172.21.15.27:0/207473190 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00076e0 con 0x7fcfe8074590 2024-09-19T08:17:47.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.829+0000 7fcfef081640 1 -- 172.21.15.27:0/207473190 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe81ab620 con 0x7fcfe8074590 2024-09-19T08:17:47.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.832+0000 7fcfe5ffb640 1 -- 172.21.15.27:0/207473190 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fcfe001c070 con 0x7fcfe8074590 2024-09-19T08:17:47.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.832+0000 7fcff145a740 1 Processor -- start 2024-09-19T08:17:47.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.832+0000 7fcff145a740 1 -- start start 2024-09-19T08:17:47.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.832+0000 7fcff145a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e44a0 0x556cc59e4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:47.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.832+0000 7fcff145a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556cc59e4dc0 0x556cc59ef140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:47.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.832+0000 7fcff145a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556cc59ef680 0x556cc59f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:47.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.832+0000 7fcff145a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556cc594a2e0 con 0x556cc59e44a0 2024-09-19T08:17:47.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.832+0000 7fcff145a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x556cc58f1ce0 con 0x556cc59ef680 2024-09-19T08:17:47.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.832+0000 7fcff145a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556cc59462a0 con 0x556cc59e4dc0 2024-09-19T08:17:47.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.832+0000 7fcfe5ffb640 1 --2- 172.21.15.27:0/207473190 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fcfd00a33b0 0x7fcfd00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:47.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.832+0000 7fcfed61e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e44a0 0x556cc59e4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:47.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.832+0000 7fcfed61e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e44a0 0x556cc59e4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37776/0 (socket says 172.21.15.27:37776) 2024-09-19T08:17:47.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.832+0000 7fcfed61e640 1 -- 172.21.15.27:0/2990845732 learned_addr learned my addr 172.21.15.27:0/2990845732 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:47.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.833+0000 7fcfe7fff640 1 --2- 172.21.15.27:0/2990845732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556cc59ef680 0x556cc59f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:47.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.833+0000 7fcfed61e640 1 --2- 172.21.15.27:0/207473190 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fcfd00a33b0 0x7fcfd00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:47.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.833+0000 7fcfece1d640 1 --2- 172.21.15.27:0/2990845732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556cc59e4dc0 0x556cc59ef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:47.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.833+0000 7fcfe5ffb640 1 -- 172.21.15.27:0/207473190 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fcfe00cf1c0 con 0x7fcfe8074590 2024-09-19T08:17:47.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.833+0000 7fcfed61e640 1 -- 172.21.15.27:0/2990845732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556cc59e4dc0 msgr2=0x556cc59ef140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:47.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.833+0000 7fcfed61e640 1 --2- 172.21.15.27:0/2990845732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556cc59e4dc0 0x556cc59ef140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.833+0000 7fcfed61e640 1 -- 172.21.15.27:0/2990845732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556cc59ef680 msgr2=0x556cc59f1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:47.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.833+0000 7fcfed61e640 1 --2- 172.21.15.27:0/2990845732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556cc59ef680 0x556cc59f1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.833+0000 7fcfed61e640 1 -- 172.21.15.27:0/2990845732 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cc58d6440 con 0x556cc59e44a0 2024-09-19T08:17:47.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.833+0000 7fcfed61e640 1 --2- 172.21.15.27:0/2990845732 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e44a0 0x556cc59e4880 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8076600 tx=0x7fcfd80040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd01adbcfe67c54a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:47.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.833+0000 7fcfceffd640 1 -- 172.21.15.27:0/2990845732 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8035040 con 0x556cc59e44a0 2024-09-19T08:17:47.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.833+0000 7fcfceffd640 1 -- 172.21.15.27:0/2990845732 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfd804d070 con 0x556cc59e44a0 2024-09-19T08:17:47.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.833+0000 7fcfceffd640 1 -- 172.21.15.27:0/2990845732 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8048ba0 con 0x556cc59e44a0 2024-09-19T08:17:47.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.834+0000 7fcff145a740 1 -- 172.21.15.27:0/2990845732 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e44a0 msgr2=0x556cc59e4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:47.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.834+0000 7fcff145a740 1 --2- 172.21.15.27:0/2990845732 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e44a0 0x556cc59e4880 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8076600 tx=0x7fcfd80040c0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.834+0000 7fcfed61e640 1 --2- 172.21.15.27:0/207473190 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fcfd00a33b0 0x7fcfd00a5870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcfd804c000 tx=0x7fcfd804a000 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:47.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.834+0000 7fcff145a740 1 -- 172.21.15.27:0/2990845732 shutdown_connections 2024-09-19T08:17:47.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.834+0000 7fcff145a740 1 --2- 172.21.15.27:0/2990845732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556cc59ef680 0x556cc59f1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.834+0000 7fcff145a740 1 --2- 172.21.15.27:0/2990845732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556cc59e4dc0 0x556cc59ef140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.834+0000 7fcff145a740 1 --2- 172.21.15.27:0/2990845732 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e44a0 0x556cc59e4880 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.834+0000 7fcff145a740 1 -- 172.21.15.27:0/2990845732 >> 172.21.15.27:0/2990845732 conn(0x556cc59e0a30 msgr2=0x556cc59e0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:47.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.834+0000 7fcff145a740 1 -- 172.21.15.27:0/2990845732 shutdown_connections 2024-09-19T08:17:47.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.834+0000 7fcff145a740 1 -- 172.21.15.27:0/2990845732 wait complete. 2024-09-19T08:17:47.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.834+0000 7fcff145a740 1 -- start start 2024-09-19T08:17:47.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.835+0000 7fcff145a740 1 Processor -- start 2024-09-19T08:17:47.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.835+0000 7fcff145a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556cc59e44a0 0x556cc59eef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:47.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.835+0000 7fcff145a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e4dc0 0x556cc59ec210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:47.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.835+0000 7fcff145a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556cc59ef680 0x556cc59ec750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:47.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.835+0000 7fcff145a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556cc59f2250 con 0x556cc59e4dc0 2024-09-19T08:17:47.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.835+0000 7fcff145a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x556cc5905050 con 0x556cc59ef680 2024-09-19T08:17:47.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.835+0000 7fcff145a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556cc59f23d0 con 0x556cc59e44a0 2024-09-19T08:17:47.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.835+0000 7fcff145a740 10 client.0 _ll_register_callbacks cb 0x556cc5945160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:47.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.835+0000 7fcfe7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e4dc0 0x556cc59ec210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:47.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.835+0000 7fcfe7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e4dc0 0x556cc59ec210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37786/0 (socket says 172.21.15.27:37786) 2024-09-19T08:17:47.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.835+0000 7fcfe7fff640 1 -- 172.21.15.27:0/3547302514 learned_addr learned my addr 172.21.15.27:0/3547302514 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:47.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.835+0000 7fcfece1d640 1 --2- 172.21.15.27:0/3547302514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556cc59e44a0 0x556cc59eef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:47.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.835+0000 7fcfed61e640 1 --2- 172.21.15.27:0/3547302514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556cc59ef680 0x556cc59ec750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:47.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.836+0000 7fcfe7fff640 1 -- 172.21.15.27:0/3547302514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556cc59e44a0 msgr2=0x556cc59eef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:47.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.836+0000 7fcfe7fff640 1 --2- 172.21.15.27:0/3547302514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556cc59e44a0 0x556cc59eef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.836+0000 7fcfe7fff640 1 -- 172.21.15.27:0/3547302514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556cc59ef680 msgr2=0x556cc59ec750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:47.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.836+0000 7fcfe7fff640 1 --2- 172.21.15.27:0/3547302514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556cc59ef680 0x556cc59ec750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.836+0000 7fcfe7fff640 1 -- 172.21.15.27:0/3547302514 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cc56bb3c0 con 0x556cc59e4dc0 2024-09-19T08:17:47.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.836+0000 7fcfe7fff640 1 --2- 172.21.15.27:0/3547302514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e4dc0 0x556cc59ec210 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc011760 tx=0x7fcfdc011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8099bee9d9902d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:47.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.836+0000 7fcfc7fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:47.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.836+0000 7fcfc7fff640 1 -- 172.21.15.27:0/3547302514 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc01e060 con 0x556cc59e4dc0 2024-09-19T08:17:47.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.836+0000 7fcfc7fff640 1 -- 172.21.15.27:0/3547302514 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fcfdc0193f0 con 0x556cc59e4dc0 2024-09-19T08:17:47.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.836+0000 7fcff145a740 1 -- 172.21.15.27:0/3547302514 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfd804d070 con 0x556cc59e4dc0 2024-09-19T08:17:47.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.836+0000 7fcfc7fff640 1 -- 172.21.15.27:0/3547302514 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcfdc00fe70 con 0x556cc59e4dc0 2024-09-19T08:17:47.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.836+0000 7fcff145a740 10 client.16434 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:47.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.836+0000 7fcff145a740 1 -- 172.21.15.27:0/3547302514 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556cc59fdc70 con 0x556cc59e4dc0 2024-09-19T08:17:47.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.836+0000 7fcfc7fff640 1 -- 172.21.15.27:0/3547302514 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfd804d070 con 0x556cc59e4dc0 2024-09-19T08:17:47.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.837+0000 7fcfc7fff640 1 -- 172.21.15.27:0/3547302514 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fcfdc018030 con 0x556cc59e4dc0 2024-09-19T08:17:47.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.837+0000 7fcff145a740 10 client.16434 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:47.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.837+0000 7fcff145a740 10 client.16434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:47.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.837+0000 7fcff145a740 20 client.16434 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:47.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.837+0000 7fcff145a740 1 --2- 172.21.15.27:0/3547302514 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556cc59ff130 0x556cc5a01540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:47.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.837+0000 7fcff145a740 4 client.16434 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:17:47.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.837+0000 7fcff145a740 1 -- 172.21.15.27:0/3547302514 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556cc5957850 con 0x556cc59ff130 2024-09-19T08:17:47.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.837+0000 7fcfece1d640 1 --2- 172.21.15.27:0/3547302514 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556cc59ff130 0x556cc5a01540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:47.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.837+0000 7fcfece1d640 1 --2- 172.21.15.27:0/3547302514 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556cc59ff130 0x556cc5a01540 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d9e4aff1024d994 server_cookie=78d98311bcf3dd69 in_seq=0 out_seq=0 2024-09-19T08:17:47.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.837+0000 7fcfc7fff640 10 client.16434 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:47.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.838+0000 7fcfc7fff640 1 -- 172.21.15.27:0/3547302514 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556cc5957850 con 0x556cc59ff130 2024-09-19T08:17:47.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.838+0000 7fcfc7fff640 10 client.16434 handle_command_reply: tid=0 2024-09-19T08:17:47.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.838+0000 7fcff145a740 1 client.16434 shutdown 2024-09-19T08:17:47.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.838+0000 7fcff145a740 1 -- 172.21.15.27:0/3547302514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e4dc0 msgr2=0x556cc59ec210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:47.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.838+0000 7fcff145a740 1 --2- 172.21.15.27:0/3547302514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e4dc0 0x556cc59ec210 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc011760 tx=0x7fcfdc011c20 comp rx=0 tx=0).stop 2024-09-19T08:17:47.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.839+0000 7fcff145a740 1 -- 172.21.15.27:0/3547302514 shutdown_connections 2024-09-19T08:17:47.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.839+0000 7fcff145a740 1 --2- 172.21.15.27:0/3547302514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556cc59ef680 0x556cc59ec750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.839+0000 7fcff145a740 1 --2- 172.21.15.27:0/3547302514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e4dc0 0x556cc59ec210 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.839+0000 7fcff145a740 1 --2- 172.21.15.27:0/3547302514 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556cc59ff130 0x556cc5a01540 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.839+0000 7fcff145a740 1 --2- 172.21.15.27:0/3547302514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556cc59e44a0 0x556cc59eef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.839+0000 7fcff145a740 1 -- 172.21.15.27:0/3547302514 >> 172.21.15.27:0/3547302514 conn(0x556cc59e0a30 msgr2=0x556cc59dfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:47.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.839+0000 7fcfc7fff640 0 client.16434 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:47.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.839+0000 7fcff145a740 1 -- 172.21.15.27:0/3547302514 shutdown_connections 2024-09-19T08:17:47.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.839+0000 7fcff145a740 1 -- 172.21.15.27:0/3547302514 wait complete. 2024-09-19T08:17:47.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.839+0000 7fcff145a740 20 client.16434 trim_cache size 0 max 16384 2024-09-19T08:17:47.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.856+0000 7fcff145a740 1 Processor -- start 2024-09-19T08:17:47.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.856+0000 7fcff145a740 1 -- start start 2024-09-19T08:17:47.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.856+0000 7fcff145a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556cc59e44a0 0x556cc59fb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:47.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.856+0000 7fcff145a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e4dc0 0x556cc5a06e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:47.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.856+0000 7fcff145a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556cc59ef680 0x556cc5a07350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:47.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.856+0000 7fcff145a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe81b1db0 con 0x556cc59e4dc0 2024-09-19T08:17:47.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.856+0000 7fcff145a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe81b4630 con 0x556cc59ef680 2024-09-19T08:17:47.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.856+0000 7fcff145a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe81b2420 con 0x556cc59e44a0 2024-09-19T08:17:47.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.856+0000 7fcfe7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e4dc0 0x556cc5a06e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:47.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.856+0000 7fcfe7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e4dc0 0x556cc5a06e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37788/0 (socket says 172.21.15.27:37788) 2024-09-19T08:17:47.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.856+0000 7fcfe7fff640 1 -- 172.21.15.27:0/3227690952 learned_addr learned my addr 172.21.15.27:0/3227690952 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:47.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.857+0000 7fcfed61e640 1 --2- 172.21.15.27:0/3227690952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556cc59ef680 0x556cc5a07350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:47.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.857+0000 7fcfece1d640 1 --2- 172.21.15.27:0/3227690952 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556cc59e44a0 0x556cc59fb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:47.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.857+0000 7fcfe7fff640 1 -- 172.21.15.27:0/3227690952 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556cc59e44a0 msgr2=0x556cc59fb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:47.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.857+0000 7fcfe7fff640 1 --2- 172.21.15.27:0/3227690952 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556cc59e44a0 0x556cc59fb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.857+0000 7fcfe7fff640 1 -- 172.21.15.27:0/3227690952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556cc59ef680 msgr2=0x556cc5a07350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:47.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.857+0000 7fcfe7fff640 1 --2- 172.21.15.27:0/3227690952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556cc59ef680 0x556cc5a07350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.857+0000 7fcfe7fff640 1 -- 172.21.15.27:0/3227690952 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cc59ef2d0 con 0x556cc59e4dc0 2024-09-19T08:17:47.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.857+0000 7fcfe7fff640 1 --2- 172.21.15.27:0/3227690952 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e4dc0 0x556cc5a06e10 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc021620 tx=0x7fcfdc00cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c8021c06e5a77b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:47.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.857+0000 7fcfce7fc640 1 -- 172.21.15.27:0/3227690952 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc00f790 con 0x556cc59e4dc0 2024-09-19T08:17:47.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.857+0000 7fcfce7fc640 1 -- 172.21.15.27:0/3227690952 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfdc021360 con 0x556cc59e4dc0 2024-09-19T08:17:47.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.857+0000 7fcfce7fc640 1 -- 172.21.15.27:0/3227690952 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc023c20 con 0x556cc59e4dc0 2024-09-19T08:17:47.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.858+0000 7fcff145a740 1 -- 172.21.15.27:0/3227690952 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e4dc0 msgr2=0x556cc5a06e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:47.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.858+0000 7fcff145a740 1 --2- 172.21.15.27:0/3227690952 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e4dc0 0x556cc5a06e10 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc021620 tx=0x7fcfdc00cfd0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.858+0000 7fcff145a740 1 -- 172.21.15.27:0/3227690952 shutdown_connections 2024-09-19T08:17:47.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.858+0000 7fcff145a740 1 --2- 172.21.15.27:0/3227690952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556cc59ef680 0x556cc5a07350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.858+0000 7fcff145a740 1 --2- 172.21.15.27:0/3227690952 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59e4dc0 0x556cc5a06e10 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.858+0000 7fcff145a740 1 --2- 172.21.15.27:0/3227690952 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556cc59e44a0 0x556cc59fb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.858+0000 7fcff145a740 1 -- 172.21.15.27:0/3227690952 >> 172.21.15.27:0/3227690952 conn(0x556cc59e0a30 msgr2=0x556cc59ee290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:47.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.858+0000 7fcff145a740 1 -- 172.21.15.27:0/3227690952 shutdown_connections 2024-09-19T08:17:47.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.858+0000 7fcff145a740 1 -- 172.21.15.27:0/3227690952 wait complete. 2024-09-19T08:17:47.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.858+0000 7fcff145a740 1 -- start start 2024-09-19T08:17:47.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.858+0000 7fcff145a740 1 Processor -- start 2024-09-19T08:17:47.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.859+0000 7fcff145a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556cc59e44a0 0x556cc59f7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:47.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.859+0000 7fcff145a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556cc59e4dc0 0x556cc59f3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:47.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.859+0000 7fcff145a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59ef680 0x556cc59f3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:47.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.859+0000 7fcff145a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe81b2af0 con 0x556cc59ef680 2024-09-19T08:17:47.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.859+0000 7fcff145a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe81b3f60 con 0x556cc59e4dc0 2024-09-19T08:17:47.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.859+0000 7fcff145a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe81b31c0 con 0x556cc59e44a0 2024-09-19T08:17:47.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.859+0000 7fcff145a740 10 client.0 _ll_register_callbacks cb 0x7fcfdc00c730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:47.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.859+0000 7fcfed61e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59ef680 0x556cc59f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:47.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.859+0000 7fcfed61e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59ef680 0x556cc59f3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37804/0 (socket says 172.21.15.27:37804) 2024-09-19T08:17:47.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.859+0000 7fcfed61e640 1 -- 172.21.15.27:0/3623043186 learned_addr learned my addr 172.21.15.27:0/3623043186 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:47.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.859+0000 7fcfece1d640 1 --2- 172.21.15.27:0/3623043186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556cc59e44a0 0x556cc59f7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:47.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.859+0000 7fcfe7fff640 1 --2- 172.21.15.27:0/3623043186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556cc59e4dc0 0x556cc59f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:47.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.859+0000 7fcfed61e640 1 -- 172.21.15.27:0/3623043186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556cc59e44a0 msgr2=0x556cc59f7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:47.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.859+0000 7fcfed61e640 1 --2- 172.21.15.27:0/3623043186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556cc59e44a0 0x556cc59f7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.859+0000 7fcfed61e640 1 -- 172.21.15.27:0/3623043186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556cc59e4dc0 msgr2=0x556cc59f3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:47.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.859+0000 7fcfed61e640 1 --2- 172.21.15.27:0/3623043186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556cc59e4dc0 0x556cc59f3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.859+0000 7fcfed61e640 1 -- 172.21.15.27:0/3623043186 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cc59f3da0 con 0x556cc59ef680 2024-09-19T08:17:47.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.860+0000 7fcfed61e640 1 --2- 172.21.15.27:0/3623043186 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59ef680 0x556cc59f3570 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8031550 tx=0x7fcfd8005cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e8b60d886e4613 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:47.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.860+0000 7fcfc7fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:47.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.860+0000 7fcfc7fff640 1 -- 172.21.15.27:0/3623043186 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8060060 con 0x556cc59ef680 2024-09-19T08:17:47.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.860+0000 7fcff145a740 1 -- 172.21.15.27:0/3623043186 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfdc021360 con 0x556cc59ef680 2024-09-19T08:17:47.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.860+0000 7fcfc7fff640 1 -- 172.21.15.27:0/3623043186 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fcfd80039c0 con 0x556cc59ef680 2024-09-19T08:17:47.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.860+0000 7fcfc7fff640 1 -- 172.21.15.27:0/3623043186 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcfd8035040 con 0x556cc59ef680 2024-09-19T08:17:47.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.860+0000 7fcff145a740 10 client.16440 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:47.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.860+0000 7fcff145a740 1 -- 172.21.15.27:0/3623043186 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556cc5a69d80 con 0x556cc59ef680 2024-09-19T08:17:47.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.860+0000 7fcfc7fff640 1 -- 172.21.15.27:0/3623043186 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfdc021360 con 0x556cc59ef680 2024-09-19T08:17:47.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.860+0000 7fcfc7fff640 1 -- 172.21.15.27:0/3623043186 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fcfd805a030 con 0x556cc59ef680 2024-09-19T08:17:47.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.860+0000 7fcff145a740 10 client.16440 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:47.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.860+0000 7fcff145a740 10 client.16440 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:47.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.860+0000 7fcff145a740 20 client.16440 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:47.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.860+0000 7fcff145a740 1 --2- 172.21.15.27:0/3623043186 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556cc5a6a110 0x556cc5a6c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:47.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.860+0000 7fcff145a740 4 client.16440 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:17:47.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.860+0000 7fcff145a740 1 -- 172.21.15.27:0/3623043186 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556cc5951d60 con 0x556cc5a6a110 2024-09-19T08:17:47.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.861+0000 7fcfece1d640 1 --2- 172.21.15.27:0/3623043186 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556cc5a6a110 0x556cc5a6c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:47.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.861+0000 7fcfc7fff640 10 client.16440 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:47.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.861+0000 7fcfece1d640 1 --2- 172.21.15.27:0/3623043186 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556cc5a6a110 0x556cc5a6c500 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d43abd94e8017641 server_cookie=6477360f0b20fca2 in_seq=0 out_seq=0 2024-09-19T08:17:47.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.861+0000 7fcfc7fff640 1 -- 172.21.15.27:0/3623043186 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556cc5951d60 con 0x556cc5a6a110 2024-09-19T08:17:47.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.861+0000 7fcfc7fff640 10 client.16440 handle_command_reply: tid=0 2024-09-19T08:17:47.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.861+0000 7fcff145a740 1 client.16440 shutdown 2024-09-19T08:17:47.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.861+0000 7fcff145a740 1 -- 172.21.15.27:0/3623043186 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59ef680 msgr2=0x556cc59f3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:47.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.861+0000 7fcff145a740 1 --2- 172.21.15.27:0/3623043186 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59ef680 0x556cc59f3570 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8031550 tx=0x7fcfd8005cb0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.861+0000 7fcff145a740 1 -- 172.21.15.27:0/3623043186 shutdown_connections 2024-09-19T08:17:47.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.861+0000 7fcff145a740 1 --2- 172.21.15.27:0/3623043186 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556cc59ef680 0x556cc59f3570 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.861+0000 7fcff145a740 1 --2- 172.21.15.27:0/3623043186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556cc59e4dc0 0x556cc59f3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.861+0000 7fcff145a740 1 --2- 172.21.15.27:0/3623043186 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556cc5a6a110 0x556cc5a6c500 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.861+0000 7fcff145a740 1 --2- 172.21.15.27:0/3623043186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556cc59e44a0 0x556cc59f7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.861+0000 7fcff145a740 1 -- 172.21.15.27:0/3623043186 >> 172.21.15.27:0/3623043186 conn(0x556cc59e0a30 msgr2=0x556cc59e5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:47.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.861+0000 7fcfc7fff640 0 client.16440 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:47.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.862+0000 7fcff145a740 1 -- 172.21.15.27:0/3623043186 shutdown_connections 2024-09-19T08:17:47.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.862+0000 7fcff145a740 1 -- 172.21.15.27:0/3623043186 wait complete. 2024-09-19T08:17:47.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.862+0000 7fcff145a740 20 client.16440 trim_cache size 0 max 16384 2024-09-19T08:17:47.873 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:17:47.873 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:17:47.873 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:17:47.874 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:17:47.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.862+0000 7fcfef081640 1 -- 172.21.15.27:0/207473190 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fcfd00a33b0 msgr2=0x7fcfd00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:47.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.862+0000 7fcfef081640 1 --2- 172.21.15.27:0/207473190 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fcfd00a33b0 0x7fcfd00a5870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcfd804c000 tx=0x7fcfd804a000 comp rx=0 tx=0).stop 2024-09-19T08:17:47.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.862+0000 7fcfef081640 1 -- 172.21.15.27:0/207473190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe8074590 msgr2=0x7fcfe81a4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:47.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.862+0000 7fcfef081640 1 --2- 172.21.15.27:0/207473190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe8074590 0x7fcfe81a4750 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000ba50 tx=0x7fcfe000bf10 comp rx=0 tx=0).stop 2024-09-19T08:17:47.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.862+0000 7fcfef081640 1 -- 172.21.15.27:0/207473190 shutdown_connections 2024-09-19T08:17:47.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.862+0000 7fcfef081640 1 --2- 172.21.15.27:0/207473190 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fcfd00a33b0 0x7fcfd00a5870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.862+0000 7fcfef081640 1 --2- 172.21.15.27:0/207473190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfe8112b90 0x7fcfe819e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.862+0000 7fcfef081640 1 --2- 172.21.15.27:0/207473190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfe8074eb0 0x7fcfe81a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.862+0000 7fcfef081640 1 --2- 172.21.15.27:0/207473190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe8074590 0x7fcfe81a4750 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:47.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.862+0000 7fcfef081640 1 -- 172.21.15.27:0/207473190 >> 172.21.15.27:0/207473190 conn(0x7fcfe80fd8c0 msgr2=0x7fcfe80fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:47.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.862+0000 7fcfef081640 1 -- 172.21.15.27:0/207473190 shutdown_connections 2024-09-19T08:17:47.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:47.863+0000 7fcfef081640 1 -- 172.21.15.27:0/207473190 wait complete. 2024-09-19T08:17:48.647 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:17:48.648 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:17:48.911 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:17:49.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:48 smithi155 ceph-mon[35362]: pgmap v206: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:17:49.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:48 smithi027 ceph-mon[31209]: pgmap v206: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:17:49.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:48 smithi203 ceph-mon[35198]: pgmap v206: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:17:49.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.501+0000 7f5e12f7c640 1 -- 172.21.15.27:0/1773499540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c100e20 msgr2=0x7f5e0c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:49.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.501+0000 7f5e12f7c640 1 --2- 172.21.15.27:0/1773499540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c100e20 0x7f5e0c101200 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f5e08009900 tx=0x7f5e0802a480 comp rx=0 tx=0).stop 2024-09-19T08:17:49.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.501+0000 7f5e12f7c640 1 -- 172.21.15.27:0/1773499540 shutdown_connections 2024-09-19T08:17:49.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.501+0000 7f5e12f7c640 1 --2- 172.21.15.27:0/1773499540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e0c102ef0 0x7f5e0c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:49.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.501+0000 7f5e12f7c640 1 --2- 172.21.15.27:0/1773499540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e0c102570 0x7f5e0c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:49.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.501+0000 7f5e12f7c640 1 --2- 172.21.15.27:0/1773499540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c100e20 0x7f5e0c101200 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:49.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.501+0000 7f5e12f7c640 1 -- 172.21.15.27:0/1773499540 >> 172.21.15.27:0/1773499540 conn(0x7f5e0c0fc7d0 msgr2=0x7f5e0c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:49.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.501+0000 7f5e12f7c640 1 -- 172.21.15.27:0/1773499540 shutdown_connections 2024-09-19T08:17:49.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.501+0000 7f5e12f7c640 1 -- 172.21.15.27:0/1773499540 wait complete. 2024-09-19T08:17:49.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.501+0000 7f5e12f7c640 1 Processor -- start 2024-09-19T08:17:49.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.501+0000 7f5e12f7c640 1 -- start start 2024-09-19T08:17:49.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e12f7c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e0c100e20 0x7f5e0c1a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:49.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e12f7c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c102570 0x7f5e0c1a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:49.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e12f7c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e0c102ef0 0x7f5e0c19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:49.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e12f7c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c111020 con 0x7f5e0c102570 2024-09-19T08:17:49.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e12f7c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c110ea0 con 0x7f5e0c102ef0 2024-09-19T08:17:49.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e12f7c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c1111a0 con 0x7f5e0c100e20 2024-09-19T08:17:49.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e03fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c102570 0x7f5e0c1a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:49.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e03fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c102570 0x7f5e0c1a0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37824/0 (socket says 172.21.15.27:37824) 2024-09-19T08:17:49.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e03fff640 1 -- 172.21.15.27:0/2244562721 learned_addr learned my addr 172.21.15.27:0/2244562721 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:49.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e10d18640 1 --2- 172.21.15.27:0/2244562721 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e0c100e20 0x7f5e0c1a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:49.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e03fff640 1 -- 172.21.15.27:0/2244562721 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e0c100e20 msgr2=0x7f5e0c1a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:49.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e03fff640 1 --2- 172.21.15.27:0/2244562721 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e0c100e20 0x7f5e0c1a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:49.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e03fff640 1 -- 172.21.15.27:0/2244562721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e0c102ef0 msgr2=0x7f5e0c19a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:49.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e11519640 1 --2- 172.21.15.27:0/2244562721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e0c102ef0 0x7f5e0c19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:49.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e03fff640 1 --2- 172.21.15.27:0/2244562721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e0c102ef0 0x7f5e0c19a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:49.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e03fff640 1 -- 172.21.15.27:0/2244562721 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0c19af80 con 0x7f5e0c102570 2024-09-19T08:17:49.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e03fff640 1 --2- 172.21.15.27:0/2244562721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c102570 0x7f5e0c1a0b30 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00b4a0 tx=0x7f5dfc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:49.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e01ffb640 1 -- 172.21.15.27:0/2244562721 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc014070 con 0x7f5e0c102570 2024-09-19T08:17:49.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e01ffb640 1 -- 172.21.15.27:0/2244562721 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dfc010af0 con 0x7f5e0c102570 2024-09-19T08:17:49.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e01ffb640 1 -- 172.21.15.27:0/2244562721 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc017d10 con 0x7f5e0c102570 2024-09-19T08:17:49.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.502+0000 7f5e12f7c640 1 -- 172.21.15.27:0/2244562721 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e0c19b270 con 0x7f5e0c102570 2024-09-19T08:17:49.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.503+0000 7f5e12f7c640 1 -- 172.21.15.27:0/2244562721 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e0c1a75e0 con 0x7f5e0c102570 2024-09-19T08:17:49.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.504+0000 7f5e12f7c640 1 -- 172.21.15.27:0/2244562721 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e0c101280 con 0x7f5e0c102570 2024-09-19T08:17:49.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.505+0000 7f5e01ffb640 1 -- 172.21.15.27:0/2244562721 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f5dfc017070 con 0x7f5e0c102570 2024-09-19T08:17:49.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.506+0000 7f5e01ffb640 1 --2- 172.21.15.27:0/2244562721 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f5df40a3430 0x7f5df40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:49.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.506+0000 7f5e10d18640 1 --2- 172.21.15.27:0/2244562721 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f5df40a3430 0x7f5df40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:49.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.506+0000 7f5e01ffb640 1 -- 172.21.15.27:0/2244562721 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f5dfc0cef60 con 0x7f5e0c102570 2024-09-19T08:17:49.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.506+0000 7f5e10d18640 1 --2- 172.21.15.27:0/2244562721 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f5df40a3430 0x7f5df40a58f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5e08005ab0 tx=0x7f5e08005a20 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:49.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.510+0000 7f5e01ffb640 1 -- 172.21.15.27:0/2244562721 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5dfc09baa0 con 0x7f5e0c102570 2024-09-19T08:17:49.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.723+0000 7f5e12f7c640 1 -- 172.21.15.27:0/2244562721 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e0c1a77b0 con 0x7f5e0c102570 2024-09-19T08:17:49.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.723+0000 7f5e01ffb640 1 -- 172.21.15.27:0/2244562721 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f5dfc09b3a0 con 0x7f5e0c102570 2024-09-19T08:17:49.724 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:17:49.724 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:17:49.724 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:17:49.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.726+0000 7f5e12f7c640 1 -- 172.21.15.27:0/2244562721 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f5df40a3430 msgr2=0x7f5df40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:49.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.726+0000 7f5e12f7c640 1 --2- 172.21.15.27:0/2244562721 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f5df40a3430 0x7f5df40a58f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5e08005ab0 tx=0x7f5e08005a20 comp rx=0 tx=0).stop 2024-09-19T08:17:49.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.726+0000 7f5e12f7c640 1 -- 172.21.15.27:0/2244562721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c102570 msgr2=0x7f5e0c1a0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:49.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.726+0000 7f5e12f7c640 1 --2- 172.21.15.27:0/2244562721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c102570 0x7f5e0c1a0b30 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00b4a0 tx=0x7f5dfc00b960 comp rx=0 tx=0).stop 2024-09-19T08:17:49.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.726+0000 7f5e12f7c640 1 -- 172.21.15.27:0/2244562721 shutdown_connections 2024-09-19T08:17:49.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.726+0000 7f5e12f7c640 1 --2- 172.21.15.27:0/2244562721 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f5df40a3430 0x7f5df40a58f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:49.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.726+0000 7f5e12f7c640 1 --2- 172.21.15.27:0/2244562721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e0c102ef0 0x7f5e0c19a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:49.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.726+0000 7f5e12f7c640 1 --2- 172.21.15.27:0/2244562721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c102570 0x7f5e0c1a0b30 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:49.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.726+0000 7f5e12f7c640 1 --2- 172.21.15.27:0/2244562721 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e0c100e20 0x7f5e0c1a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:49.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.726+0000 7f5e12f7c640 1 -- 172.21.15.27:0/2244562721 >> 172.21.15.27:0/2244562721 conn(0x7f5e0c0fc7d0 msgr2=0x7f5e0c06a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:49.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.727+0000 7f5e12f7c640 1 -- 172.21.15.27:0/2244562721 shutdown_connections 2024-09-19T08:17:49.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:49.727+0000 7f5e12f7c640 1 -- 172.21.15.27:0/2244562721 wait complete. 2024-09-19T08:17:50.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:49 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2244562721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:17:50.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:49 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2244562721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:17:50.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:49 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2244562721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:17:50.523 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:17:50.783 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:17:51.178 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:50 smithi027 ceph-mon[31209]: pgmap v207: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:17:51.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:50 smithi155 ceph-mon[35362]: pgmap v207: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:17:51.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:50 smithi203 ceph-mon[35198]: pgmap v207: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:17:51.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.267+0000 7feb07544640 1 -- 172.21.15.27:0/262957581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb00106f40 msgr2=0x7feb0010eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:51.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.267+0000 7feb07544640 1 --2- 172.21.15.27:0/262957581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb00106f40 0x7feb0010eac0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009ca0 tx=0x7feaf802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.267+0000 7feb07544640 1 -- 172.21.15.27:0/262957581 shutdown_connections 2024-09-19T08:17:51.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.267+0000 7feb07544640 1 --2- 172.21.15.27:0/262957581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb00106f40 0x7feb0010eac0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.267+0000 7feb07544640 1 --2- 172.21.15.27:0/262957581 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb001027c0 0x7feb00106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.267+0000 7feb07544640 1 --2- 172.21.15.27:0/262957581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb00101e10 0x7feb001021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.267+0000 7feb07544640 1 -- 172.21.15.27:0/262957581 >> 172.21.15.27:0/262957581 conn(0x7feb000fd8d0 msgr2=0x7feb000ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:51.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.267+0000 7feb07544640 1 -- 172.21.15.27:0/262957581 shutdown_connections 2024-09-19T08:17:51.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.267+0000 7feb07544640 1 -- 172.21.15.27:0/262957581 wait complete. 2024-09-19T08:17:51.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.268+0000 7feb07544640 1 Processor -- start 2024-09-19T08:17:51.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.268+0000 7feb07544640 1 -- start start 2024-09-19T08:17:51.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.268+0000 7feb07544640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb00101e10 0x7feb000744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:51.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.268+0000 7feb07544640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb001027c0 0x7feb00074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:51.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.268+0000 7feb07544640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb00106f40 0x7feb00074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:51.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.268+0000 7feb07544640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7feb00111fa0 con 0x7feb00101e10 2024-09-19T08:17:51.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.268+0000 7feb07544640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feb00111e20 con 0x7feb001027c0 2024-09-19T08:17:51.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.268+0000 7feb07544640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feb00112120 con 0x7feb00106f40 2024-09-19T08:17:51.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.268+0000 7feb052e0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb00101e10 0x7feb000744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:51.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.268+0000 7feb052e0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb00101e10 0x7feb000744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52002/0 (socket says 172.21.15.27:52002) 2024-09-19T08:17:51.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.268+0000 7feb052e0640 1 -- 172.21.15.27:0/3013935327 learned_addr learned my addr 172.21.15.27:0/3013935327 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:51.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.268+0000 7feb05ae1640 1 --2- 172.21.15.27:0/3013935327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb00106f40 0x7feb00074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:51.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.268+0000 7feb04adf640 1 --2- 172.21.15.27:0/3013935327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb001027c0 0x7feb00074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:51.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.269+0000 7feb052e0640 1 -- 172.21.15.27:0/3013935327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb00106f40 msgr2=0x7feb00074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:51.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.269+0000 7feb052e0640 1 --2- 172.21.15.27:0/3013935327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb00106f40 0x7feb00074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.269+0000 7feb052e0640 1 -- 172.21.15.27:0/3013935327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb001027c0 msgr2=0x7feb00074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:51.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.269+0000 7feb052e0640 1 --2- 172.21.15.27:0/3013935327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb001027c0 0x7feb00074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.269+0000 7feb052e0640 1 -- 172.21.15.27:0/3013935327 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb001a68c0 con 0x7feb00101e10 2024-09-19T08:17:51.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.269+0000 7feb052e0640 1 --2- 172.21.15.27:0/3013935327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb00101e10 0x7feb000744f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7feafc00d770 tx=0x7feafc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:51.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.269+0000 7feaf67fc640 1 -- 172.21.15.27:0/3013935327 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feafc017070 con 0x7feb00101e10 2024-09-19T08:17:51.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.269+0000 7feb07544640 1 -- 172.21.15.27:0/3013935327 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb001a6bb0 con 0x7feb00101e10 2024-09-19T08:17:51.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.269+0000 7feaf67fc640 1 -- 172.21.15.27:0/3013935327 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feafc005500 con 0x7feb00101e10 2024-09-19T08:17:51.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.269+0000 7feaf67fc640 1 -- 172.21.15.27:0/3013935327 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feafc004e00 con 0x7feb00101e10 2024-09-19T08:17:51.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.269+0000 7feb07544640 1 -- 172.21.15.27:0/3013935327 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb001a70f0 con 0x7feb00101e10 2024-09-19T08:17:51.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.272+0000 7feb0991d740 1 Processor -- start 2024-09-19T08:17:51.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.272+0000 7feb0991d740 1 -- start start 2024-09-19T08:17:51.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.272+0000 7feb0991d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17dab40 0x558df17d9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:51.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.272+0000 7feb0991d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17d95d0 0x558df17d9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:51.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.272+0000 7feb0991d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 0x558df17e6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:51.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.272+0000 7feb0991d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x558df173f2f0 con 0x558df17d95d0 2024-09-19T08:17:51.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.272+0000 7feb0991d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558df16e6cf0 con 0x558df17e4370 2024-09-19T08:17:51.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.272+0000 7feb0991d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558df173b2b0 con 0x558df17dab40 2024-09-19T08:17:51.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.272+0000 7feaf67fc640 1 -- 172.21.15.27:0/3013935327 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7feafc004fa0 con 0x7feb00101e10 2024-09-19T08:17:51.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.272+0000 7feb05ae1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17dab40 0x558df17d9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:51.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.272+0000 7feb05ae1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17dab40 0x558df17d9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.27:57148/0 (socket says 172.21.15.27:57148) 2024-09-19T08:17:51.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.272+0000 7feb05ae1640 1 -- 172.21.15.27:0/100962541 learned_addr learned my addr 172.21.15.27:0/100962541 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:51.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.272+0000 7feb052e0640 1 --2- 172.21.15.27:0/100962541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17d95d0 0x558df17d9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:51.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.273+0000 7feb04adf640 1 --2- 172.21.15.27:0/100962541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 0x558df17e6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:51.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.273+0000 7feb05ae1640 1 -- 172.21.15.27:0/100962541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 msgr2=0x558df17e6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:51.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.273+0000 7feb05ae1640 1 --2- 172.21.15.27:0/100962541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 0x558df17e6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.273+0000 7feb05ae1640 1 -- 172.21.15.27:0/100962541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17d95d0 msgr2=0x558df17d9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:51.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.273+0000 7feb05ae1640 1 --2- 172.21.15.27:0/100962541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17d95d0 0x558df17d9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.273+0000 7feb05ae1640 1 -- 172.21.15.27:0/100962541 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558df16cb3a0 con 0x558df17dab40 2024-09-19T08:17:51.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.273+0000 7feb04adf640 1 --2- 172.21.15.27:0/100962541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 0x558df17e6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:17:51.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.273+0000 7feb05ae1640 1 --2- 172.21.15.27:0/100962541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17dab40 0x558df17d9090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009ca0 tx=0x7feaf8009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b8271db53f9f279 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:51.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.273+0000 7feaf67fc640 1 --2- 172.21.15.27:0/3013935327 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7feaec0a33b0 0x7feaec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:51.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.273+0000 7feaeb7fe640 1 -- 172.21.15.27:0/100962541 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8031db0 con 0x558df17dab40 2024-09-19T08:17:51.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.273+0000 7feaeb7fe640 1 -- 172.21.15.27:0/100962541 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaf8036040 con 0x558df17dab40 2024-09-19T08:17:51.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.273+0000 7feaeb7fe640 1 -- 172.21.15.27:0/100962541 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8004380 con 0x558df17dab40 2024-09-19T08:17:51.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.274+0000 7feb052e0640 1 --2- 172.21.15.27:0/3013935327 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7feaec0a33b0 0x7feaec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:51.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.274+0000 7feaf67fc640 1 -- 172.21.15.27:0/3013935327 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7feafc0cf6a0 con 0x7feb00101e10 2024-09-19T08:17:51.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.274+0000 7feb0991d740 1 -- 172.21.15.27:0/100962541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17dab40 msgr2=0x558df17d9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:51.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.274+0000 7feb052e0640 1 --2- 172.21.15.27:0/3013935327 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7feaec0a33b0 0x7feaec0a5870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feafc0ccef0 tx=0x7feafc086040 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:51.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.274+0000 7feb0991d740 1 --2- 172.21.15.27:0/100962541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17dab40 0x558df17d9090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009ca0 tx=0x7feaf8009800 comp rx=0 tx=0).stop 2024-09-19T08:17:51.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.274+0000 7feb0991d740 1 -- 172.21.15.27:0/100962541 shutdown_connections 2024-09-19T08:17:51.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.274+0000 7feb0991d740 1 --2- 172.21.15.27:0/100962541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 0x558df17e6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.274+0000 7feb0991d740 1 --2- 172.21.15.27:0/100962541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17d95d0 0x558df17d9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.274+0000 7feb0991d740 1 --2- 172.21.15.27:0/100962541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17dab40 0x558df17d9090 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.274+0000 7feb0991d740 1 -- 172.21.15.27:0/100962541 >> 172.21.15.27:0/100962541 conn(0x558df17a2310 msgr2=0x558df17d5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:51.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.274+0000 7feb0991d740 1 -- 172.21.15.27:0/100962541 shutdown_connections 2024-09-19T08:17:51.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.274+0000 7feb0991d740 1 -- 172.21.15.27:0/100962541 wait complete. 2024-09-19T08:17:51.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.275+0000 7feb0991d740 1 -- start start 2024-09-19T08:17:51.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.275+0000 7feb0991d740 1 Processor -- start 2024-09-19T08:17:51.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.275+0000 7feb0991d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17d95d0 0x558df17e3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:51.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.275+0000 7feb0991d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17dab40 0x558df17e0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:51.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.275+0000 7feb0991d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 0x558df17e14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:51.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.275+0000 7feb0991d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x558df17e6e90 con 0x558df17dab40 2024-09-19T08:17:51.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.275+0000 7feb0991d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558df16fa060 con 0x558df17e4370 2024-09-19T08:17:51.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.275+0000 7feb0991d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558df17e7010 con 0x558df17d95d0 2024-09-19T08:17:51.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.275+0000 7feb0991d740 10 client.0 _ll_register_callbacks cb 0x558df144d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:51.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.275+0000 7feb04adf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17dab40 0x558df17e0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:51.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.276+0000 7feb04adf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17dab40 0x558df17e0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52012/0 (socket says 172.21.15.27:52012) 2024-09-19T08:17:51.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.276+0000 7feb04adf640 1 -- 172.21.15.27:0/3744051298 learned_addr learned my addr 172.21.15.27:0/3744051298 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:51.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.276+0000 7feb05ae1640 1 --2- 172.21.15.27:0/3744051298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 0x558df17e14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:51.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.276+0000 7feb05ae1640 1 --2- 172.21.15.27:0/3744051298 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17d95d0 0x558df17e3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:51.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.276+0000 7feb04adf640 1 -- 172.21.15.27:0/3744051298 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17d95d0 msgr2=0x558df17e3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:51.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.276+0000 7feb04adf640 1 --2- 172.21.15.27:0/3744051298 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17d95d0 0x558df17e3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.276+0000 7feb04adf640 1 -- 172.21.15.27:0/3744051298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 msgr2=0x558df17e14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:51.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.276+0000 7feb04adf640 1 --2- 172.21.15.27:0/3744051298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 0x558df17e14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.276+0000 7feb04adf640 1 -- 172.21.15.27:0/3744051298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558df14b03c0 con 0x558df17dab40 2024-09-19T08:17:51.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.276+0000 7feb04adf640 1 --2- 172.21.15.27:0/3744051298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17dab40 0x558df17e0f90 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7feaf0012700 tx=0x7feaf0012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91165673deb4b9e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:51.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.276+0000 7feae8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:51.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.276+0000 7feae8ff9640 1 -- 172.21.15.27:0/3744051298 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf000f8c0 con 0x558df17dab40 2024-09-19T08:17:51.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.276+0000 7feae8ff9640 1 -- 172.21.15.27:0/3744051298 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7feaf000fa60 con 0x558df17dab40 2024-09-19T08:17:51.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.276+0000 7feb0991d740 1 -- 172.21.15.27:0/3744051298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feaf8036040 con 0x558df17dab40 2024-09-19T08:17:51.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.277+0000 7feae8ff9640 1 -- 172.21.15.27:0/3744051298 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7feaf000fca0 con 0x558df17dab40 2024-09-19T08:17:51.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.277+0000 7feb0991d740 10 client.16458 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:51.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.277+0000 7feb0991d740 1 -- 172.21.15.27:0/3744051298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558df17f2950 con 0x558df17dab40 2024-09-19T08:17:51.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.277+0000 7feae8ff9640 1 -- 172.21.15.27:0/3744051298 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaf8036040 con 0x558df17dab40 2024-09-19T08:17:51.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.277+0000 7feae8ff9640 1 -- 172.21.15.27:0/3744051298 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7feaf001c570 con 0x558df17dab40 2024-09-19T08:17:51.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.277+0000 7feb0991d740 10 client.16458 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:51.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.277+0000 7feb0991d740 10 client.16458 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:51.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.277+0000 7feb0991d740 20 client.16458 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:51.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.277+0000 7feb0991d740 1 --2- 172.21.15.27:0/3744051298 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558df17f3db0 0x558df17f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:51.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.277+0000 7feb0991d740 4 client.16458 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:17:51.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.277+0000 7feb0991d740 1 -- 172.21.15.27:0/3744051298 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558df174c860 con 0x558df17f3db0 2024-09-19T08:17:51.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.278+0000 7feb05ae1640 1 --2- 172.21.15.27:0/3744051298 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558df17f3db0 0x558df17f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:51.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.278+0000 7feb05ae1640 1 --2- 172.21.15.27:0/3744051298 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558df17f3db0 0x558df17f61d0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f95e55f5db458d09 server_cookie=c3cca976d3e3f915 in_seq=0 out_seq=0 2024-09-19T08:17:51.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.278+0000 7feae8ff9640 10 client.16458 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:51.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.279+0000 7feae8ff9640 1 -- 172.21.15.27:0/3744051298 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558df174c860 con 0x558df17f3db0 2024-09-19T08:17:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.279+0000 7feae8ff9640 10 client.16458 handle_command_reply: tid=0 2024-09-19T08:17:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.279+0000 7feb0991d740 1 client.16458 shutdown 2024-09-19T08:17:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.279+0000 7feb0991d740 1 -- 172.21.15.27:0/3744051298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17dab40 msgr2=0x558df17e0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.279+0000 7feb0991d740 1 --2- 172.21.15.27:0/3744051298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17dab40 0x558df17e0f90 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7feaf0012700 tx=0x7feaf0012bc0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.279+0000 7feb0991d740 1 -- 172.21.15.27:0/3744051298 shutdown_connections 2024-09-19T08:17:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.279+0000 7feb0991d740 1 --2- 172.21.15.27:0/3744051298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 0x558df17e14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.279+0000 7feb0991d740 1 --2- 172.21.15.27:0/3744051298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17dab40 0x558df17e0f90 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.279+0000 7feb0991d740 1 --2- 172.21.15.27:0/3744051298 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558df17f3db0 0x558df17f61d0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.279+0000 7feb0991d740 1 --2- 172.21.15.27:0/3744051298 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17d95d0 0x558df17e3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.279+0000 7feb0991d740 1 -- 172.21.15.27:0/3744051298 >> 172.21.15.27:0/3744051298 conn(0x558df17a2310 msgr2=0x558df17db960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.279+0000 7feae8ff9640 0 client.16458 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.279+0000 7feb0991d740 1 -- 172.21.15.27:0/3744051298 shutdown_connections 2024-09-19T08:17:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.279+0000 7feb0991d740 1 -- 172.21.15.27:0/3744051298 wait complete. 2024-09-19T08:17:51.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.279+0000 7feb0991d740 20 client.16458 trim_cache size 0 max 16384 2024-09-19T08:17:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.292+0000 7feb0991d740 1 Processor -- start 2024-09-19T08:17:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.292+0000 7feb0991d740 1 -- start start 2024-09-19T08:17:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.293+0000 7feb0991d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17d95d0 0x558df17f0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.293+0000 7feb0991d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17dab40 0x558df17fba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.293+0000 7feb0991d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 0x558df17fbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.293+0000 7feb0991d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7feb001ad880 con 0x558df17dab40 2024-09-19T08:17:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.293+0000 7feb0991d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feb001b0100 con 0x558df17e4370 2024-09-19T08:17:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.293+0000 7feb0991d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feb001adef0 con 0x558df17d95d0 2024-09-19T08:17:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.293+0000 7feb04adf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17dab40 0x558df17fba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.293+0000 7feb04adf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17dab40 0x558df17fba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52018/0 (socket says 172.21.15.27:52018) 2024-09-19T08:17:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.293+0000 7feb04adf640 1 -- 172.21.15.27:0/657484357 learned_addr learned my addr 172.21.15.27:0/657484357 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.293+0000 7feb05ae1640 1 --2- 172.21.15.27:0/657484357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 0x558df17fbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.293+0000 7feb05ae1640 1 --2- 172.21.15.27:0/657484357 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17d95d0 0x558df17f0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.293+0000 7feb04adf640 1 -- 172.21.15.27:0/657484357 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17d95d0 msgr2=0x558df17f0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.293+0000 7feb04adf640 1 --2- 172.21.15.27:0/657484357 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17d95d0 0x558df17f0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.293+0000 7feb04adf640 1 -- 172.21.15.27:0/657484357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 msgr2=0x558df17fbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.293+0000 7feb04adf640 1 --2- 172.21.15.27:0/657484357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 0x558df17fbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.293+0000 7feb04adf640 1 -- 172.21.15.27:0/657484357 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558df17d6960 con 0x558df17dab40 2024-09-19T08:17:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.293+0000 7feb05ae1640 1 --2- 172.21.15.27:0/657484357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 0x558df17fbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:17:51.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.293+0000 7feb04adf640 1 --2- 172.21.15.27:0/657484357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17dab40 0x558df17fba80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7feaf00059f0 tx=0x7feaf0009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d981d71650afde9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:51.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.294+0000 7feaeaffd640 1 -- 172.21.15.27:0/657484357 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf001cc40 con 0x558df17dab40 2024-09-19T08:17:51.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.294+0000 7feaeaffd640 1 -- 172.21.15.27:0/657484357 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaf002b070 con 0x558df17dab40 2024-09-19T08:17:51.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.294+0000 7feaeaffd640 1 -- 172.21.15.27:0/657484357 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf00055d0 con 0x558df17dab40 2024-09-19T08:17:51.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.295+0000 7feb0991d740 1 -- 172.21.15.27:0/657484357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17dab40 msgr2=0x558df17fba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:51.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.295+0000 7feb0991d740 1 --2- 172.21.15.27:0/657484357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17dab40 0x558df17fba80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7feaf00059f0 tx=0x7feaf0009850 comp rx=0 tx=0).stop 2024-09-19T08:17:51.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.295+0000 7feb0991d740 1 -- 172.21.15.27:0/657484357 shutdown_connections 2024-09-19T08:17:51.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.295+0000 7feb0991d740 1 --2- 172.21.15.27:0/657484357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 0x558df17fbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.295+0000 7feb0991d740 1 --2- 172.21.15.27:0/657484357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17dab40 0x558df17fba80 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.295+0000 7feb0991d740 1 --2- 172.21.15.27:0/657484357 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17d95d0 0x558df17f0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.295+0000 7feb0991d740 1 -- 172.21.15.27:0/657484357 >> 172.21.15.27:0/657484357 conn(0x558df17a2310 msgr2=0x558df17e0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:51.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.295+0000 7feb0991d740 1 -- 172.21.15.27:0/657484357 shutdown_connections 2024-09-19T08:17:51.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.295+0000 7feb0991d740 1 -- 172.21.15.27:0/657484357 wait complete. 2024-09-19T08:17:51.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.295+0000 7feb0991d740 1 -- start start 2024-09-19T08:17:51.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.295+0000 7feb0991d740 1 Processor -- start 2024-09-19T08:17:51.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.296+0000 7feb0991d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17d95d0 0x558df17de110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:51.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.296+0000 7feb0991d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17dab40 0x558df17de650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:51.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.296+0000 7feb0991d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 0x558df17deb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:51.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.296+0000 7feb0991d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7feb001ae5c0 con 0x558df17d95d0 2024-09-19T08:17:51.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.296+0000 7feb0991d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feb001afa30 con 0x558df17e4370 2024-09-19T08:17:51.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.296+0000 7feb0991d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feb001aec90 con 0x558df17dab40 2024-09-19T08:17:51.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.296+0000 7feb0991d740 10 client.0 _ll_register_callbacks cb 0x7feaf0009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:51.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.296+0000 7feb05ae1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17d95d0 0x558df17de110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:51.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.296+0000 7feb05ae1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17d95d0 0x558df17de110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52032/0 (socket says 172.21.15.27:52032) 2024-09-19T08:17:51.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.296+0000 7feb05ae1640 1 -- 172.21.15.27:0/1832074197 learned_addr learned my addr 172.21.15.27:0/1832074197 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:51.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.296+0000 7feb05ae1640 1 --2- 172.21.15.27:0/1832074197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 0x558df17deb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:51.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.296+0000 7feb04adf640 1 --2- 172.21.15.27:0/1832074197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17dab40 0x558df17de650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:51.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.296+0000 7feb05ae1640 1 -- 172.21.15.27:0/1832074197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17dab40 msgr2=0x558df17de650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:51.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.296+0000 7feb05ae1640 1 --2- 172.21.15.27:0/1832074197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17dab40 0x558df17de650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.296+0000 7feb05ae1640 1 -- 172.21.15.27:0/1832074197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 msgr2=0x558df17deb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:51.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.296+0000 7feb05ae1640 1 --2- 172.21.15.27:0/1832074197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 0x558df17deb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.296+0000 7feb05ae1640 1 -- 172.21.15.27:0/1832074197 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558df17e1860 con 0x558df17d95d0 2024-09-19T08:17:51.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.297+0000 7feb05ae1640 1 --2- 172.21.15.27:0/1832074197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17d95d0 0x558df17de110 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x558df17da020 tx=0x7feaf0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599954405c70bea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:51.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.297+0000 7feae8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:51.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.297+0000 7feae8ff9640 1 -- 172.21.15.27:0/1832074197 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8003a30 con 0x558df17d95d0 2024-09-19T08:17:51.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.297+0000 7feae8ff9640 1 -- 172.21.15.27:0/1832074197 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7feaf8003bd0 con 0x558df17d95d0 2024-09-19T08:17:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.297+0000 7feb0991d740 1 -- 172.21.15.27:0/1832074197 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feaf002b070 con 0x558df17d95d0 2024-09-19T08:17:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.297+0000 7feae8ff9640 1 -- 172.21.15.27:0/1832074197 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7feaf8003dd0 con 0x558df17d95d0 2024-09-19T08:17:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.297+0000 7feb0991d740 10 client.16464 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.297+0000 7feb0991d740 1 -- 172.21.15.27:0/1832074197 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558df185ecc0 con 0x558df17d95d0 2024-09-19T08:17:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.297+0000 7feae8ff9640 1 -- 172.21.15.27:0/1832074197 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaf002b070 con 0x558df17d95d0 2024-09-19T08:17:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.297+0000 7feae8ff9640 1 -- 172.21.15.27:0/1832074197 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7feaf8050040 con 0x558df17d95d0 2024-09-19T08:17:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.297+0000 7feb0991d740 10 client.16464 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.297+0000 7feb0991d740 10 client.16464 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.297+0000 7feb0991d740 20 client.16464 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.297+0000 7feb0991d740 1 --2- 172.21.15.27:0/1832074197 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558df185f100 0x558df1861520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.297+0000 7feb0991d740 4 client.16464 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:17:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.297+0000 7feb0991d740 1 -- 172.21.15.27:0/1832074197 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558df1746d70 con 0x558df185f100 2024-09-19T08:17:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.298+0000 7feb04adf640 1 --2- 172.21.15.27:0/1832074197 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558df185f100 0x558df1861520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.298+0000 7feb04adf640 1 --2- 172.21.15.27:0/1832074197 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558df185f100 0x558df1861520 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87452f32012890c0 server_cookie=c59599c82af326f9 in_seq=0 out_seq=0 2024-09-19T08:17:51.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.298+0000 7feae8ff9640 10 client.16464 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:51.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.298+0000 7feae8ff9640 1 -- 172.21.15.27:0/1832074197 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558df1746d70 con 0x558df185f100 2024-09-19T08:17:51.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.298+0000 7feae8ff9640 10 client.16464 handle_command_reply: tid=0 2024-09-19T08:17:51.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.298+0000 7feb0991d740 1 client.16464 shutdown 2024-09-19T08:17:51.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.298+0000 7feb0991d740 1 -- 172.21.15.27:0/1832074197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17d95d0 msgr2=0x558df17de110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:51.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.298+0000 7feb0991d740 1 --2- 172.21.15.27:0/1832074197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17d95d0 0x558df17de110 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x558df17da020 tx=0x7feaf0009e30 comp rx=0 tx=0).stop 2024-09-19T08:17:51.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.299+0000 7feb0991d740 1 -- 172.21.15.27:0/1832074197 shutdown_connections 2024-09-19T08:17:51.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.299+0000 7feb0991d740 1 --2- 172.21.15.27:0/1832074197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558df17e4370 0x558df17deb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.299+0000 7feb0991d740 1 --2- 172.21.15.27:0/1832074197 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558df185f100 0x558df1861520 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.299+0000 7feb0991d740 1 --2- 172.21.15.27:0/1832074197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558df17dab40 0x558df17de650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.299+0000 7feb0991d740 1 --2- 172.21.15.27:0/1832074197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558df17d95d0 0x558df17de110 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.299+0000 7feb0991d740 1 -- 172.21.15.27:0/1832074197 >> 172.21.15.27:0/1832074197 conn(0x558df17a2310 msgr2=0x558df17e27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:51.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.299+0000 7feae8ff9640 0 client.16464 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:51.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.299+0000 7feb0991d740 1 -- 172.21.15.27:0/1832074197 shutdown_connections 2024-09-19T08:17:51.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.299+0000 7feb0991d740 1 -- 172.21.15.27:0/1832074197 wait complete. 2024-09-19T08:17:51.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.299+0000 7feb0991d740 20 client.16464 trim_cache size 0 max 16384 2024-09-19T08:17:51.304 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:17:51.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.299+0000 7feb07544640 1 -- 172.21.15.27:0/3013935327 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7feaec0a33b0 msgr2=0x7feaec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:51.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.299+0000 7feb07544640 1 --2- 172.21.15.27:0/3013935327 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7feaec0a33b0 0x7feaec0a5870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feafc0ccef0 tx=0x7feafc086040 comp rx=0 tx=0).stop 2024-09-19T08:17:51.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.299+0000 7feb07544640 1 -- 172.21.15.27:0/3013935327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb00101e10 msgr2=0x7feb000744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:51.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.299+0000 7feb07544640 1 --2- 172.21.15.27:0/3013935327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb00101e10 0x7feb000744f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7feafc00d770 tx=0x7feafc00dc30 comp rx=0 tx=0).stop 2024-09-19T08:17:51.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.300+0000 7feb07544640 1 -- 172.21.15.27:0/3013935327 shutdown_connections 2024-09-19T08:17:51.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.300+0000 7feb07544640 1 --2- 172.21.15.27:0/3013935327 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7feaec0a33b0 0x7feaec0a5870 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.300+0000 7feb07544640 1 --2- 172.21.15.27:0/3013935327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb00106f40 0x7feb00074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.300+0000 7feb07544640 1 --2- 172.21.15.27:0/3013935327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb001027c0 0x7feb00074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.300+0000 7feb07544640 1 --2- 172.21.15.27:0/3013935327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb00101e10 0x7feb000744f0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:51.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.300+0000 7feb07544640 1 -- 172.21.15.27:0/3013935327 >> 172.21.15.27:0/3013935327 conn(0x7feb000fd8d0 msgr2=0x7feb000fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:51.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.300+0000 7feb07544640 1 -- 172.21.15.27:0/3013935327 shutdown_connections 2024-09-19T08:17:51.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:51.300+0000 7feb07544640 1 -- 172.21.15.27:0/3013935327 wait complete. 2024-09-19T08:17:53.115 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:17:53.115 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:17:53.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:52 smithi155 ceph-mon[35362]: pgmap v208: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:17:53.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:52 smithi027 ceph-mon[31209]: pgmap v208: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:17:53.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:52 smithi203 ceph-mon[35198]: pgmap v208: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:17:53.386 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:17:53.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.868+0000 7fb45ed08640 1 -- 172.21.15.27:0/373250148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4581082a0 msgr2=0x7fb45810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:53.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.868+0000 7fb45ed08640 1 --2- 172.21.15.27:0/373250148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4581082a0 0x7fb45810ec40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb448009930 tx=0x7fb44802a420 comp rx=0 tx=0).stop 2024-09-19T08:17:53.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.868+0000 7fb45ed08640 1 -- 172.21.15.27:0/373250148 shutdown_connections 2024-09-19T08:17:53.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.868+0000 7fb45ed08640 1 --2- 172.21.15.27:0/373250148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4581082a0 0x7fb45810ec40 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.868+0000 7fb45ed08640 1 --2- 172.21.15.27:0/373250148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4581036e0 0x7fb458107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.868+0000 7fb45ed08640 1 --2- 172.21.15.27:0/373250148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb458102d30 0x7fb458103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.868+0000 7fb45ed08640 1 -- 172.21.15.27:0/373250148 >> 172.21.15.27:0/373250148 conn(0x7fb4580fc7d0 msgr2=0x7fb4580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:53.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.868+0000 7fb45ed08640 1 -- 172.21.15.27:0/373250148 shutdown_connections 2024-09-19T08:17:53.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.868+0000 7fb45ed08640 1 -- 172.21.15.27:0/373250148 wait complete. 2024-09-19T08:17:53.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.868+0000 7fb45ed08640 1 Processor -- start 2024-09-19T08:17:53.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.868+0000 7fb45ed08640 1 -- start start 2024-09-19T08:17:53.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.869+0000 7fb45ed08640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb458102d30 0x7fb458198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:53.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.869+0000 7fb45ed08640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4581036e0 0x7fb4581989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:53.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.869+0000 7fb45ed08640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4581082a0 0x7fb45819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:53.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.869+0000 7fb45ed08640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581120a0 con 0x7fb4581036e0 2024-09-19T08:17:53.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.869+0000 7fb45ed08640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb458111f20 con 0x7fb458102d30 2024-09-19T08:17:53.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.869+0000 7fb45ed08640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb458112220 con 0x7fb4581082a0 2024-09-19T08:17:53.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.869+0000 7fb457fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4581036e0 0x7fb4581989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:53.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.869+0000 7fb457fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4581036e0 0x7fb4581989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52050/0 (socket says 172.21.15.27:52050) 2024-09-19T08:17:53.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.869+0000 7fb457fff640 1 -- 172.21.15.27:0/3924898300 learned_addr learned my addr 172.21.15.27:0/3924898300 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:53.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.869+0000 7fb45caa4640 1 --2- 172.21.15.27:0/3924898300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb458102d30 0x7fb458198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:53.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.869+0000 7fb45d2a5640 1 --2- 172.21.15.27:0/3924898300 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4581082a0 0x7fb45819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:53.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.869+0000 7fb457fff640 1 -- 172.21.15.27:0/3924898300 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4581082a0 msgr2=0x7fb45819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:53.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.869+0000 7fb457fff640 1 --2- 172.21.15.27:0/3924898300 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4581082a0 0x7fb45819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.869+0000 7fb457fff640 1 -- 172.21.15.27:0/3924898300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb458102d30 msgr2=0x7fb458198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:53.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.869+0000 7fb457fff640 1 --2- 172.21.15.27:0/3924898300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb458102d30 0x7fb458198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.869+0000 7fb457fff640 1 -- 172.21.15.27:0/3924898300 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45819d430 con 0x7fb4581036e0 2024-09-19T08:17:53.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.869+0000 7fb45caa4640 1 --2- 172.21.15.27:0/3924898300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb458102d30 0x7fb458198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:17:53.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.869+0000 7fb457fff640 1 --2- 172.21.15.27:0/3924898300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4581036e0 0x7fb4581989c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00d740 tx=0x7fb44c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:53.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.870+0000 7fb455ffb640 1 -- 172.21.15.27:0/3924898300 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c017070 con 0x7fb4581036e0 2024-09-19T08:17:53.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.870+0000 7fb455ffb640 1 -- 172.21.15.27:0/3924898300 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb44c00de50 con 0x7fb4581036e0 2024-09-19T08:17:53.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.870+0000 7fb45ed08640 1 -- 172.21.15.27:0/3924898300 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb45819d720 con 0x7fb4581036e0 2024-09-19T08:17:53.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.870+0000 7fb455ffb640 1 -- 172.21.15.27:0/3924898300 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c00f6b0 con 0x7fb4581036e0 2024-09-19T08:17:53.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.870+0000 7fb45ed08640 1 -- 172.21.15.27:0/3924898300 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4581a5000 con 0x7fb4581036e0 2024-09-19T08:17:53.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.873+0000 7fb4610e1740 1 Processor -- start 2024-09-19T08:17:53.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.873+0000 7fb455ffb640 1 -- 172.21.15.27:0/3924898300 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fb44c01a070 con 0x7fb4581036e0 2024-09-19T08:17:53.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.873+0000 7fb4610e1740 1 -- start start 2024-09-19T08:17:53.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.873+0000 7fb4610e1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c8cb60 0x559716c8cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:53.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.873+0000 7fb4610e1740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8d480 0x559716c97800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:53.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.873+0000 7fb4610e1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c97d40 0x559716c9a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:53.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.873+0000 7fb4610e1740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559716bf2280 con 0x559716c8d480 2024-09-19T08:17:53.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.873+0000 7fb4610e1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559716b99b10 con 0x559716c8cb60 2024-09-19T08:17:53.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.873+0000 7fb4610e1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559716bee240 con 0x559716c97d40 2024-09-19T08:17:53.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.873+0000 7fb45caa4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8d480 0x559716c97800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:53.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.874+0000 7fb45caa4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8d480 0x559716c97800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52062/0 (socket says 172.21.15.27:52062) 2024-09-19T08:17:53.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.874+0000 7fb45caa4640 1 -- 172.21.15.27:0/37288062 learned_addr learned my addr 172.21.15.27:0/37288062 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:53.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.874+0000 7fb45d2a5640 1 --2- 172.21.15.27:0/37288062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c8cb60 0x559716c8cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:53.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.874+0000 7fb457fff640 1 --2- 172.21.15.27:0/37288062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c97d40 0x559716c9a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:53.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.874+0000 7fb45caa4640 1 -- 172.21.15.27:0/37288062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c97d40 msgr2=0x559716c9a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:53.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.874+0000 7fb45caa4640 1 --2- 172.21.15.27:0/37288062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c97d40 0x559716c9a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.874+0000 7fb455ffb640 1 --2- 172.21.15.27:0/3924898300 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb4400a33b0 0x7fb4400a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:53.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.874+0000 7fb45caa4640 1 -- 172.21.15.27:0/37288062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c8cb60 msgr2=0x559716c8cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:53.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.874+0000 7fb45caa4640 1 --2- 172.21.15.27:0/37288062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c8cb60 0x559716c8cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.874+0000 7fb45caa4640 1 -- 172.21.15.27:0/37288062 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559716ba61f0 con 0x559716c8d480 2024-09-19T08:17:53.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.874+0000 7fb45d2a5640 1 --2- 172.21.15.27:0/37288062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c8cb60 0x559716c8cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:17:53.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.874+0000 7fb45d2a5640 1 --2- 172.21.15.27:0/3924898300 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb4400a33b0 0x7fb4400a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:53.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.874+0000 7fb455ffb640 1 -- 172.21.15.27:0/3924898300 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fb44c0cf730 con 0x7fb4581036e0 2024-09-19T08:17:53.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.874+0000 7fb45caa4640 1 --2- 172.21.15.27:0/37288062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8d480 0x559716c97800 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb450007f70 tx=0x7fb45000e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38888c2cb734494c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:53.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.874+0000 7fb43effd640 1 -- 172.21.15.27:0/37288062 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450014070 con 0x559716c8d480 2024-09-19T08:17:53.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.874+0000 7fb43effd640 1 -- 172.21.15.27:0/37288062 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb450004d20 con 0x559716c8d480 2024-09-19T08:17:53.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.874+0000 7fb43effd640 1 -- 172.21.15.27:0/37288062 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450005550 con 0x559716c8d480 2024-09-19T08:17:53.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.875+0000 7fb4610e1740 1 -- 172.21.15.27:0/37288062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8d480 msgr2=0x559716c97800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:53.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.875+0000 7fb45d2a5640 1 --2- 172.21.15.27:0/3924898300 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb4400a33b0 0x7fb4400a5870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb448005940 tx=0x7fb448009260 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:53.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.875+0000 7fb4610e1740 1 --2- 172.21.15.27:0/37288062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8d480 0x559716c97800 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb450007f70 tx=0x7fb45000e7e0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.875+0000 7fb4610e1740 1 -- 172.21.15.27:0/37288062 shutdown_connections 2024-09-19T08:17:53.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.875+0000 7fb4610e1740 1 --2- 172.21.15.27:0/37288062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c97d40 0x559716c9a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.875+0000 7fb4610e1740 1 --2- 172.21.15.27:0/37288062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8d480 0x559716c97800 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.875+0000 7fb4610e1740 1 --2- 172.21.15.27:0/37288062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c8cb60 0x559716c8cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.875+0000 7fb4610e1740 1 -- 172.21.15.27:0/37288062 >> 172.21.15.27:0/37288062 conn(0x559716c890f0 msgr2=0x559716c894d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:53.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.875+0000 7fb4610e1740 1 -- 172.21.15.27:0/37288062 shutdown_connections 2024-09-19T08:17:53.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.875+0000 7fb4610e1740 1 -- 172.21.15.27:0/37288062 wait complete. 2024-09-19T08:17:53.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.875+0000 7fb4610e1740 1 -- start start 2024-09-19T08:17:53.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.876+0000 7fb4610e1740 1 Processor -- start 2024-09-19T08:17:53.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.876+0000 7fb4610e1740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8cb60 0x559716c94c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:53.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.876+0000 7fb4610e1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c8d480 0x559716c95180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:53.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.876+0000 7fb4610e1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c97d40 0x559716c956c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:53.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.876+0000 7fb4610e1740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559716c9a910 con 0x559716c8cb60 2024-09-19T08:17:53.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.876+0000 7fb4610e1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559716bacf10 con 0x559716c8d480 2024-09-19T08:17:53.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.876+0000 7fb4610e1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559716c9aa90 con 0x559716c97d40 2024-09-19T08:17:53.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.876+0000 7fb4610e1740 10 client.0 _ll_register_callbacks cb 0x559716b75a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:53.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.876+0000 7fb45caa4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8cb60 0x559716c94c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:53.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.876+0000 7fb45caa4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8cb60 0x559716c94c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52070/0 (socket says 172.21.15.27:52070) 2024-09-19T08:17:53.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.876+0000 7fb45caa4640 1 -- 172.21.15.27:0/4096426719 learned_addr learned my addr 172.21.15.27:0/4096426719 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:53.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.876+0000 7fb457fff640 1 --2- 172.21.15.27:0/4096426719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c8d480 0x559716c95180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:53.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.876+0000 7fb45d2a5640 1 --2- 172.21.15.27:0/4096426719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c97d40 0x559716c956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:53.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.877+0000 7fb45caa4640 1 -- 172.21.15.27:0/4096426719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c97d40 msgr2=0x559716c956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:53.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.877+0000 7fb45caa4640 1 --2- 172.21.15.27:0/4096426719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c97d40 0x559716c956c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.877+0000 7fb45caa4640 1 -- 172.21.15.27:0/4096426719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c8d480 msgr2=0x559716c95180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:53.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.877+0000 7fb45caa4640 1 --2- 172.21.15.27:0/4096426719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c8d480 0x559716c95180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.877+0000 7fb45caa4640 1 -- 172.21.15.27:0/4096426719 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597169636a0 con 0x559716c8cb60 2024-09-19T08:17:53.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.877+0000 7fb45d2a5640 1 --2- 172.21.15.27:0/4096426719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c97d40 0x559716c956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:17:53.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.877+0000 7fb45caa4640 1 --2- 172.21.15.27:0/4096426719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8cb60 0x559716c94c40 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fb450000f80 tx=0x7fb450004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ef9a867f56268a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:53.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.877+0000 7fb437fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:53.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.877+0000 7fb437fff640 1 -- 172.21.15.27:0/4096426719 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450027060 con 0x559716c8cb60 2024-09-19T08:17:53.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.877+0000 7fb4610e1740 1 -- 172.21.15.27:0/4096426719 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb450004d20 con 0x559716c8cb60 2024-09-19T08:17:53.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.877+0000 7fb437fff640 1 -- 172.21.15.27:0/4096426719 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fb450010640 con 0x559716c8cb60 2024-09-19T08:17:53.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.877+0000 7fb437fff640 1 -- 172.21.15.27:0/4096426719 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb450014070 con 0x559716c8cb60 2024-09-19T08:17:53.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.877+0000 7fb4610e1740 10 client.16476 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:53.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.877+0000 7fb4610e1740 1 -- 172.21.15.27:0/4096426719 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559716ca64b0 con 0x559716c8cb60 2024-09-19T08:17:53.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.877+0000 7fb437fff640 1 -- 172.21.15.27:0/4096426719 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb450004d20 con 0x559716c8cb60 2024-09-19T08:17:53.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.878+0000 7fb437fff640 1 -- 172.21.15.27:0/4096426719 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb45002c830 con 0x559716c8cb60 2024-09-19T08:17:53.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.878+0000 7fb4610e1740 10 client.16476 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:53.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.878+0000 7fb4610e1740 10 client.16476 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:53.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.878+0000 7fb4610e1740 20 client.16476 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:53.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.878+0000 7fb4610e1740 1 --2- 172.21.15.27:0/4096426719 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559716ca7970 0x559716ca9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:53.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.878+0000 7fb4610e1740 4 client.16476 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:17:53.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.878+0000 7fb4610e1740 1 -- 172.21.15.27:0/4096426719 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559716bff7f0 con 0x559716ca7970 2024-09-19T08:17:53.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.878+0000 7fb457fff640 1 --2- 172.21.15.27:0/4096426719 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559716ca7970 0x559716ca9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:53.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.878+0000 7fb437fff640 10 client.16476 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:53.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.878+0000 7fb457fff640 1 --2- 172.21.15.27:0/4096426719 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559716ca7970 0x559716ca9d60 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc1bae2b0a232792 server_cookie=a5fbd4ccd8b2e00f in_seq=0 out_seq=0 2024-09-19T08:17:53.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.879+0000 7fb437fff640 1 -- 172.21.15.27:0/4096426719 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559716bff7f0 con 0x559716ca7970 2024-09-19T08:17:53.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.879+0000 7fb437fff640 10 client.16476 handle_command_reply: tid=0 2024-09-19T08:17:53.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.879+0000 7fb4610e1740 1 client.16476 shutdown 2024-09-19T08:17:53.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.879+0000 7fb4610e1740 1 -- 172.21.15.27:0/4096426719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8cb60 msgr2=0x559716c94c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:53.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.879+0000 7fb4610e1740 1 --2- 172.21.15.27:0/4096426719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8cb60 0x559716c94c40 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fb450000f80 tx=0x7fb450004ed0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.879+0000 7fb4610e1740 1 -- 172.21.15.27:0/4096426719 shutdown_connections 2024-09-19T08:17:53.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.879+0000 7fb4610e1740 1 --2- 172.21.15.27:0/4096426719 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559716ca7970 0x559716ca9d60 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.879+0000 7fb4610e1740 1 --2- 172.21.15.27:0/4096426719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c97d40 0x559716c956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.879+0000 7fb4610e1740 1 --2- 172.21.15.27:0/4096426719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c8d480 0x559716c95180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.879+0000 7fb4610e1740 1 --2- 172.21.15.27:0/4096426719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8cb60 0x559716c94c40 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.879+0000 7fb437fff640 0 client.16476 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:53.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.879+0000 7fb4610e1740 1 -- 172.21.15.27:0/4096426719 >> 172.21.15.27:0/4096426719 conn(0x559716c890f0 msgr2=0x559716c8ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:53.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.880+0000 7fb4610e1740 1 -- 172.21.15.27:0/4096426719 shutdown_connections 2024-09-19T08:17:53.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.880+0000 7fb4610e1740 1 -- 172.21.15.27:0/4096426719 wait complete. 2024-09-19T08:17:53.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.880+0000 7fb4610e1740 20 client.16476 trim_cache size 0 max 16384 2024-09-19T08:17:53.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.897+0000 7fb4610e1740 1 Processor -- start 2024-09-19T08:17:53.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.897+0000 7fb4610e1740 1 -- start start 2024-09-19T08:17:53.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.897+0000 7fb4610e1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c8cb60 0x559716c8f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:53.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.897+0000 7fb4610e1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c8d480 0x559716c93af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:53.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.897+0000 7fb4610e1740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c97d40 0x559716caf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:53.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.897+0000 7fb4610e1740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581ab710 con 0x559716c97d40 2024-09-19T08:17:53.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.897+0000 7fb4610e1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581adf90 con 0x559716c8d480 2024-09-19T08:17:53.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.897+0000 7fb4610e1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581abd80 con 0x559716c8cb60 2024-09-19T08:17:53.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.897+0000 7fb45d2a5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c97d40 0x559716caf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:53.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.897+0000 7fb45d2a5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c97d40 0x559716caf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52078/0 (socket says 172.21.15.27:52078) 2024-09-19T08:17:53.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.897+0000 7fb45d2a5640 1 -- 172.21.15.27:0/1222134215 learned_addr learned my addr 172.21.15.27:0/1222134215 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:53.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.898+0000 7fb45caa4640 1 --2- 172.21.15.27:0/1222134215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c8cb60 0x559716c8f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:53.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.898+0000 7fb457fff640 1 --2- 172.21.15.27:0/1222134215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c8d480 0x559716c93af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:53.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.898+0000 7fb45d2a5640 1 -- 172.21.15.27:0/1222134215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c8cb60 msgr2=0x559716c8f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:53.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.898+0000 7fb45d2a5640 1 --2- 172.21.15.27:0/1222134215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c8cb60 0x559716c8f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.898+0000 7fb45d2a5640 1 -- 172.21.15.27:0/1222134215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c8d480 msgr2=0x559716c93af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:53.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.898+0000 7fb45d2a5640 1 --2- 172.21.15.27:0/1222134215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c8d480 0x559716c93af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.898+0000 7fb45d2a5640 1 -- 172.21.15.27:0/1222134215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559716c97220 con 0x559716c97d40 2024-09-19T08:17:53.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.898+0000 7fb45caa4640 1 --2- 172.21.15.27:0/1222134215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c8cb60 0x559716c8f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:17:53.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.898+0000 7fb457fff640 1 --2- 172.21.15.27:0/1222134215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c8d480 0x559716c93af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:17:53.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.898+0000 7fb45d2a5640 1 --2- 172.21.15.27:0/1222134215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c97d40 0x559716caf330 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fb448033000 tx=0x7fb44803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ffb3fabf064075 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:53.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.898+0000 7fb43e7fc640 1 -- 172.21.15.27:0/1222134215 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb448035050 con 0x559716c97d40 2024-09-19T08:17:53.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.898+0000 7fb43e7fc640 1 -- 172.21.15.27:0/1222134215 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb448031a10 con 0x559716c97d40 2024-09-19T08:17:53.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.898+0000 7fb43e7fc640 1 -- 172.21.15.27:0/1222134215 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb448003850 con 0x559716c97d40 2024-09-19T08:17:53.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.899+0000 7fb4610e1740 1 -- 172.21.15.27:0/1222134215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c97d40 msgr2=0x559716caf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:53.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.899+0000 7fb4610e1740 1 --2- 172.21.15.27:0/1222134215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c97d40 0x559716caf330 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fb448033000 tx=0x7fb44803d000 comp rx=0 tx=0).stop 2024-09-19T08:17:53.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.899+0000 7fb4610e1740 1 -- 172.21.15.27:0/1222134215 shutdown_connections 2024-09-19T08:17:53.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.899+0000 7fb4610e1740 1 --2- 172.21.15.27:0/1222134215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c97d40 0x559716caf330 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.899+0000 7fb4610e1740 1 --2- 172.21.15.27:0/1222134215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c8d480 0x559716c93af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.899+0000 7fb4610e1740 1 --2- 172.21.15.27:0/1222134215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c8cb60 0x559716c8f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.899+0000 7fb4610e1740 1 -- 172.21.15.27:0/1222134215 >> 172.21.15.27:0/1222134215 conn(0x559716c890f0 msgr2=0x559716c933e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:53.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.899+0000 7fb4610e1740 1 -- 172.21.15.27:0/1222134215 shutdown_connections 2024-09-19T08:17:53.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.899+0000 7fb4610e1740 1 -- 172.21.15.27:0/1222134215 wait complete. 2024-09-19T08:17:53.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.899+0000 7fb4610e1740 1 -- start start 2024-09-19T08:17:53.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.899+0000 7fb4610e1740 1 Processor -- start 2024-09-19T08:17:53.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb4610e1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c8cb60 0x559716ca0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:53.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb4610e1740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8d480 0x559716c91a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:53.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb4610e1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c97d40 0x559716c920a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:53.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb4610e1740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581ac450 con 0x559716c8d480 2024-09-19T08:17:53.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb4610e1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581ad8c0 con 0x559716c97d40 2024-09-19T08:17:53.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb4610e1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581acb20 con 0x559716c8cb60 2024-09-19T08:17:53.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb4610e1740 10 client.0 _ll_register_callbacks cb 0x7fb450007dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:53.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb457fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8d480 0x559716c91a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:53.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb457fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8d480 0x559716c91a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52080/0 (socket says 172.21.15.27:52080) 2024-09-19T08:17:53.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb457fff640 1 -- 172.21.15.27:0/2176901474 learned_addr learned my addr 172.21.15.27:0/2176901474 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:53.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb45caa4640 1 --2- 172.21.15.27:0/2176901474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c8cb60 0x559716ca0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:53.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb457fff640 1 -- 172.21.15.27:0/2176901474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c8cb60 msgr2=0x559716ca0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:53.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb457fff640 1 --2- 172.21.15.27:0/2176901474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c8cb60 0x559716ca0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb457fff640 1 -- 172.21.15.27:0/2176901474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c97d40 msgr2=0x559716c920a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:53.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb45d2a5640 1 --2- 172.21.15.27:0/2176901474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c97d40 0x559716c920a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:53.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb457fff640 1 --2- 172.21.15.27:0/2176901474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c97d40 0x559716c920a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb457fff640 1 -- 172.21.15.27:0/2176901474 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559716c928d0 con 0x559716c8d480 2024-09-19T08:17:53.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb45caa4640 1 --2- 172.21.15.27:0/2176901474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c8cb60 0x559716ca0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:17:53.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb45d2a5640 1 --2- 172.21.15.27:0/2176901474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c97d40 0x559716c920a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:17:53.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb457fff640 1 --2- 172.21.15.27:0/2176901474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8d480 0x559716c91a90 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0cd4d0 tx=0x7fb44c010d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b654aada07e9b93b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:53.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb437fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:53.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb437fff640 1 -- 172.21.15.27:0/2176901474 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c021040 con 0x559716c8d480 2024-09-19T08:17:53.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb437fff640 1 -- 172.21.15.27:0/2176901474 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fb44c0cd150 con 0x559716c8d480 2024-09-19T08:17:53.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.900+0000 7fb4610e1740 1 -- 172.21.15.27:0/2176901474 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559716bf9d00 con 0x559716c8d480 2024-09-19T08:17:53.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.901+0000 7fb437fff640 1 -- 172.21.15.27:0/2176901474 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb44c0a46d0 con 0x559716c8d480 2024-09-19T08:17:53.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.901+0000 7fb4610e1740 10 client.16482 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:53.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.901+0000 7fb4610e1740 1 -- 172.21.15.27:0/2176901474 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559716d123e0 con 0x559716c8d480 2024-09-19T08:17:53.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.901+0000 7fb437fff640 1 -- 172.21.15.27:0/2176901474 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x559716bf9d00 con 0x559716c8d480 2024-09-19T08:17:53.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.901+0000 7fb437fff640 1 -- 172.21.15.27:0/2176901474 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb44c0a42d0 con 0x559716c8d480 2024-09-19T08:17:53.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.901+0000 7fb4610e1740 10 client.16482 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:53.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.901+0000 7fb4610e1740 10 client.16482 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:53.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.901+0000 7fb4610e1740 20 client.16482 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:53.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.901+0000 7fb4610e1740 1 --2- 172.21.15.27:0/2176901474 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559716d12b10 0x559716d14f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:53.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.901+0000 7fb4610e1740 4 client.16482 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:17:53.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.901+0000 7fb4610e1740 1 -- 172.21.15.27:0/2176901474 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559716b76110 con 0x559716d12b10 2024-09-19T08:17:53.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.901+0000 7fb45caa4640 1 --2- 172.21.15.27:0/2176901474 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559716d12b10 0x559716d14f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:53.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.902+0000 7fb45caa4640 1 --2- 172.21.15.27:0/2176901474 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559716d12b10 0x559716d14f30 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13f0cbd67bea059c server_cookie=73ea0884440402f2 in_seq=0 out_seq=0 2024-09-19T08:17:53.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.902+0000 7fb437fff640 10 client.16482 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:53.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.903+0000 7fb437fff640 1 -- 172.21.15.27:0/2176901474 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559716b76110 con 0x559716d12b10 2024-09-19T08:17:53.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.903+0000 7fb437fff640 10 client.16482 handle_command_reply: tid=0 2024-09-19T08:17:53.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.903+0000 7fb4610e1740 1 client.16482 shutdown 2024-09-19T08:17:53.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.903+0000 7fb4610e1740 1 -- 172.21.15.27:0/2176901474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8d480 msgr2=0x559716c91a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:53.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.903+0000 7fb4610e1740 1 --2- 172.21.15.27:0/2176901474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8d480 0x559716c91a90 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0cd4d0 tx=0x7fb44c010d40 comp rx=0 tx=0).stop 2024-09-19T08:17:53.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.903+0000 7fb4610e1740 1 -- 172.21.15.27:0/2176901474 shutdown_connections 2024-09-19T08:17:53.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.903+0000 7fb4610e1740 1 --2- 172.21.15.27:0/2176901474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559716c97d40 0x559716c920a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.903+0000 7fb4610e1740 1 --2- 172.21.15.27:0/2176901474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559716c8d480 0x559716c91a90 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.903+0000 7fb4610e1740 1 --2- 172.21.15.27:0/2176901474 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559716d12b10 0x559716d14f30 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.903+0000 7fb4610e1740 1 --2- 172.21.15.27:0/2176901474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559716c8cb60 0x559716ca0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.903+0000 7fb4610e1740 1 -- 172.21.15.27:0/2176901474 >> 172.21.15.27:0/2176901474 conn(0x559716c890f0 msgr2=0x559716c93c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:53.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.903+0000 7fb437fff640 0 client.16482 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:53.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.903+0000 7fb4610e1740 1 -- 172.21.15.27:0/2176901474 shutdown_connections 2024-09-19T08:17:53.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.903+0000 7fb4610e1740 1 -- 172.21.15.27:0/2176901474 wait complete. 2024-09-19T08:17:53.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.903+0000 7fb4610e1740 20 client.16482 trim_cache size 0 max 16384 2024-09-19T08:17:53.912 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:17:53.912 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:17:53.912 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "986bb763-3722-4604-a24c-a53203ad458f", 2024-09-19T08:17:53.912 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:17:53.912 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:17:53.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.904+0000 7fb45ed08640 1 -- 172.21.15.27:0/3924898300 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb4400a33b0 msgr2=0x7fb4400a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:53.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.904+0000 7fb45ed08640 1 --2- 172.21.15.27:0/3924898300 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb4400a33b0 0x7fb4400a5870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb448005940 tx=0x7fb448009260 comp rx=0 tx=0).stop 2024-09-19T08:17:53.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.904+0000 7fb45ed08640 1 -- 172.21.15.27:0/3924898300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4581036e0 msgr2=0x7fb4581989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:53.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.904+0000 7fb45ed08640 1 --2- 172.21.15.27:0/3924898300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4581036e0 0x7fb4581989c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00d740 tx=0x7fb44c00dc00 comp rx=0 tx=0).stop 2024-09-19T08:17:53.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.904+0000 7fb45ed08640 1 -- 172.21.15.27:0/3924898300 shutdown_connections 2024-09-19T08:17:53.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.904+0000 7fb45ed08640 1 --2- 172.21.15.27:0/3924898300 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb4400a33b0 0x7fb4400a5870 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.904+0000 7fb45ed08640 1 --2- 172.21.15.27:0/3924898300 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4581082a0 0x7fb45819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.904+0000 7fb45ed08640 1 --2- 172.21.15.27:0/3924898300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4581036e0 0x7fb4581989c0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.904+0000 7fb45ed08640 1 --2- 172.21.15.27:0/3924898300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb458102d30 0x7fb458198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:53.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.904+0000 7fb45ed08640 1 -- 172.21.15.27:0/3924898300 >> 172.21.15.27:0/3924898300 conn(0x7fb4580fc7d0 msgr2=0x7fb4580fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:53.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.904+0000 7fb45ed08640 1 -- 172.21.15.27:0/3924898300 shutdown_connections 2024-09-19T08:17:53.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:53.904+0000 7fb45ed08640 1 -- 172.21.15.27:0/3924898300 wait complete. 2024-09-19T08:17:54.753 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:17:55.016 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:17:55.138 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:54 smithi027 ceph-mon[31209]: pgmap v209: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:17:55.139 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:54 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:17:55.139 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:54 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:17:55.139 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:54 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:17:55.139 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:54 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:17:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:54 smithi155 ceph-mon[35362]: pgmap v209: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:17:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:54 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:17:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:54 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:17:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:54 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:17:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:54 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:17:55.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:54 smithi203 ceph-mon[35198]: pgmap v209: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:17:55.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:54 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:17:55.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:54 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:17:55.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:54 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:17:55.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:54 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:17:55.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.509+0000 7f65e738f640 1 -- 172.21.15.27:0/833737440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e0101de0 msgr2=0x7f65e01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:55.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.509+0000 7f65e738f640 1 --2- 172.21.15.27:0/833737440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e0101de0 0x7f65e01021c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f65dc009900 tx=0x7f65dc02a410 comp rx=0 tx=0).stop 2024-09-19T08:17:55.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.509+0000 7f65e738f640 1 -- 172.21.15.27:0/833737440 shutdown_connections 2024-09-19T08:17:55.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.509+0000 7f65e738f640 1 --2- 172.21.15.27:0/833737440 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65e0106f10 0x7f65e010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.509+0000 7f65e738f640 1 --2- 172.21.15.27:0/833737440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65e0102790 0x7f65e01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.509+0000 7f65e738f640 1 --2- 172.21.15.27:0/833737440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e0101de0 0x7f65e01021c0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.509+0000 7f65e738f640 1 -- 172.21.15.27:0/833737440 >> 172.21.15.27:0/833737440 conn(0x7f65e00fd8c0 msgr2=0x7f65e00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:55.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.509+0000 7f65e738f640 1 -- 172.21.15.27:0/833737440 shutdown_connections 2024-09-19T08:17:55.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.509+0000 7f65e738f640 1 -- 172.21.15.27:0/833737440 wait complete. 2024-09-19T08:17:55.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.509+0000 7f65e738f640 1 Processor -- start 2024-09-19T08:17:55.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.509+0000 7f65e738f640 1 -- start start 2024-09-19T08:17:55.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.510+0000 7f65e738f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65e0101de0 0x7f65e0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:55.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.510+0000 7f65e738f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e0102790 0x7f65e01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:55.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.510+0000 7f65e738f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65e0106f10 0x7f65e019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:55.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.510+0000 7f65e738f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f65e0111f90 con 0x7f65e0102790 2024-09-19T08:17:55.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.510+0000 7f65e738f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f65e0111e10 con 0x7f65e0106f10 2024-09-19T08:17:55.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.510+0000 7f65e738f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f65e0112110 con 0x7f65e0101de0 2024-09-19T08:17:55.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.510+0000 7f65e492a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e0102790 0x7f65e01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:55.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.510+0000 7f65e492a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e0102790 0x7f65e01989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52100/0 (socket says 172.21.15.27:52100) 2024-09-19T08:17:55.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.510+0000 7f65e492a640 1 -- 172.21.15.27:0/3528707239 learned_addr learned my addr 172.21.15.27:0/3528707239 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:55.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.510+0000 7f65e512b640 1 --2- 172.21.15.27:0/3528707239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65e0101de0 0x7f65e0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.510+0000 7f65e592c640 1 --2- 172.21.15.27:0/3528707239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65e0106f10 0x7f65e019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.510+0000 7f65e492a640 1 -- 172.21.15.27:0/3528707239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65e0101de0 msgr2=0x7f65e0198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.510+0000 7f65e492a640 1 --2- 172.21.15.27:0/3528707239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65e0101de0 0x7f65e0198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.510+0000 7f65e492a640 1 -- 172.21.15.27:0/3528707239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65e0106f10 msgr2=0x7f65e019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.510+0000 7f65e492a640 1 --2- 172.21.15.27:0/3528707239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65e0106f10 0x7f65e019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.510+0000 7f65e492a640 1 -- 172.21.15.27:0/3528707239 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e019d440 con 0x7f65e0102790 2024-09-19T08:17:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.510+0000 7f65e512b640 1 --2- 172.21.15.27:0/3528707239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65e0101de0 0x7f65e0198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:17:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.510+0000 7f65e592c640 1 --2- 172.21.15.27:0/3528707239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65e0106f10 0x7f65e019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:17:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.510+0000 7f65e492a640 1 --2- 172.21.15.27:0/3528707239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e0102790 0x7f65e01989d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f65d400c890 tx=0x7f65d400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.511+0000 7f65d27fc640 1 -- 172.21.15.27:0/3528707239 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d4004220 con 0x7f65e0102790 2024-09-19T08:17:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.511+0000 7f65e738f640 1 -- 172.21.15.27:0/3528707239 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65e019d730 con 0x7f65e0102790 2024-09-19T08:17:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.511+0000 7f65d27fc640 1 -- 172.21.15.27:0/3528707239 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65d40043c0 con 0x7f65e0102790 2024-09-19T08:17:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.511+0000 7f65d27fc640 1 -- 172.21.15.27:0/3528707239 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d4004a00 con 0x7f65e0102790 2024-09-19T08:17:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.511+0000 7f65e738f640 1 -- 172.21.15.27:0/3528707239 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65e01a5010 con 0x7f65e0102790 2024-09-19T08:17:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.513+0000 7f65d27fc640 1 -- 172.21.15.27:0/3528707239 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f65d40079b0 con 0x7f65e0102790 2024-09-19T08:17:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.513+0000 7f65e9768740 1 Processor -- start 2024-09-19T08:17:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.513+0000 7f65e9768740 1 -- start start 2024-09-19T08:17:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.514+0000 7f65e9768740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245c6380 0x55cc245c6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.514+0000 7f65e9768740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245c6ca0 0x55cc245d5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.514+0000 7f65e9768740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245d5a90 0x55cc245d7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.514+0000 7f65e9768740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55cc2452c2e0 con 0x55cc245d5a90 2024-09-19T08:17:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.514+0000 7f65e9768740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55cc244d3ce0 con 0x55cc245c6ca0 2024-09-19T08:17:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.514+0000 7f65e9768740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cc245282a0 con 0x55cc245c6380 2024-09-19T08:17:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.514+0000 7f65e492a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245d5a90 0x55cc245d7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.514+0000 7f65e492a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245d5a90 0x55cc245d7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52110/0 (socket says 172.21.15.27:52110) 2024-09-19T08:17:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.514+0000 7f65e492a640 1 -- 172.21.15.27:0/1294188931 learned_addr learned my addr 172.21.15.27:0/1294188931 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.514+0000 7f65e512b640 1 --2- 172.21.15.27:0/1294188931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245c6ca0 0x55cc245d5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.514+0000 7f65e592c640 1 --2- 172.21.15.27:0/1294188931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245c6380 0x55cc245c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.514+0000 7f65d27fc640 1 --2- 172.21.15.27:0/3528707239 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f65cc0a33b0 0x7f65cc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.514+0000 7f65e492a640 1 -- 172.21.15.27:0/1294188931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245c6380 msgr2=0x55cc245c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.514+0000 7f65e492a640 1 --2- 172.21.15.27:0/1294188931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245c6380 0x55cc245c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.514+0000 7f65e492a640 1 -- 172.21.15.27:0/1294188931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245c6ca0 msgr2=0x55cc245d5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.514+0000 7f65e492a640 1 --2- 172.21.15.27:0/1294188931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245c6ca0 0x55cc245d5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.514+0000 7f65e492a640 1 -- 172.21.15.27:0/1294188931 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc244b8440 con 0x55cc245d5a90 2024-09-19T08:17:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.514+0000 7f65e592c640 1 --2- 172.21.15.27:0/3528707239 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f65cc0a33b0 0x7f65cc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.515+0000 7f65d27fc640 1 -- 172.21.15.27:0/3528707239 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f65d40cfa80 con 0x7f65e0102790 2024-09-19T08:17:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.515+0000 7f65e492a640 1 --2- 172.21.15.27:0/1294188931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245d5a90 0x55cc245d7e80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f65d40cd190 tx=0x7f65d406aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1aeabde7e73f163 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.515+0000 7f65cb7fe640 1 -- 172.21.15.27:0/1294188931 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d401d070 con 0x55cc245d5a90 2024-09-19T08:17:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.515+0000 7f65cb7fe640 1 -- 172.21.15.27:0/1294188931 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65d409c4b0 con 0x55cc245d5a90 2024-09-19T08:17:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.515+0000 7f65cb7fe640 1 -- 172.21.15.27:0/1294188931 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d40d7040 con 0x55cc245d5a90 2024-09-19T08:17:55.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.516+0000 7f65e9768740 1 -- 172.21.15.27:0/1294188931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245d5a90 msgr2=0x55cc245d7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:55.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.516+0000 7f65e9768740 1 --2- 172.21.15.27:0/1294188931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245d5a90 0x55cc245d7e80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f65d40cd190 tx=0x7f65d406aaa0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.516+0000 7f65e592c640 1 --2- 172.21.15.27:0/3528707239 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f65cc0a33b0 0x7f65cc0a5870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f65d800f4f0 tx=0x7f65d8004b50 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:55.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.516+0000 7f65e9768740 1 -- 172.21.15.27:0/1294188931 shutdown_connections 2024-09-19T08:17:55.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.516+0000 7f65e9768740 1 --2- 172.21.15.27:0/1294188931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245d5a90 0x55cc245d7e80 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.516+0000 7f65e9768740 1 --2- 172.21.15.27:0/1294188931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245c6ca0 0x55cc245d5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.516+0000 7f65e9768740 1 --2- 172.21.15.27:0/1294188931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245c6380 0x55cc245c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.516+0000 7f65e9768740 1 -- 172.21.15.27:0/1294188931 >> 172.21.15.27:0/1294188931 conn(0x55cc245c2a30 msgr2=0x55cc245c2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:55.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.516+0000 7f65e9768740 1 -- 172.21.15.27:0/1294188931 shutdown_connections 2024-09-19T08:17:55.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.516+0000 7f65e9768740 1 -- 172.21.15.27:0/1294188931 wait complete. 2024-09-19T08:17:55.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.516+0000 7f65e9768740 1 -- start start 2024-09-19T08:17:55.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.516+0000 7f65e9768740 1 Processor -- start 2024-09-19T08:17:55.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e9768740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245c6380 0x55cc245d5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:55.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e9768740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245c6ca0 0x55cc245d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:55.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e9768740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245d5a90 0x55cc245d2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:55.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e9768740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55cc245d8660 con 0x55cc245c6ca0 2024-09-19T08:17:55.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e9768740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55cc244e7050 con 0x55cc245d5a90 2024-09-19T08:17:55.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e9768740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cc245d87e0 con 0x55cc245c6380 2024-09-19T08:17:55.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e9768740 10 client.0 _ll_register_callbacks cb 0x55cc24527160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:55.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e492a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245c6ca0 0x55cc245d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:55.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e492a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245c6ca0 0x55cc245d2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52116/0 (socket says 172.21.15.27:52116) 2024-09-19T08:17:55.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e492a640 1 -- 172.21.15.27:0/883633729 learned_addr learned my addr 172.21.15.27:0/883633729 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:55.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e512b640 1 --2- 172.21.15.27:0/883633729 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245c6380 0x55cc245d5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:55.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e592c640 1 --2- 172.21.15.27:0/883633729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245d5a90 0x55cc245d2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:55.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e492a640 1 -- 172.21.15.27:0/883633729 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245c6380 msgr2=0x55cc245d5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:55.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e492a640 1 --2- 172.21.15.27:0/883633729 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245c6380 0x55cc245d5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e492a640 1 -- 172.21.15.27:0/883633729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245d5a90 msgr2=0x55cc245d2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e492a640 1 --2- 172.21.15.27:0/883633729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245d5a90 0x55cc245d2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e492a640 1 -- 172.21.15.27:0/883633729 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc2429d3c0 con 0x55cc245c6ca0 2024-09-19T08:17:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e592c640 1 --2- 172.21.15.27:0/883633729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245d5a90 0x55cc245d2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:17:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e492a640 1 --2- 172.21.15.27:0/883633729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245c6ca0 0x55cc245d2630 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f65d40cd2d0 tx=0x7f65d4004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d339993788190cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65c8ff9640 1 -- 172.21.15.27:0/883633729 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d401d040 con 0x55cc245c6ca0 2024-09-19T08:17:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65c8ff9640 1 -- 172.21.15.27:0/883633729 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f65d409a0b0 con 0x55cc245c6ca0 2024-09-19T08:17:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e9768740 1 -- 172.21.15.27:0/883633729 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65d409c4b0 con 0x55cc245c6ca0 2024-09-19T08:17:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65c8ff9640 1 -- 172.21.15.27:0/883633729 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f65d409b8f0 con 0x55cc245c6ca0 2024-09-19T08:17:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e9768740 10 client.16494 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.517+0000 7f65e9768740 1 -- 172.21.15.27:0/883633729 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cc245d8660 con 0x55cc245c6ca0 2024-09-19T08:17:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.518+0000 7f65c8ff9640 1 -- 172.21.15.27:0/883633729 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65d409f020 con 0x55cc245c6ca0 2024-09-19T08:17:55.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.518+0000 7f65c8ff9640 1 -- 172.21.15.27:0/883633729 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f65d40cd4a0 con 0x55cc245c6ca0 2024-09-19T08:17:55.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.518+0000 7f65e9768740 10 client.16494 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:55.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.518+0000 7f65e9768740 10 client.16494 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:55.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.518+0000 7f65e9768740 20 client.16494 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:55.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.518+0000 7f65e9768740 1 --2- 172.21.15.27:0/883633729 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55cc245e5190 0x55cc245e7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:55.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.518+0000 7f65e9768740 4 client.16494 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:17:55.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.518+0000 7f65e9768740 1 -- 172.21.15.27:0/883633729 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc24539850 con 0x55cc245e5190 2024-09-19T08:17:55.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.518+0000 7f65e512b640 1 --2- 172.21.15.27:0/883633729 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55cc245e5190 0x55cc245e7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:55.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.519+0000 7f65c8ff9640 10 client.16494 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:55.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.519+0000 7f65e512b640 1 --2- 172.21.15.27:0/883633729 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55cc245e5190 0x55cc245e7580 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6c3fa72bdd258f8 server_cookie=f32c9f362064c21 in_seq=0 out_seq=0 2024-09-19T08:17:55.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.519+0000 7f65c8ff9640 1 -- 172.21.15.27:0/883633729 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc24539850 con 0x55cc245e5190 2024-09-19T08:17:55.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.519+0000 7f65c8ff9640 10 client.16494 handle_command_reply: tid=0 2024-09-19T08:17:55.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.519+0000 7f65e9768740 1 client.16494 shutdown 2024-09-19T08:17:55.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.519+0000 7f65e9768740 1 -- 172.21.15.27:0/883633729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245c6ca0 msgr2=0x55cc245d2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:55.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.519+0000 7f65e9768740 1 --2- 172.21.15.27:0/883633729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245c6ca0 0x55cc245d2630 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f65d40cd2d0 tx=0x7f65d4004570 comp rx=0 tx=0).stop 2024-09-19T08:17:55.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.520+0000 7f65e9768740 1 -- 172.21.15.27:0/883633729 shutdown_connections 2024-09-19T08:17:55.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.520+0000 7f65e9768740 1 --2- 172.21.15.27:0/883633729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245d5a90 0x55cc245d2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.520+0000 7f65e9768740 1 --2- 172.21.15.27:0/883633729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245c6ca0 0x55cc245d2630 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.520+0000 7f65e9768740 1 --2- 172.21.15.27:0/883633729 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55cc245e5190 0x55cc245e7580 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.520+0000 7f65e9768740 1 --2- 172.21.15.27:0/883633729 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245c6380 0x55cc245d5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.520+0000 7f65e9768740 1 -- 172.21.15.27:0/883633729 >> 172.21.15.27:0/883633729 conn(0x55cc245c2a30 msgr2=0x55cc245c8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:55.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.520+0000 7f65c8ff9640 0 client.16494 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:55.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.520+0000 7f65e9768740 1 -- 172.21.15.27:0/883633729 shutdown_connections 2024-09-19T08:17:55.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.520+0000 7f65e9768740 1 -- 172.21.15.27:0/883633729 wait complete. 2024-09-19T08:17:55.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.520+0000 7f65e9768740 20 client.16494 trim_cache size 0 max 16384 2024-09-19T08:17:55.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.537+0000 7f65e9768740 1 Processor -- start 2024-09-19T08:17:55.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.537+0000 7f65e9768740 1 -- start start 2024-09-19T08:17:55.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.537+0000 7f65e9768740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245c6380 0x55cc245e1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:55.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.537+0000 7f65e9768740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245c6ca0 0x55cc245d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:55.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.537+0000 7f65e9768740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245d5a90 0x55cc245eccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:55.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.537+0000 7f65e9768740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f65e01a96a0 con 0x55cc245d5a90 2024-09-19T08:17:55.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.537+0000 7f65e9768740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f65e01abf20 con 0x55cc245c6ca0 2024-09-19T08:17:55.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.537+0000 7f65e9768740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f65e01a9d10 con 0x55cc245c6380 2024-09-19T08:17:55.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.537+0000 7f65e592c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245d5a90 0x55cc245eccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:55.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.537+0000 7f65e592c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245d5a90 0x55cc245eccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52128/0 (socket says 172.21.15.27:52128) 2024-09-19T08:17:55.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.537+0000 7f65e592c640 1 -- 172.21.15.27:0/411855435 learned_addr learned my addr 172.21.15.27:0/411855435 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:55.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.537+0000 7f65e512b640 1 --2- 172.21.15.27:0/411855435 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245c6380 0x55cc245e1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:55.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.538+0000 7f65e492a640 1 --2- 172.21.15.27:0/411855435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245c6ca0 0x55cc245d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:55.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.538+0000 7f65e592c640 1 -- 172.21.15.27:0/411855435 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245c6380 msgr2=0x55cc245e1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:55.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.538+0000 7f65e592c640 1 --2- 172.21.15.27:0/411855435 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245c6380 0x55cc245e1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.538+0000 7f65e592c640 1 -- 172.21.15.27:0/411855435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245c6ca0 msgr2=0x55cc245d0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:55.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.538+0000 7f65e592c640 1 --2- 172.21.15.27:0/411855435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245c6ca0 0x55cc245d0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.538+0000 7f65e592c640 1 -- 172.21.15.27:0/411855435 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc245c6ad0 con 0x55cc245d5a90 2024-09-19T08:17:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.538+0000 7f65e592c640 1 --2- 172.21.15.27:0/411855435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245d5a90 0x55cc245eccc0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f65d8011760 tx=0x7f65d8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9421870bf9ce90f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.538+0000 7f65caffd640 1 -- 172.21.15.27:0/411855435 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d801db80 con 0x55cc245d5a90 2024-09-19T08:17:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.538+0000 7f65caffd640 1 -- 172.21.15.27:0/411855435 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65d801dd20 con 0x55cc245d5a90 2024-09-19T08:17:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.538+0000 7f65caffd640 1 -- 172.21.15.27:0/411855435 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d8025730 con 0x55cc245d5a90 2024-09-19T08:17:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.539+0000 7f65e9768740 1 -- 172.21.15.27:0/411855435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245d5a90 msgr2=0x55cc245eccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.539+0000 7f65e9768740 1 --2- 172.21.15.27:0/411855435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245d5a90 0x55cc245eccc0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f65d8011760 tx=0x7f65d8007f90 comp rx=0 tx=0).stop 2024-09-19T08:17:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.539+0000 7f65e9768740 1 -- 172.21.15.27:0/411855435 shutdown_connections 2024-09-19T08:17:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.539+0000 7f65e9768740 1 --2- 172.21.15.27:0/411855435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245d5a90 0x55cc245eccc0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.539+0000 7f65e9768740 1 --2- 172.21.15.27:0/411855435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245c6ca0 0x55cc245d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.539+0000 7f65e9768740 1 --2- 172.21.15.27:0/411855435 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245c6380 0x55cc245e1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.539+0000 7f65e9768740 1 -- 172.21.15.27:0/411855435 >> 172.21.15.27:0/411855435 conn(0x55cc245c2a30 msgr2=0x55cc245d2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.539+0000 7f65e9768740 1 -- 172.21.15.27:0/411855435 shutdown_connections 2024-09-19T08:17:55.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.539+0000 7f65e9768740 1 -- 172.21.15.27:0/411855435 wait complete. 2024-09-19T08:17:55.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.539+0000 7f65e9768740 1 -- start start 2024-09-19T08:17:55.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.539+0000 7f65e9768740 1 Processor -- start 2024-09-19T08:17:55.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.539+0000 7f65e9768740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245c6380 0x55cc245de110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:55.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.539+0000 7f65e9768740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245c6ca0 0x55cc245d9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:55.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.539+0000 7f65e9768740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245d5a90 0x55cc245d99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:55.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.539+0000 7f65e9768740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f65e01aa3e0 con 0x55cc245c6ca0 2024-09-19T08:17:55.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.539+0000 7f65e9768740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f65e01ab850 con 0x55cc245c6380 2024-09-19T08:17:55.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.539+0000 7f65e9768740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f65e01aaab0 con 0x55cc245d5a90 2024-09-19T08:17:55.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.539+0000 7f65e9768740 10 client.0 _ll_register_callbacks cb 0x7f65dc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:55.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.540+0000 7f65e492a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245c6ca0 0x55cc245d9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:55.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.540+0000 7f65e492a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245c6ca0 0x55cc245d9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52130/0 (socket says 172.21.15.27:52130) 2024-09-19T08:17:55.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.540+0000 7f65e492a640 1 -- 172.21.15.27:0/1944214114 learned_addr learned my addr 172.21.15.27:0/1944214114 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.540+0000 7f65e512b640 1 --2- 172.21.15.27:0/1944214114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245c6380 0x55cc245de110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.540+0000 7f65e592c640 1 --2- 172.21.15.27:0/1944214114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245d5a90 0x55cc245d99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.540+0000 7f65e492a640 1 -- 172.21.15.27:0/1944214114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245d5a90 msgr2=0x55cc245d99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.540+0000 7f65e492a640 1 --2- 172.21.15.27:0/1944214114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245d5a90 0x55cc245d99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.540+0000 7f65e492a640 1 -- 172.21.15.27:0/1944214114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245c6380 msgr2=0x55cc245de110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.540+0000 7f65e492a640 1 --2- 172.21.15.27:0/1944214114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245c6380 0x55cc245de110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.540+0000 7f65e492a640 1 -- 172.21.15.27:0/1944214114 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc245da200 con 0x55cc245c6ca0 2024-09-19T08:17:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.540+0000 7f65e592c640 1 --2- 172.21.15.27:0/1944214114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245d5a90 0x55cc245d99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:17:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.540+0000 7f65e512b640 1 --2- 172.21.15.27:0/1944214114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245c6380 0x55cc245de110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:17:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.540+0000 7f65e492a640 1 --2- 172.21.15.27:0/1944214114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245c6ca0 0x55cc245d9490 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f65d40b01e0 tx=0x7f65d4097f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22792649759d12c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.540+0000 7f65c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.540+0000 7f65c8ff9640 1 -- 172.21.15.27:0/1944214114 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d401d070 con 0x55cc245c6ca0 2024-09-19T08:17:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.540+0000 7f65c8ff9640 1 -- 172.21.15.27:0/1944214114 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f65d4098420 con 0x55cc245c6ca0 2024-09-19T08:17:55.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.540+0000 7f65e9768740 1 -- 172.21.15.27:0/1944214114 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65d801dd20 con 0x55cc245c6ca0 2024-09-19T08:17:55.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.540+0000 7f65c8ff9640 1 -- 172.21.15.27:0/1944214114 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f65d409b710 con 0x55cc245c6ca0 2024-09-19T08:17:55.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.540+0000 7f65e9768740 10 client.16500 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:55.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.541+0000 7f65e9768740 1 -- 172.21.15.27:0/1944214114 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cc2464fc10 con 0x55cc245c6ca0 2024-09-19T08:17:55.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.541+0000 7f65c8ff9640 1 -- 172.21.15.27:0/1944214114 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65d801dd20 con 0x55cc245c6ca0 2024-09-19T08:17:55.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.541+0000 7f65c8ff9640 1 -- 172.21.15.27:0/1944214114 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f65d4007ca0 con 0x55cc245c6ca0 2024-09-19T08:17:55.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.541+0000 7f65e9768740 10 client.16500 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:55.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.541+0000 7f65e9768740 10 client.16500 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:55.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.541+0000 7f65e9768740 20 client.16500 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:55.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.541+0000 7f65e9768740 1 --2- 172.21.15.27:0/1944214114 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55cc24650170 0x55cc24652590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:55.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.541+0000 7f65e9768740 4 client.16500 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:17:55.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.541+0000 7f65e9768740 1 -- 172.21.15.27:0/1944214114 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cc24533d60 con 0x55cc24650170 2024-09-19T08:17:55.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.541+0000 7f65e512b640 1 --2- 172.21.15.27:0/1944214114 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55cc24650170 0x55cc24652590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:55.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.542+0000 7f65e512b640 1 --2- 172.21.15.27:0/1944214114 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55cc24650170 0x55cc24652590 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93158c780b1e651a server_cookie=aaa50668c5fe0fef in_seq=0 out_seq=0 2024-09-19T08:17:55.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.542+0000 7f65c8ff9640 10 client.16500 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:55.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.542+0000 7f65c8ff9640 1 -- 172.21.15.27:0/1944214114 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55cc24533d60 con 0x55cc24650170 2024-09-19T08:17:55.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.542+0000 7f65c8ff9640 10 client.16500 handle_command_reply: tid=0 2024-09-19T08:17:55.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.542+0000 7f65e9768740 1 client.16500 shutdown 2024-09-19T08:17:55.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.542+0000 7f65e9768740 1 -- 172.21.15.27:0/1944214114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245c6ca0 msgr2=0x55cc245d9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:55.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.542+0000 7f65e9768740 1 --2- 172.21.15.27:0/1944214114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245c6ca0 0x55cc245d9490 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f65d40b01e0 tx=0x7f65d4097f10 comp rx=0 tx=0).stop 2024-09-19T08:17:55.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.542+0000 7f65e9768740 1 -- 172.21.15.27:0/1944214114 shutdown_connections 2024-09-19T08:17:55.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.542+0000 7f65e9768740 1 --2- 172.21.15.27:0/1944214114 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55cc24650170 0x55cc24652590 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.542+0000 7f65e9768740 1 --2- 172.21.15.27:0/1944214114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc245d5a90 0x55cc245d99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.542+0000 7f65e9768740 1 --2- 172.21.15.27:0/1944214114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc245c6ca0 0x55cc245d9490 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.542+0000 7f65e9768740 1 --2- 172.21.15.27:0/1944214114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc245c6380 0x55cc245de110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.542+0000 7f65c8ff9640 0 client.16500 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:55.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.542+0000 7f65e9768740 1 -- 172.21.15.27:0/1944214114 >> 172.21.15.27:0/1944214114 conn(0x55cc245c2a30 msgr2=0x55cc245c7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:55.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.542+0000 7f65e9768740 1 -- 172.21.15.27:0/1944214114 shutdown_connections 2024-09-19T08:17:55.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.542+0000 7f65e9768740 1 -- 172.21.15.27:0/1944214114 wait complete. 2024-09-19T08:17:55.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.542+0000 7f65e9768740 20 client.16500 trim_cache size 0 max 16384 2024-09-19T08:17:55.559 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:17:55.559 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:17:55.559 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:17:55.559 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:17:55.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.543+0000 7f65e738f640 1 -- 172.21.15.27:0/3528707239 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f65cc0a33b0 msgr2=0x7f65cc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:55.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.543+0000 7f65e738f640 1 --2- 172.21.15.27:0/3528707239 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f65cc0a33b0 0x7f65cc0a5870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f65d800f4f0 tx=0x7f65d8004b50 comp rx=0 tx=0).stop 2024-09-19T08:17:55.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.543+0000 7f65e738f640 1 -- 172.21.15.27:0/3528707239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e0102790 msgr2=0x7f65e01989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:55.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.543+0000 7f65e738f640 1 --2- 172.21.15.27:0/3528707239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e0102790 0x7f65e01989d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f65d400c890 tx=0x7f65d400cd50 comp rx=0 tx=0).stop 2024-09-19T08:17:55.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.543+0000 7f65e738f640 1 -- 172.21.15.27:0/3528707239 shutdown_connections 2024-09-19T08:17:55.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.543+0000 7f65e738f640 1 --2- 172.21.15.27:0/3528707239 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f65cc0a33b0 0x7f65cc0a5870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.543+0000 7f65e738f640 1 --2- 172.21.15.27:0/3528707239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65e0106f10 0x7f65e019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.543+0000 7f65e738f640 1 --2- 172.21.15.27:0/3528707239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e0102790 0x7f65e01989d0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.543+0000 7f65e738f640 1 --2- 172.21.15.27:0/3528707239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65e0101de0 0x7f65e0198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:55.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.543+0000 7f65e738f640 1 -- 172.21.15.27:0/3528707239 >> 172.21.15.27:0/3528707239 conn(0x7f65e00fd8c0 msgr2=0x7f65e00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:55.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.543+0000 7f65e738f640 1 -- 172.21.15.27:0/3528707239 shutdown_connections 2024-09-19T08:17:55.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:55.543+0000 7f65e738f640 1 -- 172.21.15.27:0/3528707239 wait complete. 2024-09-19T08:17:56.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:55 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:17:56.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:55 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:17:56.257 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:55 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:17:56.417 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:17:56.417 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:17:56.681 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:17:57.085 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:56 smithi027 ceph-mon[31209]: pgmap v210: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:17:57.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.167+0000 7fce66a0a640 1 -- 172.21.15.27:0/2285339021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce60101de0 msgr2=0x7fce601021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:57.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.167+0000 7fce66a0a640 1 --2- 172.21.15.27:0/2285339021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce60101de0 0x7fce601021c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fce50009900 tx=0x7fce5002a410 comp rx=0 tx=0).stop 2024-09-19T08:17:57.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.167+0000 7fce66a0a640 1 -- 172.21.15.27:0/2285339021 shutdown_connections 2024-09-19T08:17:57.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.167+0000 7fce66a0a640 1 --2- 172.21.15.27:0/2285339021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce60106f10 0x7fce6010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:57.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.167+0000 7fce66a0a640 1 --2- 172.21.15.27:0/2285339021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce60102790 0x7fce601067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:57.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.167+0000 7fce66a0a640 1 --2- 172.21.15.27:0/2285339021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce60101de0 0x7fce601021c0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:57.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.167+0000 7fce66a0a640 1 -- 172.21.15.27:0/2285339021 >> 172.21.15.27:0/2285339021 conn(0x7fce600fd8c0 msgr2=0x7fce600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:57.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.167+0000 7fce66a0a640 1 -- 172.21.15.27:0/2285339021 shutdown_connections 2024-09-19T08:17:57.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.167+0000 7fce66a0a640 1 -- 172.21.15.27:0/2285339021 wait complete. 2024-09-19T08:17:57.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.168+0000 7fce66a0a640 1 Processor -- start 2024-09-19T08:17:57.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.168+0000 7fce66a0a640 1 -- start start 2024-09-19T08:17:57.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.168+0000 7fce66a0a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce60101de0 0x7fce601984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:57.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce66a0a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce60102790 0x7fce60198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:57.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce66a0a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce60106f10 0x7fce6019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:57.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce66a0a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fce60111fc0 con 0x7fce60102790 2024-09-19T08:17:57.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce66a0a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fce60111e40 con 0x7fce60106f10 2024-09-19T08:17:57.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce66a0a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fce60112140 con 0x7fce60101de0 2024-09-19T08:17:57.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce5f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce60102790 0x7fce60198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:57.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce5f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce60102790 0x7fce60198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52146/0 (socket says 172.21.15.27:52146) 2024-09-19T08:17:57.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce5f7fe640 1 -- 172.21.15.27:0/4291422998 learned_addr learned my addr 172.21.15.27:0/4291422998 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:57.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce5ffff640 1 --2- 172.21.15.27:0/4291422998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce60101de0 0x7fce601984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:57.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce64fa7640 1 --2- 172.21.15.27:0/4291422998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce60106f10 0x7fce6019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:57.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce5f7fe640 1 -- 172.21.15.27:0/4291422998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce60101de0 msgr2=0x7fce601984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:57.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce5f7fe640 1 --2- 172.21.15.27:0/4291422998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce60101de0 0x7fce601984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:57.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce5f7fe640 1 -- 172.21.15.27:0/4291422998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce60106f10 msgr2=0x7fce6019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:57.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce5f7fe640 1 --2- 172.21.15.27:0/4291422998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce60106f10 0x7fce6019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:57.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce5f7fe640 1 -- 172.21.15.27:0/4291422998 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6019d470 con 0x7fce60102790 2024-09-19T08:17:57.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce5ffff640 1 --2- 172.21.15.27:0/4291422998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce60101de0 0x7fce601984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:17:57.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce5f7fe640 1 --2- 172.21.15.27:0/4291422998 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce60102790 0x7fce60198a00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fce5400e9f0 tx=0x7fce5400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:57.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce5d7fa640 1 -- 172.21.15.27:0/4291422998 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5400cd80 con 0x7fce60102790 2024-09-19T08:17:57.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce66a0a640 1 -- 172.21.15.27:0/4291422998 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce6019d760 con 0x7fce60102790 2024-09-19T08:17:57.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce5d7fa640 1 -- 172.21.15.27:0/4291422998 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce54005500 con 0x7fce60102790 2024-09-19T08:17:57.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce5d7fa640 1 -- 172.21.15.27:0/4291422998 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce54010690 con 0x7fce60102790 2024-09-19T08:17:57.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.169+0000 7fce66a0a640 1 -- 172.21.15.27:0/4291422998 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce601a5040 con 0x7fce60102790 2024-09-19T08:17:57.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.170+0000 7fce66a0a640 1 -- 172.21.15.27:0/4291422998 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce601021c0 con 0x7fce60102790 2024-09-19T08:17:57.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.172+0000 7fce5d7fa640 1 -- 172.21.15.27:0/4291422998 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fce540046c0 con 0x7fce60102790 2024-09-19T08:17:57.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.172+0000 7fce5d7fa640 1 --2- 172.21.15.27:0/4291422998 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fce480a33b0 0x7fce480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:57.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.172+0000 7fce5ffff640 1 --2- 172.21.15.27:0/4291422998 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fce480a33b0 0x7fce480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:57.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.172+0000 7fce5d7fa640 1 -- 172.21.15.27:0/4291422998 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fce540d00c0 con 0x7fce60102790 2024-09-19T08:17:57.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.173+0000 7fce5ffff640 1 --2- 172.21.15.27:0/4291422998 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fce480a33b0 0x7fce480a5870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fce50000c00 tx=0x7fce50005a40 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:57.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.177+0000 7fce5d7fa640 1 -- 172.21.15.27:0/4291422998 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fce5409cb90 con 0x7fce60102790 2024-09-19T08:17:57.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:56 smithi203 ceph-mon[35198]: pgmap v210: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:17:57.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.390+0000 7fce66a0a640 1 -- 172.21.15.27:0/4291422998 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce6010a150 con 0x7fce60102790 2024-09-19T08:17:57.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.391+0000 7fce5d7fa640 1 -- 172.21.15.27:0/4291422998 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7fce5409c490 con 0x7fce60102790 2024-09-19T08:17:57.392 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:17:57.392 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:17:57.392 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:17:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.393+0000 7fce66a0a640 1 -- 172.21.15.27:0/4291422998 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fce480a33b0 msgr2=0x7fce480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.393+0000 7fce66a0a640 1 --2- 172.21.15.27:0/4291422998 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fce480a33b0 0x7fce480a5870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fce50000c00 tx=0x7fce50005a40 comp rx=0 tx=0).stop 2024-09-19T08:17:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.393+0000 7fce66a0a640 1 -- 172.21.15.27:0/4291422998 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce60102790 msgr2=0x7fce60198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.393+0000 7fce66a0a640 1 --2- 172.21.15.27:0/4291422998 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce60102790 0x7fce60198a00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fce5400e9f0 tx=0x7fce5400edf0 comp rx=0 tx=0).stop 2024-09-19T08:17:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.393+0000 7fce66a0a640 1 -- 172.21.15.27:0/4291422998 shutdown_connections 2024-09-19T08:17:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.393+0000 7fce66a0a640 1 --2- 172.21.15.27:0/4291422998 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fce480a33b0 0x7fce480a5870 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.394+0000 7fce66a0a640 1 --2- 172.21.15.27:0/4291422998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce60106f10 0x7fce6019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.394+0000 7fce66a0a640 1 --2- 172.21.15.27:0/4291422998 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce60102790 0x7fce60198a00 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.394+0000 7fce66a0a640 1 --2- 172.21.15.27:0/4291422998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce60101de0 0x7fce601984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.394+0000 7fce66a0a640 1 -- 172.21.15.27:0/4291422998 >> 172.21.15.27:0/4291422998 conn(0x7fce600fd8c0 msgr2=0x7fce600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.394+0000 7fce66a0a640 1 -- 172.21.15.27:0/4291422998 shutdown_connections 2024-09-19T08:17:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:57.394+0000 7fce66a0a640 1 -- 172.21.15.27:0/4291422998 wait complete. 2024-09-19T08:17:57.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:56 smithi155 ceph-mon[35362]: pgmap v210: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:17:58.062 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:17:58.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:57 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/4291422998' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:17:58.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:57 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/4291422998' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:17:58.320 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:17:58.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:57 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/4291422998' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:17:58.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.820+0000 7f4a73ffe640 1 -- 172.21.15.27:0/2354292337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a6c100e30 msgr2=0x7f4a6c104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:58.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.820+0000 7f4a73ffe640 1 --2- 172.21.15.27:0/2354292337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a6c100e30 0x7f4a6c104e80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c009900 tx=0x7f4a5c02a410 comp rx=0 tx=0).stop 2024-09-19T08:17:58.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.820+0000 7f4a73ffe640 1 -- 172.21.15.27:0/2354292337 shutdown_connections 2024-09-19T08:17:58.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.820+0000 7f4a73ffe640 1 --2- 172.21.15.27:0/2354292337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a6c1055b0 0x7f4a6c10d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.820+0000 7f4a73ffe640 1 --2- 172.21.15.27:0/2354292337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a6c100e30 0x7f4a6c104e80 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.820+0000 7f4a73ffe640 1 --2- 172.21.15.27:0/2354292337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a6c100480 0x7f4a6c100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.820+0000 7f4a73ffe640 1 -- 172.21.15.27:0/2354292337 >> 172.21.15.27:0/2354292337 conn(0x7f4a6c077210 msgr2=0x7f4a6c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:58.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.820+0000 7f4a73ffe640 1 -- 172.21.15.27:0/2354292337 shutdown_connections 2024-09-19T08:17:58.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.820+0000 7f4a73ffe640 1 -- 172.21.15.27:0/2354292337 wait complete. 2024-09-19T08:17:58.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.821+0000 7f4a73ffe640 1 Processor -- start 2024-09-19T08:17:58.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.821+0000 7f4a73ffe640 1 -- start start 2024-09-19T08:17:58.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.821+0000 7f4a73ffe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a6c100480 0x7f4a6c0fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:58.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.821+0000 7f4a73ffe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a6c100e30 0x7f4a6c0fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:58.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.821+0000 7f4a73ffe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a6c1055b0 0x7f4a6c0fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:58.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.821+0000 7f4a73ffe640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c110e50 con 0x7f4a6c100480 2024-09-19T08:17:58.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.821+0000 7f4a73ffe640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c110cd0 con 0x7f4a6c1055b0 2024-09-19T08:17:58.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.821+0000 7f4a73ffe640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c110fd0 con 0x7f4a6c100e30 2024-09-19T08:17:58.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.821+0000 7f4a71d9a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a6c100480 0x7f4a6c0fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:58.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.821+0000 7f4a71d9a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a6c100480 0x7f4a6c0fc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52170/0 (socket says 172.21.15.27:52170) 2024-09-19T08:17:58.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.821+0000 7f4a71d9a640 1 -- 172.21.15.27:0/3807314317 learned_addr learned my addr 172.21.15.27:0/3807314317 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:58.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.821+0000 7f4a71599640 1 --2- 172.21.15.27:0/3807314317 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a6c100e30 0x7f4a6c0fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:58.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.821+0000 7f4a7259b640 1 --2- 172.21.15.27:0/3807314317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a6c1055b0 0x7f4a6c0fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:58.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.822+0000 7f4a71d9a640 1 -- 172.21.15.27:0/3807314317 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a6c100e30 msgr2=0x7f4a6c0fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:58.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.822+0000 7f4a71d9a640 1 --2- 172.21.15.27:0/3807314317 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a6c100e30 0x7f4a6c0fcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.822+0000 7f4a71d9a640 1 -- 172.21.15.27:0/3807314317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a6c1055b0 msgr2=0x7f4a6c0fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:58.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.822+0000 7f4a71d9a640 1 --2- 172.21.15.27:0/3807314317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a6c1055b0 0x7f4a6c0fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.822+0000 7f4a71d9a640 1 -- 172.21.15.27:0/3807314317 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a6c1a6960 con 0x7f4a6c100480 2024-09-19T08:17:58.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.822+0000 7f4a71d9a640 1 --2- 172.21.15.27:0/3807314317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a6c100480 0x7f4a6c0fc690 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800d950 tx=0x7f4a6800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:58.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.822+0000 7f4a62ffd640 1 -- 172.21.15.27:0/3807314317 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a68017070 con 0x7f4a6c100480 2024-09-19T08:17:58.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.822+0000 7f4a62ffd640 1 -- 172.21.15.27:0/3807314317 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a68009c30 con 0x7f4a6c100480 2024-09-19T08:17:58.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.822+0000 7f4a73ffe640 1 -- 172.21.15.27:0/3807314317 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a6c1a6c50 con 0x7f4a6c100480 2024-09-19T08:17:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.822+0000 7f4a62ffd640 1 -- 172.21.15.27:0/3807314317 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6800f6b0 con 0x7f4a6c100480 2024-09-19T08:17:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.822+0000 7f4a73ffe640 1 -- 172.21.15.27:0/3807314317 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a6c1a7190 con 0x7f4a6c100480 2024-09-19T08:17:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.824+0000 7f4a62ffd640 1 -- 172.21.15.27:0/3807314317 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f4a680109d0 con 0x7f4a6c100480 2024-09-19T08:17:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.825+0000 7f4a763d7740 1 Processor -- start 2024-09-19T08:17:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.825+0000 7f4a763d7740 1 -- start start 2024-09-19T08:17:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.825+0000 7f4a763d7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55559622fb40 0x55559622e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.825+0000 7f4a763d7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55559622e5d0 0x55559622ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.825+0000 7f4a763d7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555596239370 0x55559623b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.825+0000 7f4a763d7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5555961942f0 con 0x555596239370 2024-09-19T08:17:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.825+0000 7f4a763d7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55559613bcf0 con 0x55559622e5d0 2024-09-19T08:17:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.825+0000 7f4a763d7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5555961902b0 con 0x55559622fb40 2024-09-19T08:17:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.825+0000 7f4a71599640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555596239370 0x55559623b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.825+0000 7f4a71599640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555596239370 0x55559623b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52172/0 (socket says 172.21.15.27:52172) 2024-09-19T08:17:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.825+0000 7f4a71599640 1 -- 172.21.15.27:0/1361321096 learned_addr learned my addr 172.21.15.27:0/1361321096 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.825+0000 7f4a7259b640 1 --2- 172.21.15.27:0/1361321096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55559622fb40 0x55559622e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.825+0000 7f4a62ffd640 1 --2- 172.21.15.27:0/3807314317 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f4a580a3430 0x7f4a580a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.825+0000 7f4a71d9a640 1 --2- 172.21.15.27:0/1361321096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55559622e5d0 0x55559622ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.826+0000 7f4a7259b640 1 --2- 172.21.15.27:0/3807314317 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f4a580a3430 0x7f4a580a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.826+0000 7f4a71599640 1 -- 172.21.15.27:0/1361321096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55559622fb40 msgr2=0x55559622e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.826+0000 7f4a71599640 1 --2- 172.21.15.27:0/1361321096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55559622fb40 0x55559622e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.826+0000 7f4a71599640 1 -- 172.21.15.27:0/1361321096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55559622e5d0 msgr2=0x55559622ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.826+0000 7f4a71599640 1 --2- 172.21.15.27:0/1361321096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55559622e5d0 0x55559622ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.826+0000 7f4a71599640 1 -- 172.21.15.27:0/1361321096 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555961203a0 con 0x555596239370 2024-09-19T08:17:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.826+0000 7f4a62ffd640 1 -- 172.21.15.27:0/3807314317 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f4a680cf970 con 0x7f4a6c100480 2024-09-19T08:17:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.826+0000 7f4a71599640 1 --2- 172.21.15.27:0/1361321096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555596239370 0x55559623b760 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c02a930 tx=0x7f4a5c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937407e77f982236 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.826+0000 7f4a57fff640 1 -- 172.21.15.27:0/1361321096 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c03f070 con 0x555596239370 2024-09-19T08:17:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.826+0000 7f4a7259b640 1 --2- 172.21.15.27:0/3807314317 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f4a580a3430 0x7f4a580a58f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4a64005fd0 tx=0x7f4a64004ab0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.826+0000 7f4a57fff640 1 -- 172.21.15.27:0/1361321096 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a5c004030 con 0x555596239370 2024-09-19T08:17:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.826+0000 7f4a57fff640 1 -- 172.21.15.27:0/1361321096 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c035070 con 0x555596239370 2024-09-19T08:17:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.827+0000 7f4a763d7740 1 -- 172.21.15.27:0/1361321096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555596239370 msgr2=0x55559623b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.827+0000 7f4a763d7740 1 --2- 172.21.15.27:0/1361321096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555596239370 0x55559623b760 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c02a930 tx=0x7f4a5c005e80 comp rx=0 tx=0).stop 2024-09-19T08:17:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.827+0000 7f4a763d7740 1 -- 172.21.15.27:0/1361321096 shutdown_connections 2024-09-19T08:17:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.827+0000 7f4a763d7740 1 --2- 172.21.15.27:0/1361321096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555596239370 0x55559623b760 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.827+0000 7f4a763d7740 1 --2- 172.21.15.27:0/1361321096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55559622e5d0 0x55559622ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.827+0000 7f4a763d7740 1 --2- 172.21.15.27:0/1361321096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55559622fb40 0x55559622e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.827+0000 7f4a763d7740 1 -- 172.21.15.27:0/1361321096 >> 172.21.15.27:0/1361321096 conn(0x5555961f7310 msgr2=0x55559622ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.827+0000 7f4a763d7740 1 -- 172.21.15.27:0/1361321096 shutdown_connections 2024-09-19T08:17:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.827+0000 7f4a763d7740 1 -- 172.21.15.27:0/1361321096 wait complete. 2024-09-19T08:17:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.828+0000 7f4a763d7740 1 -- start start 2024-09-19T08:17:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.828+0000 7f4a763d7740 1 Processor -- start 2024-09-19T08:17:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.828+0000 7f4a763d7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55559622e5d0 0x555596238ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.828+0000 7f4a763d7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622fb40 0x555596235f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.828+0000 7f4a763d7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555596239370 0x5555962364f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.828+0000 7f4a763d7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55559623c010 con 0x55559622fb40 2024-09-19T08:17:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.828+0000 7f4a763d7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55559614f060 con 0x555596239370 2024-09-19T08:17:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.828+0000 7f4a763d7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55559623c190 con 0x55559622e5d0 2024-09-19T08:17:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.828+0000 7f4a763d7740 10 client.0 _ll_register_callbacks cb 0x555595ea28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:58.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.828+0000 7f4a71599640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622fb40 0x555596235f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:58.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.828+0000 7f4a71599640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622fb40 0x555596235f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52180/0 (socket says 172.21.15.27:52180) 2024-09-19T08:17:58.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.828+0000 7f4a71599640 1 -- 172.21.15.27:0/187174237 learned_addr learned my addr 172.21.15.27:0/187174237 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:58.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.828+0000 7f4a7259b640 1 --2- 172.21.15.27:0/187174237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555596239370 0x5555962364f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:58.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.828+0000 7f4a71d9a640 1 --2- 172.21.15.27:0/187174237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55559622e5d0 0x555596238ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:58.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.828+0000 7f4a71599640 1 -- 172.21.15.27:0/187174237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55559622e5d0 msgr2=0x555596238ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.829+0000 7f4a71599640 1 --2- 172.21.15.27:0/187174237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55559622e5d0 0x555596238ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.829+0000 7f4a71599640 1 -- 172.21.15.27:0/187174237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555596239370 msgr2=0x5555962364f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.829+0000 7f4a71599640 1 --2- 172.21.15.27:0/187174237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555596239370 0x5555962364f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.829+0000 7f4a71599640 1 -- 172.21.15.27:0/187174237 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555595f053c0 con 0x55559622fb40 2024-09-19T08:17:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.829+0000 7f4a7259b640 1 --2- 172.21.15.27:0/187174237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555596239370 0x5555962364f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:17:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.829+0000 7f4a71d9a640 1 --2- 172.21.15.27:0/187174237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55559622e5d0 0x555596238ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:17:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.829+0000 7f4a71599640 1 --2- 172.21.15.27:0/187174237 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622fb40 0x555596235f90 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c02a450 tx=0x7f4a5c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fcca701ea9fb571 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.829+0000 7f4a557fa640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.829+0000 7f4a557fa640 1 -- 172.21.15.27:0/187174237 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c035070 con 0x55559622fb40 2024-09-19T08:17:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.829+0000 7f4a557fa640 1 -- 172.21.15.27:0/187174237 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f4a5c0317b0 con 0x55559622fb40 2024-09-19T08:17:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.829+0000 7f4a763d7740 1 -- 172.21.15.27:0/187174237 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a5c004030 con 0x55559622fb40 2024-09-19T08:17:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.829+0000 7f4a557fa640 1 -- 172.21.15.27:0/187174237 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4a5c03f040 con 0x55559622fb40 2024-09-19T08:17:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.829+0000 7f4a763d7740 10 client.16518 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.829+0000 7f4a763d7740 1 -- 172.21.15.27:0/187174237 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555596247a20 con 0x55559622fb40 2024-09-19T08:17:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.829+0000 7f4a557fa640 1 -- 172.21.15.27:0/187174237 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a5c004030 con 0x55559622fb40 2024-09-19T08:17:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.829+0000 7f4a557fa640 1 -- 172.21.15.27:0/187174237 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f4a5c0047e0 con 0x55559622fb40 2024-09-19T08:17:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.830+0000 7f4a763d7740 10 client.16518 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.830+0000 7f4a763d7740 10 client.16518 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.830+0000 7f4a763d7740 20 client.16518 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.830+0000 7f4a763d7740 1 --2- 172.21.15.27:0/187174237 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555596248d70 0x55559624b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.830+0000 7f4a763d7740 4 client.16518 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:17:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.830+0000 7f4a763d7740 1 -- 172.21.15.27:0/187174237 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555961a1860 con 0x555596248d70 2024-09-19T08:17:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.830+0000 7f4a71d9a640 1 --2- 172.21.15.27:0/187174237 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555596248d70 0x55559624b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.830+0000 7f4a71d9a640 1 --2- 172.21.15.27:0/187174237 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555596248d70 0x55559624b160 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77f3bec46715f8f server_cookie=eb37b2897e7a3f0 in_seq=0 out_seq=0 2024-09-19T08:17:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.830+0000 7f4a557fa640 10 client.16518 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.831+0000 7f4a557fa640 1 -- 172.21.15.27:0/187174237 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5555961a1860 con 0x555596248d70 2024-09-19T08:17:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.831+0000 7f4a557fa640 10 client.16518 handle_command_reply: tid=0 2024-09-19T08:17:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.831+0000 7f4a763d7740 1 client.16518 shutdown 2024-09-19T08:17:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.831+0000 7f4a763d7740 1 -- 172.21.15.27:0/187174237 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622fb40 msgr2=0x555596235f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.831+0000 7f4a763d7740 1 --2- 172.21.15.27:0/187174237 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622fb40 0x555596235f90 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c02a450 tx=0x7f4a5c0095c0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.831+0000 7f4a763d7740 1 -- 172.21.15.27:0/187174237 shutdown_connections 2024-09-19T08:17:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.831+0000 7f4a763d7740 1 --2- 172.21.15.27:0/187174237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555596239370 0x5555962364f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.831+0000 7f4a763d7740 1 --2- 172.21.15.27:0/187174237 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622fb40 0x555596235f90 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.831+0000 7f4a763d7740 1 --2- 172.21.15.27:0/187174237 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555596248d70 0x55559624b160 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.831+0000 7f4a763d7740 1 --2- 172.21.15.27:0/187174237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55559622e5d0 0x555596238ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.831+0000 7f4a557fa640 0 client.16518 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.831+0000 7f4a763d7740 1 -- 172.21.15.27:0/187174237 >> 172.21.15.27:0/187174237 conn(0x5555961f7310 msgr2=0x555596230960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.831+0000 7f4a763d7740 1 -- 172.21.15.27:0/187174237 shutdown_connections 2024-09-19T08:17:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.832+0000 7f4a763d7740 1 -- 172.21.15.27:0/187174237 wait complete. 2024-09-19T08:17:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.832+0000 7f4a763d7740 20 client.16518 trim_cache size 0 max 16384 2024-09-19T08:17:58.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.845+0000 7f4a763d7740 1 Processor -- start 2024-09-19T08:17:58.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.845+0000 7f4a763d7740 1 -- start start 2024-09-19T08:17:58.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.845+0000 7f4a763d7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622e5d0 0x5555962452b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:58.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.845+0000 7f4a763d7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55559622fb40 0x555596231120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:58.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.845+0000 7f4a763d7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555596239370 0x555596231660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:58.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.845+0000 7f4a763d7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c1ad920 con 0x55559622e5d0 2024-09-19T08:17:58.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.845+0000 7f4a763d7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c1b01a0 con 0x555596239370 2024-09-19T08:17:58.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.845+0000 7f4a763d7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c1adf90 con 0x55559622fb40 2024-09-19T08:17:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.845+0000 7f4a71d9a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622e5d0 0x5555962452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.845+0000 7f4a71d9a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622e5d0 0x5555962452b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52194/0 (socket says 172.21.15.27:52194) 2024-09-19T08:17:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.845+0000 7f4a71d9a640 1 -- 172.21.15.27:0/3982608532 learned_addr learned my addr 172.21.15.27:0/3982608532 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.846+0000 7f4a71599640 1 --2- 172.21.15.27:0/3982608532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55559622fb40 0x555596231120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.846+0000 7f4a7259b640 1 --2- 172.21.15.27:0/3982608532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555596239370 0x555596231660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.846+0000 7f4a71d9a640 1 -- 172.21.15.27:0/3982608532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55559622fb40 msgr2=0x555596231120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.846+0000 7f4a71d9a640 1 --2- 172.21.15.27:0/3982608532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55559622fb40 0x555596231120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.846+0000 7f4a71d9a640 1 -- 172.21.15.27:0/3982608532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555596239370 msgr2=0x555596231660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.846+0000 7f4a71d9a640 1 --2- 172.21.15.27:0/3982608532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555596239370 0x555596231660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.846+0000 7f4a71d9a640 1 -- 172.21.15.27:0/3982608532 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555596236860 con 0x55559622e5d0 2024-09-19T08:17:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.846+0000 7f4a71d9a640 1 --2- 172.21.15.27:0/3982608532 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622e5d0 0x5555962452b0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4a680980a0 tx=0x7f4a68086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9d71a34cab4ace server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.846+0000 7f4a577fe640 1 -- 172.21.15.27:0/3982608532 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a68020040 con 0x55559622e5d0 2024-09-19T08:17:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.846+0000 7f4a577fe640 1 -- 172.21.15.27:0/3982608532 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a68009de0 con 0x55559622e5d0 2024-09-19T08:17:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.846+0000 7f4a577fe640 1 -- 172.21.15.27:0/3982608532 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a680cd330 con 0x55559622e5d0 2024-09-19T08:17:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.847+0000 7f4a763d7740 1 -- 172.21.15.27:0/3982608532 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622e5d0 msgr2=0x5555962452b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.847+0000 7f4a763d7740 1 --2- 172.21.15.27:0/3982608532 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622e5d0 0x5555962452b0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4a680980a0 tx=0x7f4a68086040 comp rx=0 tx=0).stop 2024-09-19T08:17:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.847+0000 7f4a763d7740 1 -- 172.21.15.27:0/3982608532 shutdown_connections 2024-09-19T08:17:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.847+0000 7f4a763d7740 1 --2- 172.21.15.27:0/3982608532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555596239370 0x555596231660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.847+0000 7f4a763d7740 1 --2- 172.21.15.27:0/3982608532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55559622fb40 0x555596231120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.847+0000 7f4a763d7740 1 --2- 172.21.15.27:0/3982608532 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622e5d0 0x5555962452b0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.847+0000 7f4a763d7740 1 -- 172.21.15.27:0/3982608532 >> 172.21.15.27:0/3982608532 conn(0x5555961f7310 msgr2=0x555596238010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.847+0000 7f4a763d7740 1 -- 172.21.15.27:0/3982608532 shutdown_connections 2024-09-19T08:17:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.847+0000 7f4a763d7740 1 -- 172.21.15.27:0/3982608532 wait complete. 2024-09-19T08:17:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.847+0000 7f4a763d7740 1 -- start start 2024-09-19T08:17:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.847+0000 7f4a763d7740 1 Processor -- start 2024-09-19T08:17:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.848+0000 7f4a763d7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622e5d0 0x555596233030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.848+0000 7f4a763d7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55559622fb40 0x555596233570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.848+0000 7f4a763d7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555596239370 0x555596233ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.848+0000 7f4a763d7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c1ae660 con 0x55559622e5d0 2024-09-19T08:17:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.848+0000 7f4a763d7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c1afad0 con 0x55559622fb40 2024-09-19T08:17:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.848+0000 7f4a763d7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c1aed30 con 0x555596239370 2024-09-19T08:17:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.848+0000 7f4a763d7740 10 client.0 _ll_register_callbacks cb 0x7f4a680d2f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:17:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.848+0000 7f4a71d9a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622e5d0 0x555596233030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.848+0000 7f4a71d9a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622e5d0 0x555596233030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52196/0 (socket says 172.21.15.27:52196) 2024-09-19T08:17:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.848+0000 7f4a71d9a640 1 -- 172.21.15.27:0/3574418826 learned_addr learned my addr 172.21.15.27:0/3574418826 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:17:58.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.848+0000 7f4a7259b640 1 --2- 172.21.15.27:0/3574418826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555596239370 0x555596233ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:58.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.848+0000 7f4a71599640 1 --2- 172.21.15.27:0/3574418826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55559622fb40 0x555596233570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:58.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.848+0000 7f4a71d9a640 1 -- 172.21.15.27:0/3574418826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555596239370 msgr2=0x555596233ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:58.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.848+0000 7f4a71d9a640 1 --2- 172.21.15.27:0/3574418826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555596239370 0x555596233ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.848+0000 7f4a71d9a640 1 -- 172.21.15.27:0/3574418826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55559622fb40 msgr2=0x555596233570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:17:58.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.848+0000 7f4a71d9a640 1 --2- 172.21.15.27:0/3574418826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55559622fb40 0x555596233570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.848+0000 7f4a71d9a640 1 -- 172.21.15.27:0/3574418826 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555962b2720 con 0x55559622e5d0 2024-09-19T08:17:58.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.848+0000 7f4a71d9a640 1 --2- 172.21.15.27:0/3574418826 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622e5d0 0x555596233030 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4a6809bbd0 tx=0x7f4a6800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309e9262b2bf6d24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:17:58.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.848+0000 7f4a557fa640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:17:58.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.848+0000 7f4a557fa640 1 -- 172.21.15.27:0/3574418826 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a68020070 con 0x55559622e5d0 2024-09-19T08:17:58.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.849+0000 7f4a557fa640 1 -- 172.21.15.27:0/3574418826 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f4a680982b0 con 0x55559622e5d0 2024-09-19T08:17:58.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.849+0000 7f4a763d7740 1 -- 172.21.15.27:0/3574418826 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a68009de0 con 0x55559622e5d0 2024-09-19T08:17:58.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.849+0000 7f4a557fa640 1 -- 172.21.15.27:0/3574418826 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4a6806b070 con 0x55559622e5d0 2024-09-19T08:17:58.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.849+0000 7f4a763d7740 10 client.16524 fetch_fsmap learned FSMap version 20 2024-09-19T08:17:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.849+0000 7f4a763d7740 1 -- 172.21.15.27:0/3574418826 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5555962b3a00 con 0x55559622e5d0 2024-09-19T08:17:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.849+0000 7f4a557fa640 1 -- 172.21.15.27:0/3574418826 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a68009de0 con 0x55559622e5d0 2024-09-19T08:17:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.849+0000 7f4a557fa640 1 -- 172.21.15.27:0/3574418826 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f4a680b4030 con 0x55559622e5d0 2024-09-19T08:17:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.849+0000 7f4a763d7740 10 client.16524 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:17:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.849+0000 7f4a763d7740 10 client.16524 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:17:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.849+0000 7f4a763d7740 20 client.16524 populate_metadata read hostname 'smithi027' 2024-09-19T08:17:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.849+0000 7f4a763d7740 1 --2- 172.21.15.27:0/3574418826 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5555962b4170 0x5555962b6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:17:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.849+0000 7f4a763d7740 4 client.16524 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:17:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.849+0000 7f4a763d7740 1 -- 172.21.15.27:0/3574418826 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55559619bd70 con 0x5555962b4170 2024-09-19T08:17:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.849+0000 7f4a71599640 1 --2- 172.21.15.27:0/3574418826 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5555962b4170 0x5555962b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:17:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.850+0000 7f4a557fa640 10 client.16524 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.850+0000 7f4a71599640 1 --2- 172.21.15.27:0/3574418826 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5555962b4170 0x5555962b6590 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abb8c10dae3473bc server_cookie=24da693e6afe526 in_seq=0 out_seq=0 2024-09-19T08:17:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.850+0000 7f4a557fa640 1 -- 172.21.15.27:0/3574418826 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55559619bd70 con 0x5555962b4170 2024-09-19T08:17:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.850+0000 7f4a557fa640 10 client.16524 handle_command_reply: tid=0 2024-09-19T08:17:58.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.850+0000 7f4a763d7740 1 client.16524 shutdown 2024-09-19T08:17:58.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.850+0000 7f4a763d7740 1 -- 172.21.15.27:0/3574418826 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622e5d0 msgr2=0x555596233030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:58.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.850+0000 7f4a763d7740 1 --2- 172.21.15.27:0/3574418826 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622e5d0 0x555596233030 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4a6809bbd0 tx=0x7f4a6800bf60 comp rx=0 tx=0).stop 2024-09-19T08:17:58.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.850+0000 7f4a763d7740 1 -- 172.21.15.27:0/3574418826 shutdown_connections 2024-09-19T08:17:58.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.850+0000 7f4a763d7740 1 --2- 172.21.15.27:0/3574418826 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5555962b4170 0x5555962b6590 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.850+0000 7f4a763d7740 1 --2- 172.21.15.27:0/3574418826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555596239370 0x555596233ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.850+0000 7f4a557fa640 0 client.16524 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:17:58.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.850+0000 7f4a763d7740 1 --2- 172.21.15.27:0/3574418826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55559622fb40 0x555596233570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.850+0000 7f4a763d7740 1 --2- 172.21.15.27:0/3574418826 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55559622e5d0 0x555596233030 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.850+0000 7f4a763d7740 1 -- 172.21.15.27:0/3574418826 >> 172.21.15.27:0/3574418826 conn(0x5555961f7310 msgr2=0x555596234730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:58.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.850+0000 7f4a763d7740 1 -- 172.21.15.27:0/3574418826 shutdown_connections 2024-09-19T08:17:58.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.850+0000 7f4a763d7740 1 -- 172.21.15.27:0/3574418826 wait complete. 2024-09-19T08:17:58.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.850+0000 7f4a763d7740 20 client.16524 trim_cache size 0 max 16384 2024-09-19T08:17:58.860 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:17:58.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.851+0000 7f4a73ffe640 1 -- 172.21.15.27:0/3807314317 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f4a580a3430 msgr2=0x7f4a580a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:58.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.851+0000 7f4a73ffe640 1 --2- 172.21.15.27:0/3807314317 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f4a580a3430 0x7f4a580a58f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4a64005fd0 tx=0x7f4a64004ab0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.851+0000 7f4a73ffe640 1 -- 172.21.15.27:0/3807314317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a6c100480 msgr2=0x7f4a6c0fc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:17:58.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.851+0000 7f4a73ffe640 1 --2- 172.21.15.27:0/3807314317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a6c100480 0x7f4a6c0fc690 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800d950 tx=0x7f4a6800de10 comp rx=0 tx=0).stop 2024-09-19T08:17:58.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.851+0000 7f4a73ffe640 1 -- 172.21.15.27:0/3807314317 shutdown_connections 2024-09-19T08:17:58.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.851+0000 7f4a73ffe640 1 --2- 172.21.15.27:0/3807314317 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f4a580a3430 0x7f4a580a58f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.851+0000 7f4a73ffe640 1 --2- 172.21.15.27:0/3807314317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a6c1055b0 0x7f4a6c0fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.851+0000 7f4a73ffe640 1 --2- 172.21.15.27:0/3807314317 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a6c100e30 0x7f4a6c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.851+0000 7f4a73ffe640 1 --2- 172.21.15.27:0/3807314317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a6c100480 0x7f4a6c0fc690 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:17:58.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.851+0000 7f4a73ffe640 1 -- 172.21.15.27:0/3807314317 >> 172.21.15.27:0/3807314317 conn(0x7f4a6c077210 msgr2=0x7f4a6c10dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:17:58.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.851+0000 7f4a73ffe640 1 -- 172.21.15.27:0/3807314317 shutdown_connections 2024-09-19T08:17:58.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:17:58.851+0000 7f4a73ffe640 1 -- 172.21.15.27:0/3807314317 wait complete. 2024-09-19T08:17:59.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:17:58 smithi027 ceph-mon[31209]: pgmap v211: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-19T08:17:59.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:17:58 smithi203 ceph-mon[35198]: pgmap v211: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-19T08:17:59.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:17:58 smithi155 ceph-mon[35362]: pgmap v211: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-19T08:18:00.570 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:18:00.570 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:18:00.836 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:18:01.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:00 smithi027 ceph-mon[31209]: pgmap v212: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:18:01.257 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:01 smithi203 ceph-mon[35198]: pgmap v212: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:18:01.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.356+0000 7f3c7ec47640 1 -- 172.21.15.27:0/353393923 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c78106f50 msgr2=0x7f3c7810eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:01.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.356+0000 7f3c7ec47640 1 --2- 172.21.15.27:0/353393923 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c78106f50 0x7f3c7810eaf0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009930 tx=0x7f3c7002a420 comp rx=0 tx=0).stop 2024-09-19T08:18:01.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.356+0000 7f3c7ec47640 1 -- 172.21.15.27:0/353393923 shutdown_connections 2024-09-19T08:18:01.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.356+0000 7f3c7ec47640 1 --2- 172.21.15.27:0/353393923 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c78106f50 0x7f3c7810eaf0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.356+0000 7f3c7ec47640 1 --2- 172.21.15.27:0/353393923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c78100ca0 0x7f3c78106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.356+0000 7f3c7ec47640 1 --2- 172.21.15.27:0/353393923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c781002f0 0x7f3c781006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.356+0000 7f3c7ec47640 1 -- 172.21.15.27:0/353393923 >> 172.21.15.27:0/353393923 conn(0x7f3c78077210 msgr2=0x7f3c780fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:01.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.356+0000 7f3c7ec47640 1 -- 172.21.15.27:0/353393923 shutdown_connections 2024-09-19T08:18:01.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.356+0000 7f3c7ec47640 1 -- 172.21.15.27:0/353393923 wait complete. 2024-09-19T08:18:01.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.357+0000 7f3c7ec47640 1 Processor -- start 2024-09-19T08:18:01.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.357+0000 7f3c7ec47640 1 -- start start 2024-09-19T08:18:01.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.357+0000 7f3c7ec47640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c781002f0 0x7f3c7819f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:01.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.357+0000 7f3c7ec47640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c78100ca0 0x7f3c7819f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:01.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.357+0000 7f3c7ec47640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c78106f50 0x7f3c7810dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:01.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.357+0000 7f3c7ec47640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3c781120d0 con 0x7f3c78100ca0 2024-09-19T08:18:01.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.357+0000 7f3c7ec47640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3c78111f50 con 0x7f3c78106f50 2024-09-19T08:18:01.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.357+0000 7f3c7ec47640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3c78112250 con 0x7f3c781002f0 2024-09-19T08:18:01.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.357+0000 7f3c77fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c78100ca0 0x7f3c7819f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:01.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.357+0000 7f3c77fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c78100ca0 0x7f3c7819f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53718/0 (socket says 172.21.15.27:53718) 2024-09-19T08:18:01.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.357+0000 7f3c77fff640 1 -- 172.21.15.27:0/3256765970 learned_addr learned my addr 172.21.15.27:0/3256765970 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:01.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.357+0000 7f3c7c9e3640 1 --2- 172.21.15.27:0/3256765970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c781002f0 0x7f3c7819f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:01.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.358+0000 7f3c7d1e4640 1 --2- 172.21.15.27:0/3256765970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c78106f50 0x7f3c7810dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:01.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.358+0000 7f3c77fff640 1 -- 172.21.15.27:0/3256765970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c781002f0 msgr2=0x7f3c7819f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:01.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.358+0000 7f3c77fff640 1 --2- 172.21.15.27:0/3256765970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c781002f0 0x7f3c7819f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.358+0000 7f3c77fff640 1 -- 172.21.15.27:0/3256765970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c78106f50 msgr2=0x7f3c7810dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:01.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.358+0000 7f3c77fff640 1 --2- 172.21.15.27:0/3256765970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c78106f50 0x7f3c7810dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.358+0000 7f3c77fff640 1 -- 172.21.15.27:0/3256765970 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c7810e5a0 con 0x7f3c78100ca0 2024-09-19T08:18:01.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.358+0000 7f3c77fff640 1 --2- 172.21.15.27:0/3256765970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c78100ca0 0x7f3c7819f750 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000b450 tx=0x7f3c6000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:01.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.358+0000 7f3c75ffb640 1 -- 172.21.15.27:0/3256765970 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c60015020 con 0x7f3c78100ca0 2024-09-19T08:18:01.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.358+0000 7f3c75ffb640 1 -- 172.21.15.27:0/3256765970 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c60011d70 con 0x7f3c78100ca0 2024-09-19T08:18:01.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.358+0000 7f3c7ec47640 1 -- 172.21.15.27:0/3256765970 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c7810e830 con 0x7f3c78100ca0 2024-09-19T08:18:01.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.358+0000 7f3c75ffb640 1 -- 172.21.15.27:0/3256765970 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6000f340 con 0x7f3c78100ca0 2024-09-19T08:18:01.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.358+0000 7f3c7ec47640 1 -- 172.21.15.27:0/3256765970 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c7819ae90 con 0x7f3c78100ca0 2024-09-19T08:18:01.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.361+0000 7f3c75ffb640 1 -- 172.21.15.27:0/3256765970 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3c60018020 con 0x7f3c78100ca0 2024-09-19T08:18:01.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.361+0000 7f3c81020740 1 Processor -- start 2024-09-19T08:18:01.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.361+0000 7f3c81020740 1 -- start start 2024-09-19T08:18:01.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.361+0000 7f3c81020740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 0x559a60460f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:01.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.361+0000 7f3c81020740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a60461480 0x559a6046b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:01.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.361+0000 7f3c81020740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6046bd40 0x559a6046e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:01.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.361+0000 7f3c81020740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559a603c6280 con 0x559a60460b60 2024-09-19T08:18:01.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.361+0000 7f3c81020740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559a6036db10 con 0x559a60461480 2024-09-19T08:18:01.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.361+0000 7f3c81020740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559a603c2240 con 0x559a6046bd40 2024-09-19T08:18:01.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.361+0000 7f3c7d1e4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 0x559a60460f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:01.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.361+0000 7f3c7d1e4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 0x559a60460f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53722/0 (socket says 172.21.15.27:53722) 2024-09-19T08:18:01.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.361+0000 7f3c7d1e4640 1 -- 172.21.15.27:0/891825806 learned_addr learned my addr 172.21.15.27:0/891825806 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:01.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.361+0000 7f3c77fff640 1 --2- 172.21.15.27:0/891825806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6046bd40 0x559a6046e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:01.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.361+0000 7f3c75ffb640 1 --2- 172.21.15.27:0/3256765970 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3c640a3430 0x7f3c640a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:01.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.361+0000 7f3c7c9e3640 1 --2- 172.21.15.27:0/891825806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a60461480 0x559a6046b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:01.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.362+0000 7f3c7d1e4640 1 -- 172.21.15.27:0/891825806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6046bd40 msgr2=0x559a6046e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:01.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.362+0000 7f3c7d1e4640 1 --2- 172.21.15.27:0/891825806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6046bd40 0x559a6046e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.362+0000 7f3c7d1e4640 1 -- 172.21.15.27:0/891825806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a60461480 msgr2=0x559a6046b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:01.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.362+0000 7f3c7d1e4640 1 --2- 172.21.15.27:0/891825806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a60461480 0x559a6046b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.362+0000 7f3c7d1e4640 1 -- 172.21.15.27:0/891825806 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a6037a1f0 con 0x559a60460b60 2024-09-19T08:18:01.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.362+0000 7f3c77fff640 1 --2- 172.21.15.27:0/891825806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6046bd40 0x559a6046e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:18:01.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.362+0000 7f3c75ffb640 1 -- 172.21.15.27:0/3256765970 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f3c600cf5e0 con 0x7f3c78100ca0 2024-09-19T08:18:01.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.362+0000 7f3c7d1e4640 1 --2- 172.21.15.27:0/3256765970 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3c640a3430 0x7f3c640a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:01.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.362+0000 7f3c7d1e4640 1 --2- 172.21.15.27:0/891825806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 0x559a60460f40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3c7002a940 tx=0x7f3c700041a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d876e0ac6758a5e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:01.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.362+0000 7f3c6effd640 1 -- 172.21.15.27:0/891825806 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c70035040 con 0x559a60460b60 2024-09-19T08:18:01.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.362+0000 7f3c6effd640 1 -- 172.21.15.27:0/891825806 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c700035f0 con 0x559a60460b60 2024-09-19T08:18:01.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.362+0000 7f3c6effd640 1 -- 172.21.15.27:0/891825806 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c70004e60 con 0x559a60460b60 2024-09-19T08:18:01.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.363+0000 7f3c81020740 1 -- 172.21.15.27:0/891825806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 msgr2=0x559a60460f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:01.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.363+0000 7f3c81020740 1 --2- 172.21.15.27:0/891825806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 0x559a60460f40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3c7002a940 tx=0x7f3c700041a0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.363+0000 7f3c7d1e4640 1 --2- 172.21.15.27:0/3256765970 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3c640a3430 0x7f3c640a58f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009230 tx=0x7f3c7004a000 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:01.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.363+0000 7f3c81020740 1 -- 172.21.15.27:0/891825806 shutdown_connections 2024-09-19T08:18:01.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.363+0000 7f3c81020740 1 --2- 172.21.15.27:0/891825806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6046bd40 0x559a6046e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.363+0000 7f3c81020740 1 --2- 172.21.15.27:0/891825806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a60461480 0x559a6046b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.363+0000 7f3c81020740 1 --2- 172.21.15.27:0/891825806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 0x559a60460f40 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.363+0000 7f3c81020740 1 -- 172.21.15.27:0/891825806 >> 172.21.15.27:0/891825806 conn(0x559a6045d0f0 msgr2=0x559a6045d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:01.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.363+0000 7f3c81020740 1 -- 172.21.15.27:0/891825806 shutdown_connections 2024-09-19T08:18:01.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.363+0000 7f3c81020740 1 -- 172.21.15.27:0/891825806 wait complete. 2024-09-19T08:18:01.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.363+0000 7f3c81020740 1 -- start start 2024-09-19T08:18:01.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.363+0000 7f3c81020740 1 Processor -- start 2024-09-19T08:18:01.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.364+0000 7f3c81020740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a60460b60 0x559a60468bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:01.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.364+0000 7f3c81020740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60461480 0x559a60469100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:01.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.364+0000 7f3c81020740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6046bd40 0x559a60469640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:01.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.364+0000 7f3c81020740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559a6046e910 con 0x559a60461480 2024-09-19T08:18:01.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.364+0000 7f3c81020740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559a60380f10 con 0x559a60460b60 2024-09-19T08:18:01.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.364+0000 7f3c81020740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559a6046ea90 con 0x559a6046bd40 2024-09-19T08:18:01.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.364+0000 7f3c81020740 10 client.0 _ll_register_callbacks cb 0x559a60349a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:18:01.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.364+0000 7f3c77fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60461480 0x559a60469100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:01.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.364+0000 7f3c77fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60461480 0x559a60469100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53724/0 (socket says 172.21.15.27:53724) 2024-09-19T08:18:01.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.364+0000 7f3c77fff640 1 -- 172.21.15.27:0/4272476891 learned_addr learned my addr 172.21.15.27:0/4272476891 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:01.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.364+0000 7f3c7c9e3640 1 --2- 172.21.15.27:0/4272476891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a60460b60 0x559a60468bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:01.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.364+0000 7f3c7d1e4640 1 --2- 172.21.15.27:0/4272476891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6046bd40 0x559a60469640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:01.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.364+0000 7f3c77fff640 1 -- 172.21.15.27:0/4272476891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6046bd40 msgr2=0x559a60469640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:01.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.364+0000 7f3c77fff640 1 --2- 172.21.15.27:0/4272476891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6046bd40 0x559a60469640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.364+0000 7f3c77fff640 1 -- 172.21.15.27:0/4272476891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a60460b60 msgr2=0x559a60468bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:01.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.364+0000 7f3c77fff640 1 --2- 172.21.15.27:0/4272476891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a60460b60 0x559a60468bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.364+0000 7f3c77fff640 1 -- 172.21.15.27:0/4272476891 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a601376a0 con 0x559a60461480 2024-09-19T08:18:01.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.364+0000 7f3c77fff640 1 --2- 172.21.15.27:0/4272476891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60461480 0x559a60469100 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3c600cd380 tx=0x7f3c6009b380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86b3e240fcf1c5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:01.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.364+0000 7f3c57fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:18:01.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.364+0000 7f3c57fff640 1 -- 172.21.15.27:0/4272476891 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c600a4690 con 0x559a60461480 2024-09-19T08:18:01.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.365+0000 7f3c57fff640 1 -- 172.21.15.27:0/4272476891 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f3c60010570 con 0x559a60461480 2024-09-19T08:18:01.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.365+0000 7f3c81020740 1 -- 172.21.15.27:0/4272476891 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c700035f0 con 0x559a60461480 2024-09-19T08:18:01.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.365+0000 7f3c57fff640 1 -- 172.21.15.27:0/4272476891 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3c600b3030 con 0x559a60461480 2024-09-19T08:18:01.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.365+0000 7f3c81020740 10 client.16536 fetch_fsmap learned FSMap version 20 2024-09-19T08:18:01.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.365+0000 7f3c81020740 1 -- 172.21.15.27:0/4272476891 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559a6047a4c0 con 0x559a60461480 2024-09-19T08:18:01.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.365+0000 7f3c57fff640 1 -- 172.21.15.27:0/4272476891 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c700035f0 con 0x559a60461480 2024-09-19T08:18:01.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.365+0000 7f3c57fff640 1 -- 172.21.15.27:0/4272476891 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3c600ba290 con 0x559a60461480 2024-09-19T08:18:01.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.365+0000 7f3c81020740 10 client.16536 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:18:01.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.365+0000 7f3c81020740 10 client.16536 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:18:01.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.365+0000 7f3c81020740 20 client.16536 populate_metadata read hostname 'smithi027' 2024-09-19T08:18:01.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.365+0000 7f3c81020740 1 --2- 172.21.15.27:0/4272476891 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559a6047b980 0x559a6047de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:01.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.365+0000 7f3c81020740 4 client.16536 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:18:01.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.365+0000 7f3c81020740 1 -- 172.21.15.27:0/4272476891 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a603d37f0 con 0x559a6047b980 2024-09-19T08:18:01.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.365+0000 7f3c7c9e3640 1 --2- 172.21.15.27:0/4272476891 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559a6047b980 0x559a6047de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:01.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.366+0000 7f3c7c9e3640 1 --2- 172.21.15.27:0/4272476891 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559a6047b980 0x559a6047de20 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c79f9a70e02d9345 server_cookie=35472e81d360b187 in_seq=0 out_seq=0 2024-09-19T08:18:01.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.366+0000 7f3c57fff640 10 client.16536 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:01.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.367+0000 7f3c57fff640 1 -- 172.21.15.27:0/4272476891 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559a603d37f0 con 0x559a6047b980 2024-09-19T08:18:01.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.367+0000 7f3c57fff640 10 client.16536 handle_command_reply: tid=0 2024-09-19T08:18:01.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.367+0000 7f3c81020740 1 client.16536 shutdown 2024-09-19T08:18:01.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.367+0000 7f3c81020740 1 -- 172.21.15.27:0/4272476891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60461480 msgr2=0x559a60469100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:01.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.367+0000 7f3c81020740 1 --2- 172.21.15.27:0/4272476891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60461480 0x559a60469100 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3c600cd380 tx=0x7f3c6009b380 comp rx=0 tx=0).stop 2024-09-19T08:18:01.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.367+0000 7f3c81020740 1 -- 172.21.15.27:0/4272476891 shutdown_connections 2024-09-19T08:18:01.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.367+0000 7f3c81020740 1 --2- 172.21.15.27:0/4272476891 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559a6047b980 0x559a6047de20 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.367+0000 7f3c81020740 1 --2- 172.21.15.27:0/4272476891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6046bd40 0x559a60469640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.367+0000 7f3c81020740 1 --2- 172.21.15.27:0/4272476891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60461480 0x559a60469100 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.367+0000 7f3c81020740 1 --2- 172.21.15.27:0/4272476891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a60460b60 0x559a60468bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.367+0000 7f3c57fff640 0 client.16536 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:01.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.367+0000 7f3c81020740 1 -- 172.21.15.27:0/4272476891 >> 172.21.15.27:0/4272476891 conn(0x559a6045d0f0 msgr2=0x559a60462e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:01.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.367+0000 7f3c81020740 1 -- 172.21.15.27:0/4272476891 shutdown_connections 2024-09-19T08:18:01.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.367+0000 7f3c81020740 1 -- 172.21.15.27:0/4272476891 wait complete. 2024-09-19T08:18:01.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.367+0000 7f3c81020740 20 client.16536 trim_cache size 0 max 16384 2024-09-19T08:18:01.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.384+0000 7f3c81020740 1 Processor -- start 2024-09-19T08:18:01.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.384+0000 7f3c81020740 1 -- start start 2024-09-19T08:18:01.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.385+0000 7f3c81020740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 0x559a6045c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:01.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.385+0000 7f3c81020740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a60461480 0x559a604836f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:01.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.385+0000 7f3c81020740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6046bd40 0x559a60483c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:01.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.385+0000 7f3c81020740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3c781ba660 con 0x559a60460b60 2024-09-19T08:18:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.385+0000 7f3c81020740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3c781bcee0 con 0x559a6046bd40 2024-09-19T08:18:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.385+0000 7f3c81020740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3c781bacd0 con 0x559a60461480 2024-09-19T08:18:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.385+0000 7f3c7c9e3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 0x559a6045c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.385+0000 7f3c7c9e3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 0x559a6045c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53728/0 (socket says 172.21.15.27:53728) 2024-09-19T08:18:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.385+0000 7f3c7c9e3640 1 -- 172.21.15.27:0/3137063508 learned_addr learned my addr 172.21.15.27:0/3137063508 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.385+0000 7f3c7d1e4640 1 --2- 172.21.15.27:0/3137063508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6046bd40 0x559a60483c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.385+0000 7f3c77fff640 1 --2- 172.21.15.27:0/3137063508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a60461480 0x559a604836f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.385+0000 7f3c7c9e3640 1 -- 172.21.15.27:0/3137063508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a60461480 msgr2=0x559a604836f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.385+0000 7f3c7c9e3640 1 --2- 172.21.15.27:0/3137063508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a60461480 0x559a604836f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.385+0000 7f3c7c9e3640 1 -- 172.21.15.27:0/3137063508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6046bd40 msgr2=0x559a60483c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.385+0000 7f3c7c9e3640 1 --2- 172.21.15.27:0/3137063508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6046bd40 0x559a60483c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.385+0000 7f3c7c9e3640 1 -- 172.21.15.27:0/3137063508 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a604639d0 con 0x559a60460b60 2024-09-19T08:18:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.385+0000 7f3c7c9e3640 1 --2- 172.21.15.27:0/3137063508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 0x559a6045c160 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3c68009980 tx=0x7f3c680096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2af553e7f50f7c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.386+0000 7f3c6e7fc640 1 -- 172.21.15.27:0/3137063508 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c68026070 con 0x559a60460b60 2024-09-19T08:18:01.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.386+0000 7f3c6e7fc640 1 -- 172.21.15.27:0/3137063508 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c68018cc0 con 0x559a60460b60 2024-09-19T08:18:01.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.386+0000 7f3c6e7fc640 1 -- 172.21.15.27:0/3137063508 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c68021dc0 con 0x559a60460b60 2024-09-19T08:18:01.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.386+0000 7f3c81020740 1 -- 172.21.15.27:0/3137063508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 msgr2=0x559a6045c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:01.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.386+0000 7f3c81020740 1 --2- 172.21.15.27:0/3137063508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 0x559a6045c160 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3c68009980 tx=0x7f3c680096d0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.386+0000 7f3c81020740 1 -- 172.21.15.27:0/3137063508 shutdown_connections 2024-09-19T08:18:01.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.386+0000 7f3c81020740 1 --2- 172.21.15.27:0/3137063508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6046bd40 0x559a60483c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.386+0000 7f3c81020740 1 --2- 172.21.15.27:0/3137063508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a60461480 0x559a604836f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.386+0000 7f3c81020740 1 --2- 172.21.15.27:0/3137063508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 0x559a6045c160 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.386+0000 7f3c81020740 1 -- 172.21.15.27:0/3137063508 >> 172.21.15.27:0/3137063508 conn(0x559a6045d0f0 msgr2=0x559a6045ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.386+0000 7f3c81020740 1 -- 172.21.15.27:0/3137063508 shutdown_connections 2024-09-19T08:18:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.386+0000 7f3c81020740 1 -- 172.21.15.27:0/3137063508 wait complete. 2024-09-19T08:18:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.387+0000 7f3c81020740 1 -- start start 2024-09-19T08:18:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.387+0000 7f3c81020740 1 Processor -- start 2024-09-19T08:18:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.387+0000 7f3c81020740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 0x559a60465dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.387+0000 7f3c81020740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a60461480 0x559a60466310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.387+0000 7f3c81020740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6046bd40 0x559a60466850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.387+0000 7f3c81020740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3c781bb3a0 con 0x559a60460b60 2024-09-19T08:18:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.387+0000 7f3c81020740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3c781bc810 con 0x559a60461480 2024-09-19T08:18:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.387+0000 7f3c81020740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3c781bba70 con 0x559a6046bd40 2024-09-19T08:18:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.387+0000 7f3c81020740 10 client.0 _ll_register_callbacks cb 0x7f3c600092c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:18:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.387+0000 7f3c7c9e3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 0x559a60465dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.387+0000 7f3c7c9e3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 0x559a60465dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53736/0 (socket says 172.21.15.27:53736) 2024-09-19T08:18:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.387+0000 7f3c7c9e3640 1 -- 172.21.15.27:0/1615293951 learned_addr learned my addr 172.21.15.27:0/1615293951 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.387+0000 7f3c77fff640 1 --2- 172.21.15.27:0/1615293951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a60461480 0x559a60466310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.388+0000 7f3c7d1e4640 1 --2- 172.21.15.27:0/1615293951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6046bd40 0x559a60466850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.388+0000 7f3c7c9e3640 1 -- 172.21.15.27:0/1615293951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6046bd40 msgr2=0x559a60466850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.388+0000 7f3c7c9e3640 1 --2- 172.21.15.27:0/1615293951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6046bd40 0x559a60466850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.388+0000 7f3c7c9e3640 1 -- 172.21.15.27:0/1615293951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a60461480 msgr2=0x559a60466310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.388+0000 7f3c7c9e3640 1 --2- 172.21.15.27:0/1615293951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a60461480 0x559a60466310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.388+0000 7f3c7c9e3640 1 -- 172.21.15.27:0/1615293951 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a604e58c0 con 0x559a60460b60 2024-09-19T08:18:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.388+0000 7f3c7c9e3640 1 --2- 172.21.15.27:0/1615293951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 0x559a60465dd0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3c68004a80 tx=0x7f3c68021440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cbdf584c3b9eb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.388+0000 7f3c57fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:18:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.388+0000 7f3c57fff640 1 -- 172.21.15.27:0/1615293951 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c68026070 con 0x559a60460b60 2024-09-19T08:18:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.388+0000 7f3c57fff640 1 -- 172.21.15.27:0/1615293951 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f3c680187e0 con 0x559a60460b60 2024-09-19T08:18:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.388+0000 7f3c81020740 1 -- 172.21.15.27:0/1615293951 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c68018cc0 con 0x559a60460b60 2024-09-19T08:18:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.388+0000 7f3c57fff640 1 -- 172.21.15.27:0/1615293951 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3c680189e0 con 0x559a60460b60 2024-09-19T08:18:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.388+0000 7f3c81020740 10 client.16542 fetch_fsmap learned FSMap version 20 2024-09-19T08:18:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.388+0000 7f3c81020740 1 -- 172.21.15.27:0/1615293951 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559a604e6be0 con 0x559a60460b60 2024-09-19T08:18:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.389+0000 7f3c57fff640 1 -- 172.21.15.27:0/1615293951 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c68018cc0 con 0x559a60460b60 2024-09-19T08:18:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.389+0000 7f3c57fff640 1 -- 172.21.15.27:0/1615293951 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3c68033610 con 0x559a60460b60 2024-09-19T08:18:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.389+0000 7f3c81020740 10 client.16542 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:18:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.389+0000 7f3c81020740 10 client.16542 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:18:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.389+0000 7f3c81020740 20 client.16542 populate_metadata read hostname 'smithi027' 2024-09-19T08:18:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.389+0000 7f3c81020740 1 --2- 172.21.15.27:0/1615293951 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559a604e7290 0x559a604e96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.389+0000 7f3c81020740 4 client.16542 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:18:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.389+0000 7f3c81020740 1 -- 172.21.15.27:0/1615293951 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559a603cdd00 con 0x559a604e7290 2024-09-19T08:18:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.389+0000 7f3c77fff640 1 --2- 172.21.15.27:0/1615293951 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559a604e7290 0x559a604e96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.389+0000 7f3c57fff640 10 client.16542 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.389+0000 7f3c77fff640 1 --2- 172.21.15.27:0/1615293951 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559a604e7290 0x559a604e96b0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=608719ba89398aab server_cookie=847d479fe7dfa60c in_seq=0 out_seq=0 2024-09-19T08:18:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.390+0000 7f3c57fff640 1 -- 172.21.15.27:0/1615293951 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559a603cdd00 con 0x559a604e7290 2024-09-19T08:18:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.390+0000 7f3c57fff640 10 client.16542 handle_command_reply: tid=0 2024-09-19T08:18:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.390+0000 7f3c81020740 1 client.16542 shutdown 2024-09-19T08:18:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.390+0000 7f3c81020740 1 -- 172.21.15.27:0/1615293951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 msgr2=0x559a60465dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.390+0000 7f3c81020740 1 --2- 172.21.15.27:0/1615293951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 0x559a60465dd0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3c68004a80 tx=0x7f3c68021440 comp rx=0 tx=0).stop 2024-09-19T08:18:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.391+0000 7f3c81020740 1 -- 172.21.15.27:0/1615293951 shutdown_connections 2024-09-19T08:18:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.391+0000 7f3c81020740 1 --2- 172.21.15.27:0/1615293951 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559a604e7290 0x559a604e96b0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.391+0000 7f3c81020740 1 --2- 172.21.15.27:0/1615293951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6046bd40 0x559a60466850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.391+0000 7f3c81020740 1 --2- 172.21.15.27:0/1615293951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a60461480 0x559a60466310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.391+0000 7f3c81020740 1 --2- 172.21.15.27:0/1615293951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a60460b60 0x559a60465dd0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.391+0000 7f3c57fff640 0 client.16542 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:01.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.391+0000 7f3c81020740 1 -- 172.21.15.27:0/1615293951 >> 172.21.15.27:0/1615293951 conn(0x559a6045d0f0 msgr2=0x559a60462dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:01.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.391+0000 7f3c81020740 1 -- 172.21.15.27:0/1615293951 shutdown_connections 2024-09-19T08:18:01.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.391+0000 7f3c81020740 1 -- 172.21.15.27:0/1615293951 wait complete. 2024-09-19T08:18:01.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.391+0000 7f3c81020740 20 client.16542 trim_cache size 0 max 16384 2024-09-19T08:18:01.396 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:18:01.396 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:18:01.396 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "77fc61e5-e13d-4915-8d89-65dd60c06e7a", 2024-09-19T08:18:01.397 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:18:01.397 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:18:01.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.392+0000 7f3c7ec47640 1 -- 172.21.15.27:0/3256765970 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3c640a3430 msgr2=0x7f3c640a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:01.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.392+0000 7f3c7ec47640 1 --2- 172.21.15.27:0/3256765970 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3c640a3430 0x7f3c640a58f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009230 tx=0x7f3c7004a000 comp rx=0 tx=0).stop 2024-09-19T08:18:01.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.392+0000 7f3c7ec47640 1 -- 172.21.15.27:0/3256765970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c78100ca0 msgr2=0x7f3c7819f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:01.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.392+0000 7f3c7ec47640 1 --2- 172.21.15.27:0/3256765970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c78100ca0 0x7f3c7819f750 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000b450 tx=0x7f3c6000b910 comp rx=0 tx=0).stop 2024-09-19T08:18:01.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.392+0000 7f3c7ec47640 1 -- 172.21.15.27:0/3256765970 shutdown_connections 2024-09-19T08:18:01.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.392+0000 7f3c7ec47640 1 --2- 172.21.15.27:0/3256765970 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3c640a3430 0x7f3c640a58f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.392+0000 7f3c7ec47640 1 --2- 172.21.15.27:0/3256765970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c78106f50 0x7f3c7810dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.392+0000 7f3c7ec47640 1 --2- 172.21.15.27:0/3256765970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c78100ca0 0x7f3c7819f750 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.392+0000 7f3c7ec47640 1 --2- 172.21.15.27:0/3256765970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c781002f0 0x7f3c7819f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:01.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.392+0000 7f3c7ec47640 1 -- 172.21.15.27:0/3256765970 >> 172.21.15.27:0/3256765970 conn(0x7f3c78077210 msgr2=0x7f3c78105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:01.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.392+0000 7f3c7ec47640 1 -- 172.21.15.27:0/3256765970 shutdown_connections 2024-09-19T08:18:01.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:01.392+0000 7f3c7ec47640 1 -- 172.21.15.27:0/3256765970 wait complete. 2024-09-19T08:18:01.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:01 smithi155 ceph-mon[35362]: pgmap v212: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:18:02.232 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:18:02.490 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:18:02.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.974+0000 7f78ca4e4640 1 -- 172.21.15.27:0/1467570725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78c4101de0 msgr2=0x7f78c41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:02.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.974+0000 7f78ca4e4640 1 --2- 172.21.15.27:0/1467570725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78c4101de0 0x7f78c41021c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009900 tx=0x7f78b402a410 comp rx=0 tx=0).stop 2024-09-19T08:18:02.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.974+0000 7f78ca4e4640 1 -- 172.21.15.27:0/1467570725 shutdown_connections 2024-09-19T08:18:02.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.974+0000 7f78ca4e4640 1 --2- 172.21.15.27:0/1467570725 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78c4106f10 0x7f78c410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:02.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.974+0000 7f78ca4e4640 1 --2- 172.21.15.27:0/1467570725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78c4102790 0x7f78c41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:02.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.974+0000 7f78ca4e4640 1 --2- 172.21.15.27:0/1467570725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78c4101de0 0x7f78c41021c0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:02.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.974+0000 7f78ca4e4640 1 -- 172.21.15.27:0/1467570725 >> 172.21.15.27:0/1467570725 conn(0x7f78c40fd8c0 msgr2=0x7f78c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:02.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.974+0000 7f78ca4e4640 1 -- 172.21.15.27:0/1467570725 shutdown_connections 2024-09-19T08:18:02.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.974+0000 7f78ca4e4640 1 -- 172.21.15.27:0/1467570725 wait complete. 2024-09-19T08:18:02.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.975+0000 7f78ca4e4640 1 Processor -- start 2024-09-19T08:18:02.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.975+0000 7f78ca4e4640 1 -- start start 2024-09-19T08:18:02.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.975+0000 7f78ca4e4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78c4101de0 0x7f78c4198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:02.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.975+0000 7f78ca4e4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78c4102790 0x7f78c4198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:02.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.975+0000 7f78ca4e4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78c4106f10 0x7f78c419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:02.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.975+0000 7f78ca4e4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f78c4111f30 con 0x7f78c4101de0 2024-09-19T08:18:02.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.975+0000 7f78ca4e4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f78c4111db0 con 0x7f78c4102790 2024-09-19T08:18:02.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.975+0000 7f78ca4e4640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f78c41120b0 con 0x7f78c4106f10 2024-09-19T08:18:02.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.975+0000 7f78c3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78c4101de0 0x7f78c4198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:02.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.975+0000 7f78c3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78c4101de0 0x7f78c4198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53754/0 (socket says 172.21.15.27:53754) 2024-09-19T08:18:02.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.975+0000 7f78c3fff640 1 -- 172.21.15.27:0/3617982359 learned_addr learned my addr 172.21.15.27:0/3617982359 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:02.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.975+0000 7f78c37fe640 1 --2- 172.21.15.27:0/3617982359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78c4102790 0x7f78c4198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:02.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.975+0000 7f78c8a81640 1 --2- 172.21.15.27:0/3617982359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78c4106f10 0x7f78c419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:02.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.976+0000 7f78c3fff640 1 -- 172.21.15.27:0/3617982359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78c4106f10 msgr2=0x7f78c419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:02.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.976+0000 7f78c3fff640 1 --2- 172.21.15.27:0/3617982359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78c4106f10 0x7f78c419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:02.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.976+0000 7f78c3fff640 1 -- 172.21.15.27:0/3617982359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78c4102790 msgr2=0x7f78c4198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:02.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.976+0000 7f78c3fff640 1 --2- 172.21.15.27:0/3617982359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78c4102790 0x7f78c4198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:02.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.976+0000 7f78c3fff640 1 -- 172.21.15.27:0/3617982359 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c419d3e0 con 0x7f78c4101de0 2024-09-19T08:18:02.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.976+0000 7f78c3fff640 1 --2- 172.21.15.27:0/3617982359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78c4101de0 0x7f78c4198430 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f78b4006010 tx=0x7f78b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:02.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.976+0000 7f78c17fa640 1 -- 172.21.15.27:0/3617982359 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b403f030 con 0x7f78c4101de0 2024-09-19T08:18:02.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.976+0000 7f78c17fa640 1 -- 172.21.15.27:0/3617982359 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78b4003ce0 con 0x7f78c4101de0 2024-09-19T08:18:02.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.976+0000 7f78ca4e4640 1 -- 172.21.15.27:0/3617982359 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78c419d670 con 0x7f78c4101de0 2024-09-19T08:18:02.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.976+0000 7f78c17fa640 1 -- 172.21.15.27:0/3617982359 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b4035070 con 0x7f78c4101de0 2024-09-19T08:18:02.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.976+0000 7f78ca4e4640 1 -- 172.21.15.27:0/3617982359 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78c41a4fb0 con 0x7f78c4101de0 2024-09-19T08:18:02.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.978+0000 7f78c17fa640 1 -- 172.21.15.27:0/3617982359 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f78b4042030 con 0x7f78c4101de0 2024-09-19T08:18:02.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.979+0000 7f78cc8bd740 1 Processor -- start 2024-09-19T08:18:02.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.979+0000 7f78cc8bd740 1 -- start start 2024-09-19T08:18:02.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.979+0000 7f78cc8bd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d523a0 0x559099d52780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:02.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.979+0000 7f78cc8bd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d52cc0 0x559099d61550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:02.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.979+0000 7f78cc8bd740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 0x559099d63e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:02.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.979+0000 7f78cc8bd740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559099cb82e0 con 0x559099d61a90 2024-09-19T08:18:02.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.979+0000 7f78cc8bd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559099c5fce0 con 0x559099d523a0 2024-09-19T08:18:02.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.979+0000 7f78cc8bd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559099cb42a0 con 0x559099d52cc0 2024-09-19T08:18:02.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.979+0000 7f78c17fa640 1 --2- 172.21.15.27:0/3617982359 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f78ac0a3430 0x7f78ac0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:02.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.979+0000 7f78c37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 0x559099d63e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:02.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.979+0000 7f78c37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 0x559099d63e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53764/0 (socket says 172.21.15.27:53764) 2024-09-19T08:18:02.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.979+0000 7f78c37fe640 1 -- 172.21.15.27:0/3946247072 learned_addr learned my addr 172.21.15.27:0/3946247072 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:02.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.979+0000 7f78c3fff640 1 --2- 172.21.15.27:0/3946247072 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d52cc0 0x559099d61550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:02.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.979+0000 7f78c8a81640 1 --2- 172.21.15.27:0/3946247072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d523a0 0x559099d52780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:02.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.979+0000 7f78c8a81640 1 --2- 172.21.15.27:0/3617982359 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f78ac0a3430 0x7f78ac0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:02.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.980+0000 7f78c37fe640 1 -- 172.21.15.27:0/3946247072 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d52cc0 msgr2=0x559099d61550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:02.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.980+0000 7f78c37fe640 1 --2- 172.21.15.27:0/3946247072 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d52cc0 0x559099d61550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:02.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.980+0000 7f78c37fe640 1 -- 172.21.15.27:0/3946247072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d523a0 msgr2=0x559099d52780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:02.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.980+0000 7f78c37fe640 1 --2- 172.21.15.27:0/3946247072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d523a0 0x559099d52780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:02.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.980+0000 7f78c37fe640 1 -- 172.21.15.27:0/3946247072 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559099c44440 con 0x559099d61a90 2024-09-19T08:18:02.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.980+0000 7f78c17fa640 1 -- 172.21.15.27:0/3617982359 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f78b40f0060 con 0x7f78c4101de0 2024-09-19T08:18:02.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.980+0000 7f78c37fe640 1 --2- 172.21.15.27:0/3946247072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 0x559099d63e80 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f78b800aca0 tx=0x7f78b800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9eb57972c06f43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:02.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.980+0000 7f78c8a81640 1 --2- 172.21.15.27:0/3617982359 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f78ac0a3430 0x7f78ac0a58f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f78bc009990 tx=0x7f78bc0096a0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:02.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.980+0000 7f78aa7fc640 1 -- 172.21.15.27:0/3946247072 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b801d070 con 0x559099d61a90 2024-09-19T08:18:02.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.980+0000 7f78aa7fc640 1 -- 172.21.15.27:0/3946247072 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78b8018b20 con 0x559099d61a90 2024-09-19T08:18:02.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.980+0000 7f78aa7fc640 1 -- 172.21.15.27:0/3946247072 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8010be0 con 0x559099d61a90 2024-09-19T08:18:02.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.981+0000 7f78cc8bd740 1 -- 172.21.15.27:0/3946247072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 msgr2=0x559099d63e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:02.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.981+0000 7f78cc8bd740 1 --2- 172.21.15.27:0/3946247072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 0x559099d63e80 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f78b800aca0 tx=0x7f78b800f790 comp rx=0 tx=0).stop 2024-09-19T08:18:02.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.981+0000 7f78cc8bd740 1 -- 172.21.15.27:0/3946247072 shutdown_connections 2024-09-19T08:18:02.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.981+0000 7f78cc8bd740 1 --2- 172.21.15.27:0/3946247072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 0x559099d63e80 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:02.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.981+0000 7f78cc8bd740 1 --2- 172.21.15.27:0/3946247072 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d52cc0 0x559099d61550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:02.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.981+0000 7f78cc8bd740 1 --2- 172.21.15.27:0/3946247072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d523a0 0x559099d52780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:02.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.981+0000 7f78cc8bd740 1 -- 172.21.15.27:0/3946247072 >> 172.21.15.27:0/3946247072 conn(0x559099d4ea30 msgr2=0x559099d4ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:02.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.981+0000 7f78cc8bd740 1 -- 172.21.15.27:0/3946247072 shutdown_connections 2024-09-19T08:18:02.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.981+0000 7f78cc8bd740 1 -- 172.21.15.27:0/3946247072 wait complete. 2024-09-19T08:18:02.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.981+0000 7f78cc8bd740 1 -- start start 2024-09-19T08:18:02.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.982+0000 7f78cc8bd740 1 Processor -- start 2024-09-19T08:18:02.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.982+0000 7f78cc8bd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d523a0 0x559099d613d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:02.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.982+0000 7f78cc8bd740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d52cc0 0x559099d5e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:02.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.982+0000 7f78cc8bd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d61a90 0x559099d5ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:02.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.982+0000 7f78cc8bd740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559099d646c0 con 0x559099d52cc0 2024-09-19T08:18:02.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.982+0000 7f78cc8bd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559099c73050 con 0x559099d523a0 2024-09-19T08:18:02.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.982+0000 7f78cc8bd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559099d64840 con 0x559099d61a90 2024-09-19T08:18:02.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.982+0000 7f78c37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d52cc0 0x559099d5e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:02.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.982+0000 7f78c37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d52cc0 0x559099d5e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53768/0 (socket says 172.21.15.27:53768) 2024-09-19T08:18:02.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.982+0000 7f78cc8bd740 10 client.0 _ll_register_callbacks cb 0x559099cb3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:18:02.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.982+0000 7f78c37fe640 1 -- 172.21.15.27:0/2073796297 learned_addr learned my addr 172.21.15.27:0/2073796297 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:02.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.982+0000 7f78c8a81640 1 --2- 172.21.15.27:0/2073796297 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d61a90 0x559099d5ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:02.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.982+0000 7f78c3fff640 1 --2- 172.21.15.27:0/2073796297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d523a0 0x559099d613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:02.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.982+0000 7f78c37fe640 1 -- 172.21.15.27:0/2073796297 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d61a90 msgr2=0x559099d5ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:02.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.982+0000 7f78c37fe640 1 --2- 172.21.15.27:0/2073796297 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d61a90 0x559099d5ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:02.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.982+0000 7f78c37fe640 1 -- 172.21.15.27:0/2073796297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d523a0 msgr2=0x559099d613d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:02.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.982+0000 7f78c37fe640 1 --2- 172.21.15.27:0/2073796297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d523a0 0x559099d613d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:02.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.982+0000 7f78c37fe640 1 -- 172.21.15.27:0/2073796297 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559099a293c0 con 0x559099d52cc0 2024-09-19T08:18:02.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.983+0000 7f78c37fe640 1 --2- 172.21.15.27:0/2073796297 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d52cc0 0x559099d5e680 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f78b801b040 tx=0x7f78b8010640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7b5686e2f0e793 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:02.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.983+0000 7f78a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:18:02.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.983+0000 7f78a37fe640 1 -- 172.21.15.27:0/2073796297 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b801d050 con 0x559099d52cc0 2024-09-19T08:18:02.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.983+0000 7f78a37fe640 1 -- 172.21.15.27:0/2073796297 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f78b8010d50 con 0x559099d52cc0 2024-09-19T08:18:02.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.983+0000 7f78cc8bd740 1 -- 172.21.15.27:0/2073796297 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78b8018b20 con 0x559099d52cc0 2024-09-19T08:18:02.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.983+0000 7f78a37fe640 1 -- 172.21.15.27:0/2073796297 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f78b8032050 con 0x559099d52cc0 2024-09-19T08:18:02.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.983+0000 7f78cc8bd740 10 client.16554 fetch_fsmap learned FSMap version 20 2024-09-19T08:18:02.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.983+0000 7f78cc8bd740 1 -- 172.21.15.27:0/2073796297 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559099d700b0 con 0x559099d52cc0 2024-09-19T08:18:02.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.983+0000 7f78a37fe640 1 -- 172.21.15.27:0/2073796297 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78b8018b20 con 0x559099d52cc0 2024-09-19T08:18:02.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.984+0000 7f78a37fe640 1 -- 172.21.15.27:0/2073796297 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f78b80046c0 con 0x559099d52cc0 2024-09-19T08:18:02.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.984+0000 7f78cc8bd740 10 client.16554 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:18:02.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.984+0000 7f78cc8bd740 10 client.16554 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:18:02.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.984+0000 7f78cc8bd740 20 client.16554 populate_metadata read hostname 'smithi027' 2024-09-19T08:18:02.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.984+0000 7f78cc8bd740 1 --2- 172.21.15.27:0/2073796297 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559099d714b0 0x559099d738a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:02.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.984+0000 7f78cc8bd740 4 client.16554 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:18:02.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.984+0000 7f78cc8bd740 1 -- 172.21.15.27:0/2073796297 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559099cc5850 con 0x559099d714b0 2024-09-19T08:18:02.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.984+0000 7f78c3fff640 1 --2- 172.21.15.27:0/2073796297 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559099d714b0 0x559099d738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:02.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.985+0000 7f78c3fff640 1 --2- 172.21.15.27:0/2073796297 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559099d714b0 0x559099d738a0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcb83e90d54917af server_cookie=de9ce9b524f6e3cd in_seq=0 out_seq=0 2024-09-19T08:18:02.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.985+0000 7f78a37fe640 10 client.16554 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:02.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.985+0000 7f78a37fe640 1 -- 172.21.15.27:0/2073796297 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559099cc5850 con 0x559099d714b0 2024-09-19T08:18:02.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.985+0000 7f78a37fe640 10 client.16554 handle_command_reply: tid=0 2024-09-19T08:18:02.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.985+0000 7f78cc8bd740 1 client.16554 shutdown 2024-09-19T08:18:02.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.985+0000 7f78cc8bd740 1 -- 172.21.15.27:0/2073796297 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d52cc0 msgr2=0x559099d5e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:02.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.985+0000 7f78cc8bd740 1 --2- 172.21.15.27:0/2073796297 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d52cc0 0x559099d5e680 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f78b801b040 tx=0x7f78b8010640 comp rx=0 tx=0).stop 2024-09-19T08:18:02.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.986+0000 7f78cc8bd740 1 -- 172.21.15.27:0/2073796297 shutdown_connections 2024-09-19T08:18:02.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.986+0000 7f78cc8bd740 1 --2- 172.21.15.27:0/2073796297 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559099d714b0 0x559099d738a0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:02.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.986+0000 7f78cc8bd740 1 --2- 172.21.15.27:0/2073796297 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d61a90 0x559099d5ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:02.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.986+0000 7f78cc8bd740 1 --2- 172.21.15.27:0/2073796297 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d52cc0 0x559099d5e680 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:02.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.986+0000 7f78cc8bd740 1 --2- 172.21.15.27:0/2073796297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d523a0 0x559099d613d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:02.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.986+0000 7f78cc8bd740 1 -- 172.21.15.27:0/2073796297 >> 172.21.15.27:0/2073796297 conn(0x559099d4ea30 msgr2=0x559099d54790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:02.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.986+0000 7f78a37fe640 0 client.16554 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:02.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.986+0000 7f78cc8bd740 1 -- 172.21.15.27:0/2073796297 shutdown_connections 2024-09-19T08:18:02.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.986+0000 7f78cc8bd740 1 -- 172.21.15.27:0/2073796297 wait complete. 2024-09-19T08:18:02.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:02.986+0000 7f78cc8bd740 20 client.16554 trim_cache size 0 max 16384 2024-09-19T08:18:03.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.003+0000 7f78cc8bd740 1 Processor -- start 2024-09-19T08:18:03.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.003+0000 7f78cc8bd740 1 -- start start 2024-09-19T08:18:03.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.004+0000 7f78cc8bd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d523a0 0x559099d6d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:03.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.004+0000 7f78cc8bd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d52cc0 0x559099d78f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:03.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.004+0000 7f78cc8bd740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 0x559099d79470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:03.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.004+0000 7f78cc8bd740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f78c41a94f0 con 0x559099d61a90 2024-09-19T08:18:03.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.004+0000 7f78cc8bd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f78c41abd70 con 0x559099d52cc0 2024-09-19T08:18:03.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.004+0000 7f78cc8bd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f78c41a9b60 con 0x559099d523a0 2024-09-19T08:18:03.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.004+0000 7f78c8a81640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 0x559099d79470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:03.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.004+0000 7f78c37fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d52cc0 0x559099d78f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:03.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.004+0000 7f78c8a81640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 0x559099d79470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53772/0 (socket says 172.21.15.27:53772) 2024-09-19T08:18:03.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.004+0000 7f78c8a81640 1 -- 172.21.15.27:0/3544080697 learned_addr learned my addr 172.21.15.27:0/3544080697 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:03.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.004+0000 7f78c3fff640 1 --2- 172.21.15.27:0/3544080697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d523a0 0x559099d6d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:03.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.004+0000 7f78c8a81640 1 -- 172.21.15.27:0/3544080697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d523a0 msgr2=0x559099d6d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:03.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.004+0000 7f78c8a81640 1 --2- 172.21.15.27:0/3544080697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d523a0 0x559099d6d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:03.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.004+0000 7f78c8a81640 1 -- 172.21.15.27:0/3544080697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d52cc0 msgr2=0x559099d78f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:03.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.004+0000 7f78c8a81640 1 --2- 172.21.15.27:0/3544080697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d52cc0 0x559099d78f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:03.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.004+0000 7f78c8a81640 1 -- 172.21.15.27:0/3544080697 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559099d4fbc0 con 0x559099d61a90 2024-09-19T08:18:03.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.004+0000 7f78c3fff640 1 --2- 172.21.15.27:0/3544080697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d523a0 0x559099d6d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:18:03.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.004+0000 7f78c37fe640 1 --2- 172.21.15.27:0/3544080697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d52cc0 0x559099d78f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:18:03.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.005+0000 7f78c8a81640 1 --2- 172.21.15.27:0/3544080697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 0x559099d79470 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f78bc005c40 tx=0x7f78bc009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd7cbf263c0ca15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:03.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.005+0000 7f78a9ffb640 1 -- 172.21.15.27:0/3544080697 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78bc004b20 con 0x559099d61a90 2024-09-19T08:18:03.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.005+0000 7f78a9ffb640 1 -- 172.21.15.27:0/3544080697 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78bc00bd90 con 0x559099d61a90 2024-09-19T08:18:03.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.005+0000 7f78a9ffb640 1 -- 172.21.15.27:0/3544080697 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78bc0045b0 con 0x559099d61a90 2024-09-19T08:18:03.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.006+0000 7f78cc8bd740 1 -- 172.21.15.27:0/3544080697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 msgr2=0x559099d79470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:03.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.006+0000 7f78cc8bd740 1 --2- 172.21.15.27:0/3544080697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 0x559099d79470 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f78bc005c40 tx=0x7f78bc009920 comp rx=0 tx=0).stop 2024-09-19T08:18:03.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.006+0000 7f78cc8bd740 1 -- 172.21.15.27:0/3544080697 shutdown_connections 2024-09-19T08:18:03.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.006+0000 7f78cc8bd740 1 --2- 172.21.15.27:0/3544080697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 0x559099d79470 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:03.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.006+0000 7f78cc8bd740 1 --2- 172.21.15.27:0/3544080697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d52cc0 0x559099d78f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:03.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.006+0000 7f78cc8bd740 1 --2- 172.21.15.27:0/3544080697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d523a0 0x559099d6d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:03.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.006+0000 7f78cc8bd740 1 -- 172.21.15.27:0/3544080697 >> 172.21.15.27:0/3544080697 conn(0x559099d4ea30 msgr2=0x559099d59d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:03.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.006+0000 7f78cc8bd740 1 -- 172.21.15.27:0/3544080697 shutdown_connections 2024-09-19T08:18:03.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.006+0000 7f78cc8bd740 1 -- 172.21.15.27:0/3544080697 wait complete. 2024-09-19T08:18:03.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.006+0000 7f78cc8bd740 1 -- start start 2024-09-19T08:18:03.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.006+0000 7f78cc8bd740 1 Processor -- start 2024-09-19T08:18:03.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.006+0000 7f78cc8bd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d523a0 0x559099d65030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:03.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.006+0000 7f78cc8bd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d52cc0 0x559099d65570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:03.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.006+0000 7f78cc8bd740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 0x559099dd9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:03.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.007+0000 7f78cc8bd740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f78c41aa230 con 0x559099d61a90 2024-09-19T08:18:03.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.007+0000 7f78cc8bd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f78c41ab6a0 con 0x559099d52cc0 2024-09-19T08:18:03.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.007+0000 7f78cc8bd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f78c41aa900 con 0x559099d523a0 2024-09-19T08:18:03.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.007+0000 7f78cc8bd740 10 client.0 _ll_register_callbacks cb 0x7f78b801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:18:03.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.007+0000 7f78c8a81640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 0x559099dd9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:03.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.007+0000 7f78c3fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d523a0 0x559099d65030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:03.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.007+0000 7f78c8a81640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 0x559099dd9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53778/0 (socket says 172.21.15.27:53778) 2024-09-19T08:18:03.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.007+0000 7f78c8a81640 1 -- 172.21.15.27:0/780413651 learned_addr learned my addr 172.21.15.27:0/780413651 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:03.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.007+0000 7f78c37fe640 1 --2- 172.21.15.27:0/780413651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d52cc0 0x559099d65570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:03.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.007+0000 7f78c8a81640 1 -- 172.21.15.27:0/780413651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d523a0 msgr2=0x559099d65030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:03.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.007+0000 7f78c8a81640 1 --2- 172.21.15.27:0/780413651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d523a0 0x559099d65030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:03.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.007+0000 7f78c8a81640 1 -- 172.21.15.27:0/780413651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d52cc0 msgr2=0x559099d65570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:03.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.007+0000 7f78c8a81640 1 --2- 172.21.15.27:0/780413651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d52cc0 0x559099d65570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:03.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.007+0000 7f78c8a81640 1 -- 172.21.15.27:0/780413651 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559099dda4b0 con 0x559099d61a90 2024-09-19T08:18:03.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.007+0000 7f78c8a81640 1 --2- 172.21.15.27:0/780413651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 0x559099dd9ef0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f78bc005c10 tx=0x7f78bc004220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe6b7b5e8b704d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:03.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.007+0000 7f78a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:18:03.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.007+0000 7f78a37fe640 1 -- 172.21.15.27:0/780413651 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78bc004740 con 0x559099d61a90 2024-09-19T08:18:03.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.007+0000 7f78a37fe640 1 -- 172.21.15.27:0/780413651 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f78bc026040 con 0x559099d61a90 2024-09-19T08:18:03.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.007+0000 7f78cc8bd740 1 -- 172.21.15.27:0/780413651 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78bc00bd90 con 0x559099d61a90 2024-09-19T08:18:03.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.008+0000 7f78a37fe640 1 -- 172.21.15.27:0/780413651 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f78bc03a050 con 0x559099d61a90 2024-09-19T08:18:03.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.008+0000 7f78cc8bd740 10 client.16560 fetch_fsmap learned FSMap version 20 2024-09-19T08:18:03.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.008+0000 7f78cc8bd740 1 -- 172.21.15.27:0/780413651 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559099ddb7a0 con 0x559099d61a90 2024-09-19T08:18:03.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.008+0000 7f78a37fe640 1 -- 172.21.15.27:0/780413651 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78bc00bd90 con 0x559099d61a90 2024-09-19T08:18:03.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.008+0000 7f78a37fe640 1 -- 172.21.15.27:0/780413651 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f78bc0051e0 con 0x559099d61a90 2024-09-19T08:18:03.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.008+0000 7f78cc8bd740 10 client.16560 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:18:03.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.008+0000 7f78cc8bd740 10 client.16560 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:18:03.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.008+0000 7f78cc8bd740 20 client.16560 populate_metadata read hostname 'smithi027' 2024-09-19T08:18:03.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.008+0000 7f78cc8bd740 1 --2- 172.21.15.27:0/780413651 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559099ddbe10 0x559099dde200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:03.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.008+0000 7f78cc8bd740 4 client.16560 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:18:03.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.008+0000 7f78cc8bd740 1 -- 172.21.15.27:0/780413651 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559099d5ef50 con 0x559099ddbe10 2024-09-19T08:18:03.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.008+0000 7f78c3fff640 1 --2- 172.21.15.27:0/780413651 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559099ddbe10 0x559099dde200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:03.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.009+0000 7f78a37fe640 10 client.16560 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:03.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.009+0000 7f78c3fff640 1 --2- 172.21.15.27:0/780413651 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559099ddbe10 0x559099dde200 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0bb790c6525da1f server_cookie=c920d555f0ae9c3 in_seq=0 out_seq=0 2024-09-19T08:18:03.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.009+0000 7f78a37fe640 1 -- 172.21.15.27:0/780413651 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559099d5ef50 con 0x559099ddbe10 2024-09-19T08:18:03.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.009+0000 7f78a37fe640 10 client.16560 handle_command_reply: tid=0 2024-09-19T08:18:03.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.009+0000 7f78cc8bd740 1 client.16560 shutdown 2024-09-19T08:18:03.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.009+0000 7f78cc8bd740 1 -- 172.21.15.27:0/780413651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 msgr2=0x559099dd9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:03.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.009+0000 7f78cc8bd740 1 --2- 172.21.15.27:0/780413651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 0x559099dd9ef0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f78bc005c10 tx=0x7f78bc004220 comp rx=0 tx=0).stop 2024-09-19T08:18:03.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.009+0000 7f78cc8bd740 1 -- 172.21.15.27:0/780413651 shutdown_connections 2024-09-19T08:18:03.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.009+0000 7f78cc8bd740 1 --2- 172.21.15.27:0/780413651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559099d61a90 0x559099dd9ef0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:03.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.009+0000 7f78cc8bd740 1 --2- 172.21.15.27:0/780413651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559099d52cc0 0x559099d65570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:03.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.009+0000 7f78cc8bd740 1 --2- 172.21.15.27:0/780413651 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559099ddbe10 0x559099dde200 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:03.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.009+0000 7f78cc8bd740 1 --2- 172.21.15.27:0/780413651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559099d523a0 0x559099d65030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:03.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.009+0000 7f78cc8bd740 1 -- 172.21.15.27:0/780413651 >> 172.21.15.27:0/780413651 conn(0x559099d4ea30 msgr2=0x559099d5ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:03.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.009+0000 7f78a37fe640 0 client.16560 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:03.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.009+0000 7f78cc8bd740 1 -- 172.21.15.27:0/780413651 shutdown_connections 2024-09-19T08:18:03.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.009+0000 7f78cc8bd740 1 -- 172.21.15.27:0/780413651 wait complete. 2024-09-19T08:18:03.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.009+0000 7f78cc8bd740 20 client.16560 trim_cache size 0 max 16384 2024-09-19T08:18:03.025 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:18:03.025 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:18:03.025 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": { 2024-09-19T08:18:03.025 INFO:teuthology.orchestra.run.smithi027.stdout: "77fc61e5-e13d-4915-8d89-65dd60c06e7a": { 2024-09-19T08:18:03.026 INFO:teuthology.orchestra.run.smithi027.stdout: "path": "/", 2024-09-19T08:18:03.026 INFO:teuthology.orchestra.run.smithi027.stdout: "tag": "77fc61e5-e13d-4915-8d89-65dd60c06e7a", 2024-09-19T08:18:03.026 INFO:teuthology.orchestra.run.smithi027.stdout: "options": "recursive,force" 2024-09-19T08:18:03.026 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:18:03.026 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:18:03.026 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:18:03.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.010+0000 7f78ca4e4640 1 -- 172.21.15.27:0/3617982359 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f78ac0a3430 msgr2=0x7f78ac0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:03.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.010+0000 7f78ca4e4640 1 --2- 172.21.15.27:0/3617982359 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f78ac0a3430 0x7f78ac0a58f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f78bc009990 tx=0x7f78bc0096a0 comp rx=0 tx=0).stop 2024-09-19T08:18:03.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.010+0000 7f78ca4e4640 1 -- 172.21.15.27:0/3617982359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78c4101de0 msgr2=0x7f78c4198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:03.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.010+0000 7f78ca4e4640 1 --2- 172.21.15.27:0/3617982359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78c4101de0 0x7f78c4198430 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f78b4006010 tx=0x7f78b40042f0 comp rx=0 tx=0).stop 2024-09-19T08:18:03.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.010+0000 7f78ca4e4640 1 -- 172.21.15.27:0/3617982359 shutdown_connections 2024-09-19T08:18:03.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.010+0000 7f78ca4e4640 1 --2- 172.21.15.27:0/3617982359 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f78ac0a3430 0x7f78ac0a58f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:03.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.010+0000 7f78ca4e4640 1 --2- 172.21.15.27:0/3617982359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78c4106f10 0x7f78c419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:03.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.010+0000 7f78ca4e4640 1 --2- 172.21.15.27:0/3617982359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78c4102790 0x7f78c4198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:03.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.010+0000 7f78ca4e4640 1 --2- 172.21.15.27:0/3617982359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78c4101de0 0x7f78c4198430 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:03.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.010+0000 7f78ca4e4640 1 -- 172.21.15.27:0/3617982359 >> 172.21.15.27:0/3617982359 conn(0x7f78c40fd8c0 msgr2=0x7f78c40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:03.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.010+0000 7f78ca4e4640 1 -- 172.21.15.27:0/3617982359 shutdown_connections 2024-09-19T08:18:03.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:03.010+0000 7f78ca4e4640 1 -- 172.21.15.27:0/3617982359 wait complete. 2024-09-19T08:18:03.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:03 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:18:03.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:03 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:18:03.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:03 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:18:03.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:03 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:18:03.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:03 smithi027 ceph-mon[31209]: pgmap v213: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:18:03.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:03 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:18:03.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:03 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:18:03.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:03 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:18:03.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:03 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:18:03.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:03 smithi203 ceph-mon[35198]: pgmap v213: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:18:03.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:03 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:18:03.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:03 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:18:03.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:03 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:18:03.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:03 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:18:03.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:03 smithi155 ceph-mon[35362]: pgmap v213: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:18:03.846 INFO:tasks.cephfs.filesystem:scrub status for tag:77fc61e5-e13d-4915-8d89-65dd60c06e7a - {'path': '/', 'tag': '77fc61e5-e13d-4915-8d89-65dd60c06e7a', 'options': 'recursive,force'} 2024-09-19T08:18:05.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:05 smithi203 ceph-mon[35198]: pgmap v214: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-19T08:18:05.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:05 smithi155 ceph-mon[35362]: pgmap v214: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-19T08:18:05.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:05 smithi027 ceph-mon[31209]: pgmap v214: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-19T08:18:06.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:06 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:18:06.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:06 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:18:06.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:06 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:18:07.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:07 smithi155 ceph-mon[35362]: pgmap v215: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:18:07.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:07 smithi155 ceph-mon[35362]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T08:18:07.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:07 smithi027 ceph-mon[31209]: pgmap v215: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:18:07.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:07 smithi027 ceph-mon[31209]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T08:18:07.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:07 smithi203 ceph-mon[35198]: pgmap v215: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:18:07.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:07 smithi203 ceph-mon[35198]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T08:18:09.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:09 smithi155 ceph-mon[35362]: pgmap v217: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-19T08:18:09.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:09 smithi027 ceph-mon[31209]: pgmap v217: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-19T08:18:09.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:09 smithi203 ceph-mon[35198]: pgmap v217: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-19T08:18:11.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:11 smithi155 ceph-mon[35362]: pgmap v218: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-19T08:18:11.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:11 smithi155 ceph-mon[35362]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T08:18:11.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:11 smithi027 ceph-mon[31209]: pgmap v218: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-19T08:18:11.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:11 smithi027 ceph-mon[31209]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T08:18:11.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:11 smithi203 ceph-mon[35198]: pgmap v218: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-19T08:18:11.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:11 smithi203 ceph-mon[35198]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T08:18:13.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:13 smithi155 ceph-mon[35362]: pgmap v220: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-19T08:18:13.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:13 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:18:13.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:13 smithi027 ceph-mon[31209]: pgmap v220: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-19T08:18:13.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:13 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:18:13.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:13 smithi203 ceph-mon[35198]: pgmap v220: 97 pgs: 97 active+clean; 16 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-19T08:18:13.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:13 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:18:14.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:14 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:18:14.488 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:14 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:18:14.488 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:14 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:18:14.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:14 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:18:14.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:14 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:18:14.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:14 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:18:14.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:14 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:18:14.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:14 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:18:14.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:14 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:18:15.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:15 smithi155 ceph-mon[35362]: pgmap v221: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:18:15.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:15 smithi027 ceph-mon[31209]: pgmap v221: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:18:15.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:15 smithi203 ceph-mon[35198]: pgmap v221: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:18:17.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:17 smithi155 ceph-mon[35362]: pgmap v222: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 217 B/s wr, 2 op/s 2024-09-19T08:18:17.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:17 smithi027 ceph-mon[31209]: pgmap v222: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 217 B/s wr, 2 op/s 2024-09-19T08:18:17.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:17 smithi203 ceph-mon[35198]: pgmap v222: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 217 B/s wr, 2 op/s 2024-09-19T08:18:19.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:19 smithi155 ceph-mon[35362]: pgmap v223: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T08:18:19.505 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:19 smithi027 ceph-mon[31209]: pgmap v223: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T08:18:19.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:19 smithi203 ceph-mon[35198]: pgmap v223: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T08:18:21.303 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:21 smithi027 ceph-mon[31209]: pgmap v224: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T08:18:21.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:21 smithi155 ceph-mon[35362]: pgmap v224: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T08:18:21.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:21 smithi203 ceph-mon[35198]: pgmap v224: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T08:18:23.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:23 smithi155 ceph-mon[35362]: pgmap v225: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 96 B/s wr, 2 op/s 2024-09-19T08:18:23.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:23 smithi027 ceph-mon[31209]: pgmap v225: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 96 B/s wr, 2 op/s 2024-09-19T08:18:23.507 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:23 smithi203 ceph-mon[35198]: pgmap v225: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 96 B/s wr, 2 op/s 2024-09-19T08:18:25.310 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:25 smithi203 ceph-mon[35198]: pgmap v226: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T08:18:25.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:25 smithi155 ceph-mon[35362]: pgmap v226: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T08:18:25.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:25 smithi027 ceph-mon[31209]: pgmap v226: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T08:18:27.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:27 smithi155 ceph-mon[35362]: pgmap v227: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:27.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:27 smithi027 ceph-mon[31209]: pgmap v227: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:27.507 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:27 smithi203 ceph-mon[35198]: pgmap v227: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:29.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:29 smithi155 ceph-mon[35362]: pgmap v228: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:18:29.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:29 smithi027 ceph-mon[31209]: pgmap v228: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:18:29.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:29 smithi203 ceph-mon[35198]: pgmap v228: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:18:31.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:31 smithi155 ceph-mon[35362]: pgmap v229: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:31.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:31 smithi027 ceph-mon[31209]: pgmap v229: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:31.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:31 smithi203 ceph-mon[35198]: pgmap v229: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:33.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:33 smithi155 ceph-mon[35362]: pgmap v230: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:33.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:33 smithi027 ceph-mon[31209]: pgmap v230: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:33.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:33 smithi203 ceph-mon[35198]: pgmap v230: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:33.848 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:18:34.119 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:18:34.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.595+0000 7f918b351640 1 -- 172.21.15.27:0/2583106072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9184102ef0 msgr2=0x7f918410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:34.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.595+0000 7f918b351640 1 --2- 172.21.15.27:0/2583106072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9184102ef0 0x7f918410da40 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f917c009ca0 tx=0x7f917c02a950 comp rx=0 tx=0).stop 2024-09-19T08:18:34.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.595+0000 7f918b351640 1 -- 172.21.15.27:0/2583106072 shutdown_connections 2024-09-19T08:18:34.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.595+0000 7f918b351640 1 --2- 172.21.15.27:0/2583106072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9184102ef0 0x7f918410da40 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.595+0000 7f918b351640 1 --2- 172.21.15.27:0/2583106072 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9184102570 0x7f91841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.595+0000 7f918b351640 1 --2- 172.21.15.27:0/2583106072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9184100e20 0x7f9184101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.595+0000 7f918b351640 1 -- 172.21.15.27:0/2583106072 >> 172.21.15.27:0/2583106072 conn(0x7f91840fc7d0 msgr2=0x7f91840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:34.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.595+0000 7f918b351640 1 -- 172.21.15.27:0/2583106072 shutdown_connections 2024-09-19T08:18:34.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.595+0000 7f918b351640 1 -- 172.21.15.27:0/2583106072 wait complete. 2024-09-19T08:18:34.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.596+0000 7f918b351640 1 Processor -- start 2024-09-19T08:18:34.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.596+0000 7f918b351640 1 -- start start 2024-09-19T08:18:34.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.596+0000 7f918b351640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9184100e20 0x7f9184199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:34.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.596+0000 7f918b351640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9184102570 0x7f9184199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:34.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.596+0000 7f918b351640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9184102ef0 0x7f91841a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:34.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.596+0000 7f918b351640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9184110fa0 con 0x7f9184102570 2024-09-19T08:18:34.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.596+0000 7f918b351640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9184110e20 con 0x7f9184100e20 2024-09-19T08:18:34.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.596+0000 7f918b351640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9184111120 con 0x7f9184102ef0 2024-09-19T08:18:34.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.596+0000 7f91888ec640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9184102570 0x7f9184199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:34.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.596+0000 7f91888ec640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9184102570 0x7f9184199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45992/0 (socket says 172.21.15.27:45992) 2024-09-19T08:18:34.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.596+0000 7f91888ec640 1 -- 172.21.15.27:0/2762299746 learned_addr learned my addr 172.21.15.27:0/2762299746 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:34.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.596+0000 7f91890ed640 1 --2- 172.21.15.27:0/2762299746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9184100e20 0x7f9184199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:34.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.596+0000 7f91898ee640 1 --2- 172.21.15.27:0/2762299746 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9184102ef0 0x7f91841a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:34.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.596+0000 7f91888ec640 1 -- 172.21.15.27:0/2762299746 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9184102ef0 msgr2=0x7f91841a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:34.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.596+0000 7f91888ec640 1 --2- 172.21.15.27:0/2762299746 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9184102ef0 0x7f91841a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.596+0000 7f91888ec640 1 -- 172.21.15.27:0/2762299746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9184100e20 msgr2=0x7f9184199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:34.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.596+0000 7f91888ec640 1 --2- 172.21.15.27:0/2762299746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9184100e20 0x7f9184199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.596+0000 7f91888ec640 1 -- 172.21.15.27:0/2762299746 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91841a48d0 con 0x7f9184102570 2024-09-19T08:18:34.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.596+0000 7f91898ee640 1 --2- 172.21.15.27:0/2762299746 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9184102ef0 0x7f91841a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:18:34.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.597+0000 7f91888ec640 1 --2- 172.21.15.27:0/2762299746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9184102570 0x7f9184199850 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f917400c890 tx=0x7f917400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:34.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.597+0000 7f917a7fc640 1 -- 172.21.15.27:0/2762299746 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174004220 con 0x7f9184102570 2024-09-19T08:18:34.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.597+0000 7f918b351640 1 -- 172.21.15.27:0/2762299746 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91841a4aa0 con 0x7f9184102570 2024-09-19T08:18:34.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.597+0000 7f917a7fc640 1 -- 172.21.15.27:0/2762299746 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91740043c0 con 0x7f9184102570 2024-09-19T08:18:34.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.597+0000 7f917a7fc640 1 -- 172.21.15.27:0/2762299746 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174004a00 con 0x7f9184102570 2024-09-19T08:18:34.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.597+0000 7f918b351640 1 -- 172.21.15.27:0/2762299746 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91841a5030 con 0x7f9184102570 2024-09-19T08:18:34.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.599+0000 7f917a7fc640 1 -- 172.21.15.27:0/2762299746 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f91740079b0 con 0x7f9184102570 2024-09-19T08:18:34.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.600+0000 7f918d72a740 1 Processor -- start 2024-09-19T08:18:34.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.600+0000 7f917a7fc640 1 --2- 172.21.15.27:0/2762299746 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f91700a33b0 0x7f91700a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:34.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.600+0000 7f918d72a740 1 -- start start 2024-09-19T08:18:34.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.600+0000 7f91898ee640 1 --2- 172.21.15.27:0/2762299746 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f91700a33b0 0x7f91700a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:34.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.600+0000 7f917a7fc640 1 -- 172.21.15.27:0/2762299746 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f91740cf9d0 con 0x7f9184102570 2024-09-19T08:18:34.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.600+0000 7f918d72a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c7809e4a0 0x556c7809e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:34.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.600+0000 7f918d72a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809edc0 0x556c780a9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:34.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.600+0000 7f918d72a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c780a9680 0x556c780aba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:34.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.600+0000 7f918d72a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556c780042e0 con 0x556c780a9680 2024-09-19T08:18:34.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.600+0000 7f918d72a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x556c77fabce0 con 0x556c7809edc0 2024-09-19T08:18:34.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.600+0000 7f918d72a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556c780002a0 con 0x556c7809e4a0 2024-09-19T08:18:34.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.600+0000 7f91890ed640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c7809e4a0 0x556c7809e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:34.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.600+0000 7f91890ed640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c7809e4a0 0x556c7809e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.27:57752/0 (socket says 172.21.15.27:57752) 2024-09-19T08:18:34.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.600+0000 7f91890ed640 1 -- 172.21.15.27:0/1994563879 learned_addr learned my addr 172.21.15.27:0/1994563879 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:34.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.600+0000 7f91898ee640 1 --2- 172.21.15.27:0/1994563879 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c780a9680 0x556c780aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:34.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.601+0000 7f91888ec640 1 --2- 172.21.15.27:0/1994563879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809edc0 0x556c780a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:34.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.601+0000 7f91898ee640 1 --2- 172.21.15.27:0/2762299746 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f91700a33b0 0x7f91700a5870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f917c005cc0 tx=0x7f917c0099c0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:34.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.601+0000 7f91898ee640 1 -- 172.21.15.27:0/1994563879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c7809e4a0 msgr2=0x556c7809e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:34.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.601+0000 7f91898ee640 1 --2- 172.21.15.27:0/1994563879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c7809e4a0 0x556c7809e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.601+0000 7f91898ee640 1 -- 172.21.15.27:0/1994563879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809edc0 msgr2=0x556c780a9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:34.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.601+0000 7f91898ee640 1 --2- 172.21.15.27:0/1994563879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809edc0 0x556c780a9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.601+0000 7f91898ee640 1 -- 172.21.15.27:0/1994563879 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c77f90440 con 0x556c780a9680 2024-09-19T08:18:34.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.601+0000 7f91890ed640 1 --2- 172.21.15.27:0/1994563879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c7809e4a0 0x556c7809e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:18:34.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.601+0000 7f91898ee640 1 --2- 172.21.15.27:0/1994563879 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c780a9680 0x556c780aba70 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f917c006010 tx=0x7f917c046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4cd2093baf9ed6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:34.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.601+0000 7f916f7fe640 1 -- 172.21.15.27:0/1994563879 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c041040 con 0x556c780a9680 2024-09-19T08:18:34.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.601+0000 7f916f7fe640 1 -- 172.21.15.27:0/1994563879 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f917c04c070 con 0x556c780a9680 2024-09-19T08:18:34.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.601+0000 7f916f7fe640 1 -- 172.21.15.27:0/1994563879 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c034040 con 0x556c780a9680 2024-09-19T08:18:34.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.602+0000 7f918d72a740 1 -- 172.21.15.27:0/1994563879 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c780a9680 msgr2=0x556c780aba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:34.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.602+0000 7f918d72a740 1 --2- 172.21.15.27:0/1994563879 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c780a9680 0x556c780aba70 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f917c006010 tx=0x7f917c046000 comp rx=0 tx=0).stop 2024-09-19T08:18:34.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.602+0000 7f918d72a740 1 -- 172.21.15.27:0/1994563879 shutdown_connections 2024-09-19T08:18:34.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.602+0000 7f918d72a740 1 --2- 172.21.15.27:0/1994563879 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c780a9680 0x556c780aba70 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.602+0000 7f918d72a740 1 --2- 172.21.15.27:0/1994563879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809edc0 0x556c780a9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.602+0000 7f918d72a740 1 --2- 172.21.15.27:0/1994563879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c7809e4a0 0x556c7809e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.602+0000 7f918d72a740 1 -- 172.21.15.27:0/1994563879 >> 172.21.15.27:0/1994563879 conn(0x556c7809aa30 msgr2=0x556c7809ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:34.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.602+0000 7f918d72a740 1 -- 172.21.15.27:0/1994563879 shutdown_connections 2024-09-19T08:18:34.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.602+0000 7f918d72a740 1 -- 172.21.15.27:0/1994563879 wait complete. 2024-09-19T08:18:34.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.602+0000 7f918d72a740 1 -- start start 2024-09-19T08:18:34.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.602+0000 7f918d72a740 1 Processor -- start 2024-09-19T08:18:34.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.603+0000 7f918d72a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809e4a0 0x556c780a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:34.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.603+0000 7f918d72a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7809edc0 0x556c780a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:34.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.603+0000 7f918d72a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c780a9680 0x556c780a6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:34.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.603+0000 7f918d72a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556c780ac250 con 0x556c7809edc0 2024-09-19T08:18:34.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.603+0000 7f918d72a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x556c77fbf050 con 0x556c7809e4a0 2024-09-19T08:18:34.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.603+0000 7f918d72a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556c780ac3d0 con 0x556c780a9680 2024-09-19T08:18:34.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.603+0000 7f918d72a740 10 client.0 _ll_register_callbacks cb 0x556c77fff160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:18:34.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.603+0000 7f91888ec640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7809edc0 0x556c780a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:34.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.603+0000 7f91888ec640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7809edc0 0x556c780a61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45998/0 (socket says 172.21.15.27:45998) 2024-09-19T08:18:34.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.603+0000 7f91888ec640 1 -- 172.21.15.27:0/351230190 learned_addr learned my addr 172.21.15.27:0/351230190 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:34.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.603+0000 7f91898ee640 1 --2- 172.21.15.27:0/351230190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c780a9680 0x556c780a6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:34.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.603+0000 7f91890ed640 1 --2- 172.21.15.27:0/351230190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809e4a0 0x556c780a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:34.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.603+0000 7f91888ec640 1 -- 172.21.15.27:0/351230190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c780a9680 msgr2=0x556c780a6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:34.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.603+0000 7f91888ec640 1 --2- 172.21.15.27:0/351230190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c780a9680 0x556c780a6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.603+0000 7f91888ec640 1 -- 172.21.15.27:0/351230190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809e4a0 msgr2=0x556c780a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:34.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.603+0000 7f91888ec640 1 --2- 172.21.15.27:0/351230190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809e4a0 0x556c780a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.603+0000 7f91888ec640 1 -- 172.21.15.27:0/351230190 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c77d753c0 con 0x556c7809edc0 2024-09-19T08:18:34.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.603+0000 7f91888ec640 1 --2- 172.21.15.27:0/351230190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7809edc0 0x556c780a61e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f91740cd1a0 tx=0x7f917409b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=924e927cffaeb0c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:34.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.603+0000 7f916cff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:18:34.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.604+0000 7f916cff9640 1 -- 172.21.15.27:0/351230190 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917401d040 con 0x556c7809edc0 2024-09-19T08:18:34.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.604+0000 7f916cff9640 1 -- 172.21.15.27:0/351230190 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f917409b120 con 0x556c7809edc0 2024-09-19T08:18:34.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.604+0000 7f918d72a740 1 -- 172.21.15.27:0/351230190 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f917c04c070 con 0x556c7809edc0 2024-09-19T08:18:34.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.604+0000 7f916cff9640 1 -- 172.21.15.27:0/351230190 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f91740a0080 con 0x556c7809edc0 2024-09-19T08:18:34.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.604+0000 7f918d72a740 10 client.16572 fetch_fsmap learned FSMap version 20 2024-09-19T08:18:34.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.604+0000 7f918d72a740 1 -- 172.21.15.27:0/351230190 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556c780b7b70 con 0x556c7809edc0 2024-09-19T08:18:34.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.604+0000 7f916cff9640 1 -- 172.21.15.27:0/351230190 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f917c04c070 con 0x556c7809edc0 2024-09-19T08:18:34.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.604+0000 7f916cff9640 1 -- 172.21.15.27:0/351230190 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f91740b3020 con 0x556c7809edc0 2024-09-19T08:18:34.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.604+0000 7f918d72a740 10 client.16572 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:18:34.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.604+0000 7f918d72a740 10 client.16572 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:18:34.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.604+0000 7f918d72a740 20 client.16572 populate_metadata read hostname 'smithi027' 2024-09-19T08:18:34.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.604+0000 7f918d72a740 1 --2- 172.21.15.27:0/351230190 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556c780b8ff0 0x556c780bb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:34.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.604+0000 7f918d72a740 4 client.16572 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:18:34.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.604+0000 7f918d72a740 1 -- 172.21.15.27:0/351230190 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c78011850 con 0x556c780b8ff0 2024-09-19T08:18:34.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.604+0000 7f91890ed640 1 --2- 172.21.15.27:0/351230190 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556c780b8ff0 0x556c780bb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:34.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.605+0000 7f91890ed640 1 --2- 172.21.15.27:0/351230190 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556c780b8ff0 0x556c780bb470 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=274fadcd22f8cfe1 server_cookie=75dbb8ad0105aa25 in_seq=0 out_seq=0 2024-09-19T08:18:34.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.605+0000 7f916cff9640 10 client.16572 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:34.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.605+0000 7f916cff9640 1 -- 172.21.15.27:0/351230190 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556c78011850 con 0x556c780b8ff0 2024-09-19T08:18:34.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.605+0000 7f916cff9640 10 client.16572 handle_command_reply: tid=0 2024-09-19T08:18:34.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.605+0000 7f918d72a740 1 client.16572 shutdown 2024-09-19T08:18:34.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.606+0000 7f918d72a740 1 -- 172.21.15.27:0/351230190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7809edc0 msgr2=0x556c780a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:34.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.606+0000 7f918d72a740 1 --2- 172.21.15.27:0/351230190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7809edc0 0x556c780a61e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f91740cd1a0 tx=0x7f917409b8d0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.606+0000 7f918d72a740 1 -- 172.21.15.27:0/351230190 shutdown_connections 2024-09-19T08:18:34.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.606+0000 7f918d72a740 1 --2- 172.21.15.27:0/351230190 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556c780b8ff0 0x556c780bb470 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.606+0000 7f918d72a740 1 --2- 172.21.15.27:0/351230190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c780a9680 0x556c780a6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.606+0000 7f918d72a740 1 --2- 172.21.15.27:0/351230190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7809edc0 0x556c780a61e0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.606+0000 7f918d72a740 1 --2- 172.21.15.27:0/351230190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809e4a0 0x556c780a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.606+0000 7f916cff9640 0 client.16572 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:34.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.606+0000 7f918d72a740 1 -- 172.21.15.27:0/351230190 >> 172.21.15.27:0/351230190 conn(0x556c7809aa30 msgr2=0x556c780a0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:34.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.606+0000 7f918d72a740 1 -- 172.21.15.27:0/351230190 shutdown_connections 2024-09-19T08:18:34.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.606+0000 7f918d72a740 1 -- 172.21.15.27:0/351230190 wait complete. 2024-09-19T08:18:34.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.606+0000 7f918d72a740 20 client.16572 trim_cache size 0 max 16384 2024-09-19T08:18:34.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.623+0000 7f918d72a740 1 Processor -- start 2024-09-19T08:18:34.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.623+0000 7f918d72a740 1 -- start start 2024-09-19T08:18:34.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.624+0000 7f918d72a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809e4a0 0x556c780b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:34.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.624+0000 7f918d72a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c7809edc0 0x556c780a1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:34.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.624+0000 7f918d72a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c780a9680 0x556c780a8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:34.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.624+0000 7f918d72a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f91841ab790 con 0x556c780a9680 2024-09-19T08:18:34.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.624+0000 7f918d72a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f91841adff0 con 0x556c7809e4a0 2024-09-19T08:18:34.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.624+0000 7f918d72a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f91841abde0 con 0x556c7809edc0 2024-09-19T08:18:34.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.624+0000 7f91898ee640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c780a9680 0x556c780a8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:34.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.624+0000 7f91898ee640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c780a9680 0x556c780a8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46010/0 (socket says 172.21.15.27:46010) 2024-09-19T08:18:34.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.624+0000 7f91898ee640 1 -- 172.21.15.27:0/791051577 learned_addr learned my addr 172.21.15.27:0/791051577 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:34.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.624+0000 7f91890ed640 1 --2- 172.21.15.27:0/791051577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809e4a0 0x556c780b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:34.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.624+0000 7f91888ec640 1 --2- 172.21.15.27:0/791051577 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c7809edc0 0x556c780a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:34.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.624+0000 7f91898ee640 1 -- 172.21.15.27:0/791051577 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c7809edc0 msgr2=0x556c780a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:34.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.624+0000 7f91898ee640 1 --2- 172.21.15.27:0/791051577 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c7809edc0 0x556c780a1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.624+0000 7f91898ee640 1 -- 172.21.15.27:0/791051577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809e4a0 msgr2=0x556c780b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:34.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.624+0000 7f91898ee640 1 --2- 172.21.15.27:0/791051577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809e4a0 0x556c780b54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.624+0000 7f91898ee640 1 -- 172.21.15.27:0/791051577 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c780ac2a0 con 0x556c780a9680 2024-09-19T08:18:34.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.624+0000 7f91890ed640 1 --2- 172.21.15.27:0/791051577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809e4a0 0x556c780b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:18:34.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.624+0000 7f91898ee640 1 --2- 172.21.15.27:0/791051577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c780a9680 0x556c780a8150 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f917c0484b0 tx=0x7f917c03d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c4c1db3a141667 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:34.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.625+0000 7f916effd640 1 -- 172.21.15.27:0/791051577 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c041070 con 0x556c780a9680 2024-09-19T08:18:34.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.625+0000 7f916effd640 1 -- 172.21.15.27:0/791051577 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f917c05a070 con 0x556c780a9680 2024-09-19T08:18:34.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.625+0000 7f916effd640 1 -- 172.21.15.27:0/791051577 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c034050 con 0x556c780a9680 2024-09-19T08:18:34.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.625+0000 7f918d72a740 1 -- 172.21.15.27:0/791051577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c780a9680 msgr2=0x556c780a8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:34.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.625+0000 7f918d72a740 1 --2- 172.21.15.27:0/791051577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c780a9680 0x556c780a8150 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f917c0484b0 tx=0x7f917c03d040 comp rx=0 tx=0).stop 2024-09-19T08:18:34.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.625+0000 7f918d72a740 1 -- 172.21.15.27:0/791051577 shutdown_connections 2024-09-19T08:18:34.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.625+0000 7f918d72a740 1 --2- 172.21.15.27:0/791051577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c780a9680 0x556c780a8150 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.625+0000 7f918d72a740 1 --2- 172.21.15.27:0/791051577 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c7809edc0 0x556c780a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.625+0000 7f918d72a740 1 --2- 172.21.15.27:0/791051577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809e4a0 0x556c780b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.625+0000 7f918d72a740 1 -- 172.21.15.27:0/791051577 >> 172.21.15.27:0/791051577 conn(0x556c7809aa30 msgr2=0x556c780a7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:34.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.625+0000 7f918d72a740 1 -- 172.21.15.27:0/791051577 shutdown_connections 2024-09-19T08:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.625+0000 7f918d72a740 1 -- 172.21.15.27:0/791051577 wait complete. 2024-09-19T08:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.626+0000 7f918d72a740 1 -- start start 2024-09-19T08:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.626+0000 7f918d72a740 1 Processor -- start 2024-09-19T08:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.626+0000 7f918d72a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7809e4a0 0x556c7811bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.626+0000 7f918d72a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809edc0 0x556c7811c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.626+0000 7f918d72a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c780a9680 0x556c78126d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.626+0000 7f918d72a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f91841ac4b0 con 0x556c7809e4a0 2024-09-19T08:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.626+0000 7f918d72a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f91841ad920 con 0x556c7809edc0 2024-09-19T08:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.626+0000 7f918d72a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f91841acb80 con 0x556c780a9680 2024-09-19T08:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.626+0000 7f918d72a740 10 client.0 _ll_register_callbacks cb 0x7f91740058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.626+0000 7f91890ed640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7809e4a0 0x556c7811bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.626+0000 7f91890ed640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7809e4a0 0x556c7811bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46024/0 (socket says 172.21.15.27:46024) 2024-09-19T08:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.626+0000 7f91890ed640 1 -- 172.21.15.27:0/1210238727 learned_addr learned my addr 172.21.15.27:0/1210238727 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:34.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.627+0000 7f91888ec640 1 --2- 172.21.15.27:0/1210238727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809edc0 0x556c7811c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:34.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.627+0000 7f91898ee640 1 --2- 172.21.15.27:0/1210238727 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c780a9680 0x556c78126d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:34.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.627+0000 7f91890ed640 1 -- 172.21.15.27:0/1210238727 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c780a9680 msgr2=0x556c78126d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:34.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.627+0000 7f91890ed640 1 --2- 172.21.15.27:0/1210238727 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c780a9680 0x556c78126d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.627+0000 7f91890ed640 1 -- 172.21.15.27:0/1210238727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809edc0 msgr2=0x556c7811c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:34.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.627+0000 7f91890ed640 1 --2- 172.21.15.27:0/1210238727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809edc0 0x556c7811c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.627+0000 7f91890ed640 1 -- 172.21.15.27:0/1210238727 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c78127290 con 0x556c7809e4a0 2024-09-19T08:18:34.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.627+0000 7f91890ed640 1 --2- 172.21.15.27:0/1210238727 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7809e4a0 0x556c7811bcd0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9180006e10 tx=0x7f9180018820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562090c68f80cbd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:34.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.627+0000 7f916cff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:18:34.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.627+0000 7f916cff9640 1 -- 172.21.15.27:0/1210238727 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180016430 con 0x556c7809e4a0 2024-09-19T08:18:34.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.627+0000 7f918d72a740 1 -- 172.21.15.27:0/1210238727 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f917c05a070 con 0x556c7809e4a0 2024-09-19T08:18:34.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.627+0000 7f916cff9640 1 -- 172.21.15.27:0/1210238727 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f91800165d0 con 0x556c7809e4a0 2024-09-19T08:18:34.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.627+0000 7f916cff9640 1 -- 172.21.15.27:0/1210238727 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f918002d050 con 0x556c7809e4a0 2024-09-19T08:18:34.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.627+0000 7f918d72a740 10 client.16578 fetch_fsmap learned FSMap version 20 2024-09-19T08:18:34.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.627+0000 7f918d72a740 1 -- 172.21.15.27:0/1210238727 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556c78128450 con 0x556c7809e4a0 2024-09-19T08:18:34.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.628+0000 7f916cff9640 1 -- 172.21.15.27:0/1210238727 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f917c05a070 con 0x556c7809e4a0 2024-09-19T08:18:34.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.628+0000 7f916cff9640 1 -- 172.21.15.27:0/1210238727 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f91800259f0 con 0x556c7809e4a0 2024-09-19T08:18:34.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.628+0000 7f918d72a740 10 client.16578 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:18:34.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.628+0000 7f918d72a740 10 client.16578 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:18:34.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.628+0000 7f918d72a740 20 client.16578 populate_metadata read hostname 'smithi027' 2024-09-19T08:18:34.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.628+0000 7f918d72a740 1 --2- 172.21.15.27:0/1210238727 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556c78128b20 0x556c7812af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:34.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.628+0000 7f918d72a740 4 client.16578 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:18:34.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.628+0000 7f918d72a740 1 -- 172.21.15.27:0/1210238727 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556c780a6ab0 con 0x556c78128b20 2024-09-19T08:18:34.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.628+0000 7f91888ec640 1 --2- 172.21.15.27:0/1210238727 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556c78128b20 0x556c7812af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:34.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.629+0000 7f916cff9640 10 client.16578 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:34.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.629+0000 7f91888ec640 1 --2- 172.21.15.27:0/1210238727 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556c78128b20 0x556c7812af10 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a770e4afabaaa22c server_cookie=b5d7e08b8851128a in_seq=0 out_seq=0 2024-09-19T08:18:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.629+0000 7f916cff9640 1 -- 172.21.15.27:0/1210238727 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556c780a6ab0 con 0x556c78128b20 2024-09-19T08:18:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.629+0000 7f916cff9640 10 client.16578 handle_command_reply: tid=0 2024-09-19T08:18:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.629+0000 7f918d72a740 1 client.16578 shutdown 2024-09-19T08:18:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.629+0000 7f918d72a740 1 -- 172.21.15.27:0/1210238727 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7809e4a0 msgr2=0x556c7811bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.629+0000 7f918d72a740 1 --2- 172.21.15.27:0/1210238727 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7809e4a0 0x556c7811bcd0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9180006e10 tx=0x7f9180018820 comp rx=0 tx=0).stop 2024-09-19T08:18:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.629+0000 7f918d72a740 1 -- 172.21.15.27:0/1210238727 shutdown_connections 2024-09-19T08:18:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.629+0000 7f918d72a740 1 --2- 172.21.15.27:0/1210238727 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x556c78128b20 0x556c7812af10 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.629+0000 7f918d72a740 1 --2- 172.21.15.27:0/1210238727 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c780a9680 0x556c78126d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.629+0000 7f918d72a740 1 --2- 172.21.15.27:0/1210238727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556c7809edc0 0x556c7811c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.629+0000 7f916cff9640 0 client.16578 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.629+0000 7f918d72a740 1 --2- 172.21.15.27:0/1210238727 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7809e4a0 0x556c7811bcd0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.629+0000 7f918d72a740 1 -- 172.21.15.27:0/1210238727 >> 172.21.15.27:0/1210238727 conn(0x556c7809aa30 msgr2=0x556c780a8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.629+0000 7f918d72a740 1 -- 172.21.15.27:0/1210238727 shutdown_connections 2024-09-19T08:18:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.629+0000 7f918d72a740 1 -- 172.21.15.27:0/1210238727 wait complete. 2024-09-19T08:18:34.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.629+0000 7f918d72a740 20 client.16578 trim_cache size 0 max 16384 2024-09-19T08:18:34.635 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:18:34.635 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:18:34.635 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:18:34.635 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:18:34.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.630+0000 7f918b351640 1 -- 172.21.15.27:0/2762299746 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f91700a33b0 msgr2=0x7f91700a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:34.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.630+0000 7f918b351640 1 --2- 172.21.15.27:0/2762299746 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f91700a33b0 0x7f91700a5870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f917c005cc0 tx=0x7f917c0099c0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.630+0000 7f918b351640 1 -- 172.21.15.27:0/2762299746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9184102570 msgr2=0x7f9184199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:34.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.630+0000 7f918b351640 1 --2- 172.21.15.27:0/2762299746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9184102570 0x7f9184199850 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f917400c890 tx=0x7f917400cc90 comp rx=0 tx=0).stop 2024-09-19T08:18:34.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.630+0000 7f918b351640 1 -- 172.21.15.27:0/2762299746 shutdown_connections 2024-09-19T08:18:34.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.630+0000 7f918b351640 1 --2- 172.21.15.27:0/2762299746 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f91700a33b0 0x7f91700a5870 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.630+0000 7f918b351640 1 --2- 172.21.15.27:0/2762299746 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9184102ef0 0x7f91841a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.630+0000 7f918b351640 1 --2- 172.21.15.27:0/2762299746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9184102570 0x7f9184199850 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.630+0000 7f918b351640 1 --2- 172.21.15.27:0/2762299746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9184100e20 0x7f9184199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:34.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.630+0000 7f918b351640 1 -- 172.21.15.27:0/2762299746 >> 172.21.15.27:0/2762299746 conn(0x7f91840fc7d0 msgr2=0x7f9184106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:34.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.630+0000 7f918b351640 1 -- 172.21.15.27:0/2762299746 shutdown_connections 2024-09-19T08:18:34.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:34.630+0000 7f918b351640 1 -- 172.21.15.27:0/2762299746 wait complete. 2024-09-19T08:18:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:35 smithi027 ceph-mon[31209]: pgmap v231: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:18:35.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:35 smithi155 ceph-mon[35362]: pgmap v231: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:18:35.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:35 smithi203 ceph-mon[35198]: pgmap v231: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:18:35.513 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:18:35.514 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:18:35.774 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:18:36.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.259+0000 7f2cc57ce640 1 -- 172.21.15.27:0/2036944168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cc0102da0 msgr2=0x7f2cc0103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:36.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.259+0000 7f2cc57ce640 1 --2- 172.21.15.27:0/2036944168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cc0102da0 0x7f2cc0103180 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009900 tx=0x7f2cb802a480 comp rx=0 tx=0).stop 2024-09-19T08:18:36.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.259+0000 7f2cc57ce640 1 -- 172.21.15.27:0/2036944168 shutdown_connections 2024-09-19T08:18:36.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.259+0000 7f2cc57ce640 1 --2- 172.21.15.27:0/2036944168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cc010c180 0x7f2cc010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:36.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.259+0000 7f2cc57ce640 1 --2- 172.21.15.27:0/2036944168 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2cc01036c0 0x7f2cc010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:36.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.259+0000 7f2cc57ce640 1 --2- 172.21.15.27:0/2036944168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cc0102da0 0x7f2cc0103180 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:36.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.259+0000 7f2cc57ce640 1 -- 172.21.15.27:0/2036944168 >> 172.21.15.27:0/2036944168 conn(0x7f2cc00fc7a0 msgr2=0x7f2cc00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:36.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.259+0000 7f2cc57ce640 1 -- 172.21.15.27:0/2036944168 shutdown_connections 2024-09-19T08:18:36.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.259+0000 7f2cc57ce640 1 -- 172.21.15.27:0/2036944168 wait complete. 2024-09-19T08:18:36.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.260+0000 7f2cc57ce640 1 Processor -- start 2024-09-19T08:18:36.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.260+0000 7f2cc57ce640 1 -- start start 2024-09-19T08:18:36.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.260+0000 7f2cc57ce640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2cc0102da0 0x7f2cc0100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:36.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.260+0000 7f2cc57ce640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cc01036c0 0x7f2cc0100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:36.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.260+0000 7f2cc57ce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cc010c180 0x7f2cc0101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:36.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.260+0000 7f2cc57ce640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc0112020 con 0x7f2cc01036c0 2024-09-19T08:18:36.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.260+0000 7f2cc57ce640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc0111ea0 con 0x7f2cc010c180 2024-09-19T08:18:36.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.260+0000 7f2cc57ce640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc01121a0 con 0x7f2cc0102da0 2024-09-19T08:18:36.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.260+0000 7f2cbe7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cc01036c0 0x7f2cc0100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:36.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.260+0000 7f2cbe7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cc01036c0 0x7f2cc0100f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46036/0 (socket says 172.21.15.27:46036) 2024-09-19T08:18:36.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.260+0000 7f2cbe7fc640 1 -- 172.21.15.27:0/92933109 learned_addr learned my addr 172.21.15.27:0/92933109 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:36.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.260+0000 7f2cbeffd640 1 --2- 172.21.15.27:0/92933109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2cc0102da0 0x7f2cc0100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:36.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.260+0000 7f2cbf7fe640 1 --2- 172.21.15.27:0/92933109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cc010c180 0x7f2cc0101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:36.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.261+0000 7f2cbe7fc640 1 -- 172.21.15.27:0/92933109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2cc0102da0 msgr2=0x7f2cc0100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:36.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.261+0000 7f2cbe7fc640 1 --2- 172.21.15.27:0/92933109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2cc0102da0 0x7f2cc0100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:36.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.261+0000 7f2cbe7fc640 1 -- 172.21.15.27:0/92933109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cc010c180 msgr2=0x7f2cc0101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:36.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.261+0000 7f2cbe7fc640 1 --2- 172.21.15.27:0/92933109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cc010c180 0x7f2cc0101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:36.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.261+0000 7f2cbe7fc640 1 -- 172.21.15.27:0/92933109 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc01a6a60 con 0x7f2cc01036c0 2024-09-19T08:18:36.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.261+0000 7f2cbe7fc640 1 --2- 172.21.15.27:0/92933109 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cc01036c0 0x7f2cc0100f40 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400b4a0 tx=0x7f2cb400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:36.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.261+0000 7f2ca7fff640 1 -- 172.21.15.27:0/92933109 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4014070 con 0x7f2cc01036c0 2024-09-19T08:18:36.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.261+0000 7f2ca7fff640 1 -- 172.21.15.27:0/92933109 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cb4010af0 con 0x7f2cc01036c0 2024-09-19T08:18:36.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.261+0000 7f2cc57ce640 1 -- 172.21.15.27:0/92933109 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc01a6d50 con 0x7f2cc01036c0 2024-09-19T08:18:36.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.261+0000 7f2ca7fff640 1 -- 172.21.15.27:0/92933109 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4017d10 con 0x7f2cc01036c0 2024-09-19T08:18:36.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.261+0000 7f2cc57ce640 1 -- 172.21.15.27:0/92933109 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc01a7230 con 0x7f2cc01036c0 2024-09-19T08:18:36.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.262+0000 7f2cc57ce640 1 -- 172.21.15.27:0/92933109 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc0103200 con 0x7f2cc01036c0 2024-09-19T08:18:36.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.263+0000 7f2ca7fff640 1 -- 172.21.15.27:0/92933109 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2cb4017070 con 0x7f2cc01036c0 2024-09-19T08:18:36.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.264+0000 7f2ca7fff640 1 --2- 172.21.15.27:0/92933109 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2ca80a3430 0x7f2ca80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:36.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.265+0000 7f2cbeffd640 1 --2- 172.21.15.27:0/92933109 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2ca80a3430 0x7f2ca80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:36.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.265+0000 7f2ca7fff640 1 -- 172.21.15.27:0/92933109 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f2cb40cf2a0 con 0x7f2cc01036c0 2024-09-19T08:18:36.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.265+0000 7f2cbeffd640 1 --2- 172.21.15.27:0/92933109 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2ca80a3430 0x7f2ca80a58f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8000c00 tx=0x7f2cb80058d0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:36.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.268+0000 7f2ca7fff640 1 -- 172.21.15.27:0/92933109 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2cb409b700 con 0x7f2cc01036c0 2024-09-19T08:18:36.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.480+0000 7f2cc57ce640 1 -- 172.21.15.27:0/92933109 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2cc0101f30 con 0x7f2cc01036c0 2024-09-19T08:18:36.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.481+0000 7f2ca7fff640 1 -- 172.21.15.27:0/92933109 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f2cc0101f30 con 0x7f2cc01036c0 2024-09-19T08:18:36.481 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:18:36.482 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:18:36.482 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:18:36.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.483+0000 7f2cc57ce640 1 -- 172.21.15.27:0/92933109 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2ca80a3430 msgr2=0x7f2ca80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:36.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.483+0000 7f2cc57ce640 1 --2- 172.21.15.27:0/92933109 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2ca80a3430 0x7f2ca80a58f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8000c00 tx=0x7f2cb80058d0 comp rx=0 tx=0).stop 2024-09-19T08:18:36.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.483+0000 7f2cc57ce640 1 -- 172.21.15.27:0/92933109 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cc01036c0 msgr2=0x7f2cc0100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:36.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.483+0000 7f2cc57ce640 1 --2- 172.21.15.27:0/92933109 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cc01036c0 0x7f2cc0100f40 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400b4a0 tx=0x7f2cb400b960 comp rx=0 tx=0).stop 2024-09-19T08:18:36.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.483+0000 7f2cc57ce640 1 -- 172.21.15.27:0/92933109 shutdown_connections 2024-09-19T08:18:36.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.483+0000 7f2cc57ce640 1 --2- 172.21.15.27:0/92933109 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2ca80a3430 0x7f2ca80a58f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:36.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.483+0000 7f2cc57ce640 1 --2- 172.21.15.27:0/92933109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cc010c180 0x7f2cc0101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:36.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.483+0000 7f2cc57ce640 1 --2- 172.21.15.27:0/92933109 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cc01036c0 0x7f2cc0100f40 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:36.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.483+0000 7f2cc57ce640 1 --2- 172.21.15.27:0/92933109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2cc0102da0 0x7f2cc0100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:36.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.483+0000 7f2cc57ce640 1 -- 172.21.15.27:0/92933109 >> 172.21.15.27:0/92933109 conn(0x7f2cc00fc7a0 msgr2=0x7f2cc00fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:36.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.483+0000 7f2cc57ce640 1 -- 172.21.15.27:0/92933109 shutdown_connections 2024-09-19T08:18:36.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:36.483+0000 7f2cc57ce640 1 -- 172.21.15.27:0/92933109 wait complete. 2024-09-19T08:18:37.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:37 smithi027 ceph-mon[31209]: pgmap v232: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:37.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:37 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/92933109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:18:37.315 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:18:37.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:37 smithi155 ceph-mon[35362]: pgmap v232: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:37.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:37 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/92933109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:18:37.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:37 smithi203 ceph-mon[35198]: pgmap v232: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:37.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:37 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/92933109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:18:37.578 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:18:38.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.063+0000 7f989cd5b640 1 -- 172.21.15.27:0/590636106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9898102570 msgr2=0x7f98981029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:38.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.063+0000 7f989cd5b640 1 --2- 172.21.15.27:0/590636106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9898102570 0x7f98981029b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f9880009900 tx=0x7f988002a480 comp rx=0 tx=0).stop 2024-09-19T08:18:38.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.063+0000 7f989cd5b640 1 -- 172.21.15.27:0/590636106 shutdown_connections 2024-09-19T08:18:38.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.063+0000 7f989cd5b640 1 --2- 172.21.15.27:0/590636106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9898102ef0 0x7f989810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.063+0000 7f989cd5b640 1 --2- 172.21.15.27:0/590636106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9898102570 0x7f98981029b0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.063+0000 7f989cd5b640 1 --2- 172.21.15.27:0/590636106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9898100e20 0x7f9898101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.063+0000 7f989cd5b640 1 -- 172.21.15.27:0/590636106 >> 172.21.15.27:0/590636106 conn(0x7f98980fc7d0 msgr2=0x7f98980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:38.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.063+0000 7f989cd5b640 1 -- 172.21.15.27:0/590636106 shutdown_connections 2024-09-19T08:18:38.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.063+0000 7f989cd5b640 1 -- 172.21.15.27:0/590636106 wait complete. 2024-09-19T08:18:38.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.063+0000 7f989cd5b640 1 Processor -- start 2024-09-19T08:18:38.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.064+0000 7f989cd5b640 1 -- start start 2024-09-19T08:18:38.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.064+0000 7f989cd5b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9898100e20 0x7f9898198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:38.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.064+0000 7f989cd5b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9898102570 0x7f9898198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:38.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.064+0000 7f989cd5b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9898102ef0 0x7f989819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:38.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.064+0000 7f989cd5b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f98981120a0 con 0x7f9898102570 2024-09-19T08:18:38.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.064+0000 7f989cd5b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9898111f20 con 0x7f9898102ef0 2024-09-19T08:18:38.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.064+0000 7f989cd5b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9898112220 con 0x7f9898100e20 2024-09-19T08:18:38.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.064+0000 7f9895d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9898102570 0x7f9898198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:38.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.064+0000 7f9895d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9898102570 0x7f9898198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46050/0 (socket says 172.21.15.27:46050) 2024-09-19T08:18:38.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.064+0000 7f9895d9b640 1 -- 172.21.15.27:0/898817423 learned_addr learned my addr 172.21.15.27:0/898817423 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:38.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.064+0000 7f989659c640 1 --2- 172.21.15.27:0/898817423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9898100e20 0x7f9898198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:38.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.064+0000 7f9896d9d640 1 --2- 172.21.15.27:0/898817423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9898102ef0 0x7f989819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:38.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.064+0000 7f9895d9b640 1 -- 172.21.15.27:0/898817423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9898100e20 msgr2=0x7f9898198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:38.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.064+0000 7f9895d9b640 1 --2- 172.21.15.27:0/898817423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9898100e20 0x7f9898198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.064+0000 7f9895d9b640 1 -- 172.21.15.27:0/898817423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9898102ef0 msgr2=0x7f989819cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:38.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.064+0000 7f9895d9b640 1 --2- 172.21.15.27:0/898817423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9898102ef0 0x7f989819cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.064+0000 7f9895d9b640 1 -- 172.21.15.27:0/898817423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989819d4d0 con 0x7f9898102570 2024-09-19T08:18:38.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.064+0000 7f9895d9b640 1 --2- 172.21.15.27:0/898817423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9898102570 0x7f9898198a60 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9880006010 tx=0x7f9880003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:38.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.065+0000 7f988f7fe640 1 -- 172.21.15.27:0/898817423 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988003f070 con 0x7f9898102570 2024-09-19T08:18:38.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.065+0000 7f988f7fe640 1 -- 172.21.15.27:0/898817423 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9880031c30 con 0x7f9898102570 2024-09-19T08:18:38.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.065+0000 7f989cd5b640 1 -- 172.21.15.27:0/898817423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f989819d760 con 0x7f9898102570 2024-09-19T08:18:38.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.065+0000 7f988f7fe640 1 -- 172.21.15.27:0/898817423 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9880035030 con 0x7f9898102570 2024-09-19T08:18:38.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.065+0000 7f989cd5b640 1 -- 172.21.15.27:0/898817423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98981a50a0 con 0x7f9898102570 2024-09-19T08:18:38.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.067+0000 7f988f7fe640 1 -- 172.21.15.27:0/898817423 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9880042070 con 0x7f9898102570 2024-09-19T08:18:38.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.067+0000 7f989f134740 1 Processor -- start 2024-09-19T08:18:38.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.067+0000 7f989f134740 1 -- start start 2024-09-19T08:18:38.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f989f134740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf988b40 0x5643bf987090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:38.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f989f134740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf9875d0 0x5643bf987a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:38.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f989f134740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf992370 0x5643bf994760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:38.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f989f134740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5643bf8ed2f0 con 0x5643bf9875d0 2024-09-19T08:18:38.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f989f134740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5643bf894cf0 con 0x5643bf988b40 2024-09-19T08:18:38.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f989f134740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5643bf8e92b0 con 0x5643bf992370 2024-09-19T08:18:38.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f989659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf9875d0 0x5643bf987a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:38.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f989659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf9875d0 0x5643bf987a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46060/0 (socket says 172.21.15.27:46060) 2024-09-19T08:18:38.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f989659c640 1 -- 172.21.15.27:0/977881457 learned_addr learned my addr 172.21.15.27:0/977881457 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:38.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f9895d9b640 1 --2- 172.21.15.27:0/977881457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf992370 0x5643bf994760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:38.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f988f7fe640 1 --2- 172.21.15.27:0/898817423 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f98840a33b0 0x7f98840a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:38.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f9896d9d640 1 --2- 172.21.15.27:0/977881457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf988b40 0x5643bf987090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:38.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f989659c640 1 -- 172.21.15.27:0/977881457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf992370 msgr2=0x5643bf994760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:38.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f989659c640 1 --2- 172.21.15.27:0/977881457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf992370 0x5643bf994760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f989659c640 1 -- 172.21.15.27:0/977881457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf988b40 msgr2=0x5643bf987090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:38.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f989659c640 1 --2- 172.21.15.27:0/977881457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf988b40 0x5643bf987090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f989659c640 1 -- 172.21.15.27:0/977881457 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643bf8793a0 con 0x5643bf9875d0 2024-09-19T08:18:38.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f9896d9d640 1 --2- 172.21.15.27:0/977881457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf988b40 0x5643bf987090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:18:38.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f988f7fe640 1 -- 172.21.15.27:0/898817423 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f98800f04b0 con 0x7f9898102570 2024-09-19T08:18:38.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f9896d9d640 1 --2- 172.21.15.27:0/898817423 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f98840a33b0 0x7f98840a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:38.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.068+0000 7f989659c640 1 --2- 172.21.15.27:0/977881457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf9875d0 0x5643bf987a10 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f989000bd10 tx=0x7f98900107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c58c10bfc9982a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:38.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.069+0000 7f988cff9640 1 -- 172.21.15.27:0/977881457 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9890004030 con 0x5643bf9875d0 2024-09-19T08:18:38.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.069+0000 7f988cff9640 1 -- 172.21.15.27:0/977881457 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98900041d0 con 0x5643bf9875d0 2024-09-19T08:18:38.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.069+0000 7f988cff9640 1 -- 172.21.15.27:0/977881457 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9890011840 con 0x5643bf9875d0 2024-09-19T08:18:38.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.069+0000 7f9896d9d640 1 --2- 172.21.15.27:0/898817423 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f98840a33b0 0x7f98840a5870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f988800a5a0 tx=0x7f9888004b50 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:38.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.069+0000 7f989f134740 1 -- 172.21.15.27:0/977881457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf9875d0 msgr2=0x5643bf987a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:38.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.069+0000 7f989f134740 1 --2- 172.21.15.27:0/977881457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf9875d0 0x5643bf987a10 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f989000bd10 tx=0x7f98900107a0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.069+0000 7f989f134740 1 -- 172.21.15.27:0/977881457 shutdown_connections 2024-09-19T08:18:38.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.069+0000 7f989f134740 1 --2- 172.21.15.27:0/977881457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf992370 0x5643bf994760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.069+0000 7f989f134740 1 --2- 172.21.15.27:0/977881457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf9875d0 0x5643bf987a10 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.069+0000 7f989f134740 1 --2- 172.21.15.27:0/977881457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf988b40 0x5643bf987090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.069+0000 7f989f134740 1 -- 172.21.15.27:0/977881457 >> 172.21.15.27:0/977881457 conn(0x5643bf950310 msgr2=0x5643bf983c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:38.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.069+0000 7f989f134740 1 -- 172.21.15.27:0/977881457 shutdown_connections 2024-09-19T08:18:38.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.070+0000 7f989f134740 1 -- 172.21.15.27:0/977881457 wait complete. 2024-09-19T08:18:38.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.070+0000 7f989f134740 1 -- start start 2024-09-19T08:18:38.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.070+0000 7f989f134740 1 Processor -- start 2024-09-19T08:18:38.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.070+0000 7f989f134740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf9875d0 0x5643bf991db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:38.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.070+0000 7f989f134740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf988b40 0x5643bf98f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:38.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.070+0000 7f989f134740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf992370 0x5643bf98f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:38.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.070+0000 7f989f134740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5643bf995070 con 0x5643bf988b40 2024-09-19T08:18:38.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.070+0000 7f989f134740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5643bf8a8060 con 0x5643bf992370 2024-09-19T08:18:38.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.070+0000 7f989f134740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5643bf9951f0 con 0x5643bf9875d0 2024-09-19T08:18:38.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.070+0000 7f989f134740 10 client.0 _ll_register_callbacks cb 0x5643bf5fb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:18:38.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.070+0000 7f9895d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf988b40 0x5643bf98f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:38.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.070+0000 7f9895d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf988b40 0x5643bf98f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46076/0 (socket says 172.21.15.27:46076) 2024-09-19T08:18:38.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.070+0000 7f9895d9b640 1 -- 172.21.15.27:0/937382769 learned_addr learned my addr 172.21.15.27:0/937382769 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:38.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.070+0000 7f989659c640 1 --2- 172.21.15.27:0/937382769 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf9875d0 0x5643bf991db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:38.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.070+0000 7f9896d9d640 1 --2- 172.21.15.27:0/937382769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf992370 0x5643bf98f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:38.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.071+0000 7f9895d9b640 1 -- 172.21.15.27:0/937382769 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf9875d0 msgr2=0x5643bf991db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:38.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.071+0000 7f9895d9b640 1 --2- 172.21.15.27:0/937382769 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf9875d0 0x5643bf991db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.071+0000 7f9895d9b640 1 -- 172.21.15.27:0/937382769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf992370 msgr2=0x5643bf98f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.071+0000 7f9895d9b640 1 --2- 172.21.15.27:0/937382769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf992370 0x5643bf98f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.071+0000 7f9895d9b640 1 -- 172.21.15.27:0/937382769 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643bf65e3c0 con 0x5643bf988b40 2024-09-19T08:18:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.071+0000 7f9896d9d640 1 --2- 172.21.15.27:0/937382769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf992370 0x5643bf98f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:18:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.071+0000 7f9895d9b640 1 --2- 172.21.15.27:0/937382769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf988b40 0x5643bf98f060 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f98800bc7f0 tx=0x7f98800bc280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785003d0b916d112 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.071+0000 7f987dffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:18:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.071+0000 7f987dffb640 1 -- 172.21.15.27:0/937382769 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9880049070 con 0x5643bf988b40 2024-09-19T08:18:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.071+0000 7f987dffb640 1 -- 172.21.15.27:0/937382769 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f98800b8ed0 con 0x5643bf988b40 2024-09-19T08:18:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.071+0000 7f989f134740 1 -- 172.21.15.27:0/937382769 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98900041d0 con 0x5643bf988b40 2024-09-19T08:18:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.071+0000 7f987dffb640 1 -- 172.21.15.27:0/937382769 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f98800bc860 con 0x5643bf988b40 2024-09-19T08:18:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.071+0000 7f989f134740 10 client.16596 fetch_fsmap learned FSMap version 20 2024-09-19T08:18:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.071+0000 7f989f134740 1 -- 172.21.15.27:0/937382769 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5643bf9a0b60 con 0x5643bf988b40 2024-09-19T08:18:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.071+0000 7f987dffb640 1 -- 172.21.15.27:0/937382769 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98900041d0 con 0x5643bf988b40 2024-09-19T08:18:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.071+0000 7f987dffb640 1 -- 172.21.15.27:0/937382769 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f98800c4f90 con 0x5643bf988b40 2024-09-19T08:18:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.072+0000 7f989f134740 10 client.16596 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:18:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.072+0000 7f989f134740 10 client.16596 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:18:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.072+0000 7f989f134740 20 client.16596 populate_metadata read hostname 'smithi027' 2024-09-19T08:18:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.072+0000 7f989f134740 1 --2- 172.21.15.27:0/937382769 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5643bf9a1fc0 0x5643bf9a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.072+0000 7f989f134740 4 client.16596 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:18:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.072+0000 7f989f134740 1 -- 172.21.15.27:0/937382769 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643bf8fa860 con 0x5643bf9a1fc0 2024-09-19T08:18:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.072+0000 7f989659c640 1 --2- 172.21.15.27:0/937382769 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5643bf9a1fc0 0x5643bf9a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.072+0000 7f987dffb640 10 client.16596 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.072+0000 7f989659c640 1 --2- 172.21.15.27:0/937382769 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5643bf9a1fc0 0x5643bf9a43b0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb8d4a0503bac204 server_cookie=8ed91c3ce437beb4 in_seq=0 out_seq=0 2024-09-19T08:18:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.073+0000 7f987dffb640 1 -- 172.21.15.27:0/937382769 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5643bf8fa860 con 0x5643bf9a1fc0 2024-09-19T08:18:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.073+0000 7f987dffb640 10 client.16596 handle_command_reply: tid=0 2024-09-19T08:18:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.073+0000 7f989f134740 1 client.16596 shutdown 2024-09-19T08:18:38.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.073+0000 7f989f134740 1 -- 172.21.15.27:0/937382769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf988b40 msgr2=0x5643bf98f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:38.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.073+0000 7f989f134740 1 --2- 172.21.15.27:0/937382769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf988b40 0x5643bf98f060 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f98800bc7f0 tx=0x7f98800bc280 comp rx=0 tx=0).stop 2024-09-19T08:18:38.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.073+0000 7f989f134740 1 -- 172.21.15.27:0/937382769 shutdown_connections 2024-09-19T08:18:38.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.073+0000 7f989f134740 1 --2- 172.21.15.27:0/937382769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf992370 0x5643bf98f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.073+0000 7f989f134740 1 --2- 172.21.15.27:0/937382769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf988b40 0x5643bf98f060 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.073+0000 7f989f134740 1 --2- 172.21.15.27:0/937382769 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5643bf9a1fc0 0x5643bf9a43b0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.073+0000 7f989f134740 1 --2- 172.21.15.27:0/937382769 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf9875d0 0x5643bf991db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.073+0000 7f987dffb640 0 client.16596 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:38.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.073+0000 7f989f134740 1 -- 172.21.15.27:0/937382769 >> 172.21.15.27:0/937382769 conn(0x5643bf950310 msgr2=0x5643bf989960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:38.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.073+0000 7f989f134740 1 -- 172.21.15.27:0/937382769 shutdown_connections 2024-09-19T08:18:38.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.073+0000 7f989f134740 1 -- 172.21.15.27:0/937382769 wait complete. 2024-09-19T08:18:38.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.073+0000 7f989f134740 20 client.16596 trim_cache size 0 max 16384 2024-09-19T08:18:38.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.087+0000 7f989f134740 1 Processor -- start 2024-09-19T08:18:38.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.087+0000 7f989f134740 1 -- start start 2024-09-19T08:18:38.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.087+0000 7f989f134740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf9875d0 0x5643bf9879b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:38.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.087+0000 7f989f134740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf988b40 0x5643bf983700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:38.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.087+0000 7f989f134740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf992370 0x5643bf983c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:38.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.087+0000 7f989f134740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f98981ab880 con 0x5643bf9875d0 2024-09-19T08:18:38.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.087+0000 7f989f134740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f98981ae0e0 con 0x5643bf992370 2024-09-19T08:18:38.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.087+0000 7f989f134740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f98981abed0 con 0x5643bf988b40 2024-09-19T08:18:38.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.087+0000 7f989659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf9875d0 0x5643bf9879b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:38.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.087+0000 7f989659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf9875d0 0x5643bf9879b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46082/0 (socket says 172.21.15.27:46082) 2024-09-19T08:18:38.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.087+0000 7f989659c640 1 -- 172.21.15.27:0/3820713265 learned_addr learned my addr 172.21.15.27:0/3820713265 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:38.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.088+0000 7f9895d9b640 1 --2- 172.21.15.27:0/3820713265 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf988b40 0x5643bf983700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:38.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.088+0000 7f9896d9d640 1 --2- 172.21.15.27:0/3820713265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf992370 0x5643bf983c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:38.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.088+0000 7f989659c640 1 -- 172.21.15.27:0/3820713265 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf988b40 msgr2=0x5643bf983700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:38.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.088+0000 7f989659c640 1 --2- 172.21.15.27:0/3820713265 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf988b40 0x5643bf983700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.088+0000 7f989659c640 1 -- 172.21.15.27:0/3820713265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf992370 msgr2=0x5643bf983c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:38.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.088+0000 7f989659c640 1 --2- 172.21.15.27:0/3820713265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf992370 0x5643bf983c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.088+0000 7f989659c640 1 -- 172.21.15.27:0/3820713265 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643bf994ad0 con 0x5643bf9875d0 2024-09-19T08:18:38.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.088+0000 7f9895d9b640 1 --2- 172.21.15.27:0/3820713265 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf988b40 0x5643bf983700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:18:38.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.088+0000 7f9896d9d640 1 --2- 172.21.15.27:0/3820713265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf992370 0x5643bf983c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:18:38.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.088+0000 7f989659c640 1 --2- 172.21.15.27:0/3820713265 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf9875d0 0x5643bf9879b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f989000bc30 tx=0x7f989000b570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b47463bbbca227 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:38.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.088+0000 7f987ffff640 1 -- 172.21.15.27:0/3820713265 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9890005240 con 0x5643bf9875d0 2024-09-19T08:18:38.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.088+0000 7f987ffff640 1 -- 172.21.15.27:0/3820713265 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98900053e0 con 0x5643bf9875d0 2024-09-19T08:18:38.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.088+0000 7f987ffff640 1 -- 172.21.15.27:0/3820713265 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98900116a0 con 0x5643bf9875d0 2024-09-19T08:18:38.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.089+0000 7f989f134740 1 -- 172.21.15.27:0/3820713265 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf9875d0 msgr2=0x5643bf9879b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:38.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.089+0000 7f989f134740 1 --2- 172.21.15.27:0/3820713265 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf9875d0 0x5643bf9879b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f989000bc30 tx=0x7f989000b570 comp rx=0 tx=0).stop 2024-09-19T08:18:38.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.089+0000 7f989f134740 1 -- 172.21.15.27:0/3820713265 shutdown_connections 2024-09-19T08:18:38.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.089+0000 7f989f134740 1 --2- 172.21.15.27:0/3820713265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf992370 0x5643bf983c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.089+0000 7f989f134740 1 --2- 172.21.15.27:0/3820713265 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf988b40 0x5643bf983700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.089+0000 7f989f134740 1 --2- 172.21.15.27:0/3820713265 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf9875d0 0x5643bf9879b0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.089+0000 7f989f134740 1 -- 172.21.15.27:0/3820713265 >> 172.21.15.27:0/3820713265 conn(0x5643bf950310 msgr2=0x5643bf97ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:38.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.089+0000 7f989f134740 1 -- 172.21.15.27:0/3820713265 shutdown_connections 2024-09-19T08:18:38.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.089+0000 7f989f134740 1 -- 172.21.15.27:0/3820713265 wait complete. 2024-09-19T08:18:38.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.089+0000 7f989f134740 1 -- start start 2024-09-19T08:18:38.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.089+0000 7f989f134740 1 Processor -- start 2024-09-19T08:18:38.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f989f134740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf9875d0 0x5643bf99ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:38.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f989f134740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf988b40 0x5643bf996060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:38.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f989f134740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf992370 0x5643bf9967f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:38.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f989f134740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f98981ac5a0 con 0x5643bf988b40 2024-09-19T08:18:38.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f989f134740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f98981ada10 con 0x5643bf9875d0 2024-09-19T08:18:38.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f989f134740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f98981acc70 con 0x5643bf992370 2024-09-19T08:18:38.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f989f134740 10 client.0 _ll_register_callbacks cb 0x7f9880005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:18:38.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f9895d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf988b40 0x5643bf996060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:38.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f9895d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf988b40 0x5643bf996060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46088/0 (socket says 172.21.15.27:46088) 2024-09-19T08:18:38.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f9895d9b640 1 -- 172.21.15.27:0/3372236086 learned_addr learned my addr 172.21.15.27:0/3372236086 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:38.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f9896d9d640 1 --2- 172.21.15.27:0/3372236086 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf992370 0x5643bf9967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:38.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f989659c640 1 --2- 172.21.15.27:0/3372236086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf9875d0 0x5643bf99ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:38.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f9895d9b640 1 -- 172.21.15.27:0/3372236086 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf992370 msgr2=0x5643bf9967f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:38.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f9895d9b640 1 --2- 172.21.15.27:0/3372236086 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf992370 0x5643bf9967f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f9895d9b640 1 -- 172.21.15.27:0/3372236086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf9875d0 msgr2=0x5643bf99ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:38.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f9895d9b640 1 --2- 172.21.15.27:0/3372236086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf9875d0 0x5643bf99ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f9895d9b640 1 -- 172.21.15.27:0/3372236086 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643bfa0bc90 con 0x5643bf988b40 2024-09-19T08:18:38.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f9896d9d640 1 --2- 172.21.15.27:0/3372236086 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf992370 0x5643bf9967f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:18:38.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f989659c640 1 --2- 172.21.15.27:0/3372236086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf9875d0 0x5643bf99ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:18:38.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f9895d9b640 1 --2- 172.21.15.27:0/3372236086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf988b40 0x5643bf996060 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f98800b8cc0 tx=0x7f98800bccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49302b5cce5658f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:38.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f987dffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:18:38.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.090+0000 7f987dffb640 1 -- 172.21.15.27:0/3372236086 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9880049070 con 0x5643bf988b40 2024-09-19T08:18:38.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.091+0000 7f987dffb640 1 -- 172.21.15.27:0/3372236086 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f98800b8ed0 con 0x5643bf988b40 2024-09-19T08:18:38.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.091+0000 7f989f134740 1 -- 172.21.15.27:0/3372236086 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98900053e0 con 0x5643bf988b40 2024-09-19T08:18:38.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.091+0000 7f987dffb640 1 -- 172.21.15.27:0/3372236086 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f98800da050 con 0x5643bf988b40 2024-09-19T08:18:38.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.091+0000 7f989f134740 10 client.16602 fetch_fsmap learned FSMap version 20 2024-09-19T08:18:38.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.091+0000 7f989f134740 1 -- 172.21.15.27:0/3372236086 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5643bfa0cd60 con 0x5643bf988b40 2024-09-19T08:18:38.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.091+0000 7f987dffb640 1 -- 172.21.15.27:0/3372236086 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98900053e0 con 0x5643bf988b40 2024-09-19T08:18:38.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.091+0000 7f987dffb640 1 -- 172.21.15.27:0/3372236086 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f98800f0140 con 0x5643bf988b40 2024-09-19T08:18:38.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.091+0000 7f989f134740 10 client.16602 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:18:38.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.091+0000 7f989f134740 10 client.16602 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:18:38.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.091+0000 7f989f134740 20 client.16602 populate_metadata read hostname 'smithi027' 2024-09-19T08:18:38.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.091+0000 7f989f134740 1 --2- 172.21.15.27:0/3372236086 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5643bfa0d2f0 0x5643bfa0f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:38.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.091+0000 7f989f134740 4 client.16602 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:18:38.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.091+0000 7f989f134740 1 -- 172.21.15.27:0/3372236086 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5643bf8f4d70 con 0x5643bfa0d2f0 2024-09-19T08:18:38.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.091+0000 7f989659c640 1 --2- 172.21.15.27:0/3372236086 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5643bfa0d2f0 0x5643bfa0f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:38.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.092+0000 7f989659c640 1 --2- 172.21.15.27:0/3372236086 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5643bfa0d2f0 0x5643bfa0f6e0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=528448920b610b71 server_cookie=830f9925dde2c751 in_seq=0 out_seq=0 2024-09-19T08:18:38.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.092+0000 7f987dffb640 10 client.16602 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:38.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.092+0000 7f987dffb640 1 -- 172.21.15.27:0/3372236086 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5643bf8f4d70 con 0x5643bfa0d2f0 2024-09-19T08:18:38.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.092+0000 7f987dffb640 10 client.16602 handle_command_reply: tid=0 2024-09-19T08:18:38.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.092+0000 7f989f134740 1 client.16602 shutdown 2024-09-19T08:18:38.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.092+0000 7f989f134740 1 -- 172.21.15.27:0/3372236086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf988b40 msgr2=0x5643bf996060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:38.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.092+0000 7f989f134740 1 --2- 172.21.15.27:0/3372236086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf988b40 0x5643bf996060 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f98800b8cc0 tx=0x7f98800bccf0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.092+0000 7f989f134740 1 -- 172.21.15.27:0/3372236086 shutdown_connections 2024-09-19T08:18:38.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.092+0000 7f989f134740 1 --2- 172.21.15.27:0/3372236086 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5643bfa0d2f0 0x5643bfa0f6e0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.092+0000 7f989f134740 1 --2- 172.21.15.27:0/3372236086 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643bf992370 0x5643bf9967f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.092+0000 7f989f134740 1 --2- 172.21.15.27:0/3372236086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5643bf988b40 0x5643bf996060 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.092+0000 7f989f134740 1 --2- 172.21.15.27:0/3372236086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643bf9875d0 0x5643bf99ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.092+0000 7f989f134740 1 -- 172.21.15.27:0/3372236086 >> 172.21.15.27:0/3372236086 conn(0x5643bf950310 msgr2=0x5643bf983700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:38.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.092+0000 7f987dffb640 0 client.16602 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:38.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.092+0000 7f989f134740 1 -- 172.21.15.27:0/3372236086 shutdown_connections 2024-09-19T08:18:38.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.092+0000 7f989f134740 1 -- 172.21.15.27:0/3372236086 wait complete. 2024-09-19T08:18:38.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.093+0000 7f989f134740 20 client.16602 trim_cache size 0 max 16384 2024-09-19T08:18:38.102 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:18:38.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.093+0000 7f989cd5b640 1 -- 172.21.15.27:0/898817423 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f98840a33b0 msgr2=0x7f98840a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:38.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.093+0000 7f989cd5b640 1 --2- 172.21.15.27:0/898817423 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f98840a33b0 0x7f98840a5870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f988800a5a0 tx=0x7f9888004b50 comp rx=0 tx=0).stop 2024-09-19T08:18:38.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.093+0000 7f989cd5b640 1 -- 172.21.15.27:0/898817423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9898102570 msgr2=0x7f9898198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:38.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.093+0000 7f989cd5b640 1 --2- 172.21.15.27:0/898817423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9898102570 0x7f9898198a60 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9880006010 tx=0x7f9880003c10 comp rx=0 tx=0).stop 2024-09-19T08:18:38.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.093+0000 7f989cd5b640 1 -- 172.21.15.27:0/898817423 shutdown_connections 2024-09-19T08:18:38.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.093+0000 7f989cd5b640 1 --2- 172.21.15.27:0/898817423 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f98840a33b0 0x7f98840a5870 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.093+0000 7f989cd5b640 1 --2- 172.21.15.27:0/898817423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9898102ef0 0x7f989819cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.093+0000 7f989cd5b640 1 --2- 172.21.15.27:0/898817423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9898102570 0x7f9898198a60 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.093+0000 7f989cd5b640 1 --2- 172.21.15.27:0/898817423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9898100e20 0x7f9898198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:38.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.093+0000 7f989cd5b640 1 -- 172.21.15.27:0/898817423 >> 172.21.15.27:0/898817423 conn(0x7f98980fc7d0 msgr2=0x7f98980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:38.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.094+0000 7f989cd5b640 1 -- 172.21.15.27:0/898817423 shutdown_connections 2024-09-19T08:18:38.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:38.094+0000 7f989cd5b640 1 -- 172.21.15.27:0/898817423 wait complete. 2024-09-19T08:18:39.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:39 smithi027 ceph-mon[31209]: pgmap v233: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:18:39.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:39 smithi155 ceph-mon[35362]: pgmap v233: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:18:39.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:39 smithi203 ceph-mon[35198]: pgmap v233: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:18:40.020 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:18:40.020 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:18:40.293 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:18:40.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.909+0000 7fcaf6a75640 1 -- 172.21.15.27:0/138101668 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcaf0100ca0 msgr2=0x7fcaf0106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:40.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.909+0000 7fcaf6a75640 1 --2- 172.21.15.27:0/138101668 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcaf0100ca0 0x7fcaf0106840 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009930 tx=0x7fcadc02a420 comp rx=0 tx=0).stop 2024-09-19T08:18:40.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.909+0000 7fcaf6a75640 1 -- 172.21.15.27:0/138101668 shutdown_connections 2024-09-19T08:18:40.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.909+0000 7fcaf6a75640 1 --2- 172.21.15.27:0/138101668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaf0106f50 0x7fcaf010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.909+0000 7fcaf6a75640 1 --2- 172.21.15.27:0/138101668 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcaf0100ca0 0x7fcaf0106840 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.909+0000 7fcaf6a75640 1 --2- 172.21.15.27:0/138101668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaf01002f0 0x7fcaf01006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.909+0000 7fcaf6a75640 1 -- 172.21.15.27:0/138101668 >> 172.21.15.27:0/138101668 conn(0x7fcaf0077210 msgr2=0x7fcaf00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:40.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.909+0000 7fcaf6a75640 1 -- 172.21.15.27:0/138101668 shutdown_connections 2024-09-19T08:18:40.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.909+0000 7fcaf6a75640 1 -- 172.21.15.27:0/138101668 wait complete. 2024-09-19T08:18:40.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.910+0000 7fcaf6a75640 1 Processor -- start 2024-09-19T08:18:40.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.910+0000 7fcaf6a75640 1 -- start start 2024-09-19T08:18:40.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.910+0000 7fcaf6a75640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcaf01002f0 0x7fcaf0198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:40.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.910+0000 7fcaf6a75640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaf0100ca0 0x7fcaf0198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:40.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.910+0000 7fcaf6a75640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaf0106f50 0x7fcaf019cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:40.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.910+0000 7fcaf6a75640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf0112060 con 0x7fcaf01002f0 2024-09-19T08:18:40.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.910+0000 7fcaf6a75640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf0111ee0 con 0x7fcaf0100ca0 2024-09-19T08:18:40.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.910+0000 7fcaf6a75640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf01121e0 con 0x7fcaf0106f50 2024-09-19T08:18:40.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.910+0000 7fcaf4811640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcaf01002f0 0x7fcaf0198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:40.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.910+0000 7fcaf4811640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcaf01002f0 0x7fcaf0198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56138/0 (socket says 172.21.15.27:56138) 2024-09-19T08:18:40.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.910+0000 7fcaf4811640 1 -- 172.21.15.27:0/3937627876 learned_addr learned my addr 172.21.15.27:0/3937627876 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:40.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.910+0000 7fcaeffff640 1 --2- 172.21.15.27:0/3937627876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaf0100ca0 0x7fcaf0198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:40.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.910+0000 7fcaf4811640 1 -- 172.21.15.27:0/3937627876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaf0106f50 msgr2=0x7fcaf019cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:40.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.910+0000 7fcaf5012640 1 --2- 172.21.15.27:0/3937627876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaf0106f50 0x7fcaf019cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:40.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.910+0000 7fcaf4811640 1 --2- 172.21.15.27:0/3937627876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaf0106f50 0x7fcaf019cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.910+0000 7fcaf4811640 1 -- 172.21.15.27:0/3937627876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaf0100ca0 msgr2=0x7fcaf0198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:40.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.910+0000 7fcaf4811640 1 --2- 172.21.15.27:0/3937627876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaf0100ca0 0x7fcaf0198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.910+0000 7fcaf4811640 1 -- 172.21.15.27:0/3937627876 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf019d5d0 con 0x7fcaf01002f0 2024-09-19T08:18:40.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.910+0000 7fcaeffff640 1 --2- 172.21.15.27:0/3937627876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaf0100ca0 0x7fcaf0198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:18:40.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.910+0000 7fcaf5012640 1 --2- 172.21.15.27:0/3937627876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaf0106f50 0x7fcaf019cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:18:40.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.911+0000 7fcaf4811640 1 --2- 172.21.15.27:0/3937627876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcaf01002f0 0x7fcaf0198620 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcae400b4a0 tx=0x7fcae400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:40.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.911+0000 7fcaedffb640 1 -- 172.21.15.27:0/3937627876 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae4014070 con 0x7fcaf01002f0 2024-09-19T08:18:40.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.911+0000 7fcaf6a75640 1 -- 172.21.15.27:0/3937627876 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf019d8c0 con 0x7fcaf01002f0 2024-09-19T08:18:40.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.911+0000 7fcaedffb640 1 -- 172.21.15.27:0/3937627876 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcae4010af0 con 0x7fcaf01002f0 2024-09-19T08:18:40.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.911+0000 7fcaedffb640 1 -- 172.21.15.27:0/3937627876 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae4017d10 con 0x7fcaf01002f0 2024-09-19T08:18:40.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.911+0000 7fcaf6a75640 1 -- 172.21.15.27:0/3937627876 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf01a51a0 con 0x7fcaf01002f0 2024-09-19T08:18:40.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.914+0000 7fcaedffb640 1 -- 172.21.15.27:0/3937627876 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fcae4017070 con 0x7fcaf01002f0 2024-09-19T08:18:40.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.914+0000 7fcaf8e4e740 1 Processor -- start 2024-09-19T08:18:40.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.914+0000 7fcaf8e4e740 1 -- start start 2024-09-19T08:18:40.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.914+0000 7fcaf8e4e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42faca40 0x55aa42face20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:40.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.914+0000 7fcaf8e4e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fad360 0x55aa42fbbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:40.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.914+0000 7fcaf8e4e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42fbc150 0x55aa42fbe540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:40.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.914+0000 7fcaf8e4e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55aa42f12280 con 0x55aa42fad360 2024-09-19T08:18:40.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.914+0000 7fcaf8e4e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55aa42eb9b10 con 0x55aa42faca40 2024-09-19T08:18:40.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.914+0000 7fcaf8e4e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55aa42f0e240 con 0x55aa42fbc150 2024-09-19T08:18:40.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.915+0000 7fcaf4811640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fad360 0x55aa42fbbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:40.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.915+0000 7fcaf4811640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fad360 0x55aa42fbbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56154/0 (socket says 172.21.15.27:56154) 2024-09-19T08:18:40.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.915+0000 7fcaf4811640 1 -- 172.21.15.27:0/2979941414 learned_addr learned my addr 172.21.15.27:0/2979941414 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:40.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.915+0000 7fcaf5012640 1 --2- 172.21.15.27:0/2979941414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42faca40 0x55aa42face20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:40.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.915+0000 7fcaeffff640 1 --2- 172.21.15.27:0/2979941414 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42fbc150 0x55aa42fbe540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:40.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.915+0000 7fcaedffb640 1 --2- 172.21.15.27:0/3937627876 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fcae00a33b0 0x7fcae00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:40.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.915+0000 7fcaf5012640 1 --2- 172.21.15.27:0/3937627876 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fcae00a33b0 0x7fcae00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:40.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.915+0000 7fcaf4811640 1 -- 172.21.15.27:0/2979941414 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42fbc150 msgr2=0x55aa42fbe540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:40.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.915+0000 7fcaf4811640 1 --2- 172.21.15.27:0/2979941414 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42fbc150 0x55aa42fbe540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.915+0000 7fcaf4811640 1 -- 172.21.15.27:0/2979941414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42faca40 msgr2=0x55aa42face20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:40.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.915+0000 7fcaf4811640 1 --2- 172.21.15.27:0/2979941414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42faca40 0x55aa42face20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.915+0000 7fcaf4811640 1 -- 172.21.15.27:0/2979941414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa42ec61f0 con 0x55aa42fad360 2024-09-19T08:18:40.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.915+0000 7fcaeffff640 1 --2- 172.21.15.27:0/2979941414 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42fbc150 0x55aa42fbe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:18:40.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.915+0000 7fcaedffb640 1 -- 172.21.15.27:0/3937627876 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7fcae40cf070 con 0x7fcaf01002f0 2024-09-19T08:18:40.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.915+0000 7fcaf4811640 1 --2- 172.21.15.27:0/2979941414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fad360 0x55aa42fbbc10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcae409b180 tx=0x7fcae40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8555b19764d2c24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:40.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.916+0000 7fcaf5012640 1 --2- 172.21.15.27:0/3937627876 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fcae00a33b0 0x7fcae00a5870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcae8013870 tx=0x7fcae8004a40 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:40.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.916+0000 7fcadaffd640 1 -- 172.21.15.27:0/2979941414 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae401e070 con 0x55aa42fad360 2024-09-19T08:18:40.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.916+0000 7fcadaffd640 1 -- 172.21.15.27:0/2979941414 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcae409bb80 con 0x55aa42fad360 2024-09-19T08:18:40.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.916+0000 7fcadaffd640 1 -- 172.21.15.27:0/2979941414 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae40d2d10 con 0x55aa42fad360 2024-09-19T08:18:40.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.916+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/2979941414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fad360 msgr2=0x55aa42fbbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:40.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.916+0000 7fcaf8e4e740 1 --2- 172.21.15.27:0/2979941414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fad360 0x55aa42fbbc10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcae409b180 tx=0x7fcae40046c0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.916+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/2979941414 shutdown_connections 2024-09-19T08:18:40.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.916+0000 7fcaf8e4e740 1 --2- 172.21.15.27:0/2979941414 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42fbc150 0x55aa42fbe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.916+0000 7fcaf8e4e740 1 --2- 172.21.15.27:0/2979941414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fad360 0x55aa42fbbc10 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.916+0000 7fcaf8e4e740 1 --2- 172.21.15.27:0/2979941414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42faca40 0x55aa42face20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.916+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/2979941414 >> 172.21.15.27:0/2979941414 conn(0x55aa42fa90f0 msgr2=0x55aa42fa94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:40.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.917+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/2979941414 shutdown_connections 2024-09-19T08:18:40.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.917+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/2979941414 wait complete. 2024-09-19T08:18:40.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.917+0000 7fcaf8e4e740 1 -- start start 2024-09-19T08:18:40.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.917+0000 7fcaf8e4e740 1 Processor -- start 2024-09-19T08:18:40.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.917+0000 7fcaf8e4e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42faca40 0x55aa42fb9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:40.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.917+0000 7fcaf8e4e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42fad360 0x55aa42fb95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:40.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.917+0000 7fcaf8e4e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fbc150 0x55aa42fb9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:40.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.917+0000 7fcaf8e4e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55aa42fbed20 con 0x55aa42fbc150 2024-09-19T08:18:40.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.917+0000 7fcaf8e4e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55aa42eccf10 con 0x55aa42faca40 2024-09-19T08:18:40.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.917+0000 7fcaf8e4e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55aa42fbeea0 con 0x55aa42fad360 2024-09-19T08:18:40.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.917+0000 7fcaf8e4e740 10 client.0 _ll_register_callbacks cb 0x55aa42e95a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:18:40.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.917+0000 7fcaf5012640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fbc150 0x55aa42fb9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:40.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.918+0000 7fcaf5012640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fbc150 0x55aa42fb9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56162/0 (socket says 172.21.15.27:56162) 2024-09-19T08:18:40.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.918+0000 7fcaf5012640 1 -- 172.21.15.27:0/1485499658 learned_addr learned my addr 172.21.15.27:0/1485499658 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:40.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.918+0000 7fcaf4811640 1 --2- 172.21.15.27:0/1485499658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42faca40 0x55aa42fb9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:40.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.918+0000 7fcaeffff640 1 --2- 172.21.15.27:0/1485499658 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42fad360 0x55aa42fb95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:40.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.918+0000 7fcaf5012640 1 -- 172.21.15.27:0/1485499658 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42fad360 msgr2=0x55aa42fb95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:40.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.918+0000 7fcaf5012640 1 --2- 172.21.15.27:0/1485499658 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42fad360 0x55aa42fb95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.918+0000 7fcaf5012640 1 -- 172.21.15.27:0/1485499658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42faca40 msgr2=0x55aa42fb9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:40.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.918+0000 7fcaf5012640 1 --2- 172.21.15.27:0/1485499658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42faca40 0x55aa42fb9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.918+0000 7fcaf5012640 1 -- 172.21.15.27:0/1485499658 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa42c836a0 con 0x55aa42fbc150 2024-09-19T08:18:40.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.918+0000 7fcaf5012640 1 --2- 172.21.15.27:0/1485499658 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fbc150 0x55aa42fb9ae0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcae8010f70 tx=0x7fcae8004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06751025c557af4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:40.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.918+0000 7fcacffff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:18:40.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.918+0000 7fcacffff640 1 -- 172.21.15.27:0/1485499658 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae8022070 con 0x55aa42fbc150 2024-09-19T08:18:40.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.918+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/1485499658 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcae409bb80 con 0x55aa42fbc150 2024-09-19T08:18:40.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.918+0000 7fcacffff640 1 -- 172.21.15.27:0/1485499658 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7fcae801e800 con 0x55aa42fbc150 2024-09-19T08:18:40.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.918+0000 7fcacffff640 1 -- 172.21.15.27:0/1485499658 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcae802e050 con 0x55aa42fbc150 2024-09-19T08:18:40.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.919+0000 7fcaf8e4e740 10 client.16614 fetch_fsmap learned FSMap version 20 2024-09-19T08:18:40.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.919+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/1485499658 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55aa42fca9e0 con 0x55aa42fbc150 2024-09-19T08:18:40.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.919+0000 7fcacffff640 1 -- 172.21.15.27:0/1485499658 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcae409bb80 con 0x55aa42fbc150 2024-09-19T08:18:40.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.919+0000 7fcacffff640 1 -- 172.21.15.27:0/1485499658 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fcae801d070 con 0x55aa42fbc150 2024-09-19T08:18:40.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.919+0000 7fcaf8e4e740 10 client.16614 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:18:40.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.919+0000 7fcaf8e4e740 10 client.16614 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:18:40.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.919+0000 7fcaf8e4e740 20 client.16614 populate_metadata read hostname 'smithi027' 2024-09-19T08:18:40.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.919+0000 7fcaf8e4e740 1 --2- 172.21.15.27:0/1485499658 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55aa42fcbdf0 0x55aa42fce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:40.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.919+0000 7fcaf8e4e740 4 client.16614 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:18:40.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.919+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/1485499658 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa42f1f7f0 con 0x55aa42fcbdf0 2024-09-19T08:18:40.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.919+0000 7fcaf4811640 1 --2- 172.21.15.27:0/1485499658 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55aa42fcbdf0 0x55aa42fce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:40.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.920+0000 7fcaf4811640 1 --2- 172.21.15.27:0/1485499658 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55aa42fcbdf0 0x55aa42fce260 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c6b2111e8e620c8 server_cookie=527723e5cdd06dac in_seq=0 out_seq=0 2024-09-19T08:18:40.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.920+0000 7fcacffff640 10 client.16614 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:40.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.920+0000 7fcacffff640 1 -- 172.21.15.27:0/1485499658 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aa42f1f7f0 con 0x55aa42fcbdf0 2024-09-19T08:18:40.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.920+0000 7fcacffff640 10 client.16614 handle_command_reply: tid=0 2024-09-19T08:18:40.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.920+0000 7fcaf8e4e740 1 client.16614 shutdown 2024-09-19T08:18:40.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.921+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/1485499658 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fbc150 msgr2=0x55aa42fb9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:40.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.921+0000 7fcaf8e4e740 1 --2- 172.21.15.27:0/1485499658 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fbc150 0x55aa42fb9ae0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcae8010f70 tx=0x7fcae8004b50 comp rx=0 tx=0).stop 2024-09-19T08:18:40.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.921+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/1485499658 shutdown_connections 2024-09-19T08:18:40.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.921+0000 7fcaf8e4e740 1 --2- 172.21.15.27:0/1485499658 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fbc150 0x55aa42fb9ae0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.921+0000 7fcaf8e4e740 1 --2- 172.21.15.27:0/1485499658 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55aa42fcbdf0 0x55aa42fce260 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.921+0000 7fcaf8e4e740 1 --2- 172.21.15.27:0/1485499658 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42fad360 0x55aa42fb95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.921+0000 7fcaf8e4e740 1 --2- 172.21.15.27:0/1485499658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42faca40 0x55aa42fb9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.921+0000 7fcacffff640 0 client.16614 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:40.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.921+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/1485499658 >> 172.21.15.27:0/1485499658 conn(0x55aa42fa90f0 msgr2=0x55aa42faee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:40.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.921+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/1485499658 shutdown_connections 2024-09-19T08:18:40.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.921+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/1485499658 wait complete. 2024-09-19T08:18:40.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.921+0000 7fcaf8e4e740 20 client.16614 trim_cache size 0 max 16384 2024-09-19T08:18:40.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.938+0000 7fcaf8e4e740 1 Processor -- start 2024-09-19T08:18:40.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.938+0000 7fcaf8e4e740 1 -- start start 2024-09-19T08:18:40.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.939+0000 7fcaf8e4e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42faca40 0x55aa42fd3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:40.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.939+0000 7fcaf8e4e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42fad360 0x55aa42fd4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:40.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.939+0000 7fcaf8e4e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fbc150 0x55aa42fa7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:40.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.939+0000 7fcaf8e4e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf01a98b0 con 0x55aa42fbc150 2024-09-19T08:18:40.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.939+0000 7fcaf8e4e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf01ac130 con 0x55aa42fad360 2024-09-19T08:18:40.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.939+0000 7fcaf8e4e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf01a9f20 con 0x55aa42faca40 2024-09-19T08:18:40.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.939+0000 7fcaf5012640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fbc150 0x55aa42fa7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:40.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.939+0000 7fcaf5012640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fbc150 0x55aa42fa7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56170/0 (socket says 172.21.15.27:56170) 2024-09-19T08:18:40.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.939+0000 7fcaf5012640 1 -- 172.21.15.27:0/268923283 learned_addr learned my addr 172.21.15.27:0/268923283 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:40.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.939+0000 7fcaf5012640 1 -- 172.21.15.27:0/268923283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42faca40 msgr2=0x55aa42fd3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:40.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.939+0000 7fcaf5012640 1 --2- 172.21.15.27:0/268923283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42faca40 0x55aa42fd3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.939+0000 7fcaf5012640 1 -- 172.21.15.27:0/268923283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42fad360 msgr2=0x55aa42fd4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:40.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.939+0000 7fcaeffff640 1 --2- 172.21.15.27:0/268923283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42fad360 0x55aa42fd4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:40.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.939+0000 7fcaf5012640 1 --2- 172.21.15.27:0/268923283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42fad360 0x55aa42fd4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.939+0000 7fcaf5012640 1 -- 172.21.15.27:0/268923283 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa42fa3680 con 0x55aa42fbc150 2024-09-19T08:18:40.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.939+0000 7fcaf5012640 1 --2- 172.21.15.27:0/268923283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fbc150 0x55aa42fa7a50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fcae8007870 tx=0x7fcae8010c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468b97b752fdcedb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:40.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.940+0000 7fcada7fc640 1 -- 172.21.15.27:0/268923283 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae8037070 con 0x55aa42fbc150 2024-09-19T08:18:40.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.940+0000 7fcada7fc640 1 -- 172.21.15.27:0/268923283 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcae8018070 con 0x55aa42fbc150 2024-09-19T08:18:40.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.940+0000 7fcada7fc640 1 -- 172.21.15.27:0/268923283 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae8022040 con 0x55aa42fbc150 2024-09-19T08:18:40.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.940+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/268923283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fbc150 msgr2=0x55aa42fa7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:40.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.940+0000 7fcaf8e4e740 1 --2- 172.21.15.27:0/268923283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fbc150 0x55aa42fa7a50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fcae8007870 tx=0x7fcae8010c00 comp rx=0 tx=0).stop 2024-09-19T08:18:40.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.940+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/268923283 shutdown_connections 2024-09-19T08:18:40.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.940+0000 7fcaf8e4e740 1 --2- 172.21.15.27:0/268923283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fbc150 0x55aa42fa7a50 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.940+0000 7fcaf8e4e740 1 --2- 172.21.15.27:0/268923283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42fad360 0x55aa42fd4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.940+0000 7fcaf8e4e740 1 --2- 172.21.15.27:0/268923283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42faca40 0x55aa42fd3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.940+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/268923283 >> 172.21.15.27:0/268923283 conn(0x55aa42fa90f0 msgr2=0x55aa42fbafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:40.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.940+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/268923283 shutdown_connections 2024-09-19T08:18:40.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.940+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/268923283 wait complete. 2024-09-19T08:18:40.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.941+0000 7fcaf8e4e740 1 -- start start 2024-09-19T08:18:40.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.941+0000 7fcaf8e4e740 1 Processor -- start 2024-09-19T08:18:40.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.941+0000 7fcaf8e4e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42faca40 0x55aa42fc44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:40.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.941+0000 7fcaf8e4e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fad360 0x55aa42fc49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:40.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.941+0000 7fcaf8e4e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42fbc150 0x55aa42fbfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:40.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.941+0000 7fcaf8e4e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf01aa5f0 con 0x55aa42fad360 2024-09-19T08:18:40.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.941+0000 7fcaf8e4e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf01aba60 con 0x55aa42faca40 2024-09-19T08:18:40.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.941+0000 7fcaf8e4e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf01aacc0 con 0x55aa42fbc150 2024-09-19T08:18:40.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.941+0000 7fcaf8e4e740 10 client.0 _ll_register_callbacks cb 0x7fcae8013450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:18:40.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.941+0000 7fcaeffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fad360 0x55aa42fc49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:40.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.941+0000 7fcaeffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fad360 0x55aa42fc49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56180/0 (socket says 172.21.15.27:56180) 2024-09-19T08:18:40.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.941+0000 7fcaeffff640 1 -- 172.21.15.27:0/2879577750 learned_addr learned my addr 172.21.15.27:0/2879577750 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:40.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.941+0000 7fcaf4811640 1 --2- 172.21.15.27:0/2879577750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42faca40 0x55aa42fc44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:40.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.941+0000 7fcaf5012640 1 --2- 172.21.15.27:0/2879577750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42fbc150 0x55aa42fbfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:40.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.941+0000 7fcaeffff640 1 -- 172.21.15.27:0/2879577750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42fbc150 msgr2=0x55aa42fbfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:40.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.941+0000 7fcaeffff640 1 --2- 172.21.15.27:0/2879577750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42fbc150 0x55aa42fbfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.942+0000 7fcaeffff640 1 -- 172.21.15.27:0/2879577750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42faca40 msgr2=0x55aa42fc44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:40.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.942+0000 7fcaeffff640 1 --2- 172.21.15.27:0/2879577750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42faca40 0x55aa42fc44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.942+0000 7fcaeffff640 1 -- 172.21.15.27:0/2879577750 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa42fc02b0 con 0x55aa42fad360 2024-09-19T08:18:40.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.942+0000 7fcaf4811640 1 --2- 172.21.15.27:0/2879577750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42faca40 0x55aa42fc44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:18:40.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.942+0000 7fcaf5012640 1 --2- 172.21.15.27:0/2879577750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42fbc150 0x55aa42fbfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:18:40.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.942+0000 7fcaeffff640 1 --2- 172.21.15.27:0/2879577750 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fad360 0x55aa42fc49f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fcaf006a100 tx=0x7fcadc031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e0054f817becc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:40.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.942+0000 7fcacffff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:18:40.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.942+0000 7fcacffff640 1 -- 172.21.15.27:0/2879577750 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc035040 con 0x55aa42fad360 2024-09-19T08:18:40.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.942+0000 7fcacffff640 1 -- 172.21.15.27:0/2879577750 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7fcadc004300 con 0x55aa42fad360 2024-09-19T08:18:40.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.942+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/2879577750 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcae8018070 con 0x55aa42fad360 2024-09-19T08:18:40.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.942+0000 7fcacffff640 1 -- 172.21.15.27:0/2879577750 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcadc005030 con 0x55aa42fad360 2024-09-19T08:18:40.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.942+0000 7fcaf8e4e740 10 client.16620 fetch_fsmap learned FSMap version 20 2024-09-19T08:18:40.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.942+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/2879577750 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55aa430367d0 con 0x55aa42fad360 2024-09-19T08:18:40.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.942+0000 7fcacffff640 1 -- 172.21.15.27:0/2879577750 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcae8018070 con 0x55aa42fad360 2024-09-19T08:18:40.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.943+0000 7fcacffff640 1 -- 172.21.15.27:0/2879577750 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fcadc0035f0 con 0x55aa42fad360 2024-09-19T08:18:40.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.943+0000 7fcaf8e4e740 10 client.16620 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:18:40.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.943+0000 7fcaf8e4e740 10 client.16620 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:18:40.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.943+0000 7fcaf8e4e740 20 client.16620 populate_metadata read hostname 'smithi027' 2024-09-19T08:18:40.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.943+0000 7fcaf8e4e740 1 --2- 172.21.15.27:0/2879577750 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55aa43036f80 0x55aa430393a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:40.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.943+0000 7fcaf8e4e740 4 client.16620 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:18:40.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.943+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/2879577750 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55aa42f19d00 con 0x55aa43036f80 2024-09-19T08:18:40.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.943+0000 7fcaf4811640 1 --2- 172.21.15.27:0/2879577750 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55aa43036f80 0x55aa430393a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:40.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.943+0000 7fcacffff640 10 client.16620 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:40.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.943+0000 7fcaf4811640 1 --2- 172.21.15.27:0/2879577750 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55aa43036f80 0x55aa430393a0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2181d4d09f6edb70 server_cookie=dc450040fb16c838 in_seq=0 out_seq=0 2024-09-19T08:18:40.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.944+0000 7fcacffff640 1 -- 172.21.15.27:0/2879577750 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55aa42f19d00 con 0x55aa43036f80 2024-09-19T08:18:40.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.944+0000 7fcacffff640 10 client.16620 handle_command_reply: tid=0 2024-09-19T08:18:40.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.944+0000 7fcaf8e4e740 1 client.16620 shutdown 2024-09-19T08:18:40.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.944+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/2879577750 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fad360 msgr2=0x55aa42fc49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:40.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.944+0000 7fcaf8e4e740 1 --2- 172.21.15.27:0/2879577750 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fad360 0x55aa42fc49f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fcaf006a100 tx=0x7fcadc031a60 comp rx=0 tx=0).stop 2024-09-19T08:18:40.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.944+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/2879577750 shutdown_connections 2024-09-19T08:18:40.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.944+0000 7fcaf8e4e740 1 --2- 172.21.15.27:0/2879577750 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55aa43036f80 0x55aa430393a0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.944+0000 7fcaf8e4e740 1 --2- 172.21.15.27:0/2879577750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aa42fbc150 0x55aa42fbfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.944+0000 7fcaf8e4e740 1 --2- 172.21.15.27:0/2879577750 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55aa42fad360 0x55aa42fc49f0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.944+0000 7fcacffff640 0 client.16620 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:40.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.944+0000 7fcaf8e4e740 1 --2- 172.21.15.27:0/2879577750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aa42faca40 0x55aa42fc44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.944+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/2879577750 >> 172.21.15.27:0/2879577750 conn(0x55aa42fa90f0 msgr2=0x55aa42fb9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:40.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.945+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/2879577750 shutdown_connections 2024-09-19T08:18:40.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.945+0000 7fcaf8e4e740 1 -- 172.21.15.27:0/2879577750 wait complete. 2024-09-19T08:18:40.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.945+0000 7fcaf8e4e740 20 client.16620 trim_cache size 0 max 16384 2024-09-19T08:18:40.952 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:18:40.952 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:18:40.952 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "1f6b3bee-a6e1-4dc7-abac-cd8a10186e63", 2024-09-19T08:18:40.952 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:18:40.952 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:18:40.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.945+0000 7fcaf6a75640 1 -- 172.21.15.27:0/3937627876 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fcae00a33b0 msgr2=0x7fcae00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:40.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.945+0000 7fcaf6a75640 1 --2- 172.21.15.27:0/3937627876 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fcae00a33b0 0x7fcae00a5870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcae8013870 tx=0x7fcae8004a40 comp rx=0 tx=0).stop 2024-09-19T08:18:40.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.945+0000 7fcaf6a75640 1 -- 172.21.15.27:0/3937627876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcaf01002f0 msgr2=0x7fcaf0198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:40.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.945+0000 7fcaf6a75640 1 --2- 172.21.15.27:0/3937627876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcaf01002f0 0x7fcaf0198620 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcae400b4a0 tx=0x7fcae400b960 comp rx=0 tx=0).stop 2024-09-19T08:18:40.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.945+0000 7fcaf6a75640 1 -- 172.21.15.27:0/3937627876 shutdown_connections 2024-09-19T08:18:40.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.945+0000 7fcaf6a75640 1 --2- 172.21.15.27:0/3937627876 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fcae00a33b0 0x7fcae00a5870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.945+0000 7fcaf6a75640 1 --2- 172.21.15.27:0/3937627876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaf0106f50 0x7fcaf019cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.945+0000 7fcaf6a75640 1 --2- 172.21.15.27:0/3937627876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaf0100ca0 0x7fcaf0198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.945+0000 7fcaf6a75640 1 --2- 172.21.15.27:0/3937627876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcaf01002f0 0x7fcaf0198620 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:40.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.945+0000 7fcaf6a75640 1 -- 172.21.15.27:0/3937627876 >> 172.21.15.27:0/3937627876 conn(0x7fcaf0077210 msgr2=0x7fcaf0105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:40.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.946+0000 7fcaf6a75640 1 -- 172.21.15.27:0/3937627876 shutdown_connections 2024-09-19T08:18:40.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:40.946+0000 7fcaf6a75640 1 -- 172.21.15.27:0/3937627876 wait complete. 2024-09-19T08:18:41.447 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:41 smithi027 ceph-mon[31209]: pgmap v234: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:41.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:41 smithi155 ceph-mon[35362]: pgmap v234: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:41.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:41 smithi203 ceph-mon[35198]: pgmap v234: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:41.774 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:18:42.032 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:18:42.450 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:42 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:18:42.450 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:42 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:18:42.450 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:42 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:18:42.450 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:42 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:18:42.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:42 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:18:42.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:42 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:18:42.488 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:42 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:18:42.488 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:42 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:18:42.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:42 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:18:42.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:42 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:18:42.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:42 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:18:42.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:42 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:18:42.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.534+0000 7f1df6e4a640 1 -- 172.21.15.27:0/2202639440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1df0106f10 msgr2=0x7f1df010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:42.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.534+0000 7f1df6e4a640 1 --2- 172.21.15.27:0/2202639440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1df0106f10 0x7f1df010ea90 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1de8009900 tx=0x7f1de802a410 comp rx=0 tx=0).stop 2024-09-19T08:18:42.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.534+0000 7f1df6e4a640 1 -- 172.21.15.27:0/2202639440 shutdown_connections 2024-09-19T08:18:42.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.534+0000 7f1df6e4a640 1 --2- 172.21.15.27:0/2202639440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1df0106f10 0x7f1df010ea90 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.534+0000 7f1df6e4a640 1 --2- 172.21.15.27:0/2202639440 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1df0102790 0x7f1df01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.534+0000 7f1df6e4a640 1 --2- 172.21.15.27:0/2202639440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1df0101de0 0x7f1df01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.534+0000 7f1df6e4a640 1 -- 172.21.15.27:0/2202639440 >> 172.21.15.27:0/2202639440 conn(0x7f1df00fd8c0 msgr2=0x7f1df00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:42.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.534+0000 7f1df6e4a640 1 -- 172.21.15.27:0/2202639440 shutdown_connections 2024-09-19T08:18:42.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.534+0000 7f1df6e4a640 1 -- 172.21.15.27:0/2202639440 wait complete. 2024-09-19T08:18:42.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.535+0000 7f1df6e4a640 1 Processor -- start 2024-09-19T08:18:42.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.535+0000 7f1df6e4a640 1 -- start start 2024-09-19T08:18:42.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.535+0000 7f1df6e4a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1df0101de0 0x7f1df00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:42.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.535+0000 7f1df6e4a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1df0102790 0x7f1df0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:42.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.535+0000 7f1df6e4a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1df0106f10 0x7f1df0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:42.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.535+0000 7f1df6e4a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1df0111f90 con 0x7f1df0101de0 2024-09-19T08:18:42.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.535+0000 7f1df6e4a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1df0111e10 con 0x7f1df0102790 2024-09-19T08:18:42.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.535+0000 7f1df6e4a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1df0112110 con 0x7f1df0106f10 2024-09-19T08:18:42.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.535+0000 7f1df4be6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1df0101de0 0x7f1df00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:42.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.535+0000 7f1df4be6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1df0101de0 0x7f1df00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56200/0 (socket says 172.21.15.27:56200) 2024-09-19T08:18:42.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.535+0000 7f1df4be6640 1 -- 172.21.15.27:0/2495833516 learned_addr learned my addr 172.21.15.27:0/2495833516 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:42.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.535+0000 7f1df53e7640 1 --2- 172.21.15.27:0/2495833516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1df0106f10 0x7f1df0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:42.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.535+0000 7f1deffff640 1 --2- 172.21.15.27:0/2495833516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1df0102790 0x7f1df0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:42.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.536+0000 7f1df4be6640 1 -- 172.21.15.27:0/2495833516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1df0106f10 msgr2=0x7f1df0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:42.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.536+0000 7f1df4be6640 1 --2- 172.21.15.27:0/2495833516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1df0106f10 0x7f1df0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.536+0000 7f1df4be6640 1 -- 172.21.15.27:0/2495833516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1df0102790 msgr2=0x7f1df0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:42.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.536+0000 7f1df4be6640 1 --2- 172.21.15.27:0/2495833516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1df0102790 0x7f1df0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.536+0000 7f1df4be6640 1 -- 172.21.15.27:0/2495833516 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df01a68d0 con 0x7f1df0101de0 2024-09-19T08:18:42.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.536+0000 7f1df4be6640 1 --2- 172.21.15.27:0/2495833516 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1df0101de0 0x7f1df00744f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800c920 tx=0x7f1dd800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:42.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.536+0000 7f1dedffb640 1 -- 172.21.15.27:0/2495833516 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8007c70 con 0x7f1df0101de0 2024-09-19T08:18:42.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.536+0000 7f1dedffb640 1 -- 172.21.15.27:0/2495833516 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dd8007e10 con 0x7f1df0101de0 2024-09-19T08:18:42.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.536+0000 7f1df6e4a640 1 -- 172.21.15.27:0/2495833516 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1df01a6bc0 con 0x7f1df0101de0 2024-09-19T08:18:42.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.536+0000 7f1dedffb640 1 -- 172.21.15.27:0/2495833516 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8018890 con 0x7f1df0101de0 2024-09-19T08:18:42.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.536+0000 7f1df6e4a640 1 -- 172.21.15.27:0/2495833516 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1df01a7100 con 0x7f1df0101de0 2024-09-19T08:18:42.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.538+0000 7f1dedffb640 1 -- 172.21.15.27:0/2495833516 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f1dd8018a70 con 0x7f1df0101de0 2024-09-19T08:18:42.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.539+0000 7f1df9223740 1 Processor -- start 2024-09-19T08:18:42.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.539+0000 7f1df9223740 1 -- start start 2024-09-19T08:18:42.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.539+0000 7f1df9223740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e24a0 0x5613db6e2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:42.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.539+0000 7f1df9223740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e2dc0 0x5613db6ed140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:42.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.539+0000 7f1dedffb640 1 --2- 172.21.15.27:0/2495833516 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1ddc0a33b0 0x7f1ddc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:42.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.539+0000 7f1df9223740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6ed680 0x5613db6efa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:42.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.539+0000 7f1df9223740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5613db6482e0 con 0x5613db6e24a0 2024-09-19T08:18:42.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.539+0000 7f1df9223740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5613db5efce0 con 0x5613db6e2dc0 2024-09-19T08:18:42.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.539+0000 7f1df9223740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5613db6442a0 con 0x5613db6ed680 2024-09-19T08:18:42.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.539+0000 7f1deffff640 1 --2- 172.21.15.27:0/2495833516 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1ddc0a33b0 0x7f1ddc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:42.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.539+0000 7f1df53e7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e24a0 0x5613db6e2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:42.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.539+0000 7f1df53e7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e24a0 0x5613db6e2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56208/0 (socket says 172.21.15.27:56208) 2024-09-19T08:18:42.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.539+0000 7f1df53e7640 1 -- 172.21.15.27:0/924175285 learned_addr learned my addr 172.21.15.27:0/924175285 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:42.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.539+0000 7f1dedffb640 1 -- 172.21.15.27:0/2495833516 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f1dd80cff60 con 0x7f1df0101de0 2024-09-19T08:18:42.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.540+0000 7f1df4be6640 1 --2- 172.21.15.27:0/924175285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e2dc0 0x5613db6ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:42.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.540+0000 7f1df53e7640 1 --2- 172.21.15.27:0/924175285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6ed680 0x5613db6efa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:42.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.540+0000 7f1df53e7640 1 -- 172.21.15.27:0/924175285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6ed680 msgr2=0x5613db6efa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:42.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.540+0000 7f1df53e7640 1 --2- 172.21.15.27:0/924175285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6ed680 0x5613db6efa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.540+0000 7f1df53e7640 1 -- 172.21.15.27:0/924175285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e2dc0 msgr2=0x5613db6ed140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:42.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.540+0000 7f1df53e7640 1 --2- 172.21.15.27:0/924175285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e2dc0 0x5613db6ed140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.540+0000 7f1df53e7640 1 -- 172.21.15.27:0/924175285 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613db5d4440 con 0x5613db6e24a0 2024-09-19T08:18:42.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.540+0000 7f1deffff640 1 --2- 172.21.15.27:0/2495833516 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1ddc0a33b0 0x7f1ddc0a5870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1df0075f80 tx=0x7f1de00072f0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:42.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.540+0000 7f1df53e7640 1 --2- 172.21.15.27:0/924175285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e24a0 0x5613db6e2880 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1de80096c0 tx=0x7f1de80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4507a81edfdf45 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:42.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.540+0000 7f1de6ffd640 1 -- 172.21.15.27:0/924175285 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de8035030 con 0x5613db6e24a0 2024-09-19T08:18:42.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.540+0000 7f1de6ffd640 1 -- 172.21.15.27:0/924175285 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1de80035f0 con 0x5613db6e24a0 2024-09-19T08:18:42.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.540+0000 7f1de6ffd640 1 -- 172.21.15.27:0/924175285 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de803b6c0 con 0x5613db6e24a0 2024-09-19T08:18:42.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.541+0000 7f1df9223740 1 -- 172.21.15.27:0/924175285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e24a0 msgr2=0x5613db6e2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:42.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.541+0000 7f1df9223740 1 --2- 172.21.15.27:0/924175285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e24a0 0x5613db6e2880 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1de80096c0 tx=0x7f1de80095c0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.541+0000 7f1df9223740 1 -- 172.21.15.27:0/924175285 shutdown_connections 2024-09-19T08:18:42.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.541+0000 7f1df9223740 1 --2- 172.21.15.27:0/924175285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6ed680 0x5613db6efa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.541+0000 7f1df9223740 1 --2- 172.21.15.27:0/924175285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e2dc0 0x5613db6ed140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.541+0000 7f1df9223740 1 --2- 172.21.15.27:0/924175285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e24a0 0x5613db6e2880 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.541+0000 7f1df9223740 1 -- 172.21.15.27:0/924175285 >> 172.21.15.27:0/924175285 conn(0x5613db6dea30 msgr2=0x5613db6dee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:42.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.541+0000 7f1df9223740 1 -- 172.21.15.27:0/924175285 shutdown_connections 2024-09-19T08:18:42.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.541+0000 7f1df9223740 1 -- 172.21.15.27:0/924175285 wait complete. 2024-09-19T08:18:42.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.541+0000 7f1df9223740 1 -- start start 2024-09-19T08:18:42.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.541+0000 7f1df9223740 1 Processor -- start 2024-09-19T08:18:42.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.542+0000 7f1df9223740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6e24a0 0x5613db6ecf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:42.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.542+0000 7f1df9223740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e2dc0 0x5613db6ea200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:42.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.542+0000 7f1df9223740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6ed680 0x5613db6ea740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:42.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.542+0000 7f1df9223740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5613db6f0250 con 0x5613db6ed680 2024-09-19T08:18:42.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.542+0000 7f1df9223740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5613db603050 con 0x5613db6e2dc0 2024-09-19T08:18:42.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.542+0000 7f1df9223740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5613db6f03d0 con 0x5613db6e24a0 2024-09-19T08:18:42.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.542+0000 7f1df9223740 10 client.0 _ll_register_callbacks cb 0x5613db643160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:18:42.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.542+0000 7f1df53e7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6ed680 0x5613db6ea740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:42.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.542+0000 7f1df53e7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6ed680 0x5613db6ea740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56214/0 (socket says 172.21.15.27:56214) 2024-09-19T08:18:42.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.542+0000 7f1df53e7640 1 -- 172.21.15.27:0/1880664054 learned_addr learned my addr 172.21.15.27:0/1880664054 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:42.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.542+0000 7f1df4be6640 1 --2- 172.21.15.27:0/1880664054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6e24a0 0x5613db6ecf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:42.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.542+0000 7f1deffff640 1 --2- 172.21.15.27:0/1880664054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e2dc0 0x5613db6ea200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:42.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.542+0000 7f1df53e7640 1 -- 172.21.15.27:0/1880664054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6e24a0 msgr2=0x5613db6ecf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:42.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.542+0000 7f1df53e7640 1 --2- 172.21.15.27:0/1880664054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6e24a0 0x5613db6ecf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.542+0000 7f1df53e7640 1 -- 172.21.15.27:0/1880664054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e2dc0 msgr2=0x5613db6ea200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:42.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.542+0000 7f1df53e7640 1 --2- 172.21.15.27:0/1880664054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e2dc0 0x5613db6ea200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.542+0000 7f1df53e7640 1 -- 172.21.15.27:0/1880664054 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613db3b93c0 con 0x5613db6ed680 2024-09-19T08:18:42.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.542+0000 7f1deffff640 1 --2- 172.21.15.27:0/1880664054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e2dc0 0x5613db6ea200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:18:42.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.543+0000 7f1df53e7640 1 --2- 172.21.15.27:0/1880664054 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6ed680 0x5613db6ea740 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1de8009590 tx=0x7f1de8031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121b5e9b3d533fad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:42.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.543+0000 7f1dcffff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:18:42.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.543+0000 7f1dcffff640 1 -- 172.21.15.27:0/1880664054 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de8035040 con 0x5613db6ed680 2024-09-19T08:18:42.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.543+0000 7f1df9223740 1 -- 172.21.15.27:0/1880664054 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1de80035f0 con 0x5613db6ed680 2024-09-19T08:18:42.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.543+0000 7f1dcffff640 1 -- 172.21.15.27:0/1880664054 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f1de80039b0 con 0x5613db6ed680 2024-09-19T08:18:42.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.543+0000 7f1dcffff640 1 -- 172.21.15.27:0/1880664054 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1de8056050 con 0x5613db6ed680 2024-09-19T08:18:42.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.543+0000 7f1df9223740 10 client.16632 fetch_fsmap learned FSMap version 20 2024-09-19T08:18:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.543+0000 7f1df9223740 1 -- 172.21.15.27:0/1880664054 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5613db6fbba0 con 0x5613db6ed680 2024-09-19T08:18:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.543+0000 7f1dcffff640 1 -- 172.21.15.27:0/1880664054 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1de80035f0 con 0x5613db6ed680 2024-09-19T08:18:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.543+0000 7f1dcffff640 1 -- 172.21.15.27:0/1880664054 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1de803d450 con 0x5613db6ed680 2024-09-19T08:18:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.543+0000 7f1df9223740 10 client.16632 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:18:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.543+0000 7f1df9223740 10 client.16632 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:18:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.543+0000 7f1df9223740 20 client.16632 populate_metadata read hostname 'smithi027' 2024-09-19T08:18:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.543+0000 7f1df9223740 1 --2- 172.21.15.27:0/1880664054 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5613db6fcef0 0x5613db6ff2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.543+0000 7f1df9223740 4 client.16632 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:18:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.543+0000 7f1df9223740 1 -- 172.21.15.27:0/1880664054 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613db655850 con 0x5613db6fcef0 2024-09-19T08:18:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.544+0000 7f1df4be6640 1 --2- 172.21.15.27:0/1880664054 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5613db6fcef0 0x5613db6ff2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.544+0000 7f1dcffff640 10 client.16632 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.544+0000 7f1df4be6640 1 --2- 172.21.15.27:0/1880664054 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5613db6fcef0 0x5613db6ff2e0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64208fa99aeef272 server_cookie=48fc63e44013dd5e in_seq=0 out_seq=0 2024-09-19T08:18:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.545+0000 7f1dcffff640 1 -- 172.21.15.27:0/1880664054 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5613db655850 con 0x5613db6fcef0 2024-09-19T08:18:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.545+0000 7f1dcffff640 10 client.16632 handle_command_reply: tid=0 2024-09-19T08:18:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.545+0000 7f1df9223740 1 client.16632 shutdown 2024-09-19T08:18:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.545+0000 7f1df9223740 1 -- 172.21.15.27:0/1880664054 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6ed680 msgr2=0x5613db6ea740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.545+0000 7f1df9223740 1 --2- 172.21.15.27:0/1880664054 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6ed680 0x5613db6ea740 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1de8009590 tx=0x7f1de8031b60 comp rx=0 tx=0).stop 2024-09-19T08:18:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.545+0000 7f1df9223740 1 -- 172.21.15.27:0/1880664054 shutdown_connections 2024-09-19T08:18:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.545+0000 7f1df9223740 1 --2- 172.21.15.27:0/1880664054 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6ed680 0x5613db6ea740 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.545+0000 7f1df9223740 1 --2- 172.21.15.27:0/1880664054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e2dc0 0x5613db6ea200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.545+0000 7f1df9223740 1 --2- 172.21.15.27:0/1880664054 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5613db6fcef0 0x5613db6ff2e0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.545+0000 7f1df9223740 1 --2- 172.21.15.27:0/1880664054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6e24a0 0x5613db6ecf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.545+0000 7f1dcffff640 0 client.16632 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:42.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.545+0000 7f1df9223740 1 -- 172.21.15.27:0/1880664054 >> 172.21.15.27:0/1880664054 conn(0x5613db6dea30 msgr2=0x5613db6e4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:42.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.545+0000 7f1df9223740 1 -- 172.21.15.27:0/1880664054 shutdown_connections 2024-09-19T08:18:42.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.545+0000 7f1df9223740 1 -- 172.21.15.27:0/1880664054 wait complete. 2024-09-19T08:18:42.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.545+0000 7f1df9223740 20 client.16632 trim_cache size 0 max 16384 2024-09-19T08:18:42.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.563+0000 7f1df9223740 1 Processor -- start 2024-09-19T08:18:42.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.563+0000 7f1df9223740 1 -- start start 2024-09-19T08:18:42.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.563+0000 7f1df9223740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e24a0 0x5613db6ec530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:42.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.563+0000 7f1df9223740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e2dc0 0x5613db701f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.563+0000 7f1df9223740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6ed680 0x5613db702470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.563+0000 7f1df9223740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1df01ad900 con 0x5613db6e2dc0 2024-09-19T08:18:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.563+0000 7f1df9223740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1df01b0160 con 0x5613db6e24a0 2024-09-19T08:18:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.563+0000 7f1df9223740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1df01adf50 con 0x5613db6ed680 2024-09-19T08:18:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.563+0000 7f1deffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e2dc0 0x5613db701f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.563+0000 7f1deffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e2dc0 0x5613db701f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56222/0 (socket says 172.21.15.27:56222) 2024-09-19T08:18:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.563+0000 7f1deffff640 1 -- 172.21.15.27:0/2473104076 learned_addr learned my addr 172.21.15.27:0/2473104076 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.563+0000 7f1df53e7640 1 --2- 172.21.15.27:0/2473104076 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6ed680 0x5613db702470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.563+0000 7f1df4be6640 1 --2- 172.21.15.27:0/2473104076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e24a0 0x5613db6ec530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.563+0000 7f1deffff640 1 -- 172.21.15.27:0/2473104076 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6ed680 msgr2=0x5613db702470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.563+0000 7f1deffff640 1 --2- 172.21.15.27:0/2473104076 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6ed680 0x5613db702470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.563+0000 7f1deffff640 1 -- 172.21.15.27:0/2473104076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e24a0 msgr2=0x5613db6ec530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:42.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.563+0000 7f1deffff640 1 --2- 172.21.15.27:0/2473104076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e24a0 0x5613db6ec530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.563+0000 7f1deffff640 1 -- 172.21.15.27:0/2473104076 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613db6ed2c0 con 0x5613db6e2dc0 2024-09-19T08:18:42.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.563+0000 7f1df53e7640 1 --2- 172.21.15.27:0/2473104076 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6ed680 0x5613db702470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:18:42.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.563+0000 7f1df4be6640 1 --2- 172.21.15.27:0/2473104076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e24a0 0x5613db6ec530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:18:42.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.564+0000 7f1deffff640 1 --2- 172.21.15.27:0/2473104076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e2dc0 0x5613db701f30 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1de000ce30 tx=0x7f1de0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b960f9e1b5e9acac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:42.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.564+0000 7f1de67fc640 1 -- 172.21.15.27:0/2473104076 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de000ce60 con 0x5613db6e2dc0 2024-09-19T08:18:42.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.564+0000 7f1de67fc640 1 -- 172.21.15.27:0/2473104076 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1de0024070 con 0x5613db6e2dc0 2024-09-19T08:18:42.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.564+0000 7f1de67fc640 1 -- 172.21.15.27:0/2473104076 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de001fa00 con 0x5613db6e2dc0 2024-09-19T08:18:42.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.564+0000 7f1df9223740 1 -- 172.21.15.27:0/2473104076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e2dc0 msgr2=0x5613db701f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:42.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.564+0000 7f1df9223740 1 --2- 172.21.15.27:0/2473104076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e2dc0 0x5613db701f30 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1de000ce30 tx=0x7f1de0012000 comp rx=0 tx=0).stop 2024-09-19T08:18:42.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.564+0000 7f1df9223740 1 -- 172.21.15.27:0/2473104076 shutdown_connections 2024-09-19T08:18:42.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.564+0000 7f1df9223740 1 --2- 172.21.15.27:0/2473104076 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6ed680 0x5613db702470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.564+0000 7f1df9223740 1 --2- 172.21.15.27:0/2473104076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e2dc0 0x5613db701f30 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.564+0000 7f1df9223740 1 --2- 172.21.15.27:0/2473104076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e24a0 0x5613db6ec530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.564+0000 7f1df9223740 1 -- 172.21.15.27:0/2473104076 >> 172.21.15.27:0/2473104076 conn(0x5613db6dea30 msgr2=0x5613db6ddb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:42.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.564+0000 7f1df9223740 1 -- 172.21.15.27:0/2473104076 shutdown_connections 2024-09-19T08:18:42.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.565+0000 7f1df9223740 1 -- 172.21.15.27:0/2473104076 wait complete. 2024-09-19T08:18:42.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.565+0000 7f1df9223740 1 -- start start 2024-09-19T08:18:42.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.565+0000 7f1df9223740 1 Processor -- start 2024-09-19T08:18:42.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.565+0000 7f1df9223740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e24a0 0x5613db75ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:42.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.565+0000 7f1df9223740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e2dc0 0x5613db75f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:42.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.565+0000 7f1df9223740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6ed680 0x5613db701720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:42.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.565+0000 7f1df9223740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1df01ae620 con 0x5613db6e2dc0 2024-09-19T08:18:42.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.565+0000 7f1df9223740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1df01afa90 con 0x5613db6e24a0 2024-09-19T08:18:42.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.565+0000 7f1df9223740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1df01aecf0 con 0x5613db6ed680 2024-09-19T08:18:42.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.565+0000 7f1df9223740 10 client.0 _ll_register_callbacks cb 0x7f1dd80984e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:18:42.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.565+0000 7f1deffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e2dc0 0x5613db75f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:42.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.565+0000 7f1deffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e2dc0 0x5613db75f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56232/0 (socket says 172.21.15.27:56232) 2024-09-19T08:18:42.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.565+0000 7f1deffff640 1 -- 172.21.15.27:0/3461264151 learned_addr learned my addr 172.21.15.27:0/3461264151 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:18:42.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.566+0000 7f1df4be6640 1 --2- 172.21.15.27:0/3461264151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e24a0 0x5613db75ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:42.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.566+0000 7f1df53e7640 1 --2- 172.21.15.27:0/3461264151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6ed680 0x5613db701720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:42.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.566+0000 7f1deffff640 1 -- 172.21.15.27:0/3461264151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6ed680 msgr2=0x5613db701720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:42.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.566+0000 7f1deffff640 1 --2- 172.21.15.27:0/3461264151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6ed680 0x5613db701720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.566+0000 7f1deffff640 1 -- 172.21.15.27:0/3461264151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e24a0 msgr2=0x5613db75ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:18:42.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.566+0000 7f1deffff640 1 --2- 172.21.15.27:0/3461264151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e24a0 0x5613db75ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.566+0000 7f1deffff640 1 -- 172.21.15.27:0/3461264151 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613db701f30 con 0x5613db6e2dc0 2024-09-19T08:18:42.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.566+0000 7f1df53e7640 1 --2- 172.21.15.27:0/3461264151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6ed680 0x5613db701720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:18:42.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.566+0000 7f1deffff640 1 --2- 172.21.15.27:0/3461264151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e2dc0 0x5613db75f1a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1de0015010 tx=0x7f1de001f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148c3bc0331d1de0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:18:42.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.566+0000 7f1dcffff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:18:42.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.566+0000 7f1dcffff640 1 -- 172.21.15.27:0/3461264151 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de000ce60 con 0x5613db6e2dc0 2024-09-19T08:18:42.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.566+0000 7f1dcffff640 1 -- 172.21.15.27:0/3461264151 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f1de001f700 con 0x5613db6e2dc0 2024-09-19T08:18:42.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.566+0000 7f1df9223740 1 -- 172.21.15.27:0/3461264151 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1de0024070 con 0x5613db6e2dc0 2024-09-19T08:18:42.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.566+0000 7f1dcffff640 1 -- 172.21.15.27:0/3461264151 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1de0011c60 con 0x5613db6e2dc0 2024-09-19T08:18:42.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.566+0000 7f1df9223740 10 client.16638 fetch_fsmap learned FSMap version 20 2024-09-19T08:18:42.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.566+0000 7f1df9223740 1 -- 172.21.15.27:0/3461264151 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5613db767570 con 0x5613db6e2dc0 2024-09-19T08:18:42.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.567+0000 7f1dcffff640 1 -- 172.21.15.27:0/3461264151 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1de0024070 con 0x5613db6e2dc0 2024-09-19T08:18:42.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.567+0000 7f1dcffff640 1 -- 172.21.15.27:0/3461264151 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1de0039070 con 0x5613db6e2dc0 2024-09-19T08:18:42.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.567+0000 7f1df9223740 10 client.16638 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:18:42.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.567+0000 7f1df9223740 10 client.16638 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:18:42.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.567+0000 7f1df9223740 20 client.16638 populate_metadata read hostname 'smithi027' 2024-09-19T08:18:42.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.567+0000 7f1df9223740 1 --2- 172.21.15.27:0/3461264151 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5613db767c90 0x5613db76a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:18:42.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.567+0000 7f1df9223740 4 client.16638 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:18:42.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.567+0000 7f1df9223740 1 -- 172.21.15.27:0/3461264151 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5613db64fd60 con 0x5613db767c90 2024-09-19T08:18:42.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.567+0000 7f1df4be6640 1 --2- 172.21.15.27:0/3461264151 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5613db767c90 0x5613db76a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:18:42.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.567+0000 7f1dcffff640 10 client.16638 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:42.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.567+0000 7f1df4be6640 1 --2- 172.21.15.27:0/3461264151 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5613db767c90 0x5613db76a0b0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fbd724ede423c84 server_cookie=519f3c4613e0988e in_seq=0 out_seq=0 2024-09-19T08:18:42.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.568+0000 7f1dcffff640 1 -- 172.21.15.27:0/3461264151 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5613db64fd60 con 0x5613db767c90 2024-09-19T08:18:42.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.568+0000 7f1dcffff640 10 client.16638 handle_command_reply: tid=0 2024-09-19T08:18:42.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.568+0000 7f1df9223740 1 client.16638 shutdown 2024-09-19T08:18:42.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.568+0000 7f1df9223740 1 -- 172.21.15.27:0/3461264151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e2dc0 msgr2=0x5613db75f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:42.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.568+0000 7f1df9223740 1 --2- 172.21.15.27:0/3461264151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e2dc0 0x5613db75f1a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1de0015010 tx=0x7f1de001f420 comp rx=0 tx=0).stop 2024-09-19T08:18:42.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.568+0000 7f1df9223740 1 -- 172.21.15.27:0/3461264151 shutdown_connections 2024-09-19T08:18:42.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.568+0000 7f1df9223740 1 --2- 172.21.15.27:0/3461264151 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5613db767c90 0x5613db76a0b0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.568+0000 7f1df9223740 1 --2- 172.21.15.27:0/3461264151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613db6ed680 0x5613db701720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.568+0000 7f1df9223740 1 --2- 172.21.15.27:0/3461264151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5613db6e2dc0 0x5613db75f1a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.568+0000 7f1df9223740 1 --2- 172.21.15.27:0/3461264151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5613db6e24a0 0x5613db75ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.568+0000 7f1df9223740 1 -- 172.21.15.27:0/3461264151 >> 172.21.15.27:0/3461264151 conn(0x5613db6dea30 msgr2=0x5613db6e9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:42.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.568+0000 7f1dcffff640 0 client.16638 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:18:42.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.568+0000 7f1df9223740 1 -- 172.21.15.27:0/3461264151 shutdown_connections 2024-09-19T08:18:42.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.568+0000 7f1df9223740 1 -- 172.21.15.27:0/3461264151 wait complete. 2024-09-19T08:18:42.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.568+0000 7f1df9223740 20 client.16638 trim_cache size 0 max 16384 2024-09-19T08:18:42.587 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:18:42.587 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:18:42.587 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": { 2024-09-19T08:18:42.588 INFO:teuthology.orchestra.run.smithi027.stdout: "1f6b3bee-a6e1-4dc7-abac-cd8a10186e63": { 2024-09-19T08:18:42.588 INFO:teuthology.orchestra.run.smithi027.stdout: "path": "/", 2024-09-19T08:18:42.588 INFO:teuthology.orchestra.run.smithi027.stdout: "tag": "1f6b3bee-a6e1-4dc7-abac-cd8a10186e63", 2024-09-19T08:18:42.588 INFO:teuthology.orchestra.run.smithi027.stdout: "options": "recursive,force" 2024-09-19T08:18:42.588 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:18:42.588 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:18:42.588 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:18:42.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.569+0000 7f1df6e4a640 1 -- 172.21.15.27:0/2495833516 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1ddc0a33b0 msgr2=0x7f1ddc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:42.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.569+0000 7f1df6e4a640 1 --2- 172.21.15.27:0/2495833516 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1ddc0a33b0 0x7f1ddc0a5870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1df0075f80 tx=0x7f1de00072f0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.569+0000 7f1df6e4a640 1 -- 172.21.15.27:0/2495833516 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1df0101de0 msgr2=0x7f1df00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:18:42.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.569+0000 7f1df6e4a640 1 --2- 172.21.15.27:0/2495833516 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1df0101de0 0x7f1df00744f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800c920 tx=0x7f1dd800cde0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.569+0000 7f1df6e4a640 1 -- 172.21.15.27:0/2495833516 shutdown_connections 2024-09-19T08:18:42.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.569+0000 7f1df6e4a640 1 --2- 172.21.15.27:0/2495833516 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1ddc0a33b0 0x7f1ddc0a5870 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.569+0000 7f1df6e4a640 1 --2- 172.21.15.27:0/2495833516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1df0106f10 0x7f1df0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.569+0000 7f1df6e4a640 1 --2- 172.21.15.27:0/2495833516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1df0102790 0x7f1df0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.569+0000 7f1df6e4a640 1 --2- 172.21.15.27:0/2495833516 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1df0101de0 0x7f1df00744f0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:18:42.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.569+0000 7f1df6e4a640 1 -- 172.21.15.27:0/2495833516 >> 172.21.15.27:0/2495833516 conn(0x7f1df00fd8c0 msgr2=0x7f1df00ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:18:42.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.569+0000 7f1df6e4a640 1 -- 172.21.15.27:0/2495833516 shutdown_connections 2024-09-19T08:18:42.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:18:42.569+0000 7f1df6e4a640 1 -- 172.21.15.27:0/2495833516 wait complete. 2024-09-19T08:18:43.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:43 smithi027 ceph-mon[31209]: pgmap v235: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:43.379 INFO:tasks.cephfs.filesystem:scrub status for tag:1f6b3bee-a6e1-4dc7-abac-cd8a10186e63 - {'path': '/', 'tag': '1f6b3bee-a6e1-4dc7-abac-cd8a10186e63', 'options': 'recursive,force'} 2024-09-19T08:18:43.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:43 smithi155 ceph-mon[35362]: pgmap v235: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:43.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:43 smithi203 ceph-mon[35198]: pgmap v235: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:45.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:45 smithi155 ceph-mon[35362]: pgmap v236: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:18:45.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:45 smithi027 ceph-mon[31209]: pgmap v236: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:18:45.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:45 smithi203 ceph-mon[35198]: pgmap v236: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:18:46.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:46 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:18:46.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:46 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:18:46.507 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:46 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:18:47.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:47 smithi155 ceph-mon[35362]: pgmap v237: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:18:47.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:47 smithi027 ceph-mon[31209]: pgmap v237: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:18:47.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:47 smithi203 ceph-mon[35198]: pgmap v237: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:18:49.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:49 smithi155 ceph-mon[35362]: pgmap v238: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:18:49.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:49 smithi027 ceph-mon[31209]: pgmap v238: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:18:49.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:49 smithi203 ceph-mon[35198]: pgmap v238: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:18:51.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:51 smithi155 ceph-mon[35362]: pgmap v239: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:18:51.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:51 smithi027 ceph-mon[31209]: pgmap v239: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:18:51.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:51 smithi203 ceph-mon[35198]: pgmap v239: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:18:53.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:53 smithi155 ceph-mon[35362]: pgmap v240: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:18:53.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:53 smithi027 ceph-mon[31209]: pgmap v240: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:18:53.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:53 smithi203 ceph-mon[35198]: pgmap v240: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:18:55.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:55 smithi155 ceph-mon[35362]: pgmap v241: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:18:55.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:55 smithi027 ceph-mon[31209]: pgmap v241: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:18:55.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:55 smithi203 ceph-mon[35198]: pgmap v241: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:18:57.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:57 smithi155 ceph-mon[35362]: pgmap v242: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:57.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:57 smithi027 ceph-mon[31209]: pgmap v242: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:57.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:57 smithi203 ceph-mon[35198]: pgmap v242: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:18:59.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:18:59 smithi155 ceph-mon[35362]: pgmap v243: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:18:59.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:18:59 smithi027 ceph-mon[31209]: pgmap v243: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:18:59.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:18:59 smithi203 ceph-mon[35198]: pgmap v243: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:19:01.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:01 smithi155 ceph-mon[35362]: pgmap v244: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:01.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:01 smithi027 ceph-mon[31209]: pgmap v244: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:01.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:01 smithi203 ceph-mon[35198]: pgmap v244: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:03.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:03 smithi155 ceph-mon[35362]: pgmap v245: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:03.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:03 smithi027 ceph-mon[31209]: pgmap v245: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:03.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:03 smithi203 ceph-mon[35198]: pgmap v245: 97 pgs: 97 active+clean; 16 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:05.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:05 smithi155 ceph-mon[35362]: pgmap v246: 97 pgs: 97 active+clean; 16 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:19:05.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:05 smithi027 ceph-mon[31209]: pgmap v246: 97 pgs: 97 active+clean; 16 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:19:05.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:05 smithi203 ceph-mon[35198]: pgmap v246: 97 pgs: 97 active+clean; 16 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:19:07.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:07 smithi155 ceph-mon[35362]: pgmap v247: 97 pgs: 97 active+clean; 16 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-19T08:19:07.488 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:07 smithi155 ceph-mon[35362]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T08:19:07.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:07 smithi027 ceph-mon[31209]: pgmap v247: 97 pgs: 97 active+clean; 16 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-19T08:19:07.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:07 smithi027 ceph-mon[31209]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T08:19:07.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:07 smithi203 ceph-mon[35198]: pgmap v247: 97 pgs: 97 active+clean; 16 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-19T08:19:07.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:07 smithi203 ceph-mon[35198]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T08:19:09.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:09 smithi155 ceph-mon[35362]: pgmap v249: 97 pgs: 97 active+clean; 16 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-19T08:19:09.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:09 smithi027 ceph-mon[31209]: pgmap v249: 97 pgs: 97 active+clean; 16 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-19T08:19:09.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:09 smithi203 ceph-mon[35198]: pgmap v249: 97 pgs: 97 active+clean; 16 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-19T08:19:11.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:11 smithi155 ceph-mon[35362]: pgmap v250: 97 pgs: 97 active+clean; 16 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-19T08:19:11.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:11 smithi155 ceph-mon[35362]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T08:19:11.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:11 smithi027 ceph-mon[31209]: pgmap v250: 97 pgs: 97 active+clean; 16 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-19T08:19:11.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:11 smithi027 ceph-mon[31209]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T08:19:11.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:11 smithi203 ceph-mon[35198]: pgmap v250: 97 pgs: 97 active+clean; 16 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-19T08:19:11.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:11 smithi203 ceph-mon[35198]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T08:19:13.381 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:19:13.413 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:13 smithi027 ceph-mon[31209]: pgmap v252: 97 pgs: 97 active+clean; 16 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-19T08:19:13.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:13 smithi155 ceph-mon[35362]: pgmap v252: 97 pgs: 97 active+clean; 16 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-19T08:19:13.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:13 smithi203 ceph-mon[35198]: pgmap v252: 97 pgs: 97 active+clean; 16 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-19T08:19:13.667 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:19:14.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.187+0000 7f3f664a5640 1 -- 172.21.15.27:0/3603302130 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f60102570 msgr2=0x7f3f601029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:14.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.187+0000 7f3f664a5640 1 --2- 172.21.15.27:0/3603302130 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f60102570 0x7f3f601029b0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f3f54009900 tx=0x7f3f5402a480 comp rx=0 tx=0).stop 2024-09-19T08:19:14.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.187+0000 7f3f664a5640 1 -- 172.21.15.27:0/3603302130 shutdown_connections 2024-09-19T08:19:14.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.187+0000 7f3f664a5640 1 --2- 172.21.15.27:0/3603302130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f60102ef0 0x7f3f6010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.187+0000 7f3f664a5640 1 --2- 172.21.15.27:0/3603302130 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f60102570 0x7f3f601029b0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.187+0000 7f3f664a5640 1 --2- 172.21.15.27:0/3603302130 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f60100e20 0x7f3f60101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.187+0000 7f3f664a5640 1 -- 172.21.15.27:0/3603302130 >> 172.21.15.27:0/3603302130 conn(0x7f3f600fc7d0 msgr2=0x7f3f600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:14.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.187+0000 7f3f664a5640 1 -- 172.21.15.27:0/3603302130 shutdown_connections 2024-09-19T08:19:14.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.187+0000 7f3f664a5640 1 -- 172.21.15.27:0/3603302130 wait complete. 2024-09-19T08:19:14.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.187+0000 7f3f664a5640 1 Processor -- start 2024-09-19T08:19:14.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.187+0000 7f3f664a5640 1 -- start start 2024-09-19T08:19:14.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.188+0000 7f3f664a5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f60100e20 0x7f3f601970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:14.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.188+0000 7f3f664a5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f60102570 0x7f3f601975f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:14.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.188+0000 7f3f664a5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f60102ef0 0x7f3f6019c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:14.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.188+0000 7f3f664a5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3f60110f50 con 0x7f3f60102ef0 2024-09-19T08:19:14.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.188+0000 7f3f664a5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3f60110dd0 con 0x7f3f60100e20 2024-09-19T08:19:14.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.188+0000 7f3f664a5640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3f601110d0 con 0x7f3f60102570 2024-09-19T08:19:14.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.188+0000 7f3f64a42640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f60102ef0 0x7f3f6019c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:14.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.188+0000 7f3f64a42640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f60102ef0 0x7f3f6019c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54848/0 (socket says 172.21.15.27:54848) 2024-09-19T08:19:14.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.188+0000 7f3f64a42640 1 -- 172.21.15.27:0/748712201 learned_addr learned my addr 172.21.15.27:0/748712201 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:14.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.188+0000 7f3f5f7fe640 1 --2- 172.21.15.27:0/748712201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f60102570 0x7f3f601975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:14.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.188+0000 7f3f5ffff640 1 --2- 172.21.15.27:0/748712201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f60100e20 0x7f3f601970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:14.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.188+0000 7f3f64a42640 1 -- 172.21.15.27:0/748712201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f60102570 msgr2=0x7f3f601975f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:14.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.188+0000 7f3f64a42640 1 --2- 172.21.15.27:0/748712201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f60102570 0x7f3f601975f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.188+0000 7f3f64a42640 1 -- 172.21.15.27:0/748712201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f60100e20 msgr2=0x7f3f601970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:14.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.188+0000 7f3f64a42640 1 --2- 172.21.15.27:0/748712201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f60100e20 0x7f3f601970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.188+0000 7f3f64a42640 1 -- 172.21.15.27:0/748712201 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f6019c640 con 0x7f3f60102ef0 2024-09-19T08:19:14.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.188+0000 7f3f5f7fe640 1 --2- 172.21.15.27:0/748712201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f60102570 0x7f3f601975f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:19:14.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.189+0000 7f3f64a42640 1 --2- 172.21.15.27:0/748712201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f60102ef0 0x7f3f6019c100 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f3f5800eaa0 tx=0x7f3f5800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:14.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.189+0000 7f3f5d7fa640 1 -- 172.21.15.27:0/748712201 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f58004d20 con 0x7f3f60102ef0 2024-09-19T08:19:14.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.189+0000 7f3f664a5640 1 -- 172.21.15.27:0/748712201 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f6019c930 con 0x7f3f60102ef0 2024-09-19T08:19:14.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.189+0000 7f3f5d7fa640 1 -- 172.21.15.27:0/748712201 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f58005020 con 0x7f3f60102ef0 2024-09-19T08:19:14.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.189+0000 7f3f5d7fa640 1 -- 172.21.15.27:0/748712201 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f580116d0 con 0x7f3f60102ef0 2024-09-19T08:19:14.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.189+0000 7f3f664a5640 1 -- 172.21.15.27:0/748712201 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f6019ce40 con 0x7f3f60102ef0 2024-09-19T08:19:14.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.192+0000 7f3f6887e740 1 Processor -- start 2024-09-19T08:19:14.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.192+0000 7f3f5d7fa640 1 -- 172.21.15.27:0/748712201 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3f580051d0 con 0x7f3f60102ef0 2024-09-19T08:19:14.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.192+0000 7f3f6887e740 1 -- start start 2024-09-19T08:19:14.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.192+0000 7f3f6887e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f2fe8f64a0 0x55f2fe8f6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:14.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.193+0000 7f3f6887e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe901140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:14.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.193+0000 7f3f6887e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe901680 0x55f2fe903a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:14.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.193+0000 7f3f6887e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f2fe85c2e0 con 0x55f2fe901680 2024-09-19T08:19:14.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.193+0000 7f3f6887e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f2fe803ce0 con 0x55f2fe8f64a0 2024-09-19T08:19:14.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.193+0000 7f3f6887e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f2fe8582a0 con 0x55f2fe8f6dc0 2024-09-19T08:19:14.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.193+0000 7f3f5f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe901680 0x55f2fe903a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:14.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.193+0000 7f3f5f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe901680 0x55f2fe903a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54862/0 (socket says 172.21.15.27:54862) 2024-09-19T08:19:14.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.193+0000 7f3f5f7fe640 1 -- 172.21.15.27:0/426894022 learned_addr learned my addr 172.21.15.27:0/426894022 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:14.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.193+0000 7f3f5f7fe640 1 --2- 172.21.15.27:0/426894022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f2fe8f64a0 0x55f2fe8f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:14.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.193+0000 7f3f5ffff640 1 --2- 172.21.15.27:0/426894022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe901140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:14.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.193+0000 7f3f5d7fa640 1 --2- 172.21.15.27:0/748712201 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3f480a33b0 0x7f3f480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:14.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.193+0000 7f3f64a42640 1 --2- 172.21.15.27:0/748712201 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3f480a33b0 0x7f3f480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:14.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.193+0000 7f3f5f7fe640 1 -- 172.21.15.27:0/426894022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe8f6dc0 msgr2=0x55f2fe901140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:14.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.193+0000 7f3f5f7fe640 1 --2- 172.21.15.27:0/426894022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe901140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.193+0000 7f3f5f7fe640 1 -- 172.21.15.27:0/426894022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f2fe8f64a0 msgr2=0x55f2fe8f6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:14.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.193+0000 7f3f5d7fa640 1 -- 172.21.15.27:0/748712201 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f3f580cfe10 con 0x7f3f60102ef0 2024-09-19T08:19:14.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.193+0000 7f3f5f7fe640 1 --2- 172.21.15.27:0/426894022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f2fe8f64a0 0x55f2fe8f6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.193+0000 7f3f5f7fe640 1 -- 172.21.15.27:0/426894022 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2fe7e8440 con 0x55f2fe901680 2024-09-19T08:19:14.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.193+0000 7f3f5ffff640 1 --2- 172.21.15.27:0/426894022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe901140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:19:14.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.194+0000 7f3f5f7fe640 1 --2- 172.21.15.27:0/426894022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe901680 0x55f2fe903a70 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f3f54031490 tx=0x7f3f54031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7ff419cce8fd19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:14.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.194+0000 7f3f467fc640 1 -- 172.21.15.27:0/426894022 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f54035040 con 0x55f2fe901680 2024-09-19T08:19:14.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.194+0000 7f3f64a42640 1 --2- 172.21.15.27:0/748712201 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3f480a33b0 0x7f3f480a5870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3f580cd630 tx=0x7f3f580915a0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:14.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.194+0000 7f3f467fc640 1 -- 172.21.15.27:0/426894022 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f54031540 con 0x55f2fe901680 2024-09-19T08:19:14.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.194+0000 7f3f467fc640 1 -- 172.21.15.27:0/426894022 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5403d6e0 con 0x55f2fe901680 2024-09-19T08:19:14.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.195+0000 7f3f6887e740 1 -- 172.21.15.27:0/426894022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe901680 msgr2=0x55f2fe903a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:14.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.195+0000 7f3f6887e740 1 --2- 172.21.15.27:0/426894022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe901680 0x55f2fe903a70 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f3f54031490 tx=0x7f3f54031400 comp rx=0 tx=0).stop 2024-09-19T08:19:14.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.195+0000 7f3f6887e740 1 -- 172.21.15.27:0/426894022 shutdown_connections 2024-09-19T08:19:14.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.195+0000 7f3f6887e740 1 --2- 172.21.15.27:0/426894022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe901680 0x55f2fe903a70 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.195+0000 7f3f6887e740 1 --2- 172.21.15.27:0/426894022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe901140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.195+0000 7f3f6887e740 1 --2- 172.21.15.27:0/426894022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f2fe8f64a0 0x55f2fe8f6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.195+0000 7f3f6887e740 1 -- 172.21.15.27:0/426894022 >> 172.21.15.27:0/426894022 conn(0x55f2fe8f2a30 msgr2=0x55f2fe8f2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:14.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.195+0000 7f3f6887e740 1 -- 172.21.15.27:0/426894022 shutdown_connections 2024-09-19T08:19:14.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.195+0000 7f3f6887e740 1 -- 172.21.15.27:0/426894022 wait complete. 2024-09-19T08:19:14.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.195+0000 7f3f6887e740 1 -- start start 2024-09-19T08:19:14.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.195+0000 7f3f6887e740 1 Processor -- start 2024-09-19T08:19:14.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.196+0000 7f3f6887e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f2fe8f64a0 0x55f2fe901030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:14.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.196+0000 7f3f6887e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe8fe2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:14.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.196+0000 7f3f6887e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe901680 0x55f2fe8fe880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:14.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.196+0000 7f3f6887e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f2fe904250 con 0x55f2fe8f6dc0 2024-09-19T08:19:14.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.196+0000 7f3f6887e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f2fe817050 con 0x55f2fe8f64a0 2024-09-19T08:19:14.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.196+0000 7f3f6887e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f2fe9043d0 con 0x55f2fe901680 2024-09-19T08:19:14.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.196+0000 7f3f6887e740 10 client.0 _ll_register_callbacks cb 0x55f2fe857160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:19:14.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.196+0000 7f3f5ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe8fe2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:14.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.196+0000 7f3f5ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe8fe2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54866/0 (socket says 172.21.15.27:54866) 2024-09-19T08:19:14.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.196+0000 7f3f5ffff640 1 -- 172.21.15.27:0/2750579277 learned_addr learned my addr 172.21.15.27:0/2750579277 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:14.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.196+0000 7f3f5f7fe640 1 --2- 172.21.15.27:0/2750579277 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe901680 0x55f2fe8fe880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:14.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.196+0000 7f3f5f7fe640 1 --2- 172.21.15.27:0/2750579277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f2fe8f64a0 0x55f2fe901030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:14.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.196+0000 7f3f5ffff640 1 -- 172.21.15.27:0/2750579277 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe901680 msgr2=0x55f2fe8fe880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:14.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.196+0000 7f3f5ffff640 1 --2- 172.21.15.27:0/2750579277 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe901680 0x55f2fe8fe880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.196+0000 7f3f5ffff640 1 -- 172.21.15.27:0/2750579277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f2fe8f64a0 msgr2=0x55f2fe901030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:14.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.196+0000 7f3f5ffff640 1 --2- 172.21.15.27:0/2750579277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f2fe8f64a0 0x55f2fe901030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.196+0000 7f3f5ffff640 1 -- 172.21.15.27:0/2750579277 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2fe5cd3c0 con 0x55f2fe8f6dc0 2024-09-19T08:19:14.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.196+0000 7f3f5f7fe640 1 --2- 172.21.15.27:0/2750579277 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe901680 0x55f2fe8fe880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:19:14.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.197+0000 7f3f5ffff640 1 --2- 172.21.15.27:0/2750579277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe8fe2e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f3f50010a50 tx=0x7f3f50010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f02107ee50b195a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:14.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.197+0000 7f3f3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:19:14.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.197+0000 7f3f3f7fe640 1 -- 172.21.15.27:0/2750579277 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5001e060 con 0x55f2fe8f6dc0 2024-09-19T08:19:14.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.197+0000 7f3f3f7fe640 1 -- 172.21.15.27:0/2750579277 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f3f5000fbd0 con 0x55f2fe8f6dc0 2024-09-19T08:19:14.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.197+0000 7f3f6887e740 1 -- 172.21.15.27:0/2750579277 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f54031540 con 0x55f2fe8f6dc0 2024-09-19T08:19:14.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.197+0000 7f3f3f7fe640 1 -- 172.21.15.27:0/2750579277 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3f5000fdd0 con 0x55f2fe8f6dc0 2024-09-19T08:19:14.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.197+0000 7f3f6887e740 10 client.16650 fetch_fsmap learned FSMap version 20 2024-09-19T08:19:14.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.197+0000 7f3f6887e740 1 -- 172.21.15.27:0/2750579277 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f2fe90fcc0 con 0x55f2fe8f6dc0 2024-09-19T08:19:14.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.197+0000 7f3f3f7fe640 1 -- 172.21.15.27:0/2750579277 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f54031540 con 0x55f2fe8f6dc0 2024-09-19T08:19:14.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.197+0000 7f3f3f7fe640 1 -- 172.21.15.27:0/2750579277 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3f50021630 con 0x55f2fe8f6dc0 2024-09-19T08:19:14.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.197+0000 7f3f6887e740 10 client.16650 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:19:14.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.197+0000 7f3f6887e740 10 client.16650 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:19:14.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.197+0000 7f3f6887e740 20 client.16650 populate_metadata read hostname 'smithi027' 2024-09-19T08:19:14.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.197+0000 7f3f6887e740 1 --2- 172.21.15.27:0/2750579277 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f2fe9111d0 0x55f2fe9135c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:14.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.198+0000 7f3f6887e740 4 client.16650 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:19:14.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.198+0000 7f3f6887e740 1 -- 172.21.15.27:0/2750579277 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2fe869850 con 0x55f2fe9111d0 2024-09-19T08:19:14.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.198+0000 7f3f5f7fe640 1 --2- 172.21.15.27:0/2750579277 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f2fe9111d0 0x55f2fe9135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:14.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.198+0000 7f3f3f7fe640 10 client.16650 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:14.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.198+0000 7f3f5f7fe640 1 --2- 172.21.15.27:0/2750579277 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f2fe9111d0 0x55f2fe9135c0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=427e958b7f1ee7a1 server_cookie=419f061cd819a3a5 in_seq=0 out_seq=0 2024-09-19T08:19:14.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.199+0000 7f3f3f7fe640 1 -- 172.21.15.27:0/2750579277 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f2fe869850 con 0x55f2fe9111d0 2024-09-19T08:19:14.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.199+0000 7f3f3f7fe640 10 client.16650 handle_command_reply: tid=0 2024-09-19T08:19:14.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.199+0000 7f3f6887e740 1 client.16650 shutdown 2024-09-19T08:19:14.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.199+0000 7f3f6887e740 1 -- 172.21.15.27:0/2750579277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f6dc0 msgr2=0x55f2fe8fe2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:14.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.199+0000 7f3f6887e740 1 --2- 172.21.15.27:0/2750579277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe8fe2e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f3f50010a50 tx=0x7f3f50010f10 comp rx=0 tx=0).stop 2024-09-19T08:19:14.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.199+0000 7f3f6887e740 1 -- 172.21.15.27:0/2750579277 shutdown_connections 2024-09-19T08:19:14.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.199+0000 7f3f6887e740 1 --2- 172.21.15.27:0/2750579277 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f2fe9111d0 0x55f2fe9135c0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.199+0000 7f3f6887e740 1 --2- 172.21.15.27:0/2750579277 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe901680 0x55f2fe8fe880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.199+0000 7f3f6887e740 1 --2- 172.21.15.27:0/2750579277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe8fe2e0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.199+0000 7f3f6887e740 1 --2- 172.21.15.27:0/2750579277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f2fe8f64a0 0x55f2fe901030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.199+0000 7f3f6887e740 1 -- 172.21.15.27:0/2750579277 >> 172.21.15.27:0/2750579277 conn(0x55f2fe8f2a30 msgr2=0x55f2fe8f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:14.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.199+0000 7f3f3f7fe640 0 client.16650 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:14.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.199+0000 7f3f6887e740 1 -- 172.21.15.27:0/2750579277 shutdown_connections 2024-09-19T08:19:14.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.199+0000 7f3f6887e740 1 -- 172.21.15.27:0/2750579277 wait complete. 2024-09-19T08:19:14.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.199+0000 7f3f6887e740 20 client.16650 trim_cache size 0 max 16384 2024-09-19T08:19:14.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.219+0000 7f3f6887e740 1 Processor -- start 2024-09-19T08:19:14.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.219+0000 7f3f6887e740 1 -- start start 2024-09-19T08:19:14.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.220+0000 7f3f6887e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f2fe8f64a0 0x55f2fe90d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:14.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.220+0000 7f3f6887e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe8f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:14.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.220+0000 7f3f6887e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe901680 0x55f2fe918ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:14.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.220+0000 7f3f6887e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3f601b1df0 con 0x55f2fe8f6dc0 2024-09-19T08:19:14.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.220+0000 7f3f6887e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3f601b4650 con 0x55f2fe8f64a0 2024-09-19T08:19:14.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.220+0000 7f3f6887e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3f601b2440 con 0x55f2fe901680 2024-09-19T08:19:14.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.220+0000 7f3f5ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe8f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:14.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.220+0000 7f3f5ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe8f2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54868/0 (socket says 172.21.15.27:54868) 2024-09-19T08:19:14.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.220+0000 7f3f5ffff640 1 -- 172.21.15.27:0/1044722265 learned_addr learned my addr 172.21.15.27:0/1044722265 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:14.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.220+0000 7f3f5f7fe640 1 --2- 172.21.15.27:0/1044722265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f2fe8f64a0 0x55f2fe90d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:14.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.220+0000 7f3f5f7fe640 1 --2- 172.21.15.27:0/1044722265 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe901680 0x55f2fe918ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:14.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.220+0000 7f3f5ffff640 1 -- 172.21.15.27:0/1044722265 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe901680 msgr2=0x55f2fe918ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:14.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.220+0000 7f3f5ffff640 1 --2- 172.21.15.27:0/1044722265 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe901680 0x55f2fe918ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.220+0000 7f3f5ffff640 1 -- 172.21.15.27:0/1044722265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f2fe8f64a0 msgr2=0x55f2fe90d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:14.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.220+0000 7f3f5ffff640 1 --2- 172.21.15.27:0/1044722265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f2fe8f64a0 0x55f2fe90d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.220+0000 7f3f5ffff640 1 -- 172.21.15.27:0/1044722265 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2fe8fd290 con 0x55f2fe8f6dc0 2024-09-19T08:19:14.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.220+0000 7f3f5f7fe640 1 --2- 172.21.15.27:0/1044722265 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe901680 0x55f2fe918ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:19:14.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.220+0000 7f3f5ffff640 1 --2- 172.21.15.27:0/1044722265 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe8f2e10 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f3f50000c00 tx=0x7f3f5000f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a8abeaf2be4e2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:14.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.220+0000 7f3f45ffb640 1 -- 172.21.15.27:0/1044722265 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f50021cc0 con 0x55f2fe8f6dc0 2024-09-19T08:19:14.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.221+0000 7f3f45ffb640 1 -- 172.21.15.27:0/1044722265 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f50021e60 con 0x55f2fe8f6dc0 2024-09-19T08:19:14.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.221+0000 7f3f45ffb640 1 -- 172.21.15.27:0/1044722265 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f500048c0 con 0x55f2fe8f6dc0 2024-09-19T08:19:14.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.221+0000 7f3f6887e740 1 -- 172.21.15.27:0/1044722265 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f6dc0 msgr2=0x55f2fe8f2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:14.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.221+0000 7f3f6887e740 1 --2- 172.21.15.27:0/1044722265 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe8f2e10 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f3f50000c00 tx=0x7f3f5000f7f0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.221+0000 7f3f6887e740 1 -- 172.21.15.27:0/1044722265 shutdown_connections 2024-09-19T08:19:14.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.221+0000 7f3f6887e740 1 --2- 172.21.15.27:0/1044722265 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe901680 0x55f2fe918ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.221+0000 7f3f6887e740 1 --2- 172.21.15.27:0/1044722265 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe8f2e10 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.221+0000 7f3f6887e740 1 --2- 172.21.15.27:0/1044722265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f2fe8f64a0 0x55f2fe90d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.221+0000 7f3f6887e740 1 -- 172.21.15.27:0/1044722265 >> 172.21.15.27:0/1044722265 conn(0x55f2fe8f2a30 msgr2=0x55f2fe8f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:14.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.221+0000 7f3f6887e740 1 -- 172.21.15.27:0/1044722265 shutdown_connections 2024-09-19T08:19:14.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.221+0000 7f3f6887e740 1 -- 172.21.15.27:0/1044722265 wait complete. 2024-09-19T08:19:14.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.222+0000 7f3f6887e740 1 -- start start 2024-09-19T08:19:14.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.222+0000 7f3f6887e740 1 Processor -- start 2024-09-19T08:19:14.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.222+0000 7f3f6887e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f64a0 0x55f2fe909ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:14.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.222+0000 7f3f6887e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe904e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:14.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.222+0000 7f3f6887e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f2fe901680 0x55f2fe905340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:14.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.222+0000 7f3f6887e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3f601b2b10 con 0x55f2fe8f64a0 2024-09-19T08:19:14.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.222+0000 7f3f6887e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3f601b3f80 con 0x55f2fe901680 2024-09-19T08:19:14.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.222+0000 7f3f6887e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3f601b31e0 con 0x55f2fe8f6dc0 2024-09-19T08:19:14.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.222+0000 7f3f6887e740 10 client.0 _ll_register_callbacks cb 0x7f3f50010660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:19:14.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.222+0000 7f3f5f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f64a0 0x55f2fe909ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:14.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.222+0000 7f3f5f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f64a0 0x55f2fe909ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54878/0 (socket says 172.21.15.27:54878) 2024-09-19T08:19:14.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.222+0000 7f3f5f7fe640 1 -- 172.21.15.27:0/2444779663 learned_addr learned my addr 172.21.15.27:0/2444779663 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:14.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.223+0000 7f3f5f7fe640 1 --2- 172.21.15.27:0/2444779663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f2fe901680 0x55f2fe905340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:14.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.223+0000 7f3f5ffff640 1 --2- 172.21.15.27:0/2444779663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe904e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:14.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.223+0000 7f3f5f7fe640 1 -- 172.21.15.27:0/2444779663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe8f6dc0 msgr2=0x55f2fe904e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:14.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.223+0000 7f3f5f7fe640 1 --2- 172.21.15.27:0/2444779663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe904e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.223+0000 7f3f5f7fe640 1 -- 172.21.15.27:0/2444779663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f2fe901680 msgr2=0x55f2fe905340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:14.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.223+0000 7f3f5f7fe640 1 --2- 172.21.15.27:0/2444779663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f2fe901680 0x55f2fe905340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.223+0000 7f3f5f7fe640 1 -- 172.21.15.27:0/2444779663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2fe8febf0 con 0x55f2fe8f64a0 2024-09-19T08:19:14.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.223+0000 7f3f5ffff640 1 --2- 172.21.15.27:0/2444779663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe904e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:19:14.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.223+0000 7f3f5f7fe640 1 --2- 172.21.15.27:0/2444779663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f64a0 0x55f2fe909ad0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3f54031e20 tx=0x7f3f54031e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881f95d502cfa5be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:14.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.223+0000 7f3f3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:19:14.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.223+0000 7f3f3f7fe640 1 -- 172.21.15.27:0/2444779663 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5405e060 con 0x55f2fe8f64a0 2024-09-19T08:19:14.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.223+0000 7f3f3f7fe640 1 -- 172.21.15.27:0/2444779663 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f3f54003cb0 con 0x55f2fe8f64a0 2024-09-19T08:19:14.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.223+0000 7f3f6887e740 1 -- 172.21.15.27:0/2444779663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f50021e60 con 0x55f2fe8f64a0 2024-09-19T08:19:14.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.223+0000 7f3f3f7fe640 1 -- 172.21.15.27:0/2444779663 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3f54035040 con 0x55f2fe8f64a0 2024-09-19T08:19:14.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.223+0000 7f3f6887e740 10 client.16656 fetch_fsmap learned FSMap version 20 2024-09-19T08:19:14.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.223+0000 7f3f6887e740 1 -- 172.21.15.27:0/2444779663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f2fe97ba20 con 0x55f2fe8f64a0 2024-09-19T08:19:14.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.223+0000 7f3f3f7fe640 1 -- 172.21.15.27:0/2444779663 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f50021e60 con 0x55f2fe8f64a0 2024-09-19T08:19:14.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.224+0000 7f3f3f7fe640 1 -- 172.21.15.27:0/2444779663 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3f540317e0 con 0x55f2fe8f64a0 2024-09-19T08:19:14.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.224+0000 7f3f6887e740 10 client.16656 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:19:14.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.224+0000 7f3f6887e740 10 client.16656 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:19:14.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.224+0000 7f3f6887e740 20 client.16656 populate_metadata read hostname 'smithi027' 2024-09-19T08:19:14.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.224+0000 7f3f6887e740 1 --2- 172.21.15.27:0/2444779663 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f2fe97bd60 0x55f2fe97e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:14.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.224+0000 7f3f6887e740 4 client.16656 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:19:14.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.224+0000 7f3f6887e740 1 -- 172.21.15.27:0/2444779663 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f2fe863d60 con 0x55f2fe97bd60 2024-09-19T08:19:14.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.224+0000 7f3f5ffff640 1 --2- 172.21.15.27:0/2444779663 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f2fe97bd60 0x55f2fe97e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:14.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.225+0000 7f3f5ffff640 1 --2- 172.21.15.27:0/2444779663 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f2fe97bd60 0x55f2fe97e150 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d69216fcc826762 server_cookie=b94b9c63c0e52c2a in_seq=0 out_seq=0 2024-09-19T08:19:14.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.225+0000 7f3f3f7fe640 10 client.16656 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:14.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.225+0000 7f3f3f7fe640 1 -- 172.21.15.27:0/2444779663 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f2fe863d60 con 0x55f2fe97bd60 2024-09-19T08:19:14.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.225+0000 7f3f3f7fe640 10 client.16656 handle_command_reply: tid=0 2024-09-19T08:19:14.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.225+0000 7f3f6887e740 1 client.16656 shutdown 2024-09-19T08:19:14.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.225+0000 7f3f6887e740 1 -- 172.21.15.27:0/2444779663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f64a0 msgr2=0x55f2fe909ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:14.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.225+0000 7f3f6887e740 1 --2- 172.21.15.27:0/2444779663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f64a0 0x55f2fe909ad0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3f54031e20 tx=0x7f3f54031e50 comp rx=0 tx=0).stop 2024-09-19T08:19:14.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.225+0000 7f3f6887e740 1 -- 172.21.15.27:0/2444779663 shutdown_connections 2024-09-19T08:19:14.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.225+0000 7f3f6887e740 1 --2- 172.21.15.27:0/2444779663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f2fe901680 0x55f2fe905340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.225+0000 7f3f6887e740 1 --2- 172.21.15.27:0/2444779663 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55f2fe97bd60 0x55f2fe97e150 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.225+0000 7f3f6887e740 1 --2- 172.21.15.27:0/2444779663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f2fe8f6dc0 0x55f2fe904e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.225+0000 7f3f6887e740 1 --2- 172.21.15.27:0/2444779663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2fe8f64a0 0x55f2fe909ad0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.225+0000 7f3f3f7fe640 0 client.16656 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:14.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.225+0000 7f3f6887e740 1 -- 172.21.15.27:0/2444779663 >> 172.21.15.27:0/2444779663 conn(0x55f2fe8f2a30 msgr2=0x55f2fe8f1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:14.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.225+0000 7f3f6887e740 1 -- 172.21.15.27:0/2444779663 shutdown_connections 2024-09-19T08:19:14.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.225+0000 7f3f6887e740 1 -- 172.21.15.27:0/2444779663 wait complete. 2024-09-19T08:19:14.230 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.225+0000 7f3f6887e740 20 client.16656 trim_cache size 0 max 16384 2024-09-19T08:19:14.230 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:19:14.230 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:19:14.230 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:19:14.230 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:19:14.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.226+0000 7f3f664a5640 1 -- 172.21.15.27:0/748712201 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3f480a33b0 msgr2=0x7f3f480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:14.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.226+0000 7f3f664a5640 1 --2- 172.21.15.27:0/748712201 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3f480a33b0 0x7f3f480a5870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3f580cd630 tx=0x7f3f580915a0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.226+0000 7f3f664a5640 1 -- 172.21.15.27:0/748712201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f60102ef0 msgr2=0x7f3f6019c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:14.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.226+0000 7f3f664a5640 1 --2- 172.21.15.27:0/748712201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f60102ef0 0x7f3f6019c100 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f3f5800eaa0 tx=0x7f3f5800eea0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.226+0000 7f3f664a5640 1 -- 172.21.15.27:0/748712201 shutdown_connections 2024-09-19T08:19:14.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.226+0000 7f3f664a5640 1 --2- 172.21.15.27:0/748712201 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3f480a33b0 0x7f3f480a5870 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.226+0000 7f3f664a5640 1 --2- 172.21.15.27:0/748712201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f60102ef0 0x7f3f6019c100 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.226+0000 7f3f664a5640 1 --2- 172.21.15.27:0/748712201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f60102570 0x7f3f601975f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.226+0000 7f3f664a5640 1 --2- 172.21.15.27:0/748712201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f60100e20 0x7f3f601970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:14.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.226+0000 7f3f664a5640 1 -- 172.21.15.27:0/748712201 >> 172.21.15.27:0/748712201 conn(0x7f3f600fc7d0 msgr2=0x7f3f60106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:14.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.226+0000 7f3f664a5640 1 -- 172.21.15.27:0/748712201 shutdown_connections 2024-09-19T08:19:14.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:14.226+0000 7f3f664a5640 1 -- 172.21.15.27:0/748712201 wait complete. 2024-09-19T08:19:14.398 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:14 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:19:14.399 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:14 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:19:14.399 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:14 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:19:14.399 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:14 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:19:14.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:14 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:19:14.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:14 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:19:14.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:14 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:19:14.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:14 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:19:14.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:14 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:19:14.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:14 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:19:14.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:14 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:19:14.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:14 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:19:14.953 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:19:14.953 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:19:15.264 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:19:15.408 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:15 smithi027 ceph-mon[31209]: pgmap v253: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:19:15.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:15 smithi155 ceph-mon[35362]: pgmap v253: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:19:15.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:15 smithi203 ceph-mon[35198]: pgmap v253: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:19:15.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.780+0000 7f4a94666640 1 -- 172.21.15.27:0/3561006150 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a8c101de0 msgr2=0x7f4a8c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:15.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.780+0000 7f4a94666640 1 --2- 172.21.15.27:0/3561006150 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a8c101de0 0x7f4a8c1021c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4a88009900 tx=0x7f4a8802a410 comp rx=0 tx=0).stop 2024-09-19T08:19:15.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.780+0000 7f4a94666640 1 -- 172.21.15.27:0/3561006150 shutdown_connections 2024-09-19T08:19:15.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.780+0000 7f4a94666640 1 --2- 172.21.15.27:0/3561006150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a8c106f10 0x7f4a8c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:15.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.780+0000 7f4a94666640 1 --2- 172.21.15.27:0/3561006150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a8c102790 0x7f4a8c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:15.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.780+0000 7f4a94666640 1 --2- 172.21.15.27:0/3561006150 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a8c101de0 0x7f4a8c1021c0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:15.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.780+0000 7f4a94666640 1 -- 172.21.15.27:0/3561006150 >> 172.21.15.27:0/3561006150 conn(0x7f4a8c0fd8c0 msgr2=0x7f4a8c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:15.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.780+0000 7f4a94666640 1 -- 172.21.15.27:0/3561006150 shutdown_connections 2024-09-19T08:19:15.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.780+0000 7f4a94666640 1 -- 172.21.15.27:0/3561006150 wait complete. 2024-09-19T08:19:15.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.781+0000 7f4a94666640 1 Processor -- start 2024-09-19T08:19:15.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.781+0000 7f4a94666640 1 -- start start 2024-09-19T08:19:15.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.781+0000 7f4a94666640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a8c101de0 0x7f4a8c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:15.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.781+0000 7f4a94666640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a8c102790 0x7f4a8c19ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:15.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.781+0000 7f4a94666640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a8c106f10 0x7f4a8c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:15.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.781+0000 7f4a94666640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c111f70 con 0x7f4a8c101de0 2024-09-19T08:19:15.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.781+0000 7f4a94666640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c111df0 con 0x7f4a8c102790 2024-09-19T08:19:15.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.781+0000 7f4a94666640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c1120f0 con 0x7f4a8c106f10 2024-09-19T08:19:15.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.781+0000 7f4a92402640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a8c101de0 0x7f4a8c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:15.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.781+0000 7f4a92402640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a8c101de0 0x7f4a8c19a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54900/0 (socket says 172.21.15.27:54900) 2024-09-19T08:19:15.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.781+0000 7f4a92402640 1 -- 172.21.15.27:0/899728834 learned_addr learned my addr 172.21.15.27:0/899728834 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:15.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.781+0000 7f4a92c03640 1 --2- 172.21.15.27:0/899728834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a8c106f10 0x7f4a8c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:15.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.781+0000 7f4a91c01640 1 --2- 172.21.15.27:0/899728834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a8c102790 0x7f4a8c19ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:15.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.782+0000 7f4a92402640 1 -- 172.21.15.27:0/899728834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a8c106f10 msgr2=0x7f4a8c19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:15.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.782+0000 7f4a92402640 1 --2- 172.21.15.27:0/899728834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a8c106f10 0x7f4a8c19ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:15.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.782+0000 7f4a92402640 1 -- 172.21.15.27:0/899728834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a8c102790 msgr2=0x7f4a8c19ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:15.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.782+0000 7f4a92402640 1 --2- 172.21.15.27:0/899728834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a8c102790 0x7f4a8c19ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:15.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.782+0000 7f4a92402640 1 -- 172.21.15.27:0/899728834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8c19f620 con 0x7f4a8c101de0 2024-09-19T08:19:15.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.782+0000 7f4a92402640 1 --2- 172.21.15.27:0/899728834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a8c101de0 0x7f4a8c19a710 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4a88006010 tx=0x7f4a880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:15.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.782+0000 7f4a837fe640 1 -- 172.21.15.27:0/899728834 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8803f030 con 0x7f4a8c101de0 2024-09-19T08:19:15.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.782+0000 7f4a94666640 1 -- 172.21.15.27:0/899728834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a8c19f8b0 con 0x7f4a8c101de0 2024-09-19T08:19:15.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.782+0000 7f4a837fe640 1 -- 172.21.15.27:0/899728834 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a88003ce0 con 0x7f4a8c101de0 2024-09-19T08:19:15.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.782+0000 7f4a837fe640 1 -- 172.21.15.27:0/899728834 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88035070 con 0x7f4a8c101de0 2024-09-19T08:19:15.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.782+0000 7f4a94666640 1 -- 172.21.15.27:0/899728834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a8c1a71f0 con 0x7f4a8c101de0 2024-09-19T08:19:15.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.783+0000 7f4a94666640 1 -- 172.21.15.27:0/899728834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a8c1021c0 con 0x7f4a8c101de0 2024-09-19T08:19:15.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.784+0000 7f4a837fe640 1 -- 172.21.15.27:0/899728834 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f4a88042030 con 0x7f4a8c101de0 2024-09-19T08:19:15.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.785+0000 7f4a837fe640 1 --2- 172.21.15.27:0/899728834 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f4a780a33b0 0x7f4a780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:15.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.785+0000 7f4a91c01640 1 --2- 172.21.15.27:0/899728834 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f4a780a33b0 0x7f4a780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:15.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.785+0000 7f4a837fe640 1 -- 172.21.15.27:0/899728834 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f4a880f0390 con 0x7f4a8c101de0 2024-09-19T08:19:15.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.785+0000 7f4a91c01640 1 --2- 172.21.15.27:0/899728834 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f4a780a33b0 0x7f4a780a5870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c10eee0 tx=0x7f4a7c005f90 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:15.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:15.789+0000 7f4a837fe640 1 -- 172.21.15.27:0/899728834 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4a880bce50 con 0x7f4a8c101de0 2024-09-19T08:19:16.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:16.001+0000 7f4a94666640 1 -- 172.21.15.27:0/899728834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a8c19ba70 con 0x7f4a8c101de0 2024-09-19T08:19:16.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:16.001+0000 7f4a837fe640 1 -- 172.21.15.27:0/899728834 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f4a880bc750 con 0x7f4a8c101de0 2024-09-19T08:19:16.001 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:19:16.001 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:19:16.002 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:19:16.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:16.003+0000 7f4a94666640 1 -- 172.21.15.27:0/899728834 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f4a780a33b0 msgr2=0x7f4a780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:16.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:16.003+0000 7f4a94666640 1 --2- 172.21.15.27:0/899728834 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f4a780a33b0 0x7f4a780a5870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c10eee0 tx=0x7f4a7c005f90 comp rx=0 tx=0).stop 2024-09-19T08:19:16.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:16.003+0000 7f4a94666640 1 -- 172.21.15.27:0/899728834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a8c101de0 msgr2=0x7f4a8c19a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:16.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:16.003+0000 7f4a94666640 1 --2- 172.21.15.27:0/899728834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a8c101de0 0x7f4a8c19a710 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4a88006010 tx=0x7f4a880042f0 comp rx=0 tx=0).stop 2024-09-19T08:19:16.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:16.003+0000 7f4a94666640 1 -- 172.21.15.27:0/899728834 shutdown_connections 2024-09-19T08:19:16.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:16.003+0000 7f4a94666640 1 --2- 172.21.15.27:0/899728834 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f4a780a33b0 0x7f4a780a5870 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:16.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:16.003+0000 7f4a94666640 1 --2- 172.21.15.27:0/899728834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a8c106f10 0x7f4a8c19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:16.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:16.003+0000 7f4a94666640 1 --2- 172.21.15.27:0/899728834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a8c102790 0x7f4a8c19ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:16.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:16.003+0000 7f4a94666640 1 --2- 172.21.15.27:0/899728834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a8c101de0 0x7f4a8c19a710 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:16.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:16.003+0000 7f4a94666640 1 -- 172.21.15.27:0/899728834 >> 172.21.15.27:0/899728834 conn(0x7f4a8c0fd8c0 msgr2=0x7f4a8c0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:16.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:16.004+0000 7f4a94666640 1 -- 172.21.15.27:0/899728834 shutdown_connections 2024-09-19T08:19:16.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:16.004+0000 7f4a94666640 1 -- 172.21.15.27:0/899728834 wait complete. 2024-09-19T08:19:16.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:16 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/899728834' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:19:16.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:16 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/899728834' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:19:16.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:16 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/899728834' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:19:16.808 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:19:17.070 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:19:17.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:17 smithi155 ceph-mon[35362]: pgmap v254: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 219 B/s wr, 2 op/s 2024-09-19T08:19:17.497 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:17 smithi027 ceph-mon[31209]: pgmap v254: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 219 B/s wr, 2 op/s 2024-09-19T08:19:17.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:17 smithi203 ceph-mon[35198]: pgmap v254: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 219 B/s wr, 2 op/s 2024-09-19T08:19:17.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.580+0000 7f27ce087640 1 -- 172.21.15.27:0/3054730580 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27c8106ba0 msgr2=0x7f27c8106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:17.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.580+0000 7f27ce087640 1 --2- 172.21.15.27:0/3054730580 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27c8106ba0 0x7f27c8106f80 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009900 tx=0x7f27b802a3f0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.580+0000 7f27ce087640 1 -- 172.21.15.27:0/3054730580 shutdown_connections 2024-09-19T08:19:17.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.580+0000 7f27ce087640 1 --2- 172.21.15.27:0/3054730580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27c8100a70 0x7f27c810ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.580+0000 7f27ce087640 1 --2- 172.21.15.27:0/3054730580 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27c81000d0 0x7f27c8100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.580+0000 7f27ce087640 1 --2- 172.21.15.27:0/3054730580 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27c8106ba0 0x7f27c8106f80 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.580+0000 7f27ce087640 1 -- 172.21.15.27:0/3054730580 >> 172.21.15.27:0/3054730580 conn(0x7f27c8077210 msgr2=0x7f27c80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:17.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.580+0000 7f27ce087640 1 -- 172.21.15.27:0/3054730580 shutdown_connections 2024-09-19T08:19:17.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.580+0000 7f27ce087640 1 -- 172.21.15.27:0/3054730580 wait complete. 2024-09-19T08:19:17.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.581+0000 7f27ce087640 1 Processor -- start 2024-09-19T08:19:17.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.581+0000 7f27ce087640 1 -- start start 2024-09-19T08:19:17.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.581+0000 7f27ce087640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27c81000d0 0x7f27c8198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:17.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.581+0000 7f27ce087640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27c8100a70 0x7f27c81989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:17.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.581+0000 7f27ce087640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27c8106ba0 0x7f27c819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:17.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.581+0000 7f27ce087640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f27c8112050 con 0x7f27c8106ba0 2024-09-19T08:19:17.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.581+0000 7f27ce087640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f27c8111ed0 con 0x7f27c81000d0 2024-09-19T08:19:17.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.581+0000 7f27ce087640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f27c81121d0 con 0x7f27c8100a70 2024-09-19T08:19:17.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.581+0000 7f27c7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27c8106ba0 0x7f27c819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:17.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.581+0000 7f27c7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27c8106ba0 0x7f27c819cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54910/0 (socket says 172.21.15.27:54910) 2024-09-19T08:19:17.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.581+0000 7f27c7fff640 1 -- 172.21.15.27:0/3931362818 learned_addr learned my addr 172.21.15.27:0/3931362818 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:17.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.582+0000 7f27c77fe640 1 --2- 172.21.15.27:0/3931362818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27c81000d0 0x7f27c8198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:17.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.582+0000 7f27c6ffd640 1 --2- 172.21.15.27:0/3931362818 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27c8100a70 0x7f27c81989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:17.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.582+0000 7f27c7fff640 1 -- 172.21.15.27:0/3931362818 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27c8100a70 msgr2=0x7f27c81989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:17.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.582+0000 7f27c7fff640 1 --2- 172.21.15.27:0/3931362818 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27c8100a70 0x7f27c81989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.582+0000 7f27c7fff640 1 -- 172.21.15.27:0/3931362818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27c81000d0 msgr2=0x7f27c8198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:17.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.582+0000 7f27c7fff640 1 --2- 172.21.15.27:0/3931362818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27c81000d0 0x7f27c8198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.582+0000 7f27c7fff640 1 -- 172.21.15.27:0/3931362818 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c819d420 con 0x7f27c8106ba0 2024-09-19T08:19:17.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.582+0000 7f27c6ffd640 1 --2- 172.21.15.27:0/3931362818 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27c8100a70 0x7f27c81989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:19:17.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.582+0000 7f27c7fff640 1 --2- 172.21.15.27:0/3931362818 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27c8106ba0 0x7f27c819cd40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f27c000cce0 tx=0x7f27c000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:17.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.582+0000 7f27c4ff9640 1 -- 172.21.15.27:0/3931362818 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c000f450 con 0x7f27c8106ba0 2024-09-19T08:19:17.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.582+0000 7f27ce087640 1 -- 172.21.15.27:0/3931362818 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27c819d710 con 0x7f27c8106ba0 2024-09-19T08:19:17.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.582+0000 7f27c4ff9640 1 -- 172.21.15.27:0/3931362818 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27c000fad0 con 0x7f27c8106ba0 2024-09-19T08:19:17.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.582+0000 7f27c4ff9640 1 -- 172.21.15.27:0/3931362818 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c0018c10 con 0x7f27c8106ba0 2024-09-19T08:19:17.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.582+0000 7f27ce087640 1 -- 172.21.15.27:0/3931362818 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27c81a4ff0 con 0x7f27c8106ba0 2024-09-19T08:19:17.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.584+0000 7f27c4ff9640 1 -- 172.21.15.27:0/3931362818 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f27c000f5f0 con 0x7f27c8106ba0 2024-09-19T08:19:17.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.585+0000 7f27d0460740 1 Processor -- start 2024-09-19T08:19:17.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.585+0000 7f27d0460740 1 -- start start 2024-09-19T08:19:17.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.585+0000 7f27d0460740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9ea9b40 0x562fe9ea8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:17.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.585+0000 7f27d0460740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9ea85d0 0x562fe9ea8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:17.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.585+0000 7f27d0460740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9eb3370 0x562fe9eb5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:17.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.585+0000 7f27d0460740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x562fe9e0e2f0 con 0x562fe9ea9b40 2024-09-19T08:19:17.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.585+0000 7f27d0460740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x562fe9db5cf0 con 0x562fe9ea85d0 2024-09-19T08:19:17.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.585+0000 7f27d0460740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562fe9e0a2b0 con 0x562fe9eb3370 2024-09-19T08:19:17.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.585+0000 7f27c6ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9ea9b40 0x562fe9ea8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:17.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.585+0000 7f27c6ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9ea9b40 0x562fe9ea8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54926/0 (socket says 172.21.15.27:54926) 2024-09-19T08:19:17.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.585+0000 7f27c6ffd640 1 -- 172.21.15.27:0/2112453459 learned_addr learned my addr 172.21.15.27:0/2112453459 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:17.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.585+0000 7f27c77fe640 1 --2- 172.21.15.27:0/2112453459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9ea85d0 0x562fe9ea8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:17.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.585+0000 7f27c6ffd640 1 --2- 172.21.15.27:0/2112453459 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9eb3370 0x562fe9eb5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:17.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.586+0000 7f27c6ffd640 1 -- 172.21.15.27:0/2112453459 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9eb3370 msgr2=0x562fe9eb5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:17.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.586+0000 7f27c6ffd640 1 --2- 172.21.15.27:0/2112453459 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9eb3370 0x562fe9eb5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.586+0000 7f27c6ffd640 1 -- 172.21.15.27:0/2112453459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9ea85d0 msgr2=0x562fe9ea8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:17.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.586+0000 7f27c6ffd640 1 --2- 172.21.15.27:0/2112453459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9ea85d0 0x562fe9ea8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.586+0000 7f27c6ffd640 1 -- 172.21.15.27:0/2112453459 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fe9d9a3a0 con 0x562fe9ea9b40 2024-09-19T08:19:17.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.586+0000 7f27c4ff9640 1 --2- 172.21.15.27:0/3931362818 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f27b40a33b0 0x7f27b40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:17.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.586+0000 7f27c77fe640 1 --2- 172.21.15.27:0/3931362818 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f27b40a33b0 0x7f27b40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:17.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.586+0000 7f27c6ffd640 1 --2- 172.21.15.27:0/2112453459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9ea9b40 0x562fe9ea8090 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f27b00135b0 tx=0x7f27b000b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8d0354357a5289 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:17.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.586+0000 7f27c4ff9640 1 -- 172.21.15.27:0/3931362818 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f27c00d03f0 con 0x7f27c8106ba0 2024-09-19T08:19:17.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.586+0000 7f27bdffb640 1 -- 172.21.15.27:0/2112453459 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b0019070 con 0x562fe9ea9b40 2024-09-19T08:19:17.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.586+0000 7f27bdffb640 1 -- 172.21.15.27:0/2112453459 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27b0005500 con 0x562fe9ea9b40 2024-09-19T08:19:17.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.586+0000 7f27bdffb640 1 -- 172.21.15.27:0/2112453459 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b0004ce0 con 0x562fe9ea9b40 2024-09-19T08:19:17.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.587+0000 7f27d0460740 1 -- 172.21.15.27:0/2112453459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9ea9b40 msgr2=0x562fe9ea8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:17.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.587+0000 7f27d0460740 1 --2- 172.21.15.27:0/2112453459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9ea9b40 0x562fe9ea8090 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f27b00135b0 tx=0x7f27b000b730 comp rx=0 tx=0).stop 2024-09-19T08:19:17.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.587+0000 7f27c77fe640 1 --2- 172.21.15.27:0/3931362818 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f27b40a33b0 0x7f27b40a5870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f27b80314e0 tx=0x7f27b80058b0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:17.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.587+0000 7f27d0460740 1 -- 172.21.15.27:0/2112453459 shutdown_connections 2024-09-19T08:19:17.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.587+0000 7f27d0460740 1 --2- 172.21.15.27:0/2112453459 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9eb3370 0x562fe9eb5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.587+0000 7f27d0460740 1 --2- 172.21.15.27:0/2112453459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9ea85d0 0x562fe9ea8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.587+0000 7f27d0460740 1 --2- 172.21.15.27:0/2112453459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9ea9b40 0x562fe9ea8090 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.587+0000 7f27d0460740 1 -- 172.21.15.27:0/2112453459 >> 172.21.15.27:0/2112453459 conn(0x562fe9e71310 msgr2=0x562fe9ea4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:17.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.587+0000 7f27d0460740 1 -- 172.21.15.27:0/2112453459 shutdown_connections 2024-09-19T08:19:17.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.587+0000 7f27d0460740 1 -- 172.21.15.27:0/2112453459 wait complete. 2024-09-19T08:19:17.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.587+0000 7f27d0460740 1 -- start start 2024-09-19T08:19:17.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.587+0000 7f27d0460740 1 Processor -- start 2024-09-19T08:19:17.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.588+0000 7f27d0460740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9ea85d0 0x562fe9eb2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:17.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.588+0000 7f27d0460740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9ea9b40 0x562fe9eb0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:17.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.588+0000 7f27d0460740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9eb3370 0x562fe9eb05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:17.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.588+0000 7f27d0460740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x562fe9eb6070 con 0x562fe9ea85d0 2024-09-19T08:19:17.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.588+0000 7f27d0460740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x562fe9dc9060 con 0x562fe9eb3370 2024-09-19T08:19:17.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.588+0000 7f27d0460740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562fe9eb61f0 con 0x562fe9ea9b40 2024-09-19T08:19:17.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.588+0000 7f27d0460740 10 client.0 _ll_register_callbacks cb 0x562fe9b1c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:19:17.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.588+0000 7f27c77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9ea85d0 0x562fe9eb2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:17.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.588+0000 7f27c77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9ea85d0 0x562fe9eb2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54940/0 (socket says 172.21.15.27:54940) 2024-09-19T08:19:17.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.588+0000 7f27c77fe640 1 -- 172.21.15.27:0/521605424 learned_addr learned my addr 172.21.15.27:0/521605424 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:17.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.588+0000 7f27c7fff640 1 --2- 172.21.15.27:0/521605424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9eb3370 0x562fe9eb05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:17.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.588+0000 7f27c6ffd640 1 --2- 172.21.15.27:0/521605424 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9ea9b40 0x562fe9eb0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:17.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.588+0000 7f27c77fe640 1 -- 172.21.15.27:0/521605424 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9ea9b40 msgr2=0x562fe9eb0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:17.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.588+0000 7f27c77fe640 1 --2- 172.21.15.27:0/521605424 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9ea9b40 0x562fe9eb0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.588+0000 7f27c77fe640 1 -- 172.21.15.27:0/521605424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9eb3370 msgr2=0x562fe9eb05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:17.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.588+0000 7f27c77fe640 1 --2- 172.21.15.27:0/521605424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9eb3370 0x562fe9eb05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.588+0000 7f27c77fe640 1 -- 172.21.15.27:0/521605424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fe9b7f3c0 con 0x562fe9ea85d0 2024-09-19T08:19:17.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.588+0000 7f27c6ffd640 1 --2- 172.21.15.27:0/521605424 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9ea9b40 0x562fe9eb0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:19:17.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.588+0000 7f27c7fff640 1 --2- 172.21.15.27:0/521605424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9eb3370 0x562fe9eb05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:19:17.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.589+0000 7f27c77fe640 1 --2- 172.21.15.27:0/521605424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9ea85d0 0x562fe9eb2d50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f27b8033000 tx=0x7f27b8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f8d76c862e87de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:17.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.589+0000 7f27a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:19:17.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.589+0000 7f27a6ffd640 1 -- 172.21.15.27:0/521605424 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b804d070 con 0x562fe9ea85d0 2024-09-19T08:19:17.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.589+0000 7f27a6ffd640 1 -- 172.21.15.27:0/521605424 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f27b80037f0 con 0x562fe9ea85d0 2024-09-19T08:19:17.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.589+0000 7f27d0460740 1 -- 172.21.15.27:0/521605424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27b0005500 con 0x562fe9ea85d0 2024-09-19T08:19:17.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.589+0000 7f27a6ffd640 1 -- 172.21.15.27:0/521605424 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f27b8059050 con 0x562fe9ea85d0 2024-09-19T08:19:17.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.589+0000 7f27d0460740 10 client.16674 fetch_fsmap learned FSMap version 20 2024-09-19T08:19:17.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.589+0000 7f27d0460740 1 -- 172.21.15.27:0/521605424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562fe9ec1af0 con 0x562fe9ea85d0 2024-09-19T08:19:17.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.590+0000 7f27a6ffd640 1 -- 172.21.15.27:0/521605424 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27b0005500 con 0x562fe9ea85d0 2024-09-19T08:19:17.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.590+0000 7f27a6ffd640 1 -- 172.21.15.27:0/521605424 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f27b8032a90 con 0x562fe9ea85d0 2024-09-19T08:19:17.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.590+0000 7f27d0460740 10 client.16674 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:19:17.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.590+0000 7f27d0460740 10 client.16674 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:19:17.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.590+0000 7f27d0460740 20 client.16674 populate_metadata read hostname 'smithi027' 2024-09-19T08:19:17.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.590+0000 7f27d0460740 1 --2- 172.21.15.27:0/521605424 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x562fe9ec2f50 0x562fe9ec53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:17.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.590+0000 7f27d0460740 4 client.16674 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:19:17.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.590+0000 7f27d0460740 1 -- 172.21.15.27:0/521605424 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fe9e1b860 con 0x562fe9ec2f50 2024-09-19T08:19:17.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.590+0000 7f27c6ffd640 1 --2- 172.21.15.27:0/521605424 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x562fe9ec2f50 0x562fe9ec53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:17.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.591+0000 7f27c6ffd640 1 --2- 172.21.15.27:0/521605424 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x562fe9ec2f50 0x562fe9ec53b0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d730c124270093e server_cookie=f8880dc0f6618ddb in_seq=0 out_seq=0 2024-09-19T08:19:17.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.591+0000 7f27a6ffd640 10 client.16674 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:17.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.591+0000 7f27a6ffd640 1 -- 172.21.15.27:0/521605424 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562fe9e1b860 con 0x562fe9ec2f50 2024-09-19T08:19:17.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.591+0000 7f27a6ffd640 10 client.16674 handle_command_reply: tid=0 2024-09-19T08:19:17.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.591+0000 7f27d0460740 1 client.16674 shutdown 2024-09-19T08:19:17.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.592+0000 7f27d0460740 1 -- 172.21.15.27:0/521605424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9ea85d0 msgr2=0x562fe9eb2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:17.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.592+0000 7f27d0460740 1 --2- 172.21.15.27:0/521605424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9ea85d0 0x562fe9eb2d50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f27b8033000 tx=0x7f27b8009260 comp rx=0 tx=0).stop 2024-09-19T08:19:17.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.592+0000 7f27d0460740 1 -- 172.21.15.27:0/521605424 shutdown_connections 2024-09-19T08:19:17.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.592+0000 7f27d0460740 1 --2- 172.21.15.27:0/521605424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9eb3370 0x562fe9eb05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.592+0000 7f27d0460740 1 --2- 172.21.15.27:0/521605424 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x562fe9ec2f50 0x562fe9ec53b0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.592+0000 7f27d0460740 1 --2- 172.21.15.27:0/521605424 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9ea9b40 0x562fe9eb0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.592+0000 7f27d0460740 1 --2- 172.21.15.27:0/521605424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9ea85d0 0x562fe9eb2d50 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.592+0000 7f27a6ffd640 0 client.16674 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:17.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.592+0000 7f27d0460740 1 -- 172.21.15.27:0/521605424 >> 172.21.15.27:0/521605424 conn(0x562fe9e71310 msgr2=0x562fe9eaa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:17.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.592+0000 7f27d0460740 1 -- 172.21.15.27:0/521605424 shutdown_connections 2024-09-19T08:19:17.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.592+0000 7f27d0460740 1 -- 172.21.15.27:0/521605424 wait complete. 2024-09-19T08:19:17.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.592+0000 7f27d0460740 20 client.16674 trim_cache size 0 max 16384 2024-09-19T08:19:17.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.605+0000 7f27d0460740 1 Processor -- start 2024-09-19T08:19:17.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.605+0000 7f27d0460740 1 -- start start 2024-09-19T08:19:17.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.605+0000 7f27d0460740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9ea85d0 0x562fe9ebf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:17.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.605+0000 7f27d0460740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9ea9b40 0x562fe9eb1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:17.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.605+0000 7f27d0460740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9eb3370 0x562fe9eb24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:17.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.605+0000 7f27d0460740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f27c81ab870 con 0x562fe9eb3370 2024-09-19T08:19:17.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.605+0000 7f27d0460740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f27c81ae0d0 con 0x562fe9ea85d0 2024-09-19T08:19:17.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.605+0000 7f27d0460740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f27c81abec0 con 0x562fe9ea9b40 2024-09-19T08:19:17.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.605+0000 7f27c7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9eb3370 0x562fe9eb24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:17.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.605+0000 7f27c7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9eb3370 0x562fe9eb24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54944/0 (socket says 172.21.15.27:54944) 2024-09-19T08:19:17.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.605+0000 7f27c7fff640 1 -- 172.21.15.27:0/1893484451 learned_addr learned my addr 172.21.15.27:0/1893484451 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:17.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.605+0000 7f27c6ffd640 1 --2- 172.21.15.27:0/1893484451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9ea9b40 0x562fe9eb1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:17.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.605+0000 7f27c77fe640 1 --2- 172.21.15.27:0/1893484451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9ea85d0 0x562fe9ebf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:17.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.605+0000 7f27c7fff640 1 -- 172.21.15.27:0/1893484451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9ea9b40 msgr2=0x562fe9eb1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:17.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.605+0000 7f27c7fff640 1 --2- 172.21.15.27:0/1893484451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9ea9b40 0x562fe9eb1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.605+0000 7f27c7fff640 1 -- 172.21.15.27:0/1893484451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9ea85d0 msgr2=0x562fe9ebf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:17.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.605+0000 7f27c7fff640 1 --2- 172.21.15.27:0/1893484451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9ea85d0 0x562fe9ebf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.605+0000 7f27c7fff640 1 -- 172.21.15.27:0/1893484451 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fe9eae550 con 0x562fe9eb3370 2024-09-19T08:19:17.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.605+0000 7f27c77fe640 1 --2- 172.21.15.27:0/1893484451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9ea85d0 0x562fe9ebf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:19:17.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.606+0000 7f27c7fff640 1 --2- 172.21.15.27:0/1893484451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9eb3370 0x562fe9eb24b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f27c000ab20 tx=0x7f27c009c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723d6f33f5ab7e75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:17.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.606+0000 7f27bd7fa640 1 -- 172.21.15.27:0/1893484451 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c00b4020 con 0x562fe9eb3370 2024-09-19T08:19:17.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.606+0000 7f27bd7fa640 1 -- 172.21.15.27:0/1893484451 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27c00a0aa0 con 0x562fe9eb3370 2024-09-19T08:19:17.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.606+0000 7f27bd7fa640 1 -- 172.21.15.27:0/1893484451 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c00cdf70 con 0x562fe9eb3370 2024-09-19T08:19:17.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.606+0000 7f27d0460740 1 -- 172.21.15.27:0/1893484451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9eb3370 msgr2=0x562fe9eb24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:17.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.606+0000 7f27d0460740 1 --2- 172.21.15.27:0/1893484451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9eb3370 0x562fe9eb24b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f27c000ab20 tx=0x7f27c009c050 comp rx=0 tx=0).stop 2024-09-19T08:19:17.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.606+0000 7f27d0460740 1 -- 172.21.15.27:0/1893484451 shutdown_connections 2024-09-19T08:19:17.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.606+0000 7f27d0460740 1 --2- 172.21.15.27:0/1893484451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9eb3370 0x562fe9eb24b0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.606+0000 7f27d0460740 1 --2- 172.21.15.27:0/1893484451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9ea9b40 0x562fe9eb1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.606+0000 7f27d0460740 1 --2- 172.21.15.27:0/1893484451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9ea85d0 0x562fe9ebf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.606+0000 7f27d0460740 1 -- 172.21.15.27:0/1893484451 >> 172.21.15.27:0/1893484451 conn(0x562fe9e71310 msgr2=0x562fe9eb1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:17.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.607+0000 7f27d0460740 1 -- 172.21.15.27:0/1893484451 shutdown_connections 2024-09-19T08:19:17.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.607+0000 7f27d0460740 1 -- 172.21.15.27:0/1893484451 wait complete. 2024-09-19T08:19:17.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.607+0000 7f27d0460740 1 -- start start 2024-09-19T08:19:17.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.607+0000 7f27d0460740 1 Processor -- start 2024-09-19T08:19:17.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.607+0000 7f27d0460740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9ea85d0 0x562fe9eb7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:17.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.607+0000 7f27d0460740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9ea9b40 0x562fe9eb7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:17.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.607+0000 7f27d0460740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9eb3370 0x562fe9f26c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:17.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.607+0000 7f27d0460740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f27c81ac590 con 0x562fe9eb3370 2024-09-19T08:19:17.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.607+0000 7f27d0460740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f27c81ada00 con 0x562fe9ea9b40 2024-09-19T08:19:17.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.607+0000 7f27d0460740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f27c81acc60 con 0x562fe9ea85d0 2024-09-19T08:19:17.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.607+0000 7f27d0460740 10 client.0 _ll_register_callbacks cb 0x7f27b80054b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:19:17.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.608+0000 7f27c7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9eb3370 0x562fe9f26c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:17.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.608+0000 7f27c6ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9ea9b40 0x562fe9eb7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:17.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.608+0000 7f27c7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9eb3370 0x562fe9f26c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54958/0 (socket says 172.21.15.27:54958) 2024-09-19T08:19:17.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.608+0000 7f27c6ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9ea9b40 0x562fe9eb7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.27:51784/0 (socket says 172.21.15.27:51784) 2024-09-19T08:19:17.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.608+0000 7f27c7fff640 1 -- 172.21.15.27:0/339152022 learned_addr learned my addr 172.21.15.27:0/339152022 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:17.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.608+0000 7f27c77fe640 1 --2- 172.21.15.27:0/339152022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9ea85d0 0x562fe9eb7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:17.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.608+0000 7f27c6ffd640 1 -- 172.21.15.27:0/339152022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9ea85d0 msgr2=0x562fe9eb7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.608+0000 7f27c6ffd640 1 --2- 172.21.15.27:0/339152022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9ea85d0 0x562fe9eb7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.608+0000 7f27c6ffd640 1 -- 172.21.15.27:0/339152022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9eb3370 msgr2=0x562fe9f26c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.608+0000 7f27c6ffd640 1 --2- 172.21.15.27:0/339152022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9eb3370 0x562fe9f26c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.608+0000 7f27c6ffd640 1 -- 172.21.15.27:0/339152022 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fe9f27260 con 0x562fe9ea9b40 2024-09-19T08:19:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.608+0000 7f27c7fff640 1 --2- 172.21.15.27:0/339152022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9eb3370 0x562fe9f26c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:19:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.608+0000 7f27c6ffd640 1 --2- 172.21.15.27:0/339152022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9ea9b40 0x562fe9eb7f50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x562fe9eb15b0 tx=0x7f27b000b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8397c805b53cf49d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.608+0000 7f27a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:19:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.608+0000 7f27a6ffd640 1 -- 172.21.15.27:0/339152022 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b0019040 con 0x562fe9ea9b40 2024-09-19T08:19:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.608+0000 7f27a6ffd640 1 -- 172.21.15.27:0/339152022 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f27b0004020 con 0x562fe9ea9b40 2024-09-19T08:19:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.608+0000 7f27d0460740 1 -- 172.21.15.27:0/339152022 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27c00a0aa0 con 0x562fe9ea9b40 2024-09-19T08:19:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.609+0000 7f27a6ffd640 1 -- 172.21.15.27:0/339152022 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f27b0004240 con 0x562fe9ea9b40 2024-09-19T08:19:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.609+0000 7f27d0460740 10 client.25940 fetch_fsmap learned FSMap version 20 2024-09-19T08:19:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.609+0000 7f27d0460740 1 -- 172.21.15.27:0/339152022 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562fe9f2e590 con 0x562fe9ea9b40 2024-09-19T08:19:17.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.609+0000 7f27a6ffd640 1 -- 172.21.15.27:0/339152022 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27c00a0aa0 con 0x562fe9ea9b40 2024-09-19T08:19:17.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.609+0000 7f27a6ffd640 1 -- 172.21.15.27:0/339152022 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f27b0033070 con 0x562fe9ea9b40 2024-09-19T08:19:17.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.609+0000 7f27d0460740 10 client.25940 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:19:17.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.609+0000 7f27d0460740 10 client.25940 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:19:17.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.609+0000 7f27d0460740 20 client.25940 populate_metadata read hostname 'smithi027' 2024-09-19T08:19:17.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.609+0000 7f27d0460740 1 --2- 172.21.15.27:0/339152022 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x562fe9f2eba0 0x562fe9f30fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:17.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.609+0000 7f27d0460740 4 client.25940 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:19:17.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.609+0000 7f27d0460740 1 -- 172.21.15.27:0/339152022 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562fe9e15d70 con 0x562fe9f2eba0 2024-09-19T08:19:17.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.609+0000 7f27c77fe640 1 --2- 172.21.15.27:0/339152022 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x562fe9f2eba0 0x562fe9f30fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:17.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.610+0000 7f27c77fe640 1 --2- 172.21.15.27:0/339152022 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x562fe9f2eba0 0x562fe9f30fc0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0ae1732c834e23a server_cookie=594537b5b9859ec7 in_seq=0 out_seq=0 2024-09-19T08:19:17.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.610+0000 7f27a6ffd640 10 client.25940 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:17.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.610+0000 7f27a6ffd640 1 -- 172.21.15.27:0/339152022 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562fe9e15d70 con 0x562fe9f2eba0 2024-09-19T08:19:17.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.610+0000 7f27a6ffd640 10 client.25940 handle_command_reply: tid=0 2024-09-19T08:19:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.610+0000 7f27d0460740 1 client.25940 shutdown 2024-09-19T08:19:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.610+0000 7f27d0460740 1 -- 172.21.15.27:0/339152022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9ea9b40 msgr2=0x562fe9eb7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.610+0000 7f27d0460740 1 --2- 172.21.15.27:0/339152022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9ea9b40 0x562fe9eb7f50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x562fe9eb15b0 tx=0x7f27b000b800 comp rx=0 tx=0).stop 2024-09-19T08:19:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.610+0000 7f27d0460740 1 -- 172.21.15.27:0/339152022 shutdown_connections 2024-09-19T08:19:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.610+0000 7f27d0460740 1 --2- 172.21.15.27:0/339152022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562fe9eb3370 0x562fe9f26c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.610+0000 7f27d0460740 1 --2- 172.21.15.27:0/339152022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562fe9ea9b40 0x562fe9eb7f50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.610+0000 7f27d0460740 1 --2- 172.21.15.27:0/339152022 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x562fe9f2eba0 0x562fe9f30fc0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.610+0000 7f27d0460740 1 --2- 172.21.15.27:0/339152022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562fe9ea85d0 0x562fe9eb7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.610+0000 7f27a6ffd640 0 client.25940 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.610+0000 7f27d0460740 1 -- 172.21.15.27:0/339152022 >> 172.21.15.27:0/339152022 conn(0x562fe9e71310 msgr2=0x562fe9eb2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.610+0000 7f27d0460740 1 -- 172.21.15.27:0/339152022 shutdown_connections 2024-09-19T08:19:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.610+0000 7f27d0460740 1 -- 172.21.15.27:0/339152022 wait complete. 2024-09-19T08:19:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.610+0000 7f27d0460740 20 client.25940 trim_cache size 0 max 16384 2024-09-19T08:19:17.618 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:19:17.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.611+0000 7f27ce087640 1 -- 172.21.15.27:0/3931362818 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f27b40a33b0 msgr2=0x7f27b40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:17.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.611+0000 7f27ce087640 1 --2- 172.21.15.27:0/3931362818 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f27b40a33b0 0x7f27b40a5870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f27b80314e0 tx=0x7f27b80058b0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.611+0000 7f27ce087640 1 -- 172.21.15.27:0/3931362818 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27c8106ba0 msgr2=0x7f27c819cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:17.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.611+0000 7f27ce087640 1 --2- 172.21.15.27:0/3931362818 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27c8106ba0 0x7f27c819cd40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f27c000cce0 tx=0x7f27c000a620 comp rx=0 tx=0).stop 2024-09-19T08:19:17.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.611+0000 7f27ce087640 1 -- 172.21.15.27:0/3931362818 shutdown_connections 2024-09-19T08:19:17.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.611+0000 7f27ce087640 1 --2- 172.21.15.27:0/3931362818 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f27b40a33b0 0x7f27b40a5870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.611+0000 7f27ce087640 1 --2- 172.21.15.27:0/3931362818 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27c8106ba0 0x7f27c819cd40 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.611+0000 7f27ce087640 1 --2- 172.21.15.27:0/3931362818 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27c8100a70 0x7f27c81989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.611+0000 7f27ce087640 1 --2- 172.21.15.27:0/3931362818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27c81000d0 0x7f27c8198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:17.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.611+0000 7f27ce087640 1 -- 172.21.15.27:0/3931362818 >> 172.21.15.27:0/3931362818 conn(0x7f27c8077210 msgr2=0x7f27c8104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:17.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.611+0000 7f27ce087640 1 -- 172.21.15.27:0/3931362818 shutdown_connections 2024-09-19T08:19:17.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:17.611+0000 7f27ce087640 1 -- 172.21.15.27:0/3931362818 wait complete. 2024-09-19T08:19:19.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:19 smithi155 ceph-mon[35362]: pgmap v255: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T08:19:19.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:19 smithi027 ceph-mon[31209]: pgmap v255: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T08:19:19.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:19 smithi203 ceph-mon[35198]: pgmap v255: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T08:19:19.539 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:19:19.540 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:19:19.811 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:19:20.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.301+0000 7f2d175a3640 1 -- 172.21.15.27:0/3793299738 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d10101de0 msgr2=0x7f2d101021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:20.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.301+0000 7f2d175a3640 1 --2- 172.21.15.27:0/3793299738 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d10101de0 0x7f2d101021c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009900 tx=0x7f2d0c02a410 comp rx=0 tx=0).stop 2024-09-19T08:19:20.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.301+0000 7f2d175a3640 1 -- 172.21.15.27:0/3793299738 shutdown_connections 2024-09-19T08:19:20.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.301+0000 7f2d175a3640 1 --2- 172.21.15.27:0/3793299738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d10106f10 0x7f2d1010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.301+0000 7f2d175a3640 1 --2- 172.21.15.27:0/3793299738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d10102790 0x7f2d101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.301+0000 7f2d175a3640 1 --2- 172.21.15.27:0/3793299738 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d10101de0 0x7f2d101021c0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.301+0000 7f2d175a3640 1 -- 172.21.15.27:0/3793299738 >> 172.21.15.27:0/3793299738 conn(0x7f2d100fd8c0 msgr2=0x7f2d100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:20.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.301+0000 7f2d175a3640 1 -- 172.21.15.27:0/3793299738 shutdown_connections 2024-09-19T08:19:20.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.301+0000 7f2d175a3640 1 -- 172.21.15.27:0/3793299738 wait complete. 2024-09-19T08:19:20.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.302+0000 7f2d175a3640 1 Processor -- start 2024-09-19T08:19:20.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.302+0000 7f2d175a3640 1 -- start start 2024-09-19T08:19:20.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.302+0000 7f2d175a3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d10101de0 0x7f2d10198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:20.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.302+0000 7f2d175a3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d10102790 0x7f2d10198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:20.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d175a3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d10106f10 0x7f2d1019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:20.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d175a3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2d10111f70 con 0x7f2d10101de0 2024-09-19T08:19:20.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d175a3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2d10111df0 con 0x7f2d10106f10 2024-09-19T08:19:20.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d175a3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2d101120f0 con 0x7f2d10102790 2024-09-19T08:19:20.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d1533f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d10101de0 0x7f2d10198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:20.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d1533f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d10101de0 0x7f2d10198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54680/0 (socket says 172.21.15.27:54680) 2024-09-19T08:19:20.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d1533f640 1 -- 172.21.15.27:0/338812596 learned_addr learned my addr 172.21.15.27:0/338812596 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:20.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d14b3e640 1 --2- 172.21.15.27:0/338812596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d10102790 0x7f2d10198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:20.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d1533f640 1 -- 172.21.15.27:0/338812596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d10102790 msgr2=0x7f2d10198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:20.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d15b40640 1 --2- 172.21.15.27:0/338812596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d10106f10 0x7f2d1019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:20.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d1533f640 1 --2- 172.21.15.27:0/338812596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d10102790 0x7f2d10198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d1533f640 1 -- 172.21.15.27:0/338812596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d10106f10 msgr2=0x7f2d1019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:20.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d1533f640 1 --2- 172.21.15.27:0/338812596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d10106f10 0x7f2d1019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d1533f640 1 -- 172.21.15.27:0/338812596 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d1019d3e0 con 0x7f2d10101de0 2024-09-19T08:19:20.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d14b3e640 1 --2- 172.21.15.27:0/338812596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d10102790 0x7f2d10198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:19:20.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d15b40640 1 --2- 172.21.15.27:0/338812596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d10106f10 0x7f2d1019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:19:20.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d1533f640 1 --2- 172.21.15.27:0/338812596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d10101de0 0x7f2d10198430 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c005ab0 tx=0x7f2d0c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d027fc640 1 -- 172.21.15.27:0/338812596 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c03f030 con 0x7f2d10101de0 2024-09-19T08:19:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d027fc640 1 -- 172.21.15.27:0/338812596 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d0c003ce0 con 0x7f2d10101de0 2024-09-19T08:19:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d175a3640 1 -- 172.21.15.27:0/338812596 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d1019d670 con 0x7f2d10101de0 2024-09-19T08:19:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d027fc640 1 -- 172.21.15.27:0/338812596 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c035070 con 0x7f2d10101de0 2024-09-19T08:19:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.303+0000 7f2d175a3640 1 -- 172.21.15.27:0/338812596 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d101a4fb0 con 0x7f2d10101de0 2024-09-19T08:19:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.306+0000 7f2d027fc640 1 -- 172.21.15.27:0/338812596 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2d0c042030 con 0x7f2d10101de0 2024-09-19T08:19:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.306+0000 7f2d1997c740 1 Processor -- start 2024-09-19T08:19:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.306+0000 7f2d1997c740 1 -- start start 2024-09-19T08:19:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.306+0000 7f2d1997c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106b6b60 0x5644106b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.306+0000 7f2d1997c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106b7480 0x5644106c1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.306+0000 7f2d1997c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106c1d40 0x5644106c4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.306+0000 7f2d1997c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56441061c280 con 0x5644106b6b60 2024-09-19T08:19:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.306+0000 7f2d1997c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5644105c3b10 con 0x5644106c1d40 2024-09-19T08:19:20.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.306+0000 7f2d1997c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564410618240 con 0x5644106b7480 2024-09-19T08:19:20.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.307+0000 7f2d15b40640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106b6b60 0x5644106b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:20.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.307+0000 7f2d15b40640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106b6b60 0x5644106b6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54694/0 (socket says 172.21.15.27:54694) 2024-09-19T08:19:20.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.307+0000 7f2d15b40640 1 -- 172.21.15.27:0/236313721 learned_addr learned my addr 172.21.15.27:0/236313721 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:20.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.307+0000 7f2d027fc640 1 --2- 172.21.15.27:0/338812596 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2cfc0a33b0 0x7f2cfc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:20.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.307+0000 7f2d14b3e640 1 --2- 172.21.15.27:0/236313721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106c1d40 0x5644106c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:20.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.307+0000 7f2d15b40640 1 --2- 172.21.15.27:0/338812596 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2cfc0a33b0 0x7f2cfc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:20.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.307+0000 7f2d027fc640 1 -- 172.21.15.27:0/338812596 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f2d0c0f06c0 con 0x7f2d10101de0 2024-09-19T08:19:20.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.307+0000 7f2d1533f640 1 --2- 172.21.15.27:0/236313721 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106b7480 0x5644106c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:20.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.307+0000 7f2d15b40640 1 -- 172.21.15.27:0/236313721 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106b7480 msgr2=0x5644106c1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:20.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.307+0000 7f2d15b40640 1 --2- 172.21.15.27:0/236313721 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106b7480 0x5644106c1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.307+0000 7f2d15b40640 1 -- 172.21.15.27:0/236313721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106c1d40 msgr2=0x5644106c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:20.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.307+0000 7f2d15b40640 1 --2- 172.21.15.27:0/236313721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106c1d40 0x5644106c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.307+0000 7f2d15b40640 1 -- 172.21.15.27:0/236313721 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644105d01f0 con 0x5644106b6b60 2024-09-19T08:19:20.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.307+0000 7f2d1533f640 1 --2- 172.21.15.27:0/236313721 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106b7480 0x5644106c1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:19:20.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.307+0000 7f2d14b3e640 1 --2- 172.21.15.27:0/236313721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106c1d40 0x5644106c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:19:20.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.307+0000 7f2d15b40640 1 --2- 172.21.15.27:0/236313721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106b6b60 0x5644106b6f40 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2d08014930 tx=0x7f2d08014df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86fccf3e6322f7ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:20.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.307+0000 7f2d15b40640 1 --2- 172.21.15.27:0/338812596 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2cfc0a33b0 0x7f2cfc0a5870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800b000 tx=0x7f2d0801a000 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:20.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.307+0000 7f2cfb7fe640 1 -- 172.21.15.27:0/236313721 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d08011de0 con 0x5644106b6b60 2024-09-19T08:19:20.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.307+0000 7f2cfb7fe640 1 -- 172.21.15.27:0/236313721 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d0800fe40 con 0x5644106b6b60 2024-09-19T08:19:20.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.307+0000 7f2cfb7fe640 1 -- 172.21.15.27:0/236313721 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0801c440 con 0x5644106b6b60 2024-09-19T08:19:20.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.308+0000 7f2d1997c740 1 -- 172.21.15.27:0/236313721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106b6b60 msgr2=0x5644106b6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:20.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.308+0000 7f2d1997c740 1 --2- 172.21.15.27:0/236313721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106b6b60 0x5644106b6f40 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2d08014930 tx=0x7f2d08014df0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.308+0000 7f2d1997c740 1 -- 172.21.15.27:0/236313721 shutdown_connections 2024-09-19T08:19:20.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.308+0000 7f2d1997c740 1 --2- 172.21.15.27:0/236313721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106c1d40 0x5644106c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.308+0000 7f2d1997c740 1 --2- 172.21.15.27:0/236313721 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106b7480 0x5644106c1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.308+0000 7f2d1997c740 1 --2- 172.21.15.27:0/236313721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106b6b60 0x5644106b6f40 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.308+0000 7f2d1997c740 1 -- 172.21.15.27:0/236313721 >> 172.21.15.27:0/236313721 conn(0x5644106b30f0 msgr2=0x5644106b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:20.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.308+0000 7f2d1997c740 1 -- 172.21.15.27:0/236313721 shutdown_connections 2024-09-19T08:19:20.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.308+0000 7f2d1997c740 1 -- 172.21.15.27:0/236313721 wait complete. 2024-09-19T08:19:20.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.309+0000 7f2d1997c740 1 -- start start 2024-09-19T08:19:20.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.309+0000 7f2d1997c740 1 Processor -- start 2024-09-19T08:19:20.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.309+0000 7f2d1997c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106b6b60 0x5644106bec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:20.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.309+0000 7f2d1997c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106b7480 0x5644106bf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:20.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.309+0000 7f2d1997c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106c1d40 0x5644106bf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:20.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.309+0000 7f2d1997c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5644106c48b0 con 0x5644106c1d40 2024-09-19T08:19:20.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.309+0000 7f2d1997c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5644105d6f10 con 0x5644106b6b60 2024-09-19T08:19:20.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.309+0000 7f2d1997c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5644106c4a30 con 0x5644106b7480 2024-09-19T08:19:20.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.309+0000 7f2d1997c740 10 client.0 _ll_register_callbacks cb 0x56441059fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:19:20.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.309+0000 7f2d15b40640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106c1d40 0x5644106bf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:20.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.309+0000 7f2d15b40640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106c1d40 0x5644106bf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54700/0 (socket says 172.21.15.27:54700) 2024-09-19T08:19:20.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.309+0000 7f2d15b40640 1 -- 172.21.15.27:0/465086813 learned_addr learned my addr 172.21.15.27:0/465086813 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:20.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.309+0000 7f2d1533f640 1 --2- 172.21.15.27:0/465086813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106b6b60 0x5644106bec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:20.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.309+0000 7f2d14b3e640 1 --2- 172.21.15.27:0/465086813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106b7480 0x5644106bf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:20.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.310+0000 7f2d15b40640 1 -- 172.21.15.27:0/465086813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106b7480 msgr2=0x5644106bf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:20.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.310+0000 7f2d15b40640 1 --2- 172.21.15.27:0/465086813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106b7480 0x5644106bf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.310+0000 7f2d15b40640 1 -- 172.21.15.27:0/465086813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106b6b60 msgr2=0x5644106bec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:20.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.310+0000 7f2d15b40640 1 --2- 172.21.15.27:0/465086813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106b6b60 0x5644106bec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.310+0000 7f2d15b40640 1 -- 172.21.15.27:0/465086813 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56441038d6a0 con 0x5644106c1d40 2024-09-19T08:19:20.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.310+0000 7f2d15b40640 1 --2- 172.21.15.27:0/465086813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106c1d40 0x5644106bf700 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2d0801e040 tx=0x7f2d08005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1173a10f36fecb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:20.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.310+0000 7f2cf8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:19:20.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.310+0000 7f2cf8ff9640 1 -- 172.21.15.27:0/465086813 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d08014330 con 0x5644106c1d40 2024-09-19T08:19:20.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.310+0000 7f2cf8ff9640 1 -- 172.21.15.27:0/465086813 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f2d08026440 con 0x5644106c1d40 2024-09-19T08:19:20.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.310+0000 7f2d1997c740 1 -- 172.21.15.27:0/465086813 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5644106297f0 con 0x5644106c1d40 2024-09-19T08:19:20.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.310+0000 7f2cf8ff9640 1 -- 172.21.15.27:0/465086813 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2d08013460 con 0x5644106c1d40 2024-09-19T08:19:20.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.310+0000 7f2d1997c740 10 client.16692 fetch_fsmap learned FSMap version 20 2024-09-19T08:19:20.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.310+0000 7f2d1997c740 1 -- 172.21.15.27:0/465086813 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5644106d0480 con 0x5644106c1d40 2024-09-19T08:19:20.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.310+0000 7f2cf8ff9640 1 -- 172.21.15.27:0/465086813 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5644106297f0 con 0x5644106c1d40 2024-09-19T08:19:20.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.311+0000 7f2cf8ff9640 1 -- 172.21.15.27:0/465086813 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2d08036070 con 0x5644106c1d40 2024-09-19T08:19:20.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.311+0000 7f2d1997c740 10 client.16692 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:19:20.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.311+0000 7f2d1997c740 10 client.16692 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:19:20.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.311+0000 7f2d1997c740 20 client.16692 populate_metadata read hostname 'smithi027' 2024-09-19T08:19:20.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.311+0000 7f2d1997c740 1 --2- 172.21.15.27:0/465086813 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5644106d17d0 0x5644106d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:20.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.311+0000 7f2d1997c740 4 client.16692 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:19:20.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.311+0000 7f2d1997c740 1 -- 172.21.15.27:0/465086813 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564410623d00 con 0x5644106d17d0 2024-09-19T08:19:20.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.311+0000 7f2d1533f640 1 --2- 172.21.15.27:0/465086813 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5644106d17d0 0x5644106d3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:20.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.311+0000 7f2cf8ff9640 10 client.16692 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:20.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.311+0000 7f2d1533f640 1 --2- 172.21.15.27:0/465086813 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5644106d17d0 0x5644106d3be0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7aa00b755858940 server_cookie=4517de422fa3528c in_seq=0 out_seq=0 2024-09-19T08:19:20.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.312+0000 7f2cf8ff9640 1 -- 172.21.15.27:0/465086813 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564410623d00 con 0x5644106d17d0 2024-09-19T08:19:20.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.312+0000 7f2cf8ff9640 10 client.16692 handle_command_reply: tid=0 2024-09-19T08:19:20.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.312+0000 7f2d1997c740 1 client.16692 shutdown 2024-09-19T08:19:20.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.312+0000 7f2d1997c740 1 -- 172.21.15.27:0/465086813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106c1d40 msgr2=0x5644106bf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:20.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.312+0000 7f2d1997c740 1 --2- 172.21.15.27:0/465086813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106c1d40 0x5644106bf700 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2d0801e040 tx=0x7f2d08005bd0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.313+0000 7f2d1997c740 1 -- 172.21.15.27:0/465086813 shutdown_connections 2024-09-19T08:19:20.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.313+0000 7f2d1997c740 1 --2- 172.21.15.27:0/465086813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106c1d40 0x5644106bf700 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.313+0000 7f2d1997c740 1 --2- 172.21.15.27:0/465086813 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5644106d17d0 0x5644106d3be0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.313+0000 7f2d1997c740 1 --2- 172.21.15.27:0/465086813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106b7480 0x5644106bf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.313+0000 7f2d1997c740 1 --2- 172.21.15.27:0/465086813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106b6b60 0x5644106bec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.313+0000 7f2d1997c740 1 -- 172.21.15.27:0/465086813 >> 172.21.15.27:0/465086813 conn(0x5644106b30f0 msgr2=0x5644106b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:20.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.313+0000 7f2cf8ff9640 0 client.16692 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:20.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.313+0000 7f2d1997c740 1 -- 172.21.15.27:0/465086813 shutdown_connections 2024-09-19T08:19:20.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.313+0000 7f2d1997c740 1 -- 172.21.15.27:0/465086813 wait complete. 2024-09-19T08:19:20.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.313+0000 7f2d1997c740 20 client.16692 trim_cache size 0 max 16384 2024-09-19T08:19:20.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.331+0000 7f2d1997c740 1 Processor -- start 2024-09-19T08:19:20.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.331+0000 7f2d1997c740 1 -- start start 2024-09-19T08:19:20.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.331+0000 7f2d1997c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106b6b60 0x5644106bdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:20.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.331+0000 7f2d1997c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106b7480 0x5644106d94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:20.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.331+0000 7f2d1997c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106c1d40 0x5644106d99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:20.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.331+0000 7f2d1997c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2d101ab800 con 0x5644106b7480 2024-09-19T08:19:20.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.331+0000 7f2d1997c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2d101ae060 con 0x5644106b6b60 2024-09-19T08:19:20.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.331+0000 7f2d1997c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2d101abe50 con 0x5644106c1d40 2024-09-19T08:19:20.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.331+0000 7f2d14b3e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106b7480 0x5644106d94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:20.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.331+0000 7f2d14b3e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106b7480 0x5644106d94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54716/0 (socket says 172.21.15.27:54716) 2024-09-19T08:19:20.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.331+0000 7f2d14b3e640 1 -- 172.21.15.27:0/3420653839 learned_addr learned my addr 172.21.15.27:0/3420653839 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:20.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.331+0000 7f2d15b40640 1 --2- 172.21.15.27:0/3420653839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106c1d40 0x5644106d99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:20.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.331+0000 7f2d1533f640 1 --2- 172.21.15.27:0/3420653839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106b6b60 0x5644106bdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:20.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.331+0000 7f2d14b3e640 1 -- 172.21.15.27:0/3420653839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106c1d40 msgr2=0x5644106d99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:20.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.331+0000 7f2d14b3e640 1 --2- 172.21.15.27:0/3420653839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106c1d40 0x5644106d99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.331+0000 7f2d14b3e640 1 -- 172.21.15.27:0/3420653839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106b6b60 msgr2=0x5644106bdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:20.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.331+0000 7f2d14b3e640 1 --2- 172.21.15.27:0/3420653839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106b6b60 0x5644106bdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.331+0000 7f2d14b3e640 1 -- 172.21.15.27:0/3420653839 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644106ae830 con 0x5644106b7480 2024-09-19T08:19:20.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.331+0000 7f2d1533f640 1 --2- 172.21.15.27:0/3420653839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106b6b60 0x5644106bdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:19:20.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.332+0000 7f2d14b3e640 1 --2- 172.21.15.27:0/3420653839 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106b7480 0x5644106d94b0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2d100fdd50 tx=0x7f2d04011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886e2d55510df10e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:20.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.332+0000 7f2cfaffd640 1 -- 172.21.15.27:0/3420653839 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0401e070 con 0x5644106b7480 2024-09-19T08:19:20.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.332+0000 7f2cfaffd640 1 -- 172.21.15.27:0/3420653839 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d04019ad0 con 0x5644106b7480 2024-09-19T08:19:20.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.332+0000 7f2cfaffd640 1 -- 172.21.15.27:0/3420653839 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0400bc60 con 0x5644106b7480 2024-09-19T08:19:20.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.333+0000 7f2d1997c740 1 -- 172.21.15.27:0/3420653839 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106b7480 msgr2=0x5644106d94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:20.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.333+0000 7f2d1997c740 1 --2- 172.21.15.27:0/3420653839 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106b7480 0x5644106d94b0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2d100fdd50 tx=0x7f2d04011810 comp rx=0 tx=0).stop 2024-09-19T08:19:20.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.333+0000 7f2d1997c740 1 -- 172.21.15.27:0/3420653839 shutdown_connections 2024-09-19T08:19:20.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.333+0000 7f2d1997c740 1 --2- 172.21.15.27:0/3420653839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106c1d40 0x5644106d99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.333+0000 7f2d1997c740 1 --2- 172.21.15.27:0/3420653839 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106b7480 0x5644106d94b0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.333+0000 7f2d1997c740 1 --2- 172.21.15.27:0/3420653839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106b6b60 0x5644106bdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.333+0000 7f2d1997c740 1 -- 172.21.15.27:0/3420653839 >> 172.21.15.27:0/3420653839 conn(0x5644106b30f0 msgr2=0x5644106c0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:20.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.333+0000 7f2d1997c740 1 -- 172.21.15.27:0/3420653839 shutdown_connections 2024-09-19T08:19:20.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.333+0000 7f2d1997c740 1 -- 172.21.15.27:0/3420653839 wait complete. 2024-09-19T08:19:20.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.333+0000 7f2d1997c740 1 -- start start 2024-09-19T08:19:20.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.333+0000 7f2d1997c740 1 Processor -- start 2024-09-19T08:19:20.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.334+0000 7f2d1997c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106b6b60 0x5644106c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:20.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.334+0000 7f2d1997c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106b7480 0x5644106ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:20.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.334+0000 7f2d1997c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106c1d40 0x5644106c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:20.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.334+0000 7f2d1997c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2d101ac520 con 0x5644106c1d40 2024-09-19T08:19:20.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.334+0000 7f2d1997c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2d101ad990 con 0x5644106b7480 2024-09-19T08:19:20.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.334+0000 7f2d1997c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2d101acbf0 con 0x5644106b6b60 2024-09-19T08:19:20.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.334+0000 7f2d1997c740 10 client.0 _ll_register_callbacks cb 0x7f2d08014730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:19:20.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.334+0000 7f2d15b40640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106c1d40 0x5644106c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:20.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.334+0000 7f2d15b40640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106c1d40 0x5644106c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54718/0 (socket says 172.21.15.27:54718) 2024-09-19T08:19:20.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.334+0000 7f2d15b40640 1 -- 172.21.15.27:0/1720547756 learned_addr learned my addr 172.21.15.27:0/1720547756 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:20.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.334+0000 7f2d14b3e640 1 --2- 172.21.15.27:0/1720547756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106b7480 0x5644106ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:20.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.334+0000 7f2d1533f640 1 --2- 172.21.15.27:0/1720547756 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106b6b60 0x5644106c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:20.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.334+0000 7f2d15b40640 1 -- 172.21.15.27:0/1720547756 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106b6b60 msgr2=0x5644106c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:20.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.334+0000 7f2d15b40640 1 --2- 172.21.15.27:0/1720547756 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106b6b60 0x5644106c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.334+0000 7f2d15b40640 1 -- 172.21.15.27:0/1720547756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106b7480 msgr2=0x5644106ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:20.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.334+0000 7f2d15b40640 1 --2- 172.21.15.27:0/1720547756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106b7480 0x5644106ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.334+0000 7f2d15b40640 1 -- 172.21.15.27:0/1720547756 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644106c7190 con 0x5644106c1d40 2024-09-19T08:19:20.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.334+0000 7f2d15b40640 1 --2- 172.21.15.27:0/1720547756 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106c1d40 0x5644106c6c50 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f2d08008540 tx=0x7f2d08008c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea11f704dad1cdf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:20.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.334+0000 7f2cf8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:19:20.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.335+0000 7f2cf8ff9640 1 -- 172.21.15.27:0/1720547756 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0803c030 con 0x5644106c1d40 2024-09-19T08:19:20.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.335+0000 7f2cf8ff9640 1 -- 172.21.15.27:0/1720547756 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f2d0802fca0 con 0x5644106c1d40 2024-09-19T08:19:20.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.335+0000 7f2d1997c740 1 -- 172.21.15.27:0/1720547756 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d04019ad0 con 0x5644106c1d40 2024-09-19T08:19:20.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.335+0000 7f2cf8ff9640 1 -- 172.21.15.27:0/1720547756 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2d08046050 con 0x5644106c1d40 2024-09-19T08:19:20.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.335+0000 7f2d1997c740 10 client.16698 fetch_fsmap learned FSMap version 20 2024-09-19T08:19:20.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.335+0000 7f2d1997c740 1 -- 172.21.15.27:0/1720547756 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56441073cb00 con 0x5644106c1d40 2024-09-19T08:19:20.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.335+0000 7f2cf8ff9640 1 -- 172.21.15.27:0/1720547756 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d04019ad0 con 0x5644106c1d40 2024-09-19T08:19:20.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.335+0000 7f2cf8ff9640 1 -- 172.21.15.27:0/1720547756 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2d08036070 con 0x5644106c1d40 2024-09-19T08:19:20.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.335+0000 7f2d1997c740 10 client.16698 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:19:20.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.335+0000 7f2d1997c740 10 client.16698 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:19:20.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.335+0000 7f2d1997c740 20 client.16698 populate_metadata read hostname 'smithi027' 2024-09-19T08:19:20.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.335+0000 7f2d1997c740 1 --2- 172.21.15.27:0/1720547756 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56441073d240 0x56441073f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:20.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.335+0000 7f2d1997c740 4 client.16698 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:19:20.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.335+0000 7f2d1997c740 1 -- 172.21.15.27:0/1720547756 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5644105a0110 con 0x56441073d240 2024-09-19T08:19:20.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.335+0000 7f2d1533f640 1 --2- 172.21.15.27:0/1720547756 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56441073d240 0x56441073f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:20.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.336+0000 7f2d1533f640 1 --2- 172.21.15.27:0/1720547756 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56441073d240 0x56441073f660 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=614dbe9b690415db server_cookie=316223c2feabd552 in_seq=0 out_seq=0 2024-09-19T08:19:20.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.336+0000 7f2cf8ff9640 10 client.16698 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:20.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.337+0000 7f2cf8ff9640 1 -- 172.21.15.27:0/1720547756 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5644105a0110 con 0x56441073d240 2024-09-19T08:19:20.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.337+0000 7f2cf8ff9640 10 client.16698 handle_command_reply: tid=0 2024-09-19T08:19:20.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.337+0000 7f2d1997c740 1 client.16698 shutdown 2024-09-19T08:19:20.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.337+0000 7f2d1997c740 1 -- 172.21.15.27:0/1720547756 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106c1d40 msgr2=0x5644106c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:20.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.337+0000 7f2d1997c740 1 --2- 172.21.15.27:0/1720547756 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106c1d40 0x5644106c6c50 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f2d08008540 tx=0x7f2d08008c00 comp rx=0 tx=0).stop 2024-09-19T08:19:20.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.337+0000 7f2d1997c740 1 -- 172.21.15.27:0/1720547756 shutdown_connections 2024-09-19T08:19:20.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.337+0000 7f2d1997c740 1 --2- 172.21.15.27:0/1720547756 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5644106c1d40 0x5644106c6c50 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.337+0000 7f2d1997c740 1 --2- 172.21.15.27:0/1720547756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644106b7480 0x5644106ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.337+0000 7f2d1997c740 1 --2- 172.21.15.27:0/1720547756 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56441073d240 0x56441073f660 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.337+0000 7f2d1997c740 1 --2- 172.21.15.27:0/1720547756 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644106b6b60 0x5644106c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.337+0000 7f2d1997c740 1 -- 172.21.15.27:0/1720547756 >> 172.21.15.27:0/1720547756 conn(0x5644106b30f0 msgr2=0x5644106b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:20.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.337+0000 7f2cf8ff9640 0 client.16698 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:20.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.337+0000 7f2d1997c740 1 -- 172.21.15.27:0/1720547756 shutdown_connections 2024-09-19T08:19:20.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.337+0000 7f2d1997c740 1 -- 172.21.15.27:0/1720547756 wait complete. 2024-09-19T08:19:20.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.337+0000 7f2d1997c740 20 client.16698 trim_cache size 0 max 16384 2024-09-19T08:19:20.343 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:19:20.343 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:19:20.343 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "fc5dfbbb-fd6a-4960-9b4e-dbe06ff31577", 2024-09-19T08:19:20.343 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:19:20.343 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:19:20.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.338+0000 7f2d175a3640 1 -- 172.21.15.27:0/338812596 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2cfc0a33b0 msgr2=0x7f2cfc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:20.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.338+0000 7f2d175a3640 1 --2- 172.21.15.27:0/338812596 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2cfc0a33b0 0x7f2cfc0a5870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800b000 tx=0x7f2d0801a000 comp rx=0 tx=0).stop 2024-09-19T08:19:20.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.338+0000 7f2d175a3640 1 -- 172.21.15.27:0/338812596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d10101de0 msgr2=0x7f2d10198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:20.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.338+0000 7f2d175a3640 1 --2- 172.21.15.27:0/338812596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d10101de0 0x7f2d10198430 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c005ab0 tx=0x7f2d0c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.338+0000 7f2d175a3640 1 -- 172.21.15.27:0/338812596 shutdown_connections 2024-09-19T08:19:20.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.338+0000 7f2d175a3640 1 --2- 172.21.15.27:0/338812596 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2cfc0a33b0 0x7f2cfc0a5870 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.338+0000 7f2d175a3640 1 --2- 172.21.15.27:0/338812596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d10106f10 0x7f2d1019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.338+0000 7f2d175a3640 1 --2- 172.21.15.27:0/338812596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d10102790 0x7f2d10198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.338+0000 7f2d175a3640 1 --2- 172.21.15.27:0/338812596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d10101de0 0x7f2d10198430 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:20.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.338+0000 7f2d175a3640 1 -- 172.21.15.27:0/338812596 >> 172.21.15.27:0/338812596 conn(0x7f2d100fd8c0 msgr2=0x7f2d100fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:20.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.338+0000 7f2d175a3640 1 -- 172.21.15.27:0/338812596 shutdown_connections 2024-09-19T08:19:20.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:20.338+0000 7f2d175a3640 1 -- 172.21.15.27:0/338812596 wait complete. 2024-09-19T08:19:21.051 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:19:21.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:21 smithi027 ceph-mon[31209]: pgmap v256: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T08:19:21.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:21 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:19:21.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:21 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:19:21.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:21 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:19:21.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:21 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:19:21.310 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:19:21.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:21 smithi155 ceph-mon[35362]: pgmap v256: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T08:19:21.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:21 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:19:21.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:21 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:19:21.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:21 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:19:21.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:21 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:19:21.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:21 smithi203 ceph-mon[35198]: pgmap v256: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T08:19:21.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:21 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:19:21.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:21 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:19:21.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:21 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:19:21.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:21 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:19:21.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.826+0000 7f5400f28640 1 -- 172.21.15.27:0/3466591520 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53fc102d90 msgr2=0x7f53fc103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:21.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.826+0000 7f5400f28640 1 --2- 172.21.15.27:0/3466591520 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53fc102d90 0x7f53fc103170 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009930 tx=0x7f53ec02a420 comp rx=0 tx=0).stop 2024-09-19T08:19:21.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.826+0000 7f5400f28640 1 -- 172.21.15.27:0/3466591520 shutdown_connections 2024-09-19T08:19:21.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.826+0000 7f5400f28640 1 --2- 172.21.15.27:0/3466591520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53fc108290 0x7f53fc10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.826+0000 7f5400f28640 1 --2- 172.21.15.27:0/3466591520 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53fc103740 0x7f53fc107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.826+0000 7f5400f28640 1 --2- 172.21.15.27:0/3466591520 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53fc102d90 0x7f53fc103170 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.826+0000 7f5400f28640 1 -- 172.21.15.27:0/3466591520 >> 172.21.15.27:0/3466591520 conn(0x7f53fc0fc7d0 msgr2=0x7f53fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:21.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.826+0000 7f5400f28640 1 -- 172.21.15.27:0/3466591520 shutdown_connections 2024-09-19T08:19:21.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.826+0000 7f5400f28640 1 -- 172.21.15.27:0/3466591520 wait complete. 2024-09-19T08:19:21.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.826+0000 7f5400f28640 1 Processor -- start 2024-09-19T08:19:21.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.826+0000 7f5400f28640 1 -- start start 2024-09-19T08:19:21.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.827+0000 7f5400f28640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53fc102d90 0x7f53fc1a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:21.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.827+0000 7f5400f28640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53fc103740 0x7f53fc1a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:21.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.827+0000 7f5400f28640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53fc108290 0x7f53fc19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:21.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.827+0000 7f5400f28640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc112150 con 0x7f53fc108290 2024-09-19T08:19:21.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.827+0000 7f5400f28640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc111fd0 con 0x7f53fc102d90 2024-09-19T08:19:21.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.827+0000 7f5400f28640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc1122d0 con 0x7f53fc103740 2024-09-19T08:19:21.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.827+0000 7f53fad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53fc108290 0x7f53fc19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:21.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.827+0000 7f53fad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53fc108290 0x7f53fc19a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54738/0 (socket says 172.21.15.27:54738) 2024-09-19T08:19:21.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.827+0000 7f53fad9d640 1 -- 172.21.15.27:0/737289970 learned_addr learned my addr 172.21.15.27:0/737289970 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:21.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.827+0000 7f53f9d9b640 1 --2- 172.21.15.27:0/737289970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53fc103740 0x7f53fc1a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:21.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.827+0000 7f53fa59c640 1 --2- 172.21.15.27:0/737289970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53fc102d90 0x7f53fc1a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:21.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.827+0000 7f53fad9d640 1 -- 172.21.15.27:0/737289970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53fc103740 msgr2=0x7f53fc1a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:21.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.827+0000 7f53fad9d640 1 --2- 172.21.15.27:0/737289970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53fc103740 0x7f53fc1a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.827+0000 7f53fad9d640 1 -- 172.21.15.27:0/737289970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53fc102d90 msgr2=0x7f53fc1a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:21.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.827+0000 7f53fad9d640 1 --2- 172.21.15.27:0/737289970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53fc102d90 0x7f53fc1a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.827+0000 7f53fad9d640 1 -- 172.21.15.27:0/737289970 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53fc19afb0 con 0x7f53fc108290 2024-09-19T08:19:21.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.827+0000 7f53f9d9b640 1 --2- 172.21.15.27:0/737289970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53fc103740 0x7f53fc1a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:19:21.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.827+0000 7f53fa59c640 1 --2- 172.21.15.27:0/737289970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53fc102d90 0x7f53fc1a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:19:21.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.827+0000 7f53fad9d640 1 --2- 172.21.15.27:0/737289970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53fc108290 0x7f53fc19a740 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f53f400b970 tx=0x7f53f400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:21.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.828+0000 7f53eb7fe640 1 -- 172.21.15.27:0/737289970 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f4019070 con 0x7f53fc108290 2024-09-19T08:19:21.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.828+0000 7f5400f28640 1 -- 172.21.15.27:0/737289970 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53fc19b2a0 con 0x7f53fc108290 2024-09-19T08:19:21.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.828+0000 7f53eb7fe640 1 -- 172.21.15.27:0/737289970 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53f400cb40 con 0x7f53fc108290 2024-09-19T08:19:21.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.828+0000 7f5400f28640 1 -- 172.21.15.27:0/737289970 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53fc1a75f0 con 0x7f53fc108290 2024-09-19T08:19:21.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.828+0000 7f53eb7fe640 1 -- 172.21.15.27:0/737289970 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f4007650 con 0x7f53fc108290 2024-09-19T08:19:21.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.830+0000 7f53eb7fe640 1 -- 172.21.15.27:0/737289970 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f53f401c070 con 0x7f53fc108290 2024-09-19T08:19:21.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.830+0000 7f5403301740 1 Processor -- start 2024-09-19T08:19:21.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.830+0000 7f5403301740 1 -- start start 2024-09-19T08:19:21.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.831+0000 7f5403301740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d94a0 0x55e5972d9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:21.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.831+0000 7f5403301740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e5972d9dc0 0x55e5972e4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:21.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.831+0000 7f5403301740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5972e4680 0x55e5972e6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:21.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.831+0000 7f5403301740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55e59723f2e0 con 0x55e5972d94a0 2024-09-19T08:19:21.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.831+0000 7f5403301740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e5971e6ce0 con 0x55e5972e4680 2024-09-19T08:19:21.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.831+0000 7f5403301740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e59723b2a0 con 0x55e5972d9dc0 2024-09-19T08:19:21.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.831+0000 7f53f9d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d94a0 0x55e5972d9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:21.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.831+0000 7f53f9d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d94a0 0x55e5972d9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54742/0 (socket says 172.21.15.27:54742) 2024-09-19T08:19:21.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.831+0000 7f53f9d9b640 1 -- 172.21.15.27:0/1052090304 learned_addr learned my addr 172.21.15.27:0/1052090304 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:21.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.831+0000 7f53fa59c640 1 --2- 172.21.15.27:0/1052090304 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e5972d9dc0 0x55e5972e4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:21.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.831+0000 7f53eb7fe640 1 --2- 172.21.15.27:0/737289970 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f53e40a33b0 0x7f53e40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:21.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.831+0000 7f53f9d9b640 1 -- 172.21.15.27:0/1052090304 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e5972d9dc0 msgr2=0x55e5972e4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:21.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.831+0000 7f53f9d9b640 1 --2- 172.21.15.27:0/1052090304 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e5972d9dc0 0x55e5972e4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.831+0000 7f53f9d9b640 1 -- 172.21.15.27:0/1052090304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5972e4680 msgr2=0x55e5972e6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:21.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.831+0000 7f53f9d9b640 1 --2- 172.21.15.27:0/1052090304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5972e4680 0x55e5972e6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.831+0000 7f53f9d9b640 1 -- 172.21.15.27:0/1052090304 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5971cb440 con 0x55e5972d94a0 2024-09-19T08:19:21.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.831+0000 7f53fad9d640 1 --2- 172.21.15.27:0/737289970 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f53e40a33b0 0x7f53e40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:21.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.831+0000 7f53eb7fe640 1 -- 172.21.15.27:0/737289970 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f53f40cf2a0 con 0x7f53fc108290 2024-09-19T08:19:21.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.831+0000 7f53f9d9b640 1 --2- 172.21.15.27:0/1052090304 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d94a0 0x55e5972d9880 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f53f00079d0 tx=0x7f53f0007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2341cb6d5c1e3bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:21.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.832+0000 7f53e8ff9640 1 -- 172.21.15.27:0/1052090304 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f000fc90 con 0x55e5972d94a0 2024-09-19T08:19:21.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.832+0000 7f53e8ff9640 1 -- 172.21.15.27:0/1052090304 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53f0010040 con 0x55e5972d94a0 2024-09-19T08:19:21.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.832+0000 7f53e8ff9640 1 -- 172.21.15.27:0/1052090304 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f00136c0 con 0x55e5972d94a0 2024-09-19T08:19:21.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.832+0000 7f5403301740 1 -- 172.21.15.27:0/1052090304 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d94a0 msgr2=0x55e5972d9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:21.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.832+0000 7f53fad9d640 1 --2- 172.21.15.27:0/737289970 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f53e40a33b0 0x7f53e40a5870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f53f4061400 tx=0x7f53f406a3a0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:21.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.832+0000 7f5403301740 1 --2- 172.21.15.27:0/1052090304 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d94a0 0x55e5972d9880 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f53f00079d0 tx=0x7f53f0007e90 comp rx=0 tx=0).stop 2024-09-19T08:19:21.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.832+0000 7f5403301740 1 -- 172.21.15.27:0/1052090304 shutdown_connections 2024-09-19T08:19:21.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.832+0000 7f5403301740 1 --2- 172.21.15.27:0/1052090304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5972e4680 0x55e5972e6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.832+0000 7f5403301740 1 --2- 172.21.15.27:0/1052090304 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e5972d9dc0 0x55e5972e4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.832+0000 7f5403301740 1 --2- 172.21.15.27:0/1052090304 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d94a0 0x55e5972d9880 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.832+0000 7f5403301740 1 -- 172.21.15.27:0/1052090304 >> 172.21.15.27:0/1052090304 conn(0x55e5972d5a30 msgr2=0x55e5972d5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:21.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.833+0000 7f5403301740 1 -- 172.21.15.27:0/1052090304 shutdown_connections 2024-09-19T08:19:21.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.833+0000 7f5403301740 1 -- 172.21.15.27:0/1052090304 wait complete. 2024-09-19T08:19:21.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.833+0000 7f5403301740 1 -- start start 2024-09-19T08:19:21.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.833+0000 7f5403301740 1 Processor -- start 2024-09-19T08:19:21.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.833+0000 7f5403301740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5972d94a0 0x55e5972e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:21.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.833+0000 7f5403301740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d9dc0 0x55e5972e11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:21.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.833+0000 7f5403301740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e5972e4680 0x55e5972e1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:21.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.833+0000 7f5403301740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55e5972e7250 con 0x55e5972d9dc0 2024-09-19T08:19:21.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.833+0000 7f5403301740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e5971fa050 con 0x55e5972d94a0 2024-09-19T08:19:21.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.833+0000 7f5403301740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e5972e73d0 con 0x55e5972e4680 2024-09-19T08:19:21.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.833+0000 7f5403301740 10 client.0 _ll_register_callbacks cb 0x55e59723a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:19:21.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.833+0000 7f53fa59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d9dc0 0x55e5972e11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:21.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.833+0000 7f53fa59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d9dc0 0x55e5972e11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54744/0 (socket says 172.21.15.27:54744) 2024-09-19T08:19:21.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.833+0000 7f53fa59c640 1 -- 172.21.15.27:0/3432878299 learned_addr learned my addr 172.21.15.27:0/3432878299 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:21.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.834+0000 7f53f9d9b640 1 --2- 172.21.15.27:0/3432878299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5972d94a0 0x55e5972e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:21.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.834+0000 7f53f9d9b640 1 --2- 172.21.15.27:0/3432878299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e5972e4680 0x55e5972e1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:21.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.834+0000 7f53fa59c640 1 -- 172.21.15.27:0/3432878299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e5972e4680 msgr2=0x55e5972e1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:21.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.834+0000 7f53fa59c640 1 --2- 172.21.15.27:0/3432878299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e5972e4680 0x55e5972e1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.834+0000 7f53fa59c640 1 -- 172.21.15.27:0/3432878299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5972d94a0 msgr2=0x55e5972e3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:21.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.834+0000 7f53fa59c640 1 --2- 172.21.15.27:0/3432878299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5972d94a0 0x55e5972e3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.834+0000 7f53fa59c640 1 -- 172.21.15.27:0/3432878299 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e596fb03c0 con 0x55e5972d9dc0 2024-09-19T08:19:21.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.834+0000 7f53f9d9b640 1 --2- 172.21.15.27:0/3432878299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e5972e4680 0x55e5972e1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:19:21.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.834+0000 7f53fa59c640 1 --2- 172.21.15.27:0/3432878299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d9dc0 0x55e5972e11d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f53ec031550 tx=0x7f53ec0319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6766d0738440dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:21.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.834+0000 7f53e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:19:21.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.834+0000 7f53e1ffb640 1 -- 172.21.15.27:0/3432878299 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec03f070 con 0x55e5972d9dc0 2024-09-19T08:19:21.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.834+0000 7f53e1ffb640 1 -- 172.21.15.27:0/3432878299 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f53ec004450 con 0x55e5972d9dc0 2024-09-19T08:19:21.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.834+0000 7f5403301740 1 -- 172.21.15.27:0/3432878299 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53f0010040 con 0x55e5972d9dc0 2024-09-19T08:19:21.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.835+0000 7f53e1ffb640 1 -- 172.21.15.27:0/3432878299 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f53ec035070 con 0x55e5972d9dc0 2024-09-19T08:19:21.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.835+0000 7f5403301740 10 client.16710 fetch_fsmap learned FSMap version 20 2024-09-19T08:19:21.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.835+0000 7f5403301740 1 -- 172.21.15.27:0/3432878299 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e5972f2bd0 con 0x55e5972d9dc0 2024-09-19T08:19:21.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.835+0000 7f53e1ffb640 1 -- 172.21.15.27:0/3432878299 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53f0010040 con 0x55e5972d9dc0 2024-09-19T08:19:21.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.835+0000 7f53e1ffb640 1 -- 172.21.15.27:0/3432878299 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f53ec004c20 con 0x55e5972d9dc0 2024-09-19T08:19:21.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.835+0000 7f5403301740 10 client.16710 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:19:21.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.835+0000 7f5403301740 10 client.16710 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:19:21.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.835+0000 7f5403301740 20 client.16710 populate_metadata read hostname 'smithi027' 2024-09-19T08:19:21.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.835+0000 7f5403301740 1 --2- 172.21.15.27:0/3432878299 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e5972f4330 0x55e5972f6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:21.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.835+0000 7f5403301740 4 client.16710 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:19:21.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.835+0000 7f5403301740 1 -- 172.21.15.27:0/3432878299 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e59724c850 con 0x55e5972f4330 2024-09-19T08:19:21.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.835+0000 7f53f9d9b640 1 --2- 172.21.15.27:0/3432878299 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e5972f4330 0x55e5972f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:21.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.836+0000 7f53f9d9b640 1 --2- 172.21.15.27:0/3432878299 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e5972f4330 0x55e5972f6780 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6eee1c17e970573 server_cookie=82a478f1ed70dbdb in_seq=0 out_seq=0 2024-09-19T08:19:21.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.836+0000 7f53e1ffb640 10 client.16710 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:21.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.837+0000 7f53e1ffb640 1 -- 172.21.15.27:0/3432878299 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e59724c850 con 0x55e5972f4330 2024-09-19T08:19:21.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.837+0000 7f53e1ffb640 10 client.16710 handle_command_reply: tid=0 2024-09-19T08:19:21.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.837+0000 7f5403301740 1 client.16710 shutdown 2024-09-19T08:19:21.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.837+0000 7f5403301740 1 -- 172.21.15.27:0/3432878299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d9dc0 msgr2=0x55e5972e11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:21.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.837+0000 7f5403301740 1 --2- 172.21.15.27:0/3432878299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d9dc0 0x55e5972e11d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f53ec031550 tx=0x7f53ec0319a0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.837+0000 7f5403301740 1 -- 172.21.15.27:0/3432878299 shutdown_connections 2024-09-19T08:19:21.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.837+0000 7f5403301740 1 --2- 172.21.15.27:0/3432878299 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e5972f4330 0x55e5972f6780 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.837+0000 7f5403301740 1 --2- 172.21.15.27:0/3432878299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e5972e4680 0x55e5972e1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.837+0000 7f5403301740 1 --2- 172.21.15.27:0/3432878299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d9dc0 0x55e5972e11d0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.837+0000 7f5403301740 1 --2- 172.21.15.27:0/3432878299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5972d94a0 0x55e5972e3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.837+0000 7f5403301740 1 -- 172.21.15.27:0/3432878299 >> 172.21.15.27:0/3432878299 conn(0x55e5972d5a30 msgr2=0x55e5972db710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:21.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.837+0000 7f53e1ffb640 0 client.16710 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:21.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.837+0000 7f5403301740 1 -- 172.21.15.27:0/3432878299 shutdown_connections 2024-09-19T08:19:21.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.837+0000 7f5403301740 1 -- 172.21.15.27:0/3432878299 wait complete. 2024-09-19T08:19:21.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.837+0000 7f5403301740 20 client.16710 trim_cache size 0 max 16384 2024-09-19T08:19:21.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.854+0000 7f5403301740 1 Processor -- start 2024-09-19T08:19:21.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.854+0000 7f5403301740 1 -- start start 2024-09-19T08:19:21.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.854+0000 7f5403301740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d5a30 0x55e5972f0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:21.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.854+0000 7f5403301740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5972d94a0 0x55e5972fc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:21.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.854+0000 7f5403301740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e5972d9dc0 0x55e5972fc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:21.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.854+0000 7f5403301740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc1adbd0 con 0x55e5972d5a30 2024-09-19T08:19:21.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.854+0000 7f5403301740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc1b0430 con 0x55e5972d94a0 2024-09-19T08:19:21.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.854+0000 7f5403301740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc1ae220 con 0x55e5972d9dc0 2024-09-19T08:19:21.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.854+0000 7f53f9d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d5a30 0x55e5972f0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:21.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.855+0000 7f53f9d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d5a30 0x55e5972f0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54750/0 (socket says 172.21.15.27:54750) 2024-09-19T08:19:21.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.855+0000 7f53f9d9b640 1 -- 172.21.15.27:0/2730901945 learned_addr learned my addr 172.21.15.27:0/2730901945 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:21.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.855+0000 7f53fa59c640 1 --2- 172.21.15.27:0/2730901945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5972d94a0 0x55e5972fc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:21.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.855+0000 7f53f9d9b640 1 -- 172.21.15.27:0/2730901945 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e5972d9dc0 msgr2=0x55e5972fc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:21.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.855+0000 7f53f9d9b640 1 --2- 172.21.15.27:0/2730901945 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e5972d9dc0 0x55e5972fc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.855+0000 7f53f9d9b640 1 -- 172.21.15.27:0/2730901945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5972d94a0 msgr2=0x55e5972fc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:21.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.855+0000 7f53f9d9b640 1 --2- 172.21.15.27:0/2730901945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5972d94a0 0x55e5972fc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.855+0000 7f53f9d9b640 1 -- 172.21.15.27:0/2730901945 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5972d9bf0 con 0x55e5972d5a30 2024-09-19T08:19:21.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.855+0000 7f53fa59c640 1 --2- 172.21.15.27:0/2730901945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5972d94a0 0x55e5972fc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:19:21.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.855+0000 7f53f9d9b640 1 --2- 172.21.15.27:0/2730901945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d5a30 0x55e5972f0510 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f53f0007ed0 tx=0x7f53f0014e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581e78c3909c53ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:21.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.855+0000 7f53e3fff640 1 -- 172.21.15.27:0/2730901945 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f0032070 con 0x55e5972d5a30 2024-09-19T08:19:21.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.855+0000 7f53e3fff640 1 -- 172.21.15.27:0/2730901945 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53f002a070 con 0x55e5972d5a30 2024-09-19T08:19:21.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.855+0000 7f53e3fff640 1 -- 172.21.15.27:0/2730901945 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f0028070 con 0x55e5972d5a30 2024-09-19T08:19:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.856+0000 7f5403301740 1 -- 172.21.15.27:0/2730901945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d5a30 msgr2=0x55e5972f0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.856+0000 7f5403301740 1 --2- 172.21.15.27:0/2730901945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d5a30 0x55e5972f0510 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f53f0007ed0 tx=0x7f53f0014e40 comp rx=0 tx=0).stop 2024-09-19T08:19:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.856+0000 7f5403301740 1 -- 172.21.15.27:0/2730901945 shutdown_connections 2024-09-19T08:19:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.856+0000 7f5403301740 1 --2- 172.21.15.27:0/2730901945 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e5972d9dc0 0x55e5972fc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.856+0000 7f5403301740 1 --2- 172.21.15.27:0/2730901945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5972d94a0 0x55e5972fc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.856+0000 7f5403301740 1 --2- 172.21.15.27:0/2730901945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d5a30 0x55e5972f0510 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.856+0000 7f5403301740 1 -- 172.21.15.27:0/2730901945 >> 172.21.15.27:0/2730901945 conn(0x55e5972e1870 msgr2=0x55e5972e02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.856+0000 7f5403301740 1 -- 172.21.15.27:0/2730901945 shutdown_connections 2024-09-19T08:19:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.856+0000 7f5403301740 1 -- 172.21.15.27:0/2730901945 wait complete. 2024-09-19T08:19:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.856+0000 7f5403301740 1 -- start start 2024-09-19T08:19:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.856+0000 7f5403301740 1 Processor -- start 2024-09-19T08:19:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f5403301740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d5a30 0x55e5972e9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f5403301740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5972d94a0 0x55e5972ea3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f5403301740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e5972d9dc0 0x55e5972ec480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f5403301740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc1ae8f0 con 0x55e5972d5a30 2024-09-19T08:19:21.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f5403301740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc1afd60 con 0x55e5972d94a0 2024-09-19T08:19:21.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f5403301740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc1aefc0 con 0x55e5972d9dc0 2024-09-19T08:19:21.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f5403301740 10 client.0 _ll_register_callbacks cb 0x7f53ec009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:19:21.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f53f9d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d5a30 0x55e5972e9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:21.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f53f9d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d5a30 0x55e5972e9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54756/0 (socket says 172.21.15.27:54756) 2024-09-19T08:19:21.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f53f9d9b640 1 -- 172.21.15.27:0/2125848468 learned_addr learned my addr 172.21.15.27:0/2125848468 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:21.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f53f9d9b640 1 -- 172.21.15.27:0/2125848468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e5972d9dc0 msgr2=0x55e5972ec480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:21.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f53f9d9b640 1 --2- 172.21.15.27:0/2125848468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e5972d9dc0 0x55e5972ec480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f53f9d9b640 1 -- 172.21.15.27:0/2125848468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5972d94a0 msgr2=0x55e5972ea3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:21.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f53fa59c640 1 --2- 172.21.15.27:0/2125848468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5972d94a0 0x55e5972ea3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:21.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f53f9d9b640 1 --2- 172.21.15.27:0/2125848468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5972d94a0 0x55e5972ea3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f53f9d9b640 1 -- 172.21.15.27:0/2125848468 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5972ecac0 con 0x55e5972d5a30 2024-09-19T08:19:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f53f9d9b640 1 --2- 172.21.15.27:0/2125848468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d5a30 0x55e5972e9e90 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f53f0030040 tx=0x7f53f0006fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df86bfe4912d376 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f53e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:19:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f53e1ffb640 1 -- 172.21.15.27:0/2125848468 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f0032070 con 0x55e5972d5a30 2024-09-19T08:19:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f53e1ffb640 1 -- 172.21.15.27:0/2125848468 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f53f0005bc0 con 0x55e5972d5a30 2024-09-19T08:19:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.857+0000 7f5403301740 1 -- 172.21.15.27:0/2125848468 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53f002a070 con 0x55e5972d5a30 2024-09-19T08:19:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.858+0000 7f53e1ffb640 1 -- 172.21.15.27:0/2125848468 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f53f0028040 con 0x55e5972d5a30 2024-09-19T08:19:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.858+0000 7f5403301740 10 client.16716 fetch_fsmap learned FSMap version 20 2024-09-19T08:19:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.858+0000 7f5403301740 1 -- 172.21.15.27:0/2125848468 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e59735eb40 con 0x55e5972d5a30 2024-09-19T08:19:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.858+0000 7f53e1ffb640 1 -- 172.21.15.27:0/2125848468 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53f002a070 con 0x55e5972d5a30 2024-09-19T08:19:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.858+0000 7f53e1ffb640 1 -- 172.21.15.27:0/2125848468 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f53f003d050 con 0x55e5972d5a30 2024-09-19T08:19:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.858+0000 7f5403301740 10 client.16716 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:19:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.858+0000 7f5403301740 10 client.16716 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:19:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.858+0000 7f5403301740 20 client.16716 populate_metadata read hostname 'smithi027' 2024-09-19T08:19:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.858+0000 7f5403301740 1 --2- 172.21.15.27:0/2125848468 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e5972e4680 0x55e597360fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.858+0000 7f5403301740 4 client.16716 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:19:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.858+0000 7f5403301740 1 -- 172.21.15.27:0/2125848468 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e597246d60 con 0x55e5972e4680 2024-09-19T08:19:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.858+0000 7f53fa59c640 1 --2- 172.21.15.27:0/2125848468 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e5972e4680 0x55e597360fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.859+0000 7f53fa59c640 1 --2- 172.21.15.27:0/2125848468 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e5972e4680 0x55e597360fc0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1f28fe26fc0f0a2 server_cookie=ea7bade791c17e13 in_seq=0 out_seq=0 2024-09-19T08:19:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.859+0000 7f53e1ffb640 10 client.16716 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.859+0000 7f53e1ffb640 1 -- 172.21.15.27:0/2125848468 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e597246d60 con 0x55e5972e4680 2024-09-19T08:19:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.859+0000 7f53e1ffb640 10 client.16716 handle_command_reply: tid=0 2024-09-19T08:19:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.859+0000 7f5403301740 1 client.16716 shutdown 2024-09-19T08:19:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.859+0000 7f5403301740 1 -- 172.21.15.27:0/2125848468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d5a30 msgr2=0x55e5972e9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.859+0000 7f5403301740 1 --2- 172.21.15.27:0/2125848468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d5a30 0x55e5972e9e90 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f53f0030040 tx=0x7f53f0006fb0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.859+0000 7f5403301740 1 -- 172.21.15.27:0/2125848468 shutdown_connections 2024-09-19T08:19:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.859+0000 7f5403301740 1 --2- 172.21.15.27:0/2125848468 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e5972e4680 0x55e597360fc0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.859+0000 7f5403301740 1 --2- 172.21.15.27:0/2125848468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e5972d9dc0 0x55e5972ec480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.859+0000 7f5403301740 1 --2- 172.21.15.27:0/2125848468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e5972d94a0 0x55e5972ea3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.859+0000 7f5403301740 1 --2- 172.21.15.27:0/2125848468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e5972d5a30 0x55e5972e9e90 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.859+0000 7f5403301740 1 -- 172.21.15.27:0/2125848468 >> 172.21.15.27:0/2125848468 conn(0x55e5972e1870 msgr2=0x55e5972e2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:21.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.859+0000 7f53e1ffb640 0 client.16716 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:21.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.859+0000 7f5403301740 1 -- 172.21.15.27:0/2125848468 shutdown_connections 2024-09-19T08:19:21.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.859+0000 7f5403301740 1 -- 172.21.15.27:0/2125848468 wait complete. 2024-09-19T08:19:21.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.859+0000 7f5403301740 20 client.16716 trim_cache size 0 max 16384 2024-09-19T08:19:21.866 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:19:21.866 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:19:21.866 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": { 2024-09-19T08:19:21.867 INFO:teuthology.orchestra.run.smithi027.stdout: "fc5dfbbb-fd6a-4960-9b4e-dbe06ff31577": { 2024-09-19T08:19:21.867 INFO:teuthology.orchestra.run.smithi027.stdout: "path": "/", 2024-09-19T08:19:21.867 INFO:teuthology.orchestra.run.smithi027.stdout: "tag": "fc5dfbbb-fd6a-4960-9b4e-dbe06ff31577", 2024-09-19T08:19:21.867 INFO:teuthology.orchestra.run.smithi027.stdout: "options": "recursive,force" 2024-09-19T08:19:21.867 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:19:21.867 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:19:21.867 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:19:21.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.860+0000 7f5400f28640 1 -- 172.21.15.27:0/737289970 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f53e40a33b0 msgr2=0x7f53e40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:21.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.860+0000 7f5400f28640 1 --2- 172.21.15.27:0/737289970 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f53e40a33b0 0x7f53e40a5870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f53f4061400 tx=0x7f53f406a3a0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.860+0000 7f5400f28640 1 -- 172.21.15.27:0/737289970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53fc108290 msgr2=0x7f53fc19a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:21.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.860+0000 7f5400f28640 1 --2- 172.21.15.27:0/737289970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53fc108290 0x7f53fc19a740 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f53f400b970 tx=0x7f53f400be30 comp rx=0 tx=0).stop 2024-09-19T08:19:21.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.860+0000 7f5400f28640 1 -- 172.21.15.27:0/737289970 shutdown_connections 2024-09-19T08:19:21.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.860+0000 7f5400f28640 1 --2- 172.21.15.27:0/737289970 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f53e40a33b0 0x7f53e40a5870 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.860+0000 7f5400f28640 1 --2- 172.21.15.27:0/737289970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53fc108290 0x7f53fc19a740 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.860+0000 7f5400f28640 1 --2- 172.21.15.27:0/737289970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53fc103740 0x7f53fc1a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.860+0000 7f5400f28640 1 --2- 172.21.15.27:0/737289970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53fc102d90 0x7f53fc1a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:21.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.860+0000 7f5400f28640 1 -- 172.21.15.27:0/737289970 >> 172.21.15.27:0/737289970 conn(0x7f53fc0fc7d0 msgr2=0x7f53fc100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:21.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.860+0000 7f5400f28640 1 -- 172.21.15.27:0/737289970 shutdown_connections 2024-09-19T08:19:21.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:21.860+0000 7f5400f28640 1 -- 172.21.15.27:0/737289970 wait complete. 2024-09-19T08:19:22.686 INFO:tasks.cephfs.filesystem:scrub status for tag:fc5dfbbb-fd6a-4960-9b4e-dbe06ff31577 - {'path': '/', 'tag': 'fc5dfbbb-fd6a-4960-9b4e-dbe06ff31577', 'options': 'recursive,force'} 2024-09-19T08:19:23.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:23 smithi155 ceph-mon[35362]: pgmap v257: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 96 B/s wr, 2 op/s 2024-09-19T08:19:23.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:23 smithi027 ceph-mon[31209]: pgmap v257: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 96 B/s wr, 2 op/s 2024-09-19T08:19:23.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:23 smithi203 ceph-mon[35198]: pgmap v257: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 96 B/s wr, 2 op/s 2024-09-19T08:19:25.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:25 smithi155 ceph-mon[35362]: pgmap v258: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T08:19:25.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:25 smithi027 ceph-mon[31209]: pgmap v258: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T08:19:25.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:25 smithi203 ceph-mon[35198]: pgmap v258: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T08:19:26.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:26 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:19:26.501 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:26 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:19:26.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:26 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:19:27.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:27 smithi155 ceph-mon[35362]: pgmap v259: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:19:27.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:27 smithi027 ceph-mon[31209]: pgmap v259: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:19:27.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:27 smithi203 ceph-mon[35198]: pgmap v259: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:19:29.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:29 smithi155 ceph-mon[35362]: pgmap v260: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:19:29.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:29 smithi027 ceph-mon[31209]: pgmap v260: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:19:29.509 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:29 smithi203 ceph-mon[35198]: pgmap v260: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:19:31.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:31 smithi155 ceph-mon[35362]: pgmap v261: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:19:31.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:31 smithi027 ceph-mon[31209]: pgmap v261: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:19:31.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:31 smithi203 ceph-mon[35198]: pgmap v261: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:19:33.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:33 smithi155 ceph-mon[35362]: pgmap v262: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:19:33.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:33 smithi027 ceph-mon[31209]: pgmap v262: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:19:33.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:33 smithi203 ceph-mon[35198]: pgmap v262: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:19:35.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:35 smithi155 ceph-mon[35362]: pgmap v263: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:19:35.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:35 smithi027 ceph-mon[31209]: pgmap v263: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:19:35.507 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:35 smithi203 ceph-mon[35198]: pgmap v263: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:19:37.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:37 smithi155 ceph-mon[35362]: pgmap v264: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:37.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:37 smithi027 ceph-mon[31209]: pgmap v264: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:37.507 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:37 smithi203 ceph-mon[35198]: pgmap v264: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:39.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:39 smithi155 ceph-mon[35362]: pgmap v265: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:19:39.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:39 smithi027 ceph-mon[31209]: pgmap v265: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:19:39.507 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:39 smithi203 ceph-mon[35198]: pgmap v265: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:19:41.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:41 smithi155 ceph-mon[35362]: pgmap v266: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:41.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:41 smithi027 ceph-mon[31209]: pgmap v266: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:41.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:41 smithi203 ceph-mon[35198]: pgmap v266: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:43.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:43 smithi155 ceph-mon[35362]: pgmap v267: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:43.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:43 smithi027 ceph-mon[31209]: pgmap v267: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:43.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:43 smithi203 ceph-mon[35198]: pgmap v267: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:45.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:45 smithi155 ceph-mon[35362]: pgmap v268: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:19:45.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:45 smithi027 ceph-mon[31209]: pgmap v268: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:19:45.507 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:45 smithi203 ceph-mon[35198]: pgmap v268: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:19:47.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:47 smithi155 ceph-mon[35362]: pgmap v269: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:47.501 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:47 smithi027 ceph-mon[31209]: pgmap v269: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:47.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:47 smithi203 ceph-mon[35198]: pgmap v269: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:49.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:49 smithi155 ceph-mon[35362]: pgmap v270: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:19:49.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:49 smithi027 ceph-mon[31209]: pgmap v270: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:19:49.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:49 smithi203 ceph-mon[35198]: pgmap v270: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:19:51.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:51 smithi155 ceph-mon[35362]: pgmap v271: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:51.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:51 smithi027 ceph-mon[31209]: pgmap v271: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:51.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:51 smithi203 ceph-mon[35198]: pgmap v271: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:52.688 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:19:52.963 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:19:53.388 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:53 smithi027 ceph-mon[31209]: pgmap v272: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:53.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.472+0000 7f76ef778640 1 -- 172.21.15.27:0/4150708334 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76e810c170 msgr2=0x7f76e810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:53.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.472+0000 7f76ef778640 1 --2- 172.21.15.27:0/4150708334 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76e810c170 0x7f76e810e610 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009ca0 tx=0x7f76e002a950 comp rx=0 tx=0).stop 2024-09-19T08:19:53.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.472+0000 7f76ef778640 1 -- 172.21.15.27:0/4150708334 shutdown_connections 2024-09-19T08:19:53.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.472+0000 7f76ef778640 1 --2- 172.21.15.27:0/4150708334 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76e810c170 0x7f76e810e610 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.472+0000 7f76ef778640 1 --2- 172.21.15.27:0/4150708334 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76e8103660 0x7f76e810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.472+0000 7f76ef778640 1 --2- 172.21.15.27:0/4150708334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76e8102d40 0x7f76e8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.472+0000 7f76ef778640 1 -- 172.21.15.27:0/4150708334 >> 172.21.15.27:0/4150708334 conn(0x7f76e80fc7a0 msgr2=0x7f76e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:53.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.472+0000 7f76ef778640 1 -- 172.21.15.27:0/4150708334 shutdown_connections 2024-09-19T08:19:53.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.472+0000 7f76ef778640 1 -- 172.21.15.27:0/4150708334 wait complete. 2024-09-19T08:19:53.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.473+0000 7f76ef778640 1 Processor -- start 2024-09-19T08:19:53.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.473+0000 7f76ef778640 1 -- start start 2024-09-19T08:19:53.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.473+0000 7f76ef778640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76e8102d40 0x7f76e81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:53.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.473+0000 7f76ef778640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76e8103660 0x7f76e8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:53.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.473+0000 7f76ef778640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76e810c170 0x7f76e8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:53.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.473+0000 7f76ef778640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f76e8111f70 con 0x7f76e810c170 2024-09-19T08:19:53.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.474+0000 7f76ef778640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f76e8111df0 con 0x7f76e8103660 2024-09-19T08:19:53.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.474+0000 7f76ef778640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f76e81120f0 con 0x7f76e8102d40 2024-09-19T08:19:53.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.474+0000 7f76edd15640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76e810c170 0x7f76e8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:53.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.474+0000 7f76edd15640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76e810c170 0x7f76e8101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43146/0 (socket says 172.21.15.27:43146) 2024-09-19T08:19:53.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.474+0000 7f76edd15640 1 -- 172.21.15.27:0/1740633566 learned_addr learned my addr 172.21.15.27:0/1740633566 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:53.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.474+0000 7f76ed514640 1 --2- 172.21.15.27:0/1740633566 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76e8102d40 0x7f76e81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:53.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.474+0000 7f76ecd13640 1 --2- 172.21.15.27:0/1740633566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76e8103660 0x7f76e8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:53.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.474+0000 7f76edd15640 1 -- 172.21.15.27:0/1740633566 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76e8102d40 msgr2=0x7f76e81009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:53.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.474+0000 7f76edd15640 1 --2- 172.21.15.27:0/1740633566 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76e8102d40 0x7f76e81009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.474+0000 7f76edd15640 1 -- 172.21.15.27:0/1740633566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76e8103660 msgr2=0x7f76e8100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:53.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.474+0000 7f76edd15640 1 --2- 172.21.15.27:0/1740633566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76e8103660 0x7f76e8100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.474+0000 7f76edd15640 1 -- 172.21.15.27:0/1740633566 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e81a6910 con 0x7f76e810c170 2024-09-19T08:19:53.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.474+0000 7f76edd15640 1 --2- 172.21.15.27:0/1740633566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76e810c170 0x7f76e8101420 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f76e0004af0 tx=0x7f76e002f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:53.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.474+0000 7f76de7fc640 1 -- 172.21.15.27:0/1740633566 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e0034040 con 0x7f76e810c170 2024-09-19T08:19:53.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.474+0000 7f76de7fc640 1 -- 172.21.15.27:0/1740633566 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76e0030920 con 0x7f76e810c170 2024-09-19T08:19:53.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.474+0000 7f76ef778640 1 -- 172.21.15.27:0/1740633566 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e81a6ba0 con 0x7f76e810c170 2024-09-19T08:19:53.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.474+0000 7f76de7fc640 1 -- 172.21.15.27:0/1740633566 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e00047b0 con 0x7f76e810c170 2024-09-19T08:19:53.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.474+0000 7f76ef778640 1 -- 172.21.15.27:0/1740633566 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e81a7080 con 0x7f76e810c170 2024-09-19T08:19:53.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.477+0000 7f76de7fc640 1 -- 172.21.15.27:0/1740633566 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f76e0037020 con 0x7f76e810c170 2024-09-19T08:19:53.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.477+0000 7f76f1b51740 1 Processor -- start 2024-09-19T08:19:53.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.477+0000 7f76f1b51740 1 -- start start 2024-09-19T08:19:53.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.477+0000 7f76f1b51740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56309fc6f4a0 0x56309fc6f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:53.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.477+0000 7f76f1b51740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6fdc0 0x56309fc7a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:53.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.477+0000 7f76f1b51740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56309fc7a680 0x56309fc7ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.477+0000 7f76f1b51740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56309fbd52e0 con 0x56309fc6fdc0 2024-09-19T08:19:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.477+0000 7f76f1b51740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56309fb7cce0 con 0x56309fc6f4a0 2024-09-19T08:19:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.477+0000 7f76f1b51740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56309fbd12a0 con 0x56309fc7a680 2024-09-19T08:19:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.477+0000 7f76ed514640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6fdc0 0x56309fc7a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.477+0000 7f76ed514640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6fdc0 0x56309fc7a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43150/0 (socket says 172.21.15.27:43150) 2024-09-19T08:19:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.477+0000 7f76ed514640 1 -- 172.21.15.27:0/649205964 learned_addr learned my addr 172.21.15.27:0/649205964 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.477+0000 7f76ecd13640 1 --2- 172.21.15.27:0/649205964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56309fc6f4a0 0x56309fc6f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.478+0000 7f76ecd13640 1 --2- 172.21.15.27:0/649205964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56309fc7a680 0x56309fc7ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.478+0000 7f76de7fc640 1 --2- 172.21.15.27:0/1740633566 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f76d40a33b0 0x7f76d40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.478+0000 7f76ed514640 1 -- 172.21.15.27:0/649205964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56309fc7a680 msgr2=0x56309fc7ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.478+0000 7f76ed514640 1 --2- 172.21.15.27:0/649205964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56309fc7a680 0x56309fc7ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.478+0000 7f76ed514640 1 -- 172.21.15.27:0/649205964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56309fc6f4a0 msgr2=0x56309fc6f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.478+0000 7f76ed514640 1 --2- 172.21.15.27:0/649205964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56309fc6f4a0 0x56309fc6f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.478+0000 7f76ed514640 1 -- 172.21.15.27:0/649205964 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56309fb61440 con 0x56309fc6fdc0 2024-09-19T08:19:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.478+0000 7f76edd15640 1 --2- 172.21.15.27:0/1740633566 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f76d40a33b0 0x7f76d40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.478+0000 7f76de7fc640 1 -- 172.21.15.27:0/1740633566 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f76e00f0ac0 con 0x7f76e810c170 2024-09-19T08:19:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.478+0000 7f76ed514640 1 --2- 172.21.15.27:0/649205964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6fdc0 0x56309fc7a140 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009c80 tx=0x7f76e40117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3328146a4d6729 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.478+0000 7f76d37fe640 1 -- 172.21.15.27:0/649205964 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e4012450 con 0x56309fc6fdc0 2024-09-19T08:19:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.478+0000 7f76d37fe640 1 -- 172.21.15.27:0/649205964 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76e4012ad0 con 0x56309fc6fdc0 2024-09-19T08:19:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.478+0000 7f76d37fe640 1 -- 172.21.15.27:0/649205964 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e400fbd0 con 0x56309fc6fdc0 2024-09-19T08:19:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.479+0000 7f76f1b51740 1 -- 172.21.15.27:0/649205964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6fdc0 msgr2=0x56309fc7a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.479+0000 7f76edd15640 1 --2- 172.21.15.27:0/1740633566 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f76d40a33b0 0x7f76d40a5870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f76e00ee3f0 tx=0x7f76e00b2360 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.479+0000 7f76f1b51740 1 --2- 172.21.15.27:0/649205964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6fdc0 0x56309fc7a140 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009c80 tx=0x7f76e40117b0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.479+0000 7f76f1b51740 1 -- 172.21.15.27:0/649205964 shutdown_connections 2024-09-19T08:19:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.479+0000 7f76f1b51740 1 --2- 172.21.15.27:0/649205964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56309fc7a680 0x56309fc7ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.479+0000 7f76f1b51740 1 --2- 172.21.15.27:0/649205964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6fdc0 0x56309fc7a140 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.479+0000 7f76f1b51740 1 --2- 172.21.15.27:0/649205964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56309fc6f4a0 0x56309fc6f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.479+0000 7f76f1b51740 1 -- 172.21.15.27:0/649205964 >> 172.21.15.27:0/649205964 conn(0x56309fc6ba30 msgr2=0x56309fc6be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:53.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.479+0000 7f76f1b51740 1 -- 172.21.15.27:0/649205964 shutdown_connections 2024-09-19T08:19:53.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.479+0000 7f76f1b51740 1 -- 172.21.15.27:0/649205964 wait complete. 2024-09-19T08:19:53.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.479+0000 7f76f1b51740 1 -- start start 2024-09-19T08:19:53.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.480+0000 7f76f1b51740 1 Processor -- start 2024-09-19T08:19:53.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.480+0000 7f76f1b51740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6f4a0 0x56309fc79fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:53.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.480+0000 7f76f1b51740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56309fc6fdc0 0x56309fc77250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:53.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.480+0000 7f76f1b51740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56309fc7a680 0x56309fc77790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:53.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.480+0000 7f76f1b51740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56309fc7d250 con 0x56309fc6f4a0 2024-09-19T08:19:53.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.480+0000 7f76f1b51740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56309fb90050 con 0x56309fc6fdc0 2024-09-19T08:19:53.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.480+0000 7f76f1b51740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56309fc7d3d0 con 0x56309fc7a680 2024-09-19T08:19:53.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.480+0000 7f76f1b51740 10 client.0 _ll_register_callbacks cb 0x56309fbd0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:19:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.480+0000 7f76ecd13640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6f4a0 0x56309fc79fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.480+0000 7f76ecd13640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6f4a0 0x56309fc79fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43166/0 (socket says 172.21.15.27:43166) 2024-09-19T08:19:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.480+0000 7f76ecd13640 1 -- 172.21.15.27:0/188863675 learned_addr learned my addr 172.21.15.27:0/188863675 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.480+0000 7f76ecd13640 1 --2- 172.21.15.27:0/188863675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56309fc7a680 0x56309fc77790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.481+0000 7f76ed514640 1 --2- 172.21.15.27:0/188863675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56309fc6fdc0 0x56309fc77250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.481+0000 7f76ecd13640 1 -- 172.21.15.27:0/188863675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56309fc7a680 msgr2=0x56309fc77790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.481+0000 7f76ecd13640 1 --2- 172.21.15.27:0/188863675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56309fc7a680 0x56309fc77790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.481+0000 7f76ecd13640 1 -- 172.21.15.27:0/188863675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56309fc6fdc0 msgr2=0x56309fc77250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.481+0000 7f76ecd13640 1 --2- 172.21.15.27:0/188863675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56309fc6fdc0 0x56309fc77250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.481+0000 7f76ecd13640 1 -- 172.21.15.27:0/188863675 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56309f9463c0 con 0x56309fc6f4a0 2024-09-19T08:19:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.481+0000 7f76ecd13640 1 --2- 172.21.15.27:0/188863675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6f4a0 0x56309fc79fa0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f76d8013e20 tx=0x7f76d8015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d186fb66a5ca5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.481+0000 7f76d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:19:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.481+0000 7f76d0ff9640 1 -- 172.21.15.27:0/188863675 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8005020 con 0x56309fc6f4a0 2024-09-19T08:19:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.481+0000 7f76d0ff9640 1 -- 172.21.15.27:0/188863675 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f76d80051c0 con 0x56309fc6f4a0 2024-09-19T08:19:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.481+0000 7f76f1b51740 1 -- 172.21.15.27:0/188863675 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76e4012ad0 con 0x56309fc6f4a0 2024-09-19T08:19:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.481+0000 7f76d0ff9640 1 -- 172.21.15.27:0/188863675 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f76d8028050 con 0x56309fc6f4a0 2024-09-19T08:19:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.481+0000 7f76f1b51740 10 client.16728 fetch_fsmap learned FSMap version 20 2024-09-19T08:19:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.481+0000 7f76f1b51740 1 -- 172.21.15.27:0/188863675 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56309fc88c60 con 0x56309fc6f4a0 2024-09-19T08:19:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.482+0000 7f76d0ff9640 1 -- 172.21.15.27:0/188863675 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76e4012ad0 con 0x56309fc6f4a0 2024-09-19T08:19:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.482+0000 7f76d0ff9640 1 -- 172.21.15.27:0/188863675 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f76d800f040 con 0x56309fc6f4a0 2024-09-19T08:19:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.482+0000 7f76f1b51740 10 client.16728 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:19:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.482+0000 7f76f1b51740 10 client.16728 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:19:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.482+0000 7f76f1b51740 20 client.16728 populate_metadata read hostname 'smithi027' 2024-09-19T08:19:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.482+0000 7f76f1b51740 1 --2- 172.21.15.27:0/188863675 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56309fc8a070 0x56309fc8c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.482+0000 7f76f1b51740 4 client.16728 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:19:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.482+0000 7f76f1b51740 1 -- 172.21.15.27:0/188863675 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56309fbe2850 con 0x56309fc8a070 2024-09-19T08:19:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.482+0000 7f76ed514640 1 --2- 172.21.15.27:0/188863675 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56309fc8a070 0x56309fc8c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:53.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.483+0000 7f76d0ff9640 10 client.16728 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:53.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.483+0000 7f76ed514640 1 --2- 172.21.15.27:0/188863675 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56309fc8a070 0x56309fc8c460 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4718b245305e2678 server_cookie=4149e5cc2ff51a89 in_seq=0 out_seq=0 2024-09-19T08:19:53.491 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:53 smithi155 ceph-mon[35362]: pgmap v272: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:53.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.483+0000 7f76d0ff9640 1 -- 172.21.15.27:0/188863675 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56309fbe2850 con 0x56309fc8a070 2024-09-19T08:19:53.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.483+0000 7f76d0ff9640 10 client.16728 handle_command_reply: tid=0 2024-09-19T08:19:53.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.483+0000 7f76f1b51740 1 client.16728 shutdown 2024-09-19T08:19:53.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.484+0000 7f76f1b51740 1 -- 172.21.15.27:0/188863675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6f4a0 msgr2=0x56309fc79fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.484+0000 7f76f1b51740 1 --2- 172.21.15.27:0/188863675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6f4a0 0x56309fc79fa0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f76d8013e20 tx=0x7f76d8015040 comp rx=0 tx=0).stop 2024-09-19T08:19:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.484+0000 7f76f1b51740 1 -- 172.21.15.27:0/188863675 shutdown_connections 2024-09-19T08:19:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.484+0000 7f76f1b51740 1 --2- 172.21.15.27:0/188863675 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56309fc8a070 0x56309fc8c460 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.484+0000 7f76f1b51740 1 --2- 172.21.15.27:0/188863675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56309fc7a680 0x56309fc77790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.484+0000 7f76f1b51740 1 --2- 172.21.15.27:0/188863675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56309fc6fdc0 0x56309fc77250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.484+0000 7f76f1b51740 1 --2- 172.21.15.27:0/188863675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6f4a0 0x56309fc79fa0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.484+0000 7f76d0ff9640 0 client.16728 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.484+0000 7f76f1b51740 1 -- 172.21.15.27:0/188863675 >> 172.21.15.27:0/188863675 conn(0x56309fc6ba30 msgr2=0x56309fc6ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.484+0000 7f76f1b51740 1 -- 172.21.15.27:0/188863675 shutdown_connections 2024-09-19T08:19:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.484+0000 7f76f1b51740 1 -- 172.21.15.27:0/188863675 wait complete. 2024-09-19T08:19:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.484+0000 7f76f1b51740 20 client.16728 trim_cache size 0 max 16384 2024-09-19T08:19:53.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.502+0000 7f76f1b51740 1 Processor -- start 2024-09-19T08:19:53.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.502+0000 7f76f1b51740 1 -- start start 2024-09-19T08:19:53.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.502+0000 7f76f1b51740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56309fc6ba30 0x56309fc864e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:53.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.502+0000 7f76f1b51740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6f4a0 0x56309fc77210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:53.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.502+0000 7f76f1b51740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56309fc6fdc0 0x56309fc91d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:53.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.502+0000 7f76f1b51740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f76e81ad980 con 0x56309fc6f4a0 2024-09-19T08:19:53.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.502+0000 7f76f1b51740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f76e81b01e0 con 0x56309fc6ba30 2024-09-19T08:19:53.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.502+0000 7f76f1b51740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f76e81adfd0 con 0x56309fc6fdc0 2024-09-19T08:19:53.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.502+0000 7f76ed514640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6f4a0 0x56309fc77210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:53.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.502+0000 7f76ed514640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6f4a0 0x56309fc77210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43174/0 (socket says 172.21.15.27:43174) 2024-09-19T08:19:53.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.502+0000 7f76ed514640 1 -- 172.21.15.27:0/427059652 learned_addr learned my addr 172.21.15.27:0/427059652 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:53.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.502+0000 7f76ed514640 1 -- 172.21.15.27:0/427059652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56309fc6fdc0 msgr2=0x56309fc91d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:53.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.502+0000 7f76ed514640 1 --2- 172.21.15.27:0/427059652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56309fc6fdc0 0x56309fc91d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.502+0000 7f76ecd13640 1 --2- 172.21.15.27:0/427059652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56309fc6ba30 0x56309fc864e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:53.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.502+0000 7f76ed514640 1 -- 172.21.15.27:0/427059652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56309fc6ba30 msgr2=0x56309fc864e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:53.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.503+0000 7f76ed514640 1 --2- 172.21.15.27:0/427059652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56309fc6ba30 0x56309fc864e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.503+0000 7f76ed514640 1 -- 172.21.15.27:0/427059652 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56309fc757a0 con 0x56309fc6f4a0 2024-09-19T08:19:53.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.503+0000 7f76ecd13640 1 --2- 172.21.15.27:0/427059652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56309fc6ba30 0x56309fc864e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:19:53.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.503+0000 7f76ed514640 1 --2- 172.21.15.27:0/427059652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6f4a0 0x56309fc77210 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009c80 tx=0x7f76e400f4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9456f3205f8e4c99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:53.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.503+0000 7f76d2ffd640 1 -- 172.21.15.27:0/427059652 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e40098a0 con 0x56309fc6f4a0 2024-09-19T08:19:53.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.503+0000 7f76d2ffd640 1 -- 172.21.15.27:0/427059652 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76e4029070 con 0x56309fc6f4a0 2024-09-19T08:19:53.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.503+0000 7f76d2ffd640 1 -- 172.21.15.27:0/427059652 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e400fea0 con 0x56309fc6f4a0 2024-09-19T08:19:53.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.504+0000 7f76f1b51740 1 -- 172.21.15.27:0/427059652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6f4a0 msgr2=0x56309fc77210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:53.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.504+0000 7f76f1b51740 1 --2- 172.21.15.27:0/427059652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6f4a0 0x56309fc77210 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009c80 tx=0x7f76e400f4f0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.504+0000 7f76f1b51740 1 -- 172.21.15.27:0/427059652 shutdown_connections 2024-09-19T08:19:53.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.504+0000 7f76f1b51740 1 --2- 172.21.15.27:0/427059652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56309fc6fdc0 0x56309fc91d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.504+0000 7f76f1b51740 1 --2- 172.21.15.27:0/427059652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6f4a0 0x56309fc77210 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.504+0000 7f76f1b51740 1 --2- 172.21.15.27:0/427059652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56309fc6ba30 0x56309fc864e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.504+0000 7f76f1b51740 1 -- 172.21.15.27:0/427059652 >> 172.21.15.27:0/427059652 conn(0x56309fc778f0 msgr2=0x56309fc727e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:53.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.504+0000 7f76f1b51740 1 -- 172.21.15.27:0/427059652 shutdown_connections 2024-09-19T08:19:53.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.504+0000 7f76f1b51740 1 -- 172.21.15.27:0/427059652 wait complete. 2024-09-19T08:19:53.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.504+0000 7f76f1b51740 1 -- start start 2024-09-19T08:19:53.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.504+0000 7f76f1b51740 1 Processor -- start 2024-09-19T08:19:53.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.505+0000 7f76f1b51740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6ba30 0x56309fc7ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:53.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.505+0000 7f76f1b51740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56309fc6f4a0 0x56309fc7ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:53.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.505+0000 7f76f1b51740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56309fc6fdc0 0x56309fcf3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:53.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.505+0000 7f76f1b51740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f76e81ae6a0 con 0x56309fc6ba30 2024-09-19T08:19:53.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.505+0000 7f76f1b51740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f76e81afb10 con 0x56309fc6fdc0 2024-09-19T08:19:53.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.505+0000 7f76f1b51740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f76e81aed70 con 0x56309fc6f4a0 2024-09-19T08:19:53.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.505+0000 7f76f1b51740 10 client.0 _ll_register_callbacks cb 0x7f76d800ec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:19:53.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.505+0000 7f76ecd13640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6ba30 0x56309fc7ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:53.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.505+0000 7f76ecd13640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6ba30 0x56309fc7ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43182/0 (socket says 172.21.15.27:43182) 2024-09-19T08:19:53.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.505+0000 7f76ecd13640 1 -- 172.21.15.27:0/1362149364 learned_addr learned my addr 172.21.15.27:0/1362149364 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:53.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.505+0000 7f76ed514640 1 --2- 172.21.15.27:0/1362149364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56309fc6f4a0 0x56309fc7ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:53.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.505+0000 7f76ecd13640 1 -- 172.21.15.27:0/1362149364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56309fc6f4a0 msgr2=0x56309fc7ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:53.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.505+0000 7f76ecd13640 1 --2- 172.21.15.27:0/1362149364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56309fc6f4a0 0x56309fc7ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.505+0000 7f76ecd13640 1 -- 172.21.15.27:0/1362149364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56309fc6fdc0 msgr2=0x56309fcf3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:53.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.505+0000 7f76ecd13640 1 --2- 172.21.15.27:0/1362149364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56309fc6fdc0 0x56309fcf3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.505+0000 7f76ecd13640 1 -- 172.21.15.27:0/1362149364 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56309fcf4220 con 0x56309fc6ba30 2024-09-19T08:19:53.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.505+0000 7f76ed514640 1 --2- 172.21.15.27:0/1362149364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56309fc6f4a0 0x56309fc7ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:19:53.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.505+0000 7f76ecd13640 1 --2- 172.21.15.27:0/1362149364 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6ba30 0x56309fc7ea10 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f76d8010c30 tx=0x7f76d80116a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f239d02f9a4afee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:53.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.505+0000 7f76d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:19:53.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.506+0000 7f76d0ff9640 1 -- 172.21.15.27:0/1362149364 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8011070 con 0x56309fc6ba30 2024-09-19T08:19:53.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.506+0000 7f76d0ff9640 1 -- 172.21.15.27:0/1362149364 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f76d8011950 con 0x56309fc6ba30 2024-09-19T08:19:53.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.506+0000 7f76f1b51740 1 -- 172.21.15.27:0/1362149364 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76e4029070 con 0x56309fc6ba30 2024-09-19T08:19:53.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.506+0000 7f76d0ff9640 1 -- 172.21.15.27:0/1362149364 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f76d803d050 con 0x56309fc6ba30 2024-09-19T08:19:53.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.506+0000 7f76f1b51740 10 client.16734 fetch_fsmap learned FSMap version 20 2024-09-19T08:19:53.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.506+0000 7f76f1b51740 1 -- 172.21.15.27:0/1362149364 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56309fcf53b0 con 0x56309fc6ba30 2024-09-19T08:19:53.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.506+0000 7f76d0ff9640 1 -- 172.21.15.27:0/1362149364 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76e4029070 con 0x56309fc6ba30 2024-09-19T08:19:53.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.506+0000 7f76d0ff9640 1 -- 172.21.15.27:0/1362149364 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f76d802c6d0 con 0x56309fc6ba30 2024-09-19T08:19:53.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.506+0000 7f76f1b51740 10 client.16734 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:19:53.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.506+0000 7f76f1b51740 10 client.16734 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:19:53.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.506+0000 7f76f1b51740 20 client.16734 populate_metadata read hostname 'smithi027' 2024-09-19T08:19:53.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.506+0000 7f76f1b51740 1 --2- 172.21.15.27:0/1362149364 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56309fc7a680 0x56309fcf7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:53.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.506+0000 7f76f1b51740 4 client.16734 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:19:53.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.506+0000 7f76f1b51740 1 -- 172.21.15.27:0/1362149364 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56309fbdcd60 con 0x56309fc7a680 2024-09-19T08:19:53.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.506+0000 7f76ed514640 1 --2- 172.21.15.27:0/1362149364 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56309fc7a680 0x56309fcf7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:53.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.507+0000 7f76ed514640 1 --2- 172.21.15.27:0/1362149364 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56309fc7a680 0x56309fcf7ab0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7e25c78dcc42452 server_cookie=d203928f090af23f in_seq=0 out_seq=0 2024-09-19T08:19:53.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.507+0000 7f76d0ff9640 10 client.16734 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:53.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.507+0000 7f76d0ff9640 1 -- 172.21.15.27:0/1362149364 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56309fbdcd60 con 0x56309fc7a680 2024-09-19T08:19:53.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.507+0000 7f76d0ff9640 10 client.16734 handle_command_reply: tid=0 2024-09-19T08:19:53.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.507+0000 7f76f1b51740 1 client.16734 shutdown 2024-09-19T08:19:53.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.507+0000 7f76f1b51740 1 -- 172.21.15.27:0/1362149364 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6ba30 msgr2=0x56309fc7ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:53.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.507+0000 7f76f1b51740 1 --2- 172.21.15.27:0/1362149364 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6ba30 0x56309fc7ea10 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f76d8010c30 tx=0x7f76d80116a0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.507+0000 7f76f1b51740 1 -- 172.21.15.27:0/1362149364 shutdown_connections 2024-09-19T08:19:53.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.507+0000 7f76f1b51740 1 --2- 172.21.15.27:0/1362149364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56309fc6fdc0 0x56309fcf3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.507+0000 7f76f1b51740 1 --2- 172.21.15.27:0/1362149364 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56309fc7a680 0x56309fcf7ab0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.507+0000 7f76f1b51740 1 --2- 172.21.15.27:0/1362149364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56309fc6f4a0 0x56309fc7ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.507+0000 7f76d0ff9640 0 client.16734 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:53.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.507+0000 7f76f1b51740 1 --2- 172.21.15.27:0/1362149364 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56309fc6ba30 0x56309fc7ea10 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.507+0000 7f76f1b51740 1 -- 172.21.15.27:0/1362149364 >> 172.21.15.27:0/1362149364 conn(0x56309fc778f0 msgr2=0x56309fc70ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:53.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.507+0000 7f76f1b51740 1 -- 172.21.15.27:0/1362149364 shutdown_connections 2024-09-19T08:19:53.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.508+0000 7f76f1b51740 1 -- 172.21.15.27:0/1362149364 wait complete. 2024-09-19T08:19:53.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.508+0000 7f76f1b51740 20 client.16734 trim_cache size 0 max 16384 2024-09-19T08:19:53.513 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:19:53.513 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:19:53.513 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:19:53.513 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:19:53.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.508+0000 7f76ef778640 1 -- 172.21.15.27:0/1740633566 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f76d40a33b0 msgr2=0x7f76d40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:53.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.508+0000 7f76ef778640 1 --2- 172.21.15.27:0/1740633566 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f76d40a33b0 0x7f76d40a5870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f76e00ee3f0 tx=0x7f76e00b2360 comp rx=0 tx=0).stop 2024-09-19T08:19:53.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.508+0000 7f76ef778640 1 -- 172.21.15.27:0/1740633566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76e810c170 msgr2=0x7f76e8101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:53.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.508+0000 7f76ef778640 1 --2- 172.21.15.27:0/1740633566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76e810c170 0x7f76e8101420 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f76e0004af0 tx=0x7f76e002f5b0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.508+0000 7f76ef778640 1 -- 172.21.15.27:0/1740633566 shutdown_connections 2024-09-19T08:19:53.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.508+0000 7f76ef778640 1 --2- 172.21.15.27:0/1740633566 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f76d40a33b0 0x7f76d40a5870 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.508+0000 7f76ef778640 1 --2- 172.21.15.27:0/1740633566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76e810c170 0x7f76e8101420 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.508+0000 7f76ef778640 1 --2- 172.21.15.27:0/1740633566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76e8103660 0x7f76e8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.508+0000 7f76ef778640 1 --2- 172.21.15.27:0/1740633566 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76e8102d40 0x7f76e81009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:53.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.508+0000 7f76ef778640 1 -- 172.21.15.27:0/1740633566 >> 172.21.15.27:0/1740633566 conn(0x7f76e80fc7a0 msgr2=0x7f76e80fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:53.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.508+0000 7f76ef778640 1 -- 172.21.15.27:0/1740633566 shutdown_connections 2024-09-19T08:19:53.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:53.508+0000 7f76ef778640 1 -- 172.21.15.27:0/1740633566 wait complete. 2024-09-19T08:19:53.515 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:53 smithi203 ceph-mon[35198]: pgmap v272: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:54.377 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:19:54.378 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:19:54.640 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:19:55.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.132+0000 7fa9caf6e640 1 -- 172.21.15.27:0/3355407847 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9c4102df0 msgr2=0x7fa9c41031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:55.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.132+0000 7fa9caf6e640 1 --2- 172.21.15.27:0/3355407847 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9c4102df0 0x7fa9c41031d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4009900 tx=0x7fa9b402a410 comp rx=0 tx=0).stop 2024-09-19T08:19:55.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.133+0000 7fa9caf6e640 1 -- 172.21.15.27:0/3355407847 shutdown_connections 2024-09-19T08:19:55.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.133+0000 7fa9caf6e640 1 --2- 172.21.15.27:0/3355407847 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9c410c2f0 0x7fa9c410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:55.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.133+0000 7fa9caf6e640 1 --2- 172.21.15.27:0/3355407847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9c41037a0 0x7fa9c410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:55.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.133+0000 7fa9caf6e640 1 --2- 172.21.15.27:0/3355407847 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9c4102df0 0x7fa9c41031d0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:55.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.133+0000 7fa9caf6e640 1 -- 172.21.15.27:0/3355407847 >> 172.21.15.27:0/3355407847 conn(0x7fa9c40fc7d0 msgr2=0x7fa9c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:55.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.133+0000 7fa9caf6e640 1 -- 172.21.15.27:0/3355407847 shutdown_connections 2024-09-19T08:19:55.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.133+0000 7fa9caf6e640 1 -- 172.21.15.27:0/3355407847 wait complete. 2024-09-19T08:19:55.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.133+0000 7fa9caf6e640 1 Processor -- start 2024-09-19T08:19:55.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.133+0000 7fa9caf6e640 1 -- start start 2024-09-19T08:19:55.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.133+0000 7fa9caf6e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9c4102df0 0x7fa9c4100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:55.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.133+0000 7fa9caf6e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9c41037a0 0x7fa9c4100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:55.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.133+0000 7fa9caf6e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9c410c2f0 0x7fa9c41014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:55.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.133+0000 7fa9caf6e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c4112110 con 0x7fa9c4102df0 2024-09-19T08:19:55.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.134+0000 7fa9caf6e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c4111f90 con 0x7fa9c41037a0 2024-09-19T08:19:55.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.134+0000 7fa9caf6e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c4112290 con 0x7fa9c410c2f0 2024-09-19T08:19:55.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.134+0000 7fa9c8d0a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9c4102df0 0x7fa9c4100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:55.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.134+0000 7fa9c8d0a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9c4102df0 0x7fa9c4100a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43198/0 (socket says 172.21.15.27:43198) 2024-09-19T08:19:55.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.134+0000 7fa9c8d0a640 1 -- 172.21.15.27:0/3853757813 learned_addr learned my addr 172.21.15.27:0/3853757813 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:55.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.134+0000 7fa9c950b640 1 --2- 172.21.15.27:0/3853757813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9c410c2f0 0x7fa9c41014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:55.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.134+0000 7fa9c3fff640 1 --2- 172.21.15.27:0/3853757813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9c41037a0 0x7fa9c4100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:55.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.134+0000 7fa9c8d0a640 1 -- 172.21.15.27:0/3853757813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9c410c2f0 msgr2=0x7fa9c41014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:55.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.134+0000 7fa9c8d0a640 1 --2- 172.21.15.27:0/3853757813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9c410c2f0 0x7fa9c41014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:55.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.134+0000 7fa9c8d0a640 1 -- 172.21.15.27:0/3853757813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9c41037a0 msgr2=0x7fa9c4100f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.134+0000 7fa9c8d0a640 1 --2- 172.21.15.27:0/3853757813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9c41037a0 0x7fa9c4100f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.134+0000 7fa9c8d0a640 1 -- 172.21.15.27:0/3853757813 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c41a6af0 con 0x7fa9c4102df0 2024-09-19T08:19:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.134+0000 7fa9c950b640 1 --2- 172.21.15.27:0/3853757813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9c410c2f0 0x7fa9c41014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:19:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.134+0000 7fa9c8d0a640 1 --2- 172.21.15.27:0/3853757813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9c4102df0 0x7fa9c4100a50 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4006010 tx=0x7fa9b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.134+0000 7fa9c1ffb640 1 -- 172.21.15.27:0/3853757813 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b403f030 con 0x7fa9c4102df0 2024-09-19T08:19:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.134+0000 7fa9caf6e640 1 -- 172.21.15.27:0/3853757813 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c41a6d80 con 0x7fa9c4102df0 2024-09-19T08:19:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.134+0000 7fa9c1ffb640 1 -- 172.21.15.27:0/3853757813 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9b4003ce0 con 0x7fa9c4102df0 2024-09-19T08:19:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.134+0000 7fa9c1ffb640 1 -- 172.21.15.27:0/3853757813 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4035070 con 0x7fa9c4102df0 2024-09-19T08:19:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.135+0000 7fa9caf6e640 1 -- 172.21.15.27:0/3853757813 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c41a7250 con 0x7fa9c4102df0 2024-09-19T08:19:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.136+0000 7fa9caf6e640 1 -- 172.21.15.27:0/3853757813 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9c41031d0 con 0x7fa9c4102df0 2024-09-19T08:19:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.137+0000 7fa9c1ffb640 1 -- 172.21.15.27:0/3853757813 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fa9b4042030 con 0x7fa9c4102df0 2024-09-19T08:19:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.137+0000 7fa9c1ffb640 1 --2- 172.21.15.27:0/3853757813 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa9ac0a3430 0x7fa9ac0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.138+0000 7fa9c3fff640 1 --2- 172.21.15.27:0/3853757813 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa9ac0a3430 0x7fa9ac0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:55.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.138+0000 7fa9c1ffb640 1 -- 172.21.15.27:0/3853757813 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fa9b40f0270 con 0x7fa9c4102df0 2024-09-19T08:19:55.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.138+0000 7fa9c3fff640 1 --2- 172.21.15.27:0/3853757813 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa9ac0a3430 0x7fa9ac0a58f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8005fd0 tx=0x7fa9b8005850 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:55.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.142+0000 7fa9c1ffb640 1 -- 172.21.15.27:0/3853757813 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa9b40bcd30 con 0x7fa9c4102df0 2024-09-19T08:19:55.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.357+0000 7fa9caf6e640 1 -- 172.21.15.27:0/3853757813 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9c41072c0 con 0x7fa9c4102df0 2024-09-19T08:19:55.357 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:55 smithi027 ceph-mon[31209]: pgmap v273: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:19:55.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.358+0000 7fa9c1ffb640 1 -- 172.21.15.27:0/3853757813 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7fa9b40dc090 con 0x7fa9c4102df0 2024-09-19T08:19:55.358 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:19:55.358 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:19:55.359 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:19:55.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.361+0000 7fa9caf6e640 1 -- 172.21.15.27:0/3853757813 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa9ac0a3430 msgr2=0x7fa9ac0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:55.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.361+0000 7fa9caf6e640 1 --2- 172.21.15.27:0/3853757813 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa9ac0a3430 0x7fa9ac0a58f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8005fd0 tx=0x7fa9b8005850 comp rx=0 tx=0).stop 2024-09-19T08:19:55.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.361+0000 7fa9caf6e640 1 -- 172.21.15.27:0/3853757813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9c4102df0 msgr2=0x7fa9c4100a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:55.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.361+0000 7fa9caf6e640 1 --2- 172.21.15.27:0/3853757813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9c4102df0 0x7fa9c4100a50 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4006010 tx=0x7fa9b40042f0 comp rx=0 tx=0).stop 2024-09-19T08:19:55.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.361+0000 7fa9caf6e640 1 -- 172.21.15.27:0/3853757813 shutdown_connections 2024-09-19T08:19:55.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.361+0000 7fa9caf6e640 1 --2- 172.21.15.27:0/3853757813 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fa9ac0a3430 0x7fa9ac0a58f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:55.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.361+0000 7fa9caf6e640 1 --2- 172.21.15.27:0/3853757813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9c410c2f0 0x7fa9c41014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:55.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.361+0000 7fa9caf6e640 1 --2- 172.21.15.27:0/3853757813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9c41037a0 0x7fa9c4100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:55.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.361+0000 7fa9caf6e640 1 --2- 172.21.15.27:0/3853757813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9c4102df0 0x7fa9c4100a50 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:55.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.361+0000 7fa9caf6e640 1 -- 172.21.15.27:0/3853757813 >> 172.21.15.27:0/3853757813 conn(0x7fa9c40fc7d0 msgr2=0x7fa9c40fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:55.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.361+0000 7fa9caf6e640 1 -- 172.21.15.27:0/3853757813 shutdown_connections 2024-09-19T08:19:55.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:55.361+0000 7fa9caf6e640 1 -- 172.21.15.27:0/3853757813 wait complete. 2024-09-19T08:19:55.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:55 smithi155 ceph-mon[35362]: pgmap v273: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:19:55.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:55 smithi203 ceph-mon[35198]: pgmap v273: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:19:56.056 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:19:56.317 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:19:56.438 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:56 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3853757813' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:19:56.439 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:56 smithi027 ceph-mon[31209]: pgmap v274: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:56.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:56 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3853757813' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:19:56.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:56 smithi155 ceph-mon[35362]: pgmap v274: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:56.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:56 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3853757813' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:19:56.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:56 smithi203 ceph-mon[35198]: pgmap v274: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:19:56.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.878+0000 7fea38083640 1 -- 172.21.15.27:0/2621872778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea30101420 msgr2=0x7fea3010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:56.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.878+0000 7fea38083640 1 --2- 172.21.15.27:0/2621872778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea30101420 0x7fea3010d950 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fea28009cd0 tx=0x7fea2802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.878+0000 7fea38083640 1 -- 172.21.15.27:0/2621872778 shutdown_connections 2024-09-19T08:19:56.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.878+0000 7fea38083640 1 --2- 172.21.15.27:0/2621872778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea30101420 0x7fea3010d950 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.878+0000 7fea38083640 1 --2- 172.21.15.27:0/2621872778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea30100a80 0x7fea30100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.878+0000 7fea38083640 1 --2- 172.21.15.27:0/2621872778 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea30106a80 0x7fea30106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.878+0000 7fea38083640 1 -- 172.21.15.27:0/2621872778 >> 172.21.15.27:0/2621872778 conn(0x7fea300fc7a0 msgr2=0x7fea300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:56.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.878+0000 7fea38083640 1 -- 172.21.15.27:0/2621872778 shutdown_connections 2024-09-19T08:19:56.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.878+0000 7fea38083640 1 -- 172.21.15.27:0/2621872778 wait complete. 2024-09-19T08:19:56.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.879+0000 7fea38083640 1 Processor -- start 2024-09-19T08:19:56.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.879+0000 7fea38083640 1 -- start start 2024-09-19T08:19:56.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.879+0000 7fea38083640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea30100a80 0x7fea30102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:56.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.879+0000 7fea38083640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea30101420 0x7fea30102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:56.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.879+0000 7fea38083640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea30106a80 0x7fea301030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:56.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.879+0000 7fea38083640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fea30110e80 con 0x7fea30100a80 2024-09-19T08:19:56.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.879+0000 7fea38083640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fea30110d00 con 0x7fea30101420 2024-09-19T08:19:56.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.879+0000 7fea38083640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fea30111000 con 0x7fea30106a80 2024-09-19T08:19:56.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.879+0000 7fea35e1f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea30100a80 0x7fea30102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:56.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.879+0000 7fea35e1f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea30100a80 0x7fea30102650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43210/0 (socket says 172.21.15.27:43210) 2024-09-19T08:19:56.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.879+0000 7fea35e1f640 1 -- 172.21.15.27:0/3476826723 learned_addr learned my addr 172.21.15.27:0/3476826723 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:56.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.879+0000 7fea36620640 1 --2- 172.21.15.27:0/3476826723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea30106a80 0x7fea301030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:56.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.879+0000 7fea3561e640 1 --2- 172.21.15.27:0/3476826723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea30101420 0x7fea30102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:56.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.879+0000 7fea35e1f640 1 -- 172.21.15.27:0/3476826723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea30106a80 msgr2=0x7fea301030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:56.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.879+0000 7fea35e1f640 1 --2- 172.21.15.27:0/3476826723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea30106a80 0x7fea301030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.879+0000 7fea35e1f640 1 -- 172.21.15.27:0/3476826723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea30101420 msgr2=0x7fea30102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:56.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.879+0000 7fea35e1f640 1 --2- 172.21.15.27:0/3476826723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea30101420 0x7fea30102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.879+0000 7fea35e1f640 1 -- 172.21.15.27:0/3476826723 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea301a68d0 con 0x7fea30100a80 2024-09-19T08:19:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.879+0000 7fea3561e640 1 --2- 172.21.15.27:0/3476826723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea30101420 0x7fea30102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:19:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.879+0000 7fea36620640 1 --2- 172.21.15.27:0/3476826723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea30106a80 0x7fea301030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:19:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.880+0000 7fea35e1f640 1 --2- 172.21.15.27:0/3476826723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea30100a80 0x7fea30102650 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00d770 tx=0x7fea2c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.880+0000 7fea22ffd640 1 -- 172.21.15.27:0/3476826723 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c017070 con 0x7fea30100a80 2024-09-19T08:19:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.880+0000 7fea22ffd640 1 -- 172.21.15.27:0/3476826723 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea2c005500 con 0x7fea30100a80 2024-09-19T08:19:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.880+0000 7fea38083640 1 -- 172.21.15.27:0/3476826723 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea301a6bc0 con 0x7fea30100a80 2024-09-19T08:19:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.880+0000 7fea22ffd640 1 -- 172.21.15.27:0/3476826723 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c004e00 con 0x7fea30100a80 2024-09-19T08:19:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.880+0000 7fea38083640 1 -- 172.21.15.27:0/3476826723 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea301a70b0 con 0x7fea30100a80 2024-09-19T08:19:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.882+0000 7fea22ffd640 1 -- 172.21.15.27:0/3476826723 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fea2c004fa0 con 0x7fea30100a80 2024-09-19T08:19:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.882+0000 7fea3a45c740 1 Processor -- start 2024-09-19T08:19:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.883+0000 7fea3a45c740 1 -- start start 2024-09-19T08:19:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.883+0000 7fea3a45c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a4b40 0x559bb01a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.883+0000 7fea3a45c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01a35d0 0x559bb01a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.883+0000 7fea3a45c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb01ae370 0x559bb01b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.883+0000 7fea3a45c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559bb01092f0 con 0x559bb01a35d0 2024-09-19T08:19:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.883+0000 7fea3a45c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559bb00b0cf0 con 0x559bb01ae370 2024-09-19T08:19:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.883+0000 7fea3a45c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559bb01052b0 con 0x559bb01a4b40 2024-09-19T08:19:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.883+0000 7fea22ffd640 1 --2- 172.21.15.27:0/3476826723 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fea1c0a33b0 0x7fea1c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.883+0000 7fea35e1f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01a35d0 0x559bb01a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.883+0000 7fea35e1f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01a35d0 0x559bb01a3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43216/0 (socket says 172.21.15.27:43216) 2024-09-19T08:19:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.883+0000 7fea35e1f640 1 -- 172.21.15.27:0/2952408189 learned_addr learned my addr 172.21.15.27:0/2952408189 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.883+0000 7fea36620640 1 --2- 172.21.15.27:0/3476826723 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fea1c0a33b0 0x7fea1c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.883+0000 7fea3561e640 1 --2- 172.21.15.27:0/2952408189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb01ae370 0x559bb01b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.883+0000 7fea36620640 1 --2- 172.21.15.27:0/2952408189 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a4b40 0x559bb01a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.883+0000 7fea22ffd640 1 -- 172.21.15.27:0/3476826723 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fea2c0cf780 con 0x7fea30100a80 2024-09-19T08:19:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.883+0000 7fea35e1f640 1 -- 172.21.15.27:0/2952408189 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a4b40 msgr2=0x559bb01a3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.883+0000 7fea35e1f640 1 --2- 172.21.15.27:0/2952408189 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a4b40 0x559bb01a3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.883+0000 7fea35e1f640 1 -- 172.21.15.27:0/2952408189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb01ae370 msgr2=0x559bb01b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.883+0000 7fea35e1f640 1 --2- 172.21.15.27:0/2952408189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb01ae370 0x559bb01b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.884+0000 7fea35e1f640 1 -- 172.21.15.27:0/2952408189 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bb00953a0 con 0x559bb01a35d0 2024-09-19T08:19:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.884+0000 7fea35e1f640 1 --2- 172.21.15.27:0/2952408189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01a35d0 0x559bb01a3a10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0ccf50 tx=0x7fea2c0048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e866f129db2db304 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.884+0000 7fea36620640 1 --2- 172.21.15.27:0/3476826723 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fea1c0a33b0 0x7fea1c0a5870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fea28005fe0 tx=0x7fea28005d80 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.884+0000 7fea1bfff640 1 -- 172.21.15.27:0/2952408189 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c020050 con 0x559bb01a35d0 2024-09-19T08:19:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.884+0000 7fea1bfff640 1 -- 172.21.15.27:0/2952408189 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea2c0046c0 con 0x559bb01a35d0 2024-09-19T08:19:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.884+0000 7fea1bfff640 1 -- 172.21.15.27:0/2952408189 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c0cd170 con 0x559bb01a35d0 2024-09-19T08:19:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.885+0000 7fea3a45c740 1 -- 172.21.15.27:0/2952408189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01a35d0 msgr2=0x559bb01a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.885+0000 7fea3a45c740 1 --2- 172.21.15.27:0/2952408189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01a35d0 0x559bb01a3a10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0ccf50 tx=0x7fea2c0048a0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.885+0000 7fea3a45c740 1 -- 172.21.15.27:0/2952408189 shutdown_connections 2024-09-19T08:19:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.885+0000 7fea3a45c740 1 --2- 172.21.15.27:0/2952408189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb01ae370 0x559bb01b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.885+0000 7fea3a45c740 1 --2- 172.21.15.27:0/2952408189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01a35d0 0x559bb01a3a10 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.885+0000 7fea3a45c740 1 --2- 172.21.15.27:0/2952408189 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a4b40 0x559bb01a3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.885+0000 7fea3a45c740 1 -- 172.21.15.27:0/2952408189 >> 172.21.15.27:0/2952408189 conn(0x559bb016c310 msgr2=0x559bb019fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.885+0000 7fea3a45c740 1 -- 172.21.15.27:0/2952408189 shutdown_connections 2024-09-19T08:19:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.885+0000 7fea3a45c740 1 -- 172.21.15.27:0/2952408189 wait complete. 2024-09-19T08:19:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.885+0000 7fea3a45c740 1 -- start start 2024-09-19T08:19:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.885+0000 7fea3a45c740 1 Processor -- start 2024-09-19T08:19:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.886+0000 7fea3a45c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb01a35d0 0x559bb01ade00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.886+0000 7fea3a45c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a4b40 0x559bb01ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.886+0000 7fea3a45c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01ae370 0x559bb01ab840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.886+0000 7fea3a45c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559bb01b1010 con 0x559bb01ae370 2024-09-19T08:19:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.886+0000 7fea3a45c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559bb00c4060 con 0x559bb01a35d0 2024-09-19T08:19:56.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.886+0000 7fea3a45c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559bb01b1190 con 0x559bb01a4b40 2024-09-19T08:19:56.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.886+0000 7fea3a45c740 10 client.0 _ll_register_callbacks cb 0x559bafe178c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:19:56.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.886+0000 7fea36620640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01ae370 0x559bb01ab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:56.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.886+0000 7fea36620640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01ae370 0x559bb01ab840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43226/0 (socket says 172.21.15.27:43226) 2024-09-19T08:19:56.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.886+0000 7fea36620640 1 -- 172.21.15.27:0/1516458389 learned_addr learned my addr 172.21.15.27:0/1516458389 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:56.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.886+0000 7fea3561e640 1 --2- 172.21.15.27:0/1516458389 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a4b40 0x559bb01ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:56.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.886+0000 7fea35e1f640 1 --2- 172.21.15.27:0/1516458389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb01a35d0 0x559bb01ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:56.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.886+0000 7fea36620640 1 -- 172.21.15.27:0/1516458389 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a4b40 msgr2=0x559bb01ab0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:56.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.886+0000 7fea36620640 1 --2- 172.21.15.27:0/1516458389 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a4b40 0x559bb01ab0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.886+0000 7fea36620640 1 -- 172.21.15.27:0/1516458389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb01a35d0 msgr2=0x559bb01ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:56.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.886+0000 7fea36620640 1 --2- 172.21.15.27:0/1516458389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb01a35d0 0x559bb01ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.886+0000 7fea36620640 1 -- 172.21.15.27:0/1516458389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bafe7a3c0 con 0x559bb01ae370 2024-09-19T08:19:56.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.886+0000 7fea36620640 1 --2- 172.21.15.27:0/1516458389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01ae370 0x559bb01ab840 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fea28035000 tx=0x7fea2802a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7793e1713d48109 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.886+0000 7fea197fa640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:19:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.887+0000 7fea197fa640 1 -- 172.21.15.27:0/1516458389 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea280043d0 con 0x559bb01ae370 2024-09-19T08:19:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.887+0000 7fea197fa640 1 -- 172.21.15.27:0/1516458389 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fea28004570 con 0x559bb01ae370 2024-09-19T08:19:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.887+0000 7fea3a45c740 1 -- 172.21.15.27:0/1516458389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559bb0116860 con 0x559bb01ae370 2024-09-19T08:19:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.887+0000 7fea197fa640 1 -- 172.21.15.27:0/1516458389 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fea2805b050 con 0x559bb01ae370 2024-09-19T08:19:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.887+0000 7fea3a45c740 10 client.16752 fetch_fsmap learned FSMap version 20 2024-09-19T08:19:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.887+0000 7fea3a45c740 1 -- 172.21.15.27:0/1516458389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559bb01bcbe0 con 0x559bb01ae370 2024-09-19T08:19:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.887+0000 7fea197fa640 1 -- 172.21.15.27:0/1516458389 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x559bb0116860 con 0x559bb01ae370 2024-09-19T08:19:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.887+0000 7fea197fa640 1 -- 172.21.15.27:0/1516458389 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fea28030070 con 0x559bb01ae370 2024-09-19T08:19:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.887+0000 7fea3a45c740 10 client.16752 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:19:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.887+0000 7fea3a45c740 10 client.16752 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:19:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.887+0000 7fea3a45c740 20 client.16752 populate_metadata read hostname 'smithi027' 2024-09-19T08:19:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.887+0000 7fea3a45c740 1 --2- 172.21.15.27:0/1516458389 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559bb01be140 0x559bb01c05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.887+0000 7fea3a45c740 4 client.16752 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:19:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.887+0000 7fea3a45c740 1 -- 172.21.15.27:0/1516458389 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bb0110d70 con 0x559bb01be140 2024-09-19T08:19:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.888+0000 7fea35e1f640 1 --2- 172.21.15.27:0/1516458389 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559bb01be140 0x559bb01c05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.888+0000 7fea35e1f640 1 --2- 172.21.15.27:0/1516458389 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559bb01be140 0x559bb01c05a0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2181b6bb90016a5e server_cookie=d1feba120cdc6718 in_seq=0 out_seq=0 2024-09-19T08:19:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.888+0000 7fea197fa640 10 client.16752 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.889+0000 7fea197fa640 1 -- 172.21.15.27:0/1516458389 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559bb0110d70 con 0x559bb01be140 2024-09-19T08:19:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.889+0000 7fea197fa640 10 client.16752 handle_command_reply: tid=0 2024-09-19T08:19:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.889+0000 7fea3a45c740 1 client.16752 shutdown 2024-09-19T08:19:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.889+0000 7fea3a45c740 1 -- 172.21.15.27:0/1516458389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01ae370 msgr2=0x559bb01ab840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.889+0000 7fea3a45c740 1 --2- 172.21.15.27:0/1516458389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01ae370 0x559bb01ab840 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fea28035000 tx=0x7fea2802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.889+0000 7fea3a45c740 1 -- 172.21.15.27:0/1516458389 shutdown_connections 2024-09-19T08:19:56.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.889+0000 7fea3a45c740 1 --2- 172.21.15.27:0/1516458389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01ae370 0x559bb01ab840 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.889+0000 7fea3a45c740 1 --2- 172.21.15.27:0/1516458389 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559bb01be140 0x559bb01c05a0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.889+0000 7fea3a45c740 1 --2- 172.21.15.27:0/1516458389 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a4b40 0x559bb01ab0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.889+0000 7fea3a45c740 1 --2- 172.21.15.27:0/1516458389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb01a35d0 0x559bb01ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.889+0000 7fea3a45c740 1 -- 172.21.15.27:0/1516458389 >> 172.21.15.27:0/1516458389 conn(0x559bb016c310 msgr2=0x559bb01a5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:56.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.889+0000 7fea197fa640 0 client.16752 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:56.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.889+0000 7fea3a45c740 1 -- 172.21.15.27:0/1516458389 shutdown_connections 2024-09-19T08:19:56.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.889+0000 7fea3a45c740 1 -- 172.21.15.27:0/1516458389 wait complete. 2024-09-19T08:19:56.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.889+0000 7fea3a45c740 20 client.16752 trim_cache size 0 max 16384 2024-09-19T08:19:56.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.902+0000 7fea3a45c740 1 Processor -- start 2024-09-19T08:19:56.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.902+0000 7fea3a45c740 1 -- start start 2024-09-19T08:19:56.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.903+0000 7fea3a45c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a35d0 0x559bb01aa970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:56.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.903+0000 7fea3a45c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01a4b40 0x559bb01a6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:56.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.903+0000 7fea3a45c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb01ae370 0x559bb01a66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:56.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.903+0000 7fea3a45c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fea301ad9d0 con 0x559bb01a4b40 2024-09-19T08:19:56.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.903+0000 7fea3a45c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fea301b0230 con 0x559bb01ae370 2024-09-19T08:19:56.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.903+0000 7fea3a45c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fea301ae020 con 0x559bb01a35d0 2024-09-19T08:19:56.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.903+0000 7fea3561e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01a4b40 0x559bb01a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:56.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.903+0000 7fea3561e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01a4b40 0x559bb01a6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43236/0 (socket says 172.21.15.27:43236) 2024-09-19T08:19:56.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.903+0000 7fea3561e640 1 -- 172.21.15.27:0/1798902863 learned_addr learned my addr 172.21.15.27:0/1798902863 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:56.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.903+0000 7fea35e1f640 1 --2- 172.21.15.27:0/1798902863 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a35d0 0x559bb01aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:56.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.903+0000 7fea36620640 1 --2- 172.21.15.27:0/1798902863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb01ae370 0x559bb01a66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:56.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.903+0000 7fea3561e640 1 -- 172.21.15.27:0/1798902863 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a35d0 msgr2=0x559bb01aa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:56.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.903+0000 7fea3561e640 1 --2- 172.21.15.27:0/1798902863 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a35d0 0x559bb01aa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.903+0000 7fea3561e640 1 -- 172.21.15.27:0/1798902863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb01ae370 msgr2=0x559bb01a66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:56.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.903+0000 7fea3561e640 1 --2- 172.21.15.27:0/1798902863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb01ae370 0x559bb01a66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.903+0000 7fea3561e640 1 -- 172.21.15.27:0/1798902863 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bb01c0c20 con 0x559bb01a4b40 2024-09-19T08:19:56.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.903+0000 7fea35e1f640 1 --2- 172.21.15.27:0/1798902863 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a35d0 0x559bb01aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:19:56.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.903+0000 7fea3561e640 1 --2- 172.21.15.27:0/1798902863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01a4b40 0x559bb01a6180 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fea301040e0 tx=0x7fea24013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a9d68681df7f49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:56.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.904+0000 7fea1b7fe640 1 -- 172.21.15.27:0/1798902863 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea24004220 con 0x559bb01a4b40 2024-09-19T08:19:56.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.904+0000 7fea1b7fe640 1 -- 172.21.15.27:0/1798902863 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea240043c0 con 0x559bb01a4b40 2024-09-19T08:19:56.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.904+0000 7fea1b7fe640 1 -- 172.21.15.27:0/1798902863 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea24011990 con 0x559bb01a4b40 2024-09-19T08:19:56.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.904+0000 7fea3a45c740 1 -- 172.21.15.27:0/1798902863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01a4b40 msgr2=0x559bb01a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:56.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.904+0000 7fea3a45c740 1 --2- 172.21.15.27:0/1798902863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01a4b40 0x559bb01a6180 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fea301040e0 tx=0x7fea24013830 comp rx=0 tx=0).stop 2024-09-19T08:19:56.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.904+0000 7fea3a45c740 1 -- 172.21.15.27:0/1798902863 shutdown_connections 2024-09-19T08:19:56.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.904+0000 7fea3a45c740 1 --2- 172.21.15.27:0/1798902863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb01ae370 0x559bb01a66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.904+0000 7fea3a45c740 1 --2- 172.21.15.27:0/1798902863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01a4b40 0x559bb01a6180 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.904+0000 7fea3a45c740 1 --2- 172.21.15.27:0/1798902863 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a35d0 0x559bb01aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.904+0000 7fea3a45c740 1 -- 172.21.15.27:0/1798902863 >> 172.21.15.27:0/1798902863 conn(0x559bb016c310 msgr2=0x559bb01aa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:56.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.905+0000 7fea3a45c740 1 -- 172.21.15.27:0/1798902863 shutdown_connections 2024-09-19T08:19:56.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.905+0000 7fea3a45c740 1 -- 172.21.15.27:0/1798902863 wait complete. 2024-09-19T08:19:56.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.905+0000 7fea3a45c740 1 -- start start 2024-09-19T08:19:56.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.905+0000 7fea3a45c740 1 Processor -- start 2024-09-19T08:19:56.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.905+0000 7fea3a45c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a35d0 0x559bb01b6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:56.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.905+0000 7fea3a45c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb01a4b40 0x559bb01b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:56.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.905+0000 7fea3a45c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01ae370 0x559bb01a7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:56.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.905+0000 7fea3a45c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fea301ae6f0 con 0x559bb01ae370 2024-09-19T08:19:56.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.905+0000 7fea3a45c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fea301afb60 con 0x559bb01a4b40 2024-09-19T08:19:56.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.905+0000 7fea3a45c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fea301aedc0 con 0x559bb01a35d0 2024-09-19T08:19:56.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.906+0000 7fea3a45c740 10 client.0 _ll_register_callbacks cb 0x7fea280098f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:19:56.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.906+0000 7fea36620640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01ae370 0x559bb01a7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:56.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.906+0000 7fea35e1f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a35d0 0x559bb01b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:56.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.906+0000 7fea36620640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01ae370 0x559bb01a7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43250/0 (socket says 172.21.15.27:43250) 2024-09-19T08:19:56.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.906+0000 7fea36620640 1 -- 172.21.15.27:0/3996576126 learned_addr learned my addr 172.21.15.27:0/3996576126 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:56.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.906+0000 7fea3561e640 1 --2- 172.21.15.27:0/3996576126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb01a4b40 0x559bb01b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:56.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.906+0000 7fea35e1f640 1 -- 172.21.15.27:0/3996576126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb01a4b40 msgr2=0x559bb01b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:56.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.906+0000 7fea35e1f640 1 --2- 172.21.15.27:0/3996576126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb01a4b40 0x559bb01b6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.906+0000 7fea35e1f640 1 -- 172.21.15.27:0/3996576126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01ae370 msgr2=0x559bb01a7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:56.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.906+0000 7fea35e1f640 1 --2- 172.21.15.27:0/3996576126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01ae370 0x559bb01a7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.906+0000 7fea35e1f640 1 -- 172.21.15.27:0/3996576126 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bb01a8510 con 0x559bb01a35d0 2024-09-19T08:19:56.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.906+0000 7fea36620640 1 --2- 172.21.15.27:0/3996576126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01ae370 0x559bb01a7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:19:56.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.906+0000 7fea35e1f640 1 --2- 172.21.15.27:0/3996576126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a35d0 0x559bb01b6800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x559bb01a5140 tx=0x7fea2c099d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cad307661dccb605 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:56.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.906+0000 7fea197fa640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T08:19:56.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.906+0000 7fea197fa640 1 -- 172.21.15.27:0/3996576126 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c0b3020 con 0x559bb01a35d0 2024-09-19T08:19:56.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.907+0000 7fea197fa640 1 -- 172.21.15.27:0/3996576126 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fea2c0cd170 con 0x559bb01a35d0 2024-09-19T08:19:56.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.907+0000 7fea3a45c740 1 -- 172.21.15.27:0/3996576126 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea240043c0 con 0x559bb01a35d0 2024-09-19T08:19:56.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.907+0000 7fea197fa640 1 -- 172.21.15.27:0/3996576126 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fea2c020040 con 0x559bb01a35d0 2024-09-19T08:19:56.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.907+0000 7fea3a45c740 10 client.26017 fetch_fsmap learned FSMap version 20 2024-09-19T08:19:56.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.907+0000 7fea3a45c740 1 -- 172.21.15.27:0/3996576126 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559bb0228aa0 con 0x559bb01a35d0 2024-09-19T08:19:56.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.907+0000 7fea197fa640 1 -- 172.21.15.27:0/3996576126 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea240043c0 con 0x559bb01a35d0 2024-09-19T08:19:56.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.907+0000 7fea197fa640 1 -- 172.21.15.27:0/3996576126 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fea2c0860b0 con 0x559bb01a35d0 2024-09-19T08:19:56.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.907+0000 7fea3a45c740 10 client.26017 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:19:56.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.907+0000 7fea3a45c740 10 client.26017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:19:56.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.907+0000 7fea3a45c740 20 client.26017 populate_metadata read hostname 'smithi027' 2024-09-19T08:19:56.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.907+0000 7fea3a45c740 1 --2- 172.21.15.27:0/3996576126 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559bb0228d30 0x559bb022b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:56.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.907+0000 7fea3a45c740 4 client.26017 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:19:56.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.907+0000 7fea3a45c740 1 -- 172.21.15.27:0/3996576126 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559bb008d170 con 0x559bb0228d30 2024-09-19T08:19:56.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.908+0000 7fea3561e640 1 --2- 172.21.15.27:0/3996576126 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559bb0228d30 0x559bb022b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:56.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.908+0000 7fea197fa640 10 client.26017 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:56.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.908+0000 7fea3561e640 1 --2- 172.21.15.27:0/3996576126 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559bb0228d30 0x559bb022b120 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6931a62ed0a0844 server_cookie=2b1092d06debd13e in_seq=0 out_seq=0 2024-09-19T08:19:56.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.908+0000 7fea197fa640 1 -- 172.21.15.27:0/3996576126 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559bb008d170 con 0x559bb0228d30 2024-09-19T08:19:56.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.908+0000 7fea197fa640 10 client.26017 handle_command_reply: tid=0 2024-09-19T08:19:56.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.908+0000 7fea3a45c740 1 client.26017 shutdown 2024-09-19T08:19:56.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.908+0000 7fea3a45c740 1 -- 172.21.15.27:0/3996576126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a35d0 msgr2=0x559bb01b6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:56.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.908+0000 7fea3a45c740 1 --2- 172.21.15.27:0/3996576126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a35d0 0x559bb01b6800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x559bb01a5140 tx=0x7fea2c099d80 comp rx=0 tx=0).stop 2024-09-19T08:19:56.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.908+0000 7fea3a45c740 1 -- 172.21.15.27:0/3996576126 shutdown_connections 2024-09-19T08:19:56.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.908+0000 7fea3a45c740 1 --2- 172.21.15.27:0/3996576126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559bb01ae370 0x559bb01a7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.908+0000 7fea3a45c740 1 --2- 172.21.15.27:0/3996576126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559bb01a4b40 0x559bb01b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.908+0000 7fea3a45c740 1 --2- 172.21.15.27:0/3996576126 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559bb0228d30 0x559bb022b120 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.908+0000 7fea3a45c740 1 --2- 172.21.15.27:0/3996576126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559bb01a35d0 0x559bb01b6800 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.908+0000 7fea197fa640 0 client.26017 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:56.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.908+0000 7fea3a45c740 1 -- 172.21.15.27:0/3996576126 >> 172.21.15.27:0/3996576126 conn(0x559bb016c310 msgr2=0x559bb01b92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:56.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.909+0000 7fea3a45c740 1 -- 172.21.15.27:0/3996576126 shutdown_connections 2024-09-19T08:19:56.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.909+0000 7fea3a45c740 1 -- 172.21.15.27:0/3996576126 wait complete. 2024-09-19T08:19:56.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.909+0000 7fea3a45c740 20 client.26017 trim_cache size 0 max 16384 2024-09-19T08:19:56.915 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:19:56.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.909+0000 7fea38083640 1 -- 172.21.15.27:0/3476826723 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fea1c0a33b0 msgr2=0x7fea1c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:56.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.909+0000 7fea38083640 1 --2- 172.21.15.27:0/3476826723 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fea1c0a33b0 0x7fea1c0a5870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fea28005fe0 tx=0x7fea28005d80 comp rx=0 tx=0).stop 2024-09-19T08:19:56.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.909+0000 7fea38083640 1 -- 172.21.15.27:0/3476826723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea30100a80 msgr2=0x7fea30102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:56.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.909+0000 7fea38083640 1 --2- 172.21.15.27:0/3476826723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea30100a80 0x7fea30102650 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00d770 tx=0x7fea2c00dc30 comp rx=0 tx=0).stop 2024-09-19T08:19:56.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.909+0000 7fea38083640 1 -- 172.21.15.27:0/3476826723 shutdown_connections 2024-09-19T08:19:56.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.909+0000 7fea38083640 1 --2- 172.21.15.27:0/3476826723 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fea1c0a33b0 0x7fea1c0a5870 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.909+0000 7fea38083640 1 --2- 172.21.15.27:0/3476826723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea30106a80 0x7fea301030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.909+0000 7fea38083640 1 --2- 172.21.15.27:0/3476826723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea30101420 0x7fea30102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.909+0000 7fea38083640 1 --2- 172.21.15.27:0/3476826723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea30100a80 0x7fea30102650 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:56.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.909+0000 7fea38083640 1 -- 172.21.15.27:0/3476826723 >> 172.21.15.27:0/3476826723 conn(0x7fea300fc7a0 msgr2=0x7fea30104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:56.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.909+0000 7fea38083640 1 -- 172.21.15.27:0/3476826723 shutdown_connections 2024-09-19T08:19:56.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:56.909+0000 7fea38083640 1 -- 172.21.15.27:0/3476826723 wait complete. 2024-09-19T08:19:58.708 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:19:58.708 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:19:58.983 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:19:58.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:19:58 smithi155 ceph-mon[35362]: pgmap v275: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:19:59.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:19:58 smithi027 ceph-mon[31209]: pgmap v275: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:19:59.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:19:58 smithi203 ceph-mon[35198]: pgmap v275: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:19:59.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.472+0000 7fd61b101640 1 -- 172.21.15.27:0/2095100788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd614101de0 msgr2=0x7fd6141021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.472+0000 7fd61b101640 1 --2- 172.21.15.27:0/2095100788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd614101de0 0x7fd6141021c0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009900 tx=0x7fd5fc02a410 comp rx=0 tx=0).stop 2024-09-19T08:19:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.472+0000 7fd61b101640 1 -- 172.21.15.27:0/2095100788 shutdown_connections 2024-09-19T08:19:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.472+0000 7fd61b101640 1 --2- 172.21.15.27:0/2095100788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd614106f10 0x7fd61410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.472+0000 7fd61b101640 1 --2- 172.21.15.27:0/2095100788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd614102790 0x7fd6141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.472+0000 7fd61b101640 1 --2- 172.21.15.27:0/2095100788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd614101de0 0x7fd6141021c0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.472+0000 7fd61b101640 1 -- 172.21.15.27:0/2095100788 >> 172.21.15.27:0/2095100788 conn(0x7fd6140fd8c0 msgr2=0x7fd6140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.472+0000 7fd61b101640 1 -- 172.21.15.27:0/2095100788 shutdown_connections 2024-09-19T08:19:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.472+0000 7fd61b101640 1 -- 172.21.15.27:0/2095100788 wait complete. 2024-09-19T08:19:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.473+0000 7fd61b101640 1 Processor -- start 2024-09-19T08:19:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.473+0000 7fd61b101640 1 -- start start 2024-09-19T08:19:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.473+0000 7fd61b101640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd614101de0 0x7fd614198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.473+0000 7fd61b101640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd614102790 0x7fd614198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.473+0000 7fd61b101640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd614106f10 0x7fd61419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.473+0000 7fd61b101640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd614111fc0 con 0x7fd614101de0 2024-09-19T08:19:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.473+0000 7fd61b101640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd614111e40 con 0x7fd614102790 2024-09-19T08:19:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.473+0000 7fd61b101640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd614112140 con 0x7fd614106f10 2024-09-19T08:19:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.473+0000 7fd618e9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd614101de0 0x7fd614198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.473+0000 7fd618e9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd614101de0 0x7fd614198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43256/0 (socket says 172.21.15.27:43256) 2024-09-19T08:19:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.473+0000 7fd618e9d640 1 -- 172.21.15.27:0/2988770643 learned_addr learned my addr 172.21.15.27:0/2988770643 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.473+0000 7fd61969e640 1 --2- 172.21.15.27:0/2988770643 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd614106f10 0x7fd61419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.473+0000 7fd613fff640 1 --2- 172.21.15.27:0/2988770643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd614102790 0x7fd614198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.473+0000 7fd618e9d640 1 -- 172.21.15.27:0/2988770643 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd614106f10 msgr2=0x7fd61419ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:59.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.473+0000 7fd618e9d640 1 --2- 172.21.15.27:0/2988770643 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd614106f10 0x7fd61419ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.473+0000 7fd618e9d640 1 -- 172.21.15.27:0/2988770643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd614102790 msgr2=0x7fd614198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:59.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.473+0000 7fd618e9d640 1 --2- 172.21.15.27:0/2988770643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd614102790 0x7fd614198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.473+0000 7fd618e9d640 1 -- 172.21.15.27:0/2988770643 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61419d3d0 con 0x7fd614101de0 2024-09-19T08:19:59.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.473+0000 7fd613fff640 1 --2- 172.21.15.27:0/2988770643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd614102790 0x7fd614198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:19:59.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.473+0000 7fd61969e640 1 --2- 172.21.15.27:0/2988770643 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd614106f10 0x7fd61419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:19:59.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.474+0000 7fd618e9d640 1 --2- 172.21.15.27:0/2988770643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd614101de0 0x7fd614198420 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc004770 tx=0x7fd5fc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:59.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.474+0000 7fd611ffb640 1 -- 172.21.15.27:0/2988770643 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc03f070 con 0x7fd614101de0 2024-09-19T08:19:59.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.474+0000 7fd61b101640 1 -- 172.21.15.27:0/2988770643 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd61419d660 con 0x7fd614101de0 2024-09-19T08:19:59.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.474+0000 7fd611ffb640 1 -- 172.21.15.27:0/2988770643 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5fc031ca0 con 0x7fd614101de0 2024-09-19T08:19:59.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.474+0000 7fd611ffb640 1 -- 172.21.15.27:0/2988770643 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc035030 con 0x7fd614101de0 2024-09-19T08:19:59.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.474+0000 7fd61b101640 1 -- 172.21.15.27:0/2988770643 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6141a4fa0 con 0x7fd614101de0 2024-09-19T08:19:59.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.476+0000 7fd611ffb640 1 -- 172.21.15.27:0/2988770643 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fd5fc042070 con 0x7fd614101de0 2024-09-19T08:19:59.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.476+0000 7fd61d4da740 1 Processor -- start 2024-09-19T08:19:59.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd61d4da740 1 -- start start 2024-09-19T08:19:59.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd61d4da740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba57a40 0x5596fba57e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:59.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd61d4da740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba58360 0x5596fba66c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:59.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd61d4da740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba67150 0x5596fba69540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:59.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd61d4da740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5596fb9bd280 con 0x5596fba57a40 2024-09-19T08:19:59.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd61d4da740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5596fb964b10 con 0x5596fba58360 2024-09-19T08:19:59.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd61d4da740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5596fb9b9240 con 0x5596fba67150 2024-09-19T08:19:59.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd61969e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba57a40 0x5596fba57e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:59.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd61969e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba57a40 0x5596fba57e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43262/0 (socket says 172.21.15.27:43262) 2024-09-19T08:19:59.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd61969e640 1 -- 172.21.15.27:0/4136720895 learned_addr learned my addr 172.21.15.27:0/4136720895 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:59.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd611ffb640 1 --2- 172.21.15.27:0/2988770643 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd6000a33b0 0x7fd6000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:59.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd618e9d640 1 --2- 172.21.15.27:0/4136720895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba58360 0x5596fba66c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:59.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd613fff640 1 --2- 172.21.15.27:0/4136720895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba67150 0x5596fba69540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:59.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd61969e640 1 --2- 172.21.15.27:0/2988770643 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd6000a33b0 0x7fd6000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:59.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd61969e640 1 -- 172.21.15.27:0/4136720895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba67150 msgr2=0x5596fba69540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:59.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd61969e640 1 --2- 172.21.15.27:0/4136720895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba67150 0x5596fba69540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd61969e640 1 -- 172.21.15.27:0/4136720895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba58360 msgr2=0x5596fba66c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:59.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd61969e640 1 --2- 172.21.15.27:0/4136720895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba58360 0x5596fba66c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd611ffb640 1 -- 172.21.15.27:0/2988770643 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fd5fc0f0580 con 0x7fd614101de0 2024-09-19T08:19:59.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd61969e640 1 -- 172.21.15.27:0/4136720895 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596fb9711f0 con 0x5596fba57a40 2024-09-19T08:19:59.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.477+0000 7fd618e9d640 1 --2- 172.21.15.27:0/4136720895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba58360 0x5596fba66c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:19:59.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.478+0000 7fd61969e640 1 --2- 172.21.15.27:0/4136720895 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba57a40 0x5596fba57e20 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd60c013790 tx=0x7fd60c013c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1531f71fb1e726a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:59.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.478+0000 7fd60affd640 1 -- 172.21.15.27:0/4136720895 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c00bd60 con 0x5596fba57a40 2024-09-19T08:19:59.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.478+0000 7fd60affd640 1 -- 172.21.15.27:0/4136720895 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd60c004c80 con 0x5596fba57a40 2024-09-19T08:19:59.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.478+0000 7fd60affd640 1 -- 172.21.15.27:0/4136720895 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c01d650 con 0x5596fba57a40 2024-09-19T08:19:59.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.479+0000 7fd61d4da740 1 -- 172.21.15.27:0/4136720895 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba57a40 msgr2=0x5596fba57e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:59.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.479+0000 7fd61969e640 1 --2- 172.21.15.27:0/2988770643 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd6000a33b0 0x7fd6000a5870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd60c020000 tx=0x7fd60c01f000 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:59.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.479+0000 7fd61d4da740 1 --2- 172.21.15.27:0/4136720895 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba57a40 0x5596fba57e20 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd60c013790 tx=0x7fd60c013c50 comp rx=0 tx=0).stop 2024-09-19T08:19:59.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.479+0000 7fd61d4da740 1 -- 172.21.15.27:0/4136720895 shutdown_connections 2024-09-19T08:19:59.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.479+0000 7fd61d4da740 1 --2- 172.21.15.27:0/4136720895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba67150 0x5596fba69540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.479+0000 7fd61d4da740 1 --2- 172.21.15.27:0/4136720895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba58360 0x5596fba66c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.479+0000 7fd61d4da740 1 --2- 172.21.15.27:0/4136720895 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba57a40 0x5596fba57e20 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.479+0000 7fd61d4da740 1 -- 172.21.15.27:0/4136720895 >> 172.21.15.27:0/4136720895 conn(0x5596fba540f0 msgr2=0x5596fba544d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:59.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.479+0000 7fd61d4da740 1 -- 172.21.15.27:0/4136720895 shutdown_connections 2024-09-19T08:19:59.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.479+0000 7fd61d4da740 1 -- 172.21.15.27:0/4136720895 wait complete. 2024-09-19T08:19:59.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.479+0000 7fd61d4da740 1 -- start start 2024-09-19T08:19:59.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.479+0000 7fd61d4da740 1 Processor -- start 2024-09-19T08:19:59.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd61d4da740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba57a40 0x5596fba640d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:59.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd61d4da740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba58360 0x5596fba64610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:59.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd61d4da740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba67150 0x5596fba64b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:59.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd61d4da740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5596fba69d20 con 0x5596fba67150 2024-09-19T08:19:59.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd61d4da740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5596fb977f10 con 0x5596fba58360 2024-09-19T08:19:59.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd61d4da740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5596fba69ea0 con 0x5596fba57a40 2024-09-19T08:19:59.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd61d4da740 10 client.0 _ll_register_callbacks cb 0x5596fb940a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:19:59.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd61969e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba67150 0x5596fba64b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:59.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd61969e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba67150 0x5596fba64b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43276/0 (socket says 172.21.15.27:43276) 2024-09-19T08:19:59.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd61969e640 1 -- 172.21.15.27:0/828376090 learned_addr learned my addr 172.21.15.27:0/828376090 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:59.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd618e9d640 1 --2- 172.21.15.27:0/828376090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba57a40 0x5596fba640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:59.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd613fff640 1 --2- 172.21.15.27:0/828376090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba58360 0x5596fba64610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:59.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd61969e640 1 -- 172.21.15.27:0/828376090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba57a40 msgr2=0x5596fba640d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd61969e640 1 --2- 172.21.15.27:0/828376090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba57a40 0x5596fba640d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd61969e640 1 -- 172.21.15.27:0/828376090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba58360 msgr2=0x5596fba64610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd61969e640 1 --2- 172.21.15.27:0/828376090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba58360 0x5596fba64610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd61969e640 1 -- 172.21.15.27:0/828376090 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596fb72e6a0 con 0x5596fba67150 2024-09-19T08:19:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd618e9d640 1 --2- 172.21.15.27:0/828376090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba57a40 0x5596fba640d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:19:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd613fff640 1 --2- 172.21.15.27:0/828376090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba58360 0x5596fba64610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:19:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd61969e640 1 --2- 172.21.15.27:0/828376090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba67150 0x5596fba64b50 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0056f0 tx=0x7fd60c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b955cdc07ea030 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.480+0000 7fd5f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:19:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.481+0000 7fd5f3fff640 1 -- 172.21.15.27:0/828376090 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c01d3f0 con 0x5596fba67150 2024-09-19T08:19:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.481+0000 7fd5f3fff640 1 -- 172.21.15.27:0/828376090 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fd60c01d590 con 0x5596fba67150 2024-09-19T08:19:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.481+0000 7fd61d4da740 1 -- 172.21.15.27:0/828376090 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd60c004c80 con 0x5596fba67150 2024-09-19T08:19:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.481+0000 7fd5f3fff640 1 -- 172.21.15.27:0/828376090 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd60c013050 con 0x5596fba67150 2024-09-19T08:19:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.481+0000 7fd61d4da740 10 client.16770 fetch_fsmap learned FSMap version 20 2024-09-19T08:19:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.481+0000 7fd61d4da740 1 -- 172.21.15.27:0/828376090 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5596fba75a00 con 0x5596fba67150 2024-09-19T08:19:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.481+0000 7fd5f3fff640 1 -- 172.21.15.27:0/828376090 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd60c004c80 con 0x5596fba67150 2024-09-19T08:19:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.481+0000 7fd5f3fff640 1 -- 172.21.15.27:0/828376090 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd60c01db70 con 0x5596fba67150 2024-09-19T08:19:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.481+0000 7fd61d4da740 10 client.16770 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:19:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.481+0000 7fd61d4da740 10 client.16770 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:19:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.481+0000 7fd61d4da740 20 client.16770 populate_metadata read hostname 'smithi027' 2024-09-19T08:19:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.481+0000 7fd61d4da740 1 --2- 172.21.15.27:0/828376090 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5596fba76db0 0x5596fba791a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.481+0000 7fd61d4da740 4 client.16770 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:19:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.481+0000 7fd61d4da740 1 -- 172.21.15.27:0/828376090 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596fb9ca7f0 con 0x5596fba76db0 2024-09-19T08:19:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.482+0000 7fd618e9d640 1 --2- 172.21.15.27:0/828376090 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5596fba76db0 0x5596fba791a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.482+0000 7fd618e9d640 1 --2- 172.21.15.27:0/828376090 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5596fba76db0 0x5596fba791a0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a931301713fad08 server_cookie=87fdef87c0fbeab4 in_seq=0 out_seq=0 2024-09-19T08:19:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.482+0000 7fd5f3fff640 10 client.16770 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.483+0000 7fd5f3fff640 1 -- 172.21.15.27:0/828376090 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5596fb9ca7f0 con 0x5596fba76db0 2024-09-19T08:19:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.483+0000 7fd5f3fff640 10 client.16770 handle_command_reply: tid=0 2024-09-19T08:19:59.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.483+0000 7fd61d4da740 1 client.16770 shutdown 2024-09-19T08:19:59.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.483+0000 7fd61d4da740 1 -- 172.21.15.27:0/828376090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba67150 msgr2=0x5596fba64b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:59.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.483+0000 7fd61d4da740 1 --2- 172.21.15.27:0/828376090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba67150 0x5596fba64b50 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0056f0 tx=0x7fd60c005850 comp rx=0 tx=0).stop 2024-09-19T08:19:59.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.483+0000 7fd61d4da740 1 -- 172.21.15.27:0/828376090 shutdown_connections 2024-09-19T08:19:59.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.483+0000 7fd61d4da740 1 --2- 172.21.15.27:0/828376090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba67150 0x5596fba64b50 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.483+0000 7fd61d4da740 1 --2- 172.21.15.27:0/828376090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba58360 0x5596fba64610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.483+0000 7fd61d4da740 1 --2- 172.21.15.27:0/828376090 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5596fba76db0 0x5596fba791a0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.483+0000 7fd5f3fff640 0 client.16770 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:59.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.483+0000 7fd61d4da740 1 --2- 172.21.15.27:0/828376090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba57a40 0x5596fba640d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.483+0000 7fd61d4da740 1 -- 172.21.15.27:0/828376090 >> 172.21.15.27:0/828376090 conn(0x5596fba540f0 msgr2=0x5596fba59e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:59.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.483+0000 7fd61d4da740 1 -- 172.21.15.27:0/828376090 shutdown_connections 2024-09-19T08:19:59.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.483+0000 7fd61d4da740 1 -- 172.21.15.27:0/828376090 wait complete. 2024-09-19T08:19:59.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.483+0000 7fd61d4da740 20 client.16770 trim_cache size 0 max 16384 2024-09-19T08:19:59.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.500+0000 7fd61d4da740 1 Processor -- start 2024-09-19T08:19:59.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.500+0000 7fd61d4da740 1 -- start start 2024-09-19T08:19:59.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.501+0000 7fd61d4da740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba57a40 0x5596fba7e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:59.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.501+0000 7fd61d4da740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba58360 0x5596fba7edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:59.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.501+0000 7fd61d4da740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba67150 0x5596fba61330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:59.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.501+0000 7fd61d4da740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141a96c0 con 0x5596fba58360 2024-09-19T08:19:59.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.501+0000 7fd61d4da740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141abf20 con 0x5596fba57a40 2024-09-19T08:19:59.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.501+0000 7fd61d4da740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141a9d10 con 0x5596fba67150 2024-09-19T08:19:59.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.501+0000 7fd613fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba58360 0x5596fba7edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:59.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.501+0000 7fd613fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba58360 0x5596fba7edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43278/0 (socket says 172.21.15.27:43278) 2024-09-19T08:19:59.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.501+0000 7fd613fff640 1 -- 172.21.15.27:0/3923578515 learned_addr learned my addr 172.21.15.27:0/3923578515 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:59.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.501+0000 7fd618e9d640 1 --2- 172.21.15.27:0/3923578515 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba57a40 0x5596fba7e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:59.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.501+0000 7fd613fff640 1 -- 172.21.15.27:0/3923578515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba67150 msgr2=0x5596fba61330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:59.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.501+0000 7fd613fff640 1 --2- 172.21.15.27:0/3923578515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba67150 0x5596fba61330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.501+0000 7fd613fff640 1 -- 172.21.15.27:0/3923578515 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba57a40 msgr2=0x5596fba7e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:59.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.501+0000 7fd613fff640 1 --2- 172.21.15.27:0/3923578515 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba57a40 0x5596fba7e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.501+0000 7fd613fff640 1 -- 172.21.15.27:0/3923578515 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596fba58190 con 0x5596fba58360 2024-09-19T08:19:59.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.501+0000 7fd613fff640 1 --2- 172.21.15.27:0/3923578515 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba58360 0x5596fba7edd0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fd604009e10 tx=0x7fd6040127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b571b887a81b1b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:59.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.501+0000 7fd60a7fc640 1 -- 172.21.15.27:0/3923578515 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604020070 con 0x5596fba58360 2024-09-19T08:19:59.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.502+0000 7fd60a7fc640 1 -- 172.21.15.27:0/3923578515 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd60401b8f0 con 0x5596fba58360 2024-09-19T08:19:59.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.502+0000 7fd60a7fc640 1 -- 172.21.15.27:0/3923578515 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604010a10 con 0x5596fba58360 2024-09-19T08:19:59.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.502+0000 7fd61d4da740 1 -- 172.21.15.27:0/3923578515 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba58360 msgr2=0x5596fba7edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:59.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.502+0000 7fd61d4da740 1 --2- 172.21.15.27:0/3923578515 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba58360 0x5596fba7edd0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fd604009e10 tx=0x7fd6040127c0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.502+0000 7fd61d4da740 1 -- 172.21.15.27:0/3923578515 shutdown_connections 2024-09-19T08:19:59.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.502+0000 7fd61d4da740 1 --2- 172.21.15.27:0/3923578515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba67150 0x5596fba61330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.502+0000 7fd61d4da740 1 --2- 172.21.15.27:0/3923578515 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba58360 0x5596fba7edd0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.502+0000 7fd61d4da740 1 --2- 172.21.15.27:0/3923578515 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba57a40 0x5596fba7e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.502+0000 7fd61d4da740 1 -- 172.21.15.27:0/3923578515 >> 172.21.15.27:0/3923578515 conn(0x5596fba540f0 msgr2=0x5596fba66040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:59.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.502+0000 7fd61d4da740 1 -- 172.21.15.27:0/3923578515 shutdown_connections 2024-09-19T08:19:59.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.502+0000 7fd61d4da740 1 -- 172.21.15.27:0/3923578515 wait complete. 2024-09-19T08:19:59.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.503+0000 7fd61d4da740 1 -- start start 2024-09-19T08:19:59.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.503+0000 7fd61d4da740 1 Processor -- start 2024-09-19T08:19:59.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.503+0000 7fd61d4da740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba57a40 0x5596fba6ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:59.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.503+0000 7fd61d4da740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba58360 0x5596fba6b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:59.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.503+0000 7fd61d4da740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba67150 0x5596fba6b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:59.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.503+0000 7fd61d4da740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141aa3e0 con 0x5596fba67150 2024-09-19T08:19:59.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.503+0000 7fd61d4da740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141ab850 con 0x5596fba57a40 2024-09-19T08:19:59.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.503+0000 7fd61d4da740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141aaab0 con 0x5596fba58360 2024-09-19T08:19:59.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.503+0000 7fd61d4da740 10 client.0 _ll_register_callbacks cb 0x7fd60c013590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:19:59.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.503+0000 7fd61969e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba67150 0x5596fba6b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:59.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.503+0000 7fd618e9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba57a40 0x5596fba6ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:59.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.503+0000 7fd61969e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba67150 0x5596fba6b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43288/0 (socket says 172.21.15.27:43288) 2024-09-19T08:19:59.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.503+0000 7fd61969e640 1 -- 172.21.15.27:0/3114824269 learned_addr learned my addr 172.21.15.27:0/3114824269 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:19:59.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.503+0000 7fd613fff640 1 --2- 172.21.15.27:0/3114824269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba58360 0x5596fba6b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:59.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.504+0000 7fd61969e640 1 -- 172.21.15.27:0/3114824269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba58360 msgr2=0x5596fba6b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:59.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.504+0000 7fd61969e640 1 --2- 172.21.15.27:0/3114824269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba58360 0x5596fba6b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.504+0000 7fd61969e640 1 -- 172.21.15.27:0/3114824269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba57a40 msgr2=0x5596fba6ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:19:59.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.504+0000 7fd61969e640 1 --2- 172.21.15.27:0/3114824269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba57a40 0x5596fba6ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.504+0000 7fd61969e640 1 -- 172.21.15.27:0/3114824269 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596fbae0860 con 0x5596fba67150 2024-09-19T08:19:59.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.504+0000 7fd613fff640 1 --2- 172.21.15.27:0/3114824269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba58360 0x5596fba6b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:19:59.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.504+0000 7fd61969e640 1 --2- 172.21.15.27:0/3114824269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba67150 0x5596fba6b900 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0057b0 tx=0x7fd60c005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f68e73a22e5b0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:19:59.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.504+0000 7fd5f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:19:59.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.504+0000 7fd5f3fff640 1 -- 172.21.15.27:0/3114824269 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c048060 con 0x5596fba67150 2024-09-19T08:19:59.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.504+0000 7fd5f3fff640 1 -- 172.21.15.27:0/3114824269 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fd60c01d3f0 con 0x5596fba67150 2024-09-19T08:19:59.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.504+0000 7fd61d4da740 1 -- 172.21.15.27:0/3114824269 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd60401b8f0 con 0x5596fba67150 2024-09-19T08:19:59.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.504+0000 7fd5f3fff640 1 -- 172.21.15.27:0/3114824269 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd60c005540 con 0x5596fba67150 2024-09-19T08:19:59.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.504+0000 7fd61d4da740 10 client.16776 fetch_fsmap learned FSMap version 20 2024-09-19T08:19:59.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.504+0000 7fd61d4da740 1 -- 172.21.15.27:0/3114824269 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5596fbae1b80 con 0x5596fba67150 2024-09-19T08:19:59.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.504+0000 7fd5f3fff640 1 -- 172.21.15.27:0/3114824269 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd60401b8f0 con 0x5596fba67150 2024-09-19T08:19:59.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.504+0000 7fd5f3fff640 1 -- 172.21.15.27:0/3114824269 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd60c004680 con 0x5596fba67150 2024-09-19T08:19:59.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.505+0000 7fd61d4da740 10 client.16776 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:19:59.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.505+0000 7fd61d4da740 10 client.16776 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:19:59.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.505+0000 7fd61d4da740 20 client.16776 populate_metadata read hostname 'smithi027' 2024-09-19T08:19:59.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.505+0000 7fd61d4da740 1 --2- 172.21.15.27:0/3114824269 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5596fbae2230 0x5596fbae4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:19:59.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.505+0000 7fd61d4da740 4 client.16776 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:19:59.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.505+0000 7fd61d4da740 1 -- 172.21.15.27:0/3114824269 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5596fb9c4d00 con 0x5596fbae2230 2024-09-19T08:19:59.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.505+0000 7fd618e9d640 1 --2- 172.21.15.27:0/3114824269 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5596fbae2230 0x5596fbae4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:19:59.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.505+0000 7fd618e9d640 1 --2- 172.21.15.27:0/3114824269 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5596fbae2230 0x5596fbae4620 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e10f912305c8961c server_cookie=6650092907d4520b in_seq=0 out_seq=0 2024-09-19T08:19:59.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.505+0000 7fd5f3fff640 10 client.16776 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:59.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.506+0000 7fd5f3fff640 1 -- 172.21.15.27:0/3114824269 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5596fb9c4d00 con 0x5596fbae2230 2024-09-19T08:19:59.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.506+0000 7fd5f3fff640 10 client.16776 handle_command_reply: tid=0 2024-09-19T08:19:59.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.506+0000 7fd61d4da740 1 client.16776 shutdown 2024-09-19T08:19:59.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.506+0000 7fd61d4da740 1 -- 172.21.15.27:0/3114824269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba67150 msgr2=0x5596fba6b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:59.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.506+0000 7fd61d4da740 1 --2- 172.21.15.27:0/3114824269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba67150 0x5596fba6b900 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0057b0 tx=0x7fd60c005bf0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.507+0000 7fd61d4da740 1 -- 172.21.15.27:0/3114824269 shutdown_connections 2024-09-19T08:19:59.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.507+0000 7fd61d4da740 1 --2- 172.21.15.27:0/3114824269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fba67150 0x5596fba6b900 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.507+0000 7fd61d4da740 1 --2- 172.21.15.27:0/3114824269 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x5596fbae2230 0x5596fbae4620 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.507+0000 7fd61d4da740 1 --2- 172.21.15.27:0/3114824269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596fba58360 0x5596fba6b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.507+0000 7fd61d4da740 1 --2- 172.21.15.27:0/3114824269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596fba57a40 0x5596fba6ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.507+0000 7fd5f3fff640 0 client.16776 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:19:59.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.507+0000 7fd61d4da740 1 -- 172.21.15.27:0/3114824269 >> 172.21.15.27:0/3114824269 conn(0x5596fba540f0 msgr2=0x5596fba59550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:59.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.507+0000 7fd61d4da740 1 -- 172.21.15.27:0/3114824269 shutdown_connections 2024-09-19T08:19:59.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.507+0000 7fd61d4da740 1 -- 172.21.15.27:0/3114824269 wait complete. 2024-09-19T08:19:59.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.507+0000 7fd61d4da740 20 client.16776 trim_cache size 0 max 16384 2024-09-19T08:19:59.512 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:19:59.513 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:19:59.513 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "1df9ef22-9789-4f9c-a5ed-25c73076e964", 2024-09-19T08:19:59.513 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:19:59.513 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:19:59.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.507+0000 7fd61b101640 1 -- 172.21.15.27:0/2988770643 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd6000a33b0 msgr2=0x7fd6000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:59.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.507+0000 7fd61b101640 1 --2- 172.21.15.27:0/2988770643 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd6000a33b0 0x7fd6000a5870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd60c020000 tx=0x7fd60c01f000 comp rx=0 tx=0).stop 2024-09-19T08:19:59.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.507+0000 7fd61b101640 1 -- 172.21.15.27:0/2988770643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd614101de0 msgr2=0x7fd614198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:19:59.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.507+0000 7fd61b101640 1 --2- 172.21.15.27:0/2988770643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd614101de0 0x7fd614198420 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc004770 tx=0x7fd5fc003c10 comp rx=0 tx=0).stop 2024-09-19T08:19:59.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.508+0000 7fd61b101640 1 -- 172.21.15.27:0/2988770643 shutdown_connections 2024-09-19T08:19:59.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.508+0000 7fd61b101640 1 --2- 172.21.15.27:0/2988770643 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd6000a33b0 0x7fd6000a5870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.508+0000 7fd61b101640 1 --2- 172.21.15.27:0/2988770643 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd614106f10 0x7fd61419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.508+0000 7fd61b101640 1 --2- 172.21.15.27:0/2988770643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd614102790 0x7fd614198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.508+0000 7fd61b101640 1 --2- 172.21.15.27:0/2988770643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd614101de0 0x7fd614198420 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:19:59.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.508+0000 7fd61b101640 1 -- 172.21.15.27:0/2988770643 >> 172.21.15.27:0/2988770643 conn(0x7fd6140fd8c0 msgr2=0x7fd6140feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:19:59.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.508+0000 7fd61b101640 1 -- 172.21.15.27:0/2988770643 shutdown_connections 2024-09-19T08:19:59.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:19:59.508+0000 7fd61b101640 1 -- 172.21.15.27:0/2988770643 wait complete. 2024-09-19T08:20:00.348 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:20:00.607 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:20:00.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:00 smithi027 ceph-mon[31209]: pgmap v276: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:00.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:00 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:20:00.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:00 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:20:00.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:00 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:20:00.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:00 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:20:00.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:00 smithi027 ceph-mon[31209]: overall HEALTH_OK 2024-09-19T08:20:00.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:00 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:20:00.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:00 smithi155 ceph-mon[35362]: pgmap v276: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:00.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:00 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:20:00.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:00 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:20:00.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:00 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:20:00.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:00 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:20:00.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:00 smithi155 ceph-mon[35362]: overall HEALTH_OK 2024-09-19T08:20:00.988 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:00 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:20:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:00 smithi203 ceph-mon[35198]: pgmap v276: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:00 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:20:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:00 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:20:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:00 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:20:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:00 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:20:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:00 smithi203 ceph-mon[35198]: overall HEALTH_OK 2024-09-19T08:20:01.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:00 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:20:01.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.128+0000 7fef90dc1640 1 -- 172.21.15.27:0/1961044149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef8c101420 msgr2=0x7fef8c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:01.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.128+0000 7fef90dc1640 1 --2- 172.21.15.27:0/1961044149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef8c101420 0x7fef8c10d950 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fef84009930 tx=0x7fef8402a420 comp rx=0 tx=0).stop 2024-09-19T08:20:01.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.128+0000 7fef90dc1640 1 -- 172.21.15.27:0/1961044149 shutdown_connections 2024-09-19T08:20:01.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.128+0000 7fef90dc1640 1 --2- 172.21.15.27:0/1961044149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef8c101420 0x7fef8c10d950 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.128+0000 7fef90dc1640 1 --2- 172.21.15.27:0/1961044149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef8c100a80 0x7fef8c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.128+0000 7fef90dc1640 1 --2- 172.21.15.27:0/1961044149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef8c106a80 0x7fef8c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.128+0000 7fef90dc1640 1 -- 172.21.15.27:0/1961044149 >> 172.21.15.27:0/1961044149 conn(0x7fef8c0fc7a0 msgr2=0x7fef8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:01.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.128+0000 7fef90dc1640 1 -- 172.21.15.27:0/1961044149 shutdown_connections 2024-09-19T08:20:01.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.128+0000 7fef90dc1640 1 -- 172.21.15.27:0/1961044149 wait complete. 2024-09-19T08:20:01.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.129+0000 7fef90dc1640 1 Processor -- start 2024-09-19T08:20:01.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.129+0000 7fef90dc1640 1 -- start start 2024-09-19T08:20:01.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.129+0000 7fef90dc1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef8c100a80 0x7fef8c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:01.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.129+0000 7fef90dc1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef8c101420 0x7fef8c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:01.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.129+0000 7fef90dc1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef8c106a80 0x7fef8c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:01.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.129+0000 7fef90dc1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c110ea0 con 0x7fef8c100a80 2024-09-19T08:20:01.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.129+0000 7fef90dc1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c110d20 con 0x7fef8c101420 2024-09-19T08:20:01.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.129+0000 7fef90dc1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c111020 con 0x7fef8c106a80 2024-09-19T08:20:01.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.129+0000 7fef8a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef8c100a80 0x7fef8c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:01.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.129+0000 7fef8a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef8c100a80 0x7fef8c198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42126/0 (socket says 172.21.15.27:42126) 2024-09-19T08:20:01.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.129+0000 7fef8a59c640 1 -- 172.21.15.27:0/812513275 learned_addr learned my addr 172.21.15.27:0/812513275 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:01.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.129+0000 7fef89d9b640 1 --2- 172.21.15.27:0/812513275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef8c101420 0x7fef8c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:01.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.129+0000 7fef8ad9d640 1 --2- 172.21.15.27:0/812513275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef8c106a80 0x7fef8c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:01.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.130+0000 7fef8a59c640 1 -- 172.21.15.27:0/812513275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef8c106a80 msgr2=0x7fef8c19cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:01.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.130+0000 7fef8a59c640 1 --2- 172.21.15.27:0/812513275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef8c106a80 0x7fef8c19cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.130+0000 7fef8a59c640 1 -- 172.21.15.27:0/812513275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef8c101420 msgr2=0x7fef8c1989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:01.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.130+0000 7fef8a59c640 1 --2- 172.21.15.27:0/812513275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef8c101420 0x7fef8c1989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.130+0000 7fef8a59c640 1 -- 172.21.15.27:0/812513275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8c19d430 con 0x7fef8c100a80 2024-09-19T08:20:01.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.130+0000 7fef89d9b640 1 --2- 172.21.15.27:0/812513275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef8c101420 0x7fef8c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:20:01.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.130+0000 7fef8ad9d640 1 --2- 172.21.15.27:0/812513275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef8c106a80 0x7fef8c19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:20:01.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.130+0000 7fef8a59c640 1 --2- 172.21.15.27:0/812513275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef8c100a80 0x7fef8c198480 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fef7c00b4a0 tx=0x7fef7c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:01.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.130+0000 7fef7b7fe640 1 -- 172.21.15.27:0/812513275 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c014070 con 0x7fef8c100a80 2024-09-19T08:20:01.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.130+0000 7fef90dc1640 1 -- 172.21.15.27:0/812513275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef8c19d720 con 0x7fef8c100a80 2024-09-19T08:20:01.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.130+0000 7fef7b7fe640 1 -- 172.21.15.27:0/812513275 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef7c010af0 con 0x7fef8c100a80 2024-09-19T08:20:01.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.130+0000 7fef7b7fe640 1 -- 172.21.15.27:0/812513275 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c017d10 con 0x7fef8c100a80 2024-09-19T08:20:01.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.130+0000 7fef90dc1640 1 -- 172.21.15.27:0/812513275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef8c1a5000 con 0x7fef8c100a80 2024-09-19T08:20:01.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.132+0000 7fef7b7fe640 1 -- 172.21.15.27:0/812513275 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fef7c017070 con 0x7fef8c100a80 2024-09-19T08:20:01.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.133+0000 7fef9319a740 1 Processor -- start 2024-09-19T08:20:01.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.133+0000 7fef9319a740 1 -- start start 2024-09-19T08:20:01.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.133+0000 7fef9319a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36380 0x558b48b36760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:01.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.133+0000 7fef9319a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b36ca0 0x558b48b45550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:01.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.133+0000 7fef9319a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b45a90 0x558b48b47e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:01.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.133+0000 7fef9319a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x558b48a9c2e0 con 0x558b48b36380 2024-09-19T08:20:01.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.133+0000 7fef9319a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558b48a43ce0 con 0x558b48b45a90 2024-09-19T08:20:01.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.133+0000 7fef9319a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558b48a982a0 con 0x558b48b36ca0 2024-09-19T08:20:01.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.133+0000 7fef7b7fe640 1 --2- 172.21.15.27:0/812513275 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fef740a33b0 0x7fef740a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:01.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.133+0000 7fef8ad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36380 0x558b48b36760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:01.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.133+0000 7fef8ad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36380 0x558b48b36760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42136/0 (socket says 172.21.15.27:42136) 2024-09-19T08:20:01.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.133+0000 7fef8ad9d640 1 -- 172.21.15.27:0/4049069313 learned_addr learned my addr 172.21.15.27:0/4049069313 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:01.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.133+0000 7fef8a59c640 1 --2- 172.21.15.27:0/4049069313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b36ca0 0x558b48b45550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:01.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.134+0000 7fef8ad9d640 1 --2- 172.21.15.27:0/812513275 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fef740a33b0 0x7fef740a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:01.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.134+0000 7fef89d9b640 1 --2- 172.21.15.27:0/4049069313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b45a90 0x558b48b47e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:01.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.134+0000 7fef7b7fe640 1 -- 172.21.15.27:0/812513275 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fef7c0cf070 con 0x7fef8c100a80 2024-09-19T08:20:01.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.134+0000 7fef8ad9d640 1 -- 172.21.15.27:0/4049069313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b36ca0 msgr2=0x558b48b45550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:01.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.134+0000 7fef8ad9d640 1 --2- 172.21.15.27:0/4049069313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b36ca0 0x558b48b45550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.134+0000 7fef8ad9d640 1 -- 172.21.15.27:0/4049069313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b45a90 msgr2=0x558b48b47e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:01.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.134+0000 7fef8ad9d640 1 --2- 172.21.15.27:0/4049069313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b45a90 0x558b48b47e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.134+0000 7fef8ad9d640 1 -- 172.21.15.27:0/4049069313 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b48a28440 con 0x558b48b36380 2024-09-19T08:20:01.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.134+0000 7fef8ad9d640 1 --2- 172.21.15.27:0/4049069313 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36380 0x558b48b36760 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fef84005ec0 tx=0x7fef840044f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfe644118d848eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:01.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.134+0000 7fef8ad9d640 1 --2- 172.21.15.27:0/812513275 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fef740a33b0 0x7fef740a5870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fef84031550 tx=0x7fef84046000 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:01.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.134+0000 7fef78ff9640 1 -- 172.21.15.27:0/4049069313 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef84035030 con 0x558b48b36380 2024-09-19T08:20:01.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.134+0000 7fef78ff9640 1 -- 172.21.15.27:0/4049069313 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef8404d070 con 0x558b48b36380 2024-09-19T08:20:01.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.134+0000 7fef78ff9640 1 -- 172.21.15.27:0/4049069313 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef840049a0 con 0x558b48b36380 2024-09-19T08:20:01.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.135+0000 7fef9319a740 1 -- 172.21.15.27:0/4049069313 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36380 msgr2=0x558b48b36760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:01.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.135+0000 7fef9319a740 1 --2- 172.21.15.27:0/4049069313 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36380 0x558b48b36760 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fef84005ec0 tx=0x7fef840044f0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.135+0000 7fef9319a740 1 -- 172.21.15.27:0/4049069313 shutdown_connections 2024-09-19T08:20:01.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.135+0000 7fef9319a740 1 --2- 172.21.15.27:0/4049069313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b45a90 0x558b48b47e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.135+0000 7fef9319a740 1 --2- 172.21.15.27:0/4049069313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b36ca0 0x558b48b45550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.135+0000 7fef9319a740 1 --2- 172.21.15.27:0/4049069313 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36380 0x558b48b36760 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.135+0000 7fef9319a740 1 -- 172.21.15.27:0/4049069313 >> 172.21.15.27:0/4049069313 conn(0x558b48b32a30 msgr2=0x558b48b32e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:01.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.135+0000 7fef9319a740 1 -- 172.21.15.27:0/4049069313 shutdown_connections 2024-09-19T08:20:01.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.135+0000 7fef9319a740 1 -- 172.21.15.27:0/4049069313 wait complete. 2024-09-19T08:20:01.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.135+0000 7fef9319a740 1 -- start start 2024-09-19T08:20:01.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.135+0000 7fef9319a740 1 Processor -- start 2024-09-19T08:20:01.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef9319a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b36380 0x558b48b45450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:01.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef9319a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36ca0 0x558b48b42750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:01.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef9319a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b45a90 0x558b48b42db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:01.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef9319a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x558b48b48660 con 0x558b48b36ca0 2024-09-19T08:20:01.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef9319a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558b48a57050 con 0x558b48b36380 2024-09-19T08:20:01.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef9319a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558b48b487e0 con 0x558b48b45a90 2024-09-19T08:20:01.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef9319a740 10 client.0 _ll_register_callbacks cb 0x558b48a97160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:20:01.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef89d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36ca0 0x558b48b42750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:01.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef89d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36ca0 0x558b48b42750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42152/0 (socket says 172.21.15.27:42152) 2024-09-19T08:20:01.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef89d9b640 1 -- 172.21.15.27:0/1181437254 learned_addr learned my addr 172.21.15.27:0/1181437254 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:01.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef8a59c640 1 --2- 172.21.15.27:0/1181437254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b36380 0x558b48b45450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:01.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef8ad9d640 1 --2- 172.21.15.27:0/1181437254 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b45a90 0x558b48b42db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:01.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef89d9b640 1 -- 172.21.15.27:0/1181437254 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b45a90 msgr2=0x558b48b42db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:01.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef89d9b640 1 --2- 172.21.15.27:0/1181437254 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b45a90 0x558b48b42db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef89d9b640 1 -- 172.21.15.27:0/1181437254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b36380 msgr2=0x558b48b45450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:01.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef89d9b640 1 --2- 172.21.15.27:0/1181437254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b36380 0x558b48b45450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef89d9b640 1 -- 172.21.15.27:0/1181437254 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b4880d3c0 con 0x558b48b36ca0 2024-09-19T08:20:01.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef8a59c640 1 --2- 172.21.15.27:0/1181437254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b36380 0x558b48b45450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:20:01.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef89d9b640 1 --2- 172.21.15.27:0/1181437254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36ca0 0x558b48b42750 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fef80011ab0 tx=0x7fef80011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279c48e46c7aab7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:01.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:20:01.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.136+0000 7fef71ffb640 1 -- 172.21.15.27:0/1181437254 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80004b20 con 0x558b48b36ca0 2024-09-19T08:20:01.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.137+0000 7fef71ffb640 1 -- 172.21.15.27:0/1181437254 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fef80004cc0 con 0x558b48b36ca0 2024-09-19T08:20:01.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.137+0000 7fef9319a740 1 -- 172.21.15.27:0/1181437254 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef8404d070 con 0x558b48b36ca0 2024-09-19T08:20:01.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.137+0000 7fef71ffb640 1 -- 172.21.15.27:0/1181437254 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fef80003970 con 0x558b48b36ca0 2024-09-19T08:20:01.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.137+0000 7fef9319a740 10 client.16788 fetch_fsmap learned FSMap version 20 2024-09-19T08:20:01.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.137+0000 7fef9319a740 1 -- 172.21.15.27:0/1181437254 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558b48b54160 con 0x558b48b36ca0 2024-09-19T08:20:01.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.137+0000 7fef71ffb640 1 -- 172.21.15.27:0/1181437254 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef8404d070 con 0x558b48b36ca0 2024-09-19T08:20:01.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.137+0000 7fef71ffb640 1 -- 172.21.15.27:0/1181437254 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fef80020070 con 0x558b48b36ca0 2024-09-19T08:20:01.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.137+0000 7fef9319a740 10 client.16788 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:20:01.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.137+0000 7fef9319a740 10 client.16788 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:20:01.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.137+0000 7fef9319a740 20 client.16788 populate_metadata read hostname 'smithi027' 2024-09-19T08:20:01.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.137+0000 7fef9319a740 1 --2- 172.21.15.27:0/1181437254 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558b48b55620 0x558b48b57ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:01.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.137+0000 7fef9319a740 4 client.16788 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:20:01.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.137+0000 7fef9319a740 1 -- 172.21.15.27:0/1181437254 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b48aa9850 con 0x558b48b55620 2024-09-19T08:20:01.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.137+0000 7fef8a59c640 1 --2- 172.21.15.27:0/1181437254 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558b48b55620 0x558b48b57ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:01.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.138+0000 7fef71ffb640 10 client.16788 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:01.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.138+0000 7fef8a59c640 1 --2- 172.21.15.27:0/1181437254 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558b48b55620 0x558b48b57ac0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6878e11e0e5b3bf server_cookie=ab68575170daaf12 in_seq=0 out_seq=0 2024-09-19T08:20:01.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.138+0000 7fef71ffb640 1 -- 172.21.15.27:0/1181437254 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b48aa9850 con 0x558b48b55620 2024-09-19T08:20:01.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.138+0000 7fef71ffb640 10 client.16788 handle_command_reply: tid=0 2024-09-19T08:20:01.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.139+0000 7fef9319a740 1 client.16788 shutdown 2024-09-19T08:20:01.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.139+0000 7fef9319a740 1 -- 172.21.15.27:0/1181437254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36ca0 msgr2=0x558b48b42750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:01.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.139+0000 7fef9319a740 1 --2- 172.21.15.27:0/1181437254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36ca0 0x558b48b42750 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fef80011ab0 tx=0x7fef80011f70 comp rx=0 tx=0).stop 2024-09-19T08:20:01.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.139+0000 7fef9319a740 1 -- 172.21.15.27:0/1181437254 shutdown_connections 2024-09-19T08:20:01.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.139+0000 7fef9319a740 1 --2- 172.21.15.27:0/1181437254 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558b48b55620 0x558b48b57ac0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.139+0000 7fef9319a740 1 --2- 172.21.15.27:0/1181437254 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b45a90 0x558b48b42db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.139+0000 7fef9319a740 1 --2- 172.21.15.27:0/1181437254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36ca0 0x558b48b42750 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.139+0000 7fef9319a740 1 --2- 172.21.15.27:0/1181437254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b36380 0x558b48b45450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.139+0000 7fef71ffb640 0 client.16788 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:01.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.139+0000 7fef9319a740 1 -- 172.21.15.27:0/1181437254 >> 172.21.15.27:0/1181437254 conn(0x558b48b32a30 msgr2=0x558b48b38790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:01.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.139+0000 7fef9319a740 1 -- 172.21.15.27:0/1181437254 shutdown_connections 2024-09-19T08:20:01.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.139+0000 7fef9319a740 1 -- 172.21.15.27:0/1181437254 wait complete. 2024-09-19T08:20:01.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.139+0000 7fef9319a740 20 client.16788 trim_cache size 0 max 16384 2024-09-19T08:20:01.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.156+0000 7fef9319a740 1 Processor -- start 2024-09-19T08:20:01.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.156+0000 7fef9319a740 1 -- start start 2024-09-19T08:20:01.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.156+0000 7fef9319a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b36380 0x558b48b51900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:01.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.156+0000 7fef9319a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b36ca0 0x558b48b5d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:01.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.156+0000 7fef9319a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b45a90 0x558b48b5d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:01.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.156+0000 7fef9319a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c1a9680 con 0x558b48b45a90 2024-09-19T08:20:01.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.156+0000 7fef9319a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c1abee0 con 0x558b48b36ca0 2024-09-19T08:20:01.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.156+0000 7fef9319a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c1a9cd0 con 0x558b48b36380 2024-09-19T08:20:01.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.156+0000 7fef8ad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b45a90 0x558b48b5d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:01.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.156+0000 7fef8ad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b45a90 0x558b48b5d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42160/0 (socket says 172.21.15.27:42160) 2024-09-19T08:20:01.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.156+0000 7fef8ad9d640 1 -- 172.21.15.27:0/1348201994 learned_addr learned my addr 172.21.15.27:0/1348201994 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:01.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.156+0000 7fef89d9b640 1 --2- 172.21.15.27:0/1348201994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b36ca0 0x558b48b5d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:01.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.156+0000 7fef8a59c640 1 --2- 172.21.15.27:0/1348201994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b36380 0x558b48b51900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:01.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.156+0000 7fef8ad9d640 1 -- 172.21.15.27:0/1348201994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b36380 msgr2=0x558b48b51900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:01.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.157+0000 7fef8ad9d640 1 --2- 172.21.15.27:0/1348201994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b36380 0x558b48b51900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.157+0000 7fef8ad9d640 1 -- 172.21.15.27:0/1348201994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b36ca0 msgr2=0x558b48b5d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:01.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.157+0000 7fef8ad9d640 1 --2- 172.21.15.27:0/1348201994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b36ca0 0x558b48b5d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.157+0000 7fef8ad9d640 1 -- 172.21.15.27:0/1348201994 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b48b41700 con 0x558b48b45a90 2024-09-19T08:20:01.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.157+0000 7fef8a59c640 1 --2- 172.21.15.27:0/1348201994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b36380 0x558b48b51900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:20:01.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.157+0000 7fef89d9b640 1 --2- 172.21.15.27:0/1348201994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b36ca0 0x558b48b5d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:20:01.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.157+0000 7fef8ad9d640 1 --2- 172.21.15.27:0/1348201994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b45a90 0x558b48b5d8d0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fef84009800 tx=0x7fef840317d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754ea252a5cce3eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:01.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.157+0000 7fef73fff640 1 -- 172.21.15.27:0/1348201994 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef84055030 con 0x558b48b45a90 2024-09-19T08:20:01.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.157+0000 7fef73fff640 1 -- 172.21.15.27:0/1348201994 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef8404d050 con 0x558b48b45a90 2024-09-19T08:20:01.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.157+0000 7fef73fff640 1 -- 172.21.15.27:0/1348201994 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef84035040 con 0x558b48b45a90 2024-09-19T08:20:01.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.158+0000 7fef9319a740 1 -- 172.21.15.27:0/1348201994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b45a90 msgr2=0x558b48b5d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:01.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.158+0000 7fef9319a740 1 --2- 172.21.15.27:0/1348201994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b45a90 0x558b48b5d8d0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fef84009800 tx=0x7fef840317d0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.158+0000 7fef9319a740 1 -- 172.21.15.27:0/1348201994 shutdown_connections 2024-09-19T08:20:01.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.158+0000 7fef9319a740 1 --2- 172.21.15.27:0/1348201994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b45a90 0x558b48b5d8d0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.158+0000 7fef9319a740 1 --2- 172.21.15.27:0/1348201994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b36ca0 0x558b48b5d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.158+0000 7fef9319a740 1 --2- 172.21.15.27:0/1348201994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b36380 0x558b48b51900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.158+0000 7fef9319a740 1 -- 172.21.15.27:0/1348201994 >> 172.21.15.27:0/1348201994 conn(0x558b48b32a30 msgr2=0x558b48b3dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:01.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.158+0000 7fef9319a740 1 -- 172.21.15.27:0/1348201994 shutdown_connections 2024-09-19T08:20:01.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.158+0000 7fef9319a740 1 -- 172.21.15.27:0/1348201994 wait complete. 2024-09-19T08:20:01.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.158+0000 7fef9319a740 1 -- start start 2024-09-19T08:20:01.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.158+0000 7fef9319a740 1 Processor -- start 2024-09-19T08:20:01.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.158+0000 7fef9319a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36380 0x558b48b497c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:01.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.158+0000 7fef9319a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b36ca0 0x558b48b49d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:01.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.158+0000 7fef9319a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b45a90 0x558b48b4a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:01.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.158+0000 7fef9319a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c1aa3a0 con 0x558b48b36380 2024-09-19T08:20:01.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.158+0000 7fef9319a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c1ab810 con 0x558b48b36ca0 2024-09-19T08:20:01.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.158+0000 7fef9319a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c1aaa70 con 0x558b48b45a90 2024-09-19T08:20:01.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.158+0000 7fef9319a740 10 client.0 _ll_register_callbacks cb 0x7fef80007ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:20:01.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.159+0000 7fef8a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36380 0x558b48b497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:01.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.159+0000 7fef8a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36380 0x558b48b497c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42170/0 (socket says 172.21.15.27:42170) 2024-09-19T08:20:01.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.159+0000 7fef8a59c640 1 -- 172.21.15.27:0/1179281222 learned_addr learned my addr 172.21.15.27:0/1179281222 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:01.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.159+0000 7fef8ad9d640 1 --2- 172.21.15.27:0/1179281222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b45a90 0x558b48b4a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:01.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.159+0000 7fef89d9b640 1 --2- 172.21.15.27:0/1179281222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b36ca0 0x558b48b49d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:01.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.159+0000 7fef8a59c640 1 -- 172.21.15.27:0/1179281222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b45a90 msgr2=0x558b48b4a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:01.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.159+0000 7fef8a59c640 1 --2- 172.21.15.27:0/1179281222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b45a90 0x558b48b4a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.159+0000 7fef8a59c640 1 -- 172.21.15.27:0/1179281222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b36ca0 msgr2=0x558b48b49d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:01.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.159+0000 7fef8a59c640 1 --2- 172.21.15.27:0/1179281222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b36ca0 0x558b48b49d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.159+0000 7fef8a59c640 1 -- 172.21.15.27:0/1179281222 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b48b36ad0 con 0x558b48b36380 2024-09-19T08:20:01.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.159+0000 7fef8ad9d640 1 --2- 172.21.15.27:0/1179281222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b45a90 0x558b48b4a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:20:01.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.159+0000 7fef89d9b640 1 --2- 172.21.15.27:0/1179281222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b36ca0 0x558b48b49d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:20:01.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.159+0000 7fef8a59c640 1 --2- 172.21.15.27:0/1179281222 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36380 0x558b48b497c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0978e0 tx=0x7fef7c06b0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b3bc8bd5712fe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:01.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.159+0000 7fef71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:20:01.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.159+0000 7fef71ffb640 1 -- 172.21.15.27:0/1179281222 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c084060 con 0x558b48b36380 2024-09-19T08:20:01.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.159+0000 7fef71ffb640 1 -- 172.21.15.27:0/1179281222 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fef7c010ca0 con 0x558b48b36380 2024-09-19T08:20:01.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.159+0000 7fef9319a740 1 -- 172.21.15.27:0/1179281222 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef8404d050 con 0x558b48b36380 2024-09-19T08:20:01.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.159+0000 7fef71ffb640 1 -- 172.21.15.27:0/1179281222 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fef7c01e040 con 0x558b48b36380 2024-09-19T08:20:01.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.159+0000 7fef9319a740 10 client.16794 fetch_fsmap learned FSMap version 20 2024-09-19T08:20:01.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.159+0000 7fef9319a740 1 -- 172.21.15.27:0/1179281222 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558b48bc03f0 con 0x558b48b36380 2024-09-19T08:20:01.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.160+0000 7fef71ffb640 1 -- 172.21.15.27:0/1179281222 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef8404d050 con 0x558b48b36380 2024-09-19T08:20:01.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.160+0000 7fef71ffb640 1 -- 172.21.15.27:0/1179281222 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fef7c0cca60 con 0x558b48b36380 2024-09-19T08:20:01.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.160+0000 7fef9319a740 10 client.16794 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:20:01.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.160+0000 7fef9319a740 10 client.16794 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:20:01.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.160+0000 7fef9319a740 20 client.16794 populate_metadata read hostname 'smithi027' 2024-09-19T08:20:01.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.160+0000 7fef9319a740 1 --2- 172.21.15.27:0/1179281222 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558b48bc0ac0 0x558b48bc2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:01.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.160+0000 7fef9319a740 4 client.16794 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:20:01.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.160+0000 7fef9319a740 1 -- 172.21.15.27:0/1179281222 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558b48aa3d60 con 0x558b48bc0ac0 2024-09-19T08:20:01.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.160+0000 7fef89d9b640 1 --2- 172.21.15.27:0/1179281222 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558b48bc0ac0 0x558b48bc2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:01.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.161+0000 7fef71ffb640 10 client.16794 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:01.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.161+0000 7fef89d9b640 1 --2- 172.21.15.27:0/1179281222 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558b48bc0ac0 0x558b48bc2ee0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d480fc5bee6f710f server_cookie=e5c2319749865875 in_seq=0 out_seq=0 2024-09-19T08:20:01.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.161+0000 7fef71ffb640 1 -- 172.21.15.27:0/1179281222 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558b48aa3d60 con 0x558b48bc0ac0 2024-09-19T08:20:01.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.161+0000 7fef71ffb640 10 client.16794 handle_command_reply: tid=0 2024-09-19T08:20:01.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.161+0000 7fef9319a740 1 client.16794 shutdown 2024-09-19T08:20:01.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.161+0000 7fef9319a740 1 -- 172.21.15.27:0/1179281222 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36380 msgr2=0x558b48b497c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:01.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.161+0000 7fef9319a740 1 --2- 172.21.15.27:0/1179281222 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36380 0x558b48b497c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0978e0 tx=0x7fef7c06b0a0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.161+0000 7fef9319a740 1 -- 172.21.15.27:0/1179281222 shutdown_connections 2024-09-19T08:20:01.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.161+0000 7fef9319a740 1 --2- 172.21.15.27:0/1179281222 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x558b48bc0ac0 0x558b48bc2ee0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.161+0000 7fef9319a740 1 --2- 172.21.15.27:0/1179281222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b48b45a90 0x558b48b4a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.161+0000 7fef9319a740 1 --2- 172.21.15.27:0/1179281222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b48b36ca0 0x558b48b49d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.161+0000 7fef9319a740 1 --2- 172.21.15.27:0/1179281222 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558b48b36380 0x558b48b497c0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.161+0000 7fef9319a740 1 -- 172.21.15.27:0/1179281222 >> 172.21.15.27:0/1179281222 conn(0x558b48b32a30 msgr2=0x558b48b31350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:01.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.161+0000 7fef71ffb640 0 client.16794 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:01.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.161+0000 7fef9319a740 1 -- 172.21.15.27:0/1179281222 shutdown_connections 2024-09-19T08:20:01.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.161+0000 7fef9319a740 1 -- 172.21.15.27:0/1179281222 wait complete. 2024-09-19T08:20:01.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.161+0000 7fef9319a740 20 client.16794 trim_cache size 0 max 16384 2024-09-19T08:20:01.169 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:20:01.169 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:20:01.169 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:20:01.169 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:20:01.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.162+0000 7fef90dc1640 1 -- 172.21.15.27:0/812513275 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fef740a33b0 msgr2=0x7fef740a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:01.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.162+0000 7fef90dc1640 1 --2- 172.21.15.27:0/812513275 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fef740a33b0 0x7fef740a5870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fef84031550 tx=0x7fef84046000 comp rx=0 tx=0).stop 2024-09-19T08:20:01.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.162+0000 7fef90dc1640 1 -- 172.21.15.27:0/812513275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef8c100a80 msgr2=0x7fef8c198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:01.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.162+0000 7fef90dc1640 1 --2- 172.21.15.27:0/812513275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef8c100a80 0x7fef8c198480 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fef7c00b4a0 tx=0x7fef7c00b960 comp rx=0 tx=0).stop 2024-09-19T08:20:01.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.162+0000 7fef90dc1640 1 -- 172.21.15.27:0/812513275 shutdown_connections 2024-09-19T08:20:01.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.162+0000 7fef90dc1640 1 --2- 172.21.15.27:0/812513275 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fef740a33b0 0x7fef740a5870 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.162+0000 7fef90dc1640 1 --2- 172.21.15.27:0/812513275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef8c106a80 0x7fef8c19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.162+0000 7fef90dc1640 1 --2- 172.21.15.27:0/812513275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef8c101420 0x7fef8c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.162+0000 7fef90dc1640 1 --2- 172.21.15.27:0/812513275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef8c100a80 0x7fef8c198480 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:01.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.162+0000 7fef90dc1640 1 -- 172.21.15.27:0/812513275 >> 172.21.15.27:0/812513275 conn(0x7fef8c0fc7a0 msgr2=0x7fef8c06a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:01.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.162+0000 7fef90dc1640 1 -- 172.21.15.27:0/812513275 shutdown_connections 2024-09-19T08:20:01.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:01.162+0000 7fef90dc1640 1 -- 172.21.15.27:0/812513275 wait complete. 2024-09-19T08:20:02.073 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:20:02.073 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:20:02.337 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:20:02.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:02 smithi027 ceph-mon[31209]: pgmap v277: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:02.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.865+0000 7f915c11b640 1 -- 172.21.15.27:0/2796832815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9154102d40 msgr2=0x7f9154103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:02.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.865+0000 7f915c11b640 1 --2- 172.21.15.27:0/2796832815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9154102d40 0x7f9154103120 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9150009900 tx=0x7f915002a480 comp rx=0 tx=0).stop 2024-09-19T08:20:02.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.865+0000 7f915c11b640 1 -- 172.21.15.27:0/2796832815 shutdown_connections 2024-09-19T08:20:02.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.865+0000 7f915c11b640 1 --2- 172.21.15.27:0/2796832815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f915410c170 0x7f915410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:02.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.865+0000 7f915c11b640 1 --2- 172.21.15.27:0/2796832815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9154103660 0x7f915410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:02.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.865+0000 7f915c11b640 1 --2- 172.21.15.27:0/2796832815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9154102d40 0x7f9154103120 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:02.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.865+0000 7f915c11b640 1 -- 172.21.15.27:0/2796832815 >> 172.21.15.27:0/2796832815 conn(0x7f91540fc7a0 msgr2=0x7f91540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:02.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.865+0000 7f915c11b640 1 -- 172.21.15.27:0/2796832815 shutdown_connections 2024-09-19T08:20:02.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.865+0000 7f915c11b640 1 -- 172.21.15.27:0/2796832815 wait complete. 2024-09-19T08:20:02.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.866+0000 7f915c11b640 1 Processor -- start 2024-09-19T08:20:02.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.866+0000 7f915c11b640 1 -- start start 2024-09-19T08:20:02.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.866+0000 7f915c11b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9154102d40 0x7f91541009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:02.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.866+0000 7f915c11b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9154103660 0x7f9154100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:02.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.866+0000 7f915c11b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f915410c170 0x7f9154101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:02.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.866+0000 7f915c11b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9154111f70 con 0x7f9154103660 2024-09-19T08:20:02.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.866+0000 7f915c11b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9154111df0 con 0x7f9154102d40 2024-09-19T08:20:02.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.866+0000 7f915c11b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f91541120f0 con 0x7f915410c170 2024-09-19T08:20:02.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.866+0000 7f91596b6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9154103660 0x7f9154100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:02.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.866+0000 7f91596b6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9154103660 0x7f9154100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42196/0 (socket says 172.21.15.27:42196) 2024-09-19T08:20:02.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.866+0000 7f91596b6640 1 -- 172.21.15.27:0/50633762 learned_addr learned my addr 172.21.15.27:0/50633762 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:02.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.867+0000 7f91596b6640 1 -- 172.21.15.27:0/50633762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f915410c170 msgr2=0x7f9154101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:02.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.867+0000 7f91596b6640 1 --2- 172.21.15.27:0/50633762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f915410c170 0x7f9154101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:02.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.867+0000 7f91596b6640 1 -- 172.21.15.27:0/50633762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9154102d40 msgr2=0x7f91541009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:02.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.867+0000 7f91596b6640 1 --2- 172.21.15.27:0/50633762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9154102d40 0x7f91541009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:02.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.867+0000 7f91596b6640 1 -- 172.21.15.27:0/50633762 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91541a68c0 con 0x7f9154103660 2024-09-19T08:20:02.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.867+0000 7f91596b6640 1 --2- 172.21.15.27:0/50633762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9154103660 0x7f9154100ee0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f914400c970 tx=0x7f914400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:02.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.867+0000 7f914affd640 1 -- 172.21.15.27:0/50633762 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9144007bb0 con 0x7f9154103660 2024-09-19T08:20:02.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.867+0000 7f914affd640 1 -- 172.21.15.27:0/50633762 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9144007d50 con 0x7f9154103660 2024-09-19T08:20:02.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.867+0000 7f914affd640 1 -- 172.21.15.27:0/50633762 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9144018820 con 0x7f9154103660 2024-09-19T08:20:02.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.867+0000 7f915c11b640 1 -- 172.21.15.27:0/50633762 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91541a6bb0 con 0x7f9154103660 2024-09-19T08:20:02.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.867+0000 7f915c11b640 1 -- 172.21.15.27:0/50633762 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91541a70f0 con 0x7f9154103660 2024-09-19T08:20:02.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.868+0000 7f915c11b640 1 -- 172.21.15.27:0/50633762 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9154103120 con 0x7f9154103660 2024-09-19T08:20:02.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.869+0000 7f914affd640 1 -- 172.21.15.27:0/50633762 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f91440189c0 con 0x7f9154103660 2024-09-19T08:20:02.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.870+0000 7f914affd640 1 --2- 172.21.15.27:0/50633762 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f91400a3430 0x7f91400a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:02.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.870+0000 7f9159eb7640 1 --2- 172.21.15.27:0/50633762 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f91400a3430 0x7f91400a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:02.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.870+0000 7f914affd640 1 -- 172.21.15.27:0/50633762 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f91440d0180 con 0x7f9154103660 2024-09-19T08:20:02.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.870+0000 7f9159eb7640 1 --2- 172.21.15.27:0/50633762 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f91400a3430 0x7f91400a58f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f915002a9a0 tx=0x7f9150000bc0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:02.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:02.873+0000 7f914affd640 1 -- 172.21.15.27:0/50633762 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9144014030 con 0x7f9154103660 2024-09-19T08:20:02.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:02 smithi155 ceph-mon[35362]: pgmap v277: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:03.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:02 smithi203 ceph-mon[35198]: pgmap v277: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:03.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:03.084+0000 7f915c11b640 1 -- 172.21.15.27:0/50633762 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9154101ed0 con 0x7f9154103660 2024-09-19T08:20:03.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:03.085+0000 7f914affd640 1 -- 172.21.15.27:0/50633762 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f9154101ed0 con 0x7f9154103660 2024-09-19T08:20:03.089 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:20:03.089 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:20:03.090 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:20:03.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:03.088+0000 7f915c11b640 1 -- 172.21.15.27:0/50633762 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f91400a3430 msgr2=0x7f91400a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:03.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:03.088+0000 7f915c11b640 1 --2- 172.21.15.27:0/50633762 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f91400a3430 0x7f91400a58f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f915002a9a0 tx=0x7f9150000bc0 comp rx=0 tx=0).stop 2024-09-19T08:20:03.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:03.088+0000 7f915c11b640 1 -- 172.21.15.27:0/50633762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9154103660 msgr2=0x7f9154100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:03.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:03.088+0000 7f915c11b640 1 --2- 172.21.15.27:0/50633762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9154103660 0x7f9154100ee0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f914400c970 tx=0x7f914400ce30 comp rx=0 tx=0).stop 2024-09-19T08:20:03.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:03.088+0000 7f915c11b640 1 -- 172.21.15.27:0/50633762 shutdown_connections 2024-09-19T08:20:03.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:03.088+0000 7f915c11b640 1 --2- 172.21.15.27:0/50633762 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f91400a3430 0x7f91400a58f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:03.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:03.088+0000 7f915c11b640 1 --2- 172.21.15.27:0/50633762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f915410c170 0x7f9154101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:03.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:03.088+0000 7f915c11b640 1 --2- 172.21.15.27:0/50633762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9154103660 0x7f9154100ee0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:03.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:03.088+0000 7f915c11b640 1 --2- 172.21.15.27:0/50633762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9154102d40 0x7f91541009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:03.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:03.088+0000 7f915c11b640 1 -- 172.21.15.27:0/50633762 >> 172.21.15.27:0/50633762 conn(0x7f91540fc7a0 msgr2=0x7f91540fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:03.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:03.088+0000 7f915c11b640 1 -- 172.21.15.27:0/50633762 shutdown_connections 2024-09-19T08:20:03.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:03.088+0000 7f915c11b640 1 -- 172.21.15.27:0/50633762 wait complete. 2024-09-19T08:20:03.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:03 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/50633762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:20:03.829 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:20:03.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:03 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/50633762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:20:04.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:03 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/50633762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:20:04.086 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:20:04.744 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:04 smithi027 ceph-mon[31209]: pgmap v278: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:20:04.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.744+0000 7fab6b525640 1 -- 172.21.15.27:0/1486201905 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab64102ef0 msgr2=0x7fab6410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:04.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.744+0000 7fab6b525640 1 --2- 172.21.15.27:0/1486201905 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab64102ef0 0x7fab6410da40 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fab5c009ca0 tx=0x7fab5c02a950 comp rx=0 tx=0).stop 2024-09-19T08:20:04.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.744+0000 7fab6b525640 1 -- 172.21.15.27:0/1486201905 shutdown_connections 2024-09-19T08:20:04.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.744+0000 7fab6b525640 1 --2- 172.21.15.27:0/1486201905 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab64102ef0 0x7fab6410da40 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.744+0000 7fab6b525640 1 --2- 172.21.15.27:0/1486201905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab64102570 0x7fab641029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.744+0000 7fab6b525640 1 --2- 172.21.15.27:0/1486201905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab64100e20 0x7fab64101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.744+0000 7fab6b525640 1 -- 172.21.15.27:0/1486201905 >> 172.21.15.27:0/1486201905 conn(0x7fab640fc7d0 msgr2=0x7fab640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:04.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.744+0000 7fab6b525640 1 -- 172.21.15.27:0/1486201905 shutdown_connections 2024-09-19T08:20:04.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.744+0000 7fab6b525640 1 -- 172.21.15.27:0/1486201905 wait complete. 2024-09-19T08:20:04.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.745+0000 7fab6b525640 1 Processor -- start 2024-09-19T08:20:04.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.745+0000 7fab6b525640 1 -- start start 2024-09-19T08:20:04.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.745+0000 7fab6b525640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab64100e20 0x7fab64198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:04.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.745+0000 7fab6b525640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab64102570 0x7fab64198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:04.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.745+0000 7fab6b525640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab64102ef0 0x7fab6419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:04.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.745+0000 7fab6b525640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fab64110f80 con 0x7fab64102570 2024-09-19T08:20:04.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.745+0000 7fab6b525640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fab64110e00 con 0x7fab64100e20 2024-09-19T08:20:04.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.745+0000 7fab6b525640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fab64111100 con 0x7fab64102ef0 2024-09-19T08:20:04.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.745+0000 7fab68ac0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab64102570 0x7fab64198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:04.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.745+0000 7fab68ac0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab64102570 0x7fab64198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42222/0 (socket says 172.21.15.27:42222) 2024-09-19T08:20:04.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.745+0000 7fab68ac0640 1 -- 172.21.15.27:0/1638930572 learned_addr learned my addr 172.21.15.27:0/1638930572 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:04.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.745+0000 7fab692c1640 1 --2- 172.21.15.27:0/1638930572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab64100e20 0x7fab64198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:04.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.745+0000 7fab69ac2640 1 --2- 172.21.15.27:0/1638930572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab64102ef0 0x7fab6419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:04.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.746+0000 7fab68ac0640 1 -- 172.21.15.27:0/1638930572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab64102ef0 msgr2=0x7fab6419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:04.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.746+0000 7fab68ac0640 1 --2- 172.21.15.27:0/1638930572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab64102ef0 0x7fab6419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.746+0000 7fab68ac0640 1 -- 172.21.15.27:0/1638930572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab64100e20 msgr2=0x7fab64198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:04.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.746+0000 7fab68ac0640 1 --2- 172.21.15.27:0/1638930572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab64100e20 0x7fab64198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.746+0000 7fab68ac0640 1 -- 172.21.15.27:0/1638930572 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6419d400 con 0x7fab64102570 2024-09-19T08:20:04.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.746+0000 7fab68ac0640 1 --2- 172.21.15.27:0/1638930572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab64102570 0x7fab64198990 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fab5800d950 tx=0x7fab5800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:04.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.746+0000 7fab567fc640 1 -- 172.21.15.27:0/1638930572 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab58017070 con 0x7fab64102570 2024-09-19T08:20:04.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.746+0000 7fab567fc640 1 -- 172.21.15.27:0/1638930572 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab58009c30 con 0x7fab64102570 2024-09-19T08:20:04.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.746+0000 7fab567fc640 1 -- 172.21.15.27:0/1638930572 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5800f6b0 con 0x7fab64102570 2024-09-19T08:20:04.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.746+0000 7fab6b525640 1 -- 172.21.15.27:0/1638930572 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab6419d6f0 con 0x7fab64102570 2024-09-19T08:20:04.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.746+0000 7fab6b525640 1 -- 172.21.15.27:0/1638930572 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab641a4fd0 con 0x7fab64102570 2024-09-19T08:20:04.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.748+0000 7fab567fc640 1 -- 172.21.15.27:0/1638930572 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fab580109d0 con 0x7fab64102570 2024-09-19T08:20:04.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.749+0000 7fab6d8fe740 1 Processor -- start 2024-09-19T08:20:04.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.749+0000 7fab6d8fe740 1 -- start start 2024-09-19T08:20:04.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.749+0000 7fab6d8fe740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e234f2eb40 0x55e234f2d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:04.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.749+0000 7fab6d8fe740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2d5d0 0x55e234f2da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:04.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.749+0000 7fab6d8fe740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e234f38370 0x55e234f3a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:04.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.749+0000 7fab6d8fe740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55e234e932f0 con 0x55e234f2d5d0 2024-09-19T08:20:04.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.749+0000 7fab6d8fe740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e234e3acf0 con 0x55e234f2eb40 2024-09-19T08:20:04.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.749+0000 7fab6d8fe740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e234e8f2b0 con 0x55e234f38370 2024-09-19T08:20:04.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.749+0000 7fab567fc640 1 --2- 172.21.15.27:0/1638930572 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fab500a3430 0x7fab500a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:04.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.749+0000 7fab692c1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2d5d0 0x55e234f2da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:04.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.749+0000 7fab692c1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2d5d0 0x55e234f2da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42230/0 (socket says 172.21.15.27:42230) 2024-09-19T08:20:04.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.749+0000 7fab692c1640 1 -- 172.21.15.27:0/672695469 learned_addr learned my addr 172.21.15.27:0/672695469 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:04.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.749+0000 7fab69ac2640 1 --2- 172.21.15.27:0/672695469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e234f2eb40 0x55e234f2d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:04.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.749+0000 7fab69ac2640 1 --2- 172.21.15.27:0/1638930572 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fab500a3430 0x7fab500a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:04.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.749+0000 7fab567fc640 1 -- 172.21.15.27:0/1638930572 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fab580cfa00 con 0x7fab64102570 2024-09-19T08:20:04.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.749+0000 7fab68ac0640 1 --2- 172.21.15.27:0/672695469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e234f38370 0x55e234f3a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:04.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.750+0000 7fab692c1640 1 -- 172.21.15.27:0/672695469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e234f38370 msgr2=0x55e234f3a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:04.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.750+0000 7fab692c1640 1 --2- 172.21.15.27:0/672695469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e234f38370 0x55e234f3a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.750+0000 7fab692c1640 1 -- 172.21.15.27:0/672695469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e234f2eb40 msgr2=0x55e234f2d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:04.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.750+0000 7fab692c1640 1 --2- 172.21.15.27:0/672695469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e234f2eb40 0x55e234f2d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.750+0000 7fab692c1640 1 -- 172.21.15.27:0/672695469 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e234e1f3a0 con 0x55e234f2d5d0 2024-09-19T08:20:04.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.750+0000 7fab68ac0640 1 --2- 172.21.15.27:0/672695469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e234f38370 0x55e234f3a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:20:04.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.750+0000 7fab692c1640 1 --2- 172.21.15.27:0/672695469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2d5d0 0x55e234f2da10 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fab60009c80 tx=0x7fab600117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af912582062a258 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:04.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.750+0000 7fab69ac2640 1 --2- 172.21.15.27:0/1638930572 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fab500a3430 0x7fab500a58f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fab5c005fa0 tx=0x7fab5c02a950 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:04.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.750+0000 7fab4f7fe640 1 -- 172.21.15.27:0/672695469 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab60012450 con 0x55e234f2d5d0 2024-09-19T08:20:04.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.750+0000 7fab4f7fe640 1 -- 172.21.15.27:0/672695469 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab60012ad0 con 0x55e234f2d5d0 2024-09-19T08:20:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.750+0000 7fab4f7fe640 1 -- 172.21.15.27:0/672695469 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6000fc50 con 0x55e234f2d5d0 2024-09-19T08:20:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.751+0000 7fab6d8fe740 1 -- 172.21.15.27:0/672695469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2d5d0 msgr2=0x55e234f2da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.751+0000 7fab6d8fe740 1 --2- 172.21.15.27:0/672695469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2d5d0 0x55e234f2da10 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fab60009c80 tx=0x7fab600117b0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.751+0000 7fab6d8fe740 1 -- 172.21.15.27:0/672695469 shutdown_connections 2024-09-19T08:20:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.751+0000 7fab6d8fe740 1 --2- 172.21.15.27:0/672695469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e234f38370 0x55e234f3a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.751+0000 7fab6d8fe740 1 --2- 172.21.15.27:0/672695469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2d5d0 0x55e234f2da10 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.751+0000 7fab6d8fe740 1 --2- 172.21.15.27:0/672695469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e234f2eb40 0x55e234f2d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.751+0000 7fab6d8fe740 1 -- 172.21.15.27:0/672695469 >> 172.21.15.27:0/672695469 conn(0x55e234ef6310 msgr2=0x55e234f29c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.751+0000 7fab6d8fe740 1 -- 172.21.15.27:0/672695469 shutdown_connections 2024-09-19T08:20:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.751+0000 7fab6d8fe740 1 -- 172.21.15.27:0/672695469 wait complete. 2024-09-19T08:20:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.751+0000 7fab6d8fe740 1 -- start start 2024-09-19T08:20:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.751+0000 7fab6d8fe740 1 Processor -- start 2024-09-19T08:20:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.752+0000 7fab6d8fe740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e234f2d5d0 0x55e234f37cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.752+0000 7fab6d8fe740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 0x55e234f34f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.752+0000 7fab6d8fe740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e234f38370 0x55e234f354e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.752+0000 7fab6d8fe740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55e234f3b070 con 0x55e234f2eb40 2024-09-19T08:20:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.752+0000 7fab6d8fe740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e234e4e060 con 0x55e234f2d5d0 2024-09-19T08:20:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.752+0000 7fab6d8fe740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e234f3b1f0 con 0x55e234f38370 2024-09-19T08:20:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.752+0000 7fab6d8fe740 10 client.0 _ll_register_callbacks cb 0x55e234ba18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:20:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.752+0000 7fab68ac0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 0x55e234f34f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.752+0000 7fab68ac0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 0x55e234f34f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42236/0 (socket says 172.21.15.27:42236) 2024-09-19T08:20:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.752+0000 7fab68ac0640 1 -- 172.21.15.27:0/30944114 learned_addr learned my addr 172.21.15.27:0/30944114 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.752+0000 7fab692c1640 1 --2- 172.21.15.27:0/30944114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e234f2d5d0 0x55e234f37cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.752+0000 7fab69ac2640 1 --2- 172.21.15.27:0/30944114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e234f38370 0x55e234f354e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.752+0000 7fab68ac0640 1 -- 172.21.15.27:0/30944114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e234f38370 msgr2=0x55e234f354e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.752+0000 7fab68ac0640 1 --2- 172.21.15.27:0/30944114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e234f38370 0x55e234f354e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.752+0000 7fab68ac0640 1 -- 172.21.15.27:0/30944114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e234f2d5d0 msgr2=0x55e234f37cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:04.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.752+0000 7fab68ac0640 1 --2- 172.21.15.27:0/30944114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e234f2d5d0 0x55e234f37cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.752+0000 7fab68ac0640 1 -- 172.21.15.27:0/30944114 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e234c043c0 con 0x55e234f2eb40 2024-09-19T08:20:04.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.752+0000 7fab692c1640 1 --2- 172.21.15.27:0/30944114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e234f2d5d0 0x55e234f37cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:20:04.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.752+0000 7fab68ac0640 1 --2- 172.21.15.27:0/30944114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 0x55e234f34f80 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fab58009610 tx=0x7fab58005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b0b4ea07a8b293 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:04.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.753+0000 7fab4cff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:20:04.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.753+0000 7fab4cff9640 1 -- 172.21.15.27:0/30944114 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab58020070 con 0x55e234f2eb40 2024-09-19T08:20:04.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.753+0000 7fab4cff9640 1 -- 172.21.15.27:0/30944114 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fab5809b0f0 con 0x55e234f2eb40 2024-09-19T08:20:04.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.753+0000 7fab6d8fe740 1 -- 172.21.15.27:0/30944114 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab60012ad0 con 0x55e234f2eb40 2024-09-19T08:20:04.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.753+0000 7fab4cff9640 1 -- 172.21.15.27:0/30944114 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fab580cd590 con 0x55e234f2eb40 2024-09-19T08:20:04.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.753+0000 7fab6d8fe740 10 client.16812 fetch_fsmap learned FSMap version 20 2024-09-19T08:20:04.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.753+0000 7fab6d8fe740 1 -- 172.21.15.27:0/30944114 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e234f469f0 con 0x55e234f2eb40 2024-09-19T08:20:04.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.753+0000 7fab4cff9640 1 -- 172.21.15.27:0/30944114 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab60012ad0 con 0x55e234f2eb40 2024-09-19T08:20:04.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.753+0000 7fab4cff9640 1 -- 172.21.15.27:0/30944114 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fab58010660 con 0x55e234f2eb40 2024-09-19T08:20:04.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.753+0000 7fab6d8fe740 10 client.16812 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:20:04.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.753+0000 7fab6d8fe740 10 client.16812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:20:04.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.753+0000 7fab6d8fe740 20 client.16812 populate_metadata read hostname 'smithi027' 2024-09-19T08:20:04.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.753+0000 7fab6d8fe740 1 --2- 172.21.15.27:0/30944114 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e234f47eb0 0x55e234f4a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:04.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.753+0000 7fab6d8fe740 4 client.16812 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:20:04.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.753+0000 7fab6d8fe740 1 -- 172.21.15.27:0/30944114 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e234ea0860 con 0x55e234f47eb0 2024-09-19T08:20:04.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.754+0000 7fab692c1640 1 --2- 172.21.15.27:0/30944114 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e234f47eb0 0x55e234f4a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:04.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.754+0000 7fab692c1640 1 --2- 172.21.15.27:0/30944114 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e234f47eb0 0x55e234f4a340 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb020faa9c9fd572 server_cookie=cf6c0abe3ebdba2c in_seq=0 out_seq=0 2024-09-19T08:20:04.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.754+0000 7fab4cff9640 10 client.16812 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:04.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.755+0000 7fab4cff9640 1 -- 172.21.15.27:0/30944114 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e234ea0860 con 0x55e234f47eb0 2024-09-19T08:20:04.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.755+0000 7fab4cff9640 10 client.16812 handle_command_reply: tid=0 2024-09-19T08:20:04.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.755+0000 7fab6d8fe740 1 client.16812 shutdown 2024-09-19T08:20:04.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.755+0000 7fab6d8fe740 1 -- 172.21.15.27:0/30944114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 msgr2=0x55e234f34f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:04.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.755+0000 7fab6d8fe740 1 --2- 172.21.15.27:0/30944114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 0x55e234f34f80 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fab58009610 tx=0x7fab58005f90 comp rx=0 tx=0).stop 2024-09-19T08:20:04.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.755+0000 7fab6d8fe740 1 -- 172.21.15.27:0/30944114 shutdown_connections 2024-09-19T08:20:04.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.755+0000 7fab6d8fe740 1 --2- 172.21.15.27:0/30944114 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e234f47eb0 0x55e234f4a340 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.755+0000 7fab6d8fe740 1 --2- 172.21.15.27:0/30944114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e234f38370 0x55e234f354e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.755+0000 7fab6d8fe740 1 --2- 172.21.15.27:0/30944114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 0x55e234f34f80 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.755+0000 7fab6d8fe740 1 --2- 172.21.15.27:0/30944114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e234f2d5d0 0x55e234f37cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.755+0000 7fab4cff9640 0 client.16812 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:04.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.755+0000 7fab6d8fe740 1 -- 172.21.15.27:0/30944114 >> 172.21.15.27:0/30944114 conn(0x55e234ef6310 msgr2=0x55e234f2f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:04.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.755+0000 7fab6d8fe740 1 -- 172.21.15.27:0/30944114 shutdown_connections 2024-09-19T08:20:04.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.755+0000 7fab6d8fe740 1 -- 172.21.15.27:0/30944114 wait complete. 2024-09-19T08:20:04.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.755+0000 7fab6d8fe740 20 client.16812 trim_cache size 0 max 16384 2024-09-19T08:20:04.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.768+0000 7fab6d8fe740 1 Processor -- start 2024-09-19T08:20:04.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.768+0000 7fab6d8fe740 1 -- start start 2024-09-19T08:20:04.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.768+0000 7fab6d8fe740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e234f2d5d0 0x55e234f44310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:04.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.768+0000 7fab6d8fe740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 0x55e234f30120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:04.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.768+0000 7fab6d8fe740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e234f38370 0x55e234f30660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:04.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.768+0000 7fab6d8fe740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fab641ab6f0 con 0x55e234f2eb40 2024-09-19T08:20:04.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.768+0000 7fab6d8fe740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fab641adf50 con 0x55e234f2d5d0 2024-09-19T08:20:04.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.768+0000 7fab6d8fe740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fab641abd40 con 0x55e234f38370 2024-09-19T08:20:04.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.768+0000 7fab68ac0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 0x55e234f30120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:04.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.768+0000 7fab68ac0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 0x55e234f30120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42248/0 (socket says 172.21.15.27:42248) 2024-09-19T08:20:04.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.768+0000 7fab68ac0640 1 -- 172.21.15.27:0/1016628471 learned_addr learned my addr 172.21.15.27:0/1016628471 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:04.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.769+0000 7fab68ac0640 1 -- 172.21.15.27:0/1016628471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e234f38370 msgr2=0x55e234f30660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:04.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.769+0000 7fab68ac0640 1 --2- 172.21.15.27:0/1016628471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e234f38370 0x55e234f30660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.769+0000 7fab68ac0640 1 -- 172.21.15.27:0/1016628471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e234f2d5d0 msgr2=0x55e234f44310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:04.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.769+0000 7fab68ac0640 1 --2- 172.21.15.27:0/1016628471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e234f2d5d0 0x55e234f44310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.769+0000 7fab68ac0640 1 -- 172.21.15.27:0/1016628471 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e234f2e760 con 0x55e234f2eb40 2024-09-19T08:20:04.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.769+0000 7fab68ac0640 1 --2- 172.21.15.27:0/1016628471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 0x55e234f30120 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fab5809b9a0 tx=0x7fab58005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da8142714e77096 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:04.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.769+0000 7fab4effd640 1 -- 172.21.15.27:0/1016628471 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5807f030 con 0x55e234f2eb40 2024-09-19T08:20:04.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.769+0000 7fab4effd640 1 -- 172.21.15.27:0/1016628471 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab58009de0 con 0x55e234f2eb40 2024-09-19T08:20:04.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.769+0000 7fab4effd640 1 -- 172.21.15.27:0/1016628471 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5809b0f0 con 0x55e234f2eb40 2024-09-19T08:20:04.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.769+0000 7fab6d8fe740 1 -- 172.21.15.27:0/1016628471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 msgr2=0x55e234f30120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:04.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.769+0000 7fab6d8fe740 1 --2- 172.21.15.27:0/1016628471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 0x55e234f30120 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fab5809b9a0 tx=0x7fab58005880 comp rx=0 tx=0).stop 2024-09-19T08:20:04.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.770+0000 7fab6d8fe740 1 -- 172.21.15.27:0/1016628471 shutdown_connections 2024-09-19T08:20:04.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.770+0000 7fab6d8fe740 1 --2- 172.21.15.27:0/1016628471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e234f38370 0x55e234f30660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.770+0000 7fab6d8fe740 1 --2- 172.21.15.27:0/1016628471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 0x55e234f30120 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.770+0000 7fab6d8fe740 1 --2- 172.21.15.27:0/1016628471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e234f2d5d0 0x55e234f44310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.770+0000 7fab6d8fe740 1 -- 172.21.15.27:0/1016628471 >> 172.21.15.27:0/1016628471 conn(0x55e234ef6310 msgr2=0x55e234f34070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:04.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.770+0000 7fab6d8fe740 1 -- 172.21.15.27:0/1016628471 shutdown_connections 2024-09-19T08:20:04.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.770+0000 7fab6d8fe740 1 -- 172.21.15.27:0/1016628471 wait complete. 2024-09-19T08:20:04.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.770+0000 7fab6d8fe740 1 -- start start 2024-09-19T08:20:04.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.770+0000 7fab6d8fe740 1 Processor -- start 2024-09-19T08:20:04.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.770+0000 7fab6d8fe740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e234f2d5d0 0x55e234f40cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:04.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.770+0000 7fab6d8fe740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 0x55e234f3c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:04.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.770+0000 7fab6d8fe740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e234f38370 0x55e234f3c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:04.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.770+0000 7fab6d8fe740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fab641ac410 con 0x55e234f2eb40 2024-09-19T08:20:04.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.770+0000 7fab6d8fe740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fab641ad880 con 0x55e234f2d5d0 2024-09-19T08:20:04.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.770+0000 7fab6d8fe740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fab641acae0 con 0x55e234f38370 2024-09-19T08:20:04.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.770+0000 7fab6d8fe740 10 client.0 _ll_register_callbacks cb 0x7fab580978d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:20:04.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.771+0000 7fab68ac0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 0x55e234f3c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:04.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.771+0000 7fab68ac0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 0x55e234f3c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42254/0 (socket says 172.21.15.27:42254) 2024-09-19T08:20:04.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.771+0000 7fab68ac0640 1 -- 172.21.15.27:0/3874327840 learned_addr learned my addr 172.21.15.27:0/3874327840 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:04.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.771+0000 7fab68ac0640 1 -- 172.21.15.27:0/3874327840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e234f38370 msgr2=0x55e234f3c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:04.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.771+0000 7fab68ac0640 1 --2- 172.21.15.27:0/3874327840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e234f38370 0x55e234f3c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.771+0000 7fab68ac0640 1 -- 172.21.15.27:0/3874327840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e234f2d5d0 msgr2=0x55e234f40cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.771+0000 7fab68ac0640 1 --2- 172.21.15.27:0/3874327840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e234f2d5d0 0x55e234f40cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.771+0000 7fab68ac0640 1 -- 172.21.15.27:0/3874327840 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e234f3ce90 con 0x55e234f2eb40 2024-09-19T08:20:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.771+0000 7fab68ac0640 1 --2- 172.21.15.27:0/3874327840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 0x55e234f3c070 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fab5809bc30 tx=0x7fab5800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2d7a38a8b29c3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.771+0000 7fab4cff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:20:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.771+0000 7fab4cff9640 1 -- 172.21.15.27:0/3874327840 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5807f060 con 0x55e234f2eb40 2024-09-19T08:20:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.771+0000 7fab4cff9640 1 -- 172.21.15.27:0/3874327840 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fab58010460 con 0x55e234f2eb40 2024-09-19T08:20:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.772+0000 7fab6d8fe740 1 -- 172.21.15.27:0/3874327840 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab58009de0 con 0x55e234f2eb40 2024-09-19T08:20:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.772+0000 7fab4cff9640 1 -- 172.21.15.27:0/3874327840 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fab5809b600 con 0x55e234f2eb40 2024-09-19T08:20:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.772+0000 7fab6d8fe740 10 client.16818 fetch_fsmap learned FSMap version 20 2024-09-19T08:20:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.772+0000 7fab6d8fe740 1 -- 172.21.15.27:0/3874327840 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e234fb2d40 con 0x55e234f2eb40 2024-09-19T08:20:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.772+0000 7fab4cff9640 1 -- 172.21.15.27:0/3874327840 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab580a4910 con 0x55e234f2eb40 2024-09-19T08:20:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.773+0000 7fab4cff9640 1 -- 172.21.15.27:0/3874327840 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fab580a11e0 con 0x55e234f2eb40 2024-09-19T08:20:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.773+0000 7fab6d8fe740 10 client.16818 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:20:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.773+0000 7fab6d8fe740 10 client.16818 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:20:04.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.773+0000 7fab6d8fe740 20 client.16818 populate_metadata read hostname 'smithi027' 2024-09-19T08:20:04.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.773+0000 7fab6d8fe740 1 --2- 172.21.15.27:0/3874327840 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e234fb31a0 0x55e234fb55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:04.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.773+0000 7fab6d8fe740 4 client.16818 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:20:04.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.773+0000 7fab6d8fe740 1 -- 172.21.15.27:0/3874327840 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fab58009de0 con 0x55e234fb31a0 2024-09-19T08:20:04.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.773+0000 7fab692c1640 1 --2- 172.21.15.27:0/3874327840 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e234fb31a0 0x55e234fb55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:04.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.774+0000 7fab4cff9640 10 client.16818 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:04.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.774+0000 7fab692c1640 1 --2- 172.21.15.27:0/3874327840 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e234fb31a0 0x55e234fb55c0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=caafc48f08675ebb server_cookie=17efcfeda2b93f01 in_seq=0 out_seq=0 2024-09-19T08:20:04.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.774+0000 7fab4cff9640 1 -- 172.21.15.27:0/3874327840 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fab58009de0 con 0x55e234fb31a0 2024-09-19T08:20:04.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.774+0000 7fab4cff9640 10 client.16818 handle_command_reply: tid=0 2024-09-19T08:20:04.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.774+0000 7fab6d8fe740 1 client.16818 shutdown 2024-09-19T08:20:04.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.774+0000 7fab6d8fe740 1 -- 172.21.15.27:0/3874327840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 msgr2=0x55e234f3c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:04.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.774+0000 7fab6d8fe740 1 --2- 172.21.15.27:0/3874327840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 0x55e234f3c070 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fab5809bc30 tx=0x7fab5800bf60 comp rx=0 tx=0).stop 2024-09-19T08:20:04.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.774+0000 7fab6d8fe740 1 -- 172.21.15.27:0/3874327840 shutdown_connections 2024-09-19T08:20:04.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.774+0000 7fab6d8fe740 1 --2- 172.21.15.27:0/3874327840 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e234fb31a0 0x55e234fb55c0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.774+0000 7fab6d8fe740 1 --2- 172.21.15.27:0/3874327840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e234f38370 0x55e234f3c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.774+0000 7fab6d8fe740 1 --2- 172.21.15.27:0/3874327840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e234f2eb40 0x55e234f3c070 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.774+0000 7fab6d8fe740 1 --2- 172.21.15.27:0/3874327840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e234f2d5d0 0x55e234f40cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.774+0000 7fab6d8fe740 1 -- 172.21.15.27:0/3874327840 >> 172.21.15.27:0/3874327840 conn(0x55e234ef6310 msgr2=0x55e234f367e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:04.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.774+0000 7fab4cff9640 0 client.16818 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:04.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.774+0000 7fab6d8fe740 1 -- 172.21.15.27:0/3874327840 shutdown_connections 2024-09-19T08:20:04.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.774+0000 7fab6d8fe740 1 -- 172.21.15.27:0/3874327840 wait complete. 2024-09-19T08:20:04.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.774+0000 7fab6d8fe740 20 client.16818 trim_cache size 0 max 16384 2024-09-19T08:20:04.790 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:20:04.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.775+0000 7fab6b525640 1 -- 172.21.15.27:0/1638930572 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fab500a3430 msgr2=0x7fab500a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:04.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.775+0000 7fab6b525640 1 --2- 172.21.15.27:0/1638930572 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fab500a3430 0x7fab500a58f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fab5c005fa0 tx=0x7fab5c02a950 comp rx=0 tx=0).stop 2024-09-19T08:20:04.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.775+0000 7fab6b525640 1 -- 172.21.15.27:0/1638930572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab64102570 msgr2=0x7fab64198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:04.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.775+0000 7fab6b525640 1 --2- 172.21.15.27:0/1638930572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab64102570 0x7fab64198990 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fab5800d950 tx=0x7fab5800de10 comp rx=0 tx=0).stop 2024-09-19T08:20:04.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.775+0000 7fab6b525640 1 -- 172.21.15.27:0/1638930572 shutdown_connections 2024-09-19T08:20:04.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.775+0000 7fab6b525640 1 --2- 172.21.15.27:0/1638930572 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fab500a3430 0x7fab500a58f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.775+0000 7fab6b525640 1 --2- 172.21.15.27:0/1638930572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab64102ef0 0x7fab6419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.775+0000 7fab6b525640 1 --2- 172.21.15.27:0/1638930572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab64102570 0x7fab64198990 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.775+0000 7fab6b525640 1 --2- 172.21.15.27:0/1638930572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab64100e20 0x7fab64198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:04.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.775+0000 7fab6b525640 1 -- 172.21.15.27:0/1638930572 >> 172.21.15.27:0/1638930572 conn(0x7fab640fc7d0 msgr2=0x7fab6406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:04.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.775+0000 7fab6b525640 1 -- 172.21.15.27:0/1638930572 shutdown_connections 2024-09-19T08:20:04.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:04.775+0000 7fab6b525640 1 -- 172.21.15.27:0/1638930572 wait complete. 2024-09-19T08:20:04.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:04 smithi155 ceph-mon[35362]: pgmap v278: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:20:05.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:04 smithi203 ceph-mon[35198]: pgmap v278: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:20:06.499 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:20:06.499 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:20:06.771 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:20:06.893 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:06 smithi027 ceph-mon[31209]: pgmap v279: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:20:06.990 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:06 smithi155 ceph-mon[35362]: pgmap v279: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:20:07.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:06 smithi203 ceph-mon[35198]: pgmap v279: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:20:07.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.250+0000 7fab4af9e640 1 -- 172.21.15.27:0/2692795788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab44106a80 msgr2=0x7fab44106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:07.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.250+0000 7fab4af9e640 1 --2- 172.21.15.27:0/2692795788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab44106a80 0x7fab44106e60 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009930 tx=0x7fab2c02a420 comp rx=0 tx=0).stop 2024-09-19T08:20:07.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.250+0000 7fab4af9e640 1 -- 172.21.15.27:0/2692795788 shutdown_connections 2024-09-19T08:20:07.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.250+0000 7fab4af9e640 1 --2- 172.21.15.27:0/2692795788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab44101420 0x7fab4410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.250+0000 7fab4af9e640 1 --2- 172.21.15.27:0/2692795788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab44100a80 0x7fab44100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.250+0000 7fab4af9e640 1 --2- 172.21.15.27:0/2692795788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab44106a80 0x7fab44106e60 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.250+0000 7fab4af9e640 1 -- 172.21.15.27:0/2692795788 >> 172.21.15.27:0/2692795788 conn(0x7fab440fc7a0 msgr2=0x7fab440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:07.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.250+0000 7fab4af9e640 1 -- 172.21.15.27:0/2692795788 shutdown_connections 2024-09-19T08:20:07.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.250+0000 7fab4af9e640 1 -- 172.21.15.27:0/2692795788 wait complete. 2024-09-19T08:20:07.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.251+0000 7fab4af9e640 1 Processor -- start 2024-09-19T08:20:07.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.251+0000 7fab4af9e640 1 -- start start 2024-09-19T08:20:07.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.251+0000 7fab4af9e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab44100a80 0x7fab44199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:07.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.251+0000 7fab4af9e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab44101420 0x7fab44199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:07.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.251+0000 7fab4af9e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab44106a80 0x7fab441a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:07.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.251+0000 7fab4af9e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fab44110e80 con 0x7fab44100a80 2024-09-19T08:20:07.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.251+0000 7fab4af9e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fab44110d00 con 0x7fab44101420 2024-09-19T08:20:07.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.251+0000 7fab4af9e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fab44111000 con 0x7fab44106a80 2024-09-19T08:20:07.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.251+0000 7fab48d3a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab44100a80 0x7fab44199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:07.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.251+0000 7fab48d3a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab44100a80 0x7fab44199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42276/0 (socket says 172.21.15.27:42276) 2024-09-19T08:20:07.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.251+0000 7fab48d3a640 1 -- 172.21.15.27:0/2093253464 learned_addr learned my addr 172.21.15.27:0/2093253464 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:07.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.251+0000 7fab43fff640 1 --2- 172.21.15.27:0/2093253464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab44101420 0x7fab44199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:07.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.251+0000 7fab4953b640 1 --2- 172.21.15.27:0/2093253464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab44106a80 0x7fab441a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:07.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.251+0000 7fab48d3a640 1 -- 172.21.15.27:0/2093253464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab44106a80 msgr2=0x7fab441a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:07.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.251+0000 7fab48d3a640 1 --2- 172.21.15.27:0/2093253464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab44106a80 0x7fab441a42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.251+0000 7fab48d3a640 1 -- 172.21.15.27:0/2093253464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab44101420 msgr2=0x7fab44199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:07.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.251+0000 7fab48d3a640 1 --2- 172.21.15.27:0/2093253464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab44101420 0x7fab44199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.251+0000 7fab48d3a640 1 -- 172.21.15.27:0/2093253464 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab441a4810 con 0x7fab44100a80 2024-09-19T08:20:07.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.251+0000 7fab4953b640 1 --2- 172.21.15.27:0/2093253464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab44106a80 0x7fab441a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:20:07.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.252+0000 7fab48d3a640 1 --2- 172.21.15.27:0/2093253464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab44100a80 0x7fab44199250 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009230 tx=0x7fab2c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:07.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.252+0000 7fab41ffb640 1 -- 172.21.15.27:0/2093253464 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c03f030 con 0x7fab44100a80 2024-09-19T08:20:07.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.252+0000 7fab41ffb640 1 -- 172.21.15.27:0/2093253464 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab2c003ad0 con 0x7fab44100a80 2024-09-19T08:20:07.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.252+0000 7fab4af9e640 1 -- 172.21.15.27:0/2093253464 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab441a49e0 con 0x7fab44100a80 2024-09-19T08:20:07.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.252+0000 7fab41ffb640 1 -- 172.21.15.27:0/2093253464 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c035070 con 0x7fab44100a80 2024-09-19T08:20:07.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.252+0000 7fab4af9e640 1 -- 172.21.15.27:0/2093253464 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab441a4e30 con 0x7fab44100a80 2024-09-19T08:20:07.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.255+0000 7fab41ffb640 1 -- 172.21.15.27:0/2093253464 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fab2c042030 con 0x7fab44100a80 2024-09-19T08:20:07.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.255+0000 7fab4d377740 1 Processor -- start 2024-09-19T08:20:07.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.255+0000 7fab4d377740 1 -- start start 2024-09-19T08:20:07.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.256+0000 7fab4d377740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab52b60 0x555aeab52f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:07.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.256+0000 7fab4d377740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab53480 0x555aeab5d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:07.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.256+0000 7fab4d377740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab5dd40 0x555aeab60130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:07.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.256+0000 7fab4d377740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x555aeaab8280 con 0x555aeab53480 2024-09-19T08:20:07.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.256+0000 7fab4d377740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x555aeaa5fb10 con 0x555aeab52b60 2024-09-19T08:20:07.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.256+0000 7fab4d377740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555aeaab4240 con 0x555aeab5dd40 2024-09-19T08:20:07.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.256+0000 7fab48d3a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab53480 0x555aeab5d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:07.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.256+0000 7fab48d3a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab53480 0x555aeab5d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42280/0 (socket says 172.21.15.27:42280) 2024-09-19T08:20:07.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.256+0000 7fab48d3a640 1 -- 172.21.15.27:0/2196776913 learned_addr learned my addr 172.21.15.27:0/2196776913 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:07.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.256+0000 7fab4953b640 1 --2- 172.21.15.27:0/2196776913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab52b60 0x555aeab52f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:07.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.256+0000 7fab41ffb640 1 --2- 172.21.15.27:0/2093253464 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fab300a33b0 0x7fab300a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:07.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.256+0000 7fab43fff640 1 --2- 172.21.15.27:0/2196776913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab5dd40 0x555aeab60130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:07.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.256+0000 7fab4953b640 1 -- 172.21.15.27:0/2196776913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab5dd40 msgr2=0x555aeab60130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:07.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.256+0000 7fab4953b640 1 --2- 172.21.15.27:0/2196776913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab5dd40 0x555aeab60130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.256+0000 7fab4953b640 1 -- 172.21.15.27:0/2196776913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab53480 msgr2=0x555aeab5d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:07.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.256+0000 7fab4953b640 1 --2- 172.21.15.27:0/2196776913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab53480 0x555aeab5d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.256+0000 7fab4953b640 1 -- 172.21.15.27:0/2196776913 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aeaa6c1f0 con 0x555aeab52b60 2024-09-19T08:20:07.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.256+0000 7fab48d3a640 1 --2- 172.21.15.27:0/2196776913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab53480 0x555aeab5d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:20:07.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.257+0000 7fab4953b640 1 --2- 172.21.15.27:0/2093253464 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fab300a33b0 0x7fab300a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:07.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.257+0000 7fab41ffb640 1 -- 172.21.15.27:0/2093253464 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fab2c0f0200 con 0x7fab44100a80 2024-09-19T08:20:07.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.257+0000 7fab43fff640 1 --2- 172.21.15.27:0/2196776913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab5dd40 0x555aeab60130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:20:07.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.257+0000 7fab4953b640 1 --2- 172.21.15.27:0/2196776913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab52b60 0x555aeab52f40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00bcd0 tx=0x7fab3c011750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1ce53185a2c0019 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:07.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.257+0000 7fab4953b640 1 --2- 172.21.15.27:0/2093253464 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fab300a33b0 0x7fab300a5870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fab3c022000 tx=0x7fab3c01d000 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:07.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.257+0000 7fab3affd640 1 -- 172.21.15.27:0/2196776913 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c023440 con 0x555aeab52b60 2024-09-19T08:20:07.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.258+0000 7fab3affd640 1 -- 172.21.15.27:0/2196776913 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab3c023ac0 con 0x555aeab52b60 2024-09-19T08:20:07.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.258+0000 7fab3affd640 1 -- 172.21.15.27:0/2196776913 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c012a50 con 0x555aeab52b60 2024-09-19T08:20:07.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.258+0000 7fab4d377740 1 -- 172.21.15.27:0/2196776913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab52b60 msgr2=0x555aeab52f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:07.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.258+0000 7fab4d377740 1 --2- 172.21.15.27:0/2196776913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab52b60 0x555aeab52f40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00bcd0 tx=0x7fab3c011750 comp rx=0 tx=0).stop 2024-09-19T08:20:07.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.259+0000 7fab4d377740 1 -- 172.21.15.27:0/2196776913 shutdown_connections 2024-09-19T08:20:07.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.259+0000 7fab4d377740 1 --2- 172.21.15.27:0/2196776913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab5dd40 0x555aeab60130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.259+0000 7fab4d377740 1 --2- 172.21.15.27:0/2196776913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab53480 0x555aeab5d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.259+0000 7fab4d377740 1 --2- 172.21.15.27:0/2196776913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab52b60 0x555aeab52f40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.259+0000 7fab4d377740 1 -- 172.21.15.27:0/2196776913 >> 172.21.15.27:0/2196776913 conn(0x555aeab4f0f0 msgr2=0x555aeab4f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:07.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.259+0000 7fab4d377740 1 -- 172.21.15.27:0/2196776913 shutdown_connections 2024-09-19T08:20:07.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.259+0000 7fab4d377740 1 -- 172.21.15.27:0/2196776913 wait complete. 2024-09-19T08:20:07.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.259+0000 7fab4d377740 1 -- start start 2024-09-19T08:20:07.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.259+0000 7fab4d377740 1 Processor -- start 2024-09-19T08:20:07.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.260+0000 7fab4d377740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab52b60 0x555aeab5abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:07.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.260+0000 7fab4d377740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab53480 0x555aeab5b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:07.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.260+0000 7fab4d377740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab5dd40 0x555aeab5b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:07.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.260+0000 7fab4d377740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x555aeab60960 con 0x555aeab52b60 2024-09-19T08:20:07.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.260+0000 7fab4d377740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x555aeaa72f10 con 0x555aeab5dd40 2024-09-19T08:20:07.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.260+0000 7fab4d377740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555aeab60ae0 con 0x555aeab53480 2024-09-19T08:20:07.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.260+0000 7fab4d377740 10 client.0 _ll_register_callbacks cb 0x555aeaa3ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:20:07.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.260+0000 7fab48d3a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab52b60 0x555aeab5abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:07.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.260+0000 7fab43fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab53480 0x555aeab5b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:07.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.260+0000 7fab48d3a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab52b60 0x555aeab5abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42288/0 (socket says 172.21.15.27:42288) 2024-09-19T08:20:07.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.260+0000 7fab48d3a640 1 -- 172.21.15.27:0/1765598438 learned_addr learned my addr 172.21.15.27:0/1765598438 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:07.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.260+0000 7fab4953b640 1 --2- 172.21.15.27:0/1765598438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab5dd40 0x555aeab5b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:07.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.261+0000 7fab48d3a640 1 -- 172.21.15.27:0/1765598438 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab53480 msgr2=0x555aeab5b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:07.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.261+0000 7fab48d3a640 1 --2- 172.21.15.27:0/1765598438 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab53480 0x555aeab5b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.261+0000 7fab48d3a640 1 -- 172.21.15.27:0/1765598438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab5dd40 msgr2=0x555aeab5b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:07.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.261+0000 7fab48d3a640 1 --2- 172.21.15.27:0/1765598438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab5dd40 0x555aeab5b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.261+0000 7fab48d3a640 1 -- 172.21.15.27:0/1765598438 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aea8296a0 con 0x555aeab52b60 2024-09-19T08:20:07.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.261+0000 7fab4953b640 1 --2- 172.21.15.27:0/1765598438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab5dd40 0x555aeab5b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:20:07.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.261+0000 7fab48d3a640 1 --2- 172.21.15.27:0/1765598438 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab52b60 0x555aeab5abc0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009a50 tx=0x7fab2c0f3860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da72901244da8d69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:07.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.261+0000 7fab23fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:20:07.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.262+0000 7fab23fff640 1 -- 172.21.15.27:0/1765598438 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c049040 con 0x555aeab52b60 2024-09-19T08:20:07.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.262+0000 7fab23fff640 1 -- 172.21.15.27:0/1765598438 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fab2c003c80 con 0x555aeab52b60 2024-09-19T08:20:07.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.262+0000 7fab4d377740 1 -- 172.21.15.27:0/1765598438 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab3c023ac0 con 0x555aeab52b60 2024-09-19T08:20:07.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.262+0000 7fab23fff640 1 -- 172.21.15.27:0/1765598438 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fab2c0bbe60 con 0x555aeab52b60 2024-09-19T08:20:07.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.262+0000 7fab4d377740 10 client.16830 fetch_fsmap learned FSMap version 20 2024-09-19T08:20:07.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.262+0000 7fab4d377740 1 -- 172.21.15.27:0/1765598438 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555aeab6c4b0 con 0x555aeab52b60 2024-09-19T08:20:07.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.262+0000 7fab23fff640 1 -- 172.21.15.27:0/1765598438 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab3c023ac0 con 0x555aeab52b60 2024-09-19T08:20:07.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.262+0000 7fab23fff640 1 -- 172.21.15.27:0/1765598438 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fab2c0b8b70 con 0x555aeab52b60 2024-09-19T08:20:07.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.262+0000 7fab4d377740 10 client.16830 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:20:07.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.262+0000 7fab4d377740 10 client.16830 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:20:07.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.262+0000 7fab4d377740 20 client.16830 populate_metadata read hostname 'smithi027' 2024-09-19T08:20:07.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.262+0000 7fab4d377740 1 --2- 172.21.15.27:0/1765598438 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555aeab6d8c0 0x555aeab6fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:07.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.262+0000 7fab4d377740 4 client.16830 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:20:07.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.262+0000 7fab4d377740 1 -- 172.21.15.27:0/1765598438 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555aeaac57f0 con 0x555aeab6d8c0 2024-09-19T08:20:07.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.263+0000 7fab43fff640 1 --2- 172.21.15.27:0/1765598438 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555aeab6d8c0 0x555aeab6fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:07.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.263+0000 7fab43fff640 1 --2- 172.21.15.27:0/1765598438 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555aeab6d8c0 0x555aeab6fcf0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c3d671e3584d959 server_cookie=8f8f3446c727d053 in_seq=0 out_seq=0 2024-09-19T08:20:07.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.263+0000 7fab23fff640 10 client.16830 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:07.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.264+0000 7fab23fff640 1 -- 172.21.15.27:0/1765598438 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555aeaac57f0 con 0x555aeab6d8c0 2024-09-19T08:20:07.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.264+0000 7fab23fff640 10 client.16830 handle_command_reply: tid=0 2024-09-19T08:20:07.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.264+0000 7fab4d377740 1 client.16830 shutdown 2024-09-19T08:20:07.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.264+0000 7fab4d377740 1 -- 172.21.15.27:0/1765598438 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab52b60 msgr2=0x555aeab5abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:07.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.264+0000 7fab4d377740 1 --2- 172.21.15.27:0/1765598438 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab52b60 0x555aeab5abc0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009a50 tx=0x7fab2c0f3860 comp rx=0 tx=0).stop 2024-09-19T08:20:07.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.264+0000 7fab4d377740 1 -- 172.21.15.27:0/1765598438 shutdown_connections 2024-09-19T08:20:07.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.264+0000 7fab4d377740 1 --2- 172.21.15.27:0/1765598438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab5dd40 0x555aeab5b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.264+0000 7fab4d377740 1 --2- 172.21.15.27:0/1765598438 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555aeab6d8c0 0x555aeab6fcf0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.264+0000 7fab4d377740 1 --2- 172.21.15.27:0/1765598438 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab53480 0x555aeab5b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.264+0000 7fab4d377740 1 --2- 172.21.15.27:0/1765598438 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab52b60 0x555aeab5abc0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.264+0000 7fab4d377740 1 -- 172.21.15.27:0/1765598438 >> 172.21.15.27:0/1765598438 conn(0x555aeab4f0f0 msgr2=0x555aeab54e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:07.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.264+0000 7fab23fff640 0 client.16830 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:07.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.264+0000 7fab4d377740 1 -- 172.21.15.27:0/1765598438 shutdown_connections 2024-09-19T08:20:07.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.264+0000 7fab4d377740 1 -- 172.21.15.27:0/1765598438 wait complete. 2024-09-19T08:20:07.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.264+0000 7fab4d377740 20 client.16830 trim_cache size 0 max 16384 2024-09-19T08:20:07.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.282+0000 7fab4d377740 1 Processor -- start 2024-09-19T08:20:07.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.282+0000 7fab4d377740 1 -- start start 2024-09-19T08:20:07.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.282+0000 7fab4d377740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab52b60 0x555aeab54d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:07.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.282+0000 7fab4d377740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab53480 0x555aeab75600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:07.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.282+0000 7fab4d377740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab5dd40 0x555aeab75b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:07.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.282+0000 7fab4d377740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fab441a9590 con 0x555aeab53480 2024-09-19T08:20:07.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.282+0000 7fab4d377740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fab441abdd0 con 0x555aeab52b60 2024-09-19T08:20:07.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.282+0000 7fab4d377740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fab441a9be0 con 0x555aeab5dd40 2024-09-19T08:20:07.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.282+0000 7fab43fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab53480 0x555aeab75600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:07.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.282+0000 7fab43fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab53480 0x555aeab75600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42296/0 (socket says 172.21.15.27:42296) 2024-09-19T08:20:07.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.282+0000 7fab43fff640 1 -- 172.21.15.27:0/596909333 learned_addr learned my addr 172.21.15.27:0/596909333 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:07.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.282+0000 7fab48d3a640 1 --2- 172.21.15.27:0/596909333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab52b60 0x555aeab54d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:07.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.282+0000 7fab4953b640 1 --2- 172.21.15.27:0/596909333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab5dd40 0x555aeab75b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:07.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.282+0000 7fab43fff640 1 -- 172.21.15.27:0/596909333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab5dd40 msgr2=0x555aeab75b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:07.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.282+0000 7fab43fff640 1 --2- 172.21.15.27:0/596909333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab5dd40 0x555aeab75b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.282+0000 7fab43fff640 1 -- 172.21.15.27:0/596909333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab52b60 msgr2=0x555aeab54d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:07.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.282+0000 7fab43fff640 1 --2- 172.21.15.27:0/596909333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab52b60 0x555aeab54d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.282+0000 7fab43fff640 1 -- 172.21.15.27:0/596909333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aeab4ef20 con 0x555aeab53480 2024-09-19T08:20:07.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.282+0000 7fab48d3a640 1 --2- 172.21.15.27:0/596909333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab52b60 0x555aeab54d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:20:07.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.282+0000 7fab4953b640 1 --2- 172.21.15.27:0/596909333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab5dd40 0x555aeab75b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:20:07.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.283+0000 7fab43fff640 1 --2- 172.21.15.27:0/596909333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab53480 0x555aeab75600 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fab34000f80 tx=0x7fab34013c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944fd254b7b6af3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:07.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.283+0000 7fab3a7fc640 1 -- 172.21.15.27:0/596909333 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab34013d70 con 0x555aeab53480 2024-09-19T08:20:07.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.283+0000 7fab3a7fc640 1 -- 172.21.15.27:0/596909333 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab340130d0 con 0x555aeab53480 2024-09-19T08:20:07.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.283+0000 7fab3a7fc640 1 -- 172.21.15.27:0/596909333 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab340114c0 con 0x555aeab53480 2024-09-19T08:20:07.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.283+0000 7fab4d377740 1 -- 172.21.15.27:0/596909333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab53480 msgr2=0x555aeab75600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:07.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.283+0000 7fab4d377740 1 --2- 172.21.15.27:0/596909333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab53480 0x555aeab75600 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fab34000f80 tx=0x7fab34013c40 comp rx=0 tx=0).stop 2024-09-19T08:20:07.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.283+0000 7fab4d377740 1 -- 172.21.15.27:0/596909333 shutdown_connections 2024-09-19T08:20:07.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.283+0000 7fab4d377740 1 --2- 172.21.15.27:0/596909333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab5dd40 0x555aeab75b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.283+0000 7fab4d377740 1 --2- 172.21.15.27:0/596909333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab53480 0x555aeab75600 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.283+0000 7fab4d377740 1 --2- 172.21.15.27:0/596909333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab52b60 0x555aeab54d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.283+0000 7fab4d377740 1 -- 172.21.15.27:0/596909333 >> 172.21.15.27:0/596909333 conn(0x555aeab4f0f0 msgr2=0x555aeab54600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:07.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.284+0000 7fab4d377740 1 -- 172.21.15.27:0/596909333 shutdown_connections 2024-09-19T08:20:07.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.284+0000 7fab4d377740 1 -- 172.21.15.27:0/596909333 wait complete. 2024-09-19T08:20:07.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.284+0000 7fab4d377740 1 -- start start 2024-09-19T08:20:07.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.284+0000 7fab4d377740 1 Processor -- start 2024-09-19T08:20:07.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.284+0000 7fab4d377740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab52b60 0x555aeab61a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:07.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.284+0000 7fab4d377740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab53480 0x555aeab61f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:07.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.284+0000 7fab4d377740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab5dd40 0x555aeab624a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:07.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.284+0000 7fab4d377740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fab441aa290 con 0x555aeab52b60 2024-09-19T08:20:07.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.284+0000 7fab4d377740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fab441ab700 con 0x555aeab5dd40 2024-09-19T08:20:07.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.284+0000 7fab4d377740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fab441aa960 con 0x555aeab53480 2024-09-19T08:20:07.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.284+0000 7fab4d377740 10 client.0 _ll_register_callbacks cb 0x7fab2c0b8040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:20:07.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.285+0000 7fab48d3a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab52b60 0x555aeab61a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:07.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.285+0000 7fab48d3a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab52b60 0x555aeab61a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42312/0 (socket says 172.21.15.27:42312) 2024-09-19T08:20:07.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.285+0000 7fab48d3a640 1 -- 172.21.15.27:0/176607947 learned_addr learned my addr 172.21.15.27:0/176607947 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:07.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.285+0000 7fab43fff640 1 --2- 172.21.15.27:0/176607947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab53480 0x555aeab61f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:07.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.285+0000 7fab4953b640 1 --2- 172.21.15.27:0/176607947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab5dd40 0x555aeab624a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:07.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.285+0000 7fab48d3a640 1 -- 172.21.15.27:0/176607947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab53480 msgr2=0x555aeab61f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:07.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.285+0000 7fab48d3a640 1 --2- 172.21.15.27:0/176607947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab53480 0x555aeab61f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.285+0000 7fab48d3a640 1 -- 172.21.15.27:0/176607947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab5dd40 msgr2=0x555aeab624a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:07.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.285+0000 7fab48d3a640 1 --2- 172.21.15.27:0/176607947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab5dd40 0x555aeab624a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.285+0000 7fab48d3a640 1 -- 172.21.15.27:0/176607947 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aeabd75d0 con 0x555aeab52b60 2024-09-19T08:20:07.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.285+0000 7fab43fff640 1 --2- 172.21.15.27:0/176607947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab53480 0x555aeab61f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:20:07.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.285+0000 7fab4953b640 1 --2- 172.21.15.27:0/176607947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab5dd40 0x555aeab624a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:20:07.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.285+0000 7fab48d3a640 1 --2- 172.21.15.27:0/176607947 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab52b60 0x555aeab61a20 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fab2c03d040 tx=0x7fab2c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a96579b9e4c9135 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:07.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.285+0000 7fab23fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:20:07.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.285+0000 7fab23fff640 1 -- 172.21.15.27:0/176607947 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c0da060 con 0x555aeab52b60 2024-09-19T08:20:07.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.285+0000 7fab23fff640 1 -- 172.21.15.27:0/176607947 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fab2c0d5260 con 0x555aeab52b60 2024-09-19T08:20:07.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.285+0000 7fab4d377740 1 -- 172.21.15.27:0/176607947 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab340130d0 con 0x555aeab52b60 2024-09-19T08:20:07.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.286+0000 7fab23fff640 1 -- 172.21.15.27:0/176607947 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fab2c049070 con 0x555aeab52b60 2024-09-19T08:20:07.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.286+0000 7fab4d377740 10 client.16836 fetch_fsmap learned FSMap version 20 2024-09-19T08:20:07.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.286+0000 7fab4d377740 1 -- 172.21.15.27:0/176607947 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555aeabd87c0 con 0x555aeab52b60 2024-09-19T08:20:07.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.286+0000 7fab23fff640 1 -- 172.21.15.27:0/176607947 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab340130d0 con 0x555aeab52b60 2024-09-19T08:20:07.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.286+0000 7fab23fff640 1 -- 172.21.15.27:0/176607947 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fab2c0f3ba0 con 0x555aeab52b60 2024-09-19T08:20:07.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.286+0000 7fab4d377740 10 client.16836 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:20:07.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.286+0000 7fab4d377740 10 client.16836 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:20:07.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.286+0000 7fab4d377740 20 client.16836 populate_metadata read hostname 'smithi027' 2024-09-19T08:20:07.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.286+0000 7fab4d377740 1 --2- 172.21.15.27:0/176607947 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555aeabd8d50 0x555aeabdb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:07.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.286+0000 7fab4d377740 4 client.16836 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:20:07.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.286+0000 7fab4d377740 1 -- 172.21.15.27:0/176607947 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555aeaabfd00 con 0x555aeabd8d50 2024-09-19T08:20:07.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.286+0000 7fab43fff640 1 --2- 172.21.15.27:0/176607947 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555aeabd8d50 0x555aeabdb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:07.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.287+0000 7fab43fff640 1 --2- 172.21.15.27:0/176607947 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555aeabd8d50 0x555aeabdb160 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9650f3285fd668f0 server_cookie=254048f6a9ebe443 in_seq=0 out_seq=0 2024-09-19T08:20:07.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.287+0000 7fab23fff640 10 client.16836 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:07.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.287+0000 7fab23fff640 1 -- 172.21.15.27:0/176607947 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555aeaabfd00 con 0x555aeabd8d50 2024-09-19T08:20:07.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.287+0000 7fab23fff640 10 client.16836 handle_command_reply: tid=0 2024-09-19T08:20:07.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.288+0000 7fab4d377740 1 client.16836 shutdown 2024-09-19T08:20:07.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.288+0000 7fab4d377740 1 -- 172.21.15.27:0/176607947 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab52b60 msgr2=0x555aeab61a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:07.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.288+0000 7fab4d377740 1 --2- 172.21.15.27:0/176607947 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab52b60 0x555aeab61a20 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fab2c03d040 tx=0x7fab2c02a420 comp rx=0 tx=0).stop 2024-09-19T08:20:07.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.288+0000 7fab4d377740 1 -- 172.21.15.27:0/176607947 shutdown_connections 2024-09-19T08:20:07.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.288+0000 7fab4d377740 1 --2- 172.21.15.27:0/176607947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555aeab5dd40 0x555aeab624a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.288+0000 7fab4d377740 1 --2- 172.21.15.27:0/176607947 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x555aeabd8d50 0x555aeabdb160 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.288+0000 7fab4d377740 1 --2- 172.21.15.27:0/176607947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555aeab53480 0x555aeab61f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.288+0000 7fab4d377740 1 --2- 172.21.15.27:0/176607947 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aeab52b60 0x555aeab61a20 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.288+0000 7fab23fff640 0 client.16836 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:07.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.288+0000 7fab4d377740 1 -- 172.21.15.27:0/176607947 >> 172.21.15.27:0/176607947 conn(0x555aeab4f0f0 msgr2=0x555aeab4e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:07.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.288+0000 7fab4d377740 1 -- 172.21.15.27:0/176607947 shutdown_connections 2024-09-19T08:20:07.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.288+0000 7fab4d377740 1 -- 172.21.15.27:0/176607947 wait complete. 2024-09-19T08:20:07.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.288+0000 7fab4d377740 20 client.16836 trim_cache size 0 max 16384 2024-09-19T08:20:07.295 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:20:07.295 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:20:07.295 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "3e781dcf-a0e4-478c-88e3-0f7e1cb3bfa5", 2024-09-19T08:20:07.295 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:20:07.296 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:20:07.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.289+0000 7fab4af9e640 1 -- 172.21.15.27:0/2093253464 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fab300a33b0 msgr2=0x7fab300a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:07.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.289+0000 7fab4af9e640 1 --2- 172.21.15.27:0/2093253464 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fab300a33b0 0x7fab300a5870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fab3c022000 tx=0x7fab3c01d000 comp rx=0 tx=0).stop 2024-09-19T08:20:07.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.289+0000 7fab4af9e640 1 -- 172.21.15.27:0/2093253464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab44100a80 msgr2=0x7fab44199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:07.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.289+0000 7fab4af9e640 1 --2- 172.21.15.27:0/2093253464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab44100a80 0x7fab44199250 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009230 tx=0x7fab2c004270 comp rx=0 tx=0).stop 2024-09-19T08:20:07.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.289+0000 7fab4af9e640 1 -- 172.21.15.27:0/2093253464 shutdown_connections 2024-09-19T08:20:07.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.289+0000 7fab4af9e640 1 --2- 172.21.15.27:0/2093253464 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fab300a33b0 0x7fab300a5870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.289+0000 7fab4af9e640 1 --2- 172.21.15.27:0/2093253464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab44106a80 0x7fab441a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.289+0000 7fab4af9e640 1 --2- 172.21.15.27:0/2093253464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab44101420 0x7fab44199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.289+0000 7fab4af9e640 1 --2- 172.21.15.27:0/2093253464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab44100a80 0x7fab44199250 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:07.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.289+0000 7fab4af9e640 1 -- 172.21.15.27:0/2093253464 >> 172.21.15.27:0/2093253464 conn(0x7fab440fc7a0 msgr2=0x7fab440fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:07.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.289+0000 7fab4af9e640 1 -- 172.21.15.27:0/2093253464 shutdown_connections 2024-09-19T08:20:07.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:07.289+0000 7fab4af9e640 1 -- 172.21.15.27:0/2093253464 wait complete. 2024-09-19T08:20:07.922 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:07 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:20:07.922 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:07 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:20:07.922 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:07 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:20:07.922 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:07 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:20:07.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:07 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:20:07.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:07 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:20:07.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:07 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:20:07.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:07 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:20:08.007 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:20:08.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:07 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:20:08.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:07 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:20:08.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:07 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:20:08.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:07 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:20:08.268 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:20:08.699 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:08 smithi027 ceph-mon[31209]: pgmap v280: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-19T08:20:08.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.783+0000 7fc2500c8640 1 -- 172.21.15.27:0/2246348676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc248103660 msgr2=0x7fc24810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:08.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.783+0000 7fc2500c8640 1 --2- 172.21.15.27:0/2246348676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc248103660 0x7fc24810bb50 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc244009900 tx=0x7fc24402a480 comp rx=0 tx=0).stop 2024-09-19T08:20:08.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.783+0000 7fc2500c8640 1 -- 172.21.15.27:0/2246348676 shutdown_connections 2024-09-19T08:20:08.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.783+0000 7fc2500c8640 1 --2- 172.21.15.27:0/2246348676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc24810c170 0x7fc24810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.783+0000 7fc2500c8640 1 --2- 172.21.15.27:0/2246348676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc248103660 0x7fc24810bb50 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.783+0000 7fc2500c8640 1 --2- 172.21.15.27:0/2246348676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc248102d40 0x7fc248103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.783+0000 7fc2500c8640 1 -- 172.21.15.27:0/2246348676 >> 172.21.15.27:0/2246348676 conn(0x7fc2480fc7a0 msgr2=0x7fc2480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:08.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.784+0000 7fc2500c8640 1 -- 172.21.15.27:0/2246348676 shutdown_connections 2024-09-19T08:20:08.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.784+0000 7fc2500c8640 1 -- 172.21.15.27:0/2246348676 wait complete. 2024-09-19T08:20:08.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.784+0000 7fc2500c8640 1 Processor -- start 2024-09-19T08:20:08.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.784+0000 7fc2500c8640 1 -- start start 2024-09-19T08:20:08.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.784+0000 7fc2500c8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc248102d40 0x7fc24819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:08.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.784+0000 7fc2500c8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc248103660 0x7fc24819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:08.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.784+0000 7fc2500c8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc24810c170 0x7fc24819efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:08.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.784+0000 7fc2500c8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc248111fb0 con 0x7fc24810c170 2024-09-19T08:20:08.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.784+0000 7fc2500c8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc248111e30 con 0x7fc248103660 2024-09-19T08:20:08.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.784+0000 7fc2500c8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc248112130 con 0x7fc248102d40 2024-09-19T08:20:08.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.785+0000 7fc24e665640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc24810c170 0x7fc24819efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:08.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.785+0000 7fc24e665640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc24810c170 0x7fc24819efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42324/0 (socket says 172.21.15.27:42324) 2024-09-19T08:20:08.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.785+0000 7fc24e665640 1 -- 172.21.15.27:0/1626260319 learned_addr learned my addr 172.21.15.27:0/1626260319 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:08.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.785+0000 7fc24de64640 1 --2- 172.21.15.27:0/1626260319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc248102d40 0x7fc24819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:08.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.785+0000 7fc24d663640 1 --2- 172.21.15.27:0/1626260319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc248103660 0x7fc24819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:08.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.785+0000 7fc24e665640 1 -- 172.21.15.27:0/1626260319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc248102d40 msgr2=0x7fc24819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:08.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.785+0000 7fc24e665640 1 --2- 172.21.15.27:0/1626260319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc248102d40 0x7fc24819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.785+0000 7fc24e665640 1 -- 172.21.15.27:0/1626260319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc248103660 msgr2=0x7fc24819ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:08.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.785+0000 7fc24e665640 1 --2- 172.21.15.27:0/1626260319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc248103660 0x7fc24819ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.785+0000 7fc24e665640 1 -- 172.21.15.27:0/1626260319 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24819f6a0 con 0x7fc24810c170 2024-09-19T08:20:08.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.785+0000 7fc24e665640 1 --2- 172.21.15.27:0/1626260319 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc24810c170 0x7fc24819efc0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc24000cad0 tx=0x7fc24000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:08.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.785+0000 7fc23effd640 1 -- 172.21.15.27:0/1626260319 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24000ae20 con 0x7fc24810c170 2024-09-19T08:20:08.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.785+0000 7fc2500c8640 1 -- 172.21.15.27:0/1626260319 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc24819f990 con 0x7fc24810c170 2024-09-19T08:20:08.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.785+0000 7fc23effd640 1 -- 172.21.15.27:0/1626260319 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc240005020 con 0x7fc24810c170 2024-09-19T08:20:08.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.785+0000 7fc23effd640 1 -- 172.21.15.27:0/1626260319 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24000f6f0 con 0x7fc24810c170 2024-09-19T08:20:08.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.785+0000 7fc2500c8640 1 -- 172.21.15.27:0/1626260319 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2481a7270 con 0x7fc24810c170 2024-09-19T08:20:08.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.788+0000 7fc23effd640 1 -- 172.21.15.27:0/1626260319 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc2400051d0 con 0x7fc24810c170 2024-09-19T08:20:08.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.788+0000 7fc2524a1740 1 Processor -- start 2024-09-19T08:20:08.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.788+0000 7fc2524a1740 1 -- start start 2024-09-19T08:20:08.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.788+0000 7fc2524a1740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f22880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:08.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.788+0000 7fc2524a1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f22dc0 0x55dd97f2d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:08.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.788+0000 7fc2524a1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd97f2d680 0x55dd97f2fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:08.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.788+0000 7fc2524a1740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55dd97e882e0 con 0x55dd97f224a0 2024-09-19T08:20:08.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.788+0000 7fc2524a1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55dd97e2fce0 con 0x55dd97f2d680 2024-09-19T08:20:08.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.788+0000 7fc2524a1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55dd97e842a0 con 0x55dd97f22dc0 2024-09-19T08:20:08.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.789+0000 7fc24d663640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f22880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:08.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.789+0000 7fc24d663640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f22880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42326/0 (socket says 172.21.15.27:42326) 2024-09-19T08:20:08.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.789+0000 7fc24d663640 1 -- 172.21.15.27:0/2149760880 learned_addr learned my addr 172.21.15.27:0/2149760880 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:08.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.789+0000 7fc24de64640 1 --2- 172.21.15.27:0/2149760880 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f22dc0 0x55dd97f2d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:08.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.789+0000 7fc24d663640 1 --2- 172.21.15.27:0/2149760880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd97f2d680 0x55dd97f2fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:08.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.789+0000 7fc23effd640 1 --2- 172.21.15.27:0/1626260319 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc2340a33b0 0x7fc2340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:08.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.789+0000 7fc24d663640 1 -- 172.21.15.27:0/2149760880 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f22dc0 msgr2=0x55dd97f2d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:08.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.789+0000 7fc24d663640 1 --2- 172.21.15.27:0/2149760880 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f22dc0 0x55dd97f2d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.789+0000 7fc24d663640 1 -- 172.21.15.27:0/2149760880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd97f2d680 msgr2=0x55dd97f2fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:08.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.789+0000 7fc24d663640 1 --2- 172.21.15.27:0/2149760880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd97f2d680 0x55dd97f2fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.789+0000 7fc24d663640 1 -- 172.21.15.27:0/2149760880 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd97e14440 con 0x55dd97f224a0 2024-09-19T08:20:08.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.789+0000 7fc24e665640 1 --2- 172.21.15.27:0/1626260319 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc2340a33b0 0x7fc2340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:08.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.789+0000 7fc23effd640 1 -- 172.21.15.27:0/1626260319 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fc2400cfeb0 con 0x7fc24810c170 2024-09-19T08:20:08.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.789+0000 7fc24d663640 1 --2- 172.21.15.27:0/2149760880 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f22880 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc244005ab0 tx=0x7fc2440058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ebbf661b16da8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:08.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.789+0000 7fc233fff640 1 -- 172.21.15.27:0/2149760880 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc244043020 con 0x55dd97f224a0 2024-09-19T08:20:08.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.790+0000 7fc233fff640 1 -- 172.21.15.27:0/2149760880 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc244005500 con 0x55dd97f224a0 2024-09-19T08:20:08.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.790+0000 7fc233fff640 1 -- 172.21.15.27:0/2149760880 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc244035050 con 0x55dd97f224a0 2024-09-19T08:20:08.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.790+0000 7fc2524a1740 1 -- 172.21.15.27:0/2149760880 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 msgr2=0x55dd97f22880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:08.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.790+0000 7fc2524a1740 1 --2- 172.21.15.27:0/2149760880 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f22880 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc244005ab0 tx=0x7fc2440058b0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.790+0000 7fc24e665640 1 --2- 172.21.15.27:0/1626260319 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc2340a33b0 0x7fc2340a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc24009c0e0 tx=0x7fc2400915e0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:08.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.790+0000 7fc2524a1740 1 -- 172.21.15.27:0/2149760880 shutdown_connections 2024-09-19T08:20:08.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.790+0000 7fc2524a1740 1 --2- 172.21.15.27:0/2149760880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd97f2d680 0x55dd97f2fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.790+0000 7fc2524a1740 1 --2- 172.21.15.27:0/2149760880 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f22dc0 0x55dd97f2d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.790+0000 7fc2524a1740 1 --2- 172.21.15.27:0/2149760880 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f22880 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.790+0000 7fc2524a1740 1 -- 172.21.15.27:0/2149760880 >> 172.21.15.27:0/2149760880 conn(0x55dd97f1ea30 msgr2=0x55dd97f1ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:08.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.791+0000 7fc2524a1740 1 -- 172.21.15.27:0/2149760880 shutdown_connections 2024-09-19T08:20:08.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.791+0000 7fc2524a1740 1 -- 172.21.15.27:0/2149760880 wait complete. 2024-09-19T08:20:08.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.791+0000 7fc2524a1740 1 -- start start 2024-09-19T08:20:08.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.791+0000 7fc2524a1740 1 Processor -- start 2024-09-19T08:20:08.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.791+0000 7fc2524a1740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f2d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:08.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.791+0000 7fc2524a1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f22dc0 0x55dd97f2a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:08.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.791+0000 7fc2524a1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd97f2d680 0x55dd97f2a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:08.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.791+0000 7fc2524a1740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55dd97f30250 con 0x55dd97f224a0 2024-09-19T08:20:08.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.791+0000 7fc2524a1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55dd97e43050 con 0x55dd97f2d680 2024-09-19T08:20:08.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.791+0000 7fc2524a1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55dd97f303d0 con 0x55dd97f22dc0 2024-09-19T08:20:08.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.792+0000 7fc2524a1740 10 client.0 _ll_register_callbacks cb 0x55dd97e83160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:20:08.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.792+0000 7fc24d663640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f2d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:08.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.792+0000 7fc24d663640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f2d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42340/0 (socket says 172.21.15.27:42340) 2024-09-19T08:20:08.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.792+0000 7fc24d663640 1 -- 172.21.15.27:0/183482951 learned_addr learned my addr 172.21.15.27:0/183482951 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:08.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.792+0000 7fc24de64640 1 --2- 172.21.15.27:0/183482951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f22dc0 0x55dd97f2a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:08.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.792+0000 7fc24d663640 1 -- 172.21.15.27:0/183482951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f22dc0 msgr2=0x55dd97f2a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:08.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.792+0000 7fc24d663640 1 --2- 172.21.15.27:0/183482951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f22dc0 0x55dd97f2a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.792+0000 7fc24d663640 1 -- 172.21.15.27:0/183482951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd97f2d680 msgr2=0x55dd97f2a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:08.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.792+0000 7fc24d663640 1 --2- 172.21.15.27:0/183482951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd97f2d680 0x55dd97f2a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.792+0000 7fc24d663640 1 -- 172.21.15.27:0/183482951 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd97bf93c0 con 0x55dd97f224a0 2024-09-19T08:20:08.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.792+0000 7fc24de64640 1 --2- 172.21.15.27:0/183482951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f22dc0 0x55dd97f2a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:20:08.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.792+0000 7fc24d663640 1 --2- 172.21.15.27:0/183482951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f2d050 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc24402a9a0 tx=0x7fc2440056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb66654c117d839 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:08.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.792+0000 7fc2317fa640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:20:08.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.792+0000 7fc2317fa640 1 -- 172.21.15.27:0/183482951 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc244035040 con 0x55dd97f224a0 2024-09-19T08:20:08.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.792+0000 7fc2317fa640 1 -- 172.21.15.27:0/183482951 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fc244049480 con 0x55dd97f224a0 2024-09-19T08:20:08.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.792+0000 7fc2524a1740 1 -- 172.21.15.27:0/183482951 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc244005500 con 0x55dd97f224a0 2024-09-19T08:20:08.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.793+0000 7fc2317fa640 1 -- 172.21.15.27:0/183482951 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc244057050 con 0x55dd97f224a0 2024-09-19T08:20:08.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.793+0000 7fc2524a1740 10 client.16848 fetch_fsmap learned FSMap version 20 2024-09-19T08:20:08.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.793+0000 7fc2524a1740 1 -- 172.21.15.27:0/183482951 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dd97f3bc80 con 0x55dd97f224a0 2024-09-19T08:20:08.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.793+0000 7fc2317fa640 1 -- 172.21.15.27:0/183482951 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc244005500 con 0x55dd97f224a0 2024-09-19T08:20:08.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.793+0000 7fc2317fa640 1 -- 172.21.15.27:0/183482951 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc24403a6e0 con 0x55dd97f224a0 2024-09-19T08:20:08.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.793+0000 7fc2524a1740 10 client.16848 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:20:08.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.793+0000 7fc2524a1740 10 client.16848 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:20:08.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.793+0000 7fc2524a1740 20 client.16848 populate_metadata read hostname 'smithi027' 2024-09-19T08:20:08.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.793+0000 7fc2524a1740 1 --2- 172.21.15.27:0/183482951 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55dd97f3cfd0 0x55dd97f3f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:08.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.793+0000 7fc2524a1740 4 client.16848 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:20:08.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.793+0000 7fc2524a1740 1 -- 172.21.15.27:0/183482951 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd97e95850 con 0x55dd97f3cfd0 2024-09-19T08:20:08.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.793+0000 7fc24de64640 1 --2- 172.21.15.27:0/183482951 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55dd97f3cfd0 0x55dd97f3f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:08.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.794+0000 7fc24de64640 1 --2- 172.21.15.27:0/183482951 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55dd97f3cfd0 0x55dd97f3f3c0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=346fe7456bb223ad server_cookie=99964eb64fbc8d57 in_seq=0 out_seq=0 2024-09-19T08:20:08.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.794+0000 7fc2317fa640 10 client.16848 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:08.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.794+0000 7fc2317fa640 1 -- 172.21.15.27:0/183482951 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd97e95850 con 0x55dd97f3cfd0 2024-09-19T08:20:08.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.794+0000 7fc2317fa640 10 client.16848 handle_command_reply: tid=0 2024-09-19T08:20:08.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.794+0000 7fc2524a1740 1 client.16848 shutdown 2024-09-19T08:20:08.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.795+0000 7fc2524a1740 1 -- 172.21.15.27:0/183482951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 msgr2=0x55dd97f2d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:08.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.795+0000 7fc2524a1740 1 --2- 172.21.15.27:0/183482951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f2d050 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc24402a9a0 tx=0x7fc2440056b0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.795+0000 7fc2524a1740 1 -- 172.21.15.27:0/183482951 shutdown_connections 2024-09-19T08:20:08.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.795+0000 7fc2524a1740 1 --2- 172.21.15.27:0/183482951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd97f2d680 0x55dd97f2a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.795+0000 7fc2524a1740 1 --2- 172.21.15.27:0/183482951 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55dd97f3cfd0 0x55dd97f3f3c0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.795+0000 7fc2524a1740 1 --2- 172.21.15.27:0/183482951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f22dc0 0x55dd97f2a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.795+0000 7fc2524a1740 1 --2- 172.21.15.27:0/183482951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f2d050 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.795+0000 7fc2317fa640 0 client.16848 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:08.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.795+0000 7fc2524a1740 1 -- 172.21.15.27:0/183482951 >> 172.21.15.27:0/183482951 conn(0x55dd97f1ea30 msgr2=0x55dd97f24760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:08.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.795+0000 7fc2524a1740 1 -- 172.21.15.27:0/183482951 shutdown_connections 2024-09-19T08:20:08.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.795+0000 7fc2524a1740 1 -- 172.21.15.27:0/183482951 wait complete. 2024-09-19T08:20:08.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.795+0000 7fc2524a1740 20 client.16848 trim_cache size 0 max 16384 2024-09-19T08:20:08.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.812+0000 7fc2524a1740 1 Processor -- start 2024-09-19T08:20:08.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.812+0000 7fc2524a1740 1 -- start start 2024-09-19T08:20:08.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.812+0000 7fc2524a1740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f394b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:08.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.812+0000 7fc2524a1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd97f22dc0 0x55dd97f257f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:08.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.812+0000 7fc2524a1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f2d680 0x55dd97f44990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:08.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.812+0000 7fc2524a1740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc2481ad8e0 con 0x55dd97f224a0 2024-09-19T08:20:08.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.812+0000 7fc2524a1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc2481b0140 con 0x55dd97f22dc0 2024-09-19T08:20:08.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.812+0000 7fc2524a1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc2481adf30 con 0x55dd97f2d680 2024-09-19T08:20:08.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.812+0000 7fc24d663640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:08.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.812+0000 7fc24d663640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f394b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42346/0 (socket says 172.21.15.27:42346) 2024-09-19T08:20:08.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.812+0000 7fc24d663640 1 -- 172.21.15.27:0/1185507989 learned_addr learned my addr 172.21.15.27:0/1185507989 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:08.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.812+0000 7fc24de64640 1 --2- 172.21.15.27:0/1185507989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd97f22dc0 0x55dd97f257f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:08.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.812+0000 7fc24d663640 1 --2- 172.21.15.27:0/1185507989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f2d680 0x55dd97f44990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:08.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.812+0000 7fc24d663640 1 -- 172.21.15.27:0/1185507989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f2d680 msgr2=0x55dd97f44990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:08.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.813+0000 7fc24d663640 1 --2- 172.21.15.27:0/1185507989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f2d680 0x55dd97f44990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.813+0000 7fc24d663640 1 -- 172.21.15.27:0/1185507989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd97f22dc0 msgr2=0x55dd97f257f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:08.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.813+0000 7fc24d663640 1 --2- 172.21.15.27:0/1185507989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd97f22dc0 0x55dd97f257f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.813+0000 7fc24d663640 1 -- 172.21.15.27:0/1185507989 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd97f222d0 con 0x55dd97f224a0 2024-09-19T08:20:08.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.813+0000 7fc24d663640 1 --2- 172.21.15.27:0/1185507989 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f394b0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc244005ec0 tx=0x7fc24402ab00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759c7f02943cbf1b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:08.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.813+0000 7fc2337fe640 1 -- 172.21.15.27:0/1185507989 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc244043070 con 0x55dd97f224a0 2024-09-19T08:20:08.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.813+0000 7fc2337fe640 1 -- 172.21.15.27:0/1185507989 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc24404e070 con 0x55dd97f224a0 2024-09-19T08:20:08.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.813+0000 7fc2337fe640 1 -- 172.21.15.27:0/1185507989 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc244035040 con 0x55dd97f224a0 2024-09-19T08:20:08.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.814+0000 7fc2524a1740 1 -- 172.21.15.27:0/1185507989 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 msgr2=0x55dd97f394b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:08.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.814+0000 7fc2524a1740 1 --2- 172.21.15.27:0/1185507989 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f394b0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc244005ec0 tx=0x7fc24402ab00 comp rx=0 tx=0).stop 2024-09-19T08:20:08.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.814+0000 7fc2524a1740 1 -- 172.21.15.27:0/1185507989 shutdown_connections 2024-09-19T08:20:08.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.814+0000 7fc2524a1740 1 --2- 172.21.15.27:0/1185507989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f2d680 0x55dd97f44990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.814+0000 7fc2524a1740 1 --2- 172.21.15.27:0/1185507989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd97f22dc0 0x55dd97f257f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.814+0000 7fc2524a1740 1 --2- 172.21.15.27:0/1185507989 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f394b0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.814+0000 7fc2524a1740 1 -- 172.21.15.27:0/1185507989 >> 172.21.15.27:0/1185507989 conn(0x55dd97f1ea30 msgr2=0x55dd97f250e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:08.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.814+0000 7fc2524a1740 1 -- 172.21.15.27:0/1185507989 shutdown_connections 2024-09-19T08:20:08.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.814+0000 7fc2524a1740 1 -- 172.21.15.27:0/1185507989 wait complete. 2024-09-19T08:20:08.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.814+0000 7fc2524a1740 1 -- start start 2024-09-19T08:20:08.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.814+0000 7fc2524a1740 1 Processor -- start 2024-09-19T08:20:08.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc2524a1740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:08.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc2524a1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd97f22dc0 0x55dd97f35e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:08.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc2524a1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f2d680 0x55dd97f30c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:08.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc2524a1740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc2481ae600 con 0x55dd97f224a0 2024-09-19T08:20:08.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc2524a1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc2481afa70 con 0x55dd97f22dc0 2024-09-19T08:20:08.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc2524a1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc2481aecd0 con 0x55dd97f2d680 2024-09-19T08:20:08.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc2524a1740 10 client.0 _ll_register_callbacks cb 0x7fc244009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:20:08.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc24d663640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:08.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc24d663640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f358f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42362/0 (socket says 172.21.15.27:42362) 2024-09-19T08:20:08.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc24d663640 1 -- 172.21.15.27:0/938617190 learned_addr learned my addr 172.21.15.27:0/938617190 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:08.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc24de64640 1 --2- 172.21.15.27:0/938617190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd97f22dc0 0x55dd97f35e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:08.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc24d663640 1 --2- 172.21.15.27:0/938617190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f2d680 0x55dd97f30c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:08.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc24d663640 1 -- 172.21.15.27:0/938617190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f2d680 msgr2=0x55dd97f30c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:08.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc24d663640 1 --2- 172.21.15.27:0/938617190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f2d680 0x55dd97f30c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc24d663640 1 -- 172.21.15.27:0/938617190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd97f22dc0 msgr2=0x55dd97f35e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:08.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc24d663640 1 --2- 172.21.15.27:0/938617190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd97f22dc0 0x55dd97f35e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc24d663640 1 -- 172.21.15.27:0/938617190 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd97f314b0 con 0x55dd97f224a0 2024-09-19T08:20:08.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc24de64640 1 --2- 172.21.15.27:0/938617190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd97f22dc0 0x55dd97f35e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:20:08.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc24d663640 1 --2- 172.21.15.27:0/938617190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f358f0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc244009900 tx=0x7fc24403a9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0dcc70e99e508a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:08.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc2317fa640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:20:08.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.815+0000 7fc2317fa640 1 -- 172.21.15.27:0/938617190 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc244035040 con 0x55dd97f224a0 2024-09-19T08:20:08.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.816+0000 7fc2524a1740 1 -- 172.21.15.27:0/938617190 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc24404e070 con 0x55dd97f224a0 2024-09-19T08:20:08.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.816+0000 7fc2317fa640 1 -- 172.21.15.27:0/938617190 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fc244004120 con 0x55dd97f224a0 2024-09-19T08:20:08.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.816+0000 7fc2317fa640 1 -- 172.21.15.27:0/938617190 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc244043040 con 0x55dd97f224a0 2024-09-19T08:20:08.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.816+0000 7fc2524a1740 10 client.16854 fetch_fsmap learned FSMap version 20 2024-09-19T08:20:08.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.816+0000 7fc2524a1740 1 -- 172.21.15.27:0/938617190 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dd97fa74f0 con 0x55dd97f224a0 2024-09-19T08:20:08.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.816+0000 7fc2317fa640 1 -- 172.21.15.27:0/938617190 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc24404e070 con 0x55dd97f224a0 2024-09-19T08:20:08.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.816+0000 7fc2317fa640 1 -- 172.21.15.27:0/938617190 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc2440038c0 con 0x55dd97f224a0 2024-09-19T08:20:08.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.816+0000 7fc2524a1740 10 client.16854 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:20:08.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.816+0000 7fc2524a1740 10 client.16854 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:20:08.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.816+0000 7fc2524a1740 20 client.16854 populate_metadata read hostname 'smithi027' 2024-09-19T08:20:08.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.816+0000 7fc2524a1740 1 --2- 172.21.15.27:0/938617190 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55dd97fa7b60 0x55dd97fa9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:08.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.816+0000 7fc2524a1740 4 client.16854 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:20:08.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.816+0000 7fc2524a1740 1 -- 172.21.15.27:0/938617190 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dd97e8fd60 con 0x55dd97fa7b60 2024-09-19T08:20:08.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.816+0000 7fc24de64640 1 --2- 172.21.15.27:0/938617190 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55dd97fa7b60 0x55dd97fa9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:08.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.817+0000 7fc24de64640 1 --2- 172.21.15.27:0/938617190 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55dd97fa7b60 0x55dd97fa9f50 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4f2e4567910fae4 server_cookie=e850d2fa0356aab3 in_seq=0 out_seq=0 2024-09-19T08:20:08.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.817+0000 7fc2317fa640 10 client.16854 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:08.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.817+0000 7fc2317fa640 1 -- 172.21.15.27:0/938617190 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55dd97e8fd60 con 0x55dd97fa7b60 2024-09-19T08:20:08.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.817+0000 7fc2317fa640 10 client.16854 handle_command_reply: tid=0 2024-09-19T08:20:08.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.817+0000 7fc2524a1740 1 client.16854 shutdown 2024-09-19T08:20:08.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.817+0000 7fc2524a1740 1 -- 172.21.15.27:0/938617190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 msgr2=0x55dd97f358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:08.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.817+0000 7fc2524a1740 1 --2- 172.21.15.27:0/938617190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f358f0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc244009900 tx=0x7fc24403a9c0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.817+0000 7fc2524a1740 1 -- 172.21.15.27:0/938617190 shutdown_connections 2024-09-19T08:20:08.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.817+0000 7fc2524a1740 1 --2- 172.21.15.27:0/938617190 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55dd97fa7b60 0x55dd97fa9f50 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.817+0000 7fc2524a1740 1 --2- 172.21.15.27:0/938617190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd97f2d680 0x55dd97f30c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.817+0000 7fc2524a1740 1 --2- 172.21.15.27:0/938617190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dd97f22dc0 0x55dd97f35e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.817+0000 7fc2524a1740 1 --2- 172.21.15.27:0/938617190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dd97f224a0 0x55dd97f358f0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.817+0000 7fc2317fa640 0 client.16854 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:08.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.817+0000 7fc2524a1740 1 -- 172.21.15.27:0/938617190 >> 172.21.15.27:0/938617190 conn(0x55dd97f1ea30 msgr2=0x55dd97f1db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:08.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.817+0000 7fc2524a1740 1 -- 172.21.15.27:0/938617190 shutdown_connections 2024-09-19T08:20:08.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.817+0000 7fc2524a1740 1 -- 172.21.15.27:0/938617190 wait complete. 2024-09-19T08:20:08.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.818+0000 7fc2524a1740 20 client.16854 trim_cache size 0 max 16384 2024-09-19T08:20:08.830 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:20:08.831 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:20:08.831 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": { 2024-09-19T08:20:08.831 INFO:teuthology.orchestra.run.smithi027.stdout: "3e781dcf-a0e4-478c-88e3-0f7e1cb3bfa5": { 2024-09-19T08:20:08.831 INFO:teuthology.orchestra.run.smithi027.stdout: "path": "/", 2024-09-19T08:20:08.831 INFO:teuthology.orchestra.run.smithi027.stdout: "tag": "3e781dcf-a0e4-478c-88e3-0f7e1cb3bfa5", 2024-09-19T08:20:08.831 INFO:teuthology.orchestra.run.smithi027.stdout: "options": "recursive,force" 2024-09-19T08:20:08.831 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:20:08.831 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:20:08.831 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:20:08.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.818+0000 7fc2500c8640 1 -- 172.21.15.27:0/1626260319 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc2340a33b0 msgr2=0x7fc2340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:08.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.818+0000 7fc2500c8640 1 --2- 172.21.15.27:0/1626260319 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc2340a33b0 0x7fc2340a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc24009c0e0 tx=0x7fc2400915e0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.818+0000 7fc2500c8640 1 -- 172.21.15.27:0/1626260319 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc24810c170 msgr2=0x7fc24819efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:08.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.818+0000 7fc2500c8640 1 --2- 172.21.15.27:0/1626260319 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc24810c170 0x7fc24819efc0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc24000cad0 tx=0x7fc24000cf90 comp rx=0 tx=0).stop 2024-09-19T08:20:08.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.818+0000 7fc2500c8640 1 -- 172.21.15.27:0/1626260319 shutdown_connections 2024-09-19T08:20:08.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.818+0000 7fc2500c8640 1 --2- 172.21.15.27:0/1626260319 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc2340a33b0 0x7fc2340a5870 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.818+0000 7fc2500c8640 1 --2- 172.21.15.27:0/1626260319 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc24810c170 0x7fc24819efc0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.818+0000 7fc2500c8640 1 --2- 172.21.15.27:0/1626260319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc248103660 0x7fc24819ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.818+0000 7fc2500c8640 1 --2- 172.21.15.27:0/1626260319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc248102d40 0x7fc24819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:08.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.818+0000 7fc2500c8640 1 -- 172.21.15.27:0/1626260319 >> 172.21.15.27:0/1626260319 conn(0x7fc2480fc7a0 msgr2=0x7fc248101950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:08.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.818+0000 7fc2500c8640 1 -- 172.21.15.27:0/1626260319 shutdown_connections 2024-09-19T08:20:08.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:08.818+0000 7fc2500c8640 1 -- 172.21.15.27:0/1626260319 wait complete. 2024-09-19T08:20:08.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:08 smithi155 ceph-mon[35362]: pgmap v280: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-19T08:20:09.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:08 smithi203 ceph-mon[35198]: pgmap v280: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-19T08:20:09.567 INFO:tasks.cephfs.filesystem:scrub status for tag:3e781dcf-a0e4-478c-88e3-0f7e1cb3bfa5 - {'path': '/', 'tag': '3e781dcf-a0e4-478c-88e3-0f7e1cb3bfa5', 'options': 'recursive,force'} 2024-09-19T08:20:10.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:10 smithi155 ceph-mon[35362]: pgmap v281: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:20:10.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:10 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:20:11.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:10 smithi027 ceph-mon[31209]: pgmap v281: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:20:11.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:10 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:20:11.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:10 smithi203 ceph-mon[35198]: pgmap v281: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:20:11.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:10 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:20:11.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:11 smithi155 ceph-mon[35362]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T08:20:12.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:11 smithi027 ceph-mon[31209]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T08:20:12.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:11 smithi203 ceph-mon[35198]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T08:20:12.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:12 smithi155 ceph-mon[35362]: pgmap v283: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-19T08:20:13.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:12 smithi027 ceph-mon[31209]: pgmap v283: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-19T08:20:13.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:12 smithi203 ceph-mon[35198]: pgmap v283: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-19T08:20:14.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:14 smithi155 ceph-mon[35362]: pgmap v284: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T08:20:14.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:14 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:20:15.001 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:14 smithi027 ceph-mon[31209]: pgmap v284: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T08:20:15.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:14 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:20:15.007 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:14 smithi203 ceph-mon[35198]: pgmap v284: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T08:20:15.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:14 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:20:15.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:15 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:20:15.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:15 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:20:15.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:15 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:20:16.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:15 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:20:16.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:15 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:20:16.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:15 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:20:16.007 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:15 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:20:16.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:15 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:20:16.008 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:15 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:20:17.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:16 smithi155 ceph-mon[35362]: pgmap v285: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T08:20:17.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:16 smithi155 ceph-mon[35362]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T08:20:17.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:16 smithi027 ceph-mon[31209]: pgmap v285: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T08:20:17.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:16 smithi027 ceph-mon[31209]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T08:20:17.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:16 smithi203 ceph-mon[35198]: pgmap v285: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T08:20:17.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:16 smithi203 ceph-mon[35198]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T08:20:19.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:18 smithi155 ceph-mon[35362]: pgmap v287: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-19T08:20:19.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:18 smithi027 ceph-mon[31209]: pgmap v287: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-19T08:20:19.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:18 smithi203 ceph-mon[35198]: pgmap v287: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-19T08:20:21.074 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:20 smithi027 ceph-mon[31209]: pgmap v288: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 344 B/s wr, 2 op/s 2024-09-19T08:20:21.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:20 smithi155 ceph-mon[35362]: pgmap v288: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 344 B/s wr, 2 op/s 2024-09-19T08:20:21.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:20 smithi203 ceph-mon[35198]: pgmap v288: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 344 B/s wr, 2 op/s 2024-09-19T08:20:23.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:22 smithi155 ceph-mon[35362]: pgmap v289: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-19T08:20:23.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:22 smithi027 ceph-mon[31209]: pgmap v289: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-19T08:20:23.257 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:22 smithi203 ceph-mon[35198]: pgmap v289: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-19T08:20:25.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:24 smithi155 ceph-mon[35362]: pgmap v290: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T08:20:25.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:24 smithi027 ceph-mon[31209]: pgmap v290: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T08:20:25.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:24 smithi203 ceph-mon[35198]: pgmap v290: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T08:20:27.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:26 smithi155 ceph-mon[35362]: pgmap v291: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T08:20:27.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:26 smithi027 ceph-mon[31209]: pgmap v291: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T08:20:27.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:26 smithi203 ceph-mon[35198]: pgmap v291: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T08:20:29.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:28 smithi155 ceph-mon[35362]: pgmap v292: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 175 B/s wr, 2 op/s 2024-09-19T08:20:29.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:28 smithi027 ceph-mon[31209]: pgmap v292: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 175 B/s wr, 2 op/s 2024-09-19T08:20:29.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:28 smithi203 ceph-mon[35198]: pgmap v292: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 175 B/s wr, 2 op/s 2024-09-19T08:20:31.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:30 smithi155 ceph-mon[35362]: pgmap v293: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:31.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:30 smithi027 ceph-mon[31209]: pgmap v293: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:31.257 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:30 smithi203 ceph-mon[35198]: pgmap v293: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:33.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:32 smithi155 ceph-mon[35362]: pgmap v294: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:33.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:32 smithi027 ceph-mon[31209]: pgmap v294: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:33.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:32 smithi203 ceph-mon[35198]: pgmap v294: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:35.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:34 smithi155 ceph-mon[35362]: pgmap v295: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:20:35.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:34 smithi027 ceph-mon[31209]: pgmap v295: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:20:35.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:34 smithi203 ceph-mon[35198]: pgmap v295: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:20:37.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:36 smithi155 ceph-mon[35362]: pgmap v296: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:37.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:36 smithi027 ceph-mon[31209]: pgmap v296: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:37.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:36 smithi203 ceph-mon[35198]: pgmap v296: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:39.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:38 smithi155 ceph-mon[35362]: pgmap v297: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:20:39.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:38 smithi027 ceph-mon[31209]: pgmap v297: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:20:39.257 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:38 smithi203 ceph-mon[35198]: pgmap v297: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:20:39.568 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:20:39.845 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:20:40.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.361+0000 7f089c07e640 1 -- 172.21.15.27:0/2529383288 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08941036e0 msgr2=0x7f0894107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:40.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.361+0000 7f089c07e640 1 --2- 172.21.15.27:0/2529383288 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08941036e0 0x7f0894107b90 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f0890009930 tx=0x7f089002a420 comp rx=0 tx=0).stop 2024-09-19T08:20:40.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.361+0000 7f089c07e640 1 -- 172.21.15.27:0/2529383288 shutdown_connections 2024-09-19T08:20:40.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.361+0000 7f089c07e640 1 --2- 172.21.15.27:0/2529383288 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08941082a0 0x7f089410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.361+0000 7f089c07e640 1 --2- 172.21.15.27:0/2529383288 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08941036e0 0x7f0894107b90 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.361+0000 7f089c07e640 1 --2- 172.21.15.27:0/2529383288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0894102d30 0x7f0894103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.361+0000 7f089c07e640 1 -- 172.21.15.27:0/2529383288 >> 172.21.15.27:0/2529383288 conn(0x7f08940fc7d0 msgr2=0x7f08940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:40.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.361+0000 7f089c07e640 1 -- 172.21.15.27:0/2529383288 shutdown_connections 2024-09-19T08:20:40.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.361+0000 7f089c07e640 1 -- 172.21.15.27:0/2529383288 wait complete. 2024-09-19T08:20:40.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.361+0000 7f089c07e640 1 Processor -- start 2024-09-19T08:20:40.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.362+0000 7f089c07e640 1 -- start start 2024-09-19T08:20:40.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.362+0000 7f089c07e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0894102d30 0x7f0894100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:40.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.362+0000 7f089c07e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08941036e0 0x7f0894100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:40.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.362+0000 7f089c07e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08941082a0 0x7f0894101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:40.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.362+0000 7f089c07e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0894112060 con 0x7f08941036e0 2024-09-19T08:20:40.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.362+0000 7f089c07e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0894111ee0 con 0x7f08941082a0 2024-09-19T08:20:40.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.362+0000 7f089c07e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f08941121e0 con 0x7f0894102d30 2024-09-19T08:20:40.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.362+0000 7f0899619640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08941036e0 0x7f0894100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:40.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.362+0000 7f0899619640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08941036e0 0x7f0894100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60006/0 (socket says 172.21.15.27:60006) 2024-09-19T08:20:40.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.362+0000 7f0899619640 1 -- 172.21.15.27:0/2088028377 learned_addr learned my addr 172.21.15.27:0/2088028377 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:40.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.362+0000 7f0899e1a640 1 --2- 172.21.15.27:0/2088028377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0894102d30 0x7f0894100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:40.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.362+0000 7f089a61b640 1 --2- 172.21.15.27:0/2088028377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08941082a0 0x7f0894101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:40.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.362+0000 7f0899619640 1 -- 172.21.15.27:0/2088028377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0894102d30 msgr2=0x7f0894100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:40.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.362+0000 7f0899619640 1 --2- 172.21.15.27:0/2088028377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0894102d30 0x7f0894100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.362+0000 7f0899619640 1 -- 172.21.15.27:0/2088028377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08941082a0 msgr2=0x7f0894101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:40.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.362+0000 7f0899619640 1 --2- 172.21.15.27:0/2088028377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08941082a0 0x7f0894101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.362+0000 7f0899619640 1 -- 172.21.15.27:0/2088028377 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08941a6a80 con 0x7f08941036e0 2024-09-19T08:20:40.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.363+0000 7f0899619640 1 --2- 172.21.15.27:0/2088028377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08941036e0 0x7f0894100ed0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f0890005940 tx=0x7f08900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:40.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.363+0000 7f0886ffd640 1 -- 172.21.15.27:0/2088028377 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089003f030 con 0x7f08941036e0 2024-09-19T08:20:40.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.363+0000 7f0886ffd640 1 -- 172.21.15.27:0/2088028377 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0890003ce0 con 0x7f08941036e0 2024-09-19T08:20:40.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.363+0000 7f089c07e640 1 -- 172.21.15.27:0/2088028377 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08941a6d10 con 0x7f08941036e0 2024-09-19T08:20:40.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.363+0000 7f0886ffd640 1 -- 172.21.15.27:0/2088028377 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0890035070 con 0x7f08941036e0 2024-09-19T08:20:40.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.363+0000 7f089c07e640 1 -- 172.21.15.27:0/2088028377 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08941a71e0 con 0x7f08941036e0 2024-09-19T08:20:40.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.365+0000 7f089e457740 1 Processor -- start 2024-09-19T08:20:40.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.366+0000 7f089e457740 1 -- start start 2024-09-19T08:20:40.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.366+0000 7f0886ffd640 1 -- 172.21.15.27:0/2088028377 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0890042030 con 0x7f08941036e0 2024-09-19T08:20:40.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.366+0000 7f089e457740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab84a0 0x55e98cab8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:40.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.366+0000 7f089e457740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cab8dc0 0x55e98cac3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:40.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.366+0000 7f089e457740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cac3680 0x55e98cac5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:40.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.366+0000 7f089e457740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55e98ca1e2e0 con 0x55e98cac3680 2024-09-19T08:20:40.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.366+0000 7f089e457740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e98c9c5ce0 con 0x55e98cab84a0 2024-09-19T08:20:40.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.366+0000 7f089e457740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e98ca1a2a0 con 0x55e98cab8dc0 2024-09-19T08:20:40.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.366+0000 7f0899619640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cac3680 0x55e98cac5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:40.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.366+0000 7f0899619640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cac3680 0x55e98cac5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60008/0 (socket says 172.21.15.27:60008) 2024-09-19T08:20:40.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.366+0000 7f0899619640 1 -- 172.21.15.27:0/1215607610 learned_addr learned my addr 172.21.15.27:0/1215607610 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:40.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.366+0000 7f0899e1a640 1 --2- 172.21.15.27:0/1215607610 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cab8dc0 0x55e98cac3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:40.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.366+0000 7f089a61b640 1 --2- 172.21.15.27:0/1215607610 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab84a0 0x55e98cab8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:40.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.366+0000 7f0899619640 1 -- 172.21.15.27:0/1215607610 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cab8dc0 msgr2=0x55e98cac3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:40.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.366+0000 7f0899619640 1 --2- 172.21.15.27:0/1215607610 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cab8dc0 0x55e98cac3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.366+0000 7f0899619640 1 -- 172.21.15.27:0/1215607610 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab84a0 msgr2=0x55e98cab8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:40.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.366+0000 7f0899619640 1 --2- 172.21.15.27:0/1215607610 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab84a0 0x55e98cab8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.366+0000 7f0899619640 1 -- 172.21.15.27:0/1215607610 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e98c9aa440 con 0x55e98cac3680 2024-09-19T08:20:40.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.366+0000 7f089a61b640 1 --2- 172.21.15.27:0/1215607610 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab84a0 0x55e98cab8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:20:40.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.367+0000 7f0899619640 1 --2- 172.21.15.27:0/1215607610 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cac3680 0x55e98cac5a70 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f08900ed710 tx=0x7f08900f83b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662af38f030e4561 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:40.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.367+0000 7f0886ffd640 1 --2- 172.21.15.27:0/2088028377 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f08800a3430 0x7f08800a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:40.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.367+0000 7f089a61b640 1 --2- 172.21.15.27:0/2088028377 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f08800a3430 0x7f08800a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:40.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.367+0000 7f087ffff640 1 -- 172.21.15.27:0/1215607610 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08900b8680 con 0x55e98cac3680 2024-09-19T08:20:40.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.367+0000 7f0886ffd640 1 -- 172.21.15.27:0/2088028377 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7f08900f0030 con 0x7f08941036e0 2024-09-19T08:20:40.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.367+0000 7f087ffff640 1 -- 172.21.15.27:0/1215607610 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08900fd030 con 0x55e98cac3680 2024-09-19T08:20:40.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.367+0000 7f087ffff640 1 -- 172.21.15.27:0/1215607610 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08900c4530 con 0x55e98cac3680 2024-09-19T08:20:40.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.368+0000 7f089e457740 1 -- 172.21.15.27:0/1215607610 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cac3680 msgr2=0x55e98cac5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:40.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.368+0000 7f089e457740 1 --2- 172.21.15.27:0/1215607610 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cac3680 0x55e98cac5a70 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f08900ed710 tx=0x7f08900f83b0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.368+0000 7f089a61b640 1 --2- 172.21.15.27:0/2088028377 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f08800a3430 0x7f08800a58f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f088c005fd0 tx=0x7f088c009600 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:40.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.368+0000 7f089e457740 1 -- 172.21.15.27:0/1215607610 shutdown_connections 2024-09-19T08:20:40.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.368+0000 7f089e457740 1 --2- 172.21.15.27:0/1215607610 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cac3680 0x55e98cac5a70 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.368+0000 7f089e457740 1 --2- 172.21.15.27:0/1215607610 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cab8dc0 0x55e98cac3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.368+0000 7f089e457740 1 --2- 172.21.15.27:0/1215607610 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab84a0 0x55e98cab8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.368+0000 7f089e457740 1 -- 172.21.15.27:0/1215607610 >> 172.21.15.27:0/1215607610 conn(0x55e98cab4a30 msgr2=0x55e98cab4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:40.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.368+0000 7f089e457740 1 -- 172.21.15.27:0/1215607610 shutdown_connections 2024-09-19T08:20:40.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.368+0000 7f089e457740 1 -- 172.21.15.27:0/1215607610 wait complete. 2024-09-19T08:20:40.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.368+0000 7f089e457740 1 -- start start 2024-09-19T08:20:40.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.369+0000 7f089e457740 1 Processor -- start 2024-09-19T08:20:40.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.369+0000 7f089e457740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab84a0 0x55e98cac2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:40.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.369+0000 7f089e457740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab8dc0 0x55e98cac01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:40.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.369+0000 7f089e457740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cac3680 0x55e98cac06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:40.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.369+0000 7f089e457740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55e98cac6010 con 0x55e98cab8dc0 2024-09-19T08:20:40.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.369+0000 7f089e457740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e98c9d9050 con 0x55e98cab84a0 2024-09-19T08:20:40.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.369+0000 7f089e457740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e98cac6190 con 0x55e98cac3680 2024-09-19T08:20:40.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.369+0000 7f089e457740 10 client.0 _ll_register_callbacks cb 0x55e98ca19160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:20:40.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.369+0000 7f0899619640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab8dc0 0x55e98cac01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:40.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.369+0000 7f0899e1a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab84a0 0x55e98cac2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:40.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.369+0000 7f0899619640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab8dc0 0x55e98cac01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60018/0 (socket says 172.21.15.27:60018) 2024-09-19T08:20:40.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.369+0000 7f0899619640 1 -- 172.21.15.27:0/636664482 learned_addr learned my addr 172.21.15.27:0/636664482 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:40.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.369+0000 7f0899e1a640 1 --2- 172.21.15.27:0/636664482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab84a0 0x55e98cac2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.27:60606/0 (socket says 172.21.15.27:60606) 2024-09-19T08:20:40.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.369+0000 7f089a61b640 1 --2- 172.21.15.27:0/636664482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cac3680 0x55e98cac06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:40.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.370+0000 7f0899619640 1 -- 172.21.15.27:0/636664482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cac3680 msgr2=0x55e98cac06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:40.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.370+0000 7f0899619640 1 --2- 172.21.15.27:0/636664482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cac3680 0x55e98cac06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.370+0000 7f0899619640 1 -- 172.21.15.27:0/636664482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab84a0 msgr2=0x55e98cac2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:40.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.370+0000 7f0899619640 1 --2- 172.21.15.27:0/636664482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab84a0 0x55e98cac2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.370+0000 7f0899619640 1 -- 172.21.15.27:0/636664482 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e98c78f3c0 con 0x55e98cab8dc0 2024-09-19T08:20:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.370+0000 7f0899e1a640 1 --2- 172.21.15.27:0/636664482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab84a0 0x55e98cac2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:20:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.370+0000 7f0899619640 1 --2- 172.21.15.27:0/636664482 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab8dc0 0x55e98cac01b0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f0890006010 tx=0x7f08900f0330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac00e9582fc1b66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.370+0000 7f087d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:20:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.370+0000 7f087d7fa640 1 -- 172.21.15.27:0/636664482 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0890049030 con 0x55e98cab8dc0 2024-09-19T08:20:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.370+0000 7f087d7fa640 1 -- 172.21.15.27:0/636664482 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7f08900ba480 con 0x55e98cab8dc0 2024-09-19T08:20:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.370+0000 7f089e457740 1 -- 172.21.15.27:0/636664482 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08900fd030 con 0x55e98cab8dc0 2024-09-19T08:20:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.370+0000 7f087d7fa640 1 -- 172.21.15.27:0/636664482 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f08900c4710 con 0x55e98cab8dc0 2024-09-19T08:20:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.370+0000 7f089e457740 10 client.16866 fetch_fsmap learned FSMap version 20 2024-09-19T08:20:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.370+0000 7f089e457740 1 -- 172.21.15.27:0/636664482 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e98cac6010 con 0x55e98cab8dc0 2024-09-19T08:20:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.370+0000 7f087d7fa640 1 -- 172.21.15.27:0/636664482 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08900fd030 con 0x55e98cab8dc0 2024-09-19T08:20:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.371+0000 7f087d7fa640 1 -- 172.21.15.27:0/636664482 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f0890003800 con 0x55e98cab8dc0 2024-09-19T08:20:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.371+0000 7f089e457740 10 client.16866 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:20:40.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.371+0000 7f089e457740 10 client.16866 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:20:40.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.371+0000 7f089e457740 20 client.16866 populate_metadata read hostname 'smithi027' 2024-09-19T08:20:40.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.371+0000 7f089e457740 1 --2- 172.21.15.27:0/636664482 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e98cad2b50 0x55e98cad4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:40.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.371+0000 7f089e457740 4 client.16866 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:20:40.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.371+0000 7f089e457740 1 -- 172.21.15.27:0/636664482 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e98ca2b850 con 0x55e98cad2b50 2024-09-19T08:20:40.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.371+0000 7f0899e1a640 1 --2- 172.21.15.27:0/636664482 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e98cad2b50 0x55e98cad4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:40.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.371+0000 7f087d7fa640 10 client.16866 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:40.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.371+0000 7f0899e1a640 1 --2- 172.21.15.27:0/636664482 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e98cad2b50 0x55e98cad4f60 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb21f6eb192f01c8 server_cookie=bc8c7652612939f1 in_seq=0 out_seq=0 2024-09-19T08:20:40.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.372+0000 7f087d7fa640 1 -- 172.21.15.27:0/636664482 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e98ca2b850 con 0x55e98cad2b50 2024-09-19T08:20:40.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.372+0000 7f087d7fa640 10 client.16866 handle_command_reply: tid=0 2024-09-19T08:20:40.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.372+0000 7f089e457740 1 client.16866 shutdown 2024-09-19T08:20:40.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.372+0000 7f089e457740 1 -- 172.21.15.27:0/636664482 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab8dc0 msgr2=0x55e98cac01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:40.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.372+0000 7f089e457740 1 --2- 172.21.15.27:0/636664482 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab8dc0 0x55e98cac01b0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f0890006010 tx=0x7f08900f0330 comp rx=0 tx=0).stop 2024-09-19T08:20:40.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.372+0000 7f089e457740 1 -- 172.21.15.27:0/636664482 shutdown_connections 2024-09-19T08:20:40.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.372+0000 7f089e457740 1 --2- 172.21.15.27:0/636664482 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e98cad2b50 0x55e98cad4f60 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.372+0000 7f089e457740 1 --2- 172.21.15.27:0/636664482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cac3680 0x55e98cac06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.372+0000 7f089e457740 1 --2- 172.21.15.27:0/636664482 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab8dc0 0x55e98cac01b0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.372+0000 7f087d7fa640 0 client.16866 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:40.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.372+0000 7f089e457740 1 --2- 172.21.15.27:0/636664482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab84a0 0x55e98cac2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.372+0000 7f089e457740 1 -- 172.21.15.27:0/636664482 >> 172.21.15.27:0/636664482 conn(0x55e98cab4a30 msgr2=0x55e98caba710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:40.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.372+0000 7f089e457740 1 -- 172.21.15.27:0/636664482 shutdown_connections 2024-09-19T08:20:40.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.372+0000 7f089e457740 1 -- 172.21.15.27:0/636664482 wait complete. 2024-09-19T08:20:40.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.372+0000 7f089e457740 20 client.16866 trim_cache size 0 max 16384 2024-09-19T08:20:40.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.390+0000 7f089e457740 1 Processor -- start 2024-09-19T08:20:40.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.390+0000 7f089e457740 1 -- start start 2024-09-19T08:20:40.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.390+0000 7f089e457740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab4a30 0x55e98cabb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:40.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.390+0000 7f089e457740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cab84a0 0x55e98cabf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:40.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.390+0000 7f089e457740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab8dc0 0x55e98cada830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:40.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.390+0000 7f089e457740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f08941ada90 con 0x55e98cab8dc0 2024-09-19T08:20:40.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.390+0000 7f089e457740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f08941b02f0 con 0x55e98cab4a30 2024-09-19T08:20:40.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.390+0000 7f089e457740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f08941ae0e0 con 0x55e98cab84a0 2024-09-19T08:20:40.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.390+0000 7f089a61b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab8dc0 0x55e98cada830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:40.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.390+0000 7f089a61b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab8dc0 0x55e98cada830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60024/0 (socket says 172.21.15.27:60024) 2024-09-19T08:20:40.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.390+0000 7f089a61b640 1 -- 172.21.15.27:0/1112637060 learned_addr learned my addr 172.21.15.27:0/1112637060 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:40.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.390+0000 7f0899619640 1 --2- 172.21.15.27:0/1112637060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cab84a0 0x55e98cabf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:40.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.390+0000 7f0899e1a640 1 --2- 172.21.15.27:0/1112637060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab4a30 0x55e98cabb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:40.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.390+0000 7f089a61b640 1 -- 172.21.15.27:0/1112637060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cab84a0 msgr2=0x55e98cabf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:40.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.390+0000 7f089a61b640 1 --2- 172.21.15.27:0/1112637060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cab84a0 0x55e98cabf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.391+0000 7f089a61b640 1 -- 172.21.15.27:0/1112637060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab4a30 msgr2=0x55e98cabb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:40.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.391+0000 7f089a61b640 1 --2- 172.21.15.27:0/1112637060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab4a30 0x55e98cabb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.391+0000 7f089a61b640 1 -- 172.21.15.27:0/1112637060 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e98cab4860 con 0x55e98cab8dc0 2024-09-19T08:20:40.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.391+0000 7f089a61b640 1 --2- 172.21.15.27:0/1112637060 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab8dc0 0x55e98cada830 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f088c010650 tx=0x7f088c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461b729ecf978bd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:40.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.391+0000 7f087f7fe640 1 -- 172.21.15.27:0/1112637060 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f088c01c6c0 con 0x55e98cab8dc0 2024-09-19T08:20:40.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.391+0000 7f087f7fe640 1 -- 172.21.15.27:0/1112637060 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f088c01cd40 con 0x55e98cab8dc0 2024-09-19T08:20:40.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.391+0000 7f087f7fe640 1 -- 172.21.15.27:0/1112637060 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f088c01b390 con 0x55e98cab8dc0 2024-09-19T08:20:40.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.392+0000 7f089e457740 1 -- 172.21.15.27:0/1112637060 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab8dc0 msgr2=0x55e98cada830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:40.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.392+0000 7f089e457740 1 --2- 172.21.15.27:0/1112637060 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab8dc0 0x55e98cada830 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f088c010650 tx=0x7f088c019000 comp rx=0 tx=0).stop 2024-09-19T08:20:40.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.392+0000 7f089e457740 1 -- 172.21.15.27:0/1112637060 shutdown_connections 2024-09-19T08:20:40.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.392+0000 7f089e457740 1 --2- 172.21.15.27:0/1112637060 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab8dc0 0x55e98cada830 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.392+0000 7f089e457740 1 --2- 172.21.15.27:0/1112637060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cab84a0 0x55e98cabf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.392+0000 7f089e457740 1 --2- 172.21.15.27:0/1112637060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab4a30 0x55e98cabb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.392+0000 7f089e457740 1 -- 172.21.15.27:0/1112637060 >> 172.21.15.27:0/1112637060 conn(0x55e98cac0850 msgr2=0x55e98cabea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.392+0000 7f089e457740 1 -- 172.21.15.27:0/1112637060 shutdown_connections 2024-09-19T08:20:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.392+0000 7f089e457740 1 -- 172.21.15.27:0/1112637060 wait complete. 2024-09-19T08:20:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.392+0000 7f089e457740 1 -- start start 2024-09-19T08:20:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.392+0000 7f089e457740 1 Processor -- start 2024-09-19T08:20:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.393+0000 7f089e457740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cab4a30 0x55e98cacbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.393+0000 7f089e457740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab84a0 0x55e98cac6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.393+0000 7f089e457740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab8dc0 0x55e98cac7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.393+0000 7f089e457740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f08941ae7b0 con 0x55e98cab84a0 2024-09-19T08:20:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.393+0000 7f089e457740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f08941afc20 con 0x55e98cab8dc0 2024-09-19T08:20:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.393+0000 7f089e457740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f08941aee80 con 0x55e98cab4a30 2024-09-19T08:20:40.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.393+0000 7f089e457740 10 client.0 _ll_register_callbacks cb 0x7f088800b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:20:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.393+0000 7f0899619640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab84a0 0x55e98cac6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.393+0000 7f0899619640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab84a0 0x55e98cac6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60034/0 (socket says 172.21.15.27:60034) 2024-09-19T08:20:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.393+0000 7f0899619640 1 -- 172.21.15.27:0/1350681329 learned_addr learned my addr 172.21.15.27:0/1350681329 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.393+0000 7f089a61b640 1 --2- 172.21.15.27:0/1350681329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab8dc0 0x55e98cac7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.393+0000 7f0899e1a640 1 --2- 172.21.15.27:0/1350681329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cab4a30 0x55e98cacbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.393+0000 7f0899619640 1 -- 172.21.15.27:0/1350681329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cab4a30 msgr2=0x55e98cacbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.393+0000 7f0899619640 1 --2- 172.21.15.27:0/1350681329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cab4a30 0x55e98cacbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.393+0000 7f0899619640 1 -- 172.21.15.27:0/1350681329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab8dc0 msgr2=0x55e98cac7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.393+0000 7f0899619640 1 --2- 172.21.15.27:0/1350681329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab8dc0 0x55e98cac7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.393+0000 7f0899619640 1 -- 172.21.15.27:0/1350681329 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e98cac7d40 con 0x55e98cab84a0 2024-09-19T08:20:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.393+0000 7f0899e1a640 1 --2- 172.21.15.27:0/1350681329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cab4a30 0x55e98cacbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:20:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.393+0000 7f0899619640 1 --2- 172.21.15.27:0/1350681329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab84a0 0x55e98cac6f50 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f08900edda0 tx=0x7f08900f03a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0528b831564a68 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.393+0000 7f087d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:20:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.394+0000 7f087d7fa640 1 -- 172.21.15.27:0/1350681329 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0890049070 con 0x55e98cab84a0 2024-09-19T08:20:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.394+0000 7f087d7fa640 1 -- 172.21.15.27:0/1350681329 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7f08900f3350 con 0x55e98cab84a0 2024-09-19T08:20:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.394+0000 7f089e457740 1 -- 172.21.15.27:0/1350681329 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f088c01cd40 con 0x55e98cab84a0 2024-09-19T08:20:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.394+0000 7f087d7fa640 1 -- 172.21.15.27:0/1350681329 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f08900c4900 con 0x55e98cab84a0 2024-09-19T08:20:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.394+0000 7f089e457740 10 client.16872 fetch_fsmap learned FSMap version 20 2024-09-19T08:20:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.394+0000 7f089e457740 1 -- 172.21.15.27:0/1350681329 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e98cac7d40 con 0x55e98cab84a0 2024-09-19T08:20:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.394+0000 7f087d7fa640 1 -- 172.21.15.27:0/1350681329 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f088c01cd40 con 0x55e98cab84a0 2024-09-19T08:20:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.394+0000 7f087d7fa640 1 -- 172.21.15.27:0/1350681329 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f0890003800 con 0x55e98cab84a0 2024-09-19T08:20:40.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.394+0000 7f089e457740 10 client.16872 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:20:40.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.394+0000 7f089e457740 10 client.16872 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:20:40.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.394+0000 7f089e457740 20 client.16872 populate_metadata read hostname 'smithi027' 2024-09-19T08:20:40.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.394+0000 7f089e457740 1 --2- 172.21.15.27:0/1350681329 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e98cac3680 0x55e98cb3fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:40.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.394+0000 7f089e457740 4 client.16872 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:20:40.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.394+0000 7f089e457740 1 -- 172.21.15.27:0/1350681329 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e98ca25d60 con 0x55e98cac3680 2024-09-19T08:20:40.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.395+0000 7f0899e1a640 1 --2- 172.21.15.27:0/1350681329 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e98cac3680 0x55e98cb3fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:40.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.395+0000 7f0899e1a640 1 --2- 172.21.15.27:0/1350681329 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e98cac3680 0x55e98cb3fc00 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72c4a80cced8f8ba server_cookie=8dfd5819af546b0 in_seq=0 out_seq=0 2024-09-19T08:20:40.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.395+0000 7f087d7fa640 10 client.16872 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:40.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.395+0000 7f087d7fa640 1 -- 172.21.15.27:0/1350681329 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e98ca25d60 con 0x55e98cac3680 2024-09-19T08:20:40.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.395+0000 7f087d7fa640 10 client.16872 handle_command_reply: tid=0 2024-09-19T08:20:40.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.395+0000 7f089e457740 1 client.16872 shutdown 2024-09-19T08:20:40.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.395+0000 7f089e457740 1 -- 172.21.15.27:0/1350681329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab84a0 msgr2=0x55e98cac6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:40.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.395+0000 7f089e457740 1 --2- 172.21.15.27:0/1350681329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab84a0 0x55e98cac6f50 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f08900edda0 tx=0x7f08900f03a0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.395+0000 7f089e457740 1 -- 172.21.15.27:0/1350681329 shutdown_connections 2024-09-19T08:20:40.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.395+0000 7f089e457740 1 --2- 172.21.15.27:0/1350681329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e98cab8dc0 0x55e98cac7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.395+0000 7f089e457740 1 --2- 172.21.15.27:0/1350681329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e98cab84a0 0x55e98cac6f50 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.395+0000 7f089e457740 1 --2- 172.21.15.27:0/1350681329 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55e98cac3680 0x55e98cb3fc00 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.395+0000 7f089e457740 1 --2- 172.21.15.27:0/1350681329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e98cab4a30 0x55e98cacbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.395+0000 7f089e457740 1 -- 172.21.15.27:0/1350681329 >> 172.21.15.27:0/1350681329 conn(0x55e98cac0850 msgr2=0x55e98cabf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:40.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.395+0000 7f087d7fa640 0 client.16872 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:40.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.395+0000 7f089e457740 1 -- 172.21.15.27:0/1350681329 shutdown_connections 2024-09-19T08:20:40.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.396+0000 7f089e457740 1 -- 172.21.15.27:0/1350681329 wait complete. 2024-09-19T08:20:40.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.396+0000 7f089e457740 20 client.16872 trim_cache size 0 max 16384 2024-09-19T08:20:40.403 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:20:40.403 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:20:40.403 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:20:40.403 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:20:40.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.396+0000 7f089c07e640 1 -- 172.21.15.27:0/2088028377 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f08800a3430 msgr2=0x7f08800a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:40.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.396+0000 7f089c07e640 1 --2- 172.21.15.27:0/2088028377 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f08800a3430 0x7f08800a58f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f088c005fd0 tx=0x7f088c009600 comp rx=0 tx=0).stop 2024-09-19T08:20:40.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.396+0000 7f089c07e640 1 -- 172.21.15.27:0/2088028377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08941036e0 msgr2=0x7f0894100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:40.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.396+0000 7f089c07e640 1 --2- 172.21.15.27:0/2088028377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08941036e0 0x7f0894100ed0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f0890005940 tx=0x7f08900042f0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.396+0000 7f089c07e640 1 -- 172.21.15.27:0/2088028377 shutdown_connections 2024-09-19T08:20:40.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.396+0000 7f089c07e640 1 --2- 172.21.15.27:0/2088028377 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f08800a3430 0x7f08800a58f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.396+0000 7f089c07e640 1 --2- 172.21.15.27:0/2088028377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08941082a0 0x7f0894101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.396+0000 7f089c07e640 1 --2- 172.21.15.27:0/2088028377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08941036e0 0x7f0894100ed0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.396+0000 7f089c07e640 1 --2- 172.21.15.27:0/2088028377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0894102d30 0x7f0894100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:40.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.396+0000 7f089c07e640 1 -- 172.21.15.27:0/2088028377 >> 172.21.15.27:0/2088028377 conn(0x7f08940fc7d0 msgr2=0x7f0894105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:40.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.397+0000 7f089c07e640 1 -- 172.21.15.27:0/2088028377 shutdown_connections 2024-09-19T08:20:40.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:40.397+0000 7f089c07e640 1 -- 172.21.15.27:0/2088028377 wait complete. 2024-09-19T08:20:41.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:40 smithi155 ceph-mon[35362]: pgmap v298: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:41.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:40 smithi027 ceph-mon[31209]: pgmap v298: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:41.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:40 smithi203 ceph-mon[35198]: pgmap v298: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:41.303 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:20:41.303 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:20:41.572 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:20:42.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.086+0000 7f6659574640 1 -- 172.21.15.27:0/2903575696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6654106a90 msgr2=0x7f6654106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:42.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.086+0000 7f6659574640 1 --2- 172.21.15.27:0/2903575696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6654106a90 0x7f6654106e70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6644009930 tx=0x7f664402a420 comp rx=0 tx=0).stop 2024-09-19T08:20:42.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.086+0000 7f6659574640 1 -- 172.21.15.27:0/2903575696 shutdown_connections 2024-09-19T08:20:42.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.086+0000 7f6659574640 1 --2- 172.21.15.27:0/2903575696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6654101430 0x7f665410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:42.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.086+0000 7f6659574640 1 --2- 172.21.15.27:0/2903575696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6654100a90 0x7f6654100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:42.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.086+0000 7f6659574640 1 --2- 172.21.15.27:0/2903575696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6654106a90 0x7f6654106e70 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:42.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.086+0000 7f6659574640 1 -- 172.21.15.27:0/2903575696 >> 172.21.15.27:0/2903575696 conn(0x7f66540fc7d0 msgr2=0x7f66540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:42.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.086+0000 7f6659574640 1 -- 172.21.15.27:0/2903575696 shutdown_connections 2024-09-19T08:20:42.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.086+0000 7f6659574640 1 -- 172.21.15.27:0/2903575696 wait complete. 2024-09-19T08:20:42.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.087+0000 7f6659574640 1 Processor -- start 2024-09-19T08:20:42.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.087+0000 7f6659574640 1 -- start start 2024-09-19T08:20:42.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.087+0000 7f6659574640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6654100a90 0x7f665419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:42.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.087+0000 7f6659574640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6654101430 0x7f665419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:42.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.087+0000 7f6659574640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6654106a90 0x7f665419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:42.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.087+0000 7f6659574640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6654110e50 con 0x7f6654106a90 2024-09-19T08:20:42.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.087+0000 7f6659574640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6654110cd0 con 0x7f6654100a90 2024-09-19T08:20:42.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.087+0000 7f6659574640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6654110fd0 con 0x7f6654101430 2024-09-19T08:20:42.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.087+0000 7f6652ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6654100a90 0x7f665419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:42.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.087+0000 7f6652ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6654100a90 0x7f665419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.27:60624/0 (socket says 172.21.15.27:60624) 2024-09-19T08:20:42.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.087+0000 7f66537fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6654106a90 0x7f665419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:42.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.087+0000 7f66527fc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6654101430 0x7f665419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:42.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.087+0000 7f6652ffd640 1 -- 172.21.15.27:0/2157170087 learned_addr learned my addr 172.21.15.27:0/2157170087 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:42.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.088+0000 7f6652ffd640 1 -- 172.21.15.27:0/2157170087 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6654101430 msgr2=0x7f665419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:42.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.088+0000 7f6652ffd640 1 --2- 172.21.15.27:0/2157170087 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6654101430 0x7f665419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:42.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.088+0000 7f6652ffd640 1 -- 172.21.15.27:0/2157170087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6654106a90 msgr2=0x7f665419eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:42.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.088+0000 7f6652ffd640 1 --2- 172.21.15.27:0/2157170087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6654106a90 0x7f665419eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:42.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.088+0000 7f6652ffd640 1 -- 172.21.15.27:0/2157170087 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665419f590 con 0x7f6654100a90 2024-09-19T08:20:42.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.088+0000 7f66537fe640 1 --2- 172.21.15.27:0/2157170087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6654106a90 0x7f665419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:20:42.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.088+0000 7f6652ffd640 1 --2- 172.21.15.27:0/2157170087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6654100a90 0x7f665419a5e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6644009230 tx=0x7f6644004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:42.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.088+0000 7f664bfff640 1 -- 172.21.15.27:0/2157170087 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664403f030 con 0x7f6654100a90 2024-09-19T08:20:42.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.088+0000 7f664bfff640 1 -- 172.21.15.27:0/2157170087 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6644003ad0 con 0x7f6654100a90 2024-09-19T08:20:42.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.088+0000 7f6659574640 1 -- 172.21.15.27:0/2157170087 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f665419f820 con 0x7f6654100a90 2024-09-19T08:20:42.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.088+0000 7f664bfff640 1 -- 172.21.15.27:0/2157170087 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644035070 con 0x7f6654100a90 2024-09-19T08:20:42.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.088+0000 7f6659574640 1 -- 172.21.15.27:0/2157170087 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66541a7160 con 0x7f6654100a90 2024-09-19T08:20:42.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.089+0000 7f6659574640 1 -- 172.21.15.27:0/2157170087 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66541021d0 con 0x7f6654100a90 2024-09-19T08:20:42.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.091+0000 7f664bfff640 1 -- 172.21.15.27:0/2157170087 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6644042030 con 0x7f6654100a90 2024-09-19T08:20:42.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.091+0000 7f664bfff640 1 --2- 172.21.15.27:0/2157170087 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f66400a33b0 0x7f66400a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:42.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.092+0000 7f66527fc640 1 --2- 172.21.15.27:0/2157170087 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f66400a33b0 0x7f66400a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:42.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.092+0000 7f664bfff640 1 -- 172.21.15.27:0/2157170087 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7f66440f00a0 con 0x7f6654100a90 2024-09-19T08:20:42.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.092+0000 7f66527fc640 1 --2- 172.21.15.27:0/2157170087 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f66400a33b0 0x7f66400a5870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f665410d6a0 tx=0x7f663c00a2d0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:42.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.095+0000 7f664bfff640 1 -- 172.21.15.27:0/2157170087 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f66440bcb40 con 0x7f6654100a90 2024-09-19T08:20:42.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.309+0000 7f6659574640 1 -- 172.21.15.27:0/2157170087 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6654100ef0 con 0x7f6654100a90 2024-09-19T08:20:42.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.310+0000 7f664bfff640 1 -- 172.21.15.27:0/2157170087 <== mon.2 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f66440bc440 con 0x7f6654100a90 2024-09-19T08:20:42.311 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:20:42.311 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:20:42.312 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:20:42.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.312+0000 7f6659574640 1 -- 172.21.15.27:0/2157170087 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f66400a33b0 msgr2=0x7f66400a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:42.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.312+0000 7f6659574640 1 --2- 172.21.15.27:0/2157170087 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f66400a33b0 0x7f66400a5870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f665410d6a0 tx=0x7f663c00a2d0 comp rx=0 tx=0).stop 2024-09-19T08:20:42.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.313+0000 7f6659574640 1 -- 172.21.15.27:0/2157170087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6654100a90 msgr2=0x7f665419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:42.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.313+0000 7f6659574640 1 --2- 172.21.15.27:0/2157170087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6654100a90 0x7f665419a5e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6644009230 tx=0x7f6644004270 comp rx=0 tx=0).stop 2024-09-19T08:20:42.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.313+0000 7f6659574640 1 -- 172.21.15.27:0/2157170087 shutdown_connections 2024-09-19T08:20:42.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.313+0000 7f6659574640 1 --2- 172.21.15.27:0/2157170087 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f66400a33b0 0x7f66400a5870 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:42.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.313+0000 7f6659574640 1 --2- 172.21.15.27:0/2157170087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6654106a90 0x7f665419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:42.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.313+0000 7f6659574640 1 --2- 172.21.15.27:0/2157170087 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6654101430 0x7f665419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:42.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.313+0000 7f6659574640 1 --2- 172.21.15.27:0/2157170087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6654100a90 0x7f665419a5e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:42.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.313+0000 7f6659574640 1 -- 172.21.15.27:0/2157170087 >> 172.21.15.27:0/2157170087 conn(0x7f66540fc7d0 msgr2=0x7f665410c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:42.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.313+0000 7f6659574640 1 -- 172.21.15.27:0/2157170087 shutdown_connections 2024-09-19T08:20:42.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:42.313+0000 7f6659574640 1 -- 172.21.15.27:0/2157170087 wait complete. 2024-09-19T08:20:43.086 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:20:43.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:42 smithi155 ceph-mon[35362]: pgmap v299: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:43.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:42 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2157170087' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:20:43.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:42 smithi027 ceph-mon[31209]: pgmap v299: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:43.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:42 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2157170087' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:20:43.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:42 smithi203 ceph-mon[35198]: pgmap v299: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:43.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:42 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2157170087' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:20:43.345 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:20:43.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.831+0000 7f2b9dfa1640 1 -- 172.21.15.27:0/929801436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b98101420 msgr2=0x7f2b9810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:43.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.831+0000 7f2b9dfa1640 1 --2- 172.21.15.27:0/929801436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b98101420 0x7f2b9810d950 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009cd0 tx=0x7f2b9002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.831+0000 7f2b9dfa1640 1 -- 172.21.15.27:0/929801436 shutdown_connections 2024-09-19T08:20:43.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.831+0000 7f2b9dfa1640 1 --2- 172.21.15.27:0/929801436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b98101420 0x7f2b9810d950 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.831+0000 7f2b9dfa1640 1 --2- 172.21.15.27:0/929801436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b98100a80 0x7f2b98100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.831+0000 7f2b9dfa1640 1 --2- 172.21.15.27:0/929801436 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b98106a80 0x7f2b98106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.831+0000 7f2b9dfa1640 1 -- 172.21.15.27:0/929801436 >> 172.21.15.27:0/929801436 conn(0x7f2b980fc7a0 msgr2=0x7f2b980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:43.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.831+0000 7f2b9dfa1640 1 -- 172.21.15.27:0/929801436 shutdown_connections 2024-09-19T08:20:43.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.831+0000 7f2b9dfa1640 1 -- 172.21.15.27:0/929801436 wait complete. 2024-09-19T08:20:43.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.831+0000 7f2b9dfa1640 1 Processor -- start 2024-09-19T08:20:43.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.832+0000 7f2b9dfa1640 1 -- start start 2024-09-19T08:20:43.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.832+0000 7f2b9dfa1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b98100a80 0x7f2b980fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:43.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.832+0000 7f2b9dfa1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b98101420 0x7f2b980fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:43.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.832+0000 7f2b9dfa1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b98106a80 0x7f2b980fd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:43.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.832+0000 7f2b9dfa1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2b98110ea0 con 0x7f2b98106a80 2024-09-19T08:20:43.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.832+0000 7f2b9dfa1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2b98110d20 con 0x7f2b98101420 2024-09-19T08:20:43.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.832+0000 7f2b9dfa1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2b98111020 con 0x7f2b98100a80 2024-09-19T08:20:43.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.832+0000 7f2b97fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b98106a80 0x7f2b980fd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:43.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.832+0000 7f2b97fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b98106a80 0x7f2b980fd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60062/0 (socket says 172.21.15.27:60062) 2024-09-19T08:20:43.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.832+0000 7f2b97fff640 1 -- 172.21.15.27:0/4017038341 learned_addr learned my addr 172.21.15.27:0/4017038341 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:43.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.832+0000 7f2b977fe640 1 --2- 172.21.15.27:0/4017038341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b98100a80 0x7f2b980fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:43.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.832+0000 7f2b96ffd640 1 --2- 172.21.15.27:0/4017038341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b98101420 0x7f2b980fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:43.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.832+0000 7f2b97fff640 1 -- 172.21.15.27:0/4017038341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b98100a80 msgr2=0x7f2b980fccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:43.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.832+0000 7f2b97fff640 1 --2- 172.21.15.27:0/4017038341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b98100a80 0x7f2b980fccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.832+0000 7f2b97fff640 1 -- 172.21.15.27:0/4017038341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b98101420 msgr2=0x7f2b980fd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:43.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.832+0000 7f2b97fff640 1 --2- 172.21.15.27:0/4017038341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b98101420 0x7f2b980fd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.832+0000 7f2b97fff640 1 -- 172.21.15.27:0/4017038341 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b981a68b0 con 0x7f2b98106a80 2024-09-19T08:20:43.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.833+0000 7f2b97fff640 1 --2- 172.21.15.27:0/4017038341 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b98106a80 0x7f2b980fd770 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f2b90006010 tx=0x7f2b90003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:43.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.833+0000 7f2b94ff9640 1 -- 172.21.15.27:0/4017038341 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b90004450 con 0x7f2b98106a80 2024-09-19T08:20:43.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.833+0000 7f2b9dfa1640 1 -- 172.21.15.27:0/4017038341 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b981a6b40 con 0x7f2b98106a80 2024-09-19T08:20:43.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.833+0000 7f2b94ff9640 1 -- 172.21.15.27:0/4017038341 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b90003e10 con 0x7f2b98106a80 2024-09-19T08:20:43.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.833+0000 7f2b94ff9640 1 -- 172.21.15.27:0/4017038341 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b90046480 con 0x7f2b98106a80 2024-09-19T08:20:43.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.833+0000 7f2b9dfa1640 1 -- 172.21.15.27:0/4017038341 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b981a7080 con 0x7f2b98106a80 2024-09-19T08:20:43.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.836+0000 7f2b94ff9640 1 -- 172.21.15.27:0/4017038341 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2b900045f0 con 0x7f2b98106a80 2024-09-19T08:20:43.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.836+0000 7f2ba037a740 1 Processor -- start 2024-09-19T08:20:43.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.836+0000 7f2ba037a740 1 -- start start 2024-09-19T08:20:43.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.836+0000 7f2ba037a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca86cb40 0x559cca86b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:43.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.836+0000 7f2ba037a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86b5d0 0x559cca86ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:43.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.836+0000 7f2ba037a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca876370 0x559cca878760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:43.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.836+0000 7f2ba037a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559cca7d12f0 con 0x559cca876370 2024-09-19T08:20:43.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.836+0000 7f2ba037a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559cca778cf0 con 0x559cca86cb40 2024-09-19T08:20:43.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.836+0000 7f2ba037a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559cca7cd2b0 con 0x559cca86b5d0 2024-09-19T08:20:43.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.836+0000 7f2b96ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca876370 0x559cca878760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:43.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.836+0000 7f2b96ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca876370 0x559cca878760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60072/0 (socket says 172.21.15.27:60072) 2024-09-19T08:20:43.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.836+0000 7f2b96ffd640 1 -- 172.21.15.27:0/675841360 learned_addr learned my addr 172.21.15.27:0/675841360 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:43.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.836+0000 7f2b96ffd640 1 --2- 172.21.15.27:0/675841360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca86cb40 0x559cca86b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:43.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.837+0000 7f2b977fe640 1 --2- 172.21.15.27:0/675841360 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86b5d0 0x559cca86ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:43.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.837+0000 7f2b94ff9640 1 --2- 172.21.15.27:0/4017038341 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2b840a33b0 0x7f2b840a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:43.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.837+0000 7f2b96ffd640 1 -- 172.21.15.27:0/675841360 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86b5d0 msgr2=0x559cca86ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:43.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.837+0000 7f2b96ffd640 1 --2- 172.21.15.27:0/675841360 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86b5d0 0x559cca86ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.837+0000 7f2b96ffd640 1 -- 172.21.15.27:0/675841360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca86cb40 msgr2=0x559cca86b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:43.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.837+0000 7f2b96ffd640 1 --2- 172.21.15.27:0/675841360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca86cb40 0x559cca86b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.837+0000 7f2b96ffd640 1 -- 172.21.15.27:0/675841360 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cca75d3a0 con 0x559cca876370 2024-09-19T08:20:43.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.837+0000 7f2b97fff640 1 --2- 172.21.15.27:0/4017038341 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2b840a33b0 0x7f2b840a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:43.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.837+0000 7f2b96ffd640 1 --2- 172.21.15.27:0/675841360 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca876370 0x559cca878760 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f2b800117e0 tx=0x7f2b8000a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4605e4d741fb11d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:43.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.837+0000 7f2b94ff9640 1 -- 172.21.15.27:0/4017038341 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7f2b9002e030 con 0x7f2b98106a80 2024-09-19T08:20:43.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.837+0000 7f2b8dffb640 1 -- 172.21.15.27:0/675841360 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80011e20 con 0x559cca876370 2024-09-19T08:20:43.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.837+0000 7f2b8dffb640 1 -- 172.21.15.27:0/675841360 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b80005020 con 0x559cca876370 2024-09-19T08:20:43.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.837+0000 7f2b8dffb640 1 -- 172.21.15.27:0/675841360 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80004ac0 con 0x559cca876370 2024-09-19T08:20:43.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.838+0000 7f2ba037a740 1 -- 172.21.15.27:0/675841360 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca876370 msgr2=0x559cca878760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:43.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.838+0000 7f2b97fff640 1 --2- 172.21.15.27:0/4017038341 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2b840a33b0 0x7f2b840a5870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2b900bd5f0 tx=0x7f2b900a8040 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:43.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.838+0000 7f2ba037a740 1 --2- 172.21.15.27:0/675841360 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca876370 0x559cca878760 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f2b800117e0 tx=0x7f2b8000a760 comp rx=0 tx=0).stop 2024-09-19T08:20:43.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.838+0000 7f2ba037a740 1 -- 172.21.15.27:0/675841360 shutdown_connections 2024-09-19T08:20:43.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.838+0000 7f2ba037a740 1 --2- 172.21.15.27:0/675841360 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca876370 0x559cca878760 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.838+0000 7f2ba037a740 1 --2- 172.21.15.27:0/675841360 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86b5d0 0x559cca86ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.838+0000 7f2ba037a740 1 --2- 172.21.15.27:0/675841360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca86cb40 0x559cca86b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.838+0000 7f2ba037a740 1 -- 172.21.15.27:0/675841360 >> 172.21.15.27:0/675841360 conn(0x559cca834310 msgr2=0x559cca867c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:43.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.838+0000 7f2ba037a740 1 -- 172.21.15.27:0/675841360 shutdown_connections 2024-09-19T08:20:43.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.838+0000 7f2ba037a740 1 -- 172.21.15.27:0/675841360 wait complete. 2024-09-19T08:20:43.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.838+0000 7f2ba037a740 1 -- start start 2024-09-19T08:20:43.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.839+0000 7f2ba037a740 1 Processor -- start 2024-09-19T08:20:43.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.839+0000 7f2ba037a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86b5d0 0x559cca875d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:43.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.839+0000 7f2ba037a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86cb40 0x559cca873020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:43.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.839+0000 7f2ba037a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca876370 0x559cca873610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:43.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.839+0000 7f2ba037a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559cca879070 con 0x559cca86cb40 2024-09-19T08:20:43.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.839+0000 7f2ba037a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559cca78c060 con 0x559cca876370 2024-09-19T08:20:43.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.839+0000 7f2ba037a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559cca8791f0 con 0x559cca86b5d0 2024-09-19T08:20:43.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.839+0000 7f2ba037a740 10 client.0 _ll_register_callbacks cb 0x559cca4df8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:20:43.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.839+0000 7f2b977fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86cb40 0x559cca873020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:43.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.839+0000 7f2b977fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86cb40 0x559cca873020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60080/0 (socket says 172.21.15.27:60080) 2024-09-19T08:20:43.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.839+0000 7f2b977fe640 1 -- 172.21.15.27:0/614807801 learned_addr learned my addr 172.21.15.27:0/614807801 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:43.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.839+0000 7f2b96ffd640 1 --2- 172.21.15.27:0/614807801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca876370 0x559cca873610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:43.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.839+0000 7f2b96ffd640 1 --2- 172.21.15.27:0/614807801 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86b5d0 0x559cca875d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:43.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.839+0000 7f2b977fe640 1 -- 172.21.15.27:0/614807801 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86b5d0 msgr2=0x559cca875d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:43.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.839+0000 7f2b977fe640 1 --2- 172.21.15.27:0/614807801 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86b5d0 0x559cca875d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.839+0000 7f2b977fe640 1 -- 172.21.15.27:0/614807801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca876370 msgr2=0x559cca873610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:43.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.839+0000 7f2b977fe640 1 --2- 172.21.15.27:0/614807801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca876370 0x559cca873610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.839+0000 7f2b977fe640 1 -- 172.21.15.27:0/614807801 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cca5423c0 con 0x559cca86cb40 2024-09-19T08:20:43.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.839+0000 7f2b96ffd640 1 --2- 172.21.15.27:0/614807801 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86b5d0 0x559cca875d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:20:43.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.840+0000 7f2b977fe640 1 --2- 172.21.15.27:0/614807801 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86cb40 0x559cca873020 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009ee0 tx=0x7f2b88011630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47eec950fc0bf4cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:43.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.840+0000 7f2b76ffd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:20:43.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.840+0000 7f2b76ffd640 1 -- 172.21.15.27:0/614807801 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88019070 con 0x559cca86cb40 2024-09-19T08:20:43.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.840+0000 7f2b76ffd640 1 -- 172.21.15.27:0/614807801 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7f2b88015660 con 0x559cca86cb40 2024-09-19T08:20:43.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.840+0000 7f2ba037a740 1 -- 172.21.15.27:0/614807801 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b80005020 con 0x559cca86cb40 2024-09-19T08:20:43.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.840+0000 7f2b76ffd640 1 -- 172.21.15.27:0/614807801 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2b88025050 con 0x559cca86cb40 2024-09-19T08:20:43.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.840+0000 7f2ba037a740 10 client.16890 fetch_fsmap learned FSMap version 20 2024-09-19T08:20:43.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.840+0000 7f2ba037a740 1 -- 172.21.15.27:0/614807801 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559cca884bf0 con 0x559cca86cb40 2024-09-19T08:20:43.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.840+0000 7f2b76ffd640 1 -- 172.21.15.27:0/614807801 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b80005020 con 0x559cca86cb40 2024-09-19T08:20:43.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.840+0000 7f2b76ffd640 1 -- 172.21.15.27:0/614807801 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2b88014b40 con 0x559cca86cb40 2024-09-19T08:20:43.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.840+0000 7f2ba037a740 10 client.16890 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:20:43.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.840+0000 7f2ba037a740 10 client.16890 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:20:43.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.840+0000 7f2ba037a740 20 client.16890 populate_metadata read hostname 'smithi027' 2024-09-19T08:20:43.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.840+0000 7f2ba037a740 1 --2- 172.21.15.27:0/614807801 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559cca8860a0 0x559cca8884c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:43.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.840+0000 7f2ba037a740 4 client.16890 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:20:43.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.840+0000 7f2ba037a740 1 -- 172.21.15.27:0/614807801 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559cca7de860 con 0x559cca8860a0 2024-09-19T08:20:43.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.841+0000 7f2b96ffd640 1 --2- 172.21.15.27:0/614807801 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559cca8860a0 0x559cca8884c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:43.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.841+0000 7f2b96ffd640 1 --2- 172.21.15.27:0/614807801 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559cca8860a0 0x559cca8884c0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e99c512684b9ea64 server_cookie=cfd1ef4c002675a1 in_seq=0 out_seq=0 2024-09-19T08:20:43.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.841+0000 7f2b76ffd640 10 client.16890 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:43.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.842+0000 7f2b76ffd640 1 -- 172.21.15.27:0/614807801 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559cca7de860 con 0x559cca8860a0 2024-09-19T08:20:43.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.842+0000 7f2b76ffd640 10 client.16890 handle_command_reply: tid=0 2024-09-19T08:20:43.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.842+0000 7f2ba037a740 1 client.16890 shutdown 2024-09-19T08:20:43.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.842+0000 7f2ba037a740 1 -- 172.21.15.27:0/614807801 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86cb40 msgr2=0x559cca873020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:43.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.842+0000 7f2ba037a740 1 --2- 172.21.15.27:0/614807801 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86cb40 0x559cca873020 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009ee0 tx=0x7f2b88011630 comp rx=0 tx=0).stop 2024-09-19T08:20:43.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.843+0000 7f2ba037a740 1 -- 172.21.15.27:0/614807801 shutdown_connections 2024-09-19T08:20:43.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.843+0000 7f2ba037a740 1 --2- 172.21.15.27:0/614807801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca876370 0x559cca873610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.843+0000 7f2ba037a740 1 --2- 172.21.15.27:0/614807801 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86cb40 0x559cca873020 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.843+0000 7f2ba037a740 1 --2- 172.21.15.27:0/614807801 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559cca8860a0 0x559cca8884c0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.843+0000 7f2ba037a740 1 --2- 172.21.15.27:0/614807801 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86b5d0 0x559cca875d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.843+0000 7f2b76ffd640 0 client.16890 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:43.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.843+0000 7f2ba037a740 1 -- 172.21.15.27:0/614807801 >> 172.21.15.27:0/614807801 conn(0x559cca834310 msgr2=0x559cca86d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:43.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.843+0000 7f2ba037a740 1 -- 172.21.15.27:0/614807801 shutdown_connections 2024-09-19T08:20:43.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.843+0000 7f2ba037a740 1 -- 172.21.15.27:0/614807801 wait complete. 2024-09-19T08:20:43.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.843+0000 7f2ba037a740 20 client.16890 trim_cache size 0 max 16384 2024-09-19T08:20:43.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.856+0000 7f2ba037a740 1 Processor -- start 2024-09-19T08:20:43.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.856+0000 7f2ba037a740 1 -- start start 2024-09-19T08:20:43.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.856+0000 7f2ba037a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86b5d0 0x559cca867d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:43.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.856+0000 7f2ba037a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86cb40 0x559cca882340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:43.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.856+0000 7f2ba037a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca876370 0x559cca872000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:43.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.856+0000 7f2ba037a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2b981ad8a0 con 0x559cca86b5d0 2024-09-19T08:20:43.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.856+0000 7f2ba037a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2b981b0100 con 0x559cca876370 2024-09-19T08:20:43.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.856+0000 7f2ba037a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2b981adef0 con 0x559cca86cb40 2024-09-19T08:20:43.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.857+0000 7f2b96ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86b5d0 0x559cca867d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:43.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.857+0000 7f2b96ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86b5d0 0x559cca867d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60088/0 (socket says 172.21.15.27:60088) 2024-09-19T08:20:43.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.857+0000 7f2b96ffd640 1 -- 172.21.15.27:0/3736096886 learned_addr learned my addr 172.21.15.27:0/3736096886 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:43.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.857+0000 7f2b977fe640 1 --2- 172.21.15.27:0/3736096886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86cb40 0x559cca882340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:43.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.857+0000 7f2b96ffd640 1 --2- 172.21.15.27:0/3736096886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca876370 0x559cca872000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:43.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.857+0000 7f2b96ffd640 1 -- 172.21.15.27:0/3736096886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86cb40 msgr2=0x559cca882340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:43.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.857+0000 7f2b96ffd640 1 --2- 172.21.15.27:0/3736096886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86cb40 0x559cca882340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.857+0000 7f2b96ffd640 1 -- 172.21.15.27:0/3736096886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca876370 msgr2=0x559cca872000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:43.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.857+0000 7f2b96ffd640 1 --2- 172.21.15.27:0/3736096886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca876370 0x559cca872000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.857+0000 7f2b96ffd640 1 -- 172.21.15.27:0/3736096886 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cca888b20 con 0x559cca86b5d0 2024-09-19T08:20:43.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.857+0000 7f2b977fe640 1 --2- 172.21.15.27:0/3736096886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86cb40 0x559cca882340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:20:43.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.857+0000 7f2b96ffd640 1 --2- 172.21.15.27:0/3736096886 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86b5d0 0x559cca867d70 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000a710 tx=0x7f2b8001a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496d96becdd2607b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:43.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.857+0000 7f2b8d7fa640 1 -- 172.21.15.27:0/3736096886 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80024050 con 0x559cca86b5d0 2024-09-19T08:20:43.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.857+0000 7f2b8d7fa640 1 -- 172.21.15.27:0/3736096886 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b80028040 con 0x559cca86b5d0 2024-09-19T08:20:43.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.857+0000 7f2b8d7fa640 1 -- 172.21.15.27:0/3736096886 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80027040 con 0x559cca86b5d0 2024-09-19T08:20:43.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.858+0000 7f2ba037a740 1 -- 172.21.15.27:0/3736096886 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86b5d0 msgr2=0x559cca867d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:43.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.858+0000 7f2ba037a740 1 --2- 172.21.15.27:0/3736096886 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86b5d0 0x559cca867d70 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000a710 tx=0x7f2b8001a040 comp rx=0 tx=0).stop 2024-09-19T08:20:43.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.858+0000 7f2ba037a740 1 -- 172.21.15.27:0/3736096886 shutdown_connections 2024-09-19T08:20:43.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.858+0000 7f2ba037a740 1 --2- 172.21.15.27:0/3736096886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca876370 0x559cca872000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.858+0000 7f2ba037a740 1 --2- 172.21.15.27:0/3736096886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86cb40 0x559cca882340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.858+0000 7f2ba037a740 1 --2- 172.21.15.27:0/3736096886 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86b5d0 0x559cca867d70 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.858+0000 7f2ba037a740 1 -- 172.21.15.27:0/3736096886 >> 172.21.15.27:0/3736096886 conn(0x559cca834310 msgr2=0x559cca8718f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:43.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.858+0000 7f2ba037a740 1 -- 172.21.15.27:0/3736096886 shutdown_connections 2024-09-19T08:20:43.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.858+0000 7f2ba037a740 1 -- 172.21.15.27:0/3736096886 wait complete. 2024-09-19T08:20:43.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.859+0000 7f2ba037a740 1 -- start start 2024-09-19T08:20:43.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.859+0000 7f2ba037a740 1 Processor -- start 2024-09-19T08:20:43.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.859+0000 7f2ba037a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86b5d0 0x559cca879a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:43.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.859+0000 7f2ba037a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86cb40 0x559cca879f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:43.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.859+0000 7f2ba037a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca876370 0x559cca8eed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:43.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.859+0000 7f2ba037a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2b981ae5c0 con 0x559cca86cb40 2024-09-19T08:20:43.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.859+0000 7f2ba037a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2b981afa30 con 0x559cca876370 2024-09-19T08:20:43.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.859+0000 7f2ba037a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2b981aec90 con 0x559cca86b5d0 2024-09-19T08:20:43.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.859+0000 7f2ba037a740 10 client.0 _ll_register_callbacks cb 0x7f2b880094a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:20:43.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.859+0000 7f2b977fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86cb40 0x559cca879f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:43.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.859+0000 7f2b977fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86cb40 0x559cca879f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60096/0 (socket says 172.21.15.27:60096) 2024-09-19T08:20:43.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.859+0000 7f2b977fe640 1 -- 172.21.15.27:0/18582330 learned_addr learned my addr 172.21.15.27:0/18582330 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:43.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.859+0000 7f2b96ffd640 1 --2- 172.21.15.27:0/18582330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86b5d0 0x559cca879a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:43.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.860+0000 7f2b96ffd640 1 --2- 172.21.15.27:0/18582330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca876370 0x559cca8eed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:43.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.860+0000 7f2b977fe640 1 -- 172.21.15.27:0/18582330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86b5d0 msgr2=0x559cca879a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:43.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.860+0000 7f2b977fe640 1 --2- 172.21.15.27:0/18582330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86b5d0 0x559cca879a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.860+0000 7f2b977fe640 1 -- 172.21.15.27:0/18582330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca876370 msgr2=0x559cca8eed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:43.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.860+0000 7f2b977fe640 1 --2- 172.21.15.27:0/18582330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca876370 0x559cca8eed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.860+0000 7f2b977fe640 1 -- 172.21.15.27:0/18582330 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cca8ef340 con 0x559cca86cb40 2024-09-19T08:20:43.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.860+0000 7f2b96ffd640 1 --2- 172.21.15.27:0/18582330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca876370 0x559cca8eed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:20:43.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.860+0000 7f2b977fe640 1 --2- 172.21.15.27:0/18582330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86cb40 0x559cca879f50 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x559cca874660 tx=0x7f2b88006dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e13d16e75e6c801 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:43.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.860+0000 7f2b76ffd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:20:43.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.860+0000 7f2b76ffd640 1 -- 172.21.15.27:0/18582330 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8802d020 con 0x559cca86cb40 2024-09-19T08:20:43.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.860+0000 7f2ba037a740 1 -- 172.21.15.27:0/18582330 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b80028040 con 0x559cca86cb40 2024-09-19T08:20:43.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.860+0000 7f2b76ffd640 1 -- 172.21.15.27:0/18582330 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7f2b88005bc0 con 0x559cca86cb40 2024-09-19T08:20:43.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.860+0000 7f2b76ffd640 1 -- 172.21.15.27:0/18582330 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2b88038050 con 0x559cca86cb40 2024-09-19T08:20:43.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.860+0000 7f2ba037a740 10 client.16896 fetch_fsmap learned FSMap version 20 2024-09-19T08:20:43.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.860+0000 7f2ba037a740 1 -- 172.21.15.27:0/18582330 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559cca8f0570 con 0x559cca86cb40 2024-09-19T08:20:43.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.861+0000 7f2b76ffd640 1 -- 172.21.15.27:0/18582330 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b80028040 con 0x559cca86cb40 2024-09-19T08:20:43.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.861+0000 7f2b76ffd640 1 -- 172.21.15.27:0/18582330 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2b88006410 con 0x559cca86cb40 2024-09-19T08:20:43.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.861+0000 7f2ba037a740 10 client.16896 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:20:43.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.861+0000 7f2ba037a740 10 client.16896 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:20:43.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.861+0000 7f2ba037a740 20 client.16896 populate_metadata read hostname 'smithi027' 2024-09-19T08:20:43.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.861+0000 7f2ba037a740 1 --2- 172.21.15.27:0/18582330 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559cca8f0ce0 0x559cca8f3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:43.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.861+0000 7f2ba037a740 4 client.16896 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:20:43.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.861+0000 7f2ba037a740 1 -- 172.21.15.27:0/18582330 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559cca7d8d70 con 0x559cca8f0ce0 2024-09-19T08:20:43.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.861+0000 7f2b96ffd640 1 --2- 172.21.15.27:0/18582330 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559cca8f0ce0 0x559cca8f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:43.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.862+0000 7f2b76ffd640 10 client.16896 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:43.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.862+0000 7f2b96ffd640 1 --2- 172.21.15.27:0/18582330 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559cca8f0ce0 0x559cca8f3100 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16949b0212472d64 server_cookie=c5acf1e723ca7d07 in_seq=0 out_seq=0 2024-09-19T08:20:43.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.862+0000 7f2b76ffd640 1 -- 172.21.15.27:0/18582330 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559cca7d8d70 con 0x559cca8f0ce0 2024-09-19T08:20:43.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.862+0000 7f2b76ffd640 10 client.16896 handle_command_reply: tid=0 2024-09-19T08:20:43.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.862+0000 7f2ba037a740 1 client.16896 shutdown 2024-09-19T08:20:43.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.862+0000 7f2ba037a740 1 -- 172.21.15.27:0/18582330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86cb40 msgr2=0x559cca879f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:43.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.862+0000 7f2ba037a740 1 --2- 172.21.15.27:0/18582330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86cb40 0x559cca879f50 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x559cca874660 tx=0x7f2b88006dd0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.862+0000 7f2ba037a740 1 -- 172.21.15.27:0/18582330 shutdown_connections 2024-09-19T08:20:43.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.862+0000 7f2ba037a740 1 --2- 172.21.15.27:0/18582330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559cca876370 0x559cca8eed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.862+0000 7f2ba037a740 1 --2- 172.21.15.27:0/18582330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559cca86cb40 0x559cca879f50 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.862+0000 7f2ba037a740 1 --2- 172.21.15.27:0/18582330 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559cca8f0ce0 0x559cca8f3100 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.862+0000 7f2ba037a740 1 --2- 172.21.15.27:0/18582330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559cca86b5d0 0x559cca879a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.862+0000 7f2b76ffd640 0 client.16896 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:43.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.862+0000 7f2ba037a740 1 -- 172.21.15.27:0/18582330 >> 172.21.15.27:0/18582330 conn(0x559cca834310 msgr2=0x559cca872110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:43.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.862+0000 7f2ba037a740 1 -- 172.21.15.27:0/18582330 shutdown_connections 2024-09-19T08:20:43.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.862+0000 7f2ba037a740 1 -- 172.21.15.27:0/18582330 wait complete. 2024-09-19T08:20:43.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.862+0000 7f2ba037a740 20 client.16896 trim_cache size 0 max 16384 2024-09-19T08:20:43.870 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:20:43.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.863+0000 7f2b9dfa1640 1 -- 172.21.15.27:0/4017038341 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2b840a33b0 msgr2=0x7f2b840a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:43.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.863+0000 7f2b9dfa1640 1 --2- 172.21.15.27:0/4017038341 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2b840a33b0 0x7f2b840a5870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2b900bd5f0 tx=0x7f2b900a8040 comp rx=0 tx=0).stop 2024-09-19T08:20:43.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.863+0000 7f2b9dfa1640 1 -- 172.21.15.27:0/4017038341 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b98106a80 msgr2=0x7f2b980fd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:43.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.863+0000 7f2b9dfa1640 1 --2- 172.21.15.27:0/4017038341 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b98106a80 0x7f2b980fd770 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f2b90006010 tx=0x7f2b90003c20 comp rx=0 tx=0).stop 2024-09-19T08:20:43.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.863+0000 7f2b9dfa1640 1 -- 172.21.15.27:0/4017038341 shutdown_connections 2024-09-19T08:20:43.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.863+0000 7f2b9dfa1640 1 --2- 172.21.15.27:0/4017038341 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f2b840a33b0 0x7f2b840a5870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.863+0000 7f2b9dfa1640 1 --2- 172.21.15.27:0/4017038341 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b98106a80 0x7f2b980fd770 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.863+0000 7f2b9dfa1640 1 --2- 172.21.15.27:0/4017038341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b98101420 0x7f2b980fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.863+0000 7f2b9dfa1640 1 --2- 172.21.15.27:0/4017038341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b98100a80 0x7f2b980fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:43.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.863+0000 7f2b9dfa1640 1 -- 172.21.15.27:0/4017038341 >> 172.21.15.27:0/4017038341 conn(0x7f2b980fc7a0 msgr2=0x7f2b9806a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:43.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.863+0000 7f2b9dfa1640 1 -- 172.21.15.27:0/4017038341 shutdown_connections 2024-09-19T08:20:43.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:43.863+0000 7f2b9dfa1640 1 -- 172.21.15.27:0/4017038341 wait complete. 2024-09-19T08:20:45.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:44 smithi155 ceph-mon[35362]: pgmap v300: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:20:45.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:44 smithi027 ceph-mon[31209]: pgmap v300: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:20:45.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:44 smithi203 ceph-mon[35198]: pgmap v300: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:20:45.680 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:20:45.681 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:20:45.953 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:20:46.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.452+0000 7efe97fdf640 1 -- 172.21.15.27:0/406384229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe90102db0 msgr2=0x7efe90103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:46.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.452+0000 7efe97fdf640 1 --2- 172.21.15.27:0/406384229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe90102db0 0x7efe90103190 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7efe88009930 tx=0x7efe8802a440 comp rx=0 tx=0).stop 2024-09-19T08:20:46.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.452+0000 7efe97fdf640 1 -- 172.21.15.27:0/406384229 shutdown_connections 2024-09-19T08:20:46.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.452+0000 7efe97fdf640 1 --2- 172.21.15.27:0/406384229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe901082e0 0x7efe9010ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.452+0000 7efe97fdf640 1 --2- 172.21.15.27:0/406384229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe90103760 0x7efe90107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.452+0000 7efe97fdf640 1 --2- 172.21.15.27:0/406384229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe90102db0 0x7efe90103190 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.452+0000 7efe97fdf640 1 -- 172.21.15.27:0/406384229 >> 172.21.15.27:0/406384229 conn(0x7efe900fc7d0 msgr2=0x7efe900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:46.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.452+0000 7efe97fdf640 1 -- 172.21.15.27:0/406384229 shutdown_connections 2024-09-19T08:20:46.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.452+0000 7efe97fdf640 1 -- 172.21.15.27:0/406384229 wait complete. 2024-09-19T08:20:46.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.452+0000 7efe97fdf640 1 Processor -- start 2024-09-19T08:20:46.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.452+0000 7efe97fdf640 1 -- start start 2024-09-19T08:20:46.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.453+0000 7efe97fdf640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe90102db0 0x7efe901985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:46.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.453+0000 7efe97fdf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe90103760 0x7efe90198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:46.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.453+0000 7efe97fdf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe901082e0 0x7efe9019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:46.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.453+0000 7efe97fdf640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7efe901120f0 con 0x7efe90103760 2024-09-19T08:20:46.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.453+0000 7efe97fdf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efe90111f70 con 0x7efe901082e0 2024-09-19T08:20:46.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.453+0000 7efe97fdf640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efe90112270 con 0x7efe90102db0 2024-09-19T08:20:46.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.453+0000 7efe9557a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe90103760 0x7efe90198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:46.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.453+0000 7efe9557a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe90103760 0x7efe90198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60120/0 (socket says 172.21.15.27:60120) 2024-09-19T08:20:46.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.453+0000 7efe9557a640 1 -- 172.21.15.27:0/3768604523 learned_addr learned my addr 172.21.15.27:0/3768604523 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:46.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.453+0000 7efe9557a640 1 -- 172.21.15.27:0/3768604523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe90102db0 msgr2=0x7efe901985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:46.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.453+0000 7efe95d7b640 1 --2- 172.21.15.27:0/3768604523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe90102db0 0x7efe901985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:46.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.453+0000 7efe9657c640 1 --2- 172.21.15.27:0/3768604523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe901082e0 0x7efe9019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:46.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.453+0000 7efe9557a640 1 --2- 172.21.15.27:0/3768604523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe90102db0 0x7efe901985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.453+0000 7efe9557a640 1 -- 172.21.15.27:0/3768604523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe901082e0 msgr2=0x7efe9019cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:46.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.453+0000 7efe9557a640 1 --2- 172.21.15.27:0/3768604523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe901082e0 0x7efe9019cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.453+0000 7efe9557a640 1 -- 172.21.15.27:0/3768604523 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9019d5a0 con 0x7efe90103760 2024-09-19T08:20:46.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.453+0000 7efe9557a640 1 --2- 172.21.15.27:0/3768604523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe90103760 0x7efe90198b30 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7efe84006fd0 tx=0x7efe8400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:46.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.453+0000 7efe8effd640 1 -- 172.21.15.27:0/3768604523 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe84011830 con 0x7efe90103760 2024-09-19T08:20:46.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.453+0000 7efe8effd640 1 -- 172.21.15.27:0/3768604523 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe84016070 con 0x7efe90103760 2024-09-19T08:20:46.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.453+0000 7efe97fdf640 1 -- 172.21.15.27:0/3768604523 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe9019d890 con 0x7efe90103760 2024-09-19T08:20:46.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.454+0000 7efe8effd640 1 -- 172.21.15.27:0/3768604523 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8400f2e0 con 0x7efe90103760 2024-09-19T08:20:46.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.454+0000 7efe97fdf640 1 -- 172.21.15.27:0/3768604523 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe901a5170 con 0x7efe90103760 2024-09-19T08:20:46.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.456+0000 7efe8effd640 1 -- 172.21.15.27:0/3768604523 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7efe8401b460 con 0x7efe90103760 2024-09-19T08:20:46.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.456+0000 7efe9a3b8740 1 Processor -- start 2024-09-19T08:20:46.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.456+0000 7efe9a3b8740 1 -- start start 2024-09-19T08:20:46.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.456+0000 7efe9a3b8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01bcb60 0x55d3d01bcf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:46.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.456+0000 7efe9a3b8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01bd480 0x55d3d01c7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:46.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.456+0000 7efe9a3b8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01c7d40 0x55d3d01ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:46.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.456+0000 7efe9a3b8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55d3d0122280 con 0x55d3d01c7d40 2024-09-19T08:20:46.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.456+0000 7efe9a3b8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d3d00c9b10 con 0x55d3d01bd480 2024-09-19T08:20:46.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.456+0000 7efe9a3b8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d3d011e240 con 0x55d3d01bcb60 2024-09-19T08:20:46.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.457+0000 7efe9557a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01c7d40 0x55d3d01ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:46.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.457+0000 7efe8effd640 1 --2- 172.21.15.27:0/3768604523 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7efe780a33b0 0x7efe780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:46.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.457+0000 7efe9557a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01c7d40 0x55d3d01ca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60130/0 (socket says 172.21.15.27:60130) 2024-09-19T08:20:46.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.457+0000 7efe9557a640 1 -- 172.21.15.27:0/3753438937 learned_addr learned my addr 172.21.15.27:0/3753438937 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:46.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.457+0000 7efe95d7b640 1 --2- 172.21.15.27:0/3753438937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01bd480 0x55d3d01c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:46.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.457+0000 7efe9657c640 1 --2- 172.21.15.27:0/3753438937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01bcb60 0x55d3d01bcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:46.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.457+0000 7efe9657c640 1 --2- 172.21.15.27:0/3768604523 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7efe780a33b0 0x7efe780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:46.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.457+0000 7efe8effd640 1 -- 172.21.15.27:0/3768604523 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7efe840cf330 con 0x7efe90103760 2024-09-19T08:20:46.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.457+0000 7efe9557a640 1 -- 172.21.15.27:0/3753438937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01bcb60 msgr2=0x55d3d01bcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:46.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.457+0000 7efe9557a640 1 --2- 172.21.15.27:0/3753438937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01bcb60 0x55d3d01bcf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.457+0000 7efe9557a640 1 -- 172.21.15.27:0/3753438937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01bd480 msgr2=0x55d3d01c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:46.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.457+0000 7efe9557a640 1 --2- 172.21.15.27:0/3753438937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01bd480 0x55d3d01c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.457+0000 7efe9557a640 1 -- 172.21.15.27:0/3753438937 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3d00d61f0 con 0x55d3d01c7d40 2024-09-19T08:20:46.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.457+0000 7efe9557a640 1 --2- 172.21.15.27:0/3753438937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01c7d40 0x55d3d01ca130 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7efe84097ba0 tx=0x7efe840108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48cdae2f4b97b7dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:46.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.457+0000 7efe9657c640 1 --2- 172.21.15.27:0/3768604523 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7efe780a33b0 0x7efe780a5870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efe80009fd0 tx=0x7efe80004a40 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:46.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.457+0000 7efe77fff640 1 -- 172.21.15.27:0/3753438937 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8409be40 con 0x55d3d01c7d40 2024-09-19T08:20:46.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.458+0000 7efe77fff640 1 -- 172.21.15.27:0/3753438937 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe8409b740 con 0x55d3d01c7d40 2024-09-19T08:20:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.458+0000 7efe77fff640 1 -- 172.21.15.27:0/3753438937 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe840cceb0 con 0x55d3d01c7d40 2024-09-19T08:20:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.458+0000 7efe9a3b8740 1 -- 172.21.15.27:0/3753438937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01c7d40 msgr2=0x55d3d01ca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.458+0000 7efe9a3b8740 1 --2- 172.21.15.27:0/3753438937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01c7d40 0x55d3d01ca130 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7efe84097ba0 tx=0x7efe840108e0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.458+0000 7efe9a3b8740 1 -- 172.21.15.27:0/3753438937 shutdown_connections 2024-09-19T08:20:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.458+0000 7efe9a3b8740 1 --2- 172.21.15.27:0/3753438937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01c7d40 0x55d3d01ca130 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.458+0000 7efe9a3b8740 1 --2- 172.21.15.27:0/3753438937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01bd480 0x55d3d01c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.458+0000 7efe9a3b8740 1 --2- 172.21.15.27:0/3753438937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01bcb60 0x55d3d01bcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.458+0000 7efe9a3b8740 1 -- 172.21.15.27:0/3753438937 >> 172.21.15.27:0/3753438937 conn(0x55d3d01b90f0 msgr2=0x55d3d01b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.458+0000 7efe9a3b8740 1 -- 172.21.15.27:0/3753438937 shutdown_connections 2024-09-19T08:20:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.458+0000 7efe9a3b8740 1 -- 172.21.15.27:0/3753438937 wait complete. 2024-09-19T08:20:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.459+0000 7efe9a3b8740 1 -- start start 2024-09-19T08:20:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.459+0000 7efe9a3b8740 1 Processor -- start 2024-09-19T08:20:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.459+0000 7efe9a3b8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01bcb60 0x55d3d01c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.459+0000 7efe9a3b8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01bd480 0x55d3d01c5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.459+0000 7efe9a3b8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01c7d40 0x55d3d01c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.459+0000 7efe9a3b8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55d3d01ca910 con 0x55d3d01bd480 2024-09-19T08:20:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.459+0000 7efe9a3b8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d3d00dcf10 con 0x55d3d01bcb60 2024-09-19T08:20:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.459+0000 7efe9a3b8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d3d01caa90 con 0x55d3d01c7d40 2024-09-19T08:20:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.459+0000 7efe9a3b8740 10 client.0 _ll_register_callbacks cb 0x55d3d00a5a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:20:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.459+0000 7efe9557a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01bd480 0x55d3d01c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.459+0000 7efe9557a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01bd480 0x55d3d01c5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60134/0 (socket says 172.21.15.27:60134) 2024-09-19T08:20:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.459+0000 7efe9557a640 1 -- 172.21.15.27:0/90260387 learned_addr learned my addr 172.21.15.27:0/90260387 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.459+0000 7efe95d7b640 1 --2- 172.21.15.27:0/90260387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01bcb60 0x55d3d01c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.460+0000 7efe9657c640 1 --2- 172.21.15.27:0/90260387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01c7d40 0x55d3d01c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.460+0000 7efe9557a640 1 -- 172.21.15.27:0/90260387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01c7d40 msgr2=0x55d3d01c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.460+0000 7efe9557a640 1 --2- 172.21.15.27:0/90260387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01c7d40 0x55d3d01c56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.460+0000 7efe9557a640 1 -- 172.21.15.27:0/90260387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01bcb60 msgr2=0x55d3d01c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:46.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.460+0000 7efe9557a640 1 --2- 172.21.15.27:0/90260387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01bcb60 0x55d3d01c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.460+0000 7efe9557a640 1 -- 172.21.15.27:0/90260387 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3cfe936a0 con 0x55d3d01bd480 2024-09-19T08:20:46.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.460+0000 7efe95d7b640 1 --2- 172.21.15.27:0/90260387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01bcb60 0x55d3d01c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:20:46.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.460+0000 7efe9657c640 1 --2- 172.21.15.27:0/90260387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01c7d40 0x55d3d01c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:20:46.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.460+0000 7efe9557a640 1 --2- 172.21.15.27:0/90260387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01bd480 0x55d3d01c5180 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7efe8409b440 tx=0x7efe840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cb47688a517ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:46.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.460+0000 7efe757fa640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:20:46.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.460+0000 7efe757fa640 1 -- 172.21.15.27:0/90260387 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8409be40 con 0x55d3d01bd480 2024-09-19T08:20:46.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.460+0000 7efe757fa640 1 -- 172.21.15.27:0/90260387 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7efe8409ab90 con 0x55d3d01bd480 2024-09-19T08:20:46.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.460+0000 7efe9a3b8740 1 -- 172.21.15.27:0/90260387 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe8409b740 con 0x55d3d01bd480 2024-09-19T08:20:46.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.460+0000 7efe757fa640 1 -- 172.21.15.27:0/90260387 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7efe8409faf0 con 0x55d3d01bd480 2024-09-19T08:20:46.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.460+0000 7efe9a3b8740 10 client.16908 fetch_fsmap learned FSMap version 20 2024-09-19T08:20:46.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.460+0000 7efe9a3b8740 1 -- 172.21.15.27:0/90260387 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d3d01ca910 con 0x55d3d01bd480 2024-09-19T08:20:46.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.460+0000 7efe757fa640 1 -- 172.21.15.27:0/90260387 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe8409b740 con 0x55d3d01bd480 2024-09-19T08:20:46.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.461+0000 7efe757fa640 1 -- 172.21.15.27:0/90260387 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7efe8409a800 con 0x55d3d01bd480 2024-09-19T08:20:46.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.461+0000 7efe9a3b8740 10 client.16908 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:20:46.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.461+0000 7efe9a3b8740 10 client.16908 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:20:46.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.461+0000 7efe9a3b8740 20 client.16908 populate_metadata read hostname 'smithi027' 2024-09-19T08:20:46.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.461+0000 7efe9a3b8740 1 --2- 172.21.15.27:0/90260387 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55d3d01d76c0 0x55d3d01d9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:46.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.461+0000 7efe9a3b8740 4 client.16908 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:20:46.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.461+0000 7efe9a3b8740 1 -- 172.21.15.27:0/90260387 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3d012f7f0 con 0x55d3d01d76c0 2024-09-19T08:20:46.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.461+0000 7efe95d7b640 1 --2- 172.21.15.27:0/90260387 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55d3d01d76c0 0x55d3d01d9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:46.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.461+0000 7efe757fa640 10 client.16908 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:46.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.461+0000 7efe95d7b640 1 --2- 172.21.15.27:0/90260387 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55d3d01d76c0 0x55d3d01d9ab0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d71b4e9b2721b896 server_cookie=8734feab33a574a9 in_seq=0 out_seq=0 2024-09-19T08:20:46.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.462+0000 7efe757fa640 1 -- 172.21.15.27:0/90260387 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d3d012f7f0 con 0x55d3d01d76c0 2024-09-19T08:20:46.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.462+0000 7efe757fa640 10 client.16908 handle_command_reply: tid=0 2024-09-19T08:20:46.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.462+0000 7efe9a3b8740 1 client.16908 shutdown 2024-09-19T08:20:46.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.462+0000 7efe9a3b8740 1 -- 172.21.15.27:0/90260387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01bd480 msgr2=0x55d3d01c5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:46.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.462+0000 7efe9a3b8740 1 --2- 172.21.15.27:0/90260387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01bd480 0x55d3d01c5180 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7efe8409b440 tx=0x7efe840046c0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.462+0000 7efe9a3b8740 1 -- 172.21.15.27:0/90260387 shutdown_connections 2024-09-19T08:20:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.462+0000 7efe9a3b8740 1 --2- 172.21.15.27:0/90260387 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55d3d01d76c0 0x55d3d01d9ab0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.462+0000 7efe9a3b8740 1 --2- 172.21.15.27:0/90260387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01c7d40 0x55d3d01c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.462+0000 7efe9a3b8740 1 --2- 172.21.15.27:0/90260387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01bd480 0x55d3d01c5180 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.462+0000 7efe9a3b8740 1 --2- 172.21.15.27:0/90260387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01bcb60 0x55d3d01c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.462+0000 7efe9a3b8740 1 -- 172.21.15.27:0/90260387 >> 172.21.15.27:0/90260387 conn(0x55d3d01b90f0 msgr2=0x55d3d01bedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.462+0000 7efe757fa640 0 client.16908 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.462+0000 7efe9a3b8740 1 -- 172.21.15.27:0/90260387 shutdown_connections 2024-09-19T08:20:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.462+0000 7efe9a3b8740 1 -- 172.21.15.27:0/90260387 wait complete. 2024-09-19T08:20:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.462+0000 7efe9a3b8740 20 client.16908 trim_cache size 0 max 16384 2024-09-19T08:20:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.480+0000 7efe9a3b8740 1 Processor -- start 2024-09-19T08:20:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.480+0000 7efe9a3b8740 1 -- start start 2024-09-19T08:20:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.480+0000 7efe9a3b8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01bcb60 0x55d3d01becc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.480+0000 7efe9a3b8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01bd480 0x55d3d01df1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.480+0000 7efe9a3b8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01c7d40 0x55d3d01df730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.480+0000 7efe9a3b8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7efe901ab8f0 con 0x55d3d01c7d40 2024-09-19T08:20:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.480+0000 7efe9a3b8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efe901ae150 con 0x55d3d01bcb60 2024-09-19T08:20:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.480+0000 7efe9a3b8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efe901abf40 con 0x55d3d01bd480 2024-09-19T08:20:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.480+0000 7efe9657c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01c7d40 0x55d3d01df730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.480+0000 7efe9657c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01c7d40 0x55d3d01df730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60138/0 (socket says 172.21.15.27:60138) 2024-09-19T08:20:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.480+0000 7efe9657c640 1 -- 172.21.15.27:0/96589675 learned_addr learned my addr 172.21.15.27:0/96589675 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.480+0000 7efe9557a640 1 --2- 172.21.15.27:0/96589675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01bd480 0x55d3d01df1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.480+0000 7efe95d7b640 1 --2- 172.21.15.27:0/96589675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01bcb60 0x55d3d01becc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.480+0000 7efe9657c640 1 -- 172.21.15.27:0/96589675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01bd480 msgr2=0x55d3d01df1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.480+0000 7efe9657c640 1 --2- 172.21.15.27:0/96589675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01bd480 0x55d3d01df1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.480+0000 7efe9657c640 1 -- 172.21.15.27:0/96589675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01bcb60 msgr2=0x55d3d01becc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.480+0000 7efe9657c640 1 --2- 172.21.15.27:0/96589675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01bcb60 0x55d3d01becc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.480+0000 7efe9657c640 1 -- 172.21.15.27:0/96589675 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3d01c3bf0 con 0x55d3d01c7d40 2024-09-19T08:20:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.481+0000 7efe9657c640 1 --2- 172.21.15.27:0/96589675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01c7d40 0x55d3d01df730 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7efe80005c00 tx=0x7efe80016070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75dc694edb9b9efa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.481+0000 7efe777fe640 1 -- 172.21.15.27:0/96589675 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe80025030 con 0x55d3d01c7d40 2024-09-19T08:20:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.481+0000 7efe777fe640 1 -- 172.21.15.27:0/96589675 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe80011db0 con 0x55d3d01c7d40 2024-09-19T08:20:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.481+0000 7efe777fe640 1 -- 172.21.15.27:0/96589675 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe80021460 con 0x55d3d01c7d40 2024-09-19T08:20:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.481+0000 7efe9a3b8740 1 -- 172.21.15.27:0/96589675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01c7d40 msgr2=0x55d3d01df730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.481+0000 7efe9a3b8740 1 --2- 172.21.15.27:0/96589675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01c7d40 0x55d3d01df730 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7efe80005c00 tx=0x7efe80016070 comp rx=0 tx=0).stop 2024-09-19T08:20:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.481+0000 7efe9a3b8740 1 -- 172.21.15.27:0/96589675 shutdown_connections 2024-09-19T08:20:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.481+0000 7efe9a3b8740 1 --2- 172.21.15.27:0/96589675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01c7d40 0x55d3d01df730 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.481+0000 7efe9a3b8740 1 --2- 172.21.15.27:0/96589675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01bd480 0x55d3d01df1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.481+0000 7efe9a3b8740 1 --2- 172.21.15.27:0/96589675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01bcb60 0x55d3d01becc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.481+0000 7efe9a3b8740 1 -- 172.21.15.27:0/96589675 >> 172.21.15.27:0/96589675 conn(0x55d3d01b90f0 msgr2=0x55d3d01be5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:46.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.482+0000 7efe9a3b8740 1 -- 172.21.15.27:0/96589675 shutdown_connections 2024-09-19T08:20:46.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.482+0000 7efe9a3b8740 1 -- 172.21.15.27:0/96589675 wait complete. 2024-09-19T08:20:46.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.482+0000 7efe9a3b8740 1 -- start start 2024-09-19T08:20:46.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.482+0000 7efe9a3b8740 1 Processor -- start 2024-09-19T08:20:46.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.482+0000 7efe9a3b8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01bcb60 0x55d3d01cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:46.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.482+0000 7efe9a3b8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01bd480 0x55d3d01d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:46.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.482+0000 7efe9a3b8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01c7d40 0x55d3d01ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:46.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.482+0000 7efe9a3b8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7efe901ac610 con 0x55d3d01bd480 2024-09-19T08:20:46.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.482+0000 7efe9a3b8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efe901ada80 con 0x55d3d01c7d40 2024-09-19T08:20:46.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.482+0000 7efe9a3b8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efe901acce0 con 0x55d3d01bcb60 2024-09-19T08:20:46.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.482+0000 7efe9a3b8740 10 client.0 _ll_register_callbacks cb 0x7efe88009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:20:46.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.482+0000 7efe9557a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01bd480 0x55d3d01d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:46.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.483+0000 7efe9557a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01bd480 0x55d3d01d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60146/0 (socket says 172.21.15.27:60146) 2024-09-19T08:20:46.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.483+0000 7efe9557a640 1 -- 172.21.15.27:0/3599653663 learned_addr learned my addr 172.21.15.27:0/3599653663 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:46.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.483+0000 7efe95d7b640 1 --2- 172.21.15.27:0/3599653663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01bcb60 0x55d3d01cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:46.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.483+0000 7efe9657c640 1 --2- 172.21.15.27:0/3599653663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01c7d40 0x55d3d01ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:46.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.483+0000 7efe9557a640 1 -- 172.21.15.27:0/3599653663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01bcb60 msgr2=0x55d3d01cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:46.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.483+0000 7efe9557a640 1 --2- 172.21.15.27:0/3599653663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01bcb60 0x55d3d01cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.483+0000 7efe9557a640 1 -- 172.21.15.27:0/3599653663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01c7d40 msgr2=0x55d3d01ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:46.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.483+0000 7efe9557a640 1 --2- 172.21.15.27:0/3599653663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01c7d40 0x55d3d01ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.483+0000 7efe9557a640 1 -- 172.21.15.27:0/3599653663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3d01cd540 con 0x55d3d01bd480 2024-09-19T08:20:46.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.483+0000 7efe9557a640 1 --2- 172.21.15.27:0/3599653663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01bd480 0x55d3d01d04b0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7efe840a0d20 tx=0x7efe840047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68883a54ed3c0f0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:46.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.483+0000 7efe757fa640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:20:46.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.483+0000 7efe757fa640 1 -- 172.21.15.27:0/3599653663 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe84065060 con 0x55d3d01bd480 2024-09-19T08:20:46.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.483+0000 7efe757fa640 1 -- 172.21.15.27:0/3599653663 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7efe8409ab90 con 0x55d3d01bd480 2024-09-19T08:20:46.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.483+0000 7efe9a3b8740 1 -- 172.21.15.27:0/3599653663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe80011db0 con 0x55d3d01bd480 2024-09-19T08:20:46.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.483+0000 7efe757fa640 1 -- 172.21.15.27:0/3599653663 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7efe840d3030 con 0x55d3d01bd480 2024-09-19T08:20:46.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.483+0000 7efe9a3b8740 10 client.16914 fetch_fsmap learned FSMap version 20 2024-09-19T08:20:46.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.483+0000 7efe9a3b8740 1 -- 172.21.15.27:0/3599653663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d3d01cd540 con 0x55d3d01bd480 2024-09-19T08:20:46.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.483+0000 7efe757fa640 1 -- 172.21.15.27:0/3599653663 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe80011db0 con 0x55d3d01bd480 2024-09-19T08:20:46.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.484+0000 7efe757fa640 1 -- 172.21.15.27:0/3599653663 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7efe84097490 con 0x55d3d01bd480 2024-09-19T08:20:46.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.484+0000 7efe9a3b8740 10 client.16914 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:20:46.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.484+0000 7efe9a3b8740 10 client.16914 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:20:46.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.484+0000 7efe9a3b8740 20 client.16914 populate_metadata read hostname 'smithi027' 2024-09-19T08:20:46.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.484+0000 7efe9a3b8740 1 --2- 172.21.15.27:0/3599653663 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55d3d02474b0 0x55d3d02498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:46.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.484+0000 7efe9a3b8740 4 client.16914 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:20:46.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.484+0000 7efe9a3b8740 1 -- 172.21.15.27:0/3599653663 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d3d0129d00 con 0x55d3d02474b0 2024-09-19T08:20:46.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.484+0000 7efe95d7b640 1 --2- 172.21.15.27:0/3599653663 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55d3d02474b0 0x55d3d02498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:46.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.484+0000 7efe95d7b640 1 --2- 172.21.15.27:0/3599653663 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55d3d02474b0 0x55d3d02498a0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3269884e9369857 server_cookie=dbf0633f9649e298 in_seq=0 out_seq=0 2024-09-19T08:20:46.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.484+0000 7efe757fa640 10 client.16914 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:46.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.485+0000 7efe757fa640 1 -- 172.21.15.27:0/3599653663 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d3d0129d00 con 0x55d3d02474b0 2024-09-19T08:20:46.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.485+0000 7efe757fa640 10 client.16914 handle_command_reply: tid=0 2024-09-19T08:20:46.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.485+0000 7efe9a3b8740 1 client.16914 shutdown 2024-09-19T08:20:46.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.486+0000 7efe9a3b8740 1 -- 172.21.15.27:0/3599653663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01bd480 msgr2=0x55d3d01d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:46.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.486+0000 7efe9a3b8740 1 --2- 172.21.15.27:0/3599653663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01bd480 0x55d3d01d04b0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7efe840a0d20 tx=0x7efe840047d0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.486+0000 7efe9a3b8740 1 -- 172.21.15.27:0/3599653663 shutdown_connections 2024-09-19T08:20:46.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.486+0000 7efe9a3b8740 1 --2- 172.21.15.27:0/3599653663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d3d01c7d40 0x55d3d01ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.486+0000 7efe9a3b8740 1 --2- 172.21.15.27:0/3599653663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3d01bd480 0x55d3d01d04b0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.486+0000 7efe9a3b8740 1 --2- 172.21.15.27:0/3599653663 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55d3d02474b0 0x55d3d02498a0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.486+0000 7efe9a3b8740 1 --2- 172.21.15.27:0/3599653663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3d01bcb60 0x55d3d01cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.486+0000 7efe757fa640 0 client.16914 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:46.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.486+0000 7efe9a3b8740 1 -- 172.21.15.27:0/3599653663 >> 172.21.15.27:0/3599653663 conn(0x55d3d01b90f0 msgr2=0x55d3d01b8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:46.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.486+0000 7efe9a3b8740 1 -- 172.21.15.27:0/3599653663 shutdown_connections 2024-09-19T08:20:46.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.486+0000 7efe9a3b8740 1 -- 172.21.15.27:0/3599653663 wait complete. 2024-09-19T08:20:46.605 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:20:46.605 INFO:teuthology.orchestra.run.smithi027.stdout: "return_code": 0, 2024-09-19T08:20:46.605 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_tag": "a43c1933-9ba1-4fce-ad79-28d2e851dc8b", 2024-09-19T08:20:46.605 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": "asynchronous" 2024-09-19T08:20:46.606 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:20:46.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.486+0000 7efe9a3b8740 20 client.16914 trim_cache size 0 max 16384 2024-09-19T08:20:46.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.487+0000 7efe97fdf640 1 -- 172.21.15.27:0/3768604523 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7efe780a33b0 msgr2=0x7efe780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:46.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.487+0000 7efe97fdf640 1 --2- 172.21.15.27:0/3768604523 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7efe780a33b0 0x7efe780a5870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efe80009fd0 tx=0x7efe80004a40 comp rx=0 tx=0).stop 2024-09-19T08:20:46.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.487+0000 7efe97fdf640 1 -- 172.21.15.27:0/3768604523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe90103760 msgr2=0x7efe90198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:46.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.487+0000 7efe97fdf640 1 --2- 172.21.15.27:0/3768604523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe90103760 0x7efe90198b30 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7efe84006fd0 tx=0x7efe8400b8e0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.487+0000 7efe97fdf640 1 -- 172.21.15.27:0/3768604523 shutdown_connections 2024-09-19T08:20:46.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.487+0000 7efe97fdf640 1 --2- 172.21.15.27:0/3768604523 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7efe780a33b0 0x7efe780a5870 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.487+0000 7efe97fdf640 1 --2- 172.21.15.27:0/3768604523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe901082e0 0x7efe9019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.487+0000 7efe97fdf640 1 --2- 172.21.15.27:0/3768604523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe90103760 0x7efe90198b30 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.487+0000 7efe97fdf640 1 --2- 172.21.15.27:0/3768604523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe90102db0 0x7efe901985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:46.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.487+0000 7efe97fdf640 1 -- 172.21.15.27:0/3768604523 >> 172.21.15.27:0/3768604523 conn(0x7efe900fc7d0 msgr2=0x7efe90106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:46.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.487+0000 7efe97fdf640 1 -- 172.21.15.27:0/3768604523 shutdown_connections 2024-09-19T08:20:46.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:46.487+0000 7efe97fdf640 1 -- 172.21.15.27:0/3768604523 wait complete. 2024-09-19T08:20:47.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:46 smithi155 ceph-mon[35362]: pgmap v301: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:47.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:46 smithi027 ceph-mon[31209]: pgmap v301: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:47.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:46 smithi203 ceph-mon[35198]: pgmap v301: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:20:47.371 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:20:47.633 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:20:48.027 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:47 smithi027 ceph-mon[31209]: scrub queued for path: / 2024-09-19T08:20:48.027 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:47 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:20:48.027 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:47 smithi027 ceph-mon[31209]: scrub summary: active paths [/] 2024-09-19T08:20:48.027 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:47 smithi027 ceph-mon[31209]: scrub summary: idle+waiting paths [/] 2024-09-19T08:20:48.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.111+0000 7fdaa8326640 1 -- 172.21.15.27:0/1482620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdaa0100d00 msgr2=0x7fdaa0106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:48.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.111+0000 7fdaa8326640 1 --2- 172.21.15.27:0/1482620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdaa0100d00 0x7fdaa0106840 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fda94009930 tx=0x7fda9402a420 comp rx=0 tx=0).stop 2024-09-19T08:20:48.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.111+0000 7fdaa8326640 1 -- 172.21.15.27:0/1482620 shutdown_connections 2024-09-19T08:20:48.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.111+0000 7fdaa8326640 1 --2- 172.21.15.27:0/1482620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaa0106f50 0x7fdaa010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.111+0000 7fdaa8326640 1 --2- 172.21.15.27:0/1482620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdaa0100d00 0x7fdaa0106840 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.111+0000 7fdaa8326640 1 --2- 172.21.15.27:0/1482620 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdaa0100350 0x7fdaa0100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.111+0000 7fdaa8326640 1 -- 172.21.15.27:0/1482620 >> 172.21.15.27:0/1482620 conn(0x7fdaa0077210 msgr2=0x7fdaa00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:48.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.111+0000 7fdaa8326640 1 -- 172.21.15.27:0/1482620 shutdown_connections 2024-09-19T08:20:48.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.111+0000 7fdaa8326640 1 -- 172.21.15.27:0/1482620 wait complete. 2024-09-19T08:20:48.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.112+0000 7fdaa8326640 1 Processor -- start 2024-09-19T08:20:48.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.112+0000 7fdaa8326640 1 -- start start 2024-09-19T08:20:48.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.112+0000 7fdaa8326640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaa0100350 0x7fdaa01012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:48.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.112+0000 7fdaa8326640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdaa0100d00 0x7fdaa0101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:48.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.112+0000 7fdaa8326640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdaa0106f50 0x7fdaa0101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:48.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.112+0000 7fdaa8326640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa0111fb0 con 0x7fdaa0100d00 2024-09-19T08:20:48.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.112+0000 7fdaa8326640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa0111e30 con 0x7fdaa0100350 2024-09-19T08:20:48.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.112+0000 7fdaa8326640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa0112130 con 0x7fdaa0106f50 2024-09-19T08:20:48.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.112+0000 7fdaa58c1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdaa0100d00 0x7fdaa0101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:48.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.112+0000 7fdaa58c1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdaa0100d00 0x7fdaa0101810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60164/0 (socket says 172.21.15.27:60164) 2024-09-19T08:20:48.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.112+0000 7fdaa58c1640 1 -- 172.21.15.27:0/3784606858 learned_addr learned my addr 172.21.15.27:0/3784606858 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:48.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.112+0000 7fdaa68c3640 1 --2- 172.21.15.27:0/3784606858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdaa0106f50 0x7fdaa0101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:48.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.112+0000 7fdaa60c2640 1 --2- 172.21.15.27:0/3784606858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaa0100350 0x7fdaa01012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:48.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.112+0000 7fdaa58c1640 1 -- 172.21.15.27:0/3784606858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdaa0106f50 msgr2=0x7fdaa0101d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:48.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.112+0000 7fdaa58c1640 1 --2- 172.21.15.27:0/3784606858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdaa0106f50 0x7fdaa0101d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.112+0000 7fdaa58c1640 1 -- 172.21.15.27:0/3784606858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaa0100350 msgr2=0x7fdaa01012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:48.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.112+0000 7fdaa58c1640 1 --2- 172.21.15.27:0/3784606858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaa0100350 0x7fdaa01012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.112+0000 7fdaa58c1640 1 -- 172.21.15.27:0/3784606858 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa01a6910 con 0x7fdaa0100d00 2024-09-19T08:20:48.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.113+0000 7fdaa58c1640 1 --2- 172.21.15.27:0/3784606858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdaa0100d00 0x7fdaa0101810 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fda9402a940 tx=0x7fda94003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:48.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.113+0000 7fda937fe640 1 -- 172.21.15.27:0/3784606858 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9403f070 con 0x7fdaa0100d00 2024-09-19T08:20:48.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.113+0000 7fda937fe640 1 -- 172.21.15.27:0/3784606858 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda94031c90 con 0x7fdaa0100d00 2024-09-19T08:20:48.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.113+0000 7fdaa8326640 1 -- 172.21.15.27:0/3784606858 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa01a6ba0 con 0x7fdaa0100d00 2024-09-19T08:20:48.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.113+0000 7fda937fe640 1 -- 172.21.15.27:0/3784606858 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94035030 con 0x7fdaa0100d00 2024-09-19T08:20:48.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.113+0000 7fdaa8326640 1 -- 172.21.15.27:0/3784606858 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa01a70d0 con 0x7fdaa0100d00 2024-09-19T08:20:48.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.115+0000 7fda937fe640 1 -- 172.21.15.27:0/3784606858 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fda94042070 con 0x7fdaa0100d00 2024-09-19T08:20:48.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.116+0000 7fdaaa6ff740 1 Processor -- start 2024-09-19T08:20:48.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.116+0000 7fdaaa6ff740 1 -- start start 2024-09-19T08:20:48.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.116+0000 7fdaaa6ff740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559abbeee4a0 0x559abbeee880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:48.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.116+0000 7fdaaa6ff740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeeedc0 0x559abbef9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.116+0000 7fdaaa6ff740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbef9680 0x559abbefba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.116+0000 7fdaaa6ff740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559abbe542e0 con 0x559abbeeedc0 2024-09-19T08:20:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.116+0000 7fdaaa6ff740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559abbdfbce0 con 0x559abbeee4a0 2024-09-19T08:20:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.116+0000 7fdaaa6ff740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559abbe502a0 con 0x559abbef9680 2024-09-19T08:20:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.116+0000 7fda937fe640 1 --2- 172.21.15.27:0/3784606858 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fda8c0a3430 0x7fda8c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.116+0000 7fdaa60c2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeeedc0 0x559abbef9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.116+0000 7fdaa60c2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeeedc0 0x559abbef9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60178/0 (socket says 172.21.15.27:60178) 2024-09-19T08:20:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.116+0000 7fdaa60c2640 1 -- 172.21.15.27:0/3835109961 learned_addr learned my addr 172.21.15.27:0/3835109961 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.116+0000 7fdaa68c3640 1 --2- 172.21.15.27:0/3784606858 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fda8c0a3430 0x7fda8c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.116+0000 7fdaa58c1640 1 --2- 172.21.15.27:0/3835109961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbef9680 0x559abbefba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.116+0000 7fdaa68c3640 1 --2- 172.21.15.27:0/3835109961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559abbeee4a0 0x559abbeee880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.116+0000 7fda937fe640 1 -- 172.21.15.27:0/3784606858 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7fda940f0460 con 0x7fdaa0100d00 2024-09-19T08:20:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.117+0000 7fdaa60c2640 1 -- 172.21.15.27:0/3835109961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbef9680 msgr2=0x559abbefba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:48.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.117+0000 7fdaa60c2640 1 --2- 172.21.15.27:0/3835109961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbef9680 0x559abbefba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.117+0000 7fdaa60c2640 1 -- 172.21.15.27:0/3835109961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559abbeee4a0 msgr2=0x559abbeee880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:48.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.117+0000 7fdaa60c2640 1 --2- 172.21.15.27:0/3835109961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559abbeee4a0 0x559abbeee880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.117+0000 7fdaa60c2640 1 -- 172.21.15.27:0/3835109961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559abbde0440 con 0x559abbeeedc0 2024-09-19T08:20:48.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.117+0000 7fdaa58c1640 1 --2- 172.21.15.27:0/3835109961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbef9680 0x559abbefba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:20:48.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.117+0000 7fdaa60c2640 1 --2- 172.21.15.27:0/3835109961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeeedc0 0x559abbef9140 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fda9c00ad00 tx=0x7fda9c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7267886c0cf0725 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:48.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.117+0000 7fdaa68c3640 1 --2- 172.21.15.27:0/3784606858 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fda8c0a3430 0x7fda8c0a58f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fda98007fd0 tx=0x7fda980072a0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:48.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.117+0000 7fda90dea640 1 -- 172.21.15.27:0/3835109961 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c01d070 con 0x559abbeeedc0 2024-09-19T08:20:48.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.117+0000 7fda90dea640 1 -- 172.21.15.27:0/3835109961 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda9c018b20 con 0x559abbeeedc0 2024-09-19T08:20:48.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.117+0000 7fda90dea640 1 -- 172.21.15.27:0/3835109961 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c010bc0 con 0x559abbeeedc0 2024-09-19T08:20:48.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.118+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/3835109961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeeedc0 msgr2=0x559abbef9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:48.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.118+0000 7fdaaa6ff740 1 --2- 172.21.15.27:0/3835109961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeeedc0 0x559abbef9140 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fda9c00ad00 tx=0x7fda9c00f790 comp rx=0 tx=0).stop 2024-09-19T08:20:48.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.118+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/3835109961 shutdown_connections 2024-09-19T08:20:48.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.118+0000 7fdaaa6ff740 1 --2- 172.21.15.27:0/3835109961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbef9680 0x559abbefba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.118+0000 7fdaaa6ff740 1 --2- 172.21.15.27:0/3835109961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeeedc0 0x559abbef9140 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.118+0000 7fdaaa6ff740 1 --2- 172.21.15.27:0/3835109961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559abbeee4a0 0x559abbeee880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.118+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/3835109961 >> 172.21.15.27:0/3835109961 conn(0x559abbeeaa30 msgr2=0x559abbeeae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:48.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.118+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/3835109961 shutdown_connections 2024-09-19T08:20:48.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.118+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/3835109961 wait complete. 2024-09-19T08:20:48.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.118+0000 7fdaaa6ff740 1 -- start start 2024-09-19T08:20:48.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.118+0000 7fdaaa6ff740 1 Processor -- start 2024-09-19T08:20:48.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fdaaa6ff740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeee4a0 0x559abbef8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:48.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fdaaa6ff740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559abbeeedc0 0x559abbef61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:48.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fdaaa6ff740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbef9680 0x559abbef6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:48.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fdaaa6ff740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559abbefc250 con 0x559abbeee4a0 2024-09-19T08:20:48.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fdaaa6ff740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559abbe0f050 con 0x559abbeeedc0 2024-09-19T08:20:48.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fdaaa6ff740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559abbefc3d0 con 0x559abbef9680 2024-09-19T08:20:48.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fdaaa6ff740 10 client.0 _ll_register_callbacks cb 0x559abbe4f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:20:48.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fdaa60c2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeee4a0 0x559abbef8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:48.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fdaa60c2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeee4a0 0x559abbef8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60186/0 (socket says 172.21.15.27:60186) 2024-09-19T08:20:48.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fdaa60c2640 1 -- 172.21.15.27:0/908659973 learned_addr learned my addr 172.21.15.27:0/908659973 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:48.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fdaa58c1640 1 --2- 172.21.15.27:0/908659973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559abbeeedc0 0x559abbef61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:48.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fdaa68c3640 1 --2- 172.21.15.27:0/908659973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbef9680 0x559abbef6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:48.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fdaa60c2640 1 -- 172.21.15.27:0/908659973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbef9680 msgr2=0x559abbef6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:48.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fdaa60c2640 1 --2- 172.21.15.27:0/908659973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbef9680 0x559abbef6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fdaa60c2640 1 -- 172.21.15.27:0/908659973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559abbeeedc0 msgr2=0x559abbef61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:48.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fdaa60c2640 1 --2- 172.21.15.27:0/908659973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559abbeeedc0 0x559abbef61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fdaa60c2640 1 -- 172.21.15.27:0/908659973 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559abbbc53c0 con 0x559abbeee4a0 2024-09-19T08:20:48.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fdaa60c2640 1 --2- 172.21.15.27:0/908659973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeee4a0 0x559abbef8f20 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fda9c01b040 tx=0x7fda9c010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9950c862a81e20e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:48.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fda89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:20:48.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fda89ffb640 1 -- 172.21.15.27:0/908659973 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c01d040 con 0x559abbeee4a0 2024-09-19T08:20:48.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fda89ffb640 1 -- 172.21.15.27:0/908659973 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7fda9c018440 con 0x559abbeee4a0 2024-09-19T08:20:48.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.119+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/908659973 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda9c018b20 con 0x559abbeee4a0 2024-09-19T08:20:48.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.120+0000 7fda89ffb640 1 -- 172.21.15.27:0/908659973 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fda9c031050 con 0x559abbeee4a0 2024-09-19T08:20:48.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.120+0000 7fdaaa6ff740 10 client.16926 fetch_fsmap learned FSMap version 20 2024-09-19T08:20:48.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.120+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/908659973 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559abbf07ae0 con 0x559abbeee4a0 2024-09-19T08:20:48.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.120+0000 7fda89ffb640 1 -- 172.21.15.27:0/908659973 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda9c018b20 con 0x559abbeee4a0 2024-09-19T08:20:48.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.120+0000 7fda89ffb640 1 -- 172.21.15.27:0/908659973 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fda9c020030 con 0x559abbeee4a0 2024-09-19T08:20:48.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.120+0000 7fdaaa6ff740 10 client.16926 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:20:48.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.120+0000 7fdaaa6ff740 10 client.16926 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:20:48.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.120+0000 7fdaaa6ff740 20 client.16926 populate_metadata read hostname 'smithi027' 2024-09-19T08:20:48.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.120+0000 7fdaaa6ff740 1 --2- 172.21.15.27:0/908659973 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559abbf08f40 0x559abbf0b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:48.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.120+0000 7fdaaa6ff740 4 client.16926 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:20:48.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.120+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/908659973 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559abbe61850 con 0x559abbf08f40 2024-09-19T08:20:48.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.120+0000 7fdaa58c1640 1 --2- 172.21.15.27:0/908659973 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559abbf08f40 0x559abbf0b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:48.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.121+0000 7fda89ffb640 10 client.16926 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:48.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.121+0000 7fdaa58c1640 1 --2- 172.21.15.27:0/908659973 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559abbf08f40 0x559abbf0b330 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7b28d21d7d7a963 server_cookie=edf96698699b77d2 in_seq=0 out_seq=0 2024-09-19T08:20:48.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.122+0000 7fda89ffb640 1 -- 172.21.15.27:0/908659973 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559abbe61850 con 0x559abbf08f40 2024-09-19T08:20:48.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.122+0000 7fda89ffb640 10 client.16926 handle_command_reply: tid=0 2024-09-19T08:20:48.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.122+0000 7fdaaa6ff740 1 client.16926 shutdown 2024-09-19T08:20:48.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.122+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/908659973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeee4a0 msgr2=0x559abbef8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:48.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.122+0000 7fdaaa6ff740 1 --2- 172.21.15.27:0/908659973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeee4a0 0x559abbef8f20 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fda9c01b040 tx=0x7fda9c010bd0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.122+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/908659973 shutdown_connections 2024-09-19T08:20:48.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.122+0000 7fdaaa6ff740 1 --2- 172.21.15.27:0/908659973 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559abbf08f40 0x559abbf0b330 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.122+0000 7fdaaa6ff740 1 --2- 172.21.15.27:0/908659973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbef9680 0x559abbef6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.122+0000 7fdaaa6ff740 1 --2- 172.21.15.27:0/908659973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559abbeeedc0 0x559abbef61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.122+0000 7fda89ffb640 0 client.16926 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:48.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.122+0000 7fdaaa6ff740 1 --2- 172.21.15.27:0/908659973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeee4a0 0x559abbef8f20 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.122+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/908659973 >> 172.21.15.27:0/908659973 conn(0x559abbeeaa30 msgr2=0x559abbef0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:48.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.122+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/908659973 shutdown_connections 2024-09-19T08:20:48.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.122+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/908659973 wait complete. 2024-09-19T08:20:48.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.122+0000 7fdaaa6ff740 20 client.16926 trim_cache size 0 max 16384 2024-09-19T08:20:48.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.139+0000 7fdaaa6ff740 1 Processor -- start 2024-09-19T08:20:48.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.139+0000 7fdaaa6ff740 1 -- start start 2024-09-19T08:20:48.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.139+0000 7fdaaa6ff740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559abbeee4a0 0x559abbf054b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:48.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.139+0000 7fdaaa6ff740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbeeedc0 0x559abbf10930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:48.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.139+0000 7fdaaa6ff740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbef9680 0x559abbf10e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:48.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.139+0000 7fdaaa6ff740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa01ad9c0 con 0x559abbef9680 2024-09-19T08:20:48.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.139+0000 7fdaaa6ff740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa01b0220 con 0x559abbeee4a0 2024-09-19T08:20:48.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.139+0000 7fdaaa6ff740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa01ae010 con 0x559abbeeedc0 2024-09-19T08:20:48.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.139+0000 7fdaa68c3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbef9680 0x559abbf10e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:48.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.140+0000 7fdaa68c3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbef9680 0x559abbf10e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60192/0 (socket says 172.21.15.27:60192) 2024-09-19T08:20:48.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.140+0000 7fdaa68c3640 1 -- 172.21.15.27:0/785169096 learned_addr learned my addr 172.21.15.27:0/785169096 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:48.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.140+0000 7fdaa60c2640 1 --2- 172.21.15.27:0/785169096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559abbeee4a0 0x559abbf054b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:48.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.140+0000 7fdaa58c1640 1 --2- 172.21.15.27:0/785169096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbeeedc0 0x559abbf10930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:48.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.140+0000 7fdaa68c3640 1 -- 172.21.15.27:0/785169096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbeeedc0 msgr2=0x559abbf10930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:48.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.140+0000 7fdaa68c3640 1 --2- 172.21.15.27:0/785169096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbeeedc0 0x559abbf10930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.140+0000 7fdaa68c3640 1 -- 172.21.15.27:0/785169096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559abbeee4a0 msgr2=0x559abbf054b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:48.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.140+0000 7fdaa68c3640 1 --2- 172.21.15.27:0/785169096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559abbeee4a0 0x559abbf054b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.140+0000 7fdaa68c3640 1 -- 172.21.15.27:0/785169096 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559abbef9290 con 0x559abbef9680 2024-09-19T08:20:48.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.140+0000 7fdaa68c3640 1 --2- 172.21.15.27:0/785169096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbef9680 0x559abbf10e70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fda98014660 tx=0x7fda98007520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4433a60d24e7f350 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:48.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.140+0000 7fda8bfff640 1 -- 172.21.15.27:0/785169096 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98026030 con 0x559abbef9680 2024-09-19T08:20:48.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.140+0000 7fda8bfff640 1 -- 172.21.15.27:0/785169096 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda98014320 con 0x559abbef9680 2024-09-19T08:20:48.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.140+0000 7fda8bfff640 1 -- 172.21.15.27:0/785169096 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98005370 con 0x559abbef9680 2024-09-19T08:20:48.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.141+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/785169096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbef9680 msgr2=0x559abbf10e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:48.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.141+0000 7fdaaa6ff740 1 --2- 172.21.15.27:0/785169096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbef9680 0x559abbf10e70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fda98014660 tx=0x7fda98007520 comp rx=0 tx=0).stop 2024-09-19T08:20:48.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.141+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/785169096 shutdown_connections 2024-09-19T08:20:48.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.141+0000 7fdaaa6ff740 1 --2- 172.21.15.27:0/785169096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbef9680 0x559abbf10e70 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.141+0000 7fdaaa6ff740 1 --2- 172.21.15.27:0/785169096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbeeedc0 0x559abbf10930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.141+0000 7fdaaa6ff740 1 --2- 172.21.15.27:0/785169096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559abbeee4a0 0x559abbf054b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.141+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/785169096 >> 172.21.15.27:0/785169096 conn(0x559abbeeaa30 msgr2=0x559abbef5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:48.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.141+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/785169096 shutdown_connections 2024-09-19T08:20:48.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.141+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/785169096 wait complete. 2024-09-19T08:20:48.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.141+0000 7fdaaa6ff740 1 -- start start 2024-09-19T08:20:48.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.141+0000 7fdaaa6ff740 1 Processor -- start 2024-09-19T08:20:48.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fdaaa6ff740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559abbeee4a0 0x559abbf6acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:48.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fdaaa6ff740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeeedc0 0x559abbf6b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:48.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fdaaa6ff740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbef9680 0x559abbefecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:48.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fdaaa6ff740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa01ae6e0 con 0x559abbeeedc0 2024-09-19T08:20:48.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fdaaa6ff740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa01afb50 con 0x559abbeee4a0 2024-09-19T08:20:48.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fdaaa6ff740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa01aedb0 con 0x559abbef9680 2024-09-19T08:20:48.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fdaaa6ff740 10 client.0 _ll_register_callbacks cb 0x7fda9c01b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:20:48.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fdaa58c1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeeedc0 0x559abbf6b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:48.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fdaa58c1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeeedc0 0x559abbf6b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60208/0 (socket says 172.21.15.27:60208) 2024-09-19T08:20:48.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fdaa58c1640 1 -- 172.21.15.27:0/487545463 learned_addr learned my addr 172.21.15.27:0/487545463 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:20:48.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fdaa60c2640 1 --2- 172.21.15.27:0/487545463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559abbeee4a0 0x559abbf6acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:48.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fdaa68c3640 1 --2- 172.21.15.27:0/487545463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbef9680 0x559abbefecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:48.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fdaa58c1640 1 -- 172.21.15.27:0/487545463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbef9680 msgr2=0x559abbefecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:48.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fdaa58c1640 1 --2- 172.21.15.27:0/487545463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbef9680 0x559abbefecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fdaa58c1640 1 -- 172.21.15.27:0/487545463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559abbeee4a0 msgr2=0x559abbf6acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:20:48.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fdaa58c1640 1 --2- 172.21.15.27:0/487545463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559abbeee4a0 0x559abbf6acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fdaa58c1640 1 -- 172.21.15.27:0/487545463 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559abbeff4e0 con 0x559abbeeedc0 2024-09-19T08:20:48.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fdaa68c3640 1 --2- 172.21.15.27:0/487545463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbef9680 0x559abbefecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:20:48.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fdaa58c1640 1 --2- 172.21.15.27:0/487545463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeeedc0 0x559abbf6b200 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fda940bc690 tx=0x7fda94005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22debe180fe5e3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:20:48.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fda89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:20:48.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fda89ffb640 1 -- 172.21.15.27:0/487545463 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94049040 con 0x559abbeeedc0 2024-09-19T08:20:48.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fda89ffb640 1 -- 172.21.15.27:0/487545463 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7fda9403b5f0 con 0x559abbeeedc0 2024-09-19T08:20:48.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.142+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/487545463 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda98014320 con 0x559abbeeedc0 2024-09-19T08:20:48.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.143+0000 7fda89ffb640 1 -- 172.21.15.27:0/487545463 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fda940bce00 con 0x559abbeeedc0 2024-09-19T08:20:48.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.143+0000 7fdaaa6ff740 10 client.16932 fetch_fsmap learned FSMap version 20 2024-09-19T08:20:48.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.143+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/487545463 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559abbf73510 con 0x559abbeeedc0 2024-09-19T08:20:48.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.143+0000 7fda89ffb640 1 -- 172.21.15.27:0/487545463 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda98014320 con 0x559abbeeedc0 2024-09-19T08:20:48.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.143+0000 7fda89ffb640 1 -- 172.21.15.27:0/487545463 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fda9c019ce0 con 0x559abbeeedc0 2024-09-19T08:20:48.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.143+0000 7fdaaa6ff740 10 client.16932 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:20:48.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.143+0000 7fdaaa6ff740 10 client.16932 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:20:48.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.143+0000 7fdaaa6ff740 20 client.16932 populate_metadata read hostname 'smithi027' 2024-09-19T08:20:48.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.143+0000 7fdaaa6ff740 1 --2- 172.21.15.27:0/487545463 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559abbf08f40 0x559abbf75cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:20:48.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.143+0000 7fdaaa6ff740 4 client.16932 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:20:48.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.143+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/487545463 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559abbe5bd60 con 0x559abbf08f40 2024-09-19T08:20:48.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.143+0000 7fdaa60c2640 1 --2- 172.21.15.27:0/487545463 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559abbf08f40 0x559abbf75cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:20:48.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.144+0000 7fdaa60c2640 1 --2- 172.21.15.27:0/487545463 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559abbf08f40 0x559abbf75cf0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2887eabcc468fcdc server_cookie=581cacce24b9002c in_seq=0 out_seq=0 2024-09-19T08:20:48.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.144+0000 7fda89ffb640 10 client.16932 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:48.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.144+0000 7fda89ffb640 1 -- 172.21.15.27:0/487545463 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559abbe5bd60 con 0x559abbf08f40 2024-09-19T08:20:48.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.144+0000 7fda89ffb640 10 client.16932 handle_command_reply: tid=0 2024-09-19T08:20:48.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.144+0000 7fdaaa6ff740 1 client.16932 shutdown 2024-09-19T08:20:48.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.144+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/487545463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeeedc0 msgr2=0x559abbf6b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:48.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.144+0000 7fdaaa6ff740 1 --2- 172.21.15.27:0/487545463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeeedc0 0x559abbf6b200 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fda940bc690 tx=0x7fda94005d50 comp rx=0 tx=0).stop 2024-09-19T08:20:48.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.144+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/487545463 shutdown_connections 2024-09-19T08:20:48.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.144+0000 7fdaaa6ff740 1 --2- 172.21.15.27:0/487545463 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x559abbf08f40 0x559abbf75cf0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.144+0000 7fdaaa6ff740 1 --2- 172.21.15.27:0/487545463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559abbef9680 0x559abbefecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.144+0000 7fdaaa6ff740 1 --2- 172.21.15.27:0/487545463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559abbeeedc0 0x559abbf6b200 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.144+0000 7fdaaa6ff740 1 --2- 172.21.15.27:0/487545463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559abbeee4a0 0x559abbf6acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.144+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/487545463 >> 172.21.15.27:0/487545463 conn(0x559abbeeaa30 msgr2=0x559abbee9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:48.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.144+0000 7fda89ffb640 0 client.16932 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:20:48.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.144+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/487545463 shutdown_connections 2024-09-19T08:20:48.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.144+0000 7fdaaa6ff740 1 -- 172.21.15.27:0/487545463 wait complete. 2024-09-19T08:20:48.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.144+0000 7fdaaa6ff740 20 client.16932 trim_cache size 0 max 16384 2024-09-19T08:20:48.151 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:20:48.151 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:20:48.151 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": { 2024-09-19T08:20:48.152 INFO:teuthology.orchestra.run.smithi027.stdout: "a43c1933-9ba1-4fce-ad79-28d2e851dc8b": { 2024-09-19T08:20:48.152 INFO:teuthology.orchestra.run.smithi027.stdout: "path": "/", 2024-09-19T08:20:48.152 INFO:teuthology.orchestra.run.smithi027.stdout: "tag": "a43c1933-9ba1-4fce-ad79-28d2e851dc8b", 2024-09-19T08:20:48.152 INFO:teuthology.orchestra.run.smithi027.stdout: "options": "recursive,force" 2024-09-19T08:20:48.152 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:20:48.152 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:20:48.152 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:20:48.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.145+0000 7fdaa8326640 1 -- 172.21.15.27:0/3784606858 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fda8c0a3430 msgr2=0x7fda8c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:48.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.145+0000 7fdaa8326640 1 --2- 172.21.15.27:0/3784606858 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fda8c0a3430 0x7fda8c0a58f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fda98007fd0 tx=0x7fda980072a0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.145+0000 7fdaa8326640 1 -- 172.21.15.27:0/3784606858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdaa0100d00 msgr2=0x7fdaa0101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:20:48.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.145+0000 7fdaa8326640 1 --2- 172.21.15.27:0/3784606858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdaa0100d00 0x7fdaa0101810 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fda9402a940 tx=0x7fda94003c00 comp rx=0 tx=0).stop 2024-09-19T08:20:48.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.145+0000 7fdaa8326640 1 -- 172.21.15.27:0/3784606858 shutdown_connections 2024-09-19T08:20:48.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.145+0000 7fdaa8326640 1 --2- 172.21.15.27:0/3784606858 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fda8c0a3430 0x7fda8c0a58f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.145+0000 7fdaa8326640 1 --2- 172.21.15.27:0/3784606858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdaa0106f50 0x7fdaa0101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.145+0000 7fdaa8326640 1 --2- 172.21.15.27:0/3784606858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdaa0100d00 0x7fdaa0101810 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.145+0000 7fdaa8326640 1 --2- 172.21.15.27:0/3784606858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaa0100350 0x7fdaa01012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:20:48.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.145+0000 7fdaa8326640 1 -- 172.21.15.27:0/3784606858 >> 172.21.15.27:0/3784606858 conn(0x7fdaa0077210 msgr2=0x7fdaa0105750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:20:48.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.145+0000 7fdaa8326640 1 -- 172.21.15.27:0/3784606858 shutdown_connections 2024-09-19T08:20:48.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:20:48.145+0000 7fdaa8326640 1 -- 172.21.15.27:0/3784606858 wait complete. 2024-09-19T08:20:48.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:47 smithi155 ceph-mon[35362]: scrub queued for path: / 2024-09-19T08:20:48.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:47 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:20:48.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:47 smithi155 ceph-mon[35362]: scrub summary: active paths [/] 2024-09-19T08:20:48.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:47 smithi155 ceph-mon[35362]: scrub summary: idle+waiting paths [/] 2024-09-19T08:20:48.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:47 smithi203 ceph-mon[35198]: scrub queued for path: / 2024-09-19T08:20:48.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:47 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:20:48.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:47 smithi203 ceph-mon[35198]: scrub summary: active paths [/] 2024-09-19T08:20:48.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:47 smithi203 ceph-mon[35198]: scrub summary: idle+waiting paths [/] 2024-09-19T08:20:48.981 INFO:tasks.cephfs.filesystem:scrub status for tag:a43c1933-9ba1-4fce-ad79-28d2e851dc8b - {'path': '/', 'tag': 'a43c1933-9ba1-4fce-ad79-28d2e851dc8b', 'options': 'recursive,force'} 2024-09-19T08:20:49.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:48 smithi155 ceph-mon[35362]: pgmap v302: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:20:49.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:48 smithi027 ceph-mon[31209]: pgmap v302: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:20:49.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:48 smithi203 ceph-mon[35198]: pgmap v302: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:20:51.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:50 smithi155 ceph-mon[35362]: pgmap v303: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:20:51.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:50 smithi155 ceph-mon[35362]: scrub summary: idle 2024-09-19T08:20:51.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:50 smithi027 ceph-mon[31209]: pgmap v303: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:20:51.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:50 smithi027 ceph-mon[31209]: scrub summary: idle 2024-09-19T08:20:51.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:50 smithi203 ceph-mon[35198]: pgmap v303: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:20:51.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:50 smithi203 ceph-mon[35198]: scrub summary: idle 2024-09-19T08:20:53.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:52 smithi155 ceph-mon[35362]: pgmap v304: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:20:53.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:52 smithi027 ceph-mon[31209]: pgmap v304: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:20:53.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:52 smithi203 ceph-mon[35198]: pgmap v304: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:20:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:54 smithi155 ceph-mon[35362]: pgmap v305: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:20:55.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:54 smithi027 ceph-mon[31209]: pgmap v305: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:20:55.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:54 smithi203 ceph-mon[35198]: pgmap v305: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:20:57.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:56 smithi155 ceph-mon[35362]: pgmap v306: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:20:57.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:56 smithi027 ceph-mon[31209]: pgmap v306: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:20:57.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:56 smithi203 ceph-mon[35198]: pgmap v306: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:20:59.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:20:58 smithi155 ceph-mon[35362]: pgmap v307: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:20:59.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:20:58 smithi027 ceph-mon[31209]: pgmap v307: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:20:59.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:20:58 smithi203 ceph-mon[35198]: pgmap v307: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T08:21:01.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:00 smithi155 ceph-mon[35362]: pgmap v308: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:01.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:00 smithi027 ceph-mon[31209]: pgmap v308: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:01.257 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:00 smithi203 ceph-mon[35198]: pgmap v308: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:03.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:02 smithi155 ceph-mon[35362]: pgmap v309: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:03.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:02 smithi027 ceph-mon[31209]: pgmap v309: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:03.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:02 smithi203 ceph-mon[35198]: pgmap v309: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:05.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:04 smithi155 ceph-mon[35362]: pgmap v310: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:21:05.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:04 smithi027 ceph-mon[31209]: pgmap v310: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:21:05.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:04 smithi203 ceph-mon[35198]: pgmap v310: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:21:07.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:06 smithi155 ceph-mon[35362]: pgmap v311: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-19T08:21:07.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:06 smithi027 ceph-mon[31209]: pgmap v311: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-19T08:21:07.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:06 smithi203 ceph-mon[35198]: pgmap v311: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-19T08:21:09.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:08 smithi155 ceph-mon[35362]: pgmap v312: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:21:09.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:08 smithi027 ceph-mon[31209]: pgmap v312: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:21:09.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:08 smithi203 ceph-mon[35198]: pgmap v312: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-19T08:21:10.944 DEBUG:teuthology.orchestra.run.smithi027:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T08:21:11.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.065+0000 7f2171477640 1 -- 172.21.15.27:0/3334406730 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f216c106a00 msgr2=0x7f216c106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:11.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.065+0000 7f2171477640 1 --2- 172.21.15.27:0/3334406730 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f216c106a00 0x7f216c106de0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f215c009930 tx=0x7f215c02a420 comp rx=0 tx=0).stop 2024-09-19T08:21:11.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.065+0000 7f2171477640 1 -- 172.21.15.27:0/3334406730 shutdown_connections 2024-09-19T08:21:11.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.065+0000 7f2171477640 1 --2- 172.21.15.27:0/3334406730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f216c101390 0x7f216c10d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:11.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.065+0000 7f2171477640 1 --2- 172.21.15.27:0/3334406730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f216c1009f0 0x7f216c100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:11.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.065+0000 7f2171477640 1 --2- 172.21.15.27:0/3334406730 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f216c106a00 0x7f216c106de0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:11.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.065+0000 7f2171477640 1 -- 172.21.15.27:0/3334406730 >> 172.21.15.27:0/3334406730 conn(0x7f216c0fc6b0 msgr2=0x7f216c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:11.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.065+0000 7f2171477640 1 -- 172.21.15.27:0/3334406730 shutdown_connections 2024-09-19T08:21:11.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.065+0000 7f2171477640 1 -- 172.21.15.27:0/3334406730 wait complete. 2024-09-19T08:21:11.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.065+0000 7f2171477640 1 Processor -- start 2024-09-19T08:21:11.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.066+0000 7f2171477640 1 -- start start 2024-09-19T08:21:11.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.066+0000 7f2171477640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f216c1009f0 0x7f216c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:11.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.066+0000 7f2171477640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f216c101390 0x7f216c1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:11.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.066+0000 7f2171477640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f216c106a00 0x7f216c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:11.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.066+0000 7f2171477640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f216c110e40 con 0x7f216c1009f0 2024-09-19T08:21:11.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.066+0000 7f2171477640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f216c110cc0 con 0x7f216c101390 2024-09-19T08:21:11.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.066+0000 7f2171477640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f216c110fc0 con 0x7f216c106a00 2024-09-19T08:21:11.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.066+0000 7f216affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f216c1009f0 0x7f216c1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:11.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.066+0000 7f216affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f216c1009f0 0x7f216c1983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42090/0 (socket says 172.21.15.27:42090) 2024-09-19T08:21:11.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.066+0000 7f216affd640 1 -- 172.21.15.27:0/610145633 learned_addr learned my addr 172.21.15.27:0/610145633 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:11.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.066+0000 7f216a7fc640 1 --2- 172.21.15.27:0/610145633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f216c101390 0x7f216c1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:11.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.066+0000 7f216b7fe640 1 --2- 172.21.15.27:0/610145633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f216c106a00 0x7f216c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:11.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.066+0000 7f216affd640 1 -- 172.21.15.27:0/610145633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f216c106a00 msgr2=0x7f216c19cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:11.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.066+0000 7f216affd640 1 --2- 172.21.15.27:0/610145633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f216c106a00 0x7f216c19cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:11.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.066+0000 7f216affd640 1 -- 172.21.15.27:0/610145633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f216c101390 msgr2=0x7f216c1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:11.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.066+0000 7f216affd640 1 --2- 172.21.15.27:0/610145633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f216c101390 0x7f216c1988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:11.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.066+0000 7f216affd640 1 -- 172.21.15.27:0/610145633 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216c19d3a0 con 0x7f216c1009f0 2024-09-19T08:21:11.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.067+0000 7f216affd640 1 --2- 172.21.15.27:0/610145633 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f216c1009f0 0x7f216c1983b0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f215c009230 tx=0x7f215c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:11.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.067+0000 7f2153fff640 1 -- 172.21.15.27:0/610145633 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c03f030 con 0x7f216c1009f0 2024-09-19T08:21:11.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.067+0000 7f2153fff640 1 -- 172.21.15.27:0/610145633 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f215c003ad0 con 0x7f216c1009f0 2024-09-19T08:21:11.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.067+0000 7f2171477640 1 -- 172.21.15.27:0/610145633 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f216c19d630 con 0x7f216c1009f0 2024-09-19T08:21:11.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.067+0000 7f2153fff640 1 -- 172.21.15.27:0/610145633 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c035070 con 0x7f216c1009f0 2024-09-19T08:21:11.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.067+0000 7f2171477640 1 -- 172.21.15.27:0/610145633 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f216c1a4f20 con 0x7f216c1009f0 2024-09-19T08:21:11.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.068+0000 7f2171477640 1 -- 172.21.15.27:0/610145633 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f216c102130 con 0x7f216c1009f0 2024-09-19T08:21:11.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.069+0000 7f2153fff640 1 -- 172.21.15.27:0/610145633 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f215c042030 con 0x7f216c1009f0 2024-09-19T08:21:11.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.070+0000 7f2153fff640 1 --2- 172.21.15.27:0/610145633 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f21540a3460 0x7f21540a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:11.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.070+0000 7f2153fff640 1 -- 172.21.15.27:0/610145633 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8528+0+0 (secure 0 0 0) 0x7f215c0f0630 con 0x7f216c1009f0 2024-09-19T08:21:11.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.070+0000 7f216a7fc640 1 --2- 172.21.15.27:0/610145633 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f21540a3460 0x7f21540a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:11.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.071+0000 7f216a7fc640 1 --2- 172.21.15.27:0/610145633 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f21540a3460 0x7f21540a5920 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f216c0feba0 tx=0x7f216000b390 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:11.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.073+0000 7f2153fff640 1 -- 172.21.15.27:0/610145633 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f215c0bd010 con 0x7f216c1009f0 2024-09-19T08:21:11.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:10 smithi155 ceph-mon[35362]: pgmap v313: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-19T08:21:11.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:10 smithi027 ceph-mon[31209]: pgmap v313: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-19T08:21:11.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:10 smithi203 ceph-mon[35198]: pgmap v313: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-19T08:21:11.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.274+0000 7f2171477640 1 -- 172.21.15.27:0/610145633 --> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f216c06a300 con 0x7f21540a3460 2024-09-19T08:21:11.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.285+0000 7f2153fff640 1 -- 172.21.15.27:0/610145633 <== mgr.15093 v2:172.21.15.27:6800/1578338135 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f216c06a300 con 0x7f21540a3460 2024-09-19T08:21:11.285 INFO:teuthology.orchestra.run.smithi027.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T08:11:09", "first": "2024-09-19T08:12:00", "last": "2024-09-19T08:21:00", "last_pruned": "2024-09-19T08:21:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-19T08:21:11.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.287+0000 7f2171477640 1 -- 172.21.15.27:0/610145633 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f21540a3460 msgr2=0x7f21540a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:11.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.287+0000 7f2171477640 1 --2- 172.21.15.27:0/610145633 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f21540a3460 0x7f21540a5920 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f216c0feba0 tx=0x7f216000b390 comp rx=0 tx=0).stop 2024-09-19T08:21:11.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.287+0000 7f2171477640 1 -- 172.21.15.27:0/610145633 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f216c1009f0 msgr2=0x7f216c1983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:11.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.287+0000 7f2171477640 1 --2- 172.21.15.27:0/610145633 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f216c1009f0 0x7f216c1983b0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f215c009230 tx=0x7f215c004270 comp rx=0 tx=0).stop 2024-09-19T08:21:11.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.287+0000 7f2171477640 1 -- 172.21.15.27:0/610145633 shutdown_connections 2024-09-19T08:21:11.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.287+0000 7f2171477640 1 --2- 172.21.15.27:0/610145633 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f21540a3460 0x7f21540a5920 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:11.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.287+0000 7f2171477640 1 --2- 172.21.15.27:0/610145633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f216c106a00 0x7f216c19cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:11.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.287+0000 7f2171477640 1 --2- 172.21.15.27:0/610145633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f216c101390 0x7f216c1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:11.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.287+0000 7f2171477640 1 --2- 172.21.15.27:0/610145633 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f216c1009f0 0x7f216c1983b0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:11.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.287+0000 7f2171477640 1 -- 172.21.15.27:0/610145633 >> 172.21.15.27:0/610145633 conn(0x7f216c0fc6b0 msgr2=0x7f216c1047a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:11.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.287+0000 7f2171477640 1 -- 172.21.15.27:0/610145633 shutdown_connections 2024-09-19T08:21:11.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.287+0000 7f2171477640 1 -- 172.21.15.27:0/610145633 wait complete. 2024-09-19T08:21:11.298 DEBUG:teuthology.orchestra.run.smithi027:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T08:21:11.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.405+0000 7fb347a65640 1 -- 172.21.15.27:0/15343756 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb340101350 msgr2=0x7fb34010d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:11.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.405+0000 7fb347a65640 1 --2- 172.21.15.27:0/15343756 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb340101350 0x7fb34010d880 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fb330009c10 tx=0x7fb33002a6e0 comp rx=0 tx=0).stop 2024-09-19T08:21:11.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.405+0000 7fb347a65640 1 -- 172.21.15.27:0/15343756 shutdown_connections 2024-09-19T08:21:11.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.405+0000 7fb347a65640 1 --2- 172.21.15.27:0/15343756 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb340101350 0x7fb34010d880 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:11.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.405+0000 7fb347a65640 1 --2- 172.21.15.27:0/15343756 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3401009b0 0x7fb340100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:11.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.405+0000 7fb347a65640 1 --2- 172.21.15.27:0/15343756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3401069c0 0x7fb340106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:11.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.405+0000 7fb347a65640 1 -- 172.21.15.27:0/15343756 >> 172.21.15.27:0/15343756 conn(0x7fb340077990 msgr2=0x7fb3400fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:11.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.405+0000 7fb347a65640 1 -- 172.21.15.27:0/15343756 shutdown_connections 2024-09-19T08:21:11.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.405+0000 7fb347a65640 1 -- 172.21.15.27:0/15343756 wait complete. 2024-09-19T08:21:11.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.406+0000 7fb347a65640 1 Processor -- start 2024-09-19T08:21:11.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.406+0000 7fb347a65640 1 -- start start 2024-09-19T08:21:11.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.406+0000 7fb347a65640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3401009b0 0x7fb340198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:11.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.406+0000 7fb347a65640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb340101350 0x7fb340198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:11.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.406+0000 7fb347a65640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3401069c0 0x7fb34019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:11.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.406+0000 7fb347a65640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb340111ea0 con 0x7fb340101350 2024-09-19T08:21:11.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.406+0000 7fb347a65640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb340111d20 con 0x7fb3401009b0 2024-09-19T08:21:11.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.406+0000 7fb347a65640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb340112020 con 0x7fb3401069c0 2024-09-19T08:21:11.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.406+0000 7fb345000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb340101350 0x7fb340198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:11.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.406+0000 7fb345000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb340101350 0x7fb340198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42108/0 (socket says 172.21.15.27:42108) 2024-09-19T08:21:11.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.406+0000 7fb345000640 1 -- 172.21.15.27:0/3370845618 learned_addr learned my addr 172.21.15.27:0/3370845618 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:11.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.406+0000 7fb345801640 1 --2- 172.21.15.27:0/3370845618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3401009b0 0x7fb340198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:11.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.406+0000 7fb346002640 1 --2- 172.21.15.27:0/3370845618 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3401069c0 0x7fb34019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:11.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.407+0000 7fb345000640 1 -- 172.21.15.27:0/3370845618 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3401069c0 msgr2=0x7fb34019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:11.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.407+0000 7fb345000640 1 --2- 172.21.15.27:0/3370845618 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3401069c0 0x7fb34019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:11.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.407+0000 7fb345000640 1 -- 172.21.15.27:0/3370845618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3401009b0 msgr2=0x7fb340198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:11.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.407+0000 7fb345000640 1 --2- 172.21.15.27:0/3370845618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3401009b0 0x7fb340198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:11.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.407+0000 7fb345000640 1 -- 172.21.15.27:0/3370845618 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34019d300 con 0x7fb340101350 2024-09-19T08:21:11.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.407+0000 7fb345801640 1 --2- 172.21.15.27:0/3370845618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3401009b0 0x7fb340198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:21:11.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.407+0000 7fb345000640 1 --2- 172.21.15.27:0/3370845618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb340101350 0x7fb340198850 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fb33400e9c0 tx=0x7fb33400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:11.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.407+0000 7fb33e7fc640 1 -- 172.21.15.27:0/3370845618 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33400ccc0 con 0x7fb340101350 2024-09-19T08:21:11.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.407+0000 7fb33e7fc640 1 -- 172.21.15.27:0/3370845618 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb334005500 con 0x7fb340101350 2024-09-19T08:21:11.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.407+0000 7fb347a65640 1 -- 172.21.15.27:0/3370845618 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb34019d5f0 con 0x7fb340101350 2024-09-19T08:21:11.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.407+0000 7fb33e7fc640 1 -- 172.21.15.27:0/3370845618 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb334010430 con 0x7fb340101350 2024-09-19T08:21:11.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.407+0000 7fb347a65640 1 -- 172.21.15.27:0/3370845618 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3401a4e80 con 0x7fb340101350 2024-09-19T08:21:11.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.408+0000 7fb347a65640 1 -- 172.21.15.27:0/3370845618 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb340100e10 con 0x7fb340101350 2024-09-19T08:21:11.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.409+0000 7fb33e7fc640 1 -- 172.21.15.27:0/3370845618 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fb3340046c0 con 0x7fb340101350 2024-09-19T08:21:11.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.410+0000 7fb33e7fc640 1 --2- 172.21.15.27:0/3370845618 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb3280a3460 0x7fb3280a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:11.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.410+0000 7fb345801640 1 --2- 172.21.15.27:0/3370845618 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb3280a3460 0x7fb3280a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:11.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.410+0000 7fb33e7fc640 1 -- 172.21.15.27:0/3370845618 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8528+0+0 (secure 0 0 0) 0x7fb3340d0010 con 0x7fb340101350 2024-09-19T08:21:11.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.410+0000 7fb345801640 1 --2- 172.21.15.27:0/3370845618 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb3280a3460 0x7fb3280a5920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb338009f40 tx=0x7fb338005f90 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:11.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.414+0000 7fb33e7fc640 1 -- 172.21.15.27:0/3370845618 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb33409c9f0 con 0x7fb340101350 2024-09-19T08:21:11.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.611+0000 7fb347a65640 1 -- 172.21.15.27:0/3370845618 --> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fb3400ff710 con 0x7fb3280a3460 2024-09-19T08:21:11.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.618+0000 7fb33e7fc640 1 -- 172.21.15.27:0/3370845618 <== mgr.15093 v2:172.21.15.27:6800/1578338135 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fb3400ff710 con 0x7fb3280a3460 2024-09-19T08:21:11.617 INFO:teuthology.orchestra.run.smithi027.stdout:/ 1m 6m3h 2024-09-19T08:21:11.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.620+0000 7fb347a65640 1 -- 172.21.15.27:0/3370845618 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb3280a3460 msgr2=0x7fb3280a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:11.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.620+0000 7fb347a65640 1 --2- 172.21.15.27:0/3370845618 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb3280a3460 0x7fb3280a5920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb338009f40 tx=0x7fb338005f90 comp rx=0 tx=0).stop 2024-09-19T08:21:11.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.620+0000 7fb347a65640 1 -- 172.21.15.27:0/3370845618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb340101350 msgr2=0x7fb340198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:11.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.620+0000 7fb347a65640 1 --2- 172.21.15.27:0/3370845618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb340101350 0x7fb340198850 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fb33400e9c0 tx=0x7fb33400ee80 comp rx=0 tx=0).stop 2024-09-19T08:21:11.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.620+0000 7fb347a65640 1 -- 172.21.15.27:0/3370845618 shutdown_connections 2024-09-19T08:21:11.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.620+0000 7fb347a65640 1 --2- 172.21.15.27:0/3370845618 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fb3280a3460 0x7fb3280a5920 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:11.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.620+0000 7fb347a65640 1 --2- 172.21.15.27:0/3370845618 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3401069c0 0x7fb34019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:11.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.620+0000 7fb347a65640 1 --2- 172.21.15.27:0/3370845618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb340101350 0x7fb340198850 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:11.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.620+0000 7fb347a65640 1 --2- 172.21.15.27:0/3370845618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3401009b0 0x7fb340198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:11.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.620+0000 7fb347a65640 1 -- 172.21.15.27:0/3370845618 >> 172.21.15.27:0/3370845618 conn(0x7fb340077990 msgr2=0x7fb3400ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:11.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.620+0000 7fb347a65640 1 -- 172.21.15.27:0/3370845618 shutdown_connections 2024-09-19T08:21:11.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:11.620+0000 7fb347a65640 1 -- 172.21.15.27:0/3370845618 wait complete. 2024-09-19T08:21:11.631 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T08:21:11.645 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T08:21:12.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:11 smithi155 ceph-mon[35362]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T08:21:12.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:11 smithi027 ceph-mon[31209]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T08:21:12.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:11 smithi203 ceph-mon[35198]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T08:21:13.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:12 smithi155 ceph-mon[35362]: from='client.16938 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:21:13.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:12 smithi155 ceph-mon[35362]: pgmap v315: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-19T08:21:13.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:12 smithi155 ceph-mon[35362]: from='client.16944 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:21:13.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:12 smithi027 ceph-mon[31209]: from='client.16938 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:21:13.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:12 smithi027 ceph-mon[31209]: pgmap v315: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-19T08:21:13.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:12 smithi027 ceph-mon[31209]: from='client.16944 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:21:13.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:12 smithi203 ceph-mon[35198]: from='client.16938 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:21:13.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:12 smithi203 ceph-mon[35198]: pgmap v315: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-19T08:21:13.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:12 smithi203 ceph-mon[35198]: from='client.16944 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:21:15.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:14 smithi155 ceph-mon[35362]: pgmap v316: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-19T08:21:15.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:14 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:21:15.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:14 smithi027 ceph-mon[31209]: pgmap v316: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-19T08:21:15.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:14 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:21:15.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:14 smithi203 ceph-mon[35198]: pgmap v316: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-19T08:21:15.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:14 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:21:17.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: pgmap v317: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-19T08:21:17.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T08:21:17.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:17.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:17.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:17.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:17.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:17.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:17.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.239 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.240 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.240 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.240 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.240 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.240 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.240 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.240 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.240 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.240 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.240 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.240 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.240 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.240 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:21:17.241 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:21:17.241 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:16 smithi155 ceph-mon[35362]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:17.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: pgmap v317: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-19T08:21:17.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T08:21:17.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:17.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:17.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:17.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:17.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:17.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:17.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.255 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.255 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:21:17.255 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:21:17.255 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:16 smithi027 ceph-mon[31209]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:17.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: pgmap v317: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-19T08:21:17.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T08:21:17.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:17.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:17.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:17.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:17.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:17.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:17.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.260 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.261 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.261 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.261 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.261 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.261 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.261 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.262 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.262 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.262 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.262 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.262 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.263 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.263 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.263 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.263 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.263 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.263 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:21:17.263 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:21:17.264 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:21:17.264 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:16 smithi203 ceph-mon[35198]: from='mgr.15093 ' entity='mgr.x' 2024-09-19T08:21:18.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:17 smithi155 ceph-mon[35362]: Adjusting osd_memory_target on smithi155 to 176.0M 2024-09-19T08:21:18.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:17 smithi155 ceph-mon[35362]: Unable to set osd_memory_target on smithi155 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-19T08:21:18.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:17 smithi155 ceph-mon[35362]: Adjusting osd_memory_target on smithi203 to 176.0M 2024-09-19T08:21:18.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:17 smithi155 ceph-mon[35362]: Unable to set osd_memory_target on smithi203 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-19T08:21:18.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:17 smithi155 ceph-mon[35362]: Adjusting osd_memory_target on smithi027 to 176.0M 2024-09-19T08:21:18.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:17 smithi155 ceph-mon[35362]: Unable to set osd_memory_target on smithi027 to 184555212: error parsing value: Value '184555212' is below minimum 939524096 2024-09-19T08:21:18.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:17 smithi027 ceph-mon[31209]: Adjusting osd_memory_target on smithi155 to 176.0M 2024-09-19T08:21:18.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:17 smithi027 ceph-mon[31209]: Unable to set osd_memory_target on smithi155 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-19T08:21:18.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:17 smithi027 ceph-mon[31209]: Adjusting osd_memory_target on smithi203 to 176.0M 2024-09-19T08:21:18.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:17 smithi027 ceph-mon[31209]: Unable to set osd_memory_target on smithi203 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-19T08:21:18.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:17 smithi027 ceph-mon[31209]: Adjusting osd_memory_target on smithi027 to 176.0M 2024-09-19T08:21:18.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:17 smithi027 ceph-mon[31209]: Unable to set osd_memory_target on smithi027 to 184555212: error parsing value: Value '184555212' is below minimum 939524096 2024-09-19T08:21:18.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:17 smithi203 ceph-mon[35198]: Adjusting osd_memory_target on smithi155 to 176.0M 2024-09-19T08:21:18.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:17 smithi203 ceph-mon[35198]: Unable to set osd_memory_target on smithi155 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-19T08:21:18.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:17 smithi203 ceph-mon[35198]: Adjusting osd_memory_target on smithi203 to 176.0M 2024-09-19T08:21:18.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:17 smithi203 ceph-mon[35198]: Unable to set osd_memory_target on smithi203 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-19T08:21:18.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:17 smithi203 ceph-mon[35198]: Adjusting osd_memory_target on smithi027 to 176.0M 2024-09-19T08:21:18.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:17 smithi203 ceph-mon[35198]: Unable to set osd_memory_target on smithi027 to 184555212: error parsing value: Value '184555212' is below minimum 939524096 2024-09-19T08:21:18.982 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:21:19.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:18 smithi155 ceph-mon[35362]: pgmap v319: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T08:21:19.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:18 smithi027 ceph-mon[31209]: pgmap v319: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T08:21:19.253 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:21:19.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:18 smithi203 ceph-mon[35198]: pgmap v319: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T08:21:19.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.737+0000 7f741e70b640 1 -- 172.21.15.27:0/3218780716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7418103720 msgr2=0x7f7418107b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:19.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.737+0000 7f741e70b640 1 --2- 172.21.15.27:0/3218780716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7418103720 0x7f7418107b60 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f740c009930 tx=0x7f740c02a420 comp rx=0 tx=0).stop 2024-09-19T08:21:19.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.737+0000 7f741e70b640 1 -- 172.21.15.27:0/3218780716 shutdown_connections 2024-09-19T08:21:19.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.737+0000 7f741e70b640 1 --2- 172.21.15.27:0/3218780716 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74181082a0 0x7f741810ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.737+0000 7f741e70b640 1 --2- 172.21.15.27:0/3218780716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7418103720 0x7f7418107b60 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.737+0000 7f741e70b640 1 --2- 172.21.15.27:0/3218780716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7418102d70 0x7f7418103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.737+0000 7f741e70b640 1 -- 172.21.15.27:0/3218780716 >> 172.21.15.27:0/3218780716 conn(0x7f74180fc7d0 msgr2=0x7f74180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:19.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.737+0000 7f741e70b640 1 -- 172.21.15.27:0/3218780716 shutdown_connections 2024-09-19T08:21:19.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.737+0000 7f741e70b640 1 -- 172.21.15.27:0/3218780716 wait complete. 2024-09-19T08:21:19.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.738+0000 7f741e70b640 1 Processor -- start 2024-09-19T08:21:19.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.738+0000 7f741e70b640 1 -- start start 2024-09-19T08:21:19.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.739+0000 7f741e70b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7418102d70 0x7f74181009d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:19.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.739+0000 7f741e70b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7418103720 0x7f7418100f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:19.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.739+0000 7f741e70b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74181082a0 0x7f7418101450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:19.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.739+0000 7f741e70b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7418112040 con 0x7f7418103720 2024-09-19T08:21:19.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.739+0000 7f741e70b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7418111ec0 con 0x7f7418102d70 2024-09-19T08:21:19.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.739+0000 7f741e70b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f74181121c0 con 0x7f74181082a0 2024-09-19T08:21:19.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.739+0000 7f74177fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7418103720 0x7f7418100f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:19.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.739+0000 7f74177fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7418103720 0x7f7418100f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42116/0 (socket says 172.21.15.27:42116) 2024-09-19T08:21:19.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.739+0000 7f74177fe640 1 -- 172.21.15.27:0/3600645471 learned_addr learned my addr 172.21.15.27:0/3600645471 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:19.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.739+0000 7f741cca8640 1 --2- 172.21.15.27:0/3600645471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74181082a0 0x7f7418101450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:19.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.739+0000 7f7417fff640 1 --2- 172.21.15.27:0/3600645471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7418102d70 0x7f74181009d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:19.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.739+0000 7f74177fe640 1 -- 172.21.15.27:0/3600645471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74181082a0 msgr2=0x7f7418101450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:19.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.739+0000 7f74177fe640 1 --2- 172.21.15.27:0/3600645471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74181082a0 0x7f7418101450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.739+0000 7f74177fe640 1 -- 172.21.15.27:0/3600645471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7418102d70 msgr2=0x7f74181009d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:19.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.739+0000 7f74177fe640 1 --2- 172.21.15.27:0/3600645471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7418102d70 0x7f74181009d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.739+0000 7f74177fe640 1 -- 172.21.15.27:0/3600645471 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74181a69f0 con 0x7f7418103720 2024-09-19T08:21:19.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.739+0000 7f74177fe640 1 --2- 172.21.15.27:0/3600645471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7418103720 0x7f7418100f10 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f740c005940 tx=0x7f740c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:19.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.740+0000 7f74157fa640 1 -- 172.21.15.27:0/3600645471 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c03f030 con 0x7f7418103720 2024-09-19T08:21:19.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.740+0000 7f74157fa640 1 -- 172.21.15.27:0/3600645471 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f740c003ce0 con 0x7f7418103720 2024-09-19T08:21:19.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.740+0000 7f741e70b640 1 -- 172.21.15.27:0/3600645471 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74181a6c80 con 0x7f7418103720 2024-09-19T08:21:19.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.740+0000 7f74157fa640 1 -- 172.21.15.27:0/3600645471 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c035070 con 0x7f7418103720 2024-09-19T08:21:19.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.740+0000 7f741e70b640 1 -- 172.21.15.27:0/3600645471 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74181a71b0 con 0x7f7418103720 2024-09-19T08:21:19.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.742+0000 7f74157fa640 1 -- 172.21.15.27:0/3600645471 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f740c042030 con 0x7f7418103720 2024-09-19T08:21:19.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.742+0000 7f7420ae4740 1 Processor -- start 2024-09-19T08:21:19.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.742+0000 7f7420ae4740 1 -- start start 2024-09-19T08:21:19.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.743+0000 7f7420ae4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b8d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:19.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.743+0000 7f7420ae4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4c4b8ddc0 0x55b4c4b98140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:19.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.743+0000 7f7420ae4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b98680 0x55b4c4b9aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:19.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.743+0000 7f7420ae4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55b4c4af32e0 con 0x55b4c4b8d4a0 2024-09-19T08:21:19.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.743+0000 7f7420ae4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b4c4a9ace0 con 0x55b4c4b98680 2024-09-19T08:21:19.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.743+0000 7f7420ae4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b4c4aef2a0 con 0x55b4c4b8ddc0 2024-09-19T08:21:19.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.743+0000 7f741cca8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b8d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:19.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.743+0000 7f741cca8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b8d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42124/0 (socket says 172.21.15.27:42124) 2024-09-19T08:21:19.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.743+0000 7f741cca8640 1 -- 172.21.15.27:0/1266346113 learned_addr learned my addr 172.21.15.27:0/1266346113 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:19.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.743+0000 7f7417fff640 1 --2- 172.21.15.27:0/1266346113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4c4b8ddc0 0x55b4c4b98140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:19.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.743+0000 7f74177fe640 1 --2- 172.21.15.27:0/1266346113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b98680 0x55b4c4b9aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:19.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.743+0000 7f741cca8640 1 -- 172.21.15.27:0/1266346113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4c4b8ddc0 msgr2=0x55b4c4b98140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:21:19.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.743+0000 7f741cca8640 1 --2- 172.21.15.27:0/1266346113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4c4b8ddc0 0x55b4c4b98140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.743+0000 7f741cca8640 1 -- 172.21.15.27:0/1266346113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b98680 msgr2=0x55b4c4b9aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:21:19.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.743+0000 7f741cca8640 1 --2- 172.21.15.27:0/1266346113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b98680 0x55b4c4b9aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.743+0000 7f741cca8640 1 -- 172.21.15.27:0/1266346113 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4c4a7f440 con 0x55b4c4b8d4a0 2024-09-19T08:21:19.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.743+0000 7f74177fe640 1 --2- 172.21.15.27:0/1266346113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b98680 0x55b4c4b9aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:21:19.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.743+0000 7f74157fa640 1 --2- 172.21.15.27:0/3600645471 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f74000a3430 0x7f74000a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:19.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.743+0000 7f741cca8640 1 --2- 172.21.15.27:0/1266346113 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b8d880 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7410009f70 tx=0x7f7410010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46c89d391eace14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:19.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.743+0000 7f7417fff640 1 --2- 172.21.15.27:0/3600645471 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f74000a3430 0x7f74000a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:19.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.744+0000 7f74157fa640 1 -- 172.21.15.27:0/3600645471 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f740c0f0100 con 0x7f7418103720 2024-09-19T08:21:19.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.744+0000 7f73fe7fc640 1 -- 172.21.15.27:0/1266346113 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410016070 con 0x55b4c4b8d4a0 2024-09-19T08:21:19.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.744+0000 7f73fe7fc640 1 -- 172.21.15.27:0/1266346113 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7410004d20 con 0x55b4c4b8d4a0 2024-09-19T08:21:19.900 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:21:19.900 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "no active scrubs running", 2024-09-19T08:21:19.900 INFO:teuthology.orchestra.run.smithi027.stdout: "scrubs": {} 2024-09-19T08:21:19.900 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:21:19.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.744+0000 7f73fe7fc640 1 -- 172.21.15.27:0/1266346113 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74100128f0 con 0x55b4c4b8d4a0 2024-09-19T08:21:19.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.744+0000 7f7420ae4740 1 -- 172.21.15.27:0/1266346113 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 msgr2=0x55b4c4b8d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:19.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.744+0000 7f7420ae4740 1 --2- 172.21.15.27:0/1266346113 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b8d880 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7410009f70 tx=0x7f7410010800 comp rx=0 tx=0).stop 2024-09-19T08:21:19.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.744+0000 7f7417fff640 1 --2- 172.21.15.27:0/3600645471 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f74000a3430 0x7f74000a58f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55b4c4b8a890 tx=0x7f7408005ec0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:19.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.745+0000 7f7420ae4740 1 -- 172.21.15.27:0/1266346113 shutdown_connections 2024-09-19T08:21:19.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.745+0000 7f7420ae4740 1 --2- 172.21.15.27:0/1266346113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b98680 0x55b4c4b9aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.745+0000 7f7420ae4740 1 --2- 172.21.15.27:0/1266346113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4c4b8ddc0 0x55b4c4b98140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.745+0000 7f7420ae4740 1 --2- 172.21.15.27:0/1266346113 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b8d880 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.745+0000 7f7420ae4740 1 -- 172.21.15.27:0/1266346113 >> 172.21.15.27:0/1266346113 conn(0x55b4c4b89a30 msgr2=0x55b4c4b89e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:19.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.745+0000 7f7420ae4740 1 -- 172.21.15.27:0/1266346113 shutdown_connections 2024-09-19T08:21:19.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.745+0000 7f7420ae4740 1 -- 172.21.15.27:0/1266346113 wait complete. 2024-09-19T08:21:19.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.745+0000 7f7420ae4740 1 -- start start 2024-09-19T08:21:19.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.745+0000 7f7420ae4740 1 Processor -- start 2024-09-19T08:21:19.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.746+0000 7f7420ae4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b97fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:19.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.746+0000 7f7420ae4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4c4b8ddc0 0x55b4c4b95250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:19.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.746+0000 7f7420ae4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b98680 0x55b4c4b95790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:19.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.746+0000 7f7420ae4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55b4c4b9b250 con 0x55b4c4b8d4a0 2024-09-19T08:21:19.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.746+0000 7f7420ae4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b4c4aae050 con 0x55b4c4b98680 2024-09-19T08:21:19.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.746+0000 7f7420ae4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b4c4b9b3d0 con 0x55b4c4b8ddc0 2024-09-19T08:21:19.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.746+0000 7f7420ae4740 10 client.0 _ll_register_callbacks cb 0x55b4c4aee160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:21:19.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.746+0000 7f7417fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b97fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:19.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.746+0000 7f7417fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b97fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42126/0 (socket says 172.21.15.27:42126) 2024-09-19T08:21:19.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.746+0000 7f7417fff640 1 -- 172.21.15.27:0/981350612 learned_addr learned my addr 172.21.15.27:0/981350612 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:19.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.746+0000 7f741cca8640 1 --2- 172.21.15.27:0/981350612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b98680 0x55b4c4b95790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:19.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.746+0000 7f74177fe640 1 --2- 172.21.15.27:0/981350612 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4c4b8ddc0 0x55b4c4b95250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:19.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.746+0000 7f7417fff640 1 -- 172.21.15.27:0/981350612 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4c4b8ddc0 msgr2=0x55b4c4b95250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:21:19.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.746+0000 7f7417fff640 1 --2- 172.21.15.27:0/981350612 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4c4b8ddc0 0x55b4c4b95250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.746+0000 7f7417fff640 1 -- 172.21.15.27:0/981350612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b98680 msgr2=0x55b4c4b95790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:21:19.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.746+0000 7f7417fff640 1 --2- 172.21.15.27:0/981350612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b98680 0x55b4c4b95790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.746+0000 7f7417fff640 1 -- 172.21.15.27:0/981350612 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4c48643c0 con 0x55b4c4b8d4a0 2024-09-19T08:21:19.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.746+0000 7f7417fff640 1 --2- 172.21.15.27:0/981350612 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b97fa0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f74080116c0 tx=0x7f7408004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76229a41db2b4e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:19.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.746+0000 7f73f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:21:19.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.747+0000 7f73f77fe640 1 -- 172.21.15.27:0/981350612 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7408022070 con 0x55b4c4b8d4a0 2024-09-19T08:21:19.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.747+0000 7f7420ae4740 1 -- 172.21.15.27:0/981350612 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7410004d20 con 0x55b4c4b8d4a0 2024-09-19T08:21:19.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.747+0000 7f73f77fe640 1 -- 172.21.15.27:0/981350612 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f7408005220 con 0x55b4c4b8d4a0 2024-09-19T08:21:19.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.747+0000 7f73f77fe640 1 -- 172.21.15.27:0/981350612 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f740802d050 con 0x55b4c4b8d4a0 2024-09-19T08:21:19.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.747+0000 7f7420ae4740 10 client.16956 fetch_fsmap learned FSMap version 20 2024-09-19T08:21:19.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.747+0000 7f7420ae4740 1 -- 172.21.15.27:0/981350612 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b4c4ba6c20 con 0x55b4c4b8d4a0 2024-09-19T08:21:19.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.747+0000 7f73f77fe640 1 -- 172.21.15.27:0/981350612 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7410004d20 con 0x55b4c4b8d4a0 2024-09-19T08:21:19.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.747+0000 7f73f77fe640 1 -- 172.21.15.27:0/981350612 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f74080108d0 con 0x55b4c4b8d4a0 2024-09-19T08:21:19.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.747+0000 7f7420ae4740 10 client.16956 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:21:19.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.747+0000 7f7420ae4740 10 client.16956 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:21:19.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.747+0000 7f7420ae4740 20 client.16956 populate_metadata read hostname 'smithi027' 2024-09-19T08:21:19.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.747+0000 7f7420ae4740 1 --2- 172.21.15.27:0/981350612 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55b4c4ba83c0 0x55b4c4baa810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:19.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.747+0000 7f7420ae4740 4 client.16956 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:21:19.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.747+0000 7f7420ae4740 1 -- 172.21.15.27:0/981350612 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4c4b00850 con 0x55b4c4ba83c0 2024-09-19T08:21:19.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.748+0000 7f74177fe640 1 --2- 172.21.15.27:0/981350612 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55b4c4ba83c0 0x55b4c4baa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:19.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.748+0000 7f74177fe640 1 --2- 172.21.15.27:0/981350612 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55b4c4ba83c0 0x55b4c4baa810 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=986d7bc895ffc95a server_cookie=a2f2c277d3b21160 in_seq=0 out_seq=0 2024-09-19T08:21:19.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.748+0000 7f73f77fe640 10 client.16956 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:21:19.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.749+0000 7f73f77fe640 1 -- 172.21.15.27:0/981350612 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b4c4b00850 con 0x55b4c4ba83c0 2024-09-19T08:21:19.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.749+0000 7f73f77fe640 10 client.16956 handle_command_reply: tid=0 2024-09-19T08:21:19.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.749+0000 7f7420ae4740 1 client.16956 shutdown 2024-09-19T08:21:19.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.749+0000 7f7420ae4740 1 -- 172.21.15.27:0/981350612 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 msgr2=0x55b4c4b97fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:19.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.749+0000 7f7420ae4740 1 --2- 172.21.15.27:0/981350612 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b97fa0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f74080116c0 tx=0x7f7408004730 comp rx=0 tx=0).stop 2024-09-19T08:21:19.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.749+0000 7f7420ae4740 1 -- 172.21.15.27:0/981350612 shutdown_connections 2024-09-19T08:21:19.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.749+0000 7f7420ae4740 1 --2- 172.21.15.27:0/981350612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b98680 0x55b4c4b95790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.749+0000 7f7420ae4740 1 --2- 172.21.15.27:0/981350612 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55b4c4ba83c0 0x55b4c4baa810 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.749+0000 7f7420ae4740 1 --2- 172.21.15.27:0/981350612 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4c4b8ddc0 0x55b4c4b95250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.749+0000 7f73f77fe640 0 client.16956 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:21:19.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.749+0000 7f7420ae4740 1 --2- 172.21.15.27:0/981350612 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b97fa0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.749+0000 7f7420ae4740 1 -- 172.21.15.27:0/981350612 >> 172.21.15.27:0/981350612 conn(0x55b4c4b89a30 msgr2=0x55b4c4b8f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:19.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.749+0000 7f7420ae4740 1 -- 172.21.15.27:0/981350612 shutdown_connections 2024-09-19T08:21:19.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.749+0000 7f7420ae4740 1 -- 172.21.15.27:0/981350612 wait complete. 2024-09-19T08:21:19.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.749+0000 7f7420ae4740 20 client.16956 trim_cache size 0 max 16384 2024-09-19T08:21:19.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.787+0000 7f7420ae4740 1 Processor -- start 2024-09-19T08:21:19.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.787+0000 7f7420ae4740 1 -- start start 2024-09-19T08:21:19.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.787+0000 7f7420ae4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4c4b89a30 0x55b4c4ba44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:19.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.787+0000 7f7420ae4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b95210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:19.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.787+0000 7f7420ae4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b8ddc0 0x55b4c4b907f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:19.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.787+0000 7f7420ae4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f74181ada70 con 0x55b4c4b8d4a0 2024-09-19T08:21:19.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.787+0000 7f7420ae4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f74181b02d0 con 0x55b4c4b8ddc0 2024-09-19T08:21:19.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.787+0000 7f7420ae4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f74181ae0c0 con 0x55b4c4b89a30 2024-09-19T08:21:19.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.787+0000 7f74177fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b95210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:19.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.787+0000 7f74177fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b95210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42132/0 (socket says 172.21.15.27:42132) 2024-09-19T08:21:19.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.787+0000 7f74177fe640 1 -- 172.21.15.27:0/3984317460 learned_addr learned my addr 172.21.15.27:0/3984317460 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:19.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.787+0000 7f741cca8640 1 --2- 172.21.15.27:0/3984317460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b8ddc0 0x55b4c4b907f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:19.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.787+0000 7f7417fff640 1 --2- 172.21.15.27:0/3984317460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4c4b89a30 0x55b4c4ba44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:19.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.787+0000 7f74177fe640 1 -- 172.21.15.27:0/3984317460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4c4b89a30 msgr2=0x55b4c4ba44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:21:19.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.787+0000 7f74177fe640 1 --2- 172.21.15.27:0/3984317460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4c4b89a30 0x55b4c4ba44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.787+0000 7f74177fe640 1 -- 172.21.15.27:0/3984317460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b8ddc0 msgr2=0x55b4c4b907f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:21:19.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.787+0000 7f74177fe640 1 --2- 172.21.15.27:0/3984317460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b8ddc0 0x55b4c4b907f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.787+0000 7f74177fe640 1 -- 172.21.15.27:0/3984317460 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4c4b8dbb0 con 0x55b4c4b8d4a0 2024-09-19T08:21:19.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.787+0000 7f741cca8640 1 --2- 172.21.15.27:0/3984317460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b8ddc0 0x55b4c4b907f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:21:19.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.788+0000 7f74177fe640 1 --2- 172.21.15.27:0/3984317460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b95210 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f740c004600 tx=0x7f740c0f2610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91c8c19fdf4882c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:19.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.788+0000 7f73fdffb640 1 -- 172.21.15.27:0/3984317460 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c049040 con 0x55b4c4b8d4a0 2024-09-19T08:21:19.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.788+0000 7f73fdffb640 1 -- 172.21.15.27:0/3984317460 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f740c0bcb00 con 0x55b4c4b8d4a0 2024-09-19T08:21:19.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.788+0000 7f73fdffb640 1 -- 172.21.15.27:0/3984317460 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c0b8a70 con 0x55b4c4b8d4a0 2024-09-19T08:21:19.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.789+0000 7f7420ae4740 1 -- 172.21.15.27:0/3984317460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 msgr2=0x55b4c4b95210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:19.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.789+0000 7f7420ae4740 1 --2- 172.21.15.27:0/3984317460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b95210 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f740c004600 tx=0x7f740c0f2610 comp rx=0 tx=0).stop 2024-09-19T08:21:19.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.789+0000 7f7420ae4740 1 -- 172.21.15.27:0/3984317460 shutdown_connections 2024-09-19T08:21:19.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.789+0000 7f7420ae4740 1 --2- 172.21.15.27:0/3984317460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b8ddc0 0x55b4c4b907f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.789+0000 7f7420ae4740 1 --2- 172.21.15.27:0/3984317460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b95210 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.789+0000 7f7420ae4740 1 --2- 172.21.15.27:0/3984317460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4c4b89a30 0x55b4c4ba44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.789+0000 7f7420ae4740 1 -- 172.21.15.27:0/3984317460 >> 172.21.15.27:0/3984317460 conn(0x55b4c4b958f0 msgr2=0x55b4c4b900e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:19.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.789+0000 7f7420ae4740 1 -- 172.21.15.27:0/3984317460 shutdown_connections 2024-09-19T08:21:19.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.789+0000 7f7420ae4740 1 -- 172.21.15.27:0/3984317460 wait complete. 2024-09-19T08:21:19.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.789+0000 7f7420ae4740 1 -- start start 2024-09-19T08:21:19.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.789+0000 7f7420ae4740 1 Processor -- start 2024-09-19T08:21:19.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f7420ae4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4c4b89a30 0x55b4c4ba0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:19.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f7420ae4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b9c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:19.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f7420ae4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8ddc0 0x55b4c4b9c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:19.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f7420ae4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f74181ae790 con 0x55b4c4b8ddc0 2024-09-19T08:21:19.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f7420ae4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f74181afc00 con 0x55b4c4b8d4a0 2024-09-19T08:21:19.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f7420ae4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f74181aee60 con 0x55b4c4b89a30 2024-09-19T08:21:19.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f7420ae4740 10 client.0 _ll_register_callbacks cb 0x7f7408015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:21:19.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f741cca8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8ddc0 0x55b4c4b9c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:19.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f741cca8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8ddc0 0x55b4c4b9c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42144/0 (socket says 172.21.15.27:42144) 2024-09-19T08:21:19.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f741cca8640 1 -- 172.21.15.27:0/2293888613 learned_addr learned my addr 172.21.15.27:0/2293888613 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:19.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f7417fff640 1 --2- 172.21.15.27:0/2293888613 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4c4b89a30 0x55b4c4ba0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:19.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f74177fe640 1 --2- 172.21.15.27:0/2293888613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b9c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:19.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f741cca8640 1 -- 172.21.15.27:0/2293888613 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4c4b89a30 msgr2=0x55b4c4ba0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:21:19.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f741cca8640 1 --2- 172.21.15.27:0/2293888613 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4c4b89a30 0x55b4c4ba0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f741cca8640 1 -- 172.21.15.27:0/2293888613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b8d4a0 msgr2=0x55b4c4b9c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:21:19.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f741cca8640 1 --2- 172.21.15.27:0/2293888613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b9c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f741cca8640 1 -- 172.21.15.27:0/2293888613 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4c4c120f0 con 0x55b4c4b8ddc0 2024-09-19T08:21:19.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f74177fe640 1 --2- 172.21.15.27:0/2293888613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b9c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:21:19.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f741cca8640 1 --2- 172.21.15.27:0/2293888613 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8ddc0 0x55b4c4b9c9e0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f74100124c0 tx=0x7f7410012850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdcd1ce9531a31d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:19.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f73f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:21:19.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.790+0000 7f73f77fe640 1 -- 172.21.15.27:0/2293888613 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741002b060 con 0x55b4c4b8ddc0 2024-09-19T08:21:19.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.791+0000 7f73f77fe640 1 -- 172.21.15.27:0/2293888613 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f7410012d50 con 0x55b4c4b8ddc0 2024-09-19T08:21:19.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.791+0000 7f7420ae4740 1 -- 172.21.15.27:0/2293888613 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f740c0bcb00 con 0x55b4c4b8ddc0 2024-09-19T08:21:19.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.791+0000 7f73f77fe640 1 -- 172.21.15.27:0/2293888613 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7410016040 con 0x55b4c4b8ddc0 2024-09-19T08:21:19.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.791+0000 7f7420ae4740 10 client.16962 fetch_fsmap learned FSMap version 20 2024-09-19T08:21:19.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.791+0000 7f7420ae4740 1 -- 172.21.15.27:0/2293888613 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b4c4c132f0 con 0x55b4c4b8ddc0 2024-09-19T08:21:19.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.791+0000 7f73f77fe640 1 -- 172.21.15.27:0/2293888613 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f740c0bcb00 con 0x55b4c4b8ddc0 2024-09-19T08:21:19.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.791+0000 7f73f77fe640 1 -- 172.21.15.27:0/2293888613 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f741000f040 con 0x55b4c4b8ddc0 2024-09-19T08:21:19.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.791+0000 7f7420ae4740 10 client.16962 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:21:19.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.791+0000 7f7420ae4740 10 client.16962 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:21:19.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.791+0000 7f7420ae4740 20 client.16962 populate_metadata read hostname 'smithi027' 2024-09-19T08:21:19.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.791+0000 7f7420ae4740 1 --2- 172.21.15.27:0/2293888613 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55b4c4b98680 0x55b4c4c158f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:19.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.791+0000 7f7420ae4740 4 client.16962 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:21:19.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.791+0000 7f7420ae4740 1 -- 172.21.15.27:0/2293888613 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b4c4afad60 con 0x55b4c4b98680 2024-09-19T08:21:19.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.791+0000 7f7417fff640 1 --2- 172.21.15.27:0/2293888613 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55b4c4b98680 0x55b4c4c158f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:19.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.792+0000 7f73f77fe640 10 client.16962 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:21:19.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.792+0000 7f7417fff640 1 --2- 172.21.15.27:0/2293888613 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55b4c4b98680 0x55b4c4c158f0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92cdc09b390ba194 server_cookie=bda39a9189673a9 in_seq=0 out_seq=0 2024-09-19T08:21:19.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.792+0000 7f73f77fe640 1 -- 172.21.15.27:0/2293888613 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b4c4afad60 con 0x55b4c4b98680 2024-09-19T08:21:19.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.792+0000 7f73f77fe640 10 client.16962 handle_command_reply: tid=0 2024-09-19T08:21:19.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.792+0000 7f7420ae4740 1 client.16962 shutdown 2024-09-19T08:21:19.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.792+0000 7f7420ae4740 1 -- 172.21.15.27:0/2293888613 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8ddc0 msgr2=0x55b4c4b9c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:19.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.792+0000 7f7420ae4740 1 --2- 172.21.15.27:0/2293888613 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8ddc0 0x55b4c4b9c9e0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f74100124c0 tx=0x7f7410012850 comp rx=0 tx=0).stop 2024-09-19T08:21:19.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.792+0000 7f7420ae4740 1 -- 172.21.15.27:0/2293888613 shutdown_connections 2024-09-19T08:21:19.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.792+0000 7f7420ae4740 1 --2- 172.21.15.27:0/2293888613 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4c4b8ddc0 0x55b4c4b9c9e0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.792+0000 7f7420ae4740 1 --2- 172.21.15.27:0/2293888613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b4c4b8d4a0 0x55b4c4b9c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.792+0000 7f7420ae4740 1 --2- 172.21.15.27:0/2293888613 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x55b4c4b98680 0x55b4c4c158f0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.792+0000 7f7420ae4740 1 --2- 172.21.15.27:0/2293888613 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4c4b89a30 0x55b4c4ba0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.792+0000 7f7420ae4740 1 -- 172.21.15.27:0/2293888613 >> 172.21.15.27:0/2293888613 conn(0x55b4c4b958f0 msgr2=0x55b4c4b90900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:19.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.792+0000 7f73f77fe640 0 client.16962 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:21:19.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.792+0000 7f7420ae4740 1 -- 172.21.15.27:0/2293888613 shutdown_connections 2024-09-19T08:21:19.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.792+0000 7f7420ae4740 1 -- 172.21.15.27:0/2293888613 wait complete. 2024-09-19T08:21:19.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.793+0000 7f7420ae4740 20 client.16962 trim_cache size 0 max 16384 2024-09-19T08:21:19.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.793+0000 7f741e70b640 1 -- 172.21.15.27:0/3600645471 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f74000a3430 msgr2=0x7f74000a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:19.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.793+0000 7f741e70b640 1 --2- 172.21.15.27:0/3600645471 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f74000a3430 0x7f74000a58f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55b4c4b8a890 tx=0x7f7408005ec0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.793+0000 7f741e70b640 1 -- 172.21.15.27:0/3600645471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7418103720 msgr2=0x7f7418100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:19.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.793+0000 7f741e70b640 1 --2- 172.21.15.27:0/3600645471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7418103720 0x7f7418100f10 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f740c005940 tx=0x7f740c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.793+0000 7f741e70b640 1 -- 172.21.15.27:0/3600645471 shutdown_connections 2024-09-19T08:21:19.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.793+0000 7f741e70b640 1 --2- 172.21.15.27:0/3600645471 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f74000a3430 0x7f74000a58f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.793+0000 7f741e70b640 1 --2- 172.21.15.27:0/3600645471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74181082a0 0x7f7418101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.793+0000 7f741e70b640 1 --2- 172.21.15.27:0/3600645471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7418103720 0x7f7418100f10 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.793+0000 7f741e70b640 1 --2- 172.21.15.27:0/3600645471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7418102d70 0x7f74181009d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:19.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.793+0000 7f741e70b640 1 -- 172.21.15.27:0/3600645471 >> 172.21.15.27:0/3600645471 conn(0x7f74180fc7d0 msgr2=0x7f7418105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:19.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.793+0000 7f741e70b640 1 -- 172.21.15.27:0/3600645471 shutdown_connections 2024-09-19T08:21:19.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:19.794+0000 7f741e70b640 1 -- 172.21.15.27:0/3600645471 wait complete. 2024-09-19T08:21:20.895 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:21:20.895 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:21:21.168 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:21:21.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:20 smithi155 ceph-mon[35362]: pgmap v320: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 238 B/s wr, 6 op/s 2024-09-19T08:21:21.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:20 smithi027 ceph-mon[31209]: pgmap v320: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 238 B/s wr, 6 op/s 2024-09-19T08:21:21.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:20 smithi203 ceph-mon[35198]: pgmap v320: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 238 B/s wr, 6 op/s 2024-09-19T08:21:21.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.638+0000 7f3db6769640 1 -- 172.21.15.27:0/1326621462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3db010c170 msgr2=0x7f3db010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:21.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.638+0000 7f3db6769640 1 --2- 172.21.15.27:0/1326621462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3db010c170 0x7f3db010e610 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f3da8009ca0 tx=0x7f3da802a950 comp rx=0 tx=0).stop 2024-09-19T08:21:21.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.638+0000 7f3db6769640 1 -- 172.21.15.27:0/1326621462 shutdown_connections 2024-09-19T08:21:21.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.638+0000 7f3db6769640 1 --2- 172.21.15.27:0/1326621462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3db010c170 0x7f3db010e610 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:21.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.638+0000 7f3db6769640 1 --2- 172.21.15.27:0/1326621462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db0103660 0x7f3db010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:21.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.638+0000 7f3db6769640 1 --2- 172.21.15.27:0/1326621462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3db0102d40 0x7f3db0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:21.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.638+0000 7f3db6769640 1 -- 172.21.15.27:0/1326621462 >> 172.21.15.27:0/1326621462 conn(0x7f3db00fc7a0 msgr2=0x7f3db00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:21.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.638+0000 7f3db6769640 1 -- 172.21.15.27:0/1326621462 shutdown_connections 2024-09-19T08:21:21.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.638+0000 7f3db6769640 1 -- 172.21.15.27:0/1326621462 wait complete. 2024-09-19T08:21:21.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.638+0000 7f3db6769640 1 Processor -- start 2024-09-19T08:21:21.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.638+0000 7f3db6769640 1 -- start start 2024-09-19T08:21:21.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.639+0000 7f3db6769640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3db0102d40 0x7f3db019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:21.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.639+0000 7f3db6769640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3db0103660 0x7f3db019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:21.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.639+0000 7f3db6769640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db010c170 0x7f3db019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:21.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.639+0000 7f3db6769640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3db0111f70 con 0x7f3db0103660 2024-09-19T08:21:21.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.639+0000 7f3db6769640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3db0111df0 con 0x7f3db010c170 2024-09-19T08:21:21.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.639+0000 7f3db6769640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3db01120f0 con 0x7f3db0102d40 2024-09-19T08:21:21.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.639+0000 7f3daf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3db0103660 0x7f3db019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:21.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.639+0000 7f3daf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3db0103660 0x7f3db019ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52220/0 (socket says 172.21.15.27:52220) 2024-09-19T08:21:21.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.639+0000 7f3daf7fe640 1 -- 172.21.15.27:0/912483270 learned_addr learned my addr 172.21.15.27:0/912483270 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:21.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.639+0000 7f3db4d06640 1 --2- 172.21.15.27:0/912483270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db010c170 0x7f3db019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:21.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.639+0000 7f3daffff640 1 --2- 172.21.15.27:0/912483270 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3db0102d40 0x7f3db019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:21.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.639+0000 7f3daf7fe640 1 -- 172.21.15.27:0/912483270 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3db0102d40 msgr2=0x7f3db019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:21.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.639+0000 7f3daf7fe640 1 --2- 172.21.15.27:0/912483270 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3db0102d40 0x7f3db019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:21.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.639+0000 7f3daf7fe640 1 -- 172.21.15.27:0/912483270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db010c170 msgr2=0x7f3db019eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:21.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.639+0000 7f3daf7fe640 1 --2- 172.21.15.27:0/912483270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db010c170 0x7f3db019eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:21.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.639+0000 7f3daf7fe640 1 -- 172.21.15.27:0/912483270 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db019f5b0 con 0x7f3db0103660 2024-09-19T08:21:21.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.639+0000 7f3daf7fe640 1 --2- 172.21.15.27:0/912483270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3db0103660 0x7f3db019ab40 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f3da400d740 tx=0x7f3da400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:21.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.640+0000 7f3dad7fa640 1 -- 172.21.15.27:0/912483270 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da4017070 con 0x7f3db0103660 2024-09-19T08:21:21.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.640+0000 7f3db6769640 1 -- 172.21.15.27:0/912483270 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db019f8a0 con 0x7f3db0103660 2024-09-19T08:21:21.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.640+0000 7f3dad7fa640 1 -- 172.21.15.27:0/912483270 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3da400de50 con 0x7f3db0103660 2024-09-19T08:21:21.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.640+0000 7f3dad7fa640 1 -- 172.21.15.27:0/912483270 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da400f620 con 0x7f3db0103660 2024-09-19T08:21:21.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.640+0000 7f3db6769640 1 -- 172.21.15.27:0/912483270 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db01a7180 con 0x7f3db0103660 2024-09-19T08:21:21.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.641+0000 7f3db6769640 1 -- 172.21.15.27:0/912483270 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3db0103120 con 0x7f3db0103660 2024-09-19T08:21:21.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.642+0000 7f3dad7fa640 1 -- 172.21.15.27:0/912483270 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3da4009c30 con 0x7f3db0103660 2024-09-19T08:21:21.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.642+0000 7f3dad7fa640 1 --2- 172.21.15.27:0/912483270 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3d980a33b0 0x7f3d980a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:21.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.643+0000 7f3daffff640 1 --2- 172.21.15.27:0/912483270 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3d980a33b0 0x7f3d980a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:21.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.643+0000 7f3dad7fa640 1 -- 172.21.15.27:0/912483270 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f3da40cf890 con 0x7f3db0103660 2024-09-19T08:21:21.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.643+0000 7f3daffff640 1 --2- 172.21.15.27:0/912483270 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3d980a33b0 0x7f3d980a5870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3da0005fd0 tx=0x7f3da0005850 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:21.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.647+0000 7f3dad7fa640 1 -- 172.21.15.27:0/912483270 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3da409c290 con 0x7f3db0103660 2024-09-19T08:21:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.860+0000 7f3db6769640 1 -- 172.21.15.27:0/912483270 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3db01a7420 con 0x7f3db0103660 2024-09-19T08:21:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.861+0000 7f3dad7fa640 1 -- 172.21.15.27:0/912483270 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7f3da409bb90 con 0x7f3db0103660 2024-09-19T08:21:21.862 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:21:21.862 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:21:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:21:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.863+0000 7f3db6769640 1 -- 172.21.15.27:0/912483270 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3d980a33b0 msgr2=0x7f3d980a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.863+0000 7f3db6769640 1 --2- 172.21.15.27:0/912483270 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3d980a33b0 0x7f3d980a5870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3da0005fd0 tx=0x7f3da0005850 comp rx=0 tx=0).stop 2024-09-19T08:21:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.863+0000 7f3db6769640 1 -- 172.21.15.27:0/912483270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3db0103660 msgr2=0x7f3db019ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.863+0000 7f3db6769640 1 --2- 172.21.15.27:0/912483270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3db0103660 0x7f3db019ab40 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f3da400d740 tx=0x7f3da400dc00 comp rx=0 tx=0).stop 2024-09-19T08:21:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.863+0000 7f3db6769640 1 -- 172.21.15.27:0/912483270 shutdown_connections 2024-09-19T08:21:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.863+0000 7f3db6769640 1 --2- 172.21.15.27:0/912483270 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3d980a33b0 0x7f3d980a5870 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.863+0000 7f3db6769640 1 --2- 172.21.15.27:0/912483270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db010c170 0x7f3db019eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.863+0000 7f3db6769640 1 --2- 172.21.15.27:0/912483270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3db0103660 0x7f3db019ab40 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.863+0000 7f3db6769640 1 --2- 172.21.15.27:0/912483270 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3db0102d40 0x7f3db019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.863+0000 7f3db6769640 1 -- 172.21.15.27:0/912483270 >> 172.21.15.27:0/912483270 conn(0x7f3db00fc7a0 msgr2=0x7f3db010d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.863+0000 7f3db6769640 1 -- 172.21.15.27:0/912483270 shutdown_connections 2024-09-19T08:21:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:21.863+0000 7f3db6769640 1 -- 172.21.15.27:0/912483270 wait complete. 2024-09-19T08:21:22.600 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:21:22.863 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:21:23.149 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:22 smithi027 ceph-mon[31209]: pgmap v321: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-19T08:21:23.149 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:22 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/912483270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:21:23.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:22 smithi155 ceph-mon[35362]: pgmap v321: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-19T08:21:23.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:22 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/912483270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:21:23.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:22 smithi203 ceph-mon[35198]: pgmap v321: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-19T08:21:23.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:22 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/912483270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:21:23.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.389+0000 7f701864a640 1 -- 172.21.15.27:0/3335608463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7010106f10 msgr2=0x7f701010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:23.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.389+0000 7f701864a640 1 --2- 172.21.15.27:0/3335608463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7010106f10 0x7f701010ea90 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f7008009ca0 tx=0x7f700802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.389+0000 7f701864a640 1 -- 172.21.15.27:0/3335608463 shutdown_connections 2024-09-19T08:21:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.389+0000 7f701864a640 1 --2- 172.21.15.27:0/3335608463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7010106f10 0x7f701010ea90 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.389+0000 7f701864a640 1 --2- 172.21.15.27:0/3335608463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7010102790 0x7f70101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.389+0000 7f701864a640 1 --2- 172.21.15.27:0/3335608463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7010101de0 0x7f70101021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.389+0000 7f701864a640 1 -- 172.21.15.27:0/3335608463 >> 172.21.15.27:0/3335608463 conn(0x7f70100fd8c0 msgr2=0x7f70100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.389+0000 7f701864a640 1 -- 172.21.15.27:0/3335608463 shutdown_connections 2024-09-19T08:21:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.389+0000 7f701864a640 1 -- 172.21.15.27:0/3335608463 wait complete. 2024-09-19T08:21:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.390+0000 7f701864a640 1 Processor -- start 2024-09-19T08:21:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.390+0000 7f701864a640 1 -- start start 2024-09-19T08:21:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.390+0000 7f701864a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7010101de0 0x7f7010198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.390+0000 7f701864a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7010102790 0x7f70101989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.390+0000 7f701864a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7010106f10 0x7f701019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.390+0000 7f701864a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7010111f90 con 0x7f7010106f10 2024-09-19T08:21:23.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.390+0000 7f701864a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7010111e10 con 0x7f7010101de0 2024-09-19T08:21:23.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.390+0000 7f701864a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7010112110 con 0x7f7010102790 2024-09-19T08:21:23.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.390+0000 7f7016be7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7010106f10 0x7f701019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:23.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.390+0000 7f7016be7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7010106f10 0x7f701019cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52242/0 (socket says 172.21.15.27:52242) 2024-09-19T08:21:23.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.390+0000 7f7016be7640 1 -- 172.21.15.27:0/193136156 learned_addr learned my addr 172.21.15.27:0/193136156 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:23.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.390+0000 7f70163e6640 1 --2- 172.21.15.27:0/193136156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7010101de0 0x7f7010198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:23.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.390+0000 7f7015be5640 1 --2- 172.21.15.27:0/193136156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7010102790 0x7f70101989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:23.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.391+0000 7f7016be7640 1 -- 172.21.15.27:0/193136156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7010102790 msgr2=0x7f70101989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:23.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.391+0000 7f7016be7640 1 --2- 172.21.15.27:0/193136156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7010102790 0x7f70101989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.391+0000 7f7016be7640 1 -- 172.21.15.27:0/193136156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7010101de0 msgr2=0x7f7010198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:23.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.391+0000 7f7016be7640 1 --2- 172.21.15.27:0/193136156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7010101de0 0x7f7010198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.391+0000 7f7016be7640 1 -- 172.21.15.27:0/193136156 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f701019d420 con 0x7f7010106f10 2024-09-19T08:21:23.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.391+0000 7f7015be5640 1 --2- 172.21.15.27:0/193136156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7010102790 0x7f70101989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:21:23.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.391+0000 7f7016be7640 1 --2- 172.21.15.27:0/193136156 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7010106f10 0x7f701019cd40 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f7008031a60 tx=0x7f7008031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:23.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.391+0000 7f70077fe640 1 -- 172.21.15.27:0/193136156 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7008003c30 con 0x7f7010106f10 2024-09-19T08:21:23.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.391+0000 7f70077fe640 1 -- 172.21.15.27:0/193136156 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7008003dd0 con 0x7f7010106f10 2024-09-19T08:21:23.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.391+0000 7f701864a640 1 -- 172.21.15.27:0/193136156 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f701019d6b0 con 0x7f7010106f10 2024-09-19T08:21:23.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.391+0000 7f70077fe640 1 -- 172.21.15.27:0/193136156 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70080047e0 con 0x7f7010106f10 2024-09-19T08:21:23.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.391+0000 7f701864a640 1 -- 172.21.15.27:0/193136156 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70101a4ff0 con 0x7f7010106f10 2024-09-19T08:21:23.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.393+0000 7f70077fe640 1 -- 172.21.15.27:0/193136156 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f700802f790 con 0x7f7010106f10 2024-09-19T08:21:23.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.394+0000 7f701aa23740 1 Processor -- start 2024-09-19T08:21:23.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.394+0000 7f701aa23740 1 -- start start 2024-09-19T08:21:23.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.394+0000 7f70077fe640 1 --2- 172.21.15.27:0/193136156 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6ffc0a33b0 0x7f6ffc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:23.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.394+0000 7f701aa23740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56316b23ff50 0x56316b23e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:23.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.394+0000 7f701aa23740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 0x56316b23ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:23.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.394+0000 7f701aa23740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56316b249780 0x56316b24bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:23.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.394+0000 7f701aa23740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56316b1a02f0 con 0x56316b23e9e0 2024-09-19T08:21:23.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.394+0000 7f701aa23740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56316b147cf0 con 0x56316b249780 2024-09-19T08:21:23.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.394+0000 7f701aa23740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56316b19c2b0 con 0x56316b23ff50 2024-09-19T08:21:23.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.394+0000 7f7015be5640 1 --2- 172.21.15.27:0/193136156 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6ffc0a33b0 0x7f6ffc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:23.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.395+0000 7f70077fe640 1 -- 172.21.15.27:0/193136156 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f70080f1060 con 0x7f7010106f10 2024-09-19T08:21:23.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.395+0000 7f7015be5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 0x56316b23ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:23.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.395+0000 7f7015be5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 0x56316b23ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52248/0 (socket says 172.21.15.27:52248) 2024-09-19T08:21:23.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.395+0000 7f7015be5640 1 -- 172.21.15.27:0/263140766 learned_addr learned my addr 172.21.15.27:0/263140766 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:23.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.395+0000 7f70163e6640 1 --2- 172.21.15.27:0/263140766 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56316b23ff50 0x56316b23e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.395+0000 7f7016be7640 1 --2- 172.21.15.27:0/263140766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56316b249780 0x56316b24bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.395+0000 7f7015be5640 1 -- 172.21.15.27:0/263140766 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56316b23ff50 msgr2=0x56316b23e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:21:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.395+0000 7f7015be5640 1 --2- 172.21.15.27:0/263140766 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56316b23ff50 0x56316b23e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.395+0000 7f7015be5640 1 -- 172.21.15.27:0/263140766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56316b249780 msgr2=0x56316b24bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:21:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.395+0000 7f7015be5640 1 --2- 172.21.15.27:0/263140766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56316b249780 0x56316b24bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.395+0000 7f7015be5640 1 -- 172.21.15.27:0/263140766 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56316b12c3a0 con 0x56316b23e9e0 2024-09-19T08:21:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.395+0000 7f7015be5640 1 --2- 172.21.15.27:0/193136156 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6ffc0a33b0 0x7f6ffc0a5870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f700000afd0 tx=0x7f700000a9b0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.395+0000 7f7015be5640 1 --2- 172.21.15.27:0/263140766 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 0x56316b23ee20 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f7000014fd0 tx=0x7f7000019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1e7a874584351e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.395+0000 7f7004ff9640 1 -- 172.21.15.27:0/263140766 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7000025070 con 0x56316b23e9e0 2024-09-19T08:21:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.395+0000 7f7004ff9640 1 -- 172.21.15.27:0/263140766 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f700001c070 con 0x56316b23e9e0 2024-09-19T08:21:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.395+0000 7f7004ff9640 1 -- 172.21.15.27:0/263140766 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7000020680 con 0x56316b23e9e0 2024-09-19T08:21:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.396+0000 7f701aa23740 1 -- 172.21.15.27:0/263140766 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 msgr2=0x56316b23ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.396+0000 7f701aa23740 1 --2- 172.21.15.27:0/263140766 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 0x56316b23ee20 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f7000014fd0 tx=0x7f7000019000 comp rx=0 tx=0).stop 2024-09-19T08:21:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.396+0000 7f701aa23740 1 -- 172.21.15.27:0/263140766 shutdown_connections 2024-09-19T08:21:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.396+0000 7f701aa23740 1 --2- 172.21.15.27:0/263140766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56316b249780 0x56316b24bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.396+0000 7f701aa23740 1 --2- 172.21.15.27:0/263140766 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 0x56316b23ee20 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.396+0000 7f701aa23740 1 --2- 172.21.15.27:0/263140766 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56316b23ff50 0x56316b23e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.396+0000 7f701aa23740 1 -- 172.21.15.27:0/263140766 >> 172.21.15.27:0/263140766 conn(0x56316b203310 msgr2=0x56316b23b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.396+0000 7f701aa23740 1 -- 172.21.15.27:0/263140766 shutdown_connections 2024-09-19T08:21:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.396+0000 7f701aa23740 1 -- 172.21.15.27:0/263140766 wait complete. 2024-09-19T08:21:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.397+0000 7f701aa23740 1 -- start start 2024-09-19T08:21:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.397+0000 7f701aa23740 1 Processor -- start 2024-09-19T08:21:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.397+0000 7f701aa23740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 0x56316b2491f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.397+0000 7f701aa23740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56316b23ff50 0x56316b2464a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.397+0000 7f701aa23740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56316b249780 0x56316b246be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.397+0000 7f701aa23740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56316b24c420 con 0x56316b23e9e0 2024-09-19T08:21:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.397+0000 7f701aa23740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56316b15b060 con 0x56316b249780 2024-09-19T08:21:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.397+0000 7f701aa23740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56316b24c5a0 con 0x56316b23ff50 2024-09-19T08:21:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.397+0000 7f701aa23740 10 client.0 _ll_register_callbacks cb 0x56316aeae8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:21:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.397+0000 7f70163e6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 0x56316b2491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.397+0000 7f70163e6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 0x56316b2491f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52254/0 (socket says 172.21.15.27:52254) 2024-09-19T08:21:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.397+0000 7f70163e6640 1 -- 172.21.15.27:0/1498091767 learned_addr learned my addr 172.21.15.27:0/1498091767 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.397+0000 7f7016be7640 1 --2- 172.21.15.27:0/1498091767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56316b249780 0x56316b246be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.397+0000 7f7015be5640 1 --2- 172.21.15.27:0/1498091767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56316b23ff50 0x56316b2464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.397+0000 7f70163e6640 1 -- 172.21.15.27:0/1498091767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56316b23ff50 msgr2=0x56316b2464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:21:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.397+0000 7f70163e6640 1 --2- 172.21.15.27:0/1498091767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56316b23ff50 0x56316b2464a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.397+0000 7f70163e6640 1 -- 172.21.15.27:0/1498091767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56316b249780 msgr2=0x56316b246be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:21:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.397+0000 7f70163e6640 1 --2- 172.21.15.27:0/1498091767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56316b249780 0x56316b246be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.397+0000 7f70163e6640 1 -- 172.21.15.27:0/1498091767 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56316af113c0 con 0x56316b23e9e0 2024-09-19T08:21:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.398+0000 7f70163e6640 1 --2- 172.21.15.27:0/1498091767 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 0x56316b2491f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f700c010a50 tx=0x7f700c010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b07d77b53b2230 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.398+0000 7f6ff9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:21:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.398+0000 7f6ff9ffb640 1 -- 172.21.15.27:0/1498091767 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c01e060 con 0x56316b23e9e0 2024-09-19T08:21:23.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.398+0000 7f6ff9ffb640 1 -- 172.21.15.27:0/1498091767 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f700c00fb50 con 0x56316b23e9e0 2024-09-19T08:21:23.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.398+0000 7f701aa23740 1 -- 172.21.15.27:0/1498091767 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f700001c070 con 0x56316b23e9e0 2024-09-19T08:21:23.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.398+0000 7f6ff9ffb640 1 -- 172.21.15.27:0/1498091767 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f700c00fd50 con 0x56316b23e9e0 2024-09-19T08:21:23.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.398+0000 7f701aa23740 10 client.16980 fetch_fsmap learned FSMap version 20 2024-09-19T08:21:23.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.398+0000 7f701aa23740 1 -- 172.21.15.27:0/1498091767 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56316b257fb0 con 0x56316b23e9e0 2024-09-19T08:21:23.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.398+0000 7f6ff9ffb640 1 -- 172.21.15.27:0/1498091767 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f700001c070 con 0x56316b23e9e0 2024-09-19T08:21:23.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.399+0000 7f6ff9ffb640 1 -- 172.21.15.27:0/1498091767 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f700c0214b0 con 0x56316b23e9e0 2024-09-19T08:21:23.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.399+0000 7f701aa23740 10 client.16980 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:21:23.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.399+0000 7f701aa23740 10 client.16980 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:21:23.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.399+0000 7f701aa23740 20 client.16980 populate_metadata read hostname 'smithi027' 2024-09-19T08:21:23.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.399+0000 7f701aa23740 1 --2- 172.21.15.27:0/1498091767 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56316b259470 0x56316b25b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:23.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.399+0000 7f701aa23740 4 client.16980 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:21:23.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.399+0000 7f701aa23740 1 -- 172.21.15.27:0/1498091767 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56316b1ad860 con 0x56316b259470 2024-09-19T08:21:23.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.399+0000 7f7015be5640 1 --2- 172.21.15.27:0/1498091767 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56316b259470 0x56316b25b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:23.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.399+0000 7f7015be5640 1 --2- 172.21.15.27:0/1498091767 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56316b259470 0x56316b25b860 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c9e2c04b641b4a4 server_cookie=fbd7efe4cc315ba9 in_seq=0 out_seq=0 2024-09-19T08:21:23.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.399+0000 7f6ff9ffb640 10 client.16980 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:21:23.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.400+0000 7f6ff9ffb640 1 -- 172.21.15.27:0/1498091767 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56316b1ad860 con 0x56316b259470 2024-09-19T08:21:23.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.400+0000 7f6ff9ffb640 10 client.16980 handle_command_reply: tid=0 2024-09-19T08:21:23.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.400+0000 7f701aa23740 1 client.16980 shutdown 2024-09-19T08:21:23.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.400+0000 7f701aa23740 1 -- 172.21.15.27:0/1498091767 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 msgr2=0x56316b2491f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:23.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.400+0000 7f701aa23740 1 --2- 172.21.15.27:0/1498091767 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 0x56316b2491f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f700c010a50 tx=0x7f700c010f10 comp rx=0 tx=0).stop 2024-09-19T08:21:23.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.400+0000 7f701aa23740 1 -- 172.21.15.27:0/1498091767 shutdown_connections 2024-09-19T08:21:23.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.400+0000 7f701aa23740 1 --2- 172.21.15.27:0/1498091767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56316b249780 0x56316b246be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.400+0000 7f701aa23740 1 --2- 172.21.15.27:0/1498091767 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56316b259470 0x56316b25b860 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.400+0000 7f701aa23740 1 --2- 172.21.15.27:0/1498091767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56316b23ff50 0x56316b2464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.400+0000 7f6ff9ffb640 0 client.16980 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:21:23.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.400+0000 7f701aa23740 1 --2- 172.21.15.27:0/1498091767 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 0x56316b2491f0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.400+0000 7f701aa23740 1 -- 172.21.15.27:0/1498091767 >> 172.21.15.27:0/1498091767 conn(0x56316b203310 msgr2=0x56316b240d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:23.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.401+0000 7f701aa23740 1 -- 172.21.15.27:0/1498091767 shutdown_connections 2024-09-19T08:21:23.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.401+0000 7f701aa23740 1 -- 172.21.15.27:0/1498091767 wait complete. 2024-09-19T08:21:23.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.401+0000 7f701aa23740 20 client.16980 trim_cache size 0 max 16384 2024-09-19T08:21:23.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.414+0000 7f701aa23740 1 Processor -- start 2024-09-19T08:21:23.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.414+0000 7f701aa23740 1 -- start start 2024-09-19T08:21:23.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.414+0000 7f701aa23740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 0x56316b2556c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:23.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.414+0000 7f701aa23740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56316b23ff50 0x56316b241530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:23.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.414+0000 7f701aa23740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56316b249780 0x56316b241a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:23.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.414+0000 7f701aa23740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f70101a95f0 con 0x56316b23e9e0 2024-09-19T08:21:23.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.414+0000 7f701aa23740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f70101abe50 con 0x56316b249780 2024-09-19T08:21:23.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.414+0000 7f701aa23740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f70101a9c40 con 0x56316b23ff50 2024-09-19T08:21:23.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.414+0000 7f70163e6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 0x56316b2556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:23.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.414+0000 7f70163e6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 0x56316b2556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52262/0 (socket says 172.21.15.27:52262) 2024-09-19T08:21:23.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.414+0000 7f70163e6640 1 -- 172.21.15.27:0/2035131199 learned_addr learned my addr 172.21.15.27:0/2035131199 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:23.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.414+0000 7f7015be5640 1 --2- 172.21.15.27:0/2035131199 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56316b23ff50 0x56316b241530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:23.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.414+0000 7f7016be7640 1 --2- 172.21.15.27:0/2035131199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56316b249780 0x56316b241a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:23.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.415+0000 7f70163e6640 1 -- 172.21.15.27:0/2035131199 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56316b23ff50 msgr2=0x56316b241530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:21:23.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.415+0000 7f70163e6640 1 --2- 172.21.15.27:0/2035131199 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56316b23ff50 0x56316b241530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.415+0000 7f70163e6640 1 -- 172.21.15.27:0/2035131199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56316b249780 msgr2=0x56316b241a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:21:23.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.415+0000 7f70163e6640 1 --2- 172.21.15.27:0/2035131199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56316b249780 0x56316b241a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.415+0000 7f70163e6640 1 -- 172.21.15.27:0/2035131199 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56316b255c00 con 0x56316b23e9e0 2024-09-19T08:21:23.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.415+0000 7f70163e6640 1 --2- 172.21.15.27:0/2035131199 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 0x56316b2556c0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f700c000c00 tx=0x7f700c005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467a6706021b28a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:23.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.415+0000 7f6ffbfff640 1 -- 172.21.15.27:0/2035131199 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c00a340 con 0x56316b23e9e0 2024-09-19T08:21:23.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.415+0000 7f6ffbfff640 1 -- 172.21.15.27:0/2035131199 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f700c005510 con 0x56316b23e9e0 2024-09-19T08:21:23.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.415+0000 7f6ffbfff640 1 -- 172.21.15.27:0/2035131199 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c004660 con 0x56316b23e9e0 2024-09-19T08:21:23.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f701aa23740 1 -- 172.21.15.27:0/2035131199 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 msgr2=0x56316b2556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:23.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f701aa23740 1 --2- 172.21.15.27:0/2035131199 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 0x56316b2556c0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f700c000c00 tx=0x7f700c005dc0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f701aa23740 1 -- 172.21.15.27:0/2035131199 shutdown_connections 2024-09-19T08:21:23.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f701aa23740 1 --2- 172.21.15.27:0/2035131199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56316b249780 0x56316b241a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f701aa23740 1 --2- 172.21.15.27:0/2035131199 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56316b23ff50 0x56316b241530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f701aa23740 1 --2- 172.21.15.27:0/2035131199 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b23e9e0 0x56316b2556c0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f701aa23740 1 -- 172.21.15.27:0/2035131199 >> 172.21.15.27:0/2035131199 conn(0x56316b203310 msgr2=0x56316b245590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:23.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f701aa23740 1 -- 172.21.15.27:0/2035131199 shutdown_connections 2024-09-19T08:21:23.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f701aa23740 1 -- 172.21.15.27:0/2035131199 wait complete. 2024-09-19T08:21:23.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f701aa23740 1 -- start start 2024-09-19T08:21:23.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f701aa23740 1 Processor -- start 2024-09-19T08:21:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f701aa23740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56316b23e9e0 0x56316b251cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f701aa23740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56316b23ff50 0x56316b24d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f701aa23740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b249780 0x56316b24d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f701aa23740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f70101aa310 con 0x56316b249780 2024-09-19T08:21:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f701aa23740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f70101ab780 con 0x56316b23ff50 2024-09-19T08:21:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f701aa23740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f70101aa9e0 con 0x56316b23e9e0 2024-09-19T08:21:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f701aa23740 10 client.0 _ll_register_callbacks cb 0x7f700c00a740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:21:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f7016be7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b249780 0x56316b24d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f7016be7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b249780 0x56316b24d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52272/0 (socket says 172.21.15.27:52272) 2024-09-19T08:21:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.416+0000 7f7016be7640 1 -- 172.21.15.27:0/137962715 learned_addr learned my addr 172.21.15.27:0/137962715 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.417+0000 7f7015be5640 1 --2- 172.21.15.27:0/137962715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56316b23ff50 0x56316b24d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.417+0000 7f70163e6640 1 --2- 172.21.15.27:0/137962715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56316b23e9e0 0x56316b251cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.417+0000 7f7016be7640 1 -- 172.21.15.27:0/137962715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56316b23e9e0 msgr2=0x56316b251cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:21:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.417+0000 7f7016be7640 1 --2- 172.21.15.27:0/137962715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56316b23e9e0 0x56316b251cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.417+0000 7f7016be7640 1 -- 172.21.15.27:0/137962715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56316b23ff50 msgr2=0x56316b24d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:21:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.417+0000 7f7016be7640 1 --2- 172.21.15.27:0/137962715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56316b23ff50 0x56316b24d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.417+0000 7f7016be7640 1 -- 172.21.15.27:0/137962715 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56316b24dab0 con 0x56316b249780 2024-09-19T08:21:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.417+0000 7f7016be7640 1 --2- 172.21.15.27:0/137962715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b249780 0x56316b24d570 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f70080b9870 tx=0x7f70080bd010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee7ac953c4b34ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.417+0000 7f6ff9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-19T08:21:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.417+0000 7f6ff9ffb640 1 -- 172.21.15.27:0/137962715 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70080bdb10 con 0x56316b249780 2024-09-19T08:21:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.417+0000 7f701aa23740 1 -- 172.21.15.27:0/137962715 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f700c005510 con 0x56316b249780 2024-09-19T08:21:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.417+0000 7f6ff9ffb640 1 -- 172.21.15.27:0/137962715 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f70080ac400 con 0x56316b249780 2024-09-19T08:21:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.417+0000 7f6ff9ffb640 1 -- 172.21.15.27:0/137962715 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f70080bd410 con 0x56316b249780 2024-09-19T08:21:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.417+0000 7f701aa23740 10 client.16986 fetch_fsmap learned FSMap version 20 2024-09-19T08:21:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.417+0000 7f701aa23740 1 -- 172.21.15.27:0/137962715 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56316b2c3e40 con 0x56316b249780 2024-09-19T08:21:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.418+0000 7f6ff9ffb640 1 -- 172.21.15.27:0/137962715 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f700c005510 con 0x56316b249780 2024-09-19T08:21:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.418+0000 7f6ff9ffb640 1 -- 172.21.15.27:0/137962715 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f70080c5bf0 con 0x56316b249780 2024-09-19T08:21:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.418+0000 7f701aa23740 10 client.16986 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T08:21:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.418+0000 7f701aa23740 10 client.16986 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:21:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.418+0000 7f701aa23740 20 client.16986 populate_metadata read hostname 'smithi027' 2024-09-19T08:21:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.418+0000 7f701aa23740 1 --2- 172.21.15.27:0/137962715 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56316b2c4560 0x56316b2c6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.418+0000 7f701aa23740 4 client.16986 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:21:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.418+0000 7f701aa23740 1 -- 172.21.15.27:0/137962715 --> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56316b1a7d70 con 0x56316b2c4560 2024-09-19T08:21:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.418+0000 7f70163e6640 1 --2- 172.21.15.27:0/137962715 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56316b2c4560 0x56316b2c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.418+0000 7f70163e6640 1 --2- 172.21.15.27:0/137962715 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56316b2c4560 0x56316b2c6950 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47e370b02a69f336 server_cookie=be28c2805352cae4 in_seq=0 out_seq=0 2024-09-19T08:21:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.418+0000 7f6ff9ffb640 10 client.16986 ms_handle_connect on v2:172.21.15.155:6838/1929184836 2024-09-19T08:21:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.419+0000 7f6ff9ffb640 1 -- 172.21.15.27:0/137962715 <== mds.0 v2:172.21.15.155:6838/1929184836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56316b1a7d70 con 0x56316b2c4560 2024-09-19T08:21:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.419+0000 7f6ff9ffb640 10 client.16986 handle_command_reply: tid=0 2024-09-19T08:21:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.419+0000 7f701aa23740 1 client.16986 shutdown 2024-09-19T08:21:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.419+0000 7f701aa23740 1 -- 172.21.15.27:0/137962715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b249780 msgr2=0x56316b24d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:23.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.419+0000 7f701aa23740 1 --2- 172.21.15.27:0/137962715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b249780 0x56316b24d570 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f70080b9870 tx=0x7f70080bd010 comp rx=0 tx=0).stop 2024-09-19T08:21:23.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.419+0000 7f701aa23740 1 -- 172.21.15.27:0/137962715 shutdown_connections 2024-09-19T08:21:23.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.419+0000 7f701aa23740 1 --2- 172.21.15.27:0/137962715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56316b249780 0x56316b24d570 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.419+0000 7f701aa23740 1 --2- 172.21.15.27:0/137962715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56316b23ff50 0x56316b24d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.419+0000 7f701aa23740 1 --2- 172.21.15.27:0/137962715 >> [v2:172.21.15.155:6838/1929184836,v1:172.21.15.155:6839/1929184836] conn(0x56316b2c4560 0x56316b2c6950 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.419+0000 7f6ff9ffb640 0 client.16986 ms_handle_reset on v2:172.21.15.155:6838/1929184836 2024-09-19T08:21:23.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.419+0000 7f701aa23740 1 --2- 172.21.15.27:0/137962715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56316b23e9e0 0x56316b251cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.419+0000 7f701aa23740 1 -- 172.21.15.27:0/137962715 >> 172.21.15.27:0/137962715 conn(0x56316b203310 msgr2=0x56316b2354e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:23.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.419+0000 7f701aa23740 1 -- 172.21.15.27:0/137962715 shutdown_connections 2024-09-19T08:21:23.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.419+0000 7f701aa23740 1 -- 172.21.15.27:0/137962715 wait complete. 2024-09-19T08:21:23.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.419+0000 7f701aa23740 20 client.16986 trim_cache size 0 max 16384 2024-09-19T08:21:23.434 INFO:teuthology.orchestra.run.smithi027.stdout:[] 2024-09-19T08:21:23.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.420+0000 7f701864a640 1 -- 172.21.15.27:0/193136156 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6ffc0a33b0 msgr2=0x7f6ffc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:23.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.420+0000 7f701864a640 1 --2- 172.21.15.27:0/193136156 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6ffc0a33b0 0x7f6ffc0a5870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f700000afd0 tx=0x7f700000a9b0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.420+0000 7f701864a640 1 -- 172.21.15.27:0/193136156 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7010106f10 msgr2=0x7f701019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:23.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.420+0000 7f701864a640 1 --2- 172.21.15.27:0/193136156 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7010106f10 0x7f701019cd40 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f7008031a60 tx=0x7f7008031a90 comp rx=0 tx=0).stop 2024-09-19T08:21:23.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.420+0000 7f701864a640 1 -- 172.21.15.27:0/193136156 shutdown_connections 2024-09-19T08:21:23.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.420+0000 7f701864a640 1 --2- 172.21.15.27:0/193136156 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6ffc0a33b0 0x7f6ffc0a5870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.420+0000 7f701864a640 1 --2- 172.21.15.27:0/193136156 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7010106f10 0x7f701019cd40 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.420+0000 7f701864a640 1 --2- 172.21.15.27:0/193136156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7010102790 0x7f70101989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.420+0000 7f701864a640 1 --2- 172.21.15.27:0/193136156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7010101de0 0x7f7010198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:23.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.420+0000 7f701864a640 1 -- 172.21.15.27:0/193136156 >> 172.21.15.27:0/193136156 conn(0x7f70100fd8c0 msgr2=0x7f70100fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:23.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.420+0000 7f701864a640 1 -- 172.21.15.27:0/193136156 shutdown_connections 2024-09-19T08:21:23.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:23.420+0000 7f701864a640 1 -- 172.21.15.27:0/193136156 wait complete. 2024-09-19T08:21:24.085 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-19T08:21:24.086 INFO:tasks.fwd_scrub:done joining 2024-09-19T08:21:24.086 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T08:21:24.099 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:21:24.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.207+0000 7f27414af640 1 -- 172.21.15.27:0/420753846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f273c106990 msgr2=0x7f273c106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:24.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.207+0000 7f27414af640 1 --2- 172.21.15.27:0/420753846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f273c106990 0x7f273c106d70 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f272c009cd0 tx=0x7f272c02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.207+0000 7f27414af640 1 -- 172.21.15.27:0/420753846 shutdown_connections 2024-09-19T08:21:24.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.207+0000 7f27414af640 1 --2- 172.21.15.27:0/420753846 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f273c101320 0x7f273c10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.207+0000 7f27414af640 1 --2- 172.21.15.27:0/420753846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f273c100980 0x7f273c100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.207+0000 7f27414af640 1 --2- 172.21.15.27:0/420753846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f273c106990 0x7f273c106d70 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.207+0000 7f27414af640 1 -- 172.21.15.27:0/420753846 >> 172.21.15.27:0/420753846 conn(0x7f273c077a10 msgr2=0x7f273c0fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:24.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.207+0000 7f27414af640 1 -- 172.21.15.27:0/420753846 shutdown_connections 2024-09-19T08:21:24.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.207+0000 7f27414af640 1 -- 172.21.15.27:0/420753846 wait complete. 2024-09-19T08:21:24.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.208+0000 7f27414af640 1 Processor -- start 2024-09-19T08:21:24.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.208+0000 7f27414af640 1 -- start start 2024-09-19T08:21:24.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.208+0000 7f27414af640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f273c100980 0x7f273c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:24.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.208+0000 7f27414af640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f273c101320 0x7f273c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:24.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.208+0000 7f27414af640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f273c106990 0x7f273c1a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:24.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.208+0000 7f27414af640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f273c110dd0 con 0x7f273c106990 2024-09-19T08:21:24.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.208+0000 7f27414af640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f273c110c50 con 0x7f273c101320 2024-09-19T08:21:24.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.208+0000 7f27414af640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f273c110f50 con 0x7f273c100980 2024-09-19T08:21:24.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.208+0000 7f273b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f273c106990 0x7f273c1a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:24.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.208+0000 7f273b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f273c106990 0x7f273c1a4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52298/0 (socket says 172.21.15.27:52298) 2024-09-19T08:21:24.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.208+0000 7f273b7fe640 1 -- 172.21.15.27:0/3995218853 learned_addr learned my addr 172.21.15.27:0/3995218853 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:24.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.208+0000 7f273affd640 1 --2- 172.21.15.27:0/3995218853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f273c100980 0x7f273c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:24.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.208+0000 7f273a7fc640 1 --2- 172.21.15.27:0/3995218853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f273c101320 0x7f273c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:24.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.209+0000 7f273b7fe640 1 -- 172.21.15.27:0/3995218853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f273c100980 msgr2=0x7f273c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:24.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.209+0000 7f273b7fe640 1 --2- 172.21.15.27:0/3995218853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f273c100980 0x7f273c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.209+0000 7f273b7fe640 1 -- 172.21.15.27:0/3995218853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f273c101320 msgr2=0x7f273c199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:24.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.209+0000 7f273b7fe640 1 --2- 172.21.15.27:0/3995218853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f273c101320 0x7f273c199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.209+0000 7f273b7fe640 1 -- 172.21.15.27:0/3995218853 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273c1a48a0 con 0x7f273c106990 2024-09-19T08:21:24.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.209+0000 7f273b7fe640 1 --2- 172.21.15.27:0/3995218853 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f273c106990 0x7f273c1a4360 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f273400d750 tx=0x7f273400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:24.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.209+0000 7f2733fff640 1 -- 172.21.15.27:0/3995218853 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2734017070 con 0x7f273c106990 2024-09-19T08:21:24.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.209+0000 7f2733fff640 1 -- 172.21.15.27:0/3995218853 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2734005500 con 0x7f273c106990 2024-09-19T08:21:24.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.209+0000 7f27414af640 1 -- 172.21.15.27:0/3995218853 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f273c1a4a70 con 0x7f273c106990 2024-09-19T08:21:24.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.209+0000 7f2733fff640 1 -- 172.21.15.27:0/3995218853 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2734004d90 con 0x7f273c106990 2024-09-19T08:21:24.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.209+0000 7f27414af640 1 -- 172.21.15.27:0/3995218853 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f273c1a4f90 con 0x7f273c106990 2024-09-19T08:21:24.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.210+0000 7f27414af640 1 -- 172.21.15.27:0/3995218853 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f273c100de0 con 0x7f273c106990 2024-09-19T08:21:24.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.211+0000 7f2733fff640 1 -- 172.21.15.27:0/3995218853 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2734004f30 con 0x7f273c106990 2024-09-19T08:21:24.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.212+0000 7f2733fff640 1 --2- 172.21.15.27:0/3995218853 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f27280a33c0 0x7f27280a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:24.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.212+0000 7f273affd640 1 --2- 172.21.15.27:0/3995218853 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f27280a33c0 0x7f27280a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:24.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.212+0000 7f2733fff640 1 -- 172.21.15.27:0/3995218853 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f27340cf550 con 0x7f273c106990 2024-09-19T08:21:24.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.212+0000 7f273affd640 1 --2- 172.21.15.27:0/3995218853 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f27280a33c0 0x7f27280a5880 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f272c006010 tx=0x7f272c009360 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:24.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.216+0000 7f2733fff640 1 -- 172.21.15.27:0/3995218853 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f273409b900 con 0x7f273c106990 2024-09-19T08:21:24.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.396+0000 7f27414af640 1 -- 172.21.15.27:0/3995218853 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f273c108ef0 con 0x7f273c106990 2024-09-19T08:21:24.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.397+0000 7f2733fff640 1 -- 172.21.15.27:0/3995218853 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+23117 (secure 0 0 0) 0x7f273409fc00 con 0x7f273c106990 2024-09-19T08:21:24.398 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:21:24.398 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":92,"fsid":"35b531b0-765d-11ef-bceb-c7b262605968","created":"2024-09-19T08:01:20.929241+0000","modified":"2024-09-19T08:21:15.826853+0000","last_up_change":"2024-09-19T08:08:17.919001+0000","last_in_change":"2024-09-19T08:07:54.277124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:04:29.312984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:09:08.046858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:09:10.223258+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66fd6732-4cac-4eda-bf06-50638995ee80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6803","nonce":3645201250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6805","nonce":3645201250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6809","nonce":3645201250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6807","nonce":3645201250}]},"public_addr":"172.21.15.27:6803/3645201250","cluster_addr":"172.21.15.27:6805/3645201250","heartbeat_back_addr":"172.21.15.27:6809/3645201250","heartbeat_front_addr":"172.21.15.27:6807/3645201250","state":["exists","up"]},{"osd":1,"uuid":"36628767-66ac-433b-938e-10e75b51a877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6801","nonce":3977510449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6803","nonce":3977510449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6807","nonce":3977510449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6805","nonce":3977510449}]},"public_addr":"172.21.15.155:6801/3977510449","cluster_addr":"172.21.15.155:6803/3977510449","heartbeat_back_addr":"172.21.15.155:6807/3977510449","heartbeat_front_addr":"172.21.15.155:6805/3977510449","state":["exists","up"]},{"osd":2,"uuid":"3dc80404-a56b-456a-af02-f01e9c6c6dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6801","nonce":3796057016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6803","nonce":3796057016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6807","nonce":3796057016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6805","nonce":3796057016}]},"public_addr":"172.21.15.203:6801/3796057016","cluster_addr":"172.21.15.203:6803/3796057016","heartbeat_back_addr":"172.21.15.203:6807/3796057016","heartbeat_front_addr":"172.21.15.203:6805/3796057016","state":["exists","up"]},{"osd":3,"uuid":"a51077d0-5e04-49b5-bb3e-91711cc45ff1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6811","nonce":1608304347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6813","nonce":1608304347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6817","nonce":1608304347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6815","nonce":1608304347}]},"public_addr":"172.21.15.27:6811/1608304347","cluster_addr":"172.21.15.27:6813/1608304347","heartbeat_back_addr":"172.21.15.27:6817/1608304347","heartbeat_front_addr":"172.21.15.27:6815/1608304347","state":["exists","up"]},{"osd":4,"uuid":"0df35548-90b4-434d-8d7e-c037072c9ae4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6809","nonce":569913150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6811","nonce":569913150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6815","nonce":569913150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6813","nonce":569913150}]},"public_addr":"172.21.15.155:6809/569913150","cluster_addr":"172.21.15.155:6811/569913150","heartbeat_back_addr":"172.21.15.155:6815/569913150","heartbeat_front_addr":"172.21.15.155:6813/569913150","state":["exists","up"]},{"osd":5,"uuid":"de193c5f-1019-43e5-9f4f-6c2aaa4330e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6809","nonce":991491203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6811","nonce":991491203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6815","nonce":991491203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6813","nonce":991491203}]},"public_addr":"172.21.15.203:6809/991491203","cluster_addr":"172.21.15.203:6811/991491203","heartbeat_back_addr":"172.21.15.203:6815/991491203","heartbeat_front_addr":"172.21.15.203:6813/991491203","state":["exists","up"]},{"osd":6,"uuid":"28938e4f-9f22-466f-8cf7-62ee56a0c926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6819","nonce":3516868131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6821","nonce":3516868131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6825","nonce":3516868131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6823","nonce":3516868131}]},"public_addr":"172.21.15.27:6819/3516868131","cluster_addr":"172.21.15.27:6821/3516868131","heartbeat_back_addr":"172.21.15.27:6825/3516868131","heartbeat_front_addr":"172.21.15.27:6823/3516868131","state":["exists","up"]},{"osd":7,"uuid":"855f1728-be52-4445-8561-a90c08f2b2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6817","nonce":2047506436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6819","nonce":2047506436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6823","nonce":2047506436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6821","nonce":2047506436}]},"public_addr":"172.21.15.155:6817/2047506436","cluster_addr":"172.21.15.155:6819/2047506436","heartbeat_back_addr":"172.21.15.155:6823/2047506436","heartbeat_front_addr":"172.21.15.155:6821/2047506436","state":["exists","up"]},{"osd":8,"uuid":"5d7a8ffd-a039-403e-8b9a-c80e19fd67ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6817","nonce":199970687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6819","nonce":199970687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6823","nonce":199970687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6821","nonce":199970687}]},"public_addr":"172.21.15.203:6817/199970687","cluster_addr":"172.21.15.203:6819/199970687","heartbeat_back_addr":"172.21.15.203:6823/199970687","heartbeat_front_addr":"172.21.15.203:6821/199970687","state":["exists","up"]},{"osd":9,"uuid":"cdb90242-80a1-4cef-b5e3-ddecb05664e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6827","nonce":118390483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6829","nonce":118390483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6833","nonce":118390483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6831","nonce":118390483}]},"public_addr":"172.21.15.27:6827/118390483","cluster_addr":"172.21.15.27:6829/118390483","heartbeat_back_addr":"172.21.15.27:6833/118390483","heartbeat_front_addr":"172.21.15.27:6831/118390483","state":["exists","up"]},{"osd":10,"uuid":"c7f4c9da-d913-47a5-8629-53de21efe8c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6825","nonce":1687418565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6827","nonce":1687418565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6831","nonce":1687418565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6829","nonce":1687418565}]},"public_addr":"172.21.15.155:6825/1687418565","cluster_addr":"172.21.15.155:6827/1687418565","heartbeat_back_addr":"172.21.15.155:6831/1687418565","heartbeat_front_addr":"172.21.15.155:6829/1687418565","state":["exists","up"]},{"osd":11,"uuid":"45c11a90-585e-46fa-a5a0-51a29e29eba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6825","nonce":224768827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6827","nonce":224768827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6831","nonce":224768827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6829","nonce":224768827}]},"public_addr":"172.21.15.203:6825/224768827","cluster_addr":"172.21.15.203:6827/224768827","heartbeat_back_addr":"172.21.15.203:6831/224768827","heartbeat_front_addr":"172.21.15.203:6829/224768827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:03:35.559549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:00.526006+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:25.809346+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:51.889445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:17.246017+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:43.515854+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:08.638182+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:34.653060+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:59.469837+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:26.122937+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:50.196159+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:08:16.245770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/4099657868":"2024-09-20T08:11:01.318464+0000","172.21.15.27:0/913696111":"2024-09-20T08:11:01.318464+0000","172.21.15.27:0/1717932879":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6800/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/1963219497":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/416476667":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/1908865720":"2024-09-20T08:02:12.808047+0000","172.21.15.27:6801/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1174736321":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/958829150":"2024-09-20T08:02:12.808047+0000","172.21.15.27:6800/4220278108":"2024-09-20T08:11:01.318464+0000","172.21.15.27:6800/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/3419400802":"2024-09-20T08:11:01.318464+0000","172.21.15.27:0/1827043850":"2024-09-20T08:11:01.318464+0000","172.21.15.27:6801/4220278108":"2024-09-20T08:11:01.318464+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:21:24.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.399+0000 7f27414af640 1 -- 172.21.15.27:0/3995218853 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f27280a33c0 msgr2=0x7f27280a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:24.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.399+0000 7f27414af640 1 --2- 172.21.15.27:0/3995218853 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f27280a33c0 0x7f27280a5880 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f272c006010 tx=0x7f272c009360 comp rx=0 tx=0).stop 2024-09-19T08:21:24.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.399+0000 7f27414af640 1 -- 172.21.15.27:0/3995218853 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f273c106990 msgr2=0x7f273c1a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:24.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.399+0000 7f27414af640 1 --2- 172.21.15.27:0/3995218853 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f273c106990 0x7f273c1a4360 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f273400d750 tx=0x7f273400dc10 comp rx=0 tx=0).stop 2024-09-19T08:21:24.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.399+0000 7f27414af640 1 -- 172.21.15.27:0/3995218853 shutdown_connections 2024-09-19T08:21:24.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.399+0000 7f27414af640 1 --2- 172.21.15.27:0/3995218853 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f27280a33c0 0x7f27280a5880 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.399+0000 7f27414af640 1 --2- 172.21.15.27:0/3995218853 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f273c106990 0x7f273c1a4360 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.399+0000 7f27414af640 1 --2- 172.21.15.27:0/3995218853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f273c101320 0x7f273c199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.399+0000 7f27414af640 1 --2- 172.21.15.27:0/3995218853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f273c100980 0x7f273c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.399+0000 7f27414af640 1 -- 172.21.15.27:0/3995218853 >> 172.21.15.27:0/3995218853 conn(0x7f273c077a10 msgr2=0x7f273c1039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:24.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.399+0000 7f27414af640 1 -- 172.21.15.27:0/3995218853 shutdown_connections 2024-09-19T08:21:24.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.399+0000 7f27414af640 1 -- 172.21.15.27:0/3995218853 wait complete. 2024-09-19T08:21:24.411 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:04:29.312984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T08:09:08.046858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T08:09:10.223258+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 91, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T08:21:24.412 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T08:21:24.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.518+0000 7f28a8b8d640 1 -- 172.21.15.27:0/1954439583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a4101230 msgr2=0x7f28a410def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:24.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.518+0000 7f28a8b8d640 1 --2- 172.21.15.27:0/1954439583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a4101230 0x7f28a410def0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f288c009900 tx=0x7f288c02a410 comp rx=0 tx=0).stop 2024-09-19T08:21:24.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.518+0000 7f28a8b8d640 1 -- 172.21.15.27:0/1954439583 shutdown_connections 2024-09-19T08:21:24.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.518+0000 7f28a8b8d640 1 --2- 172.21.15.27:0/1954439583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28a410e430 0x7f28a4110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.518+0000 7f28a8b8d640 1 --2- 172.21.15.27:0/1954439583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a4101230 0x7f28a410def0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.518+0000 7f28a8b8d640 1 --2- 172.21.15.27:0/1954439583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28a4100880 0x7f28a4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.518+0000 7f28a8b8d640 1 -- 172.21.15.27:0/1954439583 >> 172.21.15.27:0/1954439583 conn(0x7f28a40fc690 msgr2=0x7f28a40feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:24.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.518+0000 7f28a8b8d640 1 -- 172.21.15.27:0/1954439583 shutdown_connections 2024-09-19T08:21:24.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.518+0000 7f28a8b8d640 1 -- 172.21.15.27:0/1954439583 wait complete. 2024-09-19T08:21:24.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.519+0000 7f28a8b8d640 1 Processor -- start 2024-09-19T08:21:24.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.519+0000 7f28a8b8d640 1 -- start start 2024-09-19T08:21:24.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.519+0000 7f28a8b8d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28a4100880 0x7f28a419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:24.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.519+0000 7f28a8b8d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28a4101230 0x7f28a419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:24.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.519+0000 7f28a8b8d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a410e430 0x7f28a419ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:24.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.519+0000 7f28a8b8d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f28a4114140 con 0x7f28a410e430 2024-09-19T08:21:24.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.519+0000 7f28a8b8d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f28a4113fc0 con 0x7f28a4101230 2024-09-19T08:21:24.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.519+0000 7f28a8b8d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f28a41142c0 con 0x7f28a4100880 2024-09-19T08:21:24.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.520+0000 7f28a2d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a410e430 0x7f28a419ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:24.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.520+0000 7f28a2d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a410e430 0x7f28a419ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52314/0 (socket says 172.21.15.27:52314) 2024-09-19T08:21:24.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.520+0000 7f28a2d9d640 1 -- 172.21.15.27:0/574211711 learned_addr learned my addr 172.21.15.27:0/574211711 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:24.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.520+0000 7f28a259c640 1 --2- 172.21.15.27:0/574211711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28a4100880 0x7f28a419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:24.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.520+0000 7f28a1d9b640 1 --2- 172.21.15.27:0/574211711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28a4101230 0x7f28a419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:24.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.520+0000 7f28a2d9d640 1 -- 172.21.15.27:0/574211711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28a4100880 msgr2=0x7f28a419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:24.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.520+0000 7f28a2d9d640 1 --2- 172.21.15.27:0/574211711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28a4100880 0x7f28a419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.520+0000 7f28a2d9d640 1 -- 172.21.15.27:0/574211711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28a4101230 msgr2=0x7f28a419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:24.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.520+0000 7f28a2d9d640 1 --2- 172.21.15.27:0/574211711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28a4101230 0x7f28a419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.520+0000 7f28a2d9d640 1 -- 172.21.15.27:0/574211711 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a419f680 con 0x7f28a410e430 2024-09-19T08:21:24.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.520+0000 7f28a2d9d640 1 --2- 172.21.15.27:0/574211711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a410e430 0x7f28a419ef50 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f289c00cce0 tx=0x7f289c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:24.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.520+0000 7f289b7fe640 1 -- 172.21.15.27:0/574211711 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c00f450 con 0x7f28a410e430 2024-09-19T08:21:24.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.520+0000 7f289b7fe640 1 -- 172.21.15.27:0/574211711 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f289c00fad0 con 0x7f28a410e430 2024-09-19T08:21:24.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.520+0000 7f28a8b8d640 1 -- 172.21.15.27:0/574211711 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a419f970 con 0x7f28a410e430 2024-09-19T08:21:24.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.520+0000 7f289b7fe640 1 -- 172.21.15.27:0/574211711 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c018ac0 con 0x7f28a410e430 2024-09-19T08:21:24.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.520+0000 7f28a8b8d640 1 -- 172.21.15.27:0/574211711 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a41a7200 con 0x7f28a410e430 2024-09-19T08:21:24.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.521+0000 7f28a8b8d640 1 -- 172.21.15.27:0/574211711 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a4100c60 con 0x7f28a410e430 2024-09-19T08:21:24.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.523+0000 7f289b7fe640 1 -- 172.21.15.27:0/574211711 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f289c00f5f0 con 0x7f28a410e430 2024-09-19T08:21:24.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.523+0000 7f289b7fe640 1 --2- 172.21.15.27:0/574211711 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f28900a33c0 0x7f28900a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:24.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.523+0000 7f28a259c640 1 --2- 172.21.15.27:0/574211711 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f28900a33c0 0x7f28900a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:24.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.523+0000 7f289b7fe640 1 -- 172.21.15.27:0/574211711 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f289c0d0470 con 0x7f28a410e430 2024-09-19T08:21:24.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.524+0000 7f28a259c640 1 --2- 172.21.15.27:0/574211711 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f28900a33c0 0x7f28900a5880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2894009990 tx=0x7f2894009110 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:24.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.526+0000 7f289b7fe640 1 -- 172.21.15.27:0/574211711 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f289c014030 con 0x7f28a410e430 2024-09-19T08:21:24.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.702+0000 7f28a8b8d640 1 -- 172.21.15.27:0/574211711 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f28a402d7c0 con 0x7f28a410e430 2024-09-19T08:21:24.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.702+0000 7f289b7fe640 1 -- 172.21.15.27:0/574211711 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) ==== 93+0+10 (secure 0 0 0) 0x7f289c09cf00 con 0x7f28a410e430 2024-09-19T08:21:24.703 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-09-19T08:21:24.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.704+0000 7f28a8b8d640 1 -- 172.21.15.27:0/574211711 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f28900a33c0 msgr2=0x7f28900a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:24.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.704+0000 7f28a8b8d640 1 --2- 172.21.15.27:0/574211711 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f28900a33c0 0x7f28900a5880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2894009990 tx=0x7f2894009110 comp rx=0 tx=0).stop 2024-09-19T08:21:24.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.704+0000 7f28a8b8d640 1 -- 172.21.15.27:0/574211711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a410e430 msgr2=0x7f28a419ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:24.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.704+0000 7f28a8b8d640 1 --2- 172.21.15.27:0/574211711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a410e430 0x7f28a419ef50 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f289c00cce0 tx=0x7f289c00a620 comp rx=0 tx=0).stop 2024-09-19T08:21:24.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.704+0000 7f28a8b8d640 1 -- 172.21.15.27:0/574211711 shutdown_connections 2024-09-19T08:21:24.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.704+0000 7f28a8b8d640 1 --2- 172.21.15.27:0/574211711 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f28900a33c0 0x7f28900a5880 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.704+0000 7f28a8b8d640 1 --2- 172.21.15.27:0/574211711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a410e430 0x7f28a419ef50 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.704+0000 7f28a8b8d640 1 --2- 172.21.15.27:0/574211711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28a4101230 0x7f28a419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.704+0000 7f28a8b8d640 1 --2- 172.21.15.27:0/574211711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28a4100880 0x7f28a419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.704+0000 7f28a8b8d640 1 -- 172.21.15.27:0/574211711 >> 172.21.15.27:0/574211711 conn(0x7f28a40fc690 msgr2=0x7f28a40fea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:24.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.704+0000 7f28a8b8d640 1 -- 172.21.15.27:0/574211711 shutdown_connections 2024-09-19T08:21:24.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.704+0000 7f28a8b8d640 1 -- 172.21.15.27:0/574211711 wait complete. 2024-09-19T08:21:24.716 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T08:21:24.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.822+0000 7fd2c8d98640 1 -- 172.21.15.27:0/1140022157 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2c410c0c0 msgr2=0x7fd2c410e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:24.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.823+0000 7fd2c8d98640 1 --2- 172.21.15.27:0/1140022157 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2c410c0c0 0x7fd2c410e530 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc009ca0 tx=0x7fd2bc02a950 comp rx=0 tx=0).stop 2024-09-19T08:21:24.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.823+0000 7fd2c8d98640 1 -- 172.21.15.27:0/1140022157 shutdown_connections 2024-09-19T08:21:24.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.823+0000 7fd2c8d98640 1 --2- 172.21.15.27:0/1140022157 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2c410c0c0 0x7fd2c410e530 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.823+0000 7fd2c8d98640 1 --2- 172.21.15.27:0/1140022157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2c4103610 0x7fd2c410baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.823+0000 7fd2c8d98640 1 --2- 172.21.15.27:0/1140022157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2c4102cf0 0x7fd2c41030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.823+0000 7fd2c8d98640 1 -- 172.21.15.27:0/1140022157 >> 172.21.15.27:0/1140022157 conn(0x7fd2c40779d0 msgr2=0x7fd2c40fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:24.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.823+0000 7fd2c8d98640 1 -- 172.21.15.27:0/1140022157 shutdown_connections 2024-09-19T08:21:24.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.823+0000 7fd2c8d98640 1 -- 172.21.15.27:0/1140022157 wait complete. 2024-09-19T08:21:24.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.823+0000 7fd2c8d98640 1 Processor -- start 2024-09-19T08:21:24.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.823+0000 7fd2c8d98640 1 -- start start 2024-09-19T08:21:24.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.824+0000 7fd2c8d98640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2c4102cf0 0x7fd2c4198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:24.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.824+0000 7fd2c8d98640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2c4103610 0x7fd2c4198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:24.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.824+0000 7fd2c8d98640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2c410c0c0 0x7fd2c419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:24.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.824+0000 7fd2c8d98640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c4111ea0 con 0x7fd2c410c0c0 2024-09-19T08:21:24.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.824+0000 7fd2c8d98640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c4111d20 con 0x7fd2c4102cf0 2024-09-19T08:21:24.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.824+0000 7fd2c8d98640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c4112020 con 0x7fd2c4103610 2024-09-19T08:21:24.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.824+0000 7fd2c2d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2c410c0c0 0x7fd2c419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:24.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.824+0000 7fd2c2d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2c410c0c0 0x7fd2c419cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52326/0 (socket says 172.21.15.27:52326) 2024-09-19T08:21:24.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.824+0000 7fd2c2d9d640 1 -- 172.21.15.27:0/4209550064 learned_addr learned my addr 172.21.15.27:0/4209550064 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:24.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.824+0000 7fd2c259c640 1 --2- 172.21.15.27:0/4209550064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2c4102cf0 0x7fd2c4198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:24.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.824+0000 7fd2c1d9b640 1 --2- 172.21.15.27:0/4209550064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2c4103610 0x7fd2c4198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:24.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.824+0000 7fd2c2d9d640 1 -- 172.21.15.27:0/4209550064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2c4103610 msgr2=0x7fd2c4198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:24.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.824+0000 7fd2c2d9d640 1 --2- 172.21.15.27:0/4209550064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2c4103610 0x7fd2c4198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.824+0000 7fd2c2d9d640 1 -- 172.21.15.27:0/4209550064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2c4102cf0 msgr2=0x7fd2c4198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:24.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.824+0000 7fd2c2d9d640 1 --2- 172.21.15.27:0/4209550064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2c4102cf0 0x7fd2c4198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:24.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.824+0000 7fd2c2d9d640 1 -- 172.21.15.27:0/4209550064 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c419d340 con 0x7fd2c410c0c0 2024-09-19T08:21:24.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.824+0000 7fd2c1d9b640 1 --2- 172.21.15.27:0/4209550064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2c4103610 0x7fd2c4198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:21:24.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.824+0000 7fd2c259c640 1 --2- 172.21.15.27:0/4209550064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2c4102cf0 0x7fd2c4198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:21:24.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.824+0000 7fd2c2d9d640 1 --2- 172.21.15.27:0/4209550064 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2c410c0c0 0x7fd2c419cc10 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc009dc0 tx=0x7fd2bc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:24.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.824+0000 7fd2b37fe640 1 -- 172.21.15.27:0/4209550064 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc034040 con 0x7fd2c410c0c0 2024-09-19T08:21:24.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.825+0000 7fd2b37fe640 1 -- 172.21.15.27:0/4209550064 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2bc02fe20 con 0x7fd2c410c0c0 2024-09-19T08:21:24.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.825+0000 7fd2b37fe640 1 -- 172.21.15.27:0/4209550064 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc0047f0 con 0x7fd2c410c0c0 2024-09-19T08:21:24.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.825+0000 7fd2c8d98640 1 -- 172.21.15.27:0/4209550064 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c419d5d0 con 0x7fd2c410c0c0 2024-09-19T08:21:24.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.825+0000 7fd2c8d98640 1 -- 172.21.15.27:0/4209550064 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c41a4ec0 con 0x7fd2c410c0c0 2024-09-19T08:21:24.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.826+0000 7fd2c8d98640 1 -- 172.21.15.27:0/4209550064 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2c41030d0 con 0x7fd2c410c0c0 2024-09-19T08:21:24.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.827+0000 7fd2b37fe640 1 -- 172.21.15.27:0/4209550064 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fd2bc037020 con 0x7fd2c410c0c0 2024-09-19T08:21:24.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.827+0000 7fd2b37fe640 1 --2- 172.21.15.27:0/4209550064 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd2ac0a3440 0x7fd2ac0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:24.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.828+0000 7fd2c259c640 1 --2- 172.21.15.27:0/4209550064 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd2ac0a3440 0x7fd2ac0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:24.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.828+0000 7fd2b37fe640 1 -- 172.21.15.27:0/4209550064 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7fd2bc0f0c60 con 0x7fd2c410c0c0 2024-09-19T08:21:24.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.828+0000 7fd2c259c640 1 --2- 172.21.15.27:0/4209550064 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd2ac0a3440 0x7fd2ac0a5900 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd2b400afb0 tx=0x7fd2b400a2d0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:24.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:24.831+0000 7fd2b37fe640 1 -- 172.21.15.27:0/4209550064 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd2bc081210 con 0x7fd2c410c0c0 2024-09-19T08:21:25.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:24 smithi027 ceph-mon[31209]: pgmap v322: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T08:21:25.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:24 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3995218853' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:21:25.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:24 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/574211711' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:21:25.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.006+0000 7fd2c8d98640 1 -- 172.21.15.27:0/4209550064 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd2c41996a0 con 0x7fd2c410c0c0 2024-09-19T08:21:25.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.006+0000 7fd2b37fe640 1 -- 172.21.15.27:0/4209550064 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) ==== 104+0+11 (secure 0 0 0) 0x7fd2bc0383b0 con 0x7fd2c410c0c0 2024-09-19T08:21:25.007 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-09-19T08:21:25.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.008+0000 7fd2c8d98640 1 -- 172.21.15.27:0/4209550064 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd2ac0a3440 msgr2=0x7fd2ac0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:25.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.008+0000 7fd2c8d98640 1 --2- 172.21.15.27:0/4209550064 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd2ac0a3440 0x7fd2ac0a5900 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd2b400afb0 tx=0x7fd2b400a2d0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.008+0000 7fd2c8d98640 1 -- 172.21.15.27:0/4209550064 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2c410c0c0 msgr2=0x7fd2c419cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:25.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.008+0000 7fd2c8d98640 1 --2- 172.21.15.27:0/4209550064 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2c410c0c0 0x7fd2c419cc10 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc009dc0 tx=0x7fd2bc003f10 comp rx=0 tx=0).stop 2024-09-19T08:21:25.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.008+0000 7fd2c8d98640 1 -- 172.21.15.27:0/4209550064 shutdown_connections 2024-09-19T08:21:25.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.008+0000 7fd2c8d98640 1 --2- 172.21.15.27:0/4209550064 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd2ac0a3440 0x7fd2ac0a5900 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.008+0000 7fd2c8d98640 1 --2- 172.21.15.27:0/4209550064 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2c410c0c0 0x7fd2c419cc10 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.008+0000 7fd2c8d98640 1 --2- 172.21.15.27:0/4209550064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2c4103610 0x7fd2c4198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.008+0000 7fd2c8d98640 1 --2- 172.21.15.27:0/4209550064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2c4102cf0 0x7fd2c4198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.008+0000 7fd2c8d98640 1 -- 172.21.15.27:0/4209550064 >> 172.21.15.27:0/4209550064 conn(0x7fd2c40779d0 msgr2=0x7fd2c40fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:25.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.008+0000 7fd2c8d98640 1 -- 172.21.15.27:0/4209550064 shutdown_connections 2024-09-19T08:21:25.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.008+0000 7fd2c8d98640 1 -- 172.21.15.27:0/4209550064 wait complete. 2024-09-19T08:21:25.019 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T08:21:25.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.126+0000 7f3deb684640 1 -- 172.21.15.27:0/766985217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3de4102c80 msgr2=0x7f3de4103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:25.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.126+0000 7f3deb684640 1 --2- 172.21.15.27:0/766985217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3de4102c80 0x7f3de4103060 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009ca0 tx=0x7f3de002a950 comp rx=0 tx=0).stop 2024-09-19T08:21:25.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.126+0000 7f3deb684640 1 -- 172.21.15.27:0/766985217 shutdown_connections 2024-09-19T08:21:25.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.126+0000 7f3deb684640 1 --2- 172.21.15.27:0/766985217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3de410c0d0 0x7f3de410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.126+0000 7f3deb684640 1 --2- 172.21.15.27:0/766985217 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3de41035a0 0x7f3de410ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.126+0000 7f3deb684640 1 --2- 172.21.15.27:0/766985217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3de4102c80 0x7f3de4103060 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.126+0000 7f3deb684640 1 -- 172.21.15.27:0/766985217 >> 172.21.15.27:0/766985217 conn(0x7f3de40fc690 msgr2=0x7f3de40feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:25.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.126+0000 7f3deb684640 1 -- 172.21.15.27:0/766985217 shutdown_connections 2024-09-19T08:21:25.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.126+0000 7f3deb684640 1 -- 172.21.15.27:0/766985217 wait complete. 2024-09-19T08:21:25.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.127+0000 7f3deb684640 1 Processor -- start 2024-09-19T08:21:25.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.127+0000 7f3deb684640 1 -- start start 2024-09-19T08:21:25.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.127+0000 7f3deb684640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3de4102c80 0x7f3de419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:25.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.127+0000 7f3deb684640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3de41035a0 0x7f3de419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:25.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.127+0000 7f3deb684640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3de410c0d0 0x7f3de419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:25.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.127+0000 7f3deb684640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3de4111ef0 con 0x7f3de41035a0 2024-09-19T08:21:25.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.127+0000 7f3deb684640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3de4111d70 con 0x7f3de410c0d0 2024-09-19T08:21:25.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.127+0000 7f3deb684640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3de4112070 con 0x7f3de4102c80 2024-09-19T08:21:25.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.127+0000 7f3de8c1f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3de41035a0 0x7f3de419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:25.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.127+0000 7f3de8c1f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3de41035a0 0x7f3de419aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52358/0 (socket says 172.21.15.27:52358) 2024-09-19T08:21:25.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.127+0000 7f3de8c1f640 1 -- 172.21.15.27:0/3599252696 learned_addr learned my addr 172.21.15.27:0/3599252696 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:25.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.127+0000 7f3de9c21640 1 --2- 172.21.15.27:0/3599252696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3de410c0d0 0x7f3de419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:25.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.127+0000 7f3de9420640 1 --2- 172.21.15.27:0/3599252696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3de4102c80 0x7f3de419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:25.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.127+0000 7f3de8c1f640 1 -- 172.21.15.27:0/3599252696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3de4102c80 msgr2=0x7f3de419a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:25.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.127+0000 7f3de8c1f640 1 --2- 172.21.15.27:0/3599252696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3de4102c80 0x7f3de419a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.127+0000 7f3de8c1f640 1 -- 172.21.15.27:0/3599252696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3de410c0d0 msgr2=0x7f3de419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:25.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.127+0000 7f3de8c1f640 1 --2- 172.21.15.27:0/3599252696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3de410c0d0 0x7f3de419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.127+0000 7f3de8c1f640 1 -- 172.21.15.27:0/3599252696 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de419f650 con 0x7f3de41035a0 2024-09-19T08:21:25.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.127+0000 7f3de9420640 1 --2- 172.21.15.27:0/3599252696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3de4102c80 0x7f3de419a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:21:25.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.127+0000 7f3de8c1f640 1 --2- 172.21.15.27:0/3599252696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3de41035a0 0x7f3de419aba0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800b3f0 tx=0x7f3dd800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:25.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.128+0000 7f3dd67fc640 1 -- 172.21.15.27:0/3599252696 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8015020 con 0x7f3de41035a0 2024-09-19T08:21:25.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.128+0000 7f3dd67fc640 1 -- 172.21.15.27:0/3599252696 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dd8011d10 con 0x7f3de41035a0 2024-09-19T08:21:25.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.128+0000 7f3dd67fc640 1 -- 172.21.15.27:0/3599252696 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd800f2e0 con 0x7f3de41035a0 2024-09-19T08:21:25.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.128+0000 7f3deb684640 1 -- 172.21.15.27:0/3599252696 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de419f940 con 0x7f3de41035a0 2024-09-19T08:21:25.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.128+0000 7f3deb684640 1 -- 172.21.15.27:0/3599252696 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de41a71d0 con 0x7f3de41035a0 2024-09-19T08:21:25.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.129+0000 7f3deb684640 1 -- 172.21.15.27:0/3599252696 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3de4103060 con 0x7f3de41035a0 2024-09-19T08:21:25.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.130+0000 7f3dd67fc640 1 -- 172.21.15.27:0/3599252696 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3dd8018020 con 0x7f3de41035a0 2024-09-19T08:21:25.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.131+0000 7f3dd67fc640 1 --2- 172.21.15.27:0/3599252696 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3dd00a33c0 0x7f3dd00a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:25.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.131+0000 7f3de9420640 1 --2- 172.21.15.27:0/3599252696 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3dd00a33c0 0x7f3dd00a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:25.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.131+0000 7f3dd67fc640 1 -- 172.21.15.27:0/3599252696 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f3dd80cf9a0 con 0x7f3de41035a0 2024-09-19T08:21:25.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.131+0000 7f3de9420640 1 --2- 172.21.15.27:0/3599252696 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3dd00a33c0 0x7f3dd00a5880 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3de0005cc0 tx=0x7f3de0005c30 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:25.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.134+0000 7f3dd67fc640 1 -- 172.21.15.27:0/3599252696 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3dd801f020 con 0x7f3de41035a0 2024-09-19T08:21:25.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:24 smithi155 ceph-mon[35362]: pgmap v322: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T08:21:25.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:24 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3995218853' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:21:25.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:24 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/574211711' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:21:25.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:24 smithi203 ceph-mon[35198]: pgmap v322: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T08:21:25.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:24 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3995218853' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:21:25.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:24 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/574211711' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:21:25.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.311+0000 7f3deb684640 1 -- 172.21.15.27:0/3599252696 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3de41a7430 con 0x7f3de41035a0 2024-09-19T08:21:25.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.312+0000 7f3dd67fc640 1 -- 172.21.15.27:0/3599252696 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) ==== 100+0+11 (secure 0 0 0) 0x7f3dd809c4b0 con 0x7f3de41035a0 2024-09-19T08:21:25.312 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-09-19T08:21:25.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.314+0000 7f3deb684640 1 -- 172.21.15.27:0/3599252696 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3dd00a33c0 msgr2=0x7f3dd00a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:25.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.314+0000 7f3deb684640 1 --2- 172.21.15.27:0/3599252696 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3dd00a33c0 0x7f3dd00a5880 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3de0005cc0 tx=0x7f3de0005c30 comp rx=0 tx=0).stop 2024-09-19T08:21:25.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.314+0000 7f3deb684640 1 -- 172.21.15.27:0/3599252696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3de41035a0 msgr2=0x7f3de419aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:25.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.314+0000 7f3deb684640 1 --2- 172.21.15.27:0/3599252696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3de41035a0 0x7f3de419aba0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800b3f0 tx=0x7f3dd800b8b0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.314+0000 7f3deb684640 1 -- 172.21.15.27:0/3599252696 shutdown_connections 2024-09-19T08:21:25.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.314+0000 7f3deb684640 1 --2- 172.21.15.27:0/3599252696 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f3dd00a33c0 0x7f3dd00a5880 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.314+0000 7f3deb684640 1 --2- 172.21.15.27:0/3599252696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3de410c0d0 0x7f3de419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.314+0000 7f3deb684640 1 --2- 172.21.15.27:0/3599252696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3de41035a0 0x7f3de419aba0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.314+0000 7f3deb684640 1 --2- 172.21.15.27:0/3599252696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3de4102c80 0x7f3de419a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.314+0000 7f3deb684640 1 -- 172.21.15.27:0/3599252696 >> 172.21.15.27:0/3599252696 conn(0x7f3de40fc690 msgr2=0x7f3de4100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:25.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.314+0000 7f3deb684640 1 -- 172.21.15.27:0/3599252696 shutdown_connections 2024-09-19T08:21:25.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.314+0000 7f3deb684640 1 -- 172.21.15.27:0/3599252696 wait complete. 2024-09-19T08:21:25.325 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T08:21:25.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.428+0000 7fc410874640 1 -- 172.21.15.27:0/3187116141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc40c100880 msgr2=0x7fc40c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:25.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.428+0000 7fc410874640 1 --2- 172.21.15.27:0/3187116141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc40c100880 0x7fc40c100c60 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009ca0 tx=0x7fc3fc02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.428+0000 7fc410874640 1 -- 172.21.15.27:0/3187116141 shutdown_connections 2024-09-19T08:21:25.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.428+0000 7fc410874640 1 --2- 172.21.15.27:0/3187116141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc40c1080d0 0x7fc40c10e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.428+0000 7fc410874640 1 --2- 172.21.15.27:0/3187116141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc40c101230 0x7fc40c107970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.428+0000 7fc410874640 1 --2- 172.21.15.27:0/3187116141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc40c100880 0x7fc40c100c60 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.428+0000 7fc410874640 1 -- 172.21.15.27:0/3187116141 >> 172.21.15.27:0/3187116141 conn(0x7fc40c075f60 msgr2=0x7fc40c076370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:25.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.428+0000 7fc410874640 1 -- 172.21.15.27:0/3187116141 shutdown_connections 2024-09-19T08:21:25.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.428+0000 7fc410874640 1 -- 172.21.15.27:0/3187116141 wait complete. 2024-09-19T08:21:25.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.429+0000 7fc410874640 1 Processor -- start 2024-09-19T08:21:25.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.429+0000 7fc410874640 1 -- start start 2024-09-19T08:21:25.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.429+0000 7fc410874640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc40c100880 0x7fc40c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:25.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.429+0000 7fc410874640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc40c1080d0 0x7fc40c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:25.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.429+0000 7fc410874640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc40c19cd20 0x7fc40c19d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:25.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.429+0000 7fc410874640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c111f20 con 0x7fc40c100880 2024-09-19T08:21:25.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.429+0000 7fc410874640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c111da0 con 0x7fc40c19cd20 2024-09-19T08:21:25.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.429+0000 7fc410874640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c1120a0 con 0x7fc40c1080d0 2024-09-19T08:21:25.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.429+0000 7fc40a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc40c100880 0x7fc40c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:25.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.430+0000 7fc40a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc40c100880 0x7fc40c198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52380/0 (socket says 172.21.15.27:52380) 2024-09-19T08:21:25.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.430+0000 7fc40a59c640 1 -- 172.21.15.27:0/701110429 learned_addr learned my addr 172.21.15.27:0/701110429 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:25.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.430+0000 7fc40ad9d640 1 --2- 172.21.15.27:0/701110429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc40c19cd20 0x7fc40c19d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:25.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.430+0000 7fc409d9b640 1 --2- 172.21.15.27:0/701110429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc40c1080d0 0x7fc40c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:25.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.430+0000 7fc40a59c640 1 -- 172.21.15.27:0/701110429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc40c1080d0 msgr2=0x7fc40c1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:25.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.430+0000 7fc40a59c640 1 --2- 172.21.15.27:0/701110429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc40c1080d0 0x7fc40c1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.430+0000 7fc40a59c640 1 -- 172.21.15.27:0/701110429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc40c19cd20 msgr2=0x7fc40c19d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:25.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.430+0000 7fc40a59c640 1 --2- 172.21.15.27:0/701110429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc40c19cd20 0x7fc40c19d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:25.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.430+0000 7fc40a59c640 1 -- 172.21.15.27:0/701110429 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40c19d810 con 0x7fc40c100880 2024-09-19T08:21:25.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.430+0000 7fc40a59c640 1 --2- 172.21.15.27:0/701110429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc40c100880 0x7fc40c198460 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0097b0 tx=0x7fc3fc031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:25.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.430+0000 7fc3fb7fe640 1 -- 172.21.15.27:0/701110429 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc02fba0 con 0x7fc40c100880 2024-09-19T08:21:25.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.430+0000 7fc3fb7fe640 1 -- 172.21.15.27:0/701110429 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3fc02fd40 con 0x7fc40c100880 2024-09-19T08:21:25.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.430+0000 7fc410874640 1 -- 172.21.15.27:0/701110429 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc40c19daa0 con 0x7fc40c100880 2024-09-19T08:21:25.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.430+0000 7fc3fb7fe640 1 -- 172.21.15.27:0/701110429 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc03b930 con 0x7fc40c100880 2024-09-19T08:21:25.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.430+0000 7fc410874640 1 -- 172.21.15.27:0/701110429 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc40c1a5260 con 0x7fc40c100880 2024-09-19T08:21:25.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.431+0000 7fc410874640 1 -- 172.21.15.27:0/701110429 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc40c100c60 con 0x7fc40c100880 2024-09-19T08:21:25.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.432+0000 7fc3fb7fe640 1 -- 172.21.15.27:0/701110429 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc3fc030cc0 con 0x7fc40c100880 2024-09-19T08:21:25.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.433+0000 7fc3fb7fe640 1 --2- 172.21.15.27:0/701110429 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc3f40a33c0 0x7fc3f40a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:25.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.433+0000 7fc409d9b640 1 --2- 172.21.15.27:0/701110429 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc3f40a33c0 0x7fc3f40a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:25.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.433+0000 7fc3fb7fe640 1 -- 172.21.15.27:0/701110429 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7fc3fc0f1340 con 0x7fc40c100880 2024-09-19T08:21:25.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.433+0000 7fc409d9b640 1 --2- 172.21.15.27:0/701110429 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc3f40a33c0 0x7fc3f40a5880 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc40c100140 tx=0x7fc400008040 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:25.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.437+0000 7fc3fb7fe640 1 -- 172.21.15.27:0/701110429 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc3fc0bde50 con 0x7fc40c100880 2024-09-19T08:21:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.661+0000 7fc410874640 1 -- 172.21.15.27:0/701110429 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fc40c101230 con 0x7fc40c100880 2024-09-19T08:21:25.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.669+0000 7fc3fb7fe640 1 -- 172.21.15.27:0/701110429 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+742872 (secure 0 0 0) 0x7fc3fc0bd750 con 0x7fc40c100880 2024-09-19T08:21:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:21:25.681 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:21:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: "epoch": 26, 2024-09-19T08:21:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: "active_gid": 15093, 2024-09-19T08:21:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: "active_name": "x", 2024-09-19T08:21:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: "active_addrs": { 2024-09-19T08:21:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: "addrvec": [ 2024-09-19T08:21:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v2", 2024-09-19T08:21:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "172.21.15.27:6800", 2024-09-19T08:21:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 1578338135 2024-09-19T08:21:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v1", 2024-09-19T08:21:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "172.21.15.27:6801", 2024-09-19T08:21:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 1578338135 2024-09-19T08:21:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-19T08:21:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: "active_addr": "172.21.15.27:6801/1578338135", 2024-09-19T08:21:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: "active_change": "2024-09-19T08:11:01.318758+0000", 2024-09-19T08:21:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T08:21:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "available": true, 2024-09-19T08:21:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "standbys": [ 2024-09-19T08:21:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "gid": 24761, 2024-09-19T08:21:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "y", 2024-09-19T08:21:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr_features": 4540701547738038271, 2024-09-19T08:21:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "available_modules": [ 2024-09-19T08:21:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "alerts", 2024-09-19T08:21:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-19T08:21:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-19T08:21:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-19T08:21:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T08:21:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_destination": { 2024-09-19T08:21:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_destination", 2024-09-19T08:21:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Email address to send alerts to", 2024-09-19T08:21:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_from_name": { 2024-09-19T08:21:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_from_name", 2024-09-19T08:21:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "Ceph", 2024-09-19T08:21:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Email From: name", 2024-09-19T08:21:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_host": { 2024-09-19T08:21:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_host", 2024-09-19T08:21:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SMTP server", 2024-09-19T08:21:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_password": { 2024-09-19T08:21:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_password", 2024-09-19T08:21:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Password to authenticate with", 2024-09-19T08:21:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_port": { 2024-09-19T08:21:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_port", 2024-09-19T08:21:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "465", 2024-09-19T08:21:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SMTP port", 2024-09-19T08:21:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_sender": { 2024-09-19T08:21:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_sender", 2024-09-19T08:21:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SMTP envelope sender", 2024-09-19T08:21:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_ssl": { 2024-09-19T08:21:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_ssl", 2024-09-19T08:21:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T08:21:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_user": { 2024-09-19T08:21:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_user", 2024-09-19T08:21:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "User to authenticate as", 2024-09-19T08:21:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "balancer", 2024-09-19T08:21:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: "active": { 2024-09-19T08:21:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "active", 2024-09-19T08:21:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T08:21:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "begin_time": { 2024-09-19T08:21:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "begin_time", 2024-09-19T08:21:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0000", 2024-09-19T08:21:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T08:21:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:21:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "begin_weekday": { 2024-09-19T08:21:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "begin_weekday", 2024-09-19T08:21:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-19T08:21:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-19T08:21:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "0", 2024-09-19T08:21:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "6", 2024-09-19T08:21:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T08:21:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:21:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "crush_compat_max_iterations": { 2024-09-19T08:21:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crush_compat_max_iterations", 2024-09-19T08:21:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-19T08:21:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "25", 2024-09-19T08:21:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-19T08:21:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "250", 2024-09-19T08:21:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T08:21:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "crush_compat_metrics": { 2024-09-19T08:21:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crush_compat_metrics", 2024-09-19T08:21:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T08:21:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T08:21:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T08:21:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "crush_compat_step": { 2024-09-19T08:21:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crush_compat_step", 2024-09-19T08:21:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0.5", 2024-09-19T08:21:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "0.001", 2024-09-19T08:21:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "0.999", 2024-09-19T08:21:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "aggressiveness of optimization", 2024-09-19T08:21:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T08:21:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "end_time": { 2024-09-19T08:21:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "end_time", 2024-09-19T08:21:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "2359", 2024-09-19T08:21:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T08:21:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:21:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "end_weekday": { 2024-09-19T08:21:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "end_weekday", 2024-09-19T08:21:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-19T08:21:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-19T08:21:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "0", 2024-09-19T08:21:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "6", 2024-09-19T08:21:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T08:21:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:21:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "min_score": { 2024-09-19T08:21:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "min_score", 2024-09-19T08:21:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-19T08:21:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T08:21:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": { 2024-09-19T08:21:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mode", 2024-09-19T08:21:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "upmap", 2024-09-19T08:21:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "crush-compat", 2024-09-19T08:21:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "none", 2024-09-19T08:21:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "read", 2024-09-19T08:21:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap", 2024-09-19T08:21:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap-read" 2024-09-19T08:21:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Balancer mode", 2024-09-19T08:21:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "pool_ids": { 2024-09-19T08:21:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pool_ids", 2024-09-19T08:21:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T08:21:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-19T08:21:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-19T08:21:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-19T08:21:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T08:21:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap_max_deviation": { 2024-09-19T08:21:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "upmap_max_deviation", 2024-09-19T08:21:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-19T08:21:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-19T08:21:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T08:21:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T08:21:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap_max_optimizations": { 2024-09-19T08:21:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "upmap_max_optimizations", 2024-09-19T08:21:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-19T08:21:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T08:21:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cephadm", 2024-09-19T08:21:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "agent_down_multiplier": { 2024-09-19T08:21:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "agent_down_multiplier", 2024-09-19T08:21:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "3.0", 2024-09-19T08:21:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T08:21:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: "agent_refresh_rate": { 2024-09-19T08:21:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "agent_refresh_rate", 2024-09-19T08:21:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "20", 2024-09-19T08:21:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T08:21:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "agent_starting_port": { 2024-09-19T08:21:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "agent_starting_port", 2024-09-19T08:21:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "4721", 2024-09-19T08:21:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T08:21:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "allow_ptrace": { 2024-09-19T08:21:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "allow_ptrace", 2024-09-19T08:21:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T08:21:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T08:21:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "autotune_interval": { 2024-09-19T08:21:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "autotune_interval", 2024-09-19T08:21:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-19T08:21:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T08:21:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "autotune_memory_target_ratio": { 2024-09-19T08:21:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T08:21:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0.7", 2024-09-19T08:21:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T08:21:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "cephadm_log_destination": { 2024-09-19T08:21:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cephadm_log_destination", 2024-09-19T08:21:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "file", 2024-09-19T08:21:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "file,syslog", 2024-09-19T08:21:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "syslog" 2024-09-19T08:21:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T08:21:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "cgroups_split": { 2024-09-19T08:21:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cgroups_split", 2024-09-19T08:21:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T08:21:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "config_checks_enabled": { 2024-09-19T08:21:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "config_checks_enabled", 2024-09-19T08:21:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T08:21:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "config_dashboard": { 2024-09-19T08:21:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "config_dashboard", 2024-09-19T08:21:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T08:21:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_alertmanager": { 2024-09-19T08:21:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_alertmanager", 2024-09-19T08:21:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T08:21:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-19T08:21:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_base": { 2024-09-19T08:21:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_base", 2024-09-19T08:21:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T08:21:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Container image name, without the tag", 2024-09-19T08:21:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_elasticsearch": { 2024-09-19T08:21:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_elasticsearch", 2024-09-19T08:21:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T08:21:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "elasticsearch container image", 2024-09-19T08:21:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_grafana": { 2024-09-19T08:21:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_grafana", 2024-09-19T08:21:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T08:21:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-19T08:21:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_haproxy": { 2024-09-19T08:21:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_haproxy", 2024-09-19T08:21:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T08:21:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "HAproxy container image", 2024-09-19T08:21:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_jaeger_agent": { 2024-09-19T08:21:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_jaeger_agent", 2024-09-19T08:21:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T08:21:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Jaeger agent container image", 2024-09-19T08:21:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_jaeger_collector": { 2024-09-19T08:21:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_jaeger_collector", 2024-09-19T08:21:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T08:21:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Jaeger collector container image", 2024-09-19T08:21:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_jaeger_query": { 2024-09-19T08:21:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_jaeger_query", 2024-09-19T08:21:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T08:21:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.745 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.745 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Jaeger query container image", 2024-09-19T08:21:25.745 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.745 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_keepalived": { 2024-09-19T08:21:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_keepalived", 2024-09-19T08:21:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T08:21:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Keepalived container image", 2024-09-19T08:21:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_loki": { 2024-09-19T08:21:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_loki", 2024-09-19T08:21:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T08:21:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Loki container image", 2024-09-19T08:21:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_node_exporter": { 2024-09-19T08:21:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_node_exporter", 2024-09-19T08:21:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T08:21:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-19T08:21:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_nvmeof": { 2024-09-19T08:21:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_nvmeof", 2024-09-19T08:21:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T08:21:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Nvme-of container image", 2024-09-19T08:21:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_prometheus": { 2024-09-19T08:21:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_prometheus", 2024-09-19T08:21:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T08:21:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-19T08:21:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_promtail": { 2024-09-19T08:21:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_promtail", 2024-09-19T08:21:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T08:21:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Promtail container image", 2024-09-19T08:21:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_samba": { 2024-09-19T08:21:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_samba", 2024-09-19T08:21:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T08:21:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Samba/SMB container image", 2024-09-19T08:21:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_snmp_gateway": { 2024-09-19T08:21:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_snmp_gateway", 2024-09-19T08:21:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T08:21:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SNMP Gateway container image", 2024-09-19T08:21:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "container_init": { 2024-09-19T08:21:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_init", 2024-09-19T08:21:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.757 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T08:21:25.757 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.757 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.757 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.757 INFO:teuthology.orchestra.run.smithi027.stdout: "daemon_cache_timeout": { 2024-09-19T08:21:25.758 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "daemon_cache_timeout", 2024-09-19T08:21:25.758 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:25.758 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.758 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.758 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-19T08:21:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T08:21:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.760 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.760 INFO:teuthology.orchestra.run.smithi027.stdout: "default_cephadm_command_timeout": { 2024-09-19T08:21:25.760 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T08:21:25.760 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.760 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.760 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.761 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "900", 2024-09-19T08:21:25.761 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.761 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.761 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.761 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T08:21:25.761 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: "default_registry": { 2024-09-19T08:21:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "default_registry", 2024-09-19T08:21:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.763 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.763 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io", 2024-09-19T08:21:25.763 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.763 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.763 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.764 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T08:21:25.764 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.764 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.764 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.764 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "device_cache_timeout": { 2024-09-19T08:21:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "device_cache_timeout", 2024-09-19T08:21:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "1800", 2024-09-19T08:21:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.766 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.766 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.766 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "seconds to cache device inventory", 2024-09-19T08:21:25.766 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.766 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: "device_enhanced_scan": { 2024-09-19T08:21:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "device_enhanced_scan", 2024-09-19T08:21:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.768 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.768 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.768 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.768 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.768 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T08:21:25.768 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.768 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.769 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.769 INFO:teuthology.orchestra.run.smithi027.stdout: "facts_cache_timeout": { 2024-09-19T08:21:25.769 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "facts_cache_timeout", 2024-09-19T08:21:25.769 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:25.770 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.770 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.770 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-19T08:21:25.770 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.770 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.771 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.771 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "seconds to cache host facts data", 2024-09-19T08:21:25.771 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.771 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.771 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.771 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.772 INFO:teuthology.orchestra.run.smithi027.stdout: "grafana_dashboards_path": { 2024-09-19T08:21:25.772 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "grafana_dashboards_path", 2024-09-19T08:21:25.772 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.772 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.772 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.772 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T08:21:25.772 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T08:21:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: "host_check_interval": { 2024-09-19T08:21:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "host_check_interval", 2024-09-19T08:21:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-19T08:21:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to perform a host check", 2024-09-19T08:21:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: "hw_monitoring": { 2024-09-19T08:21:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "hw_monitoring", 2024-09-19T08:21:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.776 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.776 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.776 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.776 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.776 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.776 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.777 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T08:21:25.777 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.777 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.777 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.777 INFO:teuthology.orchestra.run.smithi027.stdout: "inventory_list_all": { 2024-09-19T08:21:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "inventory_list_all", 2024-09-19T08:21:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.779 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.779 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.779 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T08:21:25.779 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.779 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.780 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.780 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:25.780 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:25.780 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.780 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.781 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.781 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.781 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.781 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.781 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.781 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.782 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.782 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.782 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.782 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.782 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: "log_refresh_metadata": { 2024-09-19T08:21:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_refresh_metadata", 2024-09-19T08:21:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T08:21:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T08:21:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T08:21:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T08:21:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T08:21:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T08:21:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T08:21:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "*", 2024-09-19T08:21:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T08:21:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "max_count_per_host": { 2024-09-19T08:21:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_count_per_host", 2024-09-19T08:21:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "max number of daemons per service per host", 2024-09-19T08:21:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "max_osd_draining_count": { 2024-09-19T08:21:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_osd_draining_count", 2024-09-19T08:21:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T08:21:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: "migration_current": { 2024-09-19T08:21:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "migration_current", 2024-09-19T08:21:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.796 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.796 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.796 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.796 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "internal - do not modify", 2024-09-19T08:21:25.797 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.797 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.797 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.797 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": { 2024-09-19T08:21:25.798 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mode", 2024-09-19T08:21:25.798 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.798 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.798 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.798 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "root", 2024-09-19T08:21:25.799 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.799 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.799 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.799 INFO:teuthology.orchestra.run.smithi027.stdout: "cephadm-package", 2024-09-19T08:21:25.799 INFO:teuthology.orchestra.run.smithi027.stdout: "root" 2024-09-19T08:21:25.799 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.800 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T08:21:25.800 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.800 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.800 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.800 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.800 INFO:teuthology.orchestra.run.smithi027.stdout: "oob_default_addr": { 2024-09-19T08:21:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "oob_default_addr", 2024-09-19T08:21:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "169.254.1.1", 2024-09-19T08:21:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.802 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.802 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.802 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T08:21:25.802 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.802 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.803 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.803 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.803 INFO:teuthology.orchestra.run.smithi027.stdout: "prometheus_alerts_path": { 2024-09-19T08:21:25.803 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "prometheus_alerts_path", 2024-09-19T08:21:25.803 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.803 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.804 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.804 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T08:21:25.804 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.804 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.804 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.804 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T08:21:25.805 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.805 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.805 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.805 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.805 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_insecure": { 2024-09-19T08:21:25.805 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_insecure", 2024-09-19T08:21:25.806 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.806 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.806 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.806 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.806 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T08:21:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_password": { 2024-09-19T08:21:25.808 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_password", 2024-09-19T08:21:25.808 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.808 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.808 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.808 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.808 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.808 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.809 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.809 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T08:21:25.809 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.809 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.809 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.809 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.810 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_url": { 2024-09-19T08:21:25.810 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_url", 2024-09-19T08:21:25.810 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.810 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.810 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.810 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.811 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.811 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.811 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.811 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T08:21:25.811 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.811 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.812 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.812 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.812 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_username": { 2024-09-19T08:21:25.812 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_username", 2024-09-19T08:21:25.812 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.813 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.813 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.813 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.813 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.813 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.813 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.814 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T08:21:25.814 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.814 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.814 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.814 INFO:teuthology.orchestra.run.smithi027.stdout: "secure_monitoring_stack": { 2024-09-19T08:21:25.815 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "secure_monitoring_stack", 2024-09-19T08:21:25.815 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.815 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.815 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.815 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T08:21:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: "service_discovery_port": { 2024-09-19T08:21:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "service_discovery_port", 2024-09-19T08:21:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8765", 2024-09-19T08:21:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "cephadm service discovery port", 2024-09-19T08:21:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "ssh_config_file": { 2024-09-19T08:21:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssh_config_file", 2024-09-19T08:21:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T08:21:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "use_agent": { 2024-09-19T08:21:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "use_agent", 2024-09-19T08:21:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T08:21:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "use_repo_digest": { 2024-09-19T08:21:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "use_repo_digest", 2024-09-19T08:21:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T08:21:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_on_failed_host_check": { 2024-09-19T08:21:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_on_failed_host_check", 2024-09-19T08:21:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T08:21:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_on_stray_daemons": { 2024-09-19T08:21:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_on_stray_daemons", 2024-09-19T08:21:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T08:21:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_on_stray_hosts": { 2024-09-19T08:21:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_on_stray_hosts", 2024-09-19T08:21:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T08:21:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crash", 2024-09-19T08:21:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "retain_interval": { 2024-09-19T08:21:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "retain_interval", 2024-09-19T08:21:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "31536000", 2024-09-19T08:21:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T08:21:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_recent_interval": { 2024-09-19T08:21:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_recent_interval", 2024-09-19T08:21:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "1209600", 2024-09-19T08:21:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T08:21:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "dashboard", 2024-09-19T08:21:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T08:21:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T08:21:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T08:21:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T08:21:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T08:21:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T08:21:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "AUDIT_API_ENABLED": { 2024-09-19T08:21:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T08:21:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T08:21:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T08:21:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T08:21:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T08:21:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T08:21:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T08:21:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T08:21:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T08:21:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T08:21:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T08:21:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T08:21:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T08:21:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T08:21:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T08:21:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T08:21:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T08:21:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T08:21:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T08:21:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T08:21:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T08:21:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T08:21:25.848 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T08:21:25.848 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.848 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.848 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.848 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "admin", 2024-09-19T08:21:25.848 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.848 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.848 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.848 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.848 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.848 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.848 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.848 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T08:21:25.849 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T08:21:25.849 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.849 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.849 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.849 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.849 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.849 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.849 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.849 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.849 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.849 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.849 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.850 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_URL": { 2024-09-19T08:21:25.850 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_URL", 2024-09-19T08:21:25.850 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.850 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.850 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.850 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.850 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.850 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.850 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.850 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.850 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.850 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.850 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.851 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T08:21:25.851 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T08:21:25.851 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.851 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.851 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.851 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "admin", 2024-09-19T08:21:25.851 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.851 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.851 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.851 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.851 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.851 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.852 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.852 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T08:21:25.852 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T08:21:25.852 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.852 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.852 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.852 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.852 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.852 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.852 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.852 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.852 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.853 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.853 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.853 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T08:21:25.853 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T08:21:25.853 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.853 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.853 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.853 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.853 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.853 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.853 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.854 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.854 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.854 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.854 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.854 INFO:teuthology.orchestra.run.smithi027.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T08:21:25.854 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T08:21:25.854 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.854 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.854 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.854 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.854 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.854 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.854 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.855 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.855 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.855 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.855 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.855 INFO:teuthology.orchestra.run.smithi027.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T08:21:25.855 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T08:21:25.855 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.855 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.855 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.855 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.855 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.855 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.856 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.856 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.856 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.856 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.856 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.856 INFO:teuthology.orchestra.run.smithi027.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T08:21:25.856 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T08:21:25.856 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.856 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.856 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.856 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.856 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.857 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.857 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.857 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.857 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.857 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.857 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.857 INFO:teuthology.orchestra.run.smithi027.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T08:21:25.857 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T08:21:25.857 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.857 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.857 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.857 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.858 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.858 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.858 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.858 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.858 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.858 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.858 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.858 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T08:21:25.858 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T08:21:25.858 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.858 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.858 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.858 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.859 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.859 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.859 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.859 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.859 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.859 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.859 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.859 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.859 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T08:21:25.859 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T08:21:25.859 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.859 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.859 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.859 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.860 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.860 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.860 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.860 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.860 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.860 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.860 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.860 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T08:21:25.860 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T08:21:25.860 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.860 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.860 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.861 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.861 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.861 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.861 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.861 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.861 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.861 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.861 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.861 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T08:21:25.861 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T08:21:25.861 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.861 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.861 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.862 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.862 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.862 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.862 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.862 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.862 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.862 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.862 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.862 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T08:21:25.862 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T08:21:25.862 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.862 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.862 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.862 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.863 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.863 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.863 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.863 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.863 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.863 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.863 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.863 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T08:21:25.863 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T08:21:25.863 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.863 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.863 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.863 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.864 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.864 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.864 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.864 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.864 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.864 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.864 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.864 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T08:21:25.864 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T08:21:25.864 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.864 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.864 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.864 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.865 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.865 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.865 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.865 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.865 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.865 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.865 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.865 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.865 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T08:21:25.865 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T08:21:25.865 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.865 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.865 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.865 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.866 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.866 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.866 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.866 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.866 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.866 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.866 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.866 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T08:21:25.866 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T08:21:25.866 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.866 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.867 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.867 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T08:21:25.867 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.867 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.867 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.867 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.867 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.867 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.867 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.867 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T08:21:25.867 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T08:21:25.867 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.867 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.868 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.868 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:25.868 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.868 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.868 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.868 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.868 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.868 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.868 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.868 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T08:21:25.868 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T08:21:25.868 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.869 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.869 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.869 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8", 2024-09-19T08:21:25.869 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.869 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.869 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.869 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.869 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.869 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.869 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.869 INFO:teuthology.orchestra.run.smithi027.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T08:21:25.870 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T08:21:25.870 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.870 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.870 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.870 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "45", 2024-09-19T08:21:25.870 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.870 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.870 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.870 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.870 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.870 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.870 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.871 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T08:21:25.871 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T08:21:25.871 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.871 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.871 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.871 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.871 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.871 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.871 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.871 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.871 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.871 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.871 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.872 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T08:21:25.872 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T08:21:25.872 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.872 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.872 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.872 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "admin", 2024-09-19T08:21:25.872 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.872 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.872 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.872 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.872 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.872 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.873 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.873 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T08:21:25.873 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T08:21:25.873 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.873 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.873 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.873 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.873 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.873 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.873 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.873 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.873 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.874 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.874 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.874 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T08:21:25.874 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T08:21:25.874 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.874 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.874 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.874 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.874 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.874 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.874 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.874 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.875 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.875 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.875 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.875 INFO:teuthology.orchestra.run.smithi027.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T08:21:25.875 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T08:21:25.875 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.875 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.875 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.875 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-19T08:21:25.875 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.875 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.875 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.876 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.876 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.876 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.876 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.876 INFO:teuthology.orchestra.run.smithi027.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T08:21:25.876 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T08:21:25.876 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.876 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.876 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.876 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:25.876 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.876 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.877 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.877 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.877 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.877 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.877 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.877 INFO:teuthology.orchestra.run.smithi027.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T08:21:25.877 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T08:21:25.877 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.877 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.877 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.877 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-19T08:21:25.877 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.877 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.878 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.878 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.878 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.878 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.878 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.878 INFO:teuthology.orchestra.run.smithi027.stdout: "cross_origin_url": { 2024-09-19T08:21:25.878 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cross_origin_url", 2024-09-19T08:21:25.878 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.878 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.878 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.878 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.878 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.878 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.879 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.879 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.879 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.879 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.879 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.879 INFO:teuthology.orchestra.run.smithi027.stdout: "crt_file": { 2024-09-19T08:21:25.879 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crt_file", 2024-09-19T08:21:25.879 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.879 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.879 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.879 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.879 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.879 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.880 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.880 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.880 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.880 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.880 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.880 INFO:teuthology.orchestra.run.smithi027.stdout: "debug": { 2024-09-19T08:21:25.880 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "debug", 2024-09-19T08:21:25.880 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.880 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.880 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.880 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.881 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.881 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.881 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.881 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Enable/disable debug options", 2024-09-19T08:21:25.881 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.881 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.881 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.881 INFO:teuthology.orchestra.run.smithi027.stdout: "jwt_token_ttl": { 2024-09-19T08:21:25.881 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "jwt_token_ttl", 2024-09-19T08:21:25.881 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.881 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.882 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.882 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "28800", 2024-09-19T08:21:25.882 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.882 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.882 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.882 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.882 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.882 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.882 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.882 INFO:teuthology.orchestra.run.smithi027.stdout: "key_file": { 2024-09-19T08:21:25.882 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "key_file", 2024-09-19T08:21:25.882 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.882 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.883 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.883 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.883 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.883 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.883 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.883 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.883 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.883 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.883 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.883 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:25.883 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:25.884 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.884 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.884 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.884 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.884 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.884 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.884 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.884 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.884 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.884 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.884 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.884 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.884 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.884 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.885 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.885 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.885 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.885 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.885 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:25.885 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:25.885 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.885 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.885 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.885 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.885 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.886 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.886 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.886 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.886 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.886 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.886 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.886 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.886 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:25.886 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:25.886 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.886 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.886 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.886 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:25.886 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.887 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.887 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.887 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.887 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.887 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.887 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.887 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.887 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.887 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.887 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.887 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.887 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.887 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.888 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:25.888 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:25.888 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.888 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.888 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.888 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.888 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.888 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.888 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.888 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.888 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.888 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.888 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.889 INFO:teuthology.orchestra.run.smithi027.stdout: "motd": { 2024-09-19T08:21:25.889 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "motd", 2024-09-19T08:21:25.889 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.889 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.889 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.889 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.889 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.889 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.889 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.889 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "The message of the day", 2024-09-19T08:21:25.889 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.889 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.889 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.890 INFO:teuthology.orchestra.run.smithi027.stdout: "redirect_resolve_ip_addr": { 2024-09-19T08:21:25.890 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T08:21:25.890 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.890 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.890 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.890 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.890 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.890 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.890 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.890 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.890 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.890 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.890 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.891 INFO:teuthology.orchestra.run.smithi027.stdout: "server_addr": { 2024-09-19T08:21:25.891 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_addr", 2024-09-19T08:21:25.891 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.891 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.891 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.891 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "::", 2024-09-19T08:21:25.891 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.891 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.891 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.891 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.891 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.891 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.891 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.891 INFO:teuthology.orchestra.run.smithi027.stdout: "server_port": { 2024-09-19T08:21:25.892 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_port", 2024-09-19T08:21:25.892 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.892 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.892 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.892 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8080", 2024-09-19T08:21:25.892 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.892 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.892 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.892 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.892 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.892 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.892 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.892 INFO:teuthology.orchestra.run.smithi027.stdout: "ssl": { 2024-09-19T08:21:25.893 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssl", 2024-09-19T08:21:25.893 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.893 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.893 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.893 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.893 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.893 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.893 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.893 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.893 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.893 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.893 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.894 INFO:teuthology.orchestra.run.smithi027.stdout: "ssl_server_port": { 2024-09-19T08:21:25.894 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssl_server_port", 2024-09-19T08:21:25.894 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.894 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.894 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.894 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8443", 2024-09-19T08:21:25.894 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.894 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.894 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.894 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.894 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.894 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.894 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.895 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_behaviour": { 2024-09-19T08:21:25.895 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_behaviour", 2024-09-19T08:21:25.895 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.895 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.895 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.895 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "redirect", 2024-09-19T08:21:25.895 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.895 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.895 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.895 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.895 INFO:teuthology.orchestra.run.smithi027.stdout: "redirect" 2024-09-19T08:21:25.895 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.895 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.895 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.896 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.896 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.896 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_error_status_code": { 2024-09-19T08:21:25.896 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_error_status_code", 2024-09-19T08:21:25.896 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.896 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.896 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.896 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "500", 2024-09-19T08:21:25.896 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "400", 2024-09-19T08:21:25.896 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "599", 2024-09-19T08:21:25.896 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.896 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.896 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.897 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.897 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.897 INFO:teuthology.orchestra.run.smithi027.stdout: "url_prefix": { 2024-09-19T08:21:25.897 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "url_prefix", 2024-09-19T08:21:25.897 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.897 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.897 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.897 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.897 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.897 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.897 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.897 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.897 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.898 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.898 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.898 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.898 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.898 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.898 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:25.898 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "devicehealth", 2024-09-19T08:21:25.898 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:25.898 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:25.898 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:25.898 INFO:teuthology.orchestra.run.smithi027.stdout: "enable_monitoring": { 2024-09-19T08:21:25.898 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enable_monitoring", 2024-09-19T08:21:25.898 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.899 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.899 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.899 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.899 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.899 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.899 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.899 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "monitor device health metrics", 2024-09-19T08:21:25.899 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.899 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.899 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.899 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:25.899 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:25.899 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.900 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.900 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.900 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.900 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.900 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.900 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.900 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.900 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.900 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.900 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.900 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.900 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.900 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.900 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.901 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.901 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.901 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.901 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:25.901 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:25.901 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.901 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.901 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.901 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.901 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.901 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.901 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.902 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.902 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.902 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.902 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.902 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:25.902 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:25.902 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.902 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.902 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.902 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:25.902 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.902 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.903 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.903 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.903 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.903 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.903 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.903 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.903 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.903 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.903 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.903 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.903 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.903 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.903 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:25.904 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:25.904 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.904 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.904 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.904 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.904 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.904 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.904 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.904 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.904 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.904 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.904 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.905 INFO:teuthology.orchestra.run.smithi027.stdout: "mark_out_threshold": { 2024-09-19T08:21:25.905 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mark_out_threshold", 2024-09-19T08:21:25.905 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:25.905 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.905 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.905 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "2419200", 2024-09-19T08:21:25.905 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.905 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.905 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.905 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T08:21:25.905 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.905 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.905 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.906 INFO:teuthology.orchestra.run.smithi027.stdout: "pool_name": { 2024-09-19T08:21:25.906 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pool_name", 2024-09-19T08:21:25.906 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.906 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.906 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.906 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "device_health_metrics", 2024-09-19T08:21:25.906 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.906 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.906 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.906 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T08:21:25.906 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.906 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.906 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.907 INFO:teuthology.orchestra.run.smithi027.stdout: "retention_period": { 2024-09-19T08:21:25.907 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "retention_period", 2024-09-19T08:21:25.907 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:25.907 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.907 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.907 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "15552000", 2024-09-19T08:21:25.907 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.907 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.907 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.907 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how long to retain device health metrics", 2024-09-19T08:21:25.907 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.907 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.907 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.908 INFO:teuthology.orchestra.run.smithi027.stdout: "scrape_frequency": { 2024-09-19T08:21:25.908 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "scrape_frequency", 2024-09-19T08:21:25.908 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:25.908 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.908 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.908 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "86400", 2024-09-19T08:21:25.908 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.908 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.908 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.908 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T08:21:25.908 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.908 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.909 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.909 INFO:teuthology.orchestra.run.smithi027.stdout: "self_heal": { 2024-09-19T08:21:25.909 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "self_heal", 2024-09-19T08:21:25.909 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.909 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.909 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.909 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:25.909 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.909 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.909 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.909 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T08:21:25.910 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.910 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.910 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.910 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-19T08:21:25.910 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-19T08:21:25.910 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:25.910 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.910 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.910 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-19T08:21:25.910 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.910 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.910 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T08:21:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_threshold": { 2024-09-19T08:21:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_threshold", 2024-09-19T08:21:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "7257600", 2024-09-19T08:21:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.911 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T08:21:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "diskprediction_local", 2024-09-19T08:21:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:25.912 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.913 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.914 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:25.915 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.917 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: "predict_interval": { 2024-09-19T08:21:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "predict_interval", 2024-09-19T08:21:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "86400", 2024-09-19T08:21:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "predictor_model": { 2024-09-19T08:21:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "predictor_model", 2024-09-19T08:21:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "prophetstor", 2024-09-19T08:21:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-19T08:21:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-19T08:21:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-19T08:21:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.920 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "influx", 2024-09-19T08:21:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": false, 2024-09-19T08:21:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "influxdb python module not found", 2024-09-19T08:21:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: "batch_size": { 2024-09-19T08:21:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "batch_size", 2024-09-19T08:21:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.921 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5000", 2024-09-19T08:21:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T08:21:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: "database": { 2024-09-19T08:21:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "database", 2024-09-19T08:21:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.922 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "ceph", 2024-09-19T08:21:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T08:21:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "hostname": { 2024-09-19T08:21:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "hostname", 2024-09-19T08:21:25.923 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "InfluxDB server hostname", 2024-09-19T08:21:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-19T08:21:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-19T08:21:25.924 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "30", 2024-09-19T08:21:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "5", 2024-09-19T08:21:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T08:21:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.925 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.926 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.927 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.928 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.929 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.930 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.931 INFO:teuthology.orchestra.run.smithi027.stdout: "password": { 2024-09-19T08:21:25.931 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "password", 2024-09-19T08:21:25.931 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.931 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.931 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.931 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.931 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.931 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.931 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.931 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "password of InfluxDB server user", 2024-09-19T08:21:25.931 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.931 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "port": { 2024-09-19T08:21:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "port", 2024-09-19T08:21:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8086", 2024-09-19T08:21:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "InfluxDB server port", 2024-09-19T08:21:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.932 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "ssl": { 2024-09-19T08:21:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssl", 2024-09-19T08:21:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "false", 2024-09-19T08:21:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:21:25.933 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "threads": { 2024-09-19T08:21:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "threads", 2024-09-19T08:21:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-19T08:21:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-19T08:21:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "32", 2024-09-19T08:21:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T08:21:25.934 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "username": { 2024-09-19T08:21:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "username", 2024-09-19T08:21:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "username of InfluxDB server user", 2024-09-19T08:21:25.935 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: "verify_ssl": { 2024-09-19T08:21:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "verify_ssl", 2024-09-19T08:21:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "true", 2024-09-19T08:21:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.936 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.937 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:21:25.937 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.937 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.937 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.937 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.937 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.937 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.937 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:25.937 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "insights", 2024-09-19T08:21:25.937 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:25.937 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:25.937 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:25.937 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.938 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.939 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:25.940 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.941 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.942 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "iostat", 2024-09-19T08:21:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.943 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.944 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.945 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.946 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.947 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:25.948 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "k8sevents", 2024-09-19T08:21:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_event_retention_days": { 2024-09-19T08:21:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ceph_event_retention_days", 2024-09-19T08:21:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "7", 2024-09-19T08:21:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.949 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T08:21:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: "config_check_secs": { 2024-09-19T08:21:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "config_check_secs", 2024-09-19T08:21:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "10", 2024-09-19T08:21:25.950 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T08:21:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.951 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.952 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.953 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.954 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.955 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "localpool", 2024-09-19T08:21:25.956 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "failure_domain": { 2024-09-19T08:21:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "failure_domain", 2024-09-19T08:21:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "host", 2024-09-19T08:21:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "failure domain for any created local pool", 2024-09-19T08:21:25.957 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T08:21:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.958 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:25.960 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.961 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.962 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "min_size": { 2024-09-19T08:21:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "min_size", 2024-09-19T08:21:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.963 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "default min_size for any created local pool", 2024-09-19T08:21:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T08:21:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: "num_rep": { 2024-09-19T08:21:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "num_rep", 2024-09-19T08:21:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "3", 2024-09-19T08:21:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.964 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "default replica count for any created local pool", 2024-09-19T08:21:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: "pg_num": { 2024-09-19T08:21:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pg_num", 2024-09-19T08:21:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.965 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "128", 2024-09-19T08:21:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T08:21:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: "prefix": { 2024-09-19T08:21:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "prefix", 2024-09-19T08:21:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.966 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "name prefix for any created local pool", 2024-09-19T08:21:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: "subtree": { 2024-09-19T08:21:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "subtree", 2024-09-19T08:21:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.967 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "rack", 2024-09-19T08:21:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T08:21:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T08:21:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.968 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mds_autoscaler", 2024-09-19T08:21:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.969 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:25.970 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:25.971 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.972 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.973 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mirroring", 2024-09-19T08:21:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:25.974 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.975 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.976 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.977 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.977 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.977 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.977 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.977 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.977 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:25.977 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:25.977 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.977 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.977 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.977 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:25.977 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.977 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.978 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.978 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.978 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.978 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.978 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.978 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.978 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.978 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.978 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.978 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.978 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.978 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.978 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:25.979 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:25.979 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.979 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.979 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.979 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.979 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.979 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.979 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.979 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.979 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.979 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.979 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.980 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.980 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.980 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.980 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:25.980 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "nfs", 2024-09-19T08:21:25.980 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:25.980 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:25.980 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:25.980 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:25.980 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:25.980 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.980 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.980 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.981 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.982 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.982 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:25.982 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:25.982 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.982 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.982 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.982 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.982 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.982 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.982 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.982 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.982 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.983 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.984 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.984 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.984 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.984 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.984 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.984 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.984 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.984 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.984 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.984 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:25.984 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:25.984 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "orchestrator", 2024-09-19T08:21:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: "fail_fs": { 2024-09-19T08:21:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "fail_fs", 2024-09-19T08:21:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.986 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T08:21:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.987 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.990 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "orchestrator": { 2024-09-19T08:21:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "orchestrator", 2024-09-19T08:21:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "cephadm", 2024-09-19T08:21:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "rook", 2024-09-19T08:21:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "test_orchestrator" 2024-09-19T08:21:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Orchestrator backend", 2024-09-19T08:21:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "osd_perf_query", 2024-09-19T08:21:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:25.997 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:25.998 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:25.999 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "osd_support", 2024-09-19T08:21:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.000 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.001 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.002 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.003 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.004 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pg_autoscaler", 2024-09-19T08:21:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.005 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.006 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.007 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.008 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-19T08:21:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-19T08:21:26.010 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-19T08:21:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: "threshold": { 2024-09-19T08:21:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "threshold", 2024-09-19T08:21:26.011 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "3.0", 2024-09-19T08:21:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1.0", 2024-09-19T08:21:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "scaling threshold", 2024-09-19T08:21:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T08:21:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.012 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "progress", 2024-09-19T08:21:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: "allow_pg_recovery_event": { 2024-09-19T08:21:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "allow_pg_recovery_event", 2024-09-19T08:21:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.013 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T08:21:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: "enabled": { 2024-09-19T08:21:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enabled", 2024-09-19T08:21:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.014 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.015 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.016 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.017 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.017 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.017 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.017 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.017 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.017 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.017 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.017 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.017 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.017 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.017 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.019 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "max_completed_events": { 2024-09-19T08:21:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_completed_events", 2024-09-19T08:21:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "50", 2024-09-19T08:21:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.020 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "number of past completed events to remember", 2024-09-19T08:21:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-19T08:21:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-19T08:21:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-19T08:21:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.021 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how long the module is going to sleep", 2024-09-19T08:21:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "prometheus", 2024-09-19T08:21:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.022 INFO:teuthology.orchestra.run.smithi027.stdout: "cache": { 2024-09-19T08:21:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cache", 2024-09-19T08:21:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.023 INFO:teuthology.orchestra.run.smithi027.stdout: "exclude_perf_counters": { 2024-09-19T08:21:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "exclude_perf_counters", 2024-09-19T08:21:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T08:21:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T08:21:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.024 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.025 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.026 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.027 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.028 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.029 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_stats_pools": { 2024-09-19T08:21:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rbd_stats_pools", 2024-09-19T08:21:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.030 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T08:21:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T08:21:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "300", 2024-09-19T08:21:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.031 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "scrape_interval": { 2024-09-19T08:21:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "scrape_interval", 2024-09-19T08:21:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "15.0", 2024-09-19T08:21:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.032 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: "server_addr": { 2024-09-19T08:21:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_addr", 2024-09-19T08:21:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "::", 2024-09-19T08:21:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.033 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T08:21:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "server_port": { 2024-09-19T08:21:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_port", 2024-09-19T08:21:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "9283", 2024-09-19T08:21:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T08:21:26.034 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.035 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.035 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.035 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.035 INFO:teuthology.orchestra.run.smithi027.stdout: "stale_cache_strategy": { 2024-09-19T08:21:26.035 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "stale_cache_strategy", 2024-09-19T08:21:26.035 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.035 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.035 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.035 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "log", 2024-09-19T08:21:26.035 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.035 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.035 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.035 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.035 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.036 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.036 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.036 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.036 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_behaviour": { 2024-09-19T08:21:26.036 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_behaviour", 2024-09-19T08:21:26.036 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.036 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.036 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.036 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "default", 2024-09-19T08:21:26.036 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.036 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.036 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.036 INFO:teuthology.orchestra.run.smithi027.stdout: "default", 2024-09-19T08:21:26.036 INFO:teuthology.orchestra.run.smithi027.stdout: "error" 2024-09-19T08:21:26.037 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.037 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.037 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.037 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.037 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.037 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.037 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_error_status_code": { 2024-09-19T08:21:26.037 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_error_status_code", 2024-09-19T08:21:26.037 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.037 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.037 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.037 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "500", 2024-09-19T08:21:26.037 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "400", 2024-09-19T08:21:26.037 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "599", 2024-09-19T08:21:26.038 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.038 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.038 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.038 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.038 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.038 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.038 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.038 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.038 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.038 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rbd_support", 2024-09-19T08:21:26.038 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.038 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.038 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.038 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.038 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.039 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.039 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.039 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.039 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.039 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.039 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.039 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.039 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.039 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.039 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.039 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.039 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.039 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.039 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.039 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.040 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.040 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.040 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.040 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.040 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.040 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.040 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.040 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.040 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.040 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.040 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.040 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.040 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.040 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.040 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.041 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.041 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.041 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.041 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.041 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.041 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.041 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.041 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.041 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.041 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.041 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.041 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.041 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.041 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.042 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.042 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.042 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.042 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.042 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.042 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.042 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.042 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.042 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.042 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.042 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.042 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.042 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.042 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.043 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.043 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.043 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.043 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.043 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.043 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.043 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.043 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.043 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.043 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.043 INFO:teuthology.orchestra.run.smithi027.stdout: "max_concurrent_snap_create": { 2024-09-19T08:21:26.043 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_concurrent_snap_create", 2024-09-19T08:21:26.043 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.043 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.044 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.044 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:26.044 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.044 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.044 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.044 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.044 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.044 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.044 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.044 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.044 INFO:teuthology.orchestra.run.smithi027.stdout: "mirror_snapshot_schedule": { 2024-09-19T08:21:26.044 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T08:21:26.044 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.044 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.045 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.045 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.045 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.045 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.045 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.045 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.045 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.045 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.045 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.045 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.045 INFO:teuthology.orchestra.run.smithi027.stdout: "trash_purge_schedule": { 2024-09-19T08:21:26.045 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "trash_purge_schedule", 2024-09-19T08:21:26.045 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.046 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.046 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.046 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.046 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.046 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.046 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.046 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.046 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.046 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.046 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.046 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.046 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.046 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.046 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.046 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "restful", 2024-09-19T08:21:26.047 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.047 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.047 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.047 INFO:teuthology.orchestra.run.smithi027.stdout: "enable_auth": { 2024-09-19T08:21:26.047 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enable_auth", 2024-09-19T08:21:26.047 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.047 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.047 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.047 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.047 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.047 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.047 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.047 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.048 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.048 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.048 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.048 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.048 INFO:teuthology.orchestra.run.smithi027.stdout: "key_file": { 2024-09-19T08:21:26.048 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "key_file", 2024-09-19T08:21:26.048 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.048 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.048 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.048 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.048 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.048 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.048 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.049 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.049 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.049 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.049 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.049 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.049 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.049 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.049 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.049 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.049 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.050 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.050 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.050 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.050 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.050 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.050 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.050 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.050 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.050 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.050 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.050 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.050 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.050 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.051 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.051 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.051 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.051 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.051 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.051 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.051 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.051 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.051 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.051 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.051 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.051 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.051 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.051 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.052 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.052 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.052 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.052 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.052 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.052 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.052 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.052 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.052 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.052 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.052 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.052 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.052 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.052 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.052 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.053 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.053 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.053 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.053 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.053 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.053 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.053 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.053 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.053 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.053 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.053 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.053 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.053 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.053 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.054 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.054 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.054 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.054 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.054 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.054 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.054 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.054 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.054 INFO:teuthology.orchestra.run.smithi027.stdout: "server_addr": { 2024-09-19T08:21:26.054 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_addr", 2024-09-19T08:21:26.054 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.054 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.054 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.055 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.055 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.055 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.055 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.055 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.055 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.055 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.055 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.055 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.055 INFO:teuthology.orchestra.run.smithi027.stdout: "server_port": { 2024-09-19T08:21:26.055 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_port", 2024-09-19T08:21:26.055 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.055 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.055 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.056 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.056 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.056 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.056 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.056 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.056 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.056 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.056 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.056 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.056 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.056 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.056 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.056 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rgw", 2024-09-19T08:21:26.056 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.057 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.057 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.057 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.057 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.057 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.057 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.057 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.057 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.057 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.057 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.057 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.057 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.057 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.057 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.057 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.058 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.058 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.058 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.058 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.058 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.058 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.058 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.058 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.058 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.058 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.058 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.058 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.059 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.059 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.059 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.059 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.059 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.059 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.059 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.059 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.059 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.059 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.059 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.059 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.059 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.059 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.060 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.060 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.060 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.060 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.060 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.060 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.060 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.060 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.060 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.060 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.060 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.060 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.061 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.061 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.061 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.061 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.061 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.061 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.061 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.061 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.061 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.061 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.061 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.061 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.061 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.062 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.062 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.062 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.062 INFO:teuthology.orchestra.run.smithi027.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T08:21:26.062 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T08:21:26.062 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.062 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.062 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.062 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-19T08:21:26.062 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.062 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.062 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.062 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T08:21:26.063 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.063 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.063 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.063 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.063 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.063 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.063 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rook", 2024-09-19T08:21:26.063 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.063 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.063 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.063 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.063 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.063 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.064 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.064 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.064 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.064 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.064 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.064 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.064 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.064 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.064 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.064 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.064 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.064 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.064 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.065 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.065 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.065 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.065 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.065 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.065 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.065 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.065 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.065 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.065 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.065 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.065 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.066 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.066 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.066 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.066 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.066 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.066 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.066 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.066 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.066 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.066 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.066 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.066 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.066 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.066 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.067 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.067 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.067 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.067 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.067 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.067 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.067 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.067 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.067 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.067 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.067 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.067 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.067 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.067 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.068 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.068 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.068 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.068 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.068 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.068 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.068 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.068 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.068 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.068 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.068 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.068 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.068 INFO:teuthology.orchestra.run.smithi027.stdout: "storage_class": { 2024-09-19T08:21:26.069 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "storage_class", 2024-09-19T08:21:26.069 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.069 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.069 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.069 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "local", 2024-09-19T08:21:26.069 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.069 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.069 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.069 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T08:21:26.069 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.069 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.069 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.069 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.069 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.070 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.070 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "selftest", 2024-09-19T08:21:26.070 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.070 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.070 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.070 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.070 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.070 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.070 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.070 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.070 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.070 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.070 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.070 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.071 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.071 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.071 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.071 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.071 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.071 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.071 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.071 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.071 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.071 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.071 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.071 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.071 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.072 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.072 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.072 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.072 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.072 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.072 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.072 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.072 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.072 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.072 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.072 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.072 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.072 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.073 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.073 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.073 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.073 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.073 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.073 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.073 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.073 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.073 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.073 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.073 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.073 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.073 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.074 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.074 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.074 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.074 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.074 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.074 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.074 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.074 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.074 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.074 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.074 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.074 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.074 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.075 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.075 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.075 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.075 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.075 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.075 INFO:teuthology.orchestra.run.smithi027.stdout: "roption1": { 2024-09-19T08:21:26.075 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "roption1", 2024-09-19T08:21:26.075 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.075 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.075 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.075 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.075 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.075 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.076 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.076 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.076 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.076 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.076 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.076 INFO:teuthology.orchestra.run.smithi027.stdout: "roption2": { 2024-09-19T08:21:26.076 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "roption2", 2024-09-19T08:21:26.076 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.076 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.076 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.076 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "xyz", 2024-09-19T08:21:26.076 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.076 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.076 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.077 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.077 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.077 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.077 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.077 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption1": { 2024-09-19T08:21:26.077 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption1", 2024-09-19T08:21:26.077 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.077 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.077 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.077 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.077 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.078 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.078 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.078 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.078 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.078 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.078 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.078 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption2": { 2024-09-19T08:21:26.078 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption2", 2024-09-19T08:21:26.078 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.078 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.078 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.078 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.078 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.079 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.079 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.079 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.079 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.079 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.079 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.079 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.079 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption3": { 2024-09-19T08:21:26.079 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption3", 2024-09-19T08:21:26.079 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:26.079 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.079 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.079 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.079 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.080 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.080 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.080 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.080 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.080 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.080 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.080 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption4": { 2024-09-19T08:21:26.080 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption4", 2024-09-19T08:21:26.080 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.080 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.080 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.080 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.081 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.081 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.081 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.081 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.081 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.081 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.081 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.081 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption5": { 2024-09-19T08:21:26.081 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption5", 2024-09-19T08:21:26.081 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.081 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.081 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.082 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.082 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.082 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.082 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.082 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.082 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.082 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.082 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.082 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.082 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption6": { 2024-09-19T08:21:26.082 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption6", 2024-09-19T08:21:26.082 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.082 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.082 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.083 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.083 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.083 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.083 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.083 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.083 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.083 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.083 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.083 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption7": { 2024-09-19T08:21:26.083 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption7", 2024-09-19T08:21:26.083 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.083 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.084 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.084 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.084 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-19T08:21:26.084 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "42", 2024-09-19T08:21:26.084 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.084 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.084 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.084 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.084 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.084 INFO:teuthology.orchestra.run.smithi027.stdout: "testkey": { 2024-09-19T08:21:26.084 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "testkey", 2024-09-19T08:21:26.084 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.085 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.085 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.085 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.085 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.085 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.085 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.085 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.085 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.085 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.085 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.085 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.085 INFO:teuthology.orchestra.run.smithi027.stdout: "testlkey": { 2024-09-19T08:21:26.085 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "testlkey", 2024-09-19T08:21:26.086 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.086 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.086 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.086 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.086 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.086 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.086 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.086 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.086 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.086 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.086 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.086 INFO:teuthology.orchestra.run.smithi027.stdout: "testnewline": { 2024-09-19T08:21:26.086 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "testnewline", 2024-09-19T08:21:26.087 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.087 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.087 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.087 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.087 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.087 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.087 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.087 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.087 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.087 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.087 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.087 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.087 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.088 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.088 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "snap_schedule", 2024-09-19T08:21:26.088 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.088 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.088 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.088 INFO:teuthology.orchestra.run.smithi027.stdout: "allow_m_granularity": { 2024-09-19T08:21:26.088 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "allow_m_granularity", 2024-09-19T08:21:26.088 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.088 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.088 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.088 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.088 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.089 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.089 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.089 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T08:21:26.089 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.089 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.089 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.089 INFO:teuthology.orchestra.run.smithi027.stdout: "dump_on_update": { 2024-09-19T08:21:26.089 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "dump_on_update", 2024-09-19T08:21:26.089 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.089 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.089 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.089 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.089 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.090 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.090 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.090 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "dump database to debug log on update", 2024-09-19T08:21:26.090 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.090 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.090 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.090 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.090 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.090 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.090 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.090 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.090 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.091 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.091 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.091 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.091 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.091 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.091 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.091 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.091 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.091 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.091 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.091 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.091 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.091 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.091 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.092 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.092 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.092 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.092 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.092 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.092 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.092 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.092 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.092 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.092 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.092 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.092 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.093 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.093 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.093 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.093 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.093 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.093 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.093 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.093 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.093 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.093 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.093 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.093 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.094 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.094 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.094 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.094 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.094 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.094 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.094 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.094 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.094 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.094 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.094 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.094 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.094 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.095 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.095 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.095 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.095 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.095 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.095 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.095 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.095 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.095 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.095 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.095 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.096 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "stats", 2024-09-19T08:21:26.096 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.096 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.096 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.096 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.096 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.096 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.096 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.096 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.096 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.096 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.096 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.096 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.097 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.097 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.097 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.097 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.097 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.097 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.097 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.097 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.097 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.097 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.097 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.098 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.098 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.098 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.098 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.098 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.098 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.098 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.098 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.098 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.098 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.098 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.098 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.098 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.099 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.099 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.099 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.099 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.099 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.099 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.099 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.099 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.099 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.099 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.099 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.099 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.100 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.100 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.100 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.100 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.100 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.100 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.100 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.100 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.100 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.100 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.100 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.100 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.101 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.101 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.101 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.101 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.101 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.101 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.101 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.101 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.101 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.101 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.101 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.101 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "status", 2024-09-19T08:21:26.102 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.102 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.102 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.102 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.102 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.102 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.102 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.102 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.102 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.102 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.102 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.102 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.102 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.102 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.103 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.103 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.103 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.103 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.103 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.103 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.103 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.103 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.103 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.103 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.103 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.103 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.103 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.104 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.104 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.104 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.104 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.104 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.104 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.104 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.104 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.104 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.104 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.104 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.104 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.105 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.105 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.105 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.105 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.105 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.105 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.105 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.105 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.105 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.105 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.105 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.105 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.105 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.106 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.106 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.106 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.106 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.106 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.106 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.106 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.106 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.106 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.106 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.106 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.106 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.107 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.107 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.107 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.107 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.107 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.107 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.107 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.107 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "telegraf", 2024-09-19T08:21:26.107 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.107 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.108 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.108 INFO:teuthology.orchestra.run.smithi027.stdout: "address": { 2024-09-19T08:21:26.108 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "address", 2024-09-19T08:21:26.108 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.108 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.108 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.108 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T08:21:26.108 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.108 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.108 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.108 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.108 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.108 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.109 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.109 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-19T08:21:26.109 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-19T08:21:26.109 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.109 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.109 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.109 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "15", 2024-09-19T08:21:26.109 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.109 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.109 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.109 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.109 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.110 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.110 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.110 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.110 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.110 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.110 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.110 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.110 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.110 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.110 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.110 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.110 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.110 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.111 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.111 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.111 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.111 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.111 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.111 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.111 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.111 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.111 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.111 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.111 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.111 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.112 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.112 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.112 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.112 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.112 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.112 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.112 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.112 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.112 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.112 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.112 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.112 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.112 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.113 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.113 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.113 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.113 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.113 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.113 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.113 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.113 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.113 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.113 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.113 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.113 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.113 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.113 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.114 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.114 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.114 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.114 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.114 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.114 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.114 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.114 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.114 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.114 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.114 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.114 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.114 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.114 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.115 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.115 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.115 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.115 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.115 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "telemetry", 2024-09-19T08:21:26.115 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.115 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.115 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.115 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_basic": { 2024-09-19T08:21:26.115 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_basic", 2024-09-19T08:21:26.115 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.115 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.116 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.116 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.116 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.116 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.116 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.116 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T08:21:26.116 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.116 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.116 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.116 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_crash": { 2024-09-19T08:21:26.116 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_crash", 2024-09-19T08:21:26.116 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.116 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.116 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.117 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.117 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.117 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.117 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.117 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T08:21:26.117 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.117 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.117 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.117 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_device": { 2024-09-19T08:21:26.117 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_device", 2024-09-19T08:21:26.117 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.117 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.117 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.118 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.118 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.118 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.118 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.118 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T08:21:26.118 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.118 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.118 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.118 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_ident": { 2024-09-19T08:21:26.118 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_ident", 2024-09-19T08:21:26.118 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.118 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.118 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.119 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.119 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.119 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.119 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.119 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T08:21:26.119 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.119 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.119 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.119 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_perf": { 2024-09-19T08:21:26.119 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_perf", 2024-09-19T08:21:26.119 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.119 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.119 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.119 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.120 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.120 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.120 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.120 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T08:21:26.120 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.120 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.120 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.120 INFO:teuthology.orchestra.run.smithi027.stdout: "contact": { 2024-09-19T08:21:26.120 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "contact", 2024-09-19T08:21:26.120 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.120 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.121 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.121 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.121 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.121 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.121 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.121 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.121 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.121 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.121 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.121 INFO:teuthology.orchestra.run.smithi027.stdout: "description": { 2024-09-19T08:21:26.121 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "description", 2024-09-19T08:21:26.122 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.122 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.122 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.122 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.122 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.122 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.122 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.122 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.122 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.122 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.122 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.122 INFO:teuthology.orchestra.run.smithi027.stdout: "device_url": { 2024-09-19T08:21:26.122 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "device_url", 2024-09-19T08:21:26.123 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.123 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.123 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.123 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T08:21:26.123 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.123 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.123 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.123 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.123 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.123 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.123 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.123 INFO:teuthology.orchestra.run.smithi027.stdout: "enabled": { 2024-09-19T08:21:26.124 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enabled", 2024-09-19T08:21:26.124 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.124 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.124 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.124 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.124 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.124 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.124 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.124 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.124 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.124 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.124 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.124 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-19T08:21:26.125 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-19T08:21:26.125 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.125 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.125 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.125 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "24", 2024-09-19T08:21:26.125 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "8", 2024-09-19T08:21:26.125 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.125 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.125 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.125 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.125 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.125 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.126 INFO:teuthology.orchestra.run.smithi027.stdout: "last_opt_revision": { 2024-09-19T08:21:26.126 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "last_opt_revision", 2024-09-19T08:21:26.126 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.126 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.126 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.126 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "1", 2024-09-19T08:21:26.126 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.126 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.126 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.126 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.126 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.126 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.126 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.127 INFO:teuthology.orchestra.run.smithi027.stdout: "leaderboard": { 2024-09-19T08:21:26.127 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "leaderboard", 2024-09-19T08:21:26.127 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.127 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.127 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.127 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.127 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.127 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.127 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.127 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.127 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.127 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.127 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.128 INFO:teuthology.orchestra.run.smithi027.stdout: "leaderboard_description": { 2024-09-19T08:21:26.128 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "leaderboard_description", 2024-09-19T08:21:26.128 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.128 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.128 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.128 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.128 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.128 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.128 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.128 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.128 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.128 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.129 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.129 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.129 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.129 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.129 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.129 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.129 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.129 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.129 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.129 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.129 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.129 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.130 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.130 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.130 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.130 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.130 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.130 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.130 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.130 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.130 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.130 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.130 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.130 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.130 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.131 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.131 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.131 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.131 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.131 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.131 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.131 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.131 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.131 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.131 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.131 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.131 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.131 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.132 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.132 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.132 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.132 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.132 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.132 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.132 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.132 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.132 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.132 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.132 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.132 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.132 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.133 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.133 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.133 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.133 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.133 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.133 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.133 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.133 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.133 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.133 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.133 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.133 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.134 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.134 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.134 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.134 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.134 INFO:teuthology.orchestra.run.smithi027.stdout: "organization": { 2024-09-19T08:21:26.134 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "organization", 2024-09-19T08:21:26.134 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.134 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.134 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.134 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.134 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.134 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.134 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.134 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.135 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.135 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.135 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.135 INFO:teuthology.orchestra.run.smithi027.stdout: "proxy": { 2024-09-19T08:21:26.135 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "proxy", 2024-09-19T08:21:26.135 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.135 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.135 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.135 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.135 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.135 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.135 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.136 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.136 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.136 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.136 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.136 INFO:teuthology.orchestra.run.smithi027.stdout: "url": { 2024-09-19T08:21:26.136 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "url", 2024-09-19T08:21:26.136 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.136 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.136 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.136 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T08:21:26.136 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.136 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.136 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.137 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.137 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.137 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.137 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.137 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.137 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.137 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "test_orchestrator", 2024-09-19T08:21:26.137 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.137 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.137 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.137 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.137 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.138 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.138 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.138 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.138 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.138 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.138 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.138 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.138 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.138 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.138 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.138 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.138 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.138 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.139 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.139 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.139 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.139 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.139 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.139 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.139 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.139 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.139 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.139 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.139 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.139 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.139 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.139 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.140 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.140 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.140 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.140 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.140 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.140 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.140 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.140 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.140 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.140 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.140 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.141 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.141 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.141 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.141 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.141 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.141 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.141 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.141 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.141 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.141 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.141 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.141 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.141 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.142 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.142 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.142 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.142 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.142 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.142 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.142 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.142 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.142 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.142 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.142 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.142 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.142 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.142 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.143 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.143 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.143 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "volumes", 2024-09-19T08:21:26.143 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.143 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.143 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.143 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.143 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.143 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.143 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.143 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.143 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.143 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.144 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.144 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.144 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.144 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.144 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.144 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.144 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.144 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.144 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.144 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.144 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.144 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.144 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.145 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.145 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.145 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.145 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.145 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.145 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.145 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.145 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.145 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.145 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.145 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.145 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.145 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.146 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.146 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.146 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.146 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.146 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.146 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.146 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.146 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.146 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.146 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.146 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.146 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.146 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.146 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.147 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.147 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.147 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.147 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.147 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.147 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.147 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.147 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.147 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.147 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.147 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.147 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.147 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.148 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.148 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.148 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.148 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.148 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.148 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.148 INFO:teuthology.orchestra.run.smithi027.stdout: "max_concurrent_clones": { 2024-09-19T08:21:26.148 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_concurrent_clones", 2024-09-19T08:21:26.148 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.148 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.148 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.148 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "4", 2024-09-19T08:21:26.148 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.149 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.149 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.149 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T08:21:26.149 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.149 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.149 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.149 INFO:teuthology.orchestra.run.smithi027.stdout: "periodic_async_work": { 2024-09-19T08:21:26.149 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "periodic_async_work", 2024-09-19T08:21:26.149 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.149 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.149 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.150 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.150 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.150 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.150 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.150 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Periodically check for async work", 2024-09-19T08:21:26.150 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.150 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.150 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.150 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot_clone_delay": { 2024-09-19T08:21:26.150 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "snapshot_clone_delay", 2024-09-19T08:21:26.150 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.150 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.151 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.151 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-19T08:21:26.151 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.151 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.151 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.151 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T08:21:26.151 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.151 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.151 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.151 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.151 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot_clone_no_wait": { 2024-09-19T08:21:26.151 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T08:21:26.151 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.151 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.152 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.152 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.152 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.152 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.152 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.152 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T08:21:26.152 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.152 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.152 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.152 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.152 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.152 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.152 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.153 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix", 2024-09-19T08:21:26.153 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.153 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.153 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.153 INFO:teuthology.orchestra.run.smithi027.stdout: "discovery_interval": { 2024-09-19T08:21:26.153 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "discovery_interval", 2024-09-19T08:21:26.153 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-19T08:21:26.153 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.153 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.153 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "100", 2024-09-19T08:21:26.153 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.153 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.153 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.153 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.154 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.154 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.154 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.154 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.154 INFO:teuthology.orchestra.run.smithi027.stdout: "identifier": { 2024-09-19T08:21:26.154 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "identifier", 2024-09-19T08:21:26.154 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.154 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.154 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.154 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.154 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.154 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.154 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.154 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.155 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.155 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.155 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.155 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.155 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-19T08:21:26.155 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-19T08:21:26.155 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.155 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.155 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.155 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-19T08:21:26.155 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.155 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.155 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.155 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.156 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.156 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.156 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.156 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.156 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.156 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.156 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.156 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.156 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.156 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.156 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.156 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.156 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.156 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.157 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.157 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.157 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.157 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.157 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.157 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.157 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.157 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.157 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.157 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.157 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.157 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.157 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.158 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.158 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.158 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.158 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.158 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.158 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.158 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.158 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.158 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.158 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.158 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.158 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.158 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.159 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.159 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.159 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.159 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.159 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.159 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.159 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.159 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.159 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.159 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.159 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.159 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.159 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.160 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.160 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.160 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.160 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.160 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.160 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.160 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.160 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.160 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.160 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.160 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.160 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.161 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.161 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.161 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.161 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.161 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.161 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.161 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.161 INFO:teuthology.orchestra.run.smithi027.stdout: "zabbix_host": { 2024-09-19T08:21:26.161 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix_host", 2024-09-19T08:21:26.161 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.161 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.161 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.161 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.162 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.162 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.162 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.162 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.162 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.162 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.162 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.162 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.162 INFO:teuthology.orchestra.run.smithi027.stdout: "zabbix_port": { 2024-09-19T08:21:26.162 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix_port", 2024-09-19T08:21:26.162 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.162 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.162 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.162 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10051", 2024-09-19T08:21:26.162 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.163 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.163 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.163 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.163 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.163 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.163 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.163 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.163 INFO:teuthology.orchestra.run.smithi027.stdout: "zabbix_sender": { 2024-09-19T08:21:26.163 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix_sender", 2024-09-19T08:21:26.163 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.163 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.163 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.163 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T08:21:26.163 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.164 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.164 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.164 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.164 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.164 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.164 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.164 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.164 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.164 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.164 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-19T08:21:26.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.164 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.164 INFO:teuthology.orchestra.run.smithi027.stdout: "gid": 24775, 2024-09-19T08:21:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "z", 2024-09-19T08:21:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr_features": 4540701547738038271, 2024-09-19T08:21:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: "available_modules": [ 2024-09-19T08:21:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "alerts", 2024-09-19T08:21:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-19T08:21:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-19T08:21:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-19T08:21:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T08:21:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.168 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.168 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.168 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.168 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.168 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.168 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.168 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.168 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.168 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.168 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.168 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.168 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.169 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.169 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.169 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.169 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.169 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.169 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.169 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.169 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.169 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.169 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.169 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.169 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.169 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.170 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.170 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.170 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.170 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.170 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.170 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.170 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.170 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.170 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.170 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.170 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.170 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.172 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.172 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_destination": { 2024-09-19T08:21:26.172 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_destination", 2024-09-19T08:21:26.172 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.172 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.172 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.172 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.172 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.172 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.172 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.172 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Email address to send alerts to", 2024-09-19T08:21:26.172 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.172 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.173 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.173 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.173 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_from_name": { 2024-09-19T08:21:26.173 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_from_name", 2024-09-19T08:21:26.173 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.173 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.173 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.173 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "Ceph", 2024-09-19T08:21:26.173 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.173 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.173 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.173 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Email From: name", 2024-09-19T08:21:26.173 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.173 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.174 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.174 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.174 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_host": { 2024-09-19T08:21:26.174 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_host", 2024-09-19T08:21:26.174 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.174 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.174 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.174 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.174 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.174 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.174 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.174 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SMTP server", 2024-09-19T08:21:26.174 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.174 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.175 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.175 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_password": { 2024-09-19T08:21:26.175 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_password", 2024-09-19T08:21:26.175 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.175 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.175 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.175 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.175 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.175 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.175 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.175 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Password to authenticate with", 2024-09-19T08:21:26.175 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.175 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.176 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.176 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.176 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_port": { 2024-09-19T08:21:26.176 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_port", 2024-09-19T08:21:26.176 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.176 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.176 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.176 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "465", 2024-09-19T08:21:26.176 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.176 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.176 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.176 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SMTP port", 2024-09-19T08:21:26.176 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.177 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.177 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.177 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.177 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_sender": { 2024-09-19T08:21:26.177 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_sender", 2024-09-19T08:21:26.177 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.177 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.177 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.177 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.177 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.177 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.177 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.177 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SMTP envelope sender", 2024-09-19T08:21:26.178 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.178 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.178 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.178 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_ssl": { 2024-09-19T08:21:26.178 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_ssl", 2024-09-19T08:21:26.178 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.178 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.178 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.178 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.178 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.178 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.178 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.178 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T08:21:26.179 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.179 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.179 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.179 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_user": { 2024-09-19T08:21:26.179 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_user", 2024-09-19T08:21:26.179 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.179 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.179 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.179 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.179 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.179 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.179 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.179 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "User to authenticate as", 2024-09-19T08:21:26.180 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.180 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.180 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.180 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.180 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.180 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.180 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.180 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "balancer", 2024-09-19T08:21:26.180 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.180 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.180 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.180 INFO:teuthology.orchestra.run.smithi027.stdout: "active": { 2024-09-19T08:21:26.180 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "active", 2024-09-19T08:21:26.181 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.181 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.181 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.181 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.181 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.181 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.181 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.181 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T08:21:26.181 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.181 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.181 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.181 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.181 INFO:teuthology.orchestra.run.smithi027.stdout: "begin_time": { 2024-09-19T08:21:26.181 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "begin_time", 2024-09-19T08:21:26.182 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.182 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.182 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.182 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0000", 2024-09-19T08:21:26.182 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.182 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.182 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.182 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T08:21:26.182 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:21:26.182 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.182 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.182 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.182 INFO:teuthology.orchestra.run.smithi027.stdout: "begin_weekday": { 2024-09-19T08:21:26.183 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "begin_weekday", 2024-09-19T08:21:26.183 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-19T08:21:26.183 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.183 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.183 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-19T08:21:26.183 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "0", 2024-09-19T08:21:26.183 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "6", 2024-09-19T08:21:26.183 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.183 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T08:21:26.183 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:21:26.183 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.183 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.183 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.183 INFO:teuthology.orchestra.run.smithi027.stdout: "crush_compat_max_iterations": { 2024-09-19T08:21:26.184 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crush_compat_max_iterations", 2024-09-19T08:21:26.184 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-19T08:21:26.184 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.184 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.184 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "25", 2024-09-19T08:21:26.184 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-19T08:21:26.184 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "250", 2024-09-19T08:21:26.184 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.184 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T08:21:26.184 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.184 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.184 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.184 INFO:teuthology.orchestra.run.smithi027.stdout: "crush_compat_metrics": { 2024-09-19T08:21:26.184 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crush_compat_metrics", 2024-09-19T08:21:26.185 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.185 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.185 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.185 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T08:21:26.185 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.185 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.185 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.185 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T08:21:26.185 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T08:21:26.185 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.185 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.185 INFO:teuthology.orchestra.run.smithi027.stdout: "crush_compat_step": { 2024-09-19T08:21:26.186 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crush_compat_step", 2024-09-19T08:21:26.186 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:26.186 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.186 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.186 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0.5", 2024-09-19T08:21:26.186 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "0.001", 2024-09-19T08:21:26.186 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "0.999", 2024-09-19T08:21:26.186 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.186 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "aggressiveness of optimization", 2024-09-19T08:21:26.186 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T08:21:26.186 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.186 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.186 INFO:teuthology.orchestra.run.smithi027.stdout: "end_time": { 2024-09-19T08:21:26.186 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "end_time", 2024-09-19T08:21:26.186 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.187 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.187 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.187 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "2359", 2024-09-19T08:21:26.187 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.187 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.187 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.187 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T08:21:26.187 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:21:26.187 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.187 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.187 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.187 INFO:teuthology.orchestra.run.smithi027.stdout: "end_weekday": { 2024-09-19T08:21:26.187 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "end_weekday", 2024-09-19T08:21:26.188 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-19T08:21:26.188 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.188 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.188 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-19T08:21:26.188 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "0", 2024-09-19T08:21:26.188 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "6", 2024-09-19T08:21:26.188 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.188 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T08:21:26.188 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:21:26.188 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.188 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.188 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.188 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.191 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.191 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.191 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.191 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.191 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.191 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.191 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.191 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.191 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.191 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.191 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.191 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.191 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.192 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.192 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.192 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.192 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.192 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.192 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.192 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.192 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.192 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.192 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.192 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.192 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.192 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.192 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.192 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.193 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.193 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.193 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.193 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.193 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.193 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.193 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.193 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.193 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.193 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.193 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.193 INFO:teuthology.orchestra.run.smithi027.stdout: "min_score": { 2024-09-19T08:21:26.193 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "min_score", 2024-09-19T08:21:26.193 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:26.194 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.194 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.194 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-19T08:21:26.194 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.194 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.194 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.194 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T08:21:26.194 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.194 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.194 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.194 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.194 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": { 2024-09-19T08:21:26.194 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mode", 2024-09-19T08:21:26.195 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.195 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.195 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.195 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "upmap", 2024-09-19T08:21:26.195 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.195 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.195 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.195 INFO:teuthology.orchestra.run.smithi027.stdout: "crush-compat", 2024-09-19T08:21:26.195 INFO:teuthology.orchestra.run.smithi027.stdout: "none", 2024-09-19T08:21:26.195 INFO:teuthology.orchestra.run.smithi027.stdout: "read", 2024-09-19T08:21:26.195 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap", 2024-09-19T08:21:26.195 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap-read" 2024-09-19T08:21:26.195 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.195 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Balancer mode", 2024-09-19T08:21:26.195 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.196 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.196 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.196 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.196 INFO:teuthology.orchestra.run.smithi027.stdout: "pool_ids": { 2024-09-19T08:21:26.196 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pool_ids", 2024-09-19T08:21:26.196 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.196 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.196 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.196 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.196 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.196 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.196 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.196 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T08:21:26.196 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.197 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.197 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.197 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.197 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-19T08:21:26.197 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-19T08:21:26.197 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.197 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.197 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.197 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-19T08:21:26.197 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.197 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.197 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.197 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T08:21:26.197 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.197 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.198 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.198 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.198 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap_max_deviation": { 2024-09-19T08:21:26.198 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "upmap_max_deviation", 2024-09-19T08:21:26.198 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.198 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.198 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.198 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-19T08:21:26.198 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-19T08:21:26.198 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.198 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.198 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T08:21:26.198 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T08:21:26.199 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.199 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.199 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.199 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap_max_optimizations": { 2024-09-19T08:21:26.199 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "upmap_max_optimizations", 2024-09-19T08:21:26.199 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-19T08:21:26.199 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.199 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.199 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:26.199 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.199 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.199 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.199 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T08:21:26.199 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.200 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.200 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.200 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.200 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.200 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.200 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.200 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cephadm", 2024-09-19T08:21:26.200 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.200 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.200 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.200 INFO:teuthology.orchestra.run.smithi027.stdout: "agent_down_multiplier": { 2024-09-19T08:21:26.200 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "agent_down_multiplier", 2024-09-19T08:21:26.200 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:26.201 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.201 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.201 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "3.0", 2024-09-19T08:21:26.201 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.201 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.201 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.201 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T08:21:26.201 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.201 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.201 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.201 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.201 INFO:teuthology.orchestra.run.smithi027.stdout: "agent_refresh_rate": { 2024-09-19T08:21:26.201 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "agent_refresh_rate", 2024-09-19T08:21:26.201 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.202 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.202 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.202 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "20", 2024-09-19T08:21:26.202 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.202 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.202 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.202 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T08:21:26.202 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.202 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.202 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.204 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.204 INFO:teuthology.orchestra.run.smithi027.stdout: "agent_starting_port": { 2024-09-19T08:21:26.204 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "agent_starting_port", 2024-09-19T08:21:26.204 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.204 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.204 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.204 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "4721", 2024-09-19T08:21:26.204 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.204 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.204 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.205 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T08:21:26.205 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.205 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.205 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.205 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.205 INFO:teuthology.orchestra.run.smithi027.stdout: "allow_ptrace": { 2024-09-19T08:21:26.205 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "allow_ptrace", 2024-09-19T08:21:26.205 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.205 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.205 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.205 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.205 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.205 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.206 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.206 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T08:21:26.206 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T08:21:26.206 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.206 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.206 INFO:teuthology.orchestra.run.smithi027.stdout: "autotune_interval": { 2024-09-19T08:21:26.206 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "autotune_interval", 2024-09-19T08:21:26.206 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.206 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.206 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.206 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-19T08:21:26.206 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.206 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.207 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.207 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T08:21:26.207 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.207 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.207 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.207 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.207 INFO:teuthology.orchestra.run.smithi027.stdout: "autotune_memory_target_ratio": { 2024-09-19T08:21:26.207 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T08:21:26.207 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:26.207 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.207 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.207 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0.7", 2024-09-19T08:21:26.207 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.208 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.208 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.208 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T08:21:26.208 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.208 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.208 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.208 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.208 INFO:teuthology.orchestra.run.smithi027.stdout: "cephadm_log_destination": { 2024-09-19T08:21:26.208 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cephadm_log_destination", 2024-09-19T08:21:26.208 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.208 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.208 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.208 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.209 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.209 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.209 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.209 INFO:teuthology.orchestra.run.smithi027.stdout: "file", 2024-09-19T08:21:26.209 INFO:teuthology.orchestra.run.smithi027.stdout: "file,syslog", 2024-09-19T08:21:26.209 INFO:teuthology.orchestra.run.smithi027.stdout: "syslog" 2024-09-19T08:21:26.209 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.209 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T08:21:26.209 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.209 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.209 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.209 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.209 INFO:teuthology.orchestra.run.smithi027.stdout: "cgroups_split": { 2024-09-19T08:21:26.209 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cgroups_split", 2024-09-19T08:21:26.210 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.210 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.210 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.210 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.210 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.210 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.210 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.210 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T08:21:26.210 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.210 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.210 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.210 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.210 INFO:teuthology.orchestra.run.smithi027.stdout: "config_checks_enabled": { 2024-09-19T08:21:26.210 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "config_checks_enabled", 2024-09-19T08:21:26.211 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.211 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.211 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.211 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.211 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.211 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.211 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.211 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T08:21:26.211 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.211 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.211 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.211 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.211 INFO:teuthology.orchestra.run.smithi027.stdout: "config_dashboard": { 2024-09-19T08:21:26.212 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "config_dashboard", 2024-09-19T08:21:26.212 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.212 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.212 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.212 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.212 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.212 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.212 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.212 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T08:21:26.212 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.212 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.212 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.212 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_alertmanager": { 2024-09-19T08:21:26.213 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_alertmanager", 2024-09-19T08:21:26.213 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.213 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.213 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.213 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T08:21:26.213 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.213 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.213 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.213 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-19T08:21:26.213 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.213 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.213 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.213 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.214 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_base": { 2024-09-19T08:21:26.214 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_base", 2024-09-19T08:21:26.214 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.214 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.214 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.214 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T08:21:26.214 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.214 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.214 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.214 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Container image name, without the tag", 2024-09-19T08:21:26.214 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.214 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.214 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.214 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.215 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_elasticsearch": { 2024-09-19T08:21:26.215 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_elasticsearch", 2024-09-19T08:21:26.215 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.215 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.215 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.215 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T08:21:26.215 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.215 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.215 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.215 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "elasticsearch container image", 2024-09-19T08:21:26.215 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.215 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.215 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.215 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.216 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_grafana": { 2024-09-19T08:21:26.216 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_grafana", 2024-09-19T08:21:26.216 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.216 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.216 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.216 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T08:21:26.216 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.216 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.216 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.216 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-19T08:21:26.216 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.216 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.216 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.217 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.217 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_haproxy": { 2024-09-19T08:21:26.217 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_haproxy", 2024-09-19T08:21:26.217 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.217 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.217 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.217 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T08:21:26.217 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.217 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.217 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.217 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "HAproxy container image", 2024-09-19T08:21:26.217 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.217 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.218 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.218 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.218 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_jaeger_agent": { 2024-09-19T08:21:26.218 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_jaeger_agent", 2024-09-19T08:21:26.218 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.218 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.218 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.218 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T08:21:26.218 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.218 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.218 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.218 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Jaeger agent container image", 2024-09-19T08:21:26.218 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.219 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.219 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.219 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.219 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_jaeger_collector": { 2024-09-19T08:21:26.219 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_jaeger_collector", 2024-09-19T08:21:26.219 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.219 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.219 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.219 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T08:21:26.219 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.219 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.219 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.219 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Jaeger collector container image", 2024-09-19T08:21:26.219 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.220 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.220 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.220 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.220 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_jaeger_query": { 2024-09-19T08:21:26.220 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_jaeger_query", 2024-09-19T08:21:26.220 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.220 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.220 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.220 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T08:21:26.220 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.220 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.220 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.220 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Jaeger query container image", 2024-09-19T08:21:26.221 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.221 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.221 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.221 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.221 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_keepalived": { 2024-09-19T08:21:26.221 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_keepalived", 2024-09-19T08:21:26.221 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.221 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.221 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.221 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T08:21:26.221 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.221 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.221 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.221 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Keepalived container image", 2024-09-19T08:21:26.222 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.222 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.222 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.222 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.222 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_loki": { 2024-09-19T08:21:26.222 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_loki", 2024-09-19T08:21:26.222 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.222 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.222 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.222 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T08:21:26.222 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.222 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.222 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.223 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Loki container image", 2024-09-19T08:21:26.223 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.223 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.223 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.223 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.223 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_node_exporter": { 2024-09-19T08:21:26.223 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_node_exporter", 2024-09-19T08:21:26.223 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.223 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.223 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.223 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T08:21:26.223 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.223 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.223 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.224 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-19T08:21:26.224 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.224 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.224 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.224 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.224 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_nvmeof": { 2024-09-19T08:21:26.224 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_nvmeof", 2024-09-19T08:21:26.224 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.224 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.224 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.224 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T08:21:26.224 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.224 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.225 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.225 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Nvme-of container image", 2024-09-19T08:21:26.225 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.225 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.225 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.225 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.225 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_prometheus": { 2024-09-19T08:21:26.225 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_prometheus", 2024-09-19T08:21:26.225 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.225 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.225 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.225 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T08:21:26.225 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.225 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.226 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.226 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-19T08:21:26.226 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.226 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.226 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.226 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.226 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_promtail": { 2024-09-19T08:21:26.226 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_promtail", 2024-09-19T08:21:26.226 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.226 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.226 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.226 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T08:21:26.226 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.226 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.227 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.227 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Promtail container image", 2024-09-19T08:21:26.227 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.227 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.227 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.227 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.227 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_samba": { 2024-09-19T08:21:26.227 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_samba", 2024-09-19T08:21:26.227 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.227 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.227 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.227 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T08:21:26.227 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.228 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.228 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.228 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Samba/SMB container image", 2024-09-19T08:21:26.228 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.228 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.228 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.228 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.228 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_snmp_gateway": { 2024-09-19T08:21:26.228 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_snmp_gateway", 2024-09-19T08:21:26.228 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.228 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.228 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.228 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T08:21:26.228 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.229 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.229 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.229 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SNMP Gateway container image", 2024-09-19T08:21:26.229 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.229 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.229 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.229 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.229 INFO:teuthology.orchestra.run.smithi027.stdout: "container_init": { 2024-09-19T08:21:26.229 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_init", 2024-09-19T08:21:26.229 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.229 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.229 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.230 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.230 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.230 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.230 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.230 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T08:21:26.230 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.230 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.230 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.230 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.230 INFO:teuthology.orchestra.run.smithi027.stdout: "daemon_cache_timeout": { 2024-09-19T08:21:26.230 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "daemon_cache_timeout", 2024-09-19T08:21:26.230 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.230 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.230 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.231 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-19T08:21:26.231 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.231 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.231 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.231 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T08:21:26.231 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.231 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.231 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.231 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.231 INFO:teuthology.orchestra.run.smithi027.stdout: "default_cephadm_command_timeout": { 2024-09-19T08:21:26.231 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T08:21:26.231 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.231 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.232 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.232 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "900", 2024-09-19T08:21:26.232 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.232 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.232 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.232 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T08:21:26.232 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.232 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.232 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.232 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.232 INFO:teuthology.orchestra.run.smithi027.stdout: "default_registry": { 2024-09-19T08:21:26.232 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "default_registry", 2024-09-19T08:21:26.232 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.233 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.233 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.233 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io", 2024-09-19T08:21:26.233 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.233 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.233 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.233 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T08:21:26.233 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.233 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.233 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.233 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.233 INFO:teuthology.orchestra.run.smithi027.stdout: "device_cache_timeout": { 2024-09-19T08:21:26.233 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "device_cache_timeout", 2024-09-19T08:21:26.233 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.234 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.234 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.234 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "1800", 2024-09-19T08:21:26.234 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.234 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.234 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.234 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "seconds to cache device inventory", 2024-09-19T08:21:26.234 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.234 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.234 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.234 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.234 INFO:teuthology.orchestra.run.smithi027.stdout: "device_enhanced_scan": { 2024-09-19T08:21:26.234 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "device_enhanced_scan", 2024-09-19T08:21:26.235 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.235 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.235 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.235 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.235 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.235 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.235 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.235 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T08:21:26.235 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.235 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.235 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.235 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.235 INFO:teuthology.orchestra.run.smithi027.stdout: "facts_cache_timeout": { 2024-09-19T08:21:26.236 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "facts_cache_timeout", 2024-09-19T08:21:26.236 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.236 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.236 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.236 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-19T08:21:26.236 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.236 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.236 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.236 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "seconds to cache host facts data", 2024-09-19T08:21:26.236 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.236 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.236 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.236 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.236 INFO:teuthology.orchestra.run.smithi027.stdout: "grafana_dashboards_path": { 2024-09-19T08:21:26.237 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "grafana_dashboards_path", 2024-09-19T08:21:26.237 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.237 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.237 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.237 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T08:21:26.237 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.237 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.237 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.237 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T08:21:26.237 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.237 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.237 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.237 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.238 INFO:teuthology.orchestra.run.smithi027.stdout: "host_check_interval": { 2024-09-19T08:21:26.238 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "host_check_interval", 2024-09-19T08:21:26.238 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.238 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.238 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.238 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-19T08:21:26.238 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.238 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.238 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.238 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to perform a host check", 2024-09-19T08:21:26.238 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.238 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.238 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.238 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.239 INFO:teuthology.orchestra.run.smithi027.stdout: "hw_monitoring": { 2024-09-19T08:21:26.239 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "hw_monitoring", 2024-09-19T08:21:26.239 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.239 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.239 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.239 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.239 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.239 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.239 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.239 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T08:21:26.239 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.239 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.239 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.239 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.240 INFO:teuthology.orchestra.run.smithi027.stdout: "inventory_list_all": { 2024-09-19T08:21:26.240 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "inventory_list_all", 2024-09-19T08:21:26.240 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.240 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.240 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.240 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.240 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.240 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.240 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.240 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T08:21:26.240 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.240 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.240 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.241 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.241 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.241 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.241 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.241 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.241 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.241 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.241 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.241 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.241 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.241 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.241 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.241 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.241 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.242 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.242 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.242 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.242 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.242 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.242 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.242 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.242 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.242 INFO:teuthology.orchestra.run.smithi027.stdout: "log_refresh_metadata": { 2024-09-19T08:21:26.242 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_refresh_metadata", 2024-09-19T08:21:26.242 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.242 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.243 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.243 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.243 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.243 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.243 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.243 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T08:21:26.243 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.243 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.243 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.243 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.243 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.243 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.243 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.244 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.244 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.244 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.244 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.244 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.244 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.244 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T08:21:26.244 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.244 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.244 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.244 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.244 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.244 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.244 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.245 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.245 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.245 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.245 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.245 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.245 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.245 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.245 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.245 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.245 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.245 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.245 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.245 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.245 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.245 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.246 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.246 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.246 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.246 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.246 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.246 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.246 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.246 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.246 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.246 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.246 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.246 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.246 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.247 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.247 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.247 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.247 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.247 INFO:teuthology.orchestra.run.smithi027.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T08:21:26.247 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T08:21:26.247 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.247 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.247 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.247 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.247 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.247 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.247 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.248 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T08:21:26.248 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.248 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.248 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.248 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.248 INFO:teuthology.orchestra.run.smithi027.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T08:21:26.248 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T08:21:26.248 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.248 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.248 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.248 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "*", 2024-09-19T08:21:26.248 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.248 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.248 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.249 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T08:21:26.249 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.249 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.249 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.249 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.249 INFO:teuthology.orchestra.run.smithi027.stdout: "max_count_per_host": { 2024-09-19T08:21:26.249 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_count_per_host", 2024-09-19T08:21:26.249 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.249 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.249 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.249 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:26.249 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.249 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.249 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.250 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "max number of daemons per service per host", 2024-09-19T08:21:26.250 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.250 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.250 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.250 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.250 INFO:teuthology.orchestra.run.smithi027.stdout: "max_osd_draining_count": { 2024-09-19T08:21:26.250 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_osd_draining_count", 2024-09-19T08:21:26.250 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.250 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.250 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.250 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:26.250 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.250 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.251 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.251 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T08:21:26.251 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.251 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.251 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.251 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.251 INFO:teuthology.orchestra.run.smithi027.stdout: "migration_current": { 2024-09-19T08:21:26.251 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "migration_current", 2024-09-19T08:21:26.251 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.251 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.251 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.251 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.251 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.252 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.252 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.252 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "internal - do not modify", 2024-09-19T08:21:26.252 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.252 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.252 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.252 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.252 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": { 2024-09-19T08:21:26.252 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mode", 2024-09-19T08:21:26.252 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.252 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.252 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.252 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "root", 2024-09-19T08:21:26.253 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.253 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.253 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.253 INFO:teuthology.orchestra.run.smithi027.stdout: "cephadm-package", 2024-09-19T08:21:26.253 INFO:teuthology.orchestra.run.smithi027.stdout: "root" 2024-09-19T08:21:26.253 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.253 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T08:21:26.253 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.253 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.253 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.253 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.253 INFO:teuthology.orchestra.run.smithi027.stdout: "oob_default_addr": { 2024-09-19T08:21:26.253 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "oob_default_addr", 2024-09-19T08:21:26.254 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.254 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.254 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.254 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "169.254.1.1", 2024-09-19T08:21:26.254 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.254 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.254 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.254 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T08:21:26.254 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.254 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.254 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.254 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.254 INFO:teuthology.orchestra.run.smithi027.stdout: "prometheus_alerts_path": { 2024-09-19T08:21:26.254 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "prometheus_alerts_path", 2024-09-19T08:21:26.255 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.255 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.255 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.255 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T08:21:26.255 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.255 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.255 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.255 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T08:21:26.255 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.255 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.255 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.255 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.256 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_insecure": { 2024-09-19T08:21:26.256 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_insecure", 2024-09-19T08:21:26.256 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.256 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.256 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.256 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.256 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.256 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.256 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.256 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T08:21:26.256 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.256 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.256 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.256 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.257 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_password": { 2024-09-19T08:21:26.257 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_password", 2024-09-19T08:21:26.257 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.257 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.257 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.257 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.257 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.257 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.257 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.257 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T08:21:26.257 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.257 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.257 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.257 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.258 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_url": { 2024-09-19T08:21:26.258 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_url", 2024-09-19T08:21:26.258 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.258 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.258 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.258 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.258 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.258 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.258 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.258 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T08:21:26.258 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.258 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.258 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.259 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.259 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_username": { 2024-09-19T08:21:26.259 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_username", 2024-09-19T08:21:26.259 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.259 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.259 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.259 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.259 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.259 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.259 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.259 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T08:21:26.259 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.259 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.259 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.260 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.260 INFO:teuthology.orchestra.run.smithi027.stdout: "secure_monitoring_stack": { 2024-09-19T08:21:26.260 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "secure_monitoring_stack", 2024-09-19T08:21:26.260 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.260 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.260 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.260 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.260 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.260 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.260 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.260 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T08:21:26.260 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.260 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.260 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.261 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.261 INFO:teuthology.orchestra.run.smithi027.stdout: "service_discovery_port": { 2024-09-19T08:21:26.261 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "service_discovery_port", 2024-09-19T08:21:26.261 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.261 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.261 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.261 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8765", 2024-09-19T08:21:26.261 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.261 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.261 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.261 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "cephadm service discovery port", 2024-09-19T08:21:26.261 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.261 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.262 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.262 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.262 INFO:teuthology.orchestra.run.smithi027.stdout: "ssh_config_file": { 2024-09-19T08:21:26.262 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssh_config_file", 2024-09-19T08:21:26.262 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.262 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.262 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.262 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.262 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.262 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.262 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.262 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T08:21:26.262 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.262 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.263 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.263 INFO:teuthology.orchestra.run.smithi027.stdout: "use_agent": { 2024-09-19T08:21:26.263 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "use_agent", 2024-09-19T08:21:26.263 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.263 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.263 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.263 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.263 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.263 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.263 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.263 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T08:21:26.263 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.263 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.264 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.264 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.264 INFO:teuthology.orchestra.run.smithi027.stdout: "use_repo_digest": { 2024-09-19T08:21:26.264 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "use_repo_digest", 2024-09-19T08:21:26.264 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.264 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.264 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.264 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.264 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.264 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.264 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.264 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T08:21:26.264 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.264 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.265 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.265 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_on_failed_host_check": { 2024-09-19T08:21:26.265 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_on_failed_host_check", 2024-09-19T08:21:26.265 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.265 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.265 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.265 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.265 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.265 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.265 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.265 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T08:21:26.265 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.265 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.265 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.266 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_on_stray_daemons": { 2024-09-19T08:21:26.266 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_on_stray_daemons", 2024-09-19T08:21:26.266 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.266 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.266 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.266 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.266 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.266 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.266 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.266 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T08:21:26.266 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.266 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.266 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.266 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_on_stray_hosts": { 2024-09-19T08:21:26.267 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_on_stray_hosts", 2024-09-19T08:21:26.267 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.267 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.267 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.267 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.267 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.267 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.267 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.267 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T08:21:26.267 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.267 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.267 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.267 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.267 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crash", 2024-09-19T08:21:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.268 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.269 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.270 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.271 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.272 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: "retain_interval": { 2024-09-19T08:21:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "retain_interval", 2024-09-19T08:21:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "31536000", 2024-09-19T08:21:26.273 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T08:21:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_recent_interval": { 2024-09-19T08:21:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_recent_interval", 2024-09-19T08:21:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "1209600", 2024-09-19T08:21:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.274 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T08:21:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "dashboard", 2024-09-19T08:21:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T08:21:26.275 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T08:21:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T08:21:26.276 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T08:21:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T08:21:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T08:21:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.277 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "AUDIT_API_ENABLED": { 2024-09-19T08:21:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T08:21:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.278 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T08:21:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T08:21:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.279 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T08:21:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T08:21:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.280 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T08:21:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T08:21:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.281 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T08:21:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T08:21:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.282 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T08:21:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T08:21:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.283 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T08:21:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T08:21:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.284 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T08:21:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T08:21:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.285 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T08:21:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T08:21:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.286 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T08:21:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T08:21:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.287 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T08:21:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T08:21:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.288 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T08:21:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T08:21:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.289 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "admin", 2024-09-19T08:21:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T08:21:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T08:21:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.290 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_URL": { 2024-09-19T08:21:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_URL", 2024-09-19T08:21:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T08:21:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T08:21:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.292 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "admin", 2024-09-19T08:21:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T08:21:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T08:21:26.293 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T08:21:26.294 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T08:21:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T08:21:26.295 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T08:21:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.296 INFO:teuthology.orchestra.run.smithi027.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T08:21:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T08:21:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.297 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T08:21:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T08:21:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T08:21:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T08:21:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T08:21:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T08:21:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.300 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T08:21:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T08:21:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.301 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T08:21:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T08:21:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.302 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T08:21:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T08:21:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.303 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T08:21:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T08:21:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.304 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T08:21:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T08:21:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.305 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T08:21:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T08:21:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.306 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T08:21:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T08:21:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.307 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T08:21:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T08:21:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T08:21:26.308 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T08:21:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T08:21:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:26.309 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T08:21:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T08:21:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8", 2024-09-19T08:21:26.310 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T08:21:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T08:21:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.311 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "45", 2024-09-19T08:21:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T08:21:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T08:21:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.312 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T08:21:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T08:21:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.313 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "admin", 2024-09-19T08:21:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T08:21:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T08:21:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.314 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T08:21:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T08:21:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.315 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T08:21:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T08:21:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-19T08:21:26.316 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T08:21:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T08:21:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.317 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T08:21:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T08:21:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-19T08:21:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.318 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "cross_origin_url": { 2024-09-19T08:21:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cross_origin_url", 2024-09-19T08:21:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.319 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "crt_file": { 2024-09-19T08:21:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crt_file", 2024-09-19T08:21:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.320 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: "debug": { 2024-09-19T08:21:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "debug", 2024-09-19T08:21:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.321 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Enable/disable debug options", 2024-09-19T08:21:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "jwt_token_ttl": { 2024-09-19T08:21:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "jwt_token_ttl", 2024-09-19T08:21:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "28800", 2024-09-19T08:21:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.322 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: "key_file": { 2024-09-19T08:21:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "key_file", 2024-09-19T08:21:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.323 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.324 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.325 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.326 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.327 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.328 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "motd": { 2024-09-19T08:21:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "motd", 2024-09-19T08:21:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.329 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "The message of the day", 2024-09-19T08:21:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "redirect_resolve_ip_addr": { 2024-09-19T08:21:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T08:21:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.330 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "server_addr": { 2024-09-19T08:21:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_addr", 2024-09-19T08:21:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "::", 2024-09-19T08:21:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.331 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "server_port": { 2024-09-19T08:21:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_port", 2024-09-19T08:21:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8080", 2024-09-19T08:21:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.332 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "ssl": { 2024-09-19T08:21:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssl", 2024-09-19T08:21:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.333 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "ssl_server_port": { 2024-09-19T08:21:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssl_server_port", 2024-09-19T08:21:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8443", 2024-09-19T08:21:26.334 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_behaviour": { 2024-09-19T08:21:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_behaviour", 2024-09-19T08:21:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.335 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "redirect", 2024-09-19T08:21:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: "redirect" 2024-09-19T08:21:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.336 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_error_status_code": { 2024-09-19T08:21:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_error_status_code", 2024-09-19T08:21:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "500", 2024-09-19T08:21:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "400", 2024-09-19T08:21:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "599", 2024-09-19T08:21:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "url_prefix": { 2024-09-19T08:21:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "url_prefix", 2024-09-19T08:21:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.338 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "devicehealth", 2024-09-19T08:21:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: "enable_monitoring": { 2024-09-19T08:21:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enable_monitoring", 2024-09-19T08:21:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.339 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "monitor device health metrics", 2024-09-19T08:21:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.340 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.341 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.342 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.343 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.344 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.345 INFO:teuthology.orchestra.run.smithi027.stdout: "mark_out_threshold": { 2024-09-19T08:21:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mark_out_threshold", 2024-09-19T08:21:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "2419200", 2024-09-19T08:21:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T08:21:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "pool_name": { 2024-09-19T08:21:26.346 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pool_name", 2024-09-19T08:21:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "device_health_metrics", 2024-09-19T08:21:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T08:21:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "retention_period": { 2024-09-19T08:21:26.347 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "retention_period", 2024-09-19T08:21:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "15552000", 2024-09-19T08:21:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how long to retain device health metrics", 2024-09-19T08:21:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.348 INFO:teuthology.orchestra.run.smithi027.stdout: "scrape_frequency": { 2024-09-19T08:21:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "scrape_frequency", 2024-09-19T08:21:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "86400", 2024-09-19T08:21:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T08:21:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.349 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "self_heal": { 2024-09-19T08:21:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "self_heal", 2024-09-19T08:21:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T08:21:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-19T08:21:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-19T08:21:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-19T08:21:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T08:21:26.351 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.352 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.352 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.352 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.352 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_threshold": { 2024-09-19T08:21:26.352 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_threshold", 2024-09-19T08:21:26.352 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.352 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.352 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.352 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "7257600", 2024-09-19T08:21:26.352 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.352 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.352 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.352 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T08:21:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "diskprediction_local", 2024-09-19T08:21:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.353 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.355 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.356 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.357 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "predict_interval": { 2024-09-19T08:21:26.358 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "predict_interval", 2024-09-19T08:21:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "86400", 2024-09-19T08:21:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "predictor_model": { 2024-09-19T08:21:26.359 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "predictor_model", 2024-09-19T08:21:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "prophetstor", 2024-09-19T08:21:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-19T08:21:26.360 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-19T08:21:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-19T08:21:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.361 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "influx", 2024-09-19T08:21:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": false, 2024-09-19T08:21:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "influxdb python module not found", 2024-09-19T08:21:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: "batch_size": { 2024-09-19T08:21:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "batch_size", 2024-09-19T08:21:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5000", 2024-09-19T08:21:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.362 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T08:21:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "database": { 2024-09-19T08:21:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "database", 2024-09-19T08:21:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "ceph", 2024-09-19T08:21:26.363 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T08:21:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "hostname": { 2024-09-19T08:21:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "hostname", 2024-09-19T08:21:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.364 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "InfluxDB server hostname", 2024-09-19T08:21:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-19T08:21:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-19T08:21:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.365 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "30", 2024-09-19T08:21:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "5", 2024-09-19T08:21:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T08:21:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.366 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.367 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.368 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.369 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.370 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "password": { 2024-09-19T08:21:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "password", 2024-09-19T08:21:26.371 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "password of InfluxDB server user", 2024-09-19T08:21:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "port": { 2024-09-19T08:21:26.372 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "port", 2024-09-19T08:21:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8086", 2024-09-19T08:21:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "InfluxDB server port", 2024-09-19T08:21:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.373 INFO:teuthology.orchestra.run.smithi027.stdout: "ssl": { 2024-09-19T08:21:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssl", 2024-09-19T08:21:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "false", 2024-09-19T08:21:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:21:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.374 INFO:teuthology.orchestra.run.smithi027.stdout: "threads": { 2024-09-19T08:21:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "threads", 2024-09-19T08:21:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-19T08:21:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-19T08:21:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "32", 2024-09-19T08:21:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T08:21:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.376 INFO:teuthology.orchestra.run.smithi027.stdout: "username": { 2024-09-19T08:21:26.376 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "username", 2024-09-19T08:21:26.376 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.376 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.376 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.376 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.376 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.376 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.376 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.376 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "username of InfluxDB server user", 2024-09-19T08:21:26.376 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.376 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.376 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.377 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.377 INFO:teuthology.orchestra.run.smithi027.stdout: "verify_ssl": { 2024-09-19T08:21:26.377 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "verify_ssl", 2024-09-19T08:21:26.377 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.377 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.377 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.377 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "true", 2024-09-19T08:21:26.377 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.377 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.377 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.377 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:21:26.377 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.377 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.378 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.378 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.378 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.378 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.378 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "insights", 2024-09-19T08:21:26.378 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.378 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.378 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.378 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.378 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.378 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.378 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.378 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.379 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.379 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.379 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.379 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.379 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.379 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.379 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.379 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.379 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.379 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.379 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.379 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.379 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.379 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.380 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.380 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.380 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.380 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.380 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.380 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.380 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.380 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.380 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.380 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.380 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.380 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.380 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.381 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.381 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.381 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.381 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.381 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.381 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.381 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.381 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.381 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.381 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.381 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.381 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.381 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.382 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.382 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.382 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.382 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.382 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.382 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.382 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.382 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.382 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.382 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.382 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.382 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.382 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.382 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.383 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.383 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.383 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.383 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.383 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.383 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.383 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.383 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.383 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.383 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.383 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.383 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.383 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.383 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "iostat", 2024-09-19T08:21:26.384 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.384 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.384 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.384 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.384 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.384 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.384 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.384 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.384 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.384 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.384 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.384 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.384 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.384 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.385 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.385 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.385 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.385 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.385 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.385 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.385 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.385 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.385 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.385 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.385 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.385 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.385 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.386 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.386 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.386 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.386 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.386 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.386 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.386 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.386 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.386 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.386 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.386 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.386 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.386 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.386 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.386 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.387 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.387 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.387 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.387 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.387 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.387 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.387 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.387 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.387 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.387 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.387 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.387 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.387 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.387 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.388 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.388 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.388 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.388 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.388 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.388 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.388 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.388 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.388 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.388 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.388 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.388 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.388 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.389 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.389 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.389 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.389 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.389 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.389 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.389 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "k8sevents", 2024-09-19T08:21:26.389 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.389 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.389 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.389 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_event_retention_days": { 2024-09-19T08:21:26.389 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ceph_event_retention_days", 2024-09-19T08:21:26.389 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.390 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.390 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.390 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "7", 2024-09-19T08:21:26.390 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.390 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.390 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.390 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T08:21:26.390 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.390 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.390 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.390 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.390 INFO:teuthology.orchestra.run.smithi027.stdout: "config_check_secs": { 2024-09-19T08:21:26.390 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "config_check_secs", 2024-09-19T08:21:26.390 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.391 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.391 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.391 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:26.391 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "10", 2024-09-19T08:21:26.391 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.391 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.391 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T08:21:26.391 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.391 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.391 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.391 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.391 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.392 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.392 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.392 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.392 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.392 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.392 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.392 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.392 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.392 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.392 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.392 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.392 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.392 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.393 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.393 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.393 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.393 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.393 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.393 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.393 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.393 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.393 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.393 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.393 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.393 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.394 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.394 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.394 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.394 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.394 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.394 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.394 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.394 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.394 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.394 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.394 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.394 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.394 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.394 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.395 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.395 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.395 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.395 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.395 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.395 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.395 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.395 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.395 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.395 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.395 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.395 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.395 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.396 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.396 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.396 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.396 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.396 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.396 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.396 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.396 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.396 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.396 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.396 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.396 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.396 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.396 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.397 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.397 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.397 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.397 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.397 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.397 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.397 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "localpool", 2024-09-19T08:21:26.397 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.397 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.397 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.397 INFO:teuthology.orchestra.run.smithi027.stdout: "failure_domain": { 2024-09-19T08:21:26.397 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "failure_domain", 2024-09-19T08:21:26.397 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.397 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.398 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.398 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "host", 2024-09-19T08:21:26.398 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.398 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.398 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.398 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "failure domain for any created local pool", 2024-09-19T08:21:26.398 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T08:21:26.398 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.398 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.398 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.398 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.398 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.398 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.399 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.399 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.399 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.399 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.399 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.399 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.399 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.399 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.399 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.399 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.399 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.399 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.399 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.399 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.400 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.400 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.400 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.400 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.400 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.400 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.400 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.400 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.400 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.400 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.400 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.400 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.400 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.401 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.401 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.401 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.401 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.401 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.401 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.401 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.401 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.401 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.401 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.401 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.401 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.401 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.402 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.402 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.402 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.402 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.402 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.402 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.402 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.402 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.402 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.402 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.402 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.402 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.402 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.402 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.403 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.403 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.403 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.403 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.403 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.403 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.403 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.403 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.403 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.403 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.403 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.403 INFO:teuthology.orchestra.run.smithi027.stdout: "min_size": { 2024-09-19T08:21:26.403 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "min_size", 2024-09-19T08:21:26.403 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.404 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.404 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.404 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.404 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.404 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.404 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.404 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "default min_size for any created local pool", 2024-09-19T08:21:26.404 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T08:21:26.404 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.404 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.404 INFO:teuthology.orchestra.run.smithi027.stdout: "num_rep": { 2024-09-19T08:21:26.404 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "num_rep", 2024-09-19T08:21:26.405 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.405 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.405 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.405 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "3", 2024-09-19T08:21:26.405 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.405 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.405 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.405 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "default replica count for any created local pool", 2024-09-19T08:21:26.405 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.405 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.406 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.406 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.406 INFO:teuthology.orchestra.run.smithi027.stdout: "pg_num": { 2024-09-19T08:21:26.406 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pg_num", 2024-09-19T08:21:26.406 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.406 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.406 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.406 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "128", 2024-09-19T08:21:26.406 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.408 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.408 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.408 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T08:21:26.408 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.408 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.408 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.408 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.409 INFO:teuthology.orchestra.run.smithi027.stdout: "prefix": { 2024-09-19T08:21:26.409 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "prefix", 2024-09-19T08:21:26.409 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.409 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.409 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.409 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.409 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.409 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.409 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.409 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "name prefix for any created local pool", 2024-09-19T08:21:26.409 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.410 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.410 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.410 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.410 INFO:teuthology.orchestra.run.smithi027.stdout: "subtree": { 2024-09-19T08:21:26.410 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "subtree", 2024-09-19T08:21:26.410 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.410 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.410 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.410 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "rack", 2024-09-19T08:21:26.410 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.410 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.411 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.411 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T08:21:26.411 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T08:21:26.411 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.411 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.411 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.411 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.411 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.411 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.411 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mds_autoscaler", 2024-09-19T08:21:26.411 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.411 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.412 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.412 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.412 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.412 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.412 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.412 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.412 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.412 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.412 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.412 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.412 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.413 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.413 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.413 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.413 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.413 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.413 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.413 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.413 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.413 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.413 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.413 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.414 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.414 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.414 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.414 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.414 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.414 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.414 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.414 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.414 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.414 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.414 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.415 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.415 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.415 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.415 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.415 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.415 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.415 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.415 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.415 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.415 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.416 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.416 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.416 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.416 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.416 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.416 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.416 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.416 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.416 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.416 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.416 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.417 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.417 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.417 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.417 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.417 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.417 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.417 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.417 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.417 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.417 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.418 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.418 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.418 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.418 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.418 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.418 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.418 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.418 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.418 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.418 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.419 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mirroring", 2024-09-19T08:21:26.419 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.419 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.419 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.419 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.419 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.419 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.419 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.419 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.419 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.419 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.420 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.420 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.420 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.420 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.420 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.420 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.420 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.420 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.420 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.420 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.421 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.421 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.421 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.421 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.421 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.421 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.421 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.421 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.421 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.421 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.422 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.422 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.422 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.422 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.422 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.422 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.422 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.422 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.422 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.422 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.423 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.423 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.423 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.423 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.423 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.423 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.423 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.423 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.423 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.423 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.424 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.424 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.424 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.424 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.424 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.424 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.424 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.424 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.424 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.425 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.425 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.425 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.425 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.425 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.425 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.425 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.425 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.425 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.426 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.426 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.426 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.426 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.426 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.426 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.426 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.426 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.426 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "nfs", 2024-09-19T08:21:26.426 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.427 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.427 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.427 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.427 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.427 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.427 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.427 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.427 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.427 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.427 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.428 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.428 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.428 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.428 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.428 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.428 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.428 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.428 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.428 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.428 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.428 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.429 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.429 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.429 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.429 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.429 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.429 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.429 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.429 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.429 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.429 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.429 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.430 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.430 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.430 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.430 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.430 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.430 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.430 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.430 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.430 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.430 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.431 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.431 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.431 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.431 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.431 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.431 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.431 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.431 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.431 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.431 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.432 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.432 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.432 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.432 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.432 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.432 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.432 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.432 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.432 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.432 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.433 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.433 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.433 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.433 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.433 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.433 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.433 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.433 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.433 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.433 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.433 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.433 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.434 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.434 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "orchestrator", 2024-09-19T08:21:26.434 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.434 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.434 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.434 INFO:teuthology.orchestra.run.smithi027.stdout: "fail_fs": { 2024-09-19T08:21:26.434 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "fail_fs", 2024-09-19T08:21:26.434 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.434 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.434 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.434 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.435 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.435 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.435 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.435 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T08:21:26.435 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.435 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.435 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.435 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.435 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.435 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.435 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.436 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.436 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.436 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.436 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.436 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.436 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.436 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.436 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.436 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.436 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.437 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.437 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.437 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.437 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.437 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.437 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.437 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.437 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.437 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.437 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.437 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.437 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.438 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.438 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.438 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.438 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.438 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.438 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.438 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.438 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.438 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.438 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.438 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.439 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.439 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.439 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.439 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.439 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.439 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.439 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.439 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.439 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.439 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.439 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.439 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.440 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.440 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.440 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.440 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.440 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.440 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.440 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.440 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.440 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.440 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.440 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.441 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.441 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.441 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.441 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.441 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.441 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.441 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.441 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.441 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.441 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.441 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.441 INFO:teuthology.orchestra.run.smithi027.stdout: "orchestrator": { 2024-09-19T08:21:26.441 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "orchestrator", 2024-09-19T08:21:26.442 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.442 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.442 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.442 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.442 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.442 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.442 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.442 INFO:teuthology.orchestra.run.smithi027.stdout: "cephadm", 2024-09-19T08:21:26.442 INFO:teuthology.orchestra.run.smithi027.stdout: "rook", 2024-09-19T08:21:26.442 INFO:teuthology.orchestra.run.smithi027.stdout: "test_orchestrator" 2024-09-19T08:21:26.442 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.442 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Orchestrator backend", 2024-09-19T08:21:26.443 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.443 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.443 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.443 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.443 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.443 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.443 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.443 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "osd_perf_query", 2024-09-19T08:21:26.443 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.443 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.443 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.444 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.444 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.444 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.444 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.444 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.444 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.444 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.444 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.444 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.444 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.444 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.444 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.445 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.445 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.445 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.445 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.445 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.445 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.445 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.445 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.445 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.445 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.445 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.445 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.446 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.446 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.446 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.446 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.446 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.446 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.446 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.446 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.446 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.446 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.446 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.447 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.447 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.447 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.447 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.447 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.447 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.447 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.447 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.447 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.447 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.447 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.447 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.448 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.448 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.448 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.448 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.448 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.448 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.448 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.448 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.448 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.448 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.448 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.448 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.449 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.449 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.449 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.449 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.449 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.449 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.449 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.449 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.449 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.449 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.449 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.450 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.450 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.450 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.450 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "osd_support", 2024-09-19T08:21:26.450 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.450 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.450 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.450 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.450 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.450 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.450 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.450 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.451 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.451 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.451 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.451 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.451 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.451 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.451 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.451 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.451 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.451 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.451 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.451 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.451 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.452 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.452 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.452 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.452 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.452 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.452 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.452 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.452 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.452 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.452 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.452 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.452 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.453 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.453 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.453 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.453 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.453 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.453 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.453 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.453 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.453 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.453 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.453 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.453 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.454 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.454 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.454 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.454 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.454 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.454 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.454 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.454 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.454 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.454 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.454 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.455 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.455 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.455 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.455 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.455 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.455 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.455 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.455 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.455 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.455 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.455 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.456 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.456 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.456 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.456 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.456 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.456 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.456 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.456 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.456 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.456 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pg_autoscaler", 2024-09-19T08:21:26.456 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.456 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.456 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.457 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.457 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.457 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.457 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.457 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.457 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.457 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.457 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.457 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.457 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.457 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.457 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.458 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.458 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.458 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.458 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.458 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.458 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.458 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.458 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.458 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.458 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.458 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.458 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.459 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.459 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.459 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.459 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.459 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.459 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.459 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.459 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.459 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.459 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.459 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.459 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.460 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.460 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.460 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.460 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.460 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.460 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.460 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.460 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.460 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.460 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.460 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.461 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.461 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.461 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.461 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.461 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.461 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.461 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.461 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.461 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.461 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.461 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.462 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.462 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.462 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.462 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.462 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.462 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.462 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.462 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.462 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.462 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.462 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.463 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.463 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-19T08:21:26.463 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-19T08:21:26.463 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.463 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.463 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.463 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-19T08:21:26.463 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.463 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.463 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.463 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.464 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.464 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.464 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.464 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.464 INFO:teuthology.orchestra.run.smithi027.stdout: "threshold": { 2024-09-19T08:21:26.464 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "threshold", 2024-09-19T08:21:26.464 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:26.464 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.464 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.464 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "3.0", 2024-09-19T08:21:26.465 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1.0", 2024-09-19T08:21:26.465 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.465 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.465 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "scaling threshold", 2024-09-19T08:21:26.465 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T08:21:26.465 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.465 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.465 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.465 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.466 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.466 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.466 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "progress", 2024-09-19T08:21:26.466 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.466 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.466 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.466 INFO:teuthology.orchestra.run.smithi027.stdout: "allow_pg_recovery_event": { 2024-09-19T08:21:26.466 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "allow_pg_recovery_event", 2024-09-19T08:21:26.466 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.466 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.466 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.467 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.467 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.467 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.467 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.467 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T08:21:26.467 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.467 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.467 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.467 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.467 INFO:teuthology.orchestra.run.smithi027.stdout: "enabled": { 2024-09-19T08:21:26.468 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enabled", 2024-09-19T08:21:26.468 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.468 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.468 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.468 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.468 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.468 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.468 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.468 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.468 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.468 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.469 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.469 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.469 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.469 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.469 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.469 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.469 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.469 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.469 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.469 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.469 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.470 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.470 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.470 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.470 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.470 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.470 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.470 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.470 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.470 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.470 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.470 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.471 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.471 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.471 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.471 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.471 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.471 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.471 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.471 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.471 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.471 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.471 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.472 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.472 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.472 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.472 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.472 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.472 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.472 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.472 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.472 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.472 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.472 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.473 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.473 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.473 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.473 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.473 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.473 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.473 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.473 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.473 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.473 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.473 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.474 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.474 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.474 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.474 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.474 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.474 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.474 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.474 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.474 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.474 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.474 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.475 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.475 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.475 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.475 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.475 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.475 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.475 INFO:teuthology.orchestra.run.smithi027.stdout: "max_completed_events": { 2024-09-19T08:21:26.475 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_completed_events", 2024-09-19T08:21:26.475 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.475 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.475 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.476 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "50", 2024-09-19T08:21:26.476 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.476 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.476 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.476 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "number of past completed events to remember", 2024-09-19T08:21:26.476 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.476 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.476 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.476 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.476 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-19T08:21:26.476 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-19T08:21:26.477 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.477 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.477 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.477 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-19T08:21:26.477 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.477 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.477 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.477 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how long the module is going to sleep", 2024-09-19T08:21:26.477 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.477 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.478 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.478 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.478 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.478 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.478 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.478 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "prometheus", 2024-09-19T08:21:26.478 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.478 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.478 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.478 INFO:teuthology.orchestra.run.smithi027.stdout: "cache": { 2024-09-19T08:21:26.479 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cache", 2024-09-19T08:21:26.479 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.479 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.479 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.479 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.479 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.479 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.479 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.479 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.479 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.479 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.479 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.480 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.480 INFO:teuthology.orchestra.run.smithi027.stdout: "exclude_perf_counters": { 2024-09-19T08:21:26.480 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "exclude_perf_counters", 2024-09-19T08:21:26.480 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.480 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.480 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.480 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.480 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.480 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.480 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.480 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T08:21:26.480 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T08:21:26.480 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.481 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.481 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.481 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.481 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.481 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.481 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.481 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.481 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.481 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.481 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.481 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.481 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.482 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.482 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.482 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.482 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.482 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.482 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.482 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.482 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.482 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.482 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.482 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.482 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.482 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.483 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.483 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.483 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.483 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.483 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.483 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.483 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.483 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.483 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.483 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.483 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.483 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.484 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.484 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.484 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.484 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.484 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.484 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.484 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.484 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.484 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.484 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.484 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.485 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.485 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.485 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.485 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.485 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.485 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.485 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.485 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.485 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.485 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.485 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.486 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.486 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.486 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.486 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.486 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.486 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.486 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.486 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.486 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.486 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.486 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.486 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.487 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_stats_pools": { 2024-09-19T08:21:26.487 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rbd_stats_pools", 2024-09-19T08:21:26.487 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.487 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.487 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.487 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.487 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.487 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.487 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.487 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.488 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.488 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.488 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.488 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.488 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T08:21:26.488 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T08:21:26.488 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.488 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.488 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.488 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "300", 2024-09-19T08:21:26.488 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.488 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.489 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.489 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.489 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.489 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.489 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.489 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.489 INFO:teuthology.orchestra.run.smithi027.stdout: "scrape_interval": { 2024-09-19T08:21:26.489 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "scrape_interval", 2024-09-19T08:21:26.489 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:26.489 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.489 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.490 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "15.0", 2024-09-19T08:21:26.490 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.490 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.490 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.490 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.490 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.490 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.490 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.490 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.490 INFO:teuthology.orchestra.run.smithi027.stdout: "server_addr": { 2024-09-19T08:21:26.490 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_addr", 2024-09-19T08:21:26.490 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.491 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.491 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.491 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "::", 2024-09-19T08:21:26.491 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.491 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.491 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.491 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T08:21:26.491 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.491 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.491 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.491 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.492 INFO:teuthology.orchestra.run.smithi027.stdout: "server_port": { 2024-09-19T08:21:26.492 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_port", 2024-09-19T08:21:26.492 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.492 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.492 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.492 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "9283", 2024-09-19T08:21:26.492 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.492 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.492 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.492 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T08:21:26.492 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.493 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.493 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.493 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.493 INFO:teuthology.orchestra.run.smithi027.stdout: "stale_cache_strategy": { 2024-09-19T08:21:26.493 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "stale_cache_strategy", 2024-09-19T08:21:26.493 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.493 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.493 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.493 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "log", 2024-09-19T08:21:26.493 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.493 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.494 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.494 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.494 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.494 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.494 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.494 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.494 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_behaviour": { 2024-09-19T08:21:26.494 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_behaviour", 2024-09-19T08:21:26.494 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.494 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.494 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.494 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "default", 2024-09-19T08:21:26.495 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.495 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.495 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.495 INFO:teuthology.orchestra.run.smithi027.stdout: "default", 2024-09-19T08:21:26.495 INFO:teuthology.orchestra.run.smithi027.stdout: "error" 2024-09-19T08:21:26.495 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.495 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.495 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.495 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.495 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.495 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.496 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_error_status_code": { 2024-09-19T08:21:26.496 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_error_status_code", 2024-09-19T08:21:26.496 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.496 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.496 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.496 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "500", 2024-09-19T08:21:26.496 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "400", 2024-09-19T08:21:26.496 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "599", 2024-09-19T08:21:26.496 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.496 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.496 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.497 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.497 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.497 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.497 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.497 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.497 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.497 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rbd_support", 2024-09-19T08:21:26.497 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.497 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.497 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.497 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.498 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.498 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.498 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.498 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.498 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.498 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.498 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.498 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.498 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.498 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.498 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.498 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.499 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.499 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.499 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.499 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.499 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.499 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.499 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.499 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.499 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.499 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.499 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.500 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.500 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.500 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.500 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.500 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.500 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.500 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.500 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.500 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.500 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.500 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.500 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.501 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.501 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.501 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.501 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.501 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.501 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.501 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.501 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.501 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.501 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.501 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.502 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.502 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.502 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.502 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.502 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.502 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.502 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.502 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.502 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.502 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.502 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.502 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.503 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.503 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.503 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.503 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.503 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.503 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.503 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.503 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.503 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.503 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.503 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.503 INFO:teuthology.orchestra.run.smithi027.stdout: "max_concurrent_snap_create": { 2024-09-19T08:21:26.503 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_concurrent_snap_create", 2024-09-19T08:21:26.504 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.504 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.504 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.504 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:26.504 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.504 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.504 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.504 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.504 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.504 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.504 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.504 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.505 INFO:teuthology.orchestra.run.smithi027.stdout: "mirror_snapshot_schedule": { 2024-09-19T08:21:26.505 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T08:21:26.505 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.505 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.505 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.505 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.505 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.505 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.505 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.505 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.505 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.506 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.506 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.506 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.506 INFO:teuthology.orchestra.run.smithi027.stdout: "trash_purge_schedule": { 2024-09-19T08:21:26.506 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "trash_purge_schedule", 2024-09-19T08:21:26.506 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.506 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.506 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.506 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.506 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.506 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.506 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.506 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.507 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.507 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.507 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.507 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.507 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.507 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.507 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.507 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "restful", 2024-09-19T08:21:26.507 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.507 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.507 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.507 INFO:teuthology.orchestra.run.smithi027.stdout: "enable_auth": { 2024-09-19T08:21:26.507 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enable_auth", 2024-09-19T08:21:26.508 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.508 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.508 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.508 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.508 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.508 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.508 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.508 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.508 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.508 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.508 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.508 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.509 INFO:teuthology.orchestra.run.smithi027.stdout: "key_file": { 2024-09-19T08:21:26.509 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "key_file", 2024-09-19T08:21:26.509 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.509 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.509 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.509 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.509 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.509 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.509 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.509 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.509 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.510 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.510 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.510 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.510 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.510 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.510 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.510 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.510 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.510 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.510 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.510 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.511 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.511 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.511 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.511 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.511 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.511 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.511 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.511 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.511 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.511 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.511 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.512 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.512 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.512 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.512 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.512 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.512 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.512 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.512 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.512 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.512 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.512 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.513 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.513 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.513 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.513 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.513 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.513 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.513 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.513 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.513 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.513 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.513 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.514 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.514 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.514 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.514 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.514 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.514 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.514 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.514 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.514 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.514 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.514 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.515 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.515 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.515 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.515 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.515 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.515 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.515 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.515 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.515 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.515 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.515 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.516 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.516 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.516 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.516 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.516 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.516 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.516 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.516 INFO:teuthology.orchestra.run.smithi027.stdout: "server_addr": { 2024-09-19T08:21:26.516 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_addr", 2024-09-19T08:21:26.516 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.516 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.516 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.517 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.517 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.517 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.517 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.517 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.517 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.517 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.517 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.517 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.517 INFO:teuthology.orchestra.run.smithi027.stdout: "server_port": { 2024-09-19T08:21:26.517 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_port", 2024-09-19T08:21:26.517 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.517 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.518 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.518 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.518 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.518 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.518 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.518 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.518 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.518 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.518 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.518 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.518 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.518 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.518 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.519 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rgw", 2024-09-19T08:21:26.519 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.519 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.519 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.519 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.519 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.519 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.519 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.519 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.519 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.519 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.519 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.519 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.520 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.520 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.520 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.520 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.520 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.520 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.520 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.520 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.520 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.520 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.521 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.521 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.521 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.521 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.521 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.521 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.521 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.521 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.521 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.521 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.521 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.521 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.522 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.522 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.522 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.522 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.522 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.522 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.522 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.522 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.522 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.522 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.522 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.522 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.522 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.523 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.523 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.523 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.523 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.523 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.523 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.523 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.523 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.523 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.523 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.523 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.523 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.523 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.524 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.524 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.524 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.524 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.524 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.524 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.524 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.524 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.524 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.524 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.524 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.524 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.524 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.525 INFO:teuthology.orchestra.run.smithi027.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T08:21:26.525 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T08:21:26.525 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.525 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.525 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.525 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-19T08:21:26.525 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.525 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.525 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.525 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T08:21:26.525 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.526 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.526 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.526 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.526 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.526 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.526 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.526 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rook", 2024-09-19T08:21:26.526 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.526 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.526 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.526 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.526 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.527 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.527 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.527 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.527 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.527 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.527 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.527 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.527 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.527 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.527 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.527 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.528 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.528 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.528 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.528 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.528 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.528 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.528 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.528 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.528 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.528 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.528 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.529 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.529 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.529 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.529 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.529 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.529 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.529 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.529 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.529 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.529 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.529 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.530 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.530 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.530 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.530 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.530 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.530 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.530 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.530 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.530 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.530 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.530 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.530 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.531 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.531 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.531 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.531 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.531 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.531 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.531 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.531 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.531 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.531 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.531 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.532 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.532 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.532 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.532 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.532 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.532 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.532 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.532 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.532 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.532 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.532 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.532 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.533 INFO:teuthology.orchestra.run.smithi027.stdout: "storage_class": { 2024-09-19T08:21:26.533 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "storage_class", 2024-09-19T08:21:26.533 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.533 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.533 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.533 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "local", 2024-09-19T08:21:26.533 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.533 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.533 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.533 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T08:21:26.533 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.534 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.534 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.534 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.534 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.534 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.534 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.534 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "selftest", 2024-09-19T08:21:26.534 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.534 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.534 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.534 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.534 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.535 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.535 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.535 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.535 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.535 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.535 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.535 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.535 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.535 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.535 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.535 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.535 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.536 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.536 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.536 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.536 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.536 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.536 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.536 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.536 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.536 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.536 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.536 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.537 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.537 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.537 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.537 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.537 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.537 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.537 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.537 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.537 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.537 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.537 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.538 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.538 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.538 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.538 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.538 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.538 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.538 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.538 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.538 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.538 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.538 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.538 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.539 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.539 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.539 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.539 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.539 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.539 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.539 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.539 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.539 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.539 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.539 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.539 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.540 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.540 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.540 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.540 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.540 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.540 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.540 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.540 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.540 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.540 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.540 INFO:teuthology.orchestra.run.smithi027.stdout: "roption1": { 2024-09-19T08:21:26.541 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "roption1", 2024-09-19T08:21:26.541 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.541 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.541 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.541 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.541 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.541 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.541 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.541 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.541 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.541 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.541 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.542 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.542 INFO:teuthology.orchestra.run.smithi027.stdout: "roption2": { 2024-09-19T08:21:26.542 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "roption2", 2024-09-19T08:21:26.542 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.542 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.542 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.542 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "xyz", 2024-09-19T08:21:26.542 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.542 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.542 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.542 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.542 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.543 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.543 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.543 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.543 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption1": { 2024-09-19T08:21:26.543 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption1", 2024-09-19T08:21:26.543 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.543 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.543 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.543 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.543 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.543 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.544 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.544 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.544 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.544 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.544 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.544 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.544 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption2": { 2024-09-19T08:21:26.544 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption2", 2024-09-19T08:21:26.544 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.544 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.544 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.545 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.545 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.545 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.545 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.545 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.545 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.545 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.545 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.545 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.546 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption3": { 2024-09-19T08:21:26.546 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption3", 2024-09-19T08:21:26.546 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:26.546 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.546 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.546 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.546 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.546 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.546 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.546 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.546 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.547 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.547 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.547 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.547 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption4": { 2024-09-19T08:21:26.547 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption4", 2024-09-19T08:21:26.547 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.547 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.547 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.547 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.547 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.547 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.548 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.548 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.548 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.548 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.548 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.548 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.548 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption5": { 2024-09-19T08:21:26.548 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption5", 2024-09-19T08:21:26.548 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.548 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.548 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.548 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.549 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.549 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.549 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.549 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.549 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.549 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.549 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.549 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.549 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption6": { 2024-09-19T08:21:26.549 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption6", 2024-09-19T08:21:26.550 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.550 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.550 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.550 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.550 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.550 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.550 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.550 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.550 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.550 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.550 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.550 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.551 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption7": { 2024-09-19T08:21:26.551 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption7", 2024-09-19T08:21:26.551 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.551 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.551 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.551 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.551 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-19T08:21:26.551 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "42", 2024-09-19T08:21:26.551 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.551 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.551 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.552 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.552 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.552 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.552 INFO:teuthology.orchestra.run.smithi027.stdout: "testkey": { 2024-09-19T08:21:26.552 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "testkey", 2024-09-19T08:21:26.552 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.552 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.552 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.552 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.552 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.552 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.552 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.553 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.553 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.553 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.553 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.553 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.553 INFO:teuthology.orchestra.run.smithi027.stdout: "testlkey": { 2024-09-19T08:21:26.553 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "testlkey", 2024-09-19T08:21:26.553 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.553 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.553 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.553 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.554 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.554 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.554 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.554 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.554 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.554 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.554 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.554 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.554 INFO:teuthology.orchestra.run.smithi027.stdout: "testnewline": { 2024-09-19T08:21:26.554 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "testnewline", 2024-09-19T08:21:26.554 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.555 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.555 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.555 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.555 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.555 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.555 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.555 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.555 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.555 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.555 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.556 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.556 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.556 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.556 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.556 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "snap_schedule", 2024-09-19T08:21:26.556 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.556 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.556 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.556 INFO:teuthology.orchestra.run.smithi027.stdout: "allow_m_granularity": { 2024-09-19T08:21:26.556 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "allow_m_granularity", 2024-09-19T08:21:26.556 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.557 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.557 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.557 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.557 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.557 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.557 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.557 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T08:21:26.557 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.557 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.557 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.558 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.558 INFO:teuthology.orchestra.run.smithi027.stdout: "dump_on_update": { 2024-09-19T08:21:26.558 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "dump_on_update", 2024-09-19T08:21:26.558 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.558 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.558 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.558 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.558 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.558 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.558 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.558 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "dump database to debug log on update", 2024-09-19T08:21:26.558 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.559 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.559 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.559 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.559 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.559 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.559 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.559 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.559 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.559 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.559 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.559 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.560 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.560 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.560 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.560 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.560 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.560 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.560 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.560 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.560 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.560 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.560 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.561 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.561 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.561 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.561 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.561 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.561 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.561 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.561 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.561 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.561 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.561 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.562 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.562 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.562 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.562 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.562 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.562 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.562 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.562 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.562 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.562 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.562 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.563 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.563 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.563 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.563 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.563 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.563 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.563 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.563 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.563 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.563 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.563 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.564 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.564 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.564 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.564 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.564 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.564 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.564 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.564 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.564 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.564 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.565 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.565 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.565 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.565 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.565 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.565 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.565 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.565 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.565 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.565 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "stats", 2024-09-19T08:21:26.565 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.566 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.566 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.566 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.566 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.566 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.566 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.566 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.566 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.566 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.566 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.567 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.567 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.567 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.567 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.567 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.567 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.567 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.567 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.567 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.567 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.568 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.568 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.568 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.568 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.568 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.568 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.568 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.568 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.568 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.568 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.569 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.569 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.569 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.569 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.569 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.569 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.569 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.569 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.569 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.569 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.569 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.570 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.570 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.570 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.570 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.570 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.570 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.570 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.570 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.570 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.570 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.570 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.571 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.571 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.571 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.571 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.571 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.571 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.571 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.571 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.571 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.571 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.571 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.571 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.572 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.572 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.572 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.572 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.572 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.572 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.572 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.572 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.572 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.572 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.573 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.573 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "status", 2024-09-19T08:21:26.573 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.573 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.573 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.573 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.573 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.573 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.573 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.573 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.573 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.573 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.573 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.574 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.574 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.574 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.574 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.574 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.574 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.574 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.574 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.574 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.574 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.574 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.574 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.574 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.575 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.575 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.575 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.575 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.575 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.575 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.575 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.575 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.575 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.575 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.575 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.575 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.576 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.576 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.576 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.576 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.576 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.576 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.576 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.576 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.576 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.576 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.576 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.576 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.576 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.577 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.577 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.577 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.577 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.577 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.577 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.577 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.577 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.577 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.577 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.577 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.578 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.578 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.578 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.578 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.578 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.578 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.578 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.578 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.578 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.578 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.578 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.578 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.579 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.579 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.579 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.579 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "telegraf", 2024-09-19T08:21:26.579 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.579 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.579 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.579 INFO:teuthology.orchestra.run.smithi027.stdout: "address": { 2024-09-19T08:21:26.579 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "address", 2024-09-19T08:21:26.579 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.579 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.579 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.580 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T08:21:26.580 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.580 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.580 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.580 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.580 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.580 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.580 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.580 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.580 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-19T08:21:26.580 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-19T08:21:26.580 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.581 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.581 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.581 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "15", 2024-09-19T08:21:26.581 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.581 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.581 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.581 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.581 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.581 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.581 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.581 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.581 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.582 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.582 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.582 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.582 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.582 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.582 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.582 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.582 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.582 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.582 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.582 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.583 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.583 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.583 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.583 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.583 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.583 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.583 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.583 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.583 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.583 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.583 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.584 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.584 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.584 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.584 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.584 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.584 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.584 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.584 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.584 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.584 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.585 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.585 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.585 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.585 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.585 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.585 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.585 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.585 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.585 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.585 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.585 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.586 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.586 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.586 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.586 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.586 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.586 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.586 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.586 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.586 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.586 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.587 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.587 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.587 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.587 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.587 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.587 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.587 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.587 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.587 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.587 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.587 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.588 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.588 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.588 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.588 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.588 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.588 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.588 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.588 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "telemetry", 2024-09-19T08:21:26.588 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.588 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.589 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.589 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_basic": { 2024-09-19T08:21:26.589 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_basic", 2024-09-19T08:21:26.589 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.589 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.589 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.589 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.589 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.589 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.589 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.589 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T08:21:26.590 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.590 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.590 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.590 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_crash": { 2024-09-19T08:21:26.590 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_crash", 2024-09-19T08:21:26.590 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.590 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.590 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.590 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.591 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.591 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.591 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.591 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T08:21:26.591 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.591 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.591 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.591 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_device": { 2024-09-19T08:21:26.591 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_device", 2024-09-19T08:21:26.591 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.591 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.592 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.592 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.592 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.592 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.592 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.592 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T08:21:26.592 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.592 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.592 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.592 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_ident": { 2024-09-19T08:21:26.592 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_ident", 2024-09-19T08:21:26.593 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.593 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.593 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.593 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.593 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.593 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.593 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.593 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T08:21:26.593 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.593 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.593 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.594 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.594 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_perf": { 2024-09-19T08:21:26.594 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_perf", 2024-09-19T08:21:26.594 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.594 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.594 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.594 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.594 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.594 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.594 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.594 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T08:21:26.594 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.595 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.595 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.595 INFO:teuthology.orchestra.run.smithi027.stdout: "contact": { 2024-09-19T08:21:26.595 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "contact", 2024-09-19T08:21:26.595 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.595 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.595 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.595 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.595 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.595 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.596 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.596 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.596 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.596 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.596 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.596 INFO:teuthology.orchestra.run.smithi027.stdout: "description": { 2024-09-19T08:21:26.596 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "description", 2024-09-19T08:21:26.596 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.596 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.597 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.597 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.597 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.597 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.597 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.597 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.597 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.597 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.597 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.597 INFO:teuthology.orchestra.run.smithi027.stdout: "device_url": { 2024-09-19T08:21:26.597 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "device_url", 2024-09-19T08:21:26.598 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.598 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.598 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.598 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T08:21:26.598 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.598 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.598 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.598 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.598 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.598 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.598 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.598 INFO:teuthology.orchestra.run.smithi027.stdout: "enabled": { 2024-09-19T08:21:26.599 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enabled", 2024-09-19T08:21:26.599 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.599 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.599 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.599 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.599 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.599 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.599 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.599 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.599 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.599 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.599 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.600 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-19T08:21:26.600 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-19T08:21:26.600 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.600 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.600 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.600 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "24", 2024-09-19T08:21:26.600 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "8", 2024-09-19T08:21:26.600 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.600 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.600 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.600 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.600 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.601 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.601 INFO:teuthology.orchestra.run.smithi027.stdout: "last_opt_revision": { 2024-09-19T08:21:26.601 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "last_opt_revision", 2024-09-19T08:21:26.601 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.601 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.601 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.601 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "1", 2024-09-19T08:21:26.601 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.601 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.602 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.602 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.602 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.602 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.602 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.602 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.602 INFO:teuthology.orchestra.run.smithi027.stdout: "leaderboard": { 2024-09-19T08:21:26.602 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "leaderboard", 2024-09-19T08:21:26.602 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.602 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.602 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.602 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.602 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.603 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.603 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.603 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.603 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.603 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.603 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.603 INFO:teuthology.orchestra.run.smithi027.stdout: "leaderboard_description": { 2024-09-19T08:21:26.603 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "leaderboard_description", 2024-09-19T08:21:26.603 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.603 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.603 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.603 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.604 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.604 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.604 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.604 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.604 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.604 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.604 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.604 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.604 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.604 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.604 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.605 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.605 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.605 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.605 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.605 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.605 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.605 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.605 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.605 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.605 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.605 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.605 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.606 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.606 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.606 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.606 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.606 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.606 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.606 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.606 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.606 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.606 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.606 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.607 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.607 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.607 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.607 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.607 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.607 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.607 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.607 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.607 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.607 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.607 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.607 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.608 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.608 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.608 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.608 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.608 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.608 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.608 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.608 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.608 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.608 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.608 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.608 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.608 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.609 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.609 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.609 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.609 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.609 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.609 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.609 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.609 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.609 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.609 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.609 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.612 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.612 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.612 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.612 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.612 INFO:teuthology.orchestra.run.smithi027.stdout: "organization": { 2024-09-19T08:21:26.612 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "organization", 2024-09-19T08:21:26.612 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.612 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.613 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.613 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.613 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.613 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.613 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.613 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.613 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.613 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.613 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.613 INFO:teuthology.orchestra.run.smithi027.stdout: "proxy": { 2024-09-19T08:21:26.614 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "proxy", 2024-09-19T08:21:26.614 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.614 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.614 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.614 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.614 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.614 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.614 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.614 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.614 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.614 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.615 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.615 INFO:teuthology.orchestra.run.smithi027.stdout: "url": { 2024-09-19T08:21:26.615 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "url", 2024-09-19T08:21:26.615 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.615 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.615 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.615 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T08:21:26.615 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.615 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.615 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.615 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.616 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.616 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.616 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.616 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.616 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.616 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.616 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "test_orchestrator", 2024-09-19T08:21:26.616 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.616 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.616 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.617 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.617 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.617 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.617 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.617 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.617 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.617 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.617 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.617 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.617 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.617 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.617 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.618 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.618 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.618 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.618 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.618 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.618 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.618 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.618 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.618 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.618 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.618 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.618 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.619 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.619 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.619 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.619 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.619 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.619 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.619 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.619 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.619 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.619 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.619 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.619 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.620 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.620 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.620 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.620 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.620 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.620 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.620 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.620 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.620 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.620 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.621 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.621 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.621 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.621 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.621 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.621 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.621 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.621 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.621 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.621 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.621 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.621 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.623 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "volumes", 2024-09-19T08:21:26.623 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.623 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.623 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.623 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.623 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.623 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.623 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.623 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.623 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.623 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.623 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.624 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.624 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.624 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.624 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.624 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.624 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.624 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.624 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.624 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.624 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.624 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.624 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.625 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.625 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.625 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.625 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.625 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.625 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.625 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.625 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.625 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.625 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.626 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.626 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.626 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.626 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.626 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.626 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.626 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.626 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.626 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.627 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.627 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.627 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.627 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.627 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.627 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.627 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.627 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.627 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.627 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.627 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.628 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.628 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.628 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.628 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.628 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.628 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.628 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.628 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.628 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.628 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.628 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.629 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.629 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.629 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.629 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.629 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.629 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.629 INFO:teuthology.orchestra.run.smithi027.stdout: "max_concurrent_clones": { 2024-09-19T08:21:26.629 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_concurrent_clones", 2024-09-19T08:21:26.629 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.630 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.630 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.630 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "4", 2024-09-19T08:21:26.630 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.630 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.630 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.630 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T08:21:26.630 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.630 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.630 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.631 INFO:teuthology.orchestra.run.smithi027.stdout: "periodic_async_work": { 2024-09-19T08:21:26.631 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "periodic_async_work", 2024-09-19T08:21:26.631 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.631 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.631 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.631 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.631 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.631 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.631 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.631 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Periodically check for async work", 2024-09-19T08:21:26.632 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.632 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.632 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.632 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot_clone_delay": { 2024-09-19T08:21:26.632 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "snapshot_clone_delay", 2024-09-19T08:21:26.632 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.632 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.632 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.632 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-19T08:21:26.632 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.632 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.633 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.633 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T08:21:26.633 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.633 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.633 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.633 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot_clone_no_wait": { 2024-09-19T08:21:26.633 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T08:21:26.633 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.633 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.634 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.634 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.634 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.634 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.634 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.634 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T08:21:26.634 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.634 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.634 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.634 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.634 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.635 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.635 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix", 2024-09-19T08:21:26.635 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.635 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.635 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.635 INFO:teuthology.orchestra.run.smithi027.stdout: "discovery_interval": { 2024-09-19T08:21:26.635 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "discovery_interval", 2024-09-19T08:21:26.635 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-19T08:21:26.635 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.636 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.636 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "100", 2024-09-19T08:21:26.636 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.636 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.636 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.636 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.636 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.636 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.636 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.636 INFO:teuthology.orchestra.run.smithi027.stdout: "identifier": { 2024-09-19T08:21:26.637 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "identifier", 2024-09-19T08:21:26.637 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.637 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.637 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.637 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.637 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.637 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.637 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.637 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.637 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.637 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.638 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.638 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-19T08:21:26.638 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-19T08:21:26.638 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.638 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.638 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.638 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-19T08:21:26.638 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.638 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.638 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.639 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.639 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.639 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.639 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.639 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.639 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.639 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.639 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.639 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.639 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.640 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.640 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.640 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.640 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.640 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.640 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.640 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.640 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.640 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.640 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.641 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.641 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.641 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.641 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.641 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.641 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.641 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.641 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.641 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.642 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.642 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.642 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.642 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.642 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.642 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.642 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.642 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.642 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.642 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.642 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.643 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.643 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.643 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.643 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.643 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.643 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.643 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.643 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.643 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.643 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.643 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.643 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.644 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.644 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.644 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.644 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.644 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.644 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.644 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.644 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.645 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.645 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.645 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.645 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.645 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.645 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.645 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.645 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.645 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.645 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.645 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.646 INFO:teuthology.orchestra.run.smithi027.stdout: "zabbix_host": { 2024-09-19T08:21:26.646 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix_host", 2024-09-19T08:21:26.646 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.646 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.646 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.646 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.646 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.646 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.646 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.646 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.647 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.647 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.647 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.647 INFO:teuthology.orchestra.run.smithi027.stdout: "zabbix_port": { 2024-09-19T08:21:26.647 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix_port", 2024-09-19T08:21:26.647 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.647 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.647 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.647 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10051", 2024-09-19T08:21:26.647 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.648 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.648 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.648 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.648 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.648 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.648 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.648 INFO:teuthology.orchestra.run.smithi027.stdout: "zabbix_sender": { 2024-09-19T08:21:26.648 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix_sender", 2024-09-19T08:21:26.648 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.648 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.649 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.649 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T08:21:26.649 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.649 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.649 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.649 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.649 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.649 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.649 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.650 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.650 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.650 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.650 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-19T08:21:26.650 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.650 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.650 INFO:teuthology.orchestra.run.smithi027.stdout: "modules": [ 2024-09-19T08:21:26.650 INFO:teuthology.orchestra.run.smithi027.stdout: "cephadm", 2024-09-19T08:21:26.650 INFO:teuthology.orchestra.run.smithi027.stdout: "dashboard", 2024-09-19T08:21:26.650 INFO:teuthology.orchestra.run.smithi027.stdout: "iostat", 2024-09-19T08:21:26.650 INFO:teuthology.orchestra.run.smithi027.stdout: "nfs", 2024-09-19T08:21:26.650 INFO:teuthology.orchestra.run.smithi027.stdout: "restful", 2024-09-19T08:21:26.651 INFO:teuthology.orchestra.run.smithi027.stdout: "snap_schedule" 2024-09-19T08:21:26.651 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.651 INFO:teuthology.orchestra.run.smithi027.stdout: "available_modules": [ 2024-09-19T08:21:26.651 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.651 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "alerts", 2024-09-19T08:21:26.651 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.651 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.651 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.651 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-19T08:21:26.651 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-19T08:21:26.651 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.652 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.652 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.652 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-19T08:21:26.652 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.652 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.652 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.652 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T08:21:26.652 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.652 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.652 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.653 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.653 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.653 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.653 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.653 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.653 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.653 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.653 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.653 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.653 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.653 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.654 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.654 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.654 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.654 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.654 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.654 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.654 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.654 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.654 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.655 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.655 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.655 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.655 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.655 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.655 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.655 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.655 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.655 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.655 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.655 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.656 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.656 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.656 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.656 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.656 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.656 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.656 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.656 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.656 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.656 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.657 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.657 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.657 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.657 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.657 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.657 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.657 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.657 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.657 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.657 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.657 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.657 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.658 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.658 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.658 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.658 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.658 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.658 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.658 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.658 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.658 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.658 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.659 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.659 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.659 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.659 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_destination": { 2024-09-19T08:21:26.659 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_destination", 2024-09-19T08:21:26.659 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.659 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.659 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.659 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.659 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.659 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.660 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.660 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Email address to send alerts to", 2024-09-19T08:21:26.660 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.660 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.660 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.660 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_from_name": { 2024-09-19T08:21:26.660 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_from_name", 2024-09-19T08:21:26.660 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.660 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.660 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.661 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "Ceph", 2024-09-19T08:21:26.661 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.661 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.661 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.661 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Email From: name", 2024-09-19T08:21:26.661 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.661 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.661 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.661 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_host": { 2024-09-19T08:21:26.661 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_host", 2024-09-19T08:21:26.662 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.662 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.662 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.662 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.662 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.662 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.662 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.662 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SMTP server", 2024-09-19T08:21:26.662 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.662 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.662 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.663 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_password": { 2024-09-19T08:21:26.663 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_password", 2024-09-19T08:21:26.663 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.663 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.663 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.663 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.663 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.663 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.663 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.663 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Password to authenticate with", 2024-09-19T08:21:26.663 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.663 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.663 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.664 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_port": { 2024-09-19T08:21:26.664 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_port", 2024-09-19T08:21:26.664 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.664 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.664 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.664 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "465", 2024-09-19T08:21:26.664 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.664 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.664 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.664 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SMTP port", 2024-09-19T08:21:26.665 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.665 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.665 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.665 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_sender": { 2024-09-19T08:21:26.665 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_sender", 2024-09-19T08:21:26.665 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.665 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.665 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.665 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.665 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.666 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.666 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.666 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SMTP envelope sender", 2024-09-19T08:21:26.666 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.666 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.666 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.666 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_ssl": { 2024-09-19T08:21:26.666 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_ssl", 2024-09-19T08:21:26.666 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.666 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.667 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.667 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.667 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.667 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.667 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.667 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T08:21:26.667 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.667 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.667 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.667 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_user": { 2024-09-19T08:21:26.667 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_user", 2024-09-19T08:21:26.667 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.668 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.668 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.668 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.668 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.668 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.668 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.668 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "User to authenticate as", 2024-09-19T08:21:26.668 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.668 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.668 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.668 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.669 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.669 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "balancer", 2024-09-19T08:21:26.669 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.669 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.669 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.669 INFO:teuthology.orchestra.run.smithi027.stdout: "active": { 2024-09-19T08:21:26.669 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "active", 2024-09-19T08:21:26.669 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.669 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.670 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.670 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.670 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.670 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.670 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.670 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T08:21:26.670 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.670 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.670 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.671 INFO:teuthology.orchestra.run.smithi027.stdout: "begin_time": { 2024-09-19T08:21:26.671 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "begin_time", 2024-09-19T08:21:26.671 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.671 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.671 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.671 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0000", 2024-09-19T08:21:26.671 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.671 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.671 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.671 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T08:21:26.672 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:21:26.672 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.672 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.672 INFO:teuthology.orchestra.run.smithi027.stdout: "begin_weekday": { 2024-09-19T08:21:26.672 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "begin_weekday", 2024-09-19T08:21:26.672 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-19T08:21:26.672 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.672 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.672 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-19T08:21:26.672 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "0", 2024-09-19T08:21:26.672 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "6", 2024-09-19T08:21:26.673 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.673 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T08:21:26.673 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:21:26.673 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.673 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.673 INFO:teuthology.orchestra.run.smithi027.stdout: "crush_compat_max_iterations": { 2024-09-19T08:21:26.673 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crush_compat_max_iterations", 2024-09-19T08:21:26.673 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-19T08:21:26.673 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.673 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.674 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "25", 2024-09-19T08:21:26.674 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-19T08:21:26.674 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "250", 2024-09-19T08:21:26.674 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.674 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T08:21:26.674 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.674 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.674 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.674 INFO:teuthology.orchestra.run.smithi027.stdout: "crush_compat_metrics": { 2024-09-19T08:21:26.674 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crush_compat_metrics", 2024-09-19T08:21:26.674 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.674 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.675 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.675 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T08:21:26.675 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.675 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.675 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.675 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T08:21:26.675 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T08:21:26.675 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.675 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.675 INFO:teuthology.orchestra.run.smithi027.stdout: "crush_compat_step": { 2024-09-19T08:21:26.675 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crush_compat_step", 2024-09-19T08:21:26.675 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:26.676 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.676 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.676 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0.5", 2024-09-19T08:21:26.676 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "0.001", 2024-09-19T08:21:26.676 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "0.999", 2024-09-19T08:21:26.676 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.676 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "aggressiveness of optimization", 2024-09-19T08:21:26.676 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T08:21:26.676 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.676 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.677 INFO:teuthology.orchestra.run.smithi027.stdout: "end_time": { 2024-09-19T08:21:26.677 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "end_time", 2024-09-19T08:21:26.677 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.677 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.677 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.677 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "2359", 2024-09-19T08:21:26.677 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.677 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.677 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.677 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T08:21:26.677 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:21:26.678 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.678 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.678 INFO:teuthology.orchestra.run.smithi027.stdout: "end_weekday": { 2024-09-19T08:21:26.678 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "end_weekday", 2024-09-19T08:21:26.678 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-19T08:21:26.678 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.678 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.678 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-19T08:21:26.678 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "0", 2024-09-19T08:21:26.678 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "6", 2024-09-19T08:21:26.678 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.679 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T08:21:26.679 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:21:26.679 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.679 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.679 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.679 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.679 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.679 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.679 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.679 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.679 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.679 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.680 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.680 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.680 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.680 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.680 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.680 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.680 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.680 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.680 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.680 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.680 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.681 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.681 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.681 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.681 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.681 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.681 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.681 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.681 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.681 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.681 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.681 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.682 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.682 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.682 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.682 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.682 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.682 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.682 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.682 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.682 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.682 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.682 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.683 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.683 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.683 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.683 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.683 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.683 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.683 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.683 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.683 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.683 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.683 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.684 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.684 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.684 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.684 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.684 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.684 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.684 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.684 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.684 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.684 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.685 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.685 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.685 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.685 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.685 INFO:teuthology.orchestra.run.smithi027.stdout: "min_score": { 2024-09-19T08:21:26.685 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "min_score", 2024-09-19T08:21:26.685 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:26.685 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.685 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.686 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-19T08:21:26.686 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.686 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.686 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.686 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T08:21:26.686 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.686 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.686 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.686 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.686 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": { 2024-09-19T08:21:26.686 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mode", 2024-09-19T08:21:26.687 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.687 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.687 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.687 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "upmap", 2024-09-19T08:21:26.687 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.687 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.687 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.687 INFO:teuthology.orchestra.run.smithi027.stdout: "crush-compat", 2024-09-19T08:21:26.687 INFO:teuthology.orchestra.run.smithi027.stdout: "none", 2024-09-19T08:21:26.687 INFO:teuthology.orchestra.run.smithi027.stdout: "read", 2024-09-19T08:21:26.688 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap", 2024-09-19T08:21:26.688 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap-read" 2024-09-19T08:21:26.688 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.688 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Balancer mode", 2024-09-19T08:21:26.688 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.688 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.688 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.688 INFO:teuthology.orchestra.run.smithi027.stdout: "pool_ids": { 2024-09-19T08:21:26.688 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pool_ids", 2024-09-19T08:21:26.689 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.689 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.689 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.689 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.689 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.689 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.689 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.689 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T08:21:26.689 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.689 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.689 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.690 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-19T08:21:26.690 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-19T08:21:26.690 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.690 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.690 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.690 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-19T08:21:26.690 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.690 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.690 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.690 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T08:21:26.690 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.691 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.691 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.691 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.691 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap_max_deviation": { 2024-09-19T08:21:26.691 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "upmap_max_deviation", 2024-09-19T08:21:26.691 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.691 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.691 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.691 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-19T08:21:26.692 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-19T08:21:26.692 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.692 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.692 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T08:21:26.692 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T08:21:26.692 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.692 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.692 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap_max_optimizations": { 2024-09-19T08:21:26.692 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "upmap_max_optimizations", 2024-09-19T08:21:26.692 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-19T08:21:26.693 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.693 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.693 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:26.693 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.693 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.693 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.693 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T08:21:26.693 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.693 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.693 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.693 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.694 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.694 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.694 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.694 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cephadm", 2024-09-19T08:21:26.694 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.694 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.694 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.694 INFO:teuthology.orchestra.run.smithi027.stdout: "agent_down_multiplier": { 2024-09-19T08:21:26.694 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "agent_down_multiplier", 2024-09-19T08:21:26.694 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:26.694 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.695 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.695 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "3.0", 2024-09-19T08:21:26.695 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.695 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.695 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.695 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T08:21:26.695 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.695 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.695 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.695 INFO:teuthology.orchestra.run.smithi027.stdout: "agent_refresh_rate": { 2024-09-19T08:21:26.695 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "agent_refresh_rate", 2024-09-19T08:21:26.696 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.696 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.696 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.696 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "20", 2024-09-19T08:21:26.696 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.696 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.696 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.696 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T08:21:26.696 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.696 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.696 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.697 INFO:teuthology.orchestra.run.smithi027.stdout: "agent_starting_port": { 2024-09-19T08:21:26.697 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "agent_starting_port", 2024-09-19T08:21:26.697 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.697 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.697 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.697 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "4721", 2024-09-19T08:21:26.697 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.697 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.697 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.697 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T08:21:26.697 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.698 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.698 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.698 INFO:teuthology.orchestra.run.smithi027.stdout: "allow_ptrace": { 2024-09-19T08:21:26.698 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "allow_ptrace", 2024-09-19T08:21:26.698 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.698 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.698 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.698 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.698 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.698 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.698 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.698 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T08:21:26.699 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T08:21:26.699 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.699 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.699 INFO:teuthology.orchestra.run.smithi027.stdout: "autotune_interval": { 2024-09-19T08:21:26.699 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "autotune_interval", 2024-09-19T08:21:26.699 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.699 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.699 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.699 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-19T08:21:26.699 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.699 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.699 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.700 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T08:21:26.700 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.700 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.700 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.700 INFO:teuthology.orchestra.run.smithi027.stdout: "autotune_memory_target_ratio": { 2024-09-19T08:21:26.700 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T08:21:26.700 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:26.700 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.700 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.700 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0.7", 2024-09-19T08:21:26.700 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.701 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.701 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.701 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T08:21:26.701 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.701 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.701 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.701 INFO:teuthology.orchestra.run.smithi027.stdout: "cephadm_log_destination": { 2024-09-19T08:21:26.701 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cephadm_log_destination", 2024-09-19T08:21:26.701 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.701 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.701 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.702 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.702 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.702 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.702 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.702 INFO:teuthology.orchestra.run.smithi027.stdout: "file", 2024-09-19T08:21:26.702 INFO:teuthology.orchestra.run.smithi027.stdout: "file,syslog", 2024-09-19T08:21:26.702 INFO:teuthology.orchestra.run.smithi027.stdout: "syslog" 2024-09-19T08:21:26.702 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.702 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T08:21:26.702 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.702 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.702 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.703 INFO:teuthology.orchestra.run.smithi027.stdout: "cgroups_split": { 2024-09-19T08:21:26.703 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cgroups_split", 2024-09-19T08:21:26.703 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.703 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.703 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.703 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.703 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.703 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.703 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.703 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T08:21:26.703 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.703 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.704 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.704 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.704 INFO:teuthology.orchestra.run.smithi027.stdout: "config_checks_enabled": { 2024-09-19T08:21:26.704 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "config_checks_enabled", 2024-09-19T08:21:26.704 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.704 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.704 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.704 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.704 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.704 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.704 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.705 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T08:21:26.705 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.705 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.705 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.705 INFO:teuthology.orchestra.run.smithi027.stdout: "config_dashboard": { 2024-09-19T08:21:26.705 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "config_dashboard", 2024-09-19T08:21:26.705 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.705 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.705 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.705 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.706 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.706 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.706 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.706 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T08:21:26.706 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.706 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.706 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.706 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_alertmanager": { 2024-09-19T08:21:26.706 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_alertmanager", 2024-09-19T08:21:26.706 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.706 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.707 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.707 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T08:21:26.707 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.707 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.707 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.707 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-19T08:21:26.707 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.707 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.707 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.708 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_base": { 2024-09-19T08:21:26.708 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_base", 2024-09-19T08:21:26.708 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.708 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.708 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.708 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T08:21:26.708 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.708 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.708 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.708 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Container image name, without the tag", 2024-09-19T08:21:26.708 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.709 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.709 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.709 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_elasticsearch": { 2024-09-19T08:21:26.709 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_elasticsearch", 2024-09-19T08:21:26.709 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.709 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.709 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.709 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T08:21:26.709 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.709 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.709 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.710 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "elasticsearch container image", 2024-09-19T08:21:26.710 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.710 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.710 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.710 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_grafana": { 2024-09-19T08:21:26.710 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_grafana", 2024-09-19T08:21:26.710 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.710 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.710 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.710 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T08:21:26.711 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.711 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.711 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.711 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-19T08:21:26.711 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.711 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.711 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.711 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_haproxy": { 2024-09-19T08:21:26.711 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_haproxy", 2024-09-19T08:21:26.711 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.711 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.711 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.712 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T08:21:26.712 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.712 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.712 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.712 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "HAproxy container image", 2024-09-19T08:21:26.712 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.712 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.712 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.712 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_jaeger_agent": { 2024-09-19T08:21:26.712 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_jaeger_agent", 2024-09-19T08:21:26.712 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.712 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.713 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.713 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T08:21:26.713 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.713 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.713 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.713 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Jaeger agent container image", 2024-09-19T08:21:26.713 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.713 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.713 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.713 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.713 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_jaeger_collector": { 2024-09-19T08:21:26.713 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_jaeger_collector", 2024-09-19T08:21:26.714 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.714 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.714 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.714 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T08:21:26.714 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.714 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.714 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.714 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Jaeger collector container image", 2024-09-19T08:21:26.714 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.714 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.714 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.714 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.715 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_jaeger_query": { 2024-09-19T08:21:26.715 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_jaeger_query", 2024-09-19T08:21:26.715 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.715 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.715 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.715 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T08:21:26.715 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.715 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.715 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.715 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Jaeger query container image", 2024-09-19T08:21:26.715 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.715 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.715 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.716 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_keepalived": { 2024-09-19T08:21:26.716 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_keepalived", 2024-09-19T08:21:26.716 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.716 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.716 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.716 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T08:21:26.716 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.716 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.716 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.716 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Keepalived container image", 2024-09-19T08:21:26.716 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.717 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.717 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.717 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_loki": { 2024-09-19T08:21:26.717 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_loki", 2024-09-19T08:21:26.717 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.717 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.717 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.717 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T08:21:26.717 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.717 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.718 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.718 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Loki container image", 2024-09-19T08:21:26.718 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.718 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.718 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.718 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_node_exporter": { 2024-09-19T08:21:26.718 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_node_exporter", 2024-09-19T08:21:26.718 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.718 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.718 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.718 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T08:21:26.719 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.719 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.719 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.719 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-19T08:21:26.719 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.719 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.719 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.719 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_nvmeof": { 2024-09-19T08:21:26.719 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_nvmeof", 2024-09-19T08:21:26.719 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.719 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.720 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.720 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T08:21:26.720 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.720 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.720 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.720 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Nvme-of container image", 2024-09-19T08:21:26.720 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.720 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.720 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.720 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.721 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_prometheus": { 2024-09-19T08:21:26.721 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_prometheus", 2024-09-19T08:21:26.721 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.721 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.721 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.721 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T08:21:26.721 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.721 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.721 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.721 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-19T08:21:26.721 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.721 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.722 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.722 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_promtail": { 2024-09-19T08:21:26.722 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_promtail", 2024-09-19T08:21:26.722 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.722 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.722 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.722 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T08:21:26.722 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.722 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.723 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.723 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Promtail container image", 2024-09-19T08:21:26.723 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.723 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.723 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.723 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_samba": { 2024-09-19T08:21:26.723 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_samba", 2024-09-19T08:21:26.723 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.723 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.723 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.723 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T08:21:26.724 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.724 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.724 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.724 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Samba/SMB container image", 2024-09-19T08:21:26.724 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.724 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.724 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.724 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_snmp_gateway": { 2024-09-19T08:21:26.724 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_snmp_gateway", 2024-09-19T08:21:26.724 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.724 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.725 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.725 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T08:21:26.725 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.725 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.725 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.725 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SNMP Gateway container image", 2024-09-19T08:21:26.725 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.725 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.725 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.726 INFO:teuthology.orchestra.run.smithi027.stdout: "container_init": { 2024-09-19T08:21:26.726 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_init", 2024-09-19T08:21:26.726 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.726 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.726 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.726 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.726 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.726 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.726 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.726 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T08:21:26.727 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.727 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.727 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.727 INFO:teuthology.orchestra.run.smithi027.stdout: "daemon_cache_timeout": { 2024-09-19T08:21:26.727 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "daemon_cache_timeout", 2024-09-19T08:21:26.727 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.727 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.727 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.727 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-19T08:21:26.727 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.727 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.728 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.728 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T08:21:26.728 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.728 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.728 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.728 INFO:teuthology.orchestra.run.smithi027.stdout: "default_cephadm_command_timeout": { 2024-09-19T08:21:26.728 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T08:21:26.728 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.728 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.728 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.729 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "900", 2024-09-19T08:21:26.729 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.729 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.729 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.729 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T08:21:26.729 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.729 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.729 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.729 INFO:teuthology.orchestra.run.smithi027.stdout: "default_registry": { 2024-09-19T08:21:26.729 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "default_registry", 2024-09-19T08:21:26.730 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.730 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.730 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.730 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io", 2024-09-19T08:21:26.730 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.730 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.730 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.730 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T08:21:26.730 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.730 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.730 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.730 INFO:teuthology.orchestra.run.smithi027.stdout: "device_cache_timeout": { 2024-09-19T08:21:26.731 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "device_cache_timeout", 2024-09-19T08:21:26.731 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.731 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.731 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.731 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "1800", 2024-09-19T08:21:26.731 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.731 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.731 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.731 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "seconds to cache device inventory", 2024-09-19T08:21:26.731 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.731 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.731 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.732 INFO:teuthology.orchestra.run.smithi027.stdout: "device_enhanced_scan": { 2024-09-19T08:21:26.732 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "device_enhanced_scan", 2024-09-19T08:21:26.732 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.732 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.732 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.732 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.732 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.732 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.732 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.732 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T08:21:26.732 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.732 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.733 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.733 INFO:teuthology.orchestra.run.smithi027.stdout: "facts_cache_timeout": { 2024-09-19T08:21:26.733 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "facts_cache_timeout", 2024-09-19T08:21:26.733 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.733 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.733 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.733 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-19T08:21:26.733 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.733 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.733 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.734 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "seconds to cache host facts data", 2024-09-19T08:21:26.734 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.734 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.734 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.734 INFO:teuthology.orchestra.run.smithi027.stdout: "grafana_dashboards_path": { 2024-09-19T08:21:26.734 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "grafana_dashboards_path", 2024-09-19T08:21:26.734 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.734 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.734 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.734 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T08:21:26.734 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.735 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.735 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.735 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T08:21:26.735 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.735 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.735 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.735 INFO:teuthology.orchestra.run.smithi027.stdout: "host_check_interval": { 2024-09-19T08:21:26.735 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "host_check_interval", 2024-09-19T08:21:26.735 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.735 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.735 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.736 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-19T08:21:26.736 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.736 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.736 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.736 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to perform a host check", 2024-09-19T08:21:26.736 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.736 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.736 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.736 INFO:teuthology.orchestra.run.smithi027.stdout: "hw_monitoring": { 2024-09-19T08:21:26.736 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "hw_monitoring", 2024-09-19T08:21:26.736 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.737 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.737 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.737 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.737 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.737 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.737 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.737 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T08:21:26.737 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.737 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.737 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.737 INFO:teuthology.orchestra.run.smithi027.stdout: "inventory_list_all": { 2024-09-19T08:21:26.738 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "inventory_list_all", 2024-09-19T08:21:26.738 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.738 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.738 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.738 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.738 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.738 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.738 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.738 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T08:21:26.738 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.738 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.738 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.738 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.739 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.739 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.739 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.739 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.739 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.739 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.739 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.739 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.739 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.739 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.740 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.740 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.740 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.740 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.740 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.740 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.740 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.740 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.740 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.740 INFO:teuthology.orchestra.run.smithi027.stdout: "log_refresh_metadata": { 2024-09-19T08:21:26.740 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_refresh_metadata", 2024-09-19T08:21:26.741 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.741 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.741 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.741 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.741 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.741 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.741 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.741 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T08:21:26.741 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.741 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.741 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.742 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.742 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.742 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.742 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.742 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.742 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.742 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.742 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.742 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.742 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T08:21:26.742 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.742 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.743 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.743 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.743 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.743 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.743 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.743 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.743 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.743 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.743 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.743 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.743 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.744 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.744 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.744 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.744 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.744 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.744 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.744 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.744 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.744 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.744 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.744 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.744 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.745 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.745 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.745 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.745 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.745 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.745 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.745 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.745 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.745 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.745 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.745 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.746 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.746 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.746 INFO:teuthology.orchestra.run.smithi027.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T08:21:26.746 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T08:21:26.746 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.746 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.746 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.746 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.746 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.746 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.746 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.747 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T08:21:26.747 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.747 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.747 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.747 INFO:teuthology.orchestra.run.smithi027.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T08:21:26.747 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T08:21:26.747 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.747 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.747 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.747 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "*", 2024-09-19T08:21:26.747 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.747 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.748 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.748 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T08:21:26.748 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.748 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.748 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.748 INFO:teuthology.orchestra.run.smithi027.stdout: "max_count_per_host": { 2024-09-19T08:21:26.748 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_count_per_host", 2024-09-19T08:21:26.748 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.748 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.748 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.748 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:26.749 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.749 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.749 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.749 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "max number of daemons per service per host", 2024-09-19T08:21:26.749 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.749 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.749 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.749 INFO:teuthology.orchestra.run.smithi027.stdout: "max_osd_draining_count": { 2024-09-19T08:21:26.749 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_osd_draining_count", 2024-09-19T08:21:26.749 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.749 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.750 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.750 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:26.750 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.750 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.750 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.750 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T08:21:26.750 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.750 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.750 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.750 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.750 INFO:teuthology.orchestra.run.smithi027.stdout: "migration_current": { 2024-09-19T08:21:26.751 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "migration_current", 2024-09-19T08:21:26.751 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.751 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.751 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.751 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.751 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.751 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.751 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.751 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "internal - do not modify", 2024-09-19T08:21:26.751 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.752 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.752 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.752 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.752 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": { 2024-09-19T08:21:26.752 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mode", 2024-09-19T08:21:26.752 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.752 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.752 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.752 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "root", 2024-09-19T08:21:26.752 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.753 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.753 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.753 INFO:teuthology.orchestra.run.smithi027.stdout: "cephadm-package", 2024-09-19T08:21:26.753 INFO:teuthology.orchestra.run.smithi027.stdout: "root" 2024-09-19T08:21:26.753 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.753 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T08:21:26.753 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.753 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.753 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.753 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.753 INFO:teuthology.orchestra.run.smithi027.stdout: "oob_default_addr": { 2024-09-19T08:21:26.753 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "oob_default_addr", 2024-09-19T08:21:26.754 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.754 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.754 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.754 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "169.254.1.1", 2024-09-19T08:21:26.754 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.754 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.754 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.754 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T08:21:26.754 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.754 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.754 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.755 INFO:teuthology.orchestra.run.smithi027.stdout: "prometheus_alerts_path": { 2024-09-19T08:21:26.755 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "prometheus_alerts_path", 2024-09-19T08:21:26.755 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.755 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.755 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.755 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T08:21:26.755 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.755 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.755 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.755 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T08:21:26.756 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.756 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.756 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.756 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_insecure": { 2024-09-19T08:21:26.756 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_insecure", 2024-09-19T08:21:26.756 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.756 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.756 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.756 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.757 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.757 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.757 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.757 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T08:21:26.757 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.757 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.757 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.757 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_password": { 2024-09-19T08:21:26.758 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_password", 2024-09-19T08:21:26.758 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.758 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.758 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.758 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.758 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.758 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.758 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.758 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T08:21:26.758 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.758 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.759 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.759 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_url": { 2024-09-19T08:21:26.759 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_url", 2024-09-19T08:21:26.759 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.759 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.759 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.759 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.759 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.760 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.760 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.760 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T08:21:26.760 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.760 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.760 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.760 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.760 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_username": { 2024-09-19T08:21:26.760 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_username", 2024-09-19T08:21:26.760 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.761 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.761 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.761 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.761 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.761 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.761 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.761 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T08:21:26.761 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.762 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.762 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.762 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.762 INFO:teuthology.orchestra.run.smithi027.stdout: "secure_monitoring_stack": { 2024-09-19T08:21:26.762 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "secure_monitoring_stack", 2024-09-19T08:21:26.762 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.762 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.762 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.762 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.762 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.762 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.763 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.763 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T08:21:26.763 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.763 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.763 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.763 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.763 INFO:teuthology.orchestra.run.smithi027.stdout: "service_discovery_port": { 2024-09-19T08:21:26.763 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "service_discovery_port", 2024-09-19T08:21:26.763 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.763 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.764 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.764 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8765", 2024-09-19T08:21:26.764 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.764 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.764 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.764 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "cephadm service discovery port", 2024-09-19T08:21:26.764 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.764 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.764 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.764 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.765 INFO:teuthology.orchestra.run.smithi027.stdout: "ssh_config_file": { 2024-09-19T08:21:26.765 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssh_config_file", 2024-09-19T08:21:26.765 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.765 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.765 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.765 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.765 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.765 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.765 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.765 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T08:21:26.765 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.766 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.766 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.766 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.766 INFO:teuthology.orchestra.run.smithi027.stdout: "use_agent": { 2024-09-19T08:21:26.766 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "use_agent", 2024-09-19T08:21:26.766 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.766 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.766 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.766 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.766 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.766 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.767 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.767 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T08:21:26.767 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.767 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.767 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.767 INFO:teuthology.orchestra.run.smithi027.stdout: "use_repo_digest": { 2024-09-19T08:21:26.767 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "use_repo_digest", 2024-09-19T08:21:26.767 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.767 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.767 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.767 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.768 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.768 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.768 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.768 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T08:21:26.768 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.768 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.768 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.768 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_on_failed_host_check": { 2024-09-19T08:21:26.769 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_on_failed_host_check", 2024-09-19T08:21:26.769 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.769 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.769 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.769 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.769 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.769 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.769 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.769 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T08:21:26.769 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.769 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.770 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.770 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.770 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_on_stray_daemons": { 2024-09-19T08:21:26.770 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_on_stray_daemons", 2024-09-19T08:21:26.770 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.770 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.770 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.770 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.770 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.770 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.770 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.770 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T08:21:26.771 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.771 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.771 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.771 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.771 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_on_stray_hosts": { 2024-09-19T08:21:26.771 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_on_stray_hosts", 2024-09-19T08:21:26.771 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.771 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.771 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.771 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.771 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.772 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.772 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.772 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T08:21:26.772 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.772 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.772 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.772 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.772 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.772 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.772 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crash", 2024-09-19T08:21:26.772 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.773 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.773 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.773 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.773 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.773 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.773 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.773 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.773 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.773 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.773 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.773 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.773 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.774 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.774 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.774 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.774 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.774 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.774 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.774 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.774 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.774 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.774 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.774 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.774 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.775 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.775 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.775 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.775 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.775 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.775 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.775 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.775 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.775 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.775 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.775 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.776 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.776 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.776 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.776 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.776 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.776 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.776 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.776 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.776 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.776 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.776 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.776 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.777 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.777 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.777 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.777 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.777 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.777 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.777 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.777 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.777 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.777 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.777 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.778 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.778 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.778 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.778 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.778 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.778 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.778 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.778 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.778 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.778 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.778 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.778 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.779 INFO:teuthology.orchestra.run.smithi027.stdout: "retain_interval": { 2024-09-19T08:21:26.779 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "retain_interval", 2024-09-19T08:21:26.779 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.779 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.779 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.779 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "31536000", 2024-09-19T08:21:26.779 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.779 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.779 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.779 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T08:21:26.779 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.779 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.780 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.780 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_recent_interval": { 2024-09-19T08:21:26.780 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_recent_interval", 2024-09-19T08:21:26.780 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.780 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.780 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.780 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "1209600", 2024-09-19T08:21:26.780 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.780 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.780 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.781 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T08:21:26.781 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.781 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.781 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.781 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.781 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.781 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.781 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "dashboard", 2024-09-19T08:21:26.781 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.782 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.782 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.782 INFO:teuthology.orchestra.run.smithi027.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T08:21:26.782 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T08:21:26.782 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.782 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.782 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.782 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:26.782 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.782 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.782 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.783 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.783 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.783 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.783 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.783 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.783 INFO:teuthology.orchestra.run.smithi027.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T08:21:26.783 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T08:21:26.783 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.783 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.783 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.783 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.784 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.784 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.784 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.784 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.784 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.784 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.784 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.784 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.784 INFO:teuthology.orchestra.run.smithi027.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T08:21:26.784 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T08:21:26.784 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.785 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.785 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.785 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.785 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.785 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.785 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.785 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.785 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.785 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.785 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.785 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.786 INFO:teuthology.orchestra.run.smithi027.stdout: "AUDIT_API_ENABLED": { 2024-09-19T08:21:26.786 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T08:21:26.786 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.786 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.786 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.786 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.786 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.786 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.786 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.786 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.786 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.787 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.787 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.787 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.787 INFO:teuthology.orchestra.run.smithi027.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T08:21:26.787 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T08:21:26.787 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.787 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.787 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.787 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.787 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.787 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.788 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.788 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.788 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.788 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.788 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.788 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.788 INFO:teuthology.orchestra.run.smithi027.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T08:21:26.788 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T08:21:26.788 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.788 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.788 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.789 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.789 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.789 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.789 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.789 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.789 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.789 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.789 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.789 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.789 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T08:21:26.789 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T08:21:26.789 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.789 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.790 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.790 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.790 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.790 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.790 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.790 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.790 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.790 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.790 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.790 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.790 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T08:21:26.790 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T08:21:26.791 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.791 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.791 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.791 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.791 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.791 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.791 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.791 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.791 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.791 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.791 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.792 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T08:21:26.792 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T08:21:26.792 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.792 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.792 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.792 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.792 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.792 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.792 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.792 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.792 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.793 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.793 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.793 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.793 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T08:21:26.793 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T08:21:26.793 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.793 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.793 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.793 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.793 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.794 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.794 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.794 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.794 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.794 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.794 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.794 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.794 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T08:21:26.794 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T08:21:26.794 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.794 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.794 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.795 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.795 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.795 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.795 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.795 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.795 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.795 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.795 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.795 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.795 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T08:21:26.796 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T08:21:26.796 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.796 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.796 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.796 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.796 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.796 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.796 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.796 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.796 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.796 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.797 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.797 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T08:21:26.797 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T08:21:26.797 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.797 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.797 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.797 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.797 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.797 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.797 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.798 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.798 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.798 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.798 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.798 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.798 INFO:teuthology.orchestra.run.smithi027.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T08:21:26.798 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T08:21:26.798 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.798 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.798 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.799 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.799 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.799 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.799 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.799 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.799 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.799 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.799 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.799 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.799 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T08:21:26.800 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T08:21:26.800 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.800 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.800 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.800 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "admin", 2024-09-19T08:21:26.800 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.800 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.800 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.800 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.800 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.800 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.801 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.801 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T08:21:26.801 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T08:21:26.801 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.801 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.801 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.801 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.801 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.801 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.801 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.801 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.802 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.802 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.802 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.802 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.802 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_URL": { 2024-09-19T08:21:26.802 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_URL", 2024-09-19T08:21:26.802 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.802 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.802 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.802 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.802 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.802 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.803 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.803 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.803 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.803 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.803 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.803 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.803 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T08:21:26.803 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T08:21:26.803 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.803 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.803 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.804 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "admin", 2024-09-19T08:21:26.804 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.804 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.804 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.804 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.804 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.804 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.804 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.804 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.804 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T08:21:26.804 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T08:21:26.805 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.805 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.805 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.805 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.805 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.805 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.805 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.805 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.805 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.805 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.805 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.805 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.806 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T08:21:26.806 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T08:21:26.806 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.806 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.806 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.806 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.806 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.806 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.806 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.806 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.806 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.807 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.807 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.807 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.807 INFO:teuthology.orchestra.run.smithi027.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T08:21:26.807 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T08:21:26.807 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.807 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.807 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.807 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.807 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.807 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.808 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.808 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.808 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.808 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.808 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.808 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.808 INFO:teuthology.orchestra.run.smithi027.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T08:21:26.808 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T08:21:26.808 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.808 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.808 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.808 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.809 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.809 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.809 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.809 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.809 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.809 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.809 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.809 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.809 INFO:teuthology.orchestra.run.smithi027.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T08:21:26.809 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T08:21:26.810 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.810 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.810 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.810 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.810 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.810 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.810 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.810 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.810 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.810 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.810 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.810 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.810 INFO:teuthology.orchestra.run.smithi027.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T08:21:26.811 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T08:21:26.811 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.811 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.811 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.811 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.811 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.811 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.811 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.811 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.811 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.811 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.811 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.811 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.812 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T08:21:26.812 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T08:21:26.812 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.812 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.812 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.812 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.812 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.812 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.812 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.812 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.812 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.812 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.813 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.813 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T08:21:26.813 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T08:21:26.813 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.813 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.813 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.813 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.813 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.813 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.813 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.813 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.814 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.814 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.814 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.814 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T08:21:26.814 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T08:21:26.814 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.814 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.814 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.814 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.814 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.815 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.815 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.815 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.815 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.815 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.815 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.815 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T08:21:26.815 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T08:21:26.815 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.815 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.816 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.816 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.816 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.816 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.816 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.816 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.816 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.816 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.816 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.816 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T08:21:26.816 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T08:21:26.817 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.817 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.817 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.817 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.817 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.817 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.817 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.817 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.817 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.817 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.817 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.818 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T08:21:26.818 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T08:21:26.818 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.818 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.818 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.818 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.818 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.818 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.818 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.818 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.818 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.818 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.819 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.819 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T08:21:26.819 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T08:21:26.819 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.819 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.819 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.819 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.819 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.819 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.819 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.820 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.820 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.820 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.820 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.820 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T08:21:26.820 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T08:21:26.820 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.820 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.820 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.820 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.821 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.821 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.821 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.821 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.821 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.821 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.821 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.821 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T08:21:26.821 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T08:21:26.821 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.821 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.821 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.822 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T08:21:26.822 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.822 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.822 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.822 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.822 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.822 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.822 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.822 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T08:21:26.822 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T08:21:26.822 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.823 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.823 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.823 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:26.823 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.823 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.823 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.823 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.823 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.823 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.823 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.823 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T08:21:26.823 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T08:21:26.824 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.824 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.824 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.824 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8", 2024-09-19T08:21:26.824 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.824 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.824 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.824 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.824 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.824 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.825 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.825 INFO:teuthology.orchestra.run.smithi027.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T08:21:26.825 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T08:21:26.825 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.825 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.825 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.825 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "45", 2024-09-19T08:21:26.825 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.825 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.826 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.826 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.826 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.826 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.826 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.826 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T08:21:26.826 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T08:21:26.826 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.826 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.826 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.827 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.827 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.827 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.827 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.827 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.827 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.827 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.827 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.827 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T08:21:26.827 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T08:21:26.828 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.828 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.828 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.828 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "admin", 2024-09-19T08:21:26.828 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.828 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.828 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.828 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.828 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.828 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.828 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.829 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T08:21:26.829 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T08:21:26.829 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.829 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.829 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.829 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.829 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.829 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.829 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.829 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.830 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.830 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.830 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.830 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T08:21:26.830 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T08:21:26.830 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.830 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.830 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.830 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.830 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.831 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.831 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.831 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.831 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.831 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.831 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.831 INFO:teuthology.orchestra.run.smithi027.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T08:21:26.831 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T08:21:26.831 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.832 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.832 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.832 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-19T08:21:26.832 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.832 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.832 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.832 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.832 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.832 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.832 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.832 INFO:teuthology.orchestra.run.smithi027.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T08:21:26.833 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T08:21:26.833 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.833 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.833 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.833 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:26.833 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.833 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.833 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.833 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.833 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.833 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.833 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.834 INFO:teuthology.orchestra.run.smithi027.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T08:21:26.834 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T08:21:26.834 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.834 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.834 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.834 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-19T08:21:26.834 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.834 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.834 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.834 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.834 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.834 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.835 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.835 INFO:teuthology.orchestra.run.smithi027.stdout: "cross_origin_url": { 2024-09-19T08:21:26.835 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cross_origin_url", 2024-09-19T08:21:26.835 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.835 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.835 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.835 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.835 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.835 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.835 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.835 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.836 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.836 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.836 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.836 INFO:teuthology.orchestra.run.smithi027.stdout: "crt_file": { 2024-09-19T08:21:26.836 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crt_file", 2024-09-19T08:21:26.836 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.836 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.836 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.836 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.836 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.836 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.837 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.837 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.837 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.837 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.837 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.837 INFO:teuthology.orchestra.run.smithi027.stdout: "debug": { 2024-09-19T08:21:26.837 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "debug", 2024-09-19T08:21:26.837 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.837 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.837 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.838 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.838 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.838 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.838 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.838 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Enable/disable debug options", 2024-09-19T08:21:26.838 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.838 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.838 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.838 INFO:teuthology.orchestra.run.smithi027.stdout: "jwt_token_ttl": { 2024-09-19T08:21:26.838 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "jwt_token_ttl", 2024-09-19T08:21:26.839 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.839 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.839 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.839 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "28800", 2024-09-19T08:21:26.839 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.839 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.839 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.839 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.839 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.839 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.839 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.840 INFO:teuthology.orchestra.run.smithi027.stdout: "key_file": { 2024-09-19T08:21:26.840 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "key_file", 2024-09-19T08:21:26.840 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.840 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.840 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.840 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.840 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.840 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.840 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.840 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.840 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.841 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.841 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.841 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.841 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.841 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.841 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.841 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.841 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.841 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.841 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.842 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.842 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.842 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.842 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.842 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.842 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.842 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.842 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.842 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.842 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.843 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.843 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.843 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.843 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.843 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.843 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.843 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.843 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.843 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.843 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.844 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.844 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.844 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.844 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.844 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.844 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.844 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.844 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.844 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.844 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.845 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.845 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.845 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.845 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.845 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.845 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.845 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.845 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.845 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.845 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.845 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.845 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.846 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.846 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.846 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.846 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.846 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.846 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.846 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.846 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.846 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.846 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.846 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.847 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.847 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.847 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.847 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.847 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.847 INFO:teuthology.orchestra.run.smithi027.stdout: "motd": { 2024-09-19T08:21:26.847 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "motd", 2024-09-19T08:21:26.847 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.847 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.847 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.847 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.848 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.848 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.848 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.848 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "The message of the day", 2024-09-19T08:21:26.848 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.848 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.848 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.848 INFO:teuthology.orchestra.run.smithi027.stdout: "redirect_resolve_ip_addr": { 2024-09-19T08:21:26.848 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T08:21:26.848 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.849 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.849 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.849 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.849 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.849 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.849 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.849 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.849 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.849 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.849 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.849 INFO:teuthology.orchestra.run.smithi027.stdout: "server_addr": { 2024-09-19T08:21:26.850 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_addr", 2024-09-19T08:21:26.850 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.850 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.850 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.850 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "::", 2024-09-19T08:21:26.850 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.850 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.850 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.850 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.850 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.850 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.850 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.851 INFO:teuthology.orchestra.run.smithi027.stdout: "server_port": { 2024-09-19T08:21:26.851 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_port", 2024-09-19T08:21:26.851 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.851 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.851 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.851 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8080", 2024-09-19T08:21:26.851 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.851 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.851 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.851 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.852 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.852 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.852 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.852 INFO:teuthology.orchestra.run.smithi027.stdout: "ssl": { 2024-09-19T08:21:26.852 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssl", 2024-09-19T08:21:26.852 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.852 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.852 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.852 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.852 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.853 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.853 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.853 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.853 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.853 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.853 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.853 INFO:teuthology.orchestra.run.smithi027.stdout: "ssl_server_port": { 2024-09-19T08:21:26.853 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssl_server_port", 2024-09-19T08:21:26.853 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.853 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.853 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.854 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8443", 2024-09-19T08:21:26.854 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.854 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.854 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.854 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.854 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.854 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.854 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.854 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_behaviour": { 2024-09-19T08:21:26.854 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_behaviour", 2024-09-19T08:21:26.854 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.855 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.855 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.855 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "redirect", 2024-09-19T08:21:26.855 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.855 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.855 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.855 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.855 INFO:teuthology.orchestra.run.smithi027.stdout: "redirect" 2024-09-19T08:21:26.855 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.855 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.855 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.856 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.856 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.856 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_error_status_code": { 2024-09-19T08:21:26.856 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_error_status_code", 2024-09-19T08:21:26.856 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.856 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.856 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.856 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "500", 2024-09-19T08:21:26.856 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "400", 2024-09-19T08:21:26.856 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "599", 2024-09-19T08:21:26.857 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.857 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.857 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.857 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.857 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.857 INFO:teuthology.orchestra.run.smithi027.stdout: "url_prefix": { 2024-09-19T08:21:26.857 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "url_prefix", 2024-09-19T08:21:26.857 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.857 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.857 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.857 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.858 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.858 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.858 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.858 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.858 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.858 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.858 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.858 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.858 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.858 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.858 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "devicehealth", 2024-09-19T08:21:26.858 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.859 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.859 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.859 INFO:teuthology.orchestra.run.smithi027.stdout: "enable_monitoring": { 2024-09-19T08:21:26.859 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enable_monitoring", 2024-09-19T08:21:26.859 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.859 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.859 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.859 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.859 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.859 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.859 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.859 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "monitor device health metrics", 2024-09-19T08:21:26.860 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.860 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.860 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.860 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.860 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.860 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.860 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.860 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.860 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.860 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.860 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.861 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.861 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.861 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.861 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.861 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.861 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.861 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.861 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.861 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.861 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.861 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.861 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.862 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.862 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.862 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.862 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.862 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.862 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.862 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.862 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.862 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.862 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.862 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.862 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.863 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.863 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.863 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.863 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.863 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.863 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.863 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.863 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.863 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.863 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.863 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.863 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.864 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.864 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.864 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.864 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.864 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.864 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.864 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.864 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.864 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.864 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.864 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.865 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.865 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.865 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.865 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.865 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.865 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.865 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.865 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.865 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.865 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.866 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.866 INFO:teuthology.orchestra.run.smithi027.stdout: "mark_out_threshold": { 2024-09-19T08:21:26.866 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mark_out_threshold", 2024-09-19T08:21:26.866 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.866 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.866 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.866 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "2419200", 2024-09-19T08:21:26.866 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.866 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.866 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.866 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T08:21:26.866 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.867 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.867 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.867 INFO:teuthology.orchestra.run.smithi027.stdout: "pool_name": { 2024-09-19T08:21:26.867 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pool_name", 2024-09-19T08:21:26.867 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.867 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.867 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.867 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "device_health_metrics", 2024-09-19T08:21:26.867 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.867 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.867 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.867 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T08:21:26.868 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.868 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.868 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.868 INFO:teuthology.orchestra.run.smithi027.stdout: "retention_period": { 2024-09-19T08:21:26.868 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "retention_period", 2024-09-19T08:21:26.868 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.868 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.868 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.868 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "15552000", 2024-09-19T08:21:26.868 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.869 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.869 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.869 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how long to retain device health metrics", 2024-09-19T08:21:26.869 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.869 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.869 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.869 INFO:teuthology.orchestra.run.smithi027.stdout: "scrape_frequency": { 2024-09-19T08:21:26.869 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "scrape_frequency", 2024-09-19T08:21:26.869 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.869 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.869 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.870 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "86400", 2024-09-19T08:21:26.870 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.870 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.870 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.870 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T08:21:26.870 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.870 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.870 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.870 INFO:teuthology.orchestra.run.smithi027.stdout: "self_heal": { 2024-09-19T08:21:26.870 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "self_heal", 2024-09-19T08:21:26.870 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.870 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.871 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.871 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.871 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.871 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.871 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.871 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T08:21:26.871 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.871 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.871 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.871 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-19T08:21:26.871 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-19T08:21:26.872 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.872 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.872 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.872 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-19T08:21:26.872 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.872 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.872 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.872 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T08:21:26.872 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.872 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.872 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.873 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_threshold": { 2024-09-19T08:21:26.873 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_threshold", 2024-09-19T08:21:26.873 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.873 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.873 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.873 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "7257600", 2024-09-19T08:21:26.873 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.873 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.873 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.873 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T08:21:26.874 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.874 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.874 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.874 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.874 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.874 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "diskprediction_local", 2024-09-19T08:21:26.874 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.874 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.874 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.874 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.874 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.875 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.875 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.875 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.875 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.875 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.875 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.875 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.875 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.875 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.875 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.875 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.875 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.876 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.876 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.876 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.876 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.876 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.876 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.876 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.876 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.876 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.876 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.876 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.877 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.877 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.877 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.877 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.877 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.877 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.877 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.877 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.878 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.878 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.878 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.878 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.878 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.878 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.878 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.878 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.878 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.878 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.878 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.878 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.879 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.879 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.879 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.879 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.879 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.879 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.879 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.879 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.879 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.879 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.880 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.880 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.880 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.880 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.880 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.880 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.880 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.880 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.880 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.880 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.880 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.881 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.881 INFO:teuthology.orchestra.run.smithi027.stdout: "predict_interval": { 2024-09-19T08:21:26.881 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "predict_interval", 2024-09-19T08:21:26.881 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.881 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.881 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.881 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "86400", 2024-09-19T08:21:26.881 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.881 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.881 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.881 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.882 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.882 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.882 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.882 INFO:teuthology.orchestra.run.smithi027.stdout: "predictor_model": { 2024-09-19T08:21:26.882 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "predictor_model", 2024-09-19T08:21:26.882 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.882 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.882 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.882 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "prophetstor", 2024-09-19T08:21:26.883 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.883 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.883 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.883 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.883 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.883 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.883 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.883 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-19T08:21:26.883 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-19T08:21:26.884 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.884 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.884 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.884 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-19T08:21:26.884 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.884 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.884 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.884 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.884 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.884 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.885 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.885 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.885 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.885 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.885 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "influx", 2024-09-19T08:21:26.885 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": false, 2024-09-19T08:21:26.885 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "influxdb python module not found", 2024-09-19T08:21:26.885 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.885 INFO:teuthology.orchestra.run.smithi027.stdout: "batch_size": { 2024-09-19T08:21:26.886 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "batch_size", 2024-09-19T08:21:26.886 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.886 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.886 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.886 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5000", 2024-09-19T08:21:26.886 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.886 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.886 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.886 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T08:21:26.886 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.886 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.887 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.887 INFO:teuthology.orchestra.run.smithi027.stdout: "database": { 2024-09-19T08:21:26.887 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "database", 2024-09-19T08:21:26.887 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.887 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.887 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.887 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "ceph", 2024-09-19T08:21:26.887 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.887 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.887 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.887 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T08:21:26.887 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.888 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.888 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.888 INFO:teuthology.orchestra.run.smithi027.stdout: "hostname": { 2024-09-19T08:21:26.888 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "hostname", 2024-09-19T08:21:26.888 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.888 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.888 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.888 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.888 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.888 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.889 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.889 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "InfluxDB server hostname", 2024-09-19T08:21:26.889 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.889 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.889 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.889 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-19T08:21:26.889 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-19T08:21:26.889 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.889 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.889 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.890 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "30", 2024-09-19T08:21:26.890 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "5", 2024-09-19T08:21:26.890 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.890 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.890 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T08:21:26.890 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.890 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.890 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.890 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.890 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.890 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.891 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.891 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.891 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.891 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.891 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.891 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.891 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.891 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.891 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.891 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.891 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.891 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.892 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.892 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.892 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.892 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.892 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.892 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.892 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.892 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.892 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.892 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.892 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.892 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.893 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.893 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.893 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.893 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.893 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.893 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.893 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.893 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.893 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.893 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.894 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.894 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.894 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.894 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.894 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.894 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.894 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.894 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.894 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.894 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.894 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.895 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.895 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.895 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.895 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.895 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.895 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.895 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.895 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.895 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.895 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.895 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.896 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.896 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.896 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.896 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.896 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.896 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.896 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.896 INFO:teuthology.orchestra.run.smithi027.stdout: "password": { 2024-09-19T08:21:26.896 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "password", 2024-09-19T08:21:26.896 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.897 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.897 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.897 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.897 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.897 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.897 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.897 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "password of InfluxDB server user", 2024-09-19T08:21:26.897 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.897 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.897 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.898 INFO:teuthology.orchestra.run.smithi027.stdout: "port": { 2024-09-19T08:21:26.898 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "port", 2024-09-19T08:21:26.898 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.898 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.898 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.898 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8086", 2024-09-19T08:21:26.898 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.898 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.898 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.898 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "InfluxDB server port", 2024-09-19T08:21:26.898 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.898 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.899 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.899 INFO:teuthology.orchestra.run.smithi027.stdout: "ssl": { 2024-09-19T08:21:26.899 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssl", 2024-09-19T08:21:26.899 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.899 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.899 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.899 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "false", 2024-09-19T08:21:26.899 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.899 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.899 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.900 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:21:26.900 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.900 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.900 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.900 INFO:teuthology.orchestra.run.smithi027.stdout: "threads": { 2024-09-19T08:21:26.900 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "threads", 2024-09-19T08:21:26.900 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.900 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.900 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.900 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-19T08:21:26.901 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-19T08:21:26.901 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "32", 2024-09-19T08:21:26.901 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.901 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T08:21:26.901 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.901 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.901 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.901 INFO:teuthology.orchestra.run.smithi027.stdout: "username": { 2024-09-19T08:21:26.901 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "username", 2024-09-19T08:21:26.902 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.902 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.902 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.902 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.902 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.902 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.902 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.902 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "username of InfluxDB server user", 2024-09-19T08:21:26.902 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.902 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.902 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.902 INFO:teuthology.orchestra.run.smithi027.stdout: "verify_ssl": { 2024-09-19T08:21:26.903 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "verify_ssl", 2024-09-19T08:21:26.903 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.903 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.903 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.903 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "true", 2024-09-19T08:21:26.903 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.903 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.903 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.903 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:21:26.903 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.903 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.904 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.904 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.904 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.904 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "insights", 2024-09-19T08:21:26.904 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.904 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.904 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.904 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.904 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.904 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.904 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.905 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.905 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.905 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.905 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.905 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.905 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.905 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.905 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.905 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.905 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.905 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.906 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.906 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.906 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.906 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.906 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.906 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.906 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.906 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.906 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.906 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.906 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.907 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.907 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.907 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.907 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.907 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.907 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.907 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.907 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.907 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.907 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.907 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.907 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.908 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.908 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.908 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.908 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.908 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.908 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.908 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.908 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.908 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.908 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.908 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.908 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.908 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.909 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.909 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.909 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.909 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.909 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.909 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.909 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.909 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.909 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.909 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.909 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.910 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.910 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.910 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.910 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.910 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.910 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.910 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.910 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "iostat", 2024-09-19T08:21:26.910 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.910 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.910 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.911 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.911 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.911 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.911 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.911 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.911 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.911 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.911 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.911 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.911 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.911 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.912 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.912 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.912 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.912 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.912 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.912 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.912 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.912 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.912 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.912 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.912 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.913 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.913 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.913 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.913 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.913 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.913 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.913 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.913 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.913 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.913 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.913 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.914 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.914 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.914 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.914 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.914 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.914 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.914 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.914 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.914 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.914 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.914 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.915 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.915 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.915 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.915 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.915 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.915 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.915 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.915 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.915 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.915 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.916 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.916 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.916 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.916 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.916 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.916 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.916 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.916 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.916 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.916 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.916 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.916 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.917 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.917 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.917 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.917 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "k8sevents", 2024-09-19T08:21:26.917 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.917 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.917 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.917 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_event_retention_days": { 2024-09-19T08:21:26.917 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ceph_event_retention_days", 2024-09-19T08:21:26.918 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.918 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.918 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.918 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "7", 2024-09-19T08:21:26.918 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.918 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.918 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.918 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T08:21:26.918 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.918 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.918 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.919 INFO:teuthology.orchestra.run.smithi027.stdout: "config_check_secs": { 2024-09-19T08:21:26.919 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "config_check_secs", 2024-09-19T08:21:26.919 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.919 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.919 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.919 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:26.919 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "10", 2024-09-19T08:21:26.919 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.919 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.919 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T08:21:26.920 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.920 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.920 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.920 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.920 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.920 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.920 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.920 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.920 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.920 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.920 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.921 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.921 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.921 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.921 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.921 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.921 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.921 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.921 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.921 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.921 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.921 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.921 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.922 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.922 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.922 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.922 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.922 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.922 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.922 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.922 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.922 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.922 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.922 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.923 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.923 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.923 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.923 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.923 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.923 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.923 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.923 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.923 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.923 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.923 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.923 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.924 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.924 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.924 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.924 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.924 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.924 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.924 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.924 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.924 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.924 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.924 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.924 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.925 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.925 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.925 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.925 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.925 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.925 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.925 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.925 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.925 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.925 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.925 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.926 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.926 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.926 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "localpool", 2024-09-19T08:21:26.926 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.926 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.926 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.926 INFO:teuthology.orchestra.run.smithi027.stdout: "failure_domain": { 2024-09-19T08:21:26.926 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "failure_domain", 2024-09-19T08:21:26.926 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.927 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.927 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.927 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "host", 2024-09-19T08:21:26.927 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.927 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.927 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.927 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "failure domain for any created local pool", 2024-09-19T08:21:26.927 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T08:21:26.927 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.927 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.928 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.928 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.928 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.928 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.928 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.928 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.928 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.928 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.928 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.928 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.928 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.929 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.929 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.929 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.929 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.929 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.929 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.929 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.929 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.929 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.930 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.930 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.930 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.930 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.930 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.930 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.930 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.930 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.930 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.930 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.930 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.931 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.931 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.931 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.931 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.931 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.931 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.931 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.931 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.931 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.931 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.932 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.932 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.932 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.932 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.932 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.932 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.932 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.932 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.932 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.932 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.932 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.932 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.933 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.933 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.933 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.933 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.933 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.933 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.933 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.933 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.933 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.933 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.933 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.934 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.934 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.934 INFO:teuthology.orchestra.run.smithi027.stdout: "min_size": { 2024-09-19T08:21:26.934 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "min_size", 2024-09-19T08:21:26.934 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.934 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.934 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.934 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.934 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.934 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.935 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.935 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "default min_size for any created local pool", 2024-09-19T08:21:26.935 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T08:21:26.935 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.935 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.935 INFO:teuthology.orchestra.run.smithi027.stdout: "num_rep": { 2024-09-19T08:21:26.935 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "num_rep", 2024-09-19T08:21:26.935 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.935 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.935 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.936 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "3", 2024-09-19T08:21:26.936 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.936 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.936 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.936 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "default replica count for any created local pool", 2024-09-19T08:21:26.936 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.936 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.936 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.936 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.936 INFO:teuthology.orchestra.run.smithi027.stdout: "pg_num": { 2024-09-19T08:21:26.936 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pg_num", 2024-09-19T08:21:26.937 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:26.937 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.937 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.937 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "128", 2024-09-19T08:21:26.937 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.937 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.937 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.937 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T08:21:26.937 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.937 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.937 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.938 INFO:teuthology.orchestra.run.smithi027.stdout: "prefix": { 2024-09-19T08:21:26.938 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "prefix", 2024-09-19T08:21:26.938 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.938 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.938 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.938 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.938 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.938 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.938 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.938 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "name prefix for any created local pool", 2024-09-19T08:21:26.938 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.939 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.939 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.939 INFO:teuthology.orchestra.run.smithi027.stdout: "subtree": { 2024-09-19T08:21:26.939 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "subtree", 2024-09-19T08:21:26.939 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.939 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.939 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.939 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "rack", 2024-09-19T08:21:26.939 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.939 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.940 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.940 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T08:21:26.940 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T08:21:26.940 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.940 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.940 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.940 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.940 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.940 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.940 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mds_autoscaler", 2024-09-19T08:21:26.941 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.941 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.941 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.941 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.941 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.941 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.941 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.941 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.941 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.941 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.942 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.942 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.942 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.942 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.942 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.942 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.942 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.942 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.942 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.942 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.942 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.943 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.943 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.943 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.943 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.943 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.943 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.943 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.943 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.943 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.944 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.944 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.944 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.944 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.944 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.944 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.944 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.944 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.945 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.945 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.945 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.945 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.945 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.945 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.945 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.945 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.945 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.945 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.945 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.946 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.946 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.946 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.946 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.946 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.946 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.946 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.946 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.946 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.947 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.947 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.947 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.947 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.947 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.947 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.947 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.947 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.947 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.947 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.947 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.948 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.948 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.948 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.948 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mirroring", 2024-09-19T08:21:26.948 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.948 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.948 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.948 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.948 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.949 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.949 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.949 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.949 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.949 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.949 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.949 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.949 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.949 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.949 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.949 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.950 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.950 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.950 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.950 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.950 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.950 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.950 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.950 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.950 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.950 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.951 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.951 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.951 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.951 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.951 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.951 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.951 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.951 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.951 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.951 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.952 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.952 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.952 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.952 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.952 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.952 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.952 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.952 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.952 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.952 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.952 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.952 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.953 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.953 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.953 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.953 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.953 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.953 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.953 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.953 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.953 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.953 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.954 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.954 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.954 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.954 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.954 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.954 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.954 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.954 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.954 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.954 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.954 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.954 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.955 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.955 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.955 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.955 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.955 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "nfs", 2024-09-19T08:21:26.955 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.955 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.955 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.955 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.955 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.955 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.956 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.956 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.956 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.956 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.956 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.956 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.956 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.956 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.956 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.956 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.956 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.957 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.957 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.957 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.957 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.957 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.957 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.957 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.957 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.957 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.957 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.957 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.958 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.958 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.958 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.958 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.958 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.958 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.958 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.958 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.958 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.958 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.958 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.958 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.959 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.959 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.959 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.959 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.959 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.959 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.959 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.959 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.959 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.959 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.959 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.960 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.960 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.960 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.960 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.960 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.960 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.960 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.960 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.960 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.960 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.961 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.961 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.961 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.961 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.961 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.961 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.961 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.961 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.961 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.961 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.962 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.962 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "orchestrator", 2024-09-19T08:21:26.962 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.962 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.962 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.962 INFO:teuthology.orchestra.run.smithi027.stdout: "fail_fs": { 2024-09-19T08:21:26.962 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "fail_fs", 2024-09-19T08:21:26.962 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.962 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.962 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.963 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.963 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.963 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.963 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.963 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T08:21:26.963 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.963 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.963 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.963 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.963 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.964 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.964 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.964 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.964 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.964 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.964 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.964 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.964 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.964 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.964 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.965 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.965 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.965 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.965 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.965 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.965 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.965 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.965 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.965 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.965 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.966 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.966 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.966 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.966 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.966 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.966 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.966 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.966 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.966 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.966 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.966 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.967 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.967 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.967 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.967 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.967 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.967 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.967 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.967 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.967 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.967 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.968 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.968 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.968 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.968 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.968 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.968 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.968 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.968 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.968 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.968 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.969 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.969 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.969 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.969 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.969 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.969 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.969 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.969 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.969 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.969 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.969 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.970 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.970 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.970 INFO:teuthology.orchestra.run.smithi027.stdout: "orchestrator": { 2024-09-19T08:21:26.970 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "orchestrator", 2024-09-19T08:21:26.970 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.970 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.970 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.970 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.970 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.970 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.971 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.971 INFO:teuthology.orchestra.run.smithi027.stdout: "cephadm", 2024-09-19T08:21:26.971 INFO:teuthology.orchestra.run.smithi027.stdout: "rook", 2024-09-19T08:21:26.971 INFO:teuthology.orchestra.run.smithi027.stdout: "test_orchestrator" 2024-09-19T08:21:26.971 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.971 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Orchestrator backend", 2024-09-19T08:21:26.971 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.971 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.971 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.971 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.971 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.971 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.972 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.972 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "osd_perf_query", 2024-09-19T08:21:26.972 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.972 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.972 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.972 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.972 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.972 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.972 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.972 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.972 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.973 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.973 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.973 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.973 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.973 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.973 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.973 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.973 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.973 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.973 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.973 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.973 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.974 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.974 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.974 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.974 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.974 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.974 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.974 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.974 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.974 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.974 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.975 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.975 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.975 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.975 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.975 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.975 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.975 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.975 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.975 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.975 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.975 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.976 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.976 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.976 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.976 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.976 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.976 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.976 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.976 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.976 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.976 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.977 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.977 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.977 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.977 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.977 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.977 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.977 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.977 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.977 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.977 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.977 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.978 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.978 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.978 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.978 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.978 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.978 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.978 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.978 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.978 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.978 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.979 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "osd_support", 2024-09-19T08:21:26.979 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.979 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.979 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.979 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.979 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.979 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.979 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.979 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.979 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.979 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.979 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.980 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.980 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.980 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.980 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.980 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.980 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.980 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.980 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.980 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.980 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.980 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.981 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.981 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.981 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.981 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.981 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.981 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.981 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.981 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.981 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.981 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.981 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.981 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.982 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.982 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.982 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.982 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.982 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.982 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.982 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.982 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.982 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.983 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.983 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.983 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.983 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.983 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.983 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.983 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.983 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.983 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.983 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.983 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.983 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.984 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.984 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.984 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.984 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.984 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.984 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.984 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.984 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.984 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.984 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.985 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.985 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.985 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.985 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.985 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.985 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.985 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.985 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.985 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pg_autoscaler", 2024-09-19T08:21:26.986 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.986 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.986 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.986 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.986 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.986 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.986 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.986 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.986 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.986 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.986 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.987 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.987 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.987 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.987 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.987 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.987 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.987 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.987 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.987 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.987 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.987 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.988 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.988 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:26.988 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:26.988 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.988 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.988 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.988 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.988 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.988 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.988 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.988 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.989 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.989 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.989 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.989 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:26.989 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:26.989 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.989 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.989 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.989 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:26.989 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.990 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.990 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.990 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.990 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.990 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.990 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.990 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.990 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.990 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.990 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.991 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.991 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.991 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.991 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:26.991 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:26.991 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.991 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.991 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.991 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.991 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.991 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.992 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.992 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.992 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.992 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.992 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.992 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-19T08:21:26.992 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-19T08:21:26.992 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:26.992 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.992 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.993 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-19T08:21:26.993 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.993 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.993 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.993 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.993 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.993 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.993 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.993 INFO:teuthology.orchestra.run.smithi027.stdout: "threshold": { 2024-09-19T08:21:26.993 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "threshold", 2024-09-19T08:21:26.993 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:26.994 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.994 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.994 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "3.0", 2024-09-19T08:21:26.994 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1.0", 2024-09-19T08:21:26.994 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.994 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.994 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "scaling threshold", 2024-09-19T08:21:26.994 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T08:21:26.994 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.994 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.994 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.995 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:26.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.995 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:26.995 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "progress", 2024-09-19T08:21:26.995 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:26.995 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:26.995 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:26.995 INFO:teuthology.orchestra.run.smithi027.stdout: "allow_pg_recovery_event": { 2024-09-19T08:21:26.995 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "allow_pg_recovery_event", 2024-09-19T08:21:26.995 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.996 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.996 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.996 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:26.996 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.996 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.996 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.996 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T08:21:26.996 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.996 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.996 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.997 INFO:teuthology.orchestra.run.smithi027.stdout: "enabled": { 2024-09-19T08:21:26.997 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enabled", 2024-09-19T08:21:26.997 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:26.997 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.997 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:26.997 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:26.997 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.997 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.997 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:26.997 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.997 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.998 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:26.998 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:26.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:26.998 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:26.998 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:26.998 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:26.998 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:26.998 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:26.998 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:26.998 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:26.998 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:26.999 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:26.999 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:26.999 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:26.999 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:26.999 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:26.999 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:26.999 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:26.999 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:26.999 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:26.999 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:26.999 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.000 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.000 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.000 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:27.000 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:27.000 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.000 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.000 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.000 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.000 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.000 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.000 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.001 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.001 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.001 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.001 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.001 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:27.001 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:27.001 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.001 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.001 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.001 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:27.002 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.002 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.002 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.002 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.002 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.002 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.002 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.002 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.002 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.002 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.002 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.003 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.003 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.003 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.003 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.003 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:27.003 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:27.003 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.003 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.003 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.003 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.004 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.004 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.004 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.004 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.004 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.004 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.004 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.004 INFO:teuthology.orchestra.run.smithi027.stdout: "max_completed_events": { 2024-09-19T08:21:27.004 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_completed_events", 2024-09-19T08:21:27.004 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:27.005 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.005 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.005 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "50", 2024-09-19T08:21:27.005 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.005 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.005 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.005 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "number of past completed events to remember", 2024-09-19T08:21:27.005 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.005 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.005 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.006 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-19T08:21:27.006 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-19T08:21:27.006 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:27.006 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.006 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.006 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-19T08:21:27.006 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.006 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.006 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.006 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how long the module is going to sleep", 2024-09-19T08:21:27.006 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.007 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.007 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.007 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.007 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.007 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.007 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "prometheus", 2024-09-19T08:21:27.007 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:27.007 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:27.007 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:27.007 INFO:teuthology.orchestra.run.smithi027.stdout: "cache": { 2024-09-19T08:21:27.008 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cache", 2024-09-19T08:21:27.008 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.008 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.008 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.008 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:27.008 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.008 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.008 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.008 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.008 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.008 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.009 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.009 INFO:teuthology.orchestra.run.smithi027.stdout: "exclude_perf_counters": { 2024-09-19T08:21:27.009 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "exclude_perf_counters", 2024-09-19T08:21:27.009 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.009 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.009 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.009 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:27.009 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.009 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.010 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.010 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T08:21:27.010 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T08:21:27.010 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.010 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.010 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.010 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:27.010 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:27.010 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.010 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.010 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.010 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.011 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.011 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.011 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.011 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.011 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.011 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.011 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.011 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.011 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.011 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.011 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.011 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.012 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.012 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.012 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.012 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:27.012 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:27.012 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.012 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.012 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.012 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.012 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.012 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.012 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.013 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.013 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.013 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.013 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.013 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.013 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:27.013 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:27.013 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.013 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.013 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.013 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:27.014 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.014 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.014 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.014 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.014 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.014 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.014 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.014 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.014 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.014 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.014 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.014 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.014 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.015 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.015 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:27.015 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:27.015 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.015 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.015 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.015 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.015 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.015 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.015 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.016 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.016 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.016 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.016 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.016 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_stats_pools": { 2024-09-19T08:21:27.016 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rbd_stats_pools", 2024-09-19T08:21:27.016 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.016 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.016 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.016 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.017 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.017 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.017 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.017 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.017 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.017 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.017 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.017 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T08:21:27.017 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T08:21:27.017 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:27.018 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.018 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.018 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "300", 2024-09-19T08:21:27.018 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.018 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.018 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.018 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.018 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.018 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.018 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.018 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.019 INFO:teuthology.orchestra.run.smithi027.stdout: "scrape_interval": { 2024-09-19T08:21:27.019 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "scrape_interval", 2024-09-19T08:21:27.019 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:27.019 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.019 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.019 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "15.0", 2024-09-19T08:21:27.019 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.019 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.019 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.019 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.019 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.019 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.019 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.020 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.020 INFO:teuthology.orchestra.run.smithi027.stdout: "server_addr": { 2024-09-19T08:21:27.020 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_addr", 2024-09-19T08:21:27.020 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.020 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.020 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.020 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "::", 2024-09-19T08:21:27.020 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.020 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.020 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.021 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T08:21:27.021 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.021 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.021 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.021 INFO:teuthology.orchestra.run.smithi027.stdout: "server_port": { 2024-09-19T08:21:27.021 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_port", 2024-09-19T08:21:27.021 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:27.021 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.021 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.021 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "9283", 2024-09-19T08:21:27.021 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.022 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.022 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.022 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T08:21:27.022 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.022 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.022 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.022 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.022 INFO:teuthology.orchestra.run.smithi027.stdout: "stale_cache_strategy": { 2024-09-19T08:21:27.022 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "stale_cache_strategy", 2024-09-19T08:21:27.022 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.022 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.022 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.022 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "log", 2024-09-19T08:21:27.023 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.023 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.023 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.023 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.023 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.023 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.023 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.023 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.023 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_behaviour": { 2024-09-19T08:21:27.023 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_behaviour", 2024-09-19T08:21:27.023 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.024 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.024 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.024 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "default", 2024-09-19T08:21:27.024 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.024 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.024 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.024 INFO:teuthology.orchestra.run.smithi027.stdout: "default", 2024-09-19T08:21:27.024 INFO:teuthology.orchestra.run.smithi027.stdout: "error" 2024-09-19T08:21:27.024 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.024 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.024 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.024 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.025 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.025 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_error_status_code": { 2024-09-19T08:21:27.025 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_error_status_code", 2024-09-19T08:21:27.025 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:27.025 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.025 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.025 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "500", 2024-09-19T08:21:27.025 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "400", 2024-09-19T08:21:27.025 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "599", 2024-09-19T08:21:27.026 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.026 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.026 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.026 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.026 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.026 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.026 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.026 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.026 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.026 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rbd_support", 2024-09-19T08:21:27.026 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:27.026 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:27.026 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:27.027 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:27.027 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:27.027 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.027 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.027 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.027 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.027 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.027 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.027 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.027 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.027 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.027 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.027 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.027 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.028 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.028 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.028 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.028 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.028 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.028 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.028 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.028 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:27.028 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:27.028 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.028 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.028 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.029 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.029 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.029 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.029 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.029 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.029 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.029 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.029 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.029 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.029 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:27.029 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:27.029 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.030 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.030 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.030 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:27.030 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.030 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.030 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.030 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.030 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.030 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.030 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.030 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.031 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.031 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.031 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.031 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.031 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.031 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.031 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.031 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:27.031 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:27.031 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.031 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.032 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.032 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.032 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.032 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.032 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.032 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.032 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.032 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.032 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.032 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.032 INFO:teuthology.orchestra.run.smithi027.stdout: "max_concurrent_snap_create": { 2024-09-19T08:21:27.032 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_concurrent_snap_create", 2024-09-19T08:21:27.033 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:27.033 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.033 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.033 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-19T08:21:27.033 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.033 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.033 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.033 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.033 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.033 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.033 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.034 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.034 INFO:teuthology.orchestra.run.smithi027.stdout: "mirror_snapshot_schedule": { 2024-09-19T08:21:27.034 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T08:21:27.034 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.034 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.034 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.034 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.034 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.034 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.034 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.034 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.034 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.035 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.035 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.035 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.035 INFO:teuthology.orchestra.run.smithi027.stdout: "trash_purge_schedule": { 2024-09-19T08:21:27.035 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "trash_purge_schedule", 2024-09-19T08:21:27.035 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.035 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.035 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.035 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.035 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.035 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.035 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.036 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.036 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.036 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.036 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.036 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.036 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.036 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.036 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.036 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "restful", 2024-09-19T08:21:27.036 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:27.036 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:27.037 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:27.037 INFO:teuthology.orchestra.run.smithi027.stdout: "enable_auth": { 2024-09-19T08:21:27.037 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enable_auth", 2024-09-19T08:21:27.037 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.037 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.037 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.037 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:27.037 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.037 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.037 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.037 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.038 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.038 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.038 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.038 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.038 INFO:teuthology.orchestra.run.smithi027.stdout: "key_file": { 2024-09-19T08:21:27.038 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "key_file", 2024-09-19T08:21:27.038 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.038 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.038 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.038 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.039 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.039 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.039 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.039 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.039 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.039 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.039 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.039 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.039 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:27.039 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:27.039 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.039 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.040 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.040 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.040 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.040 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.040 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.040 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.040 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.040 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.040 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.040 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.040 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.040 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.041 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.041 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.041 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.041 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.041 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.041 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:27.041 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:27.041 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.041 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.041 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.041 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.041 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.042 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.042 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.042 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.042 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.042 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.042 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.042 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.042 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:27.042 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:27.042 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.042 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.042 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.042 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:27.042 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.043 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.043 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.043 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.043 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.043 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.043 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.043 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.043 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.043 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.043 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.043 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.043 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.044 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.044 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.044 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:27.044 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:27.044 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.044 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.044 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.044 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.044 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.044 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.044 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.045 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.045 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.045 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.045 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.045 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.045 INFO:teuthology.orchestra.run.smithi027.stdout: "server_addr": { 2024-09-19T08:21:27.045 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_addr", 2024-09-19T08:21:27.045 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.045 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.045 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.045 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.046 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.046 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.046 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.046 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.046 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.046 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.046 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.046 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.046 INFO:teuthology.orchestra.run.smithi027.stdout: "server_port": { 2024-09-19T08:21:27.046 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_port", 2024-09-19T08:21:27.046 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.047 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.047 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.047 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.047 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.047 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.047 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.047 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.047 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.047 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.047 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.047 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.047 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.048 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.048 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.048 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rgw", 2024-09-19T08:21:27.048 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:27.048 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:27.048 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:27.048 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:27.048 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:27.048 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.048 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.049 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.049 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.049 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.049 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.049 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.049 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.049 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.049 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.049 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.050 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.050 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.050 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.050 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.050 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.050 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.050 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.050 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.050 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:27.050 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:27.050 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.051 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.051 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.051 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.051 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.051 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.051 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.051 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.051 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.051 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.051 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.051 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.051 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.052 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T08:21:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T08:21:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-19T08:21:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T08:21:27.055 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rook", 2024-09-19T08:21:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:27.056 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.057 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:27.058 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.059 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.060 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.061 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.062 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: "storage_class": { 2024-09-19T08:21:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "storage_class", 2024-09-19T08:21:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "local", 2024-09-19T08:21:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.063 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T08:21:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "selftest", 2024-09-19T08:21:27.064 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.065 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.066 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.067 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:27.068 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.069 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.070 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: "roption1": { 2024-09-19T08:21:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "roption1", 2024-09-19T08:21:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.071 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: "roption2": { 2024-09-19T08:21:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "roption2", 2024-09-19T08:21:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "xyz", 2024-09-19T08:21:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption1": { 2024-09-19T08:21:27.073 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption1", 2024-09-19T08:21:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.074 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption2": { 2024-09-19T08:21:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption2", 2024-09-19T08:21:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.075 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption3": { 2024-09-19T08:21:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption3", 2024-09-19T08:21:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-19T08:21:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.076 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption4": { 2024-09-19T08:21:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption4", 2024-09-19T08:21:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.077 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption5": { 2024-09-19T08:21:27.078 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption5", 2024-09-19T08:21:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.079 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption6": { 2024-09-19T08:21:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption6", 2024-09-19T08:21:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.080 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption7": { 2024-09-19T08:21:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption7", 2024-09-19T08:21:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.081 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-19T08:21:27.082 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "42", 2024-09-19T08:21:27.082 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.082 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.082 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.082 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.082 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.082 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.082 INFO:teuthology.orchestra.run.smithi027.stdout: "testkey": { 2024-09-19T08:21:27.082 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "testkey", 2024-09-19T08:21:27.082 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.082 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.082 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: "testlkey": { 2024-09-19T08:21:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "testlkey", 2024-09-19T08:21:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: "testnewline": { 2024-09-19T08:21:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "testnewline", 2024-09-19T08:21:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.085 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "snap_schedule", 2024-09-19T08:21:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:27.086 INFO:teuthology.orchestra.run.smithi027.stdout: "allow_m_granularity": { 2024-09-19T08:21:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "allow_m_granularity", 2024-09-19T08:21:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T08:21:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.087 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: "dump_on_update": { 2024-09-19T08:21:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "dump_on_update", 2024-09-19T08:21:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.088 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "dump database to debug log on update", 2024-09-19T08:21:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.089 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.090 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.091 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.092 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.093 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.094 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "stats", 2024-09-19T08:21:27.095 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.096 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.097 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.098 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.099 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.100 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.101 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "status", 2024-09-19T08:21:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:27.102 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.103 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:27.104 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.105 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.106 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:27.106 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:27.106 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.106 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.106 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.106 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:27.106 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.106 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.106 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.106 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.106 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.107 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.107 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.107 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.107 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.107 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.107 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.107 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.107 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.107 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.107 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:27.107 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:27.108 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.108 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.108 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.108 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.108 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.108 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.108 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.108 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.108 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.108 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.108 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.109 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.109 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.109 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.109 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "telegraf", 2024-09-19T08:21:27.109 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:27.109 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:27.109 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:27.109 INFO:teuthology.orchestra.run.smithi027.stdout: "address": { 2024-09-19T08:21:27.109 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "address", 2024-09-19T08:21:27.109 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.110 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.110 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.110 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T08:21:27.110 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.110 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.110 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.110 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.110 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.110 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.110 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.110 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-19T08:21:27.111 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-19T08:21:27.111 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:27.111 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.111 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.111 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "15", 2024-09-19T08:21:27.111 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.111 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.111 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.111 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.111 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.111 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.112 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.112 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:27.112 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:27.112 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.112 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.112 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.112 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.112 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.112 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.112 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.112 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.113 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.113 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.113 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.113 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.113 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.113 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.113 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.113 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.113 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.113 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.114 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:27.114 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:27.114 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.114 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.114 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.114 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.114 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.114 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.114 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.114 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.114 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.114 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.115 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.115 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:27.115 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:27.115 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.115 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.115 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.115 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:27.115 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.115 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.116 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.116 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.116 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.116 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.116 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.116 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.116 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.116 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.116 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.116 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.116 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.117 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.117 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:27.117 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:27.117 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.117 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.117 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.117 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.117 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.117 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.117 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.117 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.118 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.118 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.118 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.118 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.118 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.118 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "telemetry", 2024-09-19T08:21:27.118 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:27.118 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:27.119 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:27.119 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_basic": { 2024-09-19T08:21:27.119 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_basic", 2024-09-19T08:21:27.119 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.119 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.119 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.119 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:27.119 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.119 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.119 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.119 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T08:21:27.119 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.120 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.120 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.120 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_crash": { 2024-09-19T08:21:27.120 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_crash", 2024-09-19T08:21:27.120 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.120 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.120 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.120 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:27.120 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.120 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.121 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.121 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T08:21:27.121 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.121 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.121 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.121 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_device": { 2024-09-19T08:21:27.121 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_device", 2024-09-19T08:21:27.121 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.121 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.121 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.121 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:27.122 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.122 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.122 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.122 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T08:21:27.122 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.122 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.122 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.122 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_ident": { 2024-09-19T08:21:27.122 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_ident", 2024-09-19T08:21:27.122 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.122 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.122 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.123 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.123 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.123 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.123 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.123 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T08:21:27.123 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.123 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.123 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.123 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_perf": { 2024-09-19T08:21:27.123 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_perf", 2024-09-19T08:21:27.123 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.124 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.124 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.124 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.124 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.124 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.124 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.124 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T08:21:27.124 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.124 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.124 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.125 INFO:teuthology.orchestra.run.smithi027.stdout: "contact": { 2024-09-19T08:21:27.125 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "contact", 2024-09-19T08:21:27.125 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.125 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.125 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.125 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.125 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.125 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.125 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.125 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.126 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.126 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.126 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.126 INFO:teuthology.orchestra.run.smithi027.stdout: "description": { 2024-09-19T08:21:27.126 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "description", 2024-09-19T08:21:27.126 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.126 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.126 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.126 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.126 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.127 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.127 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.127 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.127 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.127 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.127 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.127 INFO:teuthology.orchestra.run.smithi027.stdout: "device_url": { 2024-09-19T08:21:27.127 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "device_url", 2024-09-19T08:21:27.127 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.127 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.127 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.127 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T08:21:27.128 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.128 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.128 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.128 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.128 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.128 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.128 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.128 INFO:teuthology.orchestra.run.smithi027.stdout: "enabled": { 2024-09-19T08:21:27.128 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enabled", 2024-09-19T08:21:27.128 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.128 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.128 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.129 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.129 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.129 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.129 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.129 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.129 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.129 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.129 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.129 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-19T08:21:27.129 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-19T08:21:27.129 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:27.130 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.130 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.130 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "24", 2024-09-19T08:21:27.130 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "8", 2024-09-19T08:21:27.130 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.130 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.130 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.130 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.130 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.130 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.130 INFO:teuthology.orchestra.run.smithi027.stdout: "last_opt_revision": { 2024-09-19T08:21:27.130 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "last_opt_revision", 2024-09-19T08:21:27.131 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:27.131 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.131 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.131 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "1", 2024-09-19T08:21:27.131 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.131 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.131 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.131 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.131 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.131 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.131 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.131 INFO:teuthology.orchestra.run.smithi027.stdout: "leaderboard": { 2024-09-19T08:21:27.132 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "leaderboard", 2024-09-19T08:21:27.132 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.132 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.132 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.132 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.132 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.132 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.132 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.132 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.132 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.132 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.132 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.133 INFO:teuthology.orchestra.run.smithi027.stdout: "leaderboard_description": { 2024-09-19T08:21:27.133 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "leaderboard_description", 2024-09-19T08:21:27.133 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.133 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.133 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.133 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.133 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.133 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.133 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.133 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.134 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.134 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.134 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.134 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:27.134 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:27.134 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.134 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.134 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.134 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.135 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.135 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.135 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.135 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.135 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.135 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.135 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.135 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.135 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.136 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.136 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.136 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.136 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.136 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.136 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:27.136 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:27.136 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.136 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.136 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.137 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.137 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.137 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.137 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.137 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.137 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.137 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.137 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.137 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:27.137 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:27.138 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.138 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.138 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.138 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:27.138 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.138 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.138 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.138 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.138 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.138 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.138 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.139 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.139 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.139 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.139 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.139 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.139 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.139 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.139 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:27.140 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:27.140 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.140 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.140 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.140 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.140 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.140 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.140 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.140 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.140 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.140 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.141 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.141 INFO:teuthology.orchestra.run.smithi027.stdout: "organization": { 2024-09-19T08:21:27.141 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "organization", 2024-09-19T08:21:27.141 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.141 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.141 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.141 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.141 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.141 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.142 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.142 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.142 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.142 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.142 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.142 INFO:teuthology.orchestra.run.smithi027.stdout: "proxy": { 2024-09-19T08:21:27.142 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "proxy", 2024-09-19T08:21:27.142 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.142 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.142 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.142 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.142 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.143 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.143 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.143 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.143 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.143 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.143 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.143 INFO:teuthology.orchestra.run.smithi027.stdout: "url": { 2024-09-19T08:21:27.143 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "url", 2024-09-19T08:21:27.143 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.143 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.143 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.143 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T08:21:27.144 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.144 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.144 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.144 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.144 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.144 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.144 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.144 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.144 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.145 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "test_orchestrator", 2024-09-19T08:21:27.145 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:27.145 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:27.145 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:27.145 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:27.145 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:27.145 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.145 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.145 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.145 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.145 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.146 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.146 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.146 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.146 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.146 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.146 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.146 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.146 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.146 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.146 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.146 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.147 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.147 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.147 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:27.147 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:27.147 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.147 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.147 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.147 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.147 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.147 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.148 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.148 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.148 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.148 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.148 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.148 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.148 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:27.148 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:27.148 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.148 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.148 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.148 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:27.148 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.149 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.149 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.149 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.149 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.149 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.149 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.149 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.149 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.149 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.149 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.149 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.149 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.150 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.150 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:27.150 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:27.150 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.150 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.150 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.150 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.150 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.150 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.150 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.151 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.151 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.151 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.151 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.151 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.151 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.151 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.151 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.151 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "volumes", 2024-09-19T08:21:27.151 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:27.151 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:27.152 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:27.152 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:27.152 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:27.152 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.152 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.152 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.152 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.152 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.152 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.152 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.152 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.153 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.153 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.153 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.153 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.153 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.153 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.153 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.153 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.153 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.153 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.154 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.154 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:27.154 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:27.154 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.154 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.154 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.154 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.154 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.154 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.154 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.154 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.154 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.154 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.155 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.155 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.155 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:27.155 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:27.155 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.155 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.155 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.155 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:27.155 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.155 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.155 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.156 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.156 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.156 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.156 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.156 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.156 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.156 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.156 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.156 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.156 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.156 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.157 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.157 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:27.157 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:27.157 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.157 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.157 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.157 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.157 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.157 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.157 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.157 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.158 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.158 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.158 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.158 INFO:teuthology.orchestra.run.smithi027.stdout: "max_concurrent_clones": { 2024-09-19T08:21:27.158 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_concurrent_clones", 2024-09-19T08:21:27.158 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:27.158 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.158 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.158 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "4", 2024-09-19T08:21:27.158 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.158 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.159 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.159 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T08:21:27.159 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.159 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.159 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.159 INFO:teuthology.orchestra.run.smithi027.stdout: "periodic_async_work": { 2024-09-19T08:21:27.159 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "periodic_async_work", 2024-09-19T08:21:27.159 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.159 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.159 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.160 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.160 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.160 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.160 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.160 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Periodically check for async work", 2024-09-19T08:21:27.160 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.160 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.160 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.160 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot_clone_delay": { 2024-09-19T08:21:27.161 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "snapshot_clone_delay", 2024-09-19T08:21:27.161 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:27.161 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.161 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.161 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-19T08:21:27.161 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.161 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.161 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.161 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T08:21:27.161 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.161 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.162 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.162 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.162 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot_clone_no_wait": { 2024-09-19T08:21:27.162 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T08:21:27.162 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.162 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.162 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.162 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-19T08:21:27.162 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.162 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.162 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.163 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T08:21:27.163 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.163 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.163 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.163 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.163 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.163 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.163 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.163 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix", 2024-09-19T08:21:27.163 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-19T08:21:27.163 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-19T08:21:27.164 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-19T08:21:27.164 INFO:teuthology.orchestra.run.smithi027.stdout: "discovery_interval": { 2024-09-19T08:21:27.164 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "discovery_interval", 2024-09-19T08:21:27.164 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-19T08:21:27.164 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.164 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.164 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "100", 2024-09-19T08:21:27.164 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.164 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.164 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.164 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.165 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.165 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.165 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.165 INFO:teuthology.orchestra.run.smithi027.stdout: "identifier": { 2024-09-19T08:21:27.165 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "identifier", 2024-09-19T08:21:27.165 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.165 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.165 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.165 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.165 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-19T08:21:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-19T08:21:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-19T08:21:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-19T08:21:27.167 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.167 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.167 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.167 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.167 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.167 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.167 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.167 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.167 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-19T08:21:27.167 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-19T08:21:27.167 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.168 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.168 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.168 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.168 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.168 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.168 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.168 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.168 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.168 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.168 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.168 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.168 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.168 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.169 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.169 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.169 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.169 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.169 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.169 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-19T08:21:27.169 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-19T08:21:27.169 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.169 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.169 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.169 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.169 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.170 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.170 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.170 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.170 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.170 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.170 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.170 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.170 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-19T08:21:27.170 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-19T08:21:27.170 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.170 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.170 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.170 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-19T08:21:27.171 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.171 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.171 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-19T08:21:27.171 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-19T08:21:27.171 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-19T08:21:27.171 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-19T08:21:27.171 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-19T08:21:27.171 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-19T08:21:27.171 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-19T08:21:27.171 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.171 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.171 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.172 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.172 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.172 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.172 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-19T08:21:27.172 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-19T08:21:27.172 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-19T08:21:27.172 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.172 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-19T08:21:27.172 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-19T08:21:27.172 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.173 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.173 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.173 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.173 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.173 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.173 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.173 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.173 INFO:teuthology.orchestra.run.smithi027.stdout: "zabbix_host": { 2024-09-19T08:21:27.173 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix_host", 2024-09-19T08:21:27.173 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.173 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.174 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.174 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-19T08:21:27.174 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.174 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.174 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.174 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.174 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.174 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.174 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.174 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.174 INFO:teuthology.orchestra.run.smithi027.stdout: "zabbix_port": { 2024-09-19T08:21:27.175 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix_port", 2024-09-19T08:21:27.175 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-19T08:21:27.175 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.175 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.175 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10051", 2024-09-19T08:21:27.175 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.175 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.175 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.175 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.175 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.175 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.175 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.176 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.176 INFO:teuthology.orchestra.run.smithi027.stdout: "zabbix_sender": { 2024-09-19T08:21:27.176 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix_sender", 2024-09-19T08:21:27.176 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-19T08:21:27.176 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-19T08:21:27.176 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-19T08:21:27.176 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T08:21:27.176 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-19T08:21:27.176 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-19T08:21:27.176 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-19T08:21:27.177 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-19T08:21:27.177 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-19T08:21:27.177 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-19T08:21:27.177 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-19T08:21:27.177 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.177 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.177 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.177 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.177 INFO:teuthology.orchestra.run.smithi027.stdout: "services": { 2024-09-19T08:21:27.177 INFO:teuthology.orchestra.run.smithi027.stdout: "dashboard": "https://172.21.15.27:8443/" 2024-09-19T08:21:27.177 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.178 INFO:teuthology.orchestra.run.smithi027.stdout: "always_on_modules": { 2024-09-19T08:21:27.178 INFO:teuthology.orchestra.run.smithi027.stdout: "octopus": [ 2024-09-19T08:21:27.178 INFO:teuthology.orchestra.run.smithi027.stdout: "balancer", 2024-09-19T08:21:27.178 INFO:teuthology.orchestra.run.smithi027.stdout: "crash", 2024-09-19T08:21:27.178 INFO:teuthology.orchestra.run.smithi027.stdout: "devicehealth", 2024-09-19T08:21:27.178 INFO:teuthology.orchestra.run.smithi027.stdout: "orchestrator", 2024-09-19T08:21:27.178 INFO:teuthology.orchestra.run.smithi027.stdout: "pg_autoscaler", 2024-09-19T08:21:27.178 INFO:teuthology.orchestra.run.smithi027.stdout: "progress", 2024-09-19T08:21:27.178 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_support", 2024-09-19T08:21:27.178 INFO:teuthology.orchestra.run.smithi027.stdout: "status", 2024-09-19T08:21:27.178 INFO:teuthology.orchestra.run.smithi027.stdout: "telemetry", 2024-09-19T08:21:27.179 INFO:teuthology.orchestra.run.smithi027.stdout: "volumes" 2024-09-19T08:21:27.179 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.179 INFO:teuthology.orchestra.run.smithi027.stdout: "pacific": [ 2024-09-19T08:21:27.179 INFO:teuthology.orchestra.run.smithi027.stdout: "balancer", 2024-09-19T08:21:27.179 INFO:teuthology.orchestra.run.smithi027.stdout: "crash", 2024-09-19T08:21:27.179 INFO:teuthology.orchestra.run.smithi027.stdout: "devicehealth", 2024-09-19T08:21:27.179 INFO:teuthology.orchestra.run.smithi027.stdout: "orchestrator", 2024-09-19T08:21:27.179 INFO:teuthology.orchestra.run.smithi027.stdout: "pg_autoscaler", 2024-09-19T08:21:27.179 INFO:teuthology.orchestra.run.smithi027.stdout: "progress", 2024-09-19T08:21:27.179 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_support", 2024-09-19T08:21:27.179 INFO:teuthology.orchestra.run.smithi027.stdout: "status", 2024-09-19T08:21:27.180 INFO:teuthology.orchestra.run.smithi027.stdout: "telemetry", 2024-09-19T08:21:27.180 INFO:teuthology.orchestra.run.smithi027.stdout: "volumes" 2024-09-19T08:21:27.180 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.180 INFO:teuthology.orchestra.run.smithi027.stdout: "quincy": [ 2024-09-19T08:21:27.180 INFO:teuthology.orchestra.run.smithi027.stdout: "balancer", 2024-09-19T08:21:27.180 INFO:teuthology.orchestra.run.smithi027.stdout: "crash", 2024-09-19T08:21:27.180 INFO:teuthology.orchestra.run.smithi027.stdout: "devicehealth", 2024-09-19T08:21:27.180 INFO:teuthology.orchestra.run.smithi027.stdout: "orchestrator", 2024-09-19T08:21:27.180 INFO:teuthology.orchestra.run.smithi027.stdout: "pg_autoscaler", 2024-09-19T08:21:27.180 INFO:teuthology.orchestra.run.smithi027.stdout: "progress", 2024-09-19T08:21:27.180 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_support", 2024-09-19T08:21:27.181 INFO:teuthology.orchestra.run.smithi027.stdout: "status", 2024-09-19T08:21:27.181 INFO:teuthology.orchestra.run.smithi027.stdout: "telemetry", 2024-09-19T08:21:27.181 INFO:teuthology.orchestra.run.smithi027.stdout: "volumes" 2024-09-19T08:21:27.181 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.181 INFO:teuthology.orchestra.run.smithi027.stdout: "reef": [ 2024-09-19T08:21:27.181 INFO:teuthology.orchestra.run.smithi027.stdout: "balancer", 2024-09-19T08:21:27.181 INFO:teuthology.orchestra.run.smithi027.stdout: "crash", 2024-09-19T08:21:27.181 INFO:teuthology.orchestra.run.smithi027.stdout: "devicehealth", 2024-09-19T08:21:27.181 INFO:teuthology.orchestra.run.smithi027.stdout: "orchestrator", 2024-09-19T08:21:27.181 INFO:teuthology.orchestra.run.smithi027.stdout: "pg_autoscaler", 2024-09-19T08:21:27.181 INFO:teuthology.orchestra.run.smithi027.stdout: "progress", 2024-09-19T08:21:27.181 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_support", 2024-09-19T08:21:27.182 INFO:teuthology.orchestra.run.smithi027.stdout: "status", 2024-09-19T08:21:27.182 INFO:teuthology.orchestra.run.smithi027.stdout: "telemetry", 2024-09-19T08:21:27.182 INFO:teuthology.orchestra.run.smithi027.stdout: "volumes" 2024-09-19T08:21:27.182 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-19T08:21:27.182 INFO:teuthology.orchestra.run.smithi027.stdout: "squid": [ 2024-09-19T08:21:27.182 INFO:teuthology.orchestra.run.smithi027.stdout: "balancer", 2024-09-19T08:21:27.182 INFO:teuthology.orchestra.run.smithi027.stdout: "crash", 2024-09-19T08:21:27.182 INFO:teuthology.orchestra.run.smithi027.stdout: "devicehealth", 2024-09-19T08:21:27.182 INFO:teuthology.orchestra.run.smithi027.stdout: "orchestrator", 2024-09-19T08:21:27.182 INFO:teuthology.orchestra.run.smithi027.stdout: "pg_autoscaler", 2024-09-19T08:21:27.182 INFO:teuthology.orchestra.run.smithi027.stdout: "progress", 2024-09-19T08:21:27.183 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_support", 2024-09-19T08:21:27.183 INFO:teuthology.orchestra.run.smithi027.stdout: "status", 2024-09-19T08:21:27.183 INFO:teuthology.orchestra.run.smithi027.stdout: "telemetry", 2024-09-19T08:21:27.183 INFO:teuthology.orchestra.run.smithi027.stdout: "volumes" 2024-09-19T08:21:27.183 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-19T08:21:27.183 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.183 INFO:teuthology.orchestra.run.smithi027.stdout: "last_failure_osd_epoch": 84, 2024-09-19T08:21:27.183 INFO:teuthology.orchestra.run.smithi027.stdout: "active_clients": [ 2024-09-19T08:21:27.183 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.183 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "devicehealth", 2024-09-19T08:21:27.183 INFO:teuthology.orchestra.run.smithi027.stdout: "addrvec": [ 2024-09-19T08:21:27.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.184 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v2", 2024-09-19T08:21:27.184 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "172.21.15.27:0", 2024-09-19T08:21:27.184 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 703837304 2024-09-19T08:21:27.184 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.184 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-19T08:21:27.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.184 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "libcephsqlite", 2024-09-19T08:21:27.184 INFO:teuthology.orchestra.run.smithi027.stdout: "addrvec": [ 2024-09-19T08:21:27.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.184 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v2", 2024-09-19T08:21:27.185 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "172.21.15.27:0", 2024-09-19T08:21:27.185 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 3369053026 2024-09-19T08:21:27.185 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.185 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-19T08:21:27.185 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.185 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rbd_support", 2024-09-19T08:21:27.185 INFO:teuthology.orchestra.run.smithi027.stdout: "addrvec": [ 2024-09-19T08:21:27.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.185 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v2", 2024-09-19T08:21:27.186 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "172.21.15.27:0", 2024-09-19T08:21:27.186 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 3910988716 2024-09-19T08:21:27.186 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.186 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-19T08:21:27.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.186 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "snap_schedule", 2024-09-19T08:21:27.186 INFO:teuthology.orchestra.run.smithi027.stdout: "addrvec": [ 2024-09-19T08:21:27.186 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.186 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v2", 2024-09-19T08:21:27.186 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "172.21.15.27:0", 2024-09-19T08:21:27.186 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 2000622711 2024-09-19T08:21:27.187 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.187 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-19T08:21:27.187 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.187 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.187 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "snap_schedule", 2024-09-19T08:21:27.187 INFO:teuthology.orchestra.run.smithi027.stdout: "addrvec": [ 2024-09-19T08:21:27.187 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.187 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v2", 2024-09-19T08:21:27.187 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "172.21.15.27:0", 2024-09-19T08:21:27.187 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 3509785101 2024-09-19T08:21:27.187 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.187 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-19T08:21:27.188 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:27.188 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.188 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "volumes", 2024-09-19T08:21:27.188 INFO:teuthology.orchestra.run.smithi027.stdout: "addrvec": [ 2024-09-19T08:21:27.188 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-19T08:21:27.188 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v2", 2024-09-19T08:21:27.188 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "172.21.15.27:0", 2024-09-19T08:21:27.188 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 4047211348 2024-09-19T08:21:27.188 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.188 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-19T08:21:27.188 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:27.189 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-19T08:21:27.189 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:21:27.190 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:25 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/4209550064' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:21:27.190 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:25 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3599252696' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:21:27.190 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:25 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/701110429' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T08:21:27.190 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:25 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/4209550064' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:21:27.191 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:25 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3599252696' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:21:27.191 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:25 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/701110429' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T08:21:27.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.674+0000 7fc410874640 1 -- 172.21.15.27:0/701110429 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc3f40a33c0 msgr2=0x7fc3f40a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:27.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.674+0000 7fc410874640 1 --2- 172.21.15.27:0/701110429 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc3f40a33c0 0x7fc3f40a5880 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc40c100140 tx=0x7fc400008040 comp rx=0 tx=0).stop 2024-09-19T08:21:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.674+0000 7fc410874640 1 -- 172.21.15.27:0/701110429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc40c100880 msgr2=0x7fc40c198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.675+0000 7fc410874640 1 --2- 172.21.15.27:0/701110429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc40c100880 0x7fc40c198460 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0097b0 tx=0x7fc3fc031b10 comp rx=0 tx=0).stop 2024-09-19T08:21:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.675+0000 7fc410874640 1 -- 172.21.15.27:0/701110429 shutdown_connections 2024-09-19T08:21:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.675+0000 7fc410874640 1 --2- 172.21.15.27:0/701110429 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fc3f40a33c0 0x7fc3f40a5880 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.675+0000 7fc410874640 1 --2- 172.21.15.27:0/701110429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc40c19cd20 0x7fc40c19d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.675+0000 7fc410874640 1 --2- 172.21.15.27:0/701110429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc40c1080d0 0x7fc40c1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.675+0000 7fc410874640 1 --2- 172.21.15.27:0/701110429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc40c100880 0x7fc40c198460 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.675+0000 7fc410874640 1 -- 172.21.15.27:0/701110429 >> 172.21.15.27:0/701110429 conn(0x7fc40c075f60 msgr2=0x7fc40c105b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.675+0000 7fc410874640 1 -- 172.21.15.27:0/701110429 shutdown_connections 2024-09-19T08:21:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:25.675+0000 7fc410874640 1 -- 172.21.15.27:0/701110429 wait complete. 2024-09-19T08:21:27.198 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T08:21:27.199 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T08:21:27.199 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:25 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/4209550064' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:21:27.199 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:25 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3599252696' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:21:27.199 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:25 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/701110429' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T08:21:27.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:26 smithi027 ceph-mon[31209]: pgmap v323: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T08:21:27.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:26 smithi155 ceph-mon[35362]: pgmap v323: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T08:21:27.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:26 smithi203 ceph-mon[35198]: pgmap v323: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T08:21:27.471 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:21:28.014 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:21:28.015 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:21:28.015 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 213, 2024-09-19T08:21:28.015 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 202, 2024-09-19T08:21:28.015 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 1584080, 2024-09-19T08:21:28.015 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 124064, 2024-09-19T08:21:28.015 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 4, 2024-09-19T08:21:28.015 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 0, 2024-09-19T08:21:28.015 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.041026165, 2024-09-19T08:21:28.016 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.015188536, 2024-09-19T08:21:28.016 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.036980512, 2024-09-19T08:21:28.016 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:28.016 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:28.016 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 201, 2024-09-19T08:21:28.016 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.011830927, 2024-09-19T08:21:28.016 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000058860 2024-09-19T08:21:28.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:28.016 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:28.016 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-19T08:21:28.016 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-19T08:21:28.017 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-19T08:21:28.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:28.017 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 1584080, 2024-09-19T08:21:28.017 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 124064 2024-09-19T08:21:28.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:28.017 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:21:28.017 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 2, 2024-09-19T08:21:28.017 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 155, 2024-09-19T08:21:28.017 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 320, 2024-09-19T08:21:28.017 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 184416, 2024-09-19T08:21:28.017 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 5, 2024-09-19T08:21:28.017 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 3, 2024-09-19T08:21:28.018 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.013814176, 2024-09-19T08:21:28.018 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.009491879, 2024-09-19T08:21:28.018 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.001844952, 2024-09-19T08:21:28.018 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:28.018 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:28.018 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 152, 2024-09-19T08:21:28.018 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.013820922, 2024-09-19T08:21:28.018 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000090927 2024-09-19T08:21:28.018 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:28.018 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:28.018 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-19T08:21:28.019 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-19T08:21:28.019 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-19T08:21:28.019 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:28.019 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T08:21:28.019 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 184416 2024-09-19T08:21:28.019 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:28.019 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:21:28.019 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 4, 2024-09-19T08:21:28.019 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 4, 2024-09-19T08:21:28.019 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 2992, 2024-09-19T08:21:28.019 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 448, 2024-09-19T08:21:28.019 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 2, 2024-09-19T08:21:28.020 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 1, 2024-09-19T08:21:28.020 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.002494423, 2024-09-19T08:21:28.020 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.000051532, 2024-09-19T08:21:28.020 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.002444982, 2024-09-19T08:21:28.020 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:28.020 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:28.020 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 3, 2024-09-19T08:21:28.020 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.004358252, 2024-09-19T08:21:28.020 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.001452750 2024-09-19T08:21:28.020 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:28.020 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:28.021 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-19T08:21:28.021 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-19T08:21:28.021 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-19T08:21:28.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:28.021 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T08:21:28.021 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T08:21:28.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:28.021 INFO:teuthology.orchestra.run.smithi027.stdout: "cct": { 2024-09-19T08:21:28.021 INFO:teuthology.orchestra.run.smithi027.stdout: "total_workers": 0, 2024-09-19T08:21:28.021 INFO:teuthology.orchestra.run.smithi027.stdout: "unhealthy_workers": 0 2024-09-19T08:21:28.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:28.022 INFO:teuthology.orchestra.run.smithi027.stdout: "mempool": { 2024-09-19T08:21:28.022 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:21:28.022 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_items": 0, 2024-09-19T08:21:28.022 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:21:28.022 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:21:28.022 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:21:28.022 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:21:28.022 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:21:28.022 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:21:28.022 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:21:28.022 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:21:28.022 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:21:28.023 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:21:28.023 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:21:28.023 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:21:28.023 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:21:28.023 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_items": 0, 2024-09-19T08:21:28.023 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:21:28.023 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_items": 0, 2024-09-19T08:21:28.023 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:21:28.023 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:21:28.023 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:21:28.023 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:21:28.023 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:21:28.024 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:21:28.024 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:21:28.024 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_items": 0, 2024-09-19T08:21:28.024 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:21:28.024 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:21:28.024 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:21:28.024 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_items": 0, 2024-09-19T08:21:28.024 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_bytes": 0, 2024-09-19T08:21:28.024 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_items": 0, 2024-09-19T08:21:28.024 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:21:28.024 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:21:28.025 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:21:28.025 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:21:28.025 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_bytes": 149017, 2024-09-19T08:21:28.025 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_items": 31, 2024-09-19T08:21:28.025 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:21:28.025 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_items": 0, 2024-09-19T08:21:28.025 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_bytes": 0, 2024-09-19T08:21:28.025 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_items": 0, 2024-09-19T08:21:28.025 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:21:28.025 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_items": 0, 2024-09-19T08:21:28.026 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:21:28.026 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_items": 0, 2024-09-19T08:21:28.026 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_bytes": 0, 2024-09-19T08:21:28.026 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_items": 0, 2024-09-19T08:21:28.026 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:21:28.026 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:21:28.026 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_bytes": 0, 2024-09-19T08:21:28.026 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_items": 0, 2024-09-19T08:21:28.026 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_bytes": 928, 2024-09-19T08:21:28.026 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_items": 2, 2024-09-19T08:21:28.026 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_bytes": 0, 2024-09-19T08:21:28.026 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_items": 0, 2024-09-19T08:21:28.027 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_bytes": 0, 2024-09-19T08:21:28.027 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_items": 0 2024-09-19T08:21:28.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:28.027 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:21:28.027 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-19T08:21:28.027 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 104857600, 2024-09-19T08:21:28.027 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-19T08:21:28.027 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 215, 2024-09-19T08:21:28.027 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 1554028, 2024-09-19T08:21:28.027 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-19T08:21:28.027 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 215, 2024-09-19T08:21:28.028 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 0, 2024-09-19T08:21:28.028 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 0, 2024-09-19T08:21:28.028 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 215, 2024-09-19T08:21:28.028 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 1554028, 2024-09-19T08:21:28.028 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-19T08:21:28.028 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-19T08:21:28.028 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-19T08:21:28.028 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-19T08:21:28.028 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:28.028 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:28.028 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:21:28.802 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-19T08:21:28.802 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-19T08:21:28.802 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-19T08:21:28.802 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T08:21:28.803 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T08:21:29.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:28 smithi027 ceph-mon[31209]: pgmap v324: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 87 B/s wr, 2 op/s 2024-09-19T08:21:29.100 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:21:29.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:28 smithi155 ceph-mon[35362]: pgmap v324: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 87 B/s wr, 2 op/s 2024-09-19T08:21:29.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:28 smithi203 ceph-mon[35198]: pgmap v324: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 87 B/s wr, 2 op/s 2024-09-19T08:21:29.645 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:21:29.645 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:21:29.646 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 0, 2024-09-19T08:21:29.646 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 2, 2024-09-19T08:21:29.646 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:21:29.646 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 0, 2024-09-19T08:21:29.646 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 4, 2024-09-19T08:21:29.646 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 0, 2024-09-19T08:21:29.646 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.001406005, 2024-09-19T08:21:29.646 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:21:29.646 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.000353324, 2024-09-19T08:21:29.646 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:29.647 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:29.647 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-19T08:21:29.647 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-19T08:21:29.647 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-19T08:21:29.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:29.647 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:29.647 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-19T08:21:29.647 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-19T08:21:29.647 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-19T08:21:29.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:29.647 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:21:29.647 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:21:29.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:29.648 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:21:29.648 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 219, 2024-09-19T08:21:29.648 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 208, 2024-09-19T08:21:29.648 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 1585712, 2024-09-19T08:21:29.648 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 127904, 2024-09-19T08:21:29.648 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 2, 2024-09-19T08:21:29.648 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 1, 2024-09-19T08:21:29.648 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.044438150, 2024-09-19T08:21:29.648 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.014593897, 2024-09-19T08:21:29.648 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.042930256, 2024-09-19T08:21:29.649 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:29.649 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:29.649 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 207, 2024-09-19T08:21:29.649 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.011404821, 2024-09-19T08:21:29.649 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000055095 2024-09-19T08:21:29.649 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:29.649 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:29.649 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-19T08:21:29.649 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-19T08:21:29.649 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-19T08:21:29.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:29.650 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 1585712, 2024-09-19T08:21:29.650 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 127904 2024-09-19T08:21:29.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:29.650 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:21:29.650 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 6, 2024-09-19T08:21:29.650 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 161, 2024-09-19T08:21:29.650 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 3312, 2024-09-19T08:21:29.650 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 185568, 2024-09-19T08:21:29.650 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 5, 2024-09-19T08:21:29.650 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 3, 2024-09-19T08:21:29.651 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.015463170, 2024-09-19T08:21:29.651 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.009135577, 2024-09-19T08:21:29.651 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.004128073, 2024-09-19T08:21:29.651 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:29.651 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:29.651 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 159, 2024-09-19T08:21:29.651 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.022759113, 2024-09-19T08:21:29.651 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000143139 2024-09-19T08:21:29.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:29.651 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:29.651 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-19T08:21:29.651 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-19T08:21:29.652 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-19T08:21:29.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:29.652 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-19T08:21:29.652 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 185568 2024-09-19T08:21:29.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:29.652 INFO:teuthology.orchestra.run.smithi027.stdout: "cct": { 2024-09-19T08:21:29.652 INFO:teuthology.orchestra.run.smithi027.stdout: "total_workers": 0, 2024-09-19T08:21:29.652 INFO:teuthology.orchestra.run.smithi027.stdout: "unhealthy_workers": 0 2024-09-19T08:21:29.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:29.652 INFO:teuthology.orchestra.run.smithi027.stdout: "mempool": { 2024-09-19T08:21:29.652 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:21:29.653 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_items": 0, 2024-09-19T08:21:29.653 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:21:29.653 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:21:29.653 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:21:29.653 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:21:29.653 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:21:29.653 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:21:29.653 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:21:29.653 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:21:29.653 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:21:29.653 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:21:29.654 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:21:29.654 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:21:29.654 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:21:29.654 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_items": 0, 2024-09-19T08:21:29.654 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:21:29.654 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_items": 0, 2024-09-19T08:21:29.654 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:21:29.654 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:21:29.654 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:21:29.654 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:21:29.654 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:21:29.655 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:21:29.655 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:21:29.655 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_items": 0, 2024-09-19T08:21:29.655 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:21:29.655 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:21:29.655 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:21:29.655 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_items": 0, 2024-09-19T08:21:29.655 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_bytes": 0, 2024-09-19T08:21:29.655 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_items": 0, 2024-09-19T08:21:29.655 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:21:29.655 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:21:29.656 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:21:29.656 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:21:29.656 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_bytes": 149011, 2024-09-19T08:21:29.656 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_items": 32, 2024-09-19T08:21:29.656 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:21:29.656 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_items": 0, 2024-09-19T08:21:29.656 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_bytes": 0, 2024-09-19T08:21:29.656 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_items": 0, 2024-09-19T08:21:29.656 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:21:29.656 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_items": 0, 2024-09-19T08:21:29.657 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:21:29.657 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_items": 0, 2024-09-19T08:21:29.657 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_bytes": 0, 2024-09-19T08:21:29.657 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_items": 0, 2024-09-19T08:21:29.657 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:21:29.657 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:21:29.657 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_bytes": 0, 2024-09-19T08:21:29.657 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_items": 0, 2024-09-19T08:21:29.657 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_bytes": 928, 2024-09-19T08:21:29.657 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_items": 2, 2024-09-19T08:21:29.658 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_bytes": 0, 2024-09-19T08:21:29.658 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_items": 0, 2024-09-19T08:21:29.658 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_bytes": 0, 2024-09-19T08:21:29.658 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_items": 0 2024-09-19T08:21:29.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:29.658 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:21:29.658 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-19T08:21:29.658 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 104857600, 2024-09-19T08:21:29.658 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-19T08:21:29.658 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 221, 2024-09-19T08:21:29.658 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 1554808, 2024-09-19T08:21:29.658 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-19T08:21:29.658 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 221, 2024-09-19T08:21:29.658 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 0, 2024-09-19T08:21:29.659 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 0, 2024-09-19T08:21:29.659 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 221, 2024-09-19T08:21:29.659 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 1554808, 2024-09-19T08:21:29.659 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-19T08:21:29.659 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-19T08:21:29.659 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-19T08:21:29.659 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-19T08:21:29.659 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:29.660 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:29.660 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:21:30.339 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-19T08:21:30.339 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-19T08:21:30.339 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-19T08:21:30.339 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T08:21:30.340 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T08:21:30.598 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:21:31.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:30 smithi027 ceph-mon[31209]: pgmap v325: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:31.135 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:21:31.135 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:21:31.135 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 215, 2024-09-19T08:21:31.135 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 204, 2024-09-19T08:21:31.136 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 1584624, 2024-09-19T08:21:31.136 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 125344, 2024-09-19T08:21:31.136 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 4, 2024-09-19T08:21:31.136 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 0, 2024-09-19T08:21:31.136 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.044835842, 2024-09-19T08:21:31.136 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.014257986, 2024-09-19T08:21:31.136 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.041484656, 2024-09-19T08:21:31.136 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:31.136 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:31.136 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 203, 2024-09-19T08:21:31.136 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.011602803, 2024-09-19T08:21:31.136 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000057156 2024-09-19T08:21:31.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:31.137 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:31.137 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-19T08:21:31.137 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-19T08:21:31.137 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-19T08:21:31.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:31.137 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 1584624, 2024-09-19T08:21:31.137 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 125344 2024-09-19T08:21:31.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:31.137 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:21:31.137 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 6, 2024-09-19T08:21:31.137 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 158, 2024-09-19T08:21:31.137 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 3312, 2024-09-19T08:21:31.137 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 185040, 2024-09-19T08:21:31.138 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 5, 2024-09-19T08:21:31.138 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 3, 2024-09-19T08:21:31.138 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.015125414, 2024-09-19T08:21:31.138 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.008898215, 2024-09-19T08:21:31.138 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.004234071, 2024-09-19T08:21:31.138 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:31.138 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:31.138 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 156, 2024-09-19T08:21:31.138 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.018972808, 2024-09-19T08:21:31.138 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000121620 2024-09-19T08:21:31.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:31.138 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:31.138 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-19T08:21:31.138 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-19T08:21:31.138 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-19T08:21:31.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:31.139 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-19T08:21:31.139 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 185040 2024-09-19T08:21:31.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:31.139 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:21:31.139 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 0, 2024-09-19T08:21:31.139 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 2, 2024-09-19T08:21:31.139 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:21:31.139 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 0, 2024-09-19T08:21:31.139 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 2, 2024-09-19T08:21:31.139 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 1, 2024-09-19T08:21:31.139 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.000385007, 2024-09-19T08:21:31.139 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:21:31.139 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.000305360, 2024-09-19T08:21:31.139 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:31.139 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:31.140 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-19T08:21:31.140 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-19T08:21:31.140 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-19T08:21:31.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:31.140 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:31.140 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-19T08:21:31.140 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-19T08:21:31.140 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-19T08:21:31.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:31.140 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:21:31.140 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:21:31.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:31.140 INFO:teuthology.orchestra.run.smithi027.stdout: "cct": { 2024-09-19T08:21:31.141 INFO:teuthology.orchestra.run.smithi027.stdout: "total_workers": 0, 2024-09-19T08:21:31.141 INFO:teuthology.orchestra.run.smithi027.stdout: "unhealthy_workers": 0 2024-09-19T08:21:31.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:31.141 INFO:teuthology.orchestra.run.smithi027.stdout: "mempool": { 2024-09-19T08:21:31.141 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:21:31.141 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_items": 0, 2024-09-19T08:21:31.141 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:21:31.141 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:21:31.141 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:21:31.141 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:21:31.141 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:21:31.141 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:21:31.142 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:21:31.142 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:21:31.142 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:21:31.142 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:21:31.142 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:21:31.142 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:21:31.142 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:21:31.142 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_items": 0, 2024-09-19T08:21:31.142 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:21:31.142 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_items": 0, 2024-09-19T08:21:31.143 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:21:31.143 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:21:31.143 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:21:31.143 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:21:31.143 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:21:31.143 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:21:31.143 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:21:31.143 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_items": 0, 2024-09-19T08:21:31.143 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:21:31.143 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:21:31.143 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:21:31.143 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_items": 0, 2024-09-19T08:21:31.143 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_bytes": 0, 2024-09-19T08:21:31.144 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_items": 0, 2024-09-19T08:21:31.144 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:21:31.144 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:21:31.144 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:21:31.144 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:21:31.144 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_bytes": 148977, 2024-09-19T08:21:31.144 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_items": 30, 2024-09-19T08:21:31.144 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:21:31.144 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_items": 0, 2024-09-19T08:21:31.144 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_bytes": 0, 2024-09-19T08:21:31.144 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_items": 0, 2024-09-19T08:21:31.144 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:21:31.144 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_items": 0, 2024-09-19T08:21:31.144 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:21:31.144 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_items": 0, 2024-09-19T08:21:31.145 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_bytes": 0, 2024-09-19T08:21:31.145 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_items": 0, 2024-09-19T08:21:31.145 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:21:31.145 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:21:31.145 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_bytes": 0, 2024-09-19T08:21:31.145 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_items": 0, 2024-09-19T08:21:31.145 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_bytes": 928, 2024-09-19T08:21:31.145 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_items": 2, 2024-09-19T08:21:31.145 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_bytes": 0, 2024-09-19T08:21:31.145 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_items": 0, 2024-09-19T08:21:31.145 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_bytes": 0, 2024-09-19T08:21:31.145 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_items": 0 2024-09-19T08:21:31.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:31.146 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:21:31.146 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-19T08:21:31.146 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 104857600, 2024-09-19T08:21:31.146 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-19T08:21:31.146 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 217, 2024-09-19T08:21:31.146 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 1554288, 2024-09-19T08:21:31.146 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-19T08:21:31.146 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 217, 2024-09-19T08:21:31.146 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 0, 2024-09-19T08:21:31.146 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 0, 2024-09-19T08:21:31.146 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 217, 2024-09-19T08:21:31.146 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 1554288, 2024-09-19T08:21:31.146 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-19T08:21:31.147 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-19T08:21:31.147 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-19T08:21:31.147 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-19T08:21:31.147 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:31.147 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:31.147 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:21:31.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:30 smithi155 ceph-mon[35362]: pgmap v325: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:31.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:30 smithi203 ceph-mon[35198]: pgmap v325: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:31.806 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-19T08:21:31.806 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-19T08:21:31.806 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-19T08:21:31.806 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T08:21:31.807 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T08:21:32.064 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:21:32.628 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-19T08:21:32.628 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:21:32.628 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 220, 2024-09-19T08:21:32.628 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 209, 2024-09-19T08:21:32.628 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 1585984, 2024-09-19T08:21:32.628 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 128544, 2024-09-19T08:21:32.628 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 4, 2024-09-19T08:21:32.628 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 0, 2024-09-19T08:21:32.628 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.047091095, 2024-09-19T08:21:32.628 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.014718169, 2024-09-19T08:21:32.629 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.045323821, 2024-09-19T08:21:32.629 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:32.629 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:32.629 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 208, 2024-09-19T08:21:32.629 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.011916549, 2024-09-19T08:21:32.629 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000057291 2024-09-19T08:21:32.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:32.629 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:32.629 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-19T08:21:32.629 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-19T08:21:32.629 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-19T08:21:32.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:32.630 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 1585984, 2024-09-19T08:21:32.630 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 128544 2024-09-19T08:21:32.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:32.630 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:21:32.630 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 2, 2024-09-19T08:21:32.630 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 161, 2024-09-19T08:21:32.630 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 320, 2024-09-19T08:21:32.630 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 185472, 2024-09-19T08:21:32.630 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 5, 2024-09-19T08:21:32.630 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 3, 2024-09-19T08:21:32.630 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.014215345, 2024-09-19T08:21:32.630 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.009815571, 2024-09-19T08:21:32.630 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.002040644, 2024-09-19T08:21:32.631 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:32.631 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:32.631 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 158, 2024-09-19T08:21:32.631 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.012731940, 2024-09-19T08:21:32.631 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000080581 2024-09-19T08:21:32.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:32.631 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:32.631 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-19T08:21:32.631 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-19T08:21:32.631 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-19T08:21:32.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:32.631 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T08:21:32.631 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 185472 2024-09-19T08:21:32.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:32.631 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:21:32.632 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 4, 2024-09-19T08:21:32.632 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 4, 2024-09-19T08:21:32.632 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 2992, 2024-09-19T08:21:32.632 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 448, 2024-09-19T08:21:32.632 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 2, 2024-09-19T08:21:32.632 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 1, 2024-09-19T08:21:32.632 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.002397049, 2024-09-19T08:21:32.632 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.000052222, 2024-09-19T08:21:32.632 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.002362689, 2024-09-19T08:21:32.632 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:32.632 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:32.632 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 3, 2024-09-19T08:21:32.632 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.004311910, 2024-09-19T08:21:32.633 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.001437303 2024-09-19T08:21:32.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:32.633 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:32.633 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-19T08:21:32.633 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-19T08:21:32.633 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-19T08:21:32.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:32.633 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T08:21:32.633 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T08:21:32.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:32.634 INFO:teuthology.orchestra.run.smithi027.stdout: "cct": { 2024-09-19T08:21:32.634 INFO:teuthology.orchestra.run.smithi027.stdout: "total_workers": 0, 2024-09-19T08:21:32.634 INFO:teuthology.orchestra.run.smithi027.stdout: "unhealthy_workers": 0 2024-09-19T08:21:32.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:32.634 INFO:teuthology.orchestra.run.smithi027.stdout: "mempool": { 2024-09-19T08:21:32.634 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:21:32.634 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_items": 0, 2024-09-19T08:21:32.634 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:21:32.634 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:21:32.634 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:21:32.634 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:21:32.634 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:21:32.635 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:21:32.635 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:21:32.635 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:21:32.635 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:21:32.635 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:21:32.635 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:21:32.635 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:21:32.635 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:21:32.635 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_items": 0, 2024-09-19T08:21:32.635 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:21:32.635 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_items": 0, 2024-09-19T08:21:32.635 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:21:32.636 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:21:32.636 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:21:32.636 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:21:32.636 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:21:32.636 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:21:32.636 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:21:32.636 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_items": 0, 2024-09-19T08:21:32.636 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:21:32.636 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:21:32.636 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:21:32.636 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_items": 0, 2024-09-19T08:21:32.636 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_bytes": 0, 2024-09-19T08:21:32.636 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_items": 0, 2024-09-19T08:21:32.637 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:21:32.637 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:21:32.637 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:21:32.637 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:21:32.637 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_bytes": 148977, 2024-09-19T08:21:32.637 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_items": 30, 2024-09-19T08:21:32.637 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:21:32.637 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_items": 0, 2024-09-19T08:21:32.637 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_bytes": 0, 2024-09-19T08:21:32.637 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_items": 0, 2024-09-19T08:21:32.637 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:21:32.637 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_items": 0, 2024-09-19T08:21:32.637 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:21:32.637 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_items": 0, 2024-09-19T08:21:32.638 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_bytes": 0, 2024-09-19T08:21:32.638 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_items": 0, 2024-09-19T08:21:32.638 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:21:32.638 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:21:32.638 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_bytes": 0, 2024-09-19T08:21:32.638 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_items": 0, 2024-09-19T08:21:32.638 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_bytes": 928, 2024-09-19T08:21:32.638 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_items": 2, 2024-09-19T08:21:32.638 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_bytes": 0, 2024-09-19T08:21:32.638 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_items": 0, 2024-09-19T08:21:32.638 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_bytes": 0, 2024-09-19T08:21:32.638 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_items": 0 2024-09-19T08:21:32.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-19T08:21:32.639 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:21:32.639 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-19T08:21:32.639 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 104857600, 2024-09-19T08:21:32.639 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-19T08:21:32.639 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 222, 2024-09-19T08:21:32.639 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 1554938, 2024-09-19T08:21:32.639 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-19T08:21:32.639 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 222, 2024-09-19T08:21:32.639 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 0, 2024-09-19T08:21:32.639 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 0, 2024-09-19T08:21:32.639 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 222, 2024-09-19T08:21:32.640 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 1554938, 2024-09-19T08:21:32.640 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-19T08:21:32.640 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-19T08:21:32.640 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-19T08:21:32.640 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-19T08:21:32.640 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:32.640 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-19T08:21:32.640 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-19T08:21:33.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:32 smithi155 ceph-mon[35362]: pgmap v326: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:33.240 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:32 smithi027 ceph-mon[31209]: pgmap v326: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:33.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:32 smithi203 ceph-mon[35198]: pgmap v326: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:33.325 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-19T08:21:33.325 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-19T08:21:33.325 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-19T08:21:33.326 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T08:21:33.326 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T08:21:33.586 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:21:34.122 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-09-19T08:21:34.122 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:21:34.122 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 3937, 2024-09-19T08:21:34.122 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 3392, 2024-09-19T08:21:34.122 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 1127398, 2024-09-19T08:21:34.123 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 9858516, 2024-09-19T08:21:34.123 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 38, 2024-09-19T08:21:34.123 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 5, 2024-09-19T08:21:34.123 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.352245943, 2024-09-19T08:21:34.123 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.117074588, 2024-09-19T08:21:34.123 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.095807944, 2024-09-19T08:21:34.123 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.110670554, 2024-09-19T08:21:34.123 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:34.123 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3391, 2024-09-19T08:21:34.123 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.866806800, 2024-09-19T08:21:34.123 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000255619 2024-09-19T08:21:34.123 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.124 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:34.124 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 863, 2024-09-19T08:21:34.124 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000147117, 2024-09-19T08:21:34.124 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000170 2024-09-19T08:21:34.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.124 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 305520, 2024-09-19T08:21:34.124 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 88384 2024-09-19T08:21:34.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.124 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:21:34.124 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 2892, 2024-09-19T08:21:34.124 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 2793, 2024-09-19T08:21:34.124 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 2398904, 2024-09-19T08:21:34.125 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 7002419, 2024-09-19T08:21:34.125 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 151, 2024-09-19T08:21:34.125 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 5, 2024-09-19T08:21:34.125 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.290398846, 2024-09-19T08:21:34.125 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.092842437, 2024-09-19T08:21:34.125 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.134479347, 2024-09-19T08:21:34.125 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.066093013, 2024-09-19T08:21:34.125 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:34.125 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2792, 2024-09-19T08:21:34.125 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.530001715, 2024-09-19T08:21:34.125 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000189828 2024-09-19T08:21:34.125 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.126 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:34.126 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 252, 2024-09-19T08:21:34.126 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000058020, 2024-09-19T08:21:34.126 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000230 2024-09-19T08:21:34.126 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.126 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 1666032, 2024-09-19T08:21:34.126 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 162304 2024-09-19T08:21:34.126 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.126 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:21:34.126 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 7163, 2024-09-19T08:21:34.126 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 11413, 2024-09-19T08:21:34.126 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 2689666, 2024-09-19T08:21:34.126 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 8419033, 2024-09-19T08:21:34.127 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 13, 2024-09-19T08:21:34.127 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 5, 2024-09-19T08:21:34.127 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.613021332, 2024-09-19T08:21:34.127 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.240922022, 2024-09-19T08:21:34.127 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.340363909, 2024-09-19T08:21:34.127 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.097737305, 2024-09-19T08:21:34.127 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:34.127 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 11410, 2024-09-19T08:21:34.127 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.653959528, 2024-09-19T08:21:34.127 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000057314 2024-09-19T08:21:34.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.128 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:34.128 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 13509, 2024-09-19T08:21:34.128 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.001827218, 2024-09-19T08:21:34.128 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000135 2024-09-19T08:21:34.128 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.128 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 2337664, 2024-09-19T08:21:34.128 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 4920144 2024-09-19T08:21:34.128 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.129 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2024-09-19T08:21:34.129 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 1, 2024-09-19T08:21:34.129 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2024-09-19T08:21:34.129 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.129 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-MDSRank": { 2024-09-19T08:21:34.129 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2024-09-19T08:21:34.129 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2024-09-19T08:21:34.129 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 4485, 2024-09-19T08:21:34.129 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 2.025792008, 2024-09-19T08:21:34.129 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000451681 2024-09-19T08:21:34.129 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T08:21:34.129 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.129 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-PurgeQueue": { 2024-09-19T08:21:34.130 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2024-09-19T08:21:34.130 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2024-09-19T08:21:34.130 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3620, 2024-09-19T08:21:34.130 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.222705664, 2024-09-19T08:21:34.130 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000061520 2024-09-19T08:21:34.130 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T08:21:34.130 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.130 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2024-09-19T08:21:34.130 INFO:teuthology.orchestra.run.smithi155.stdout: "request": 2594, 2024-09-19T08:21:34.130 INFO:teuthology.orchestra.run.smithi155.stdout: "reply": 2594, 2024-09-19T08:21:34.130 INFO:teuthology.orchestra.run.smithi155.stdout: "reply_latency": { 2024-09-19T08:21:34.130 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2594, 2024-09-19T08:21:34.130 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 13.768833093, 2024-09-19T08:21:34.131 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.005307954 2024-09-19T08:21:34.131 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.131 INFO:teuthology.orchestra.run.smithi155.stdout: "slow_reply": 0, 2024-09-19T08:21:34.131 INFO:teuthology.orchestra.run.smithi155.stdout: "forward": 0, 2024-09-19T08:21:34.131 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch_complete": 0, 2024-09-19T08:21:34.131 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch_keys": 0, 2024-09-19T08:21:34.131 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_commit": 12, 2024-09-19T08:21:34.131 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_split": 0, 2024-09-19T08:21:34.131 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_merge": 0, 2024-09-19T08:21:34.131 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes": 33, 2024-09-19T08:21:34.131 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_top": 2, 2024-09-19T08:21:34.131 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_bottom": 31, 2024-09-19T08:21:34.131 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pin_tail": 0, 2024-09-19T08:21:34.131 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pinned": 30, 2024-09-19T08:21:34.132 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_expired": 0, 2024-09-19T08:21:34.132 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_with_caps": 3, 2024-09-19T08:21:34.132 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 4, 2024-09-19T08:21:34.132 INFO:teuthology.orchestra.run.smithi155.stdout: "subtrees": 2, 2024-09-19T08:21:34.132 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse": 2672, 2024-09-19T08:21:34.132 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_hit": 2655, 2024-09-19T08:21:34.132 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_forward": 0, 2024-09-19T08:21:34.132 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_discover": 0, 2024-09-19T08:21:34.133 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_dir_fetch": 0, 2024-09-19T08:21:34.133 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_remote_ino": 0, 2024-09-19T08:21:34.133 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_lock": 0, 2024-09-19T08:21:34.133 INFO:teuthology.orchestra.run.smithi155.stdout: "load_cent": 0, 2024-09-19T08:21:34.133 INFO:teuthology.orchestra.run.smithi155.stdout: "q": 0, 2024-09-19T08:21:34.133 INFO:teuthology.orchestra.run.smithi155.stdout: "exported": 0, 2024-09-19T08:21:34.133 INFO:teuthology.orchestra.run.smithi155.stdout: "exported_inodes": 0, 2024-09-19T08:21:34.133 INFO:teuthology.orchestra.run.smithi155.stdout: "imported": 0, 2024-09-19T08:21:34.133 INFO:teuthology.orchestra.run.smithi155.stdout: "imported_inodes": 0, 2024-09-19T08:21:34.133 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_dir_fetch": 0, 2024-09-19T08:21:34.134 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_backtrace_fetch": 237, 2024-09-19T08:21:34.134 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_peer_discover": 0, 2024-09-19T08:21:34.134 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rfiles": 4, 2024-09-19T08:21:34.134 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rbytes": 234, 2024-09-19T08:21:34.134 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rsnaps": 6, 2024-09-19T08:21:34.134 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_backtrace_fetch": 237, 2024-09-19T08:21:34.134 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_set_tag": 0, 2024-09-19T08:21:34.134 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T08:21:34.134 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_inotable_repaired": 0, 2024-09-19T08:21:34.134 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dir_inodes": 152, 2024-09-19T08:21:34.134 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dir_base_inodes": 21, 2024-09-19T08:21:34.134 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dirfrag_rstats": 131, 2024-09-19T08:21:34.134 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_file_inodes": 85, 2024-09-19T08:21:34.135 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_inode_file_caps": 0, 2024-09-19T08:21:34.135 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_revoke": 37, 2024-09-19T08:21:34.135 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_grant": 3651, 2024-09-19T08:21:34.135 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T08:21:34.135 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T08:21:34.135 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T08:21:34.135 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_caps": 2454, 2024-09-19T08:21:34.135 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_caps_dirty": 1212, 2024-09-19T08:21:34.135 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_cap_release": 13, 2024-09-19T08:21:34.135 INFO:teuthology.orchestra.run.smithi155.stdout: "process_request_cap_release": 1241 2024-09-19T08:21:34.135 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.135 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2024-09-19T08:21:34.135 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_update": 0, 2024-09-19T08:21:34.135 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_update_receipt": 0, 2024-09-19T08:21:34.136 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_try_discover": 0, 2024-09-19T08:21:34.136 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_send_discover": 0, 2024-09-19T08:21:34.136 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_handle_discover": 0, 2024-09-19T08:21:34.136 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 2, 2024-09-19T08:21:34.136 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_delayed": 0, 2024-09-19T08:21:34.136 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_enqueuing": 0, 2024-09-19T08:21:34.136 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 1212, 2024-09-19T08:21:34.136 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 1210, 2024-09-19T08:21:34.136 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 0, 2024-09-19T08:21:34.136 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_migrated": 0, 2024-09-19T08:21:34.136 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_processing": 0, 2024-09-19T08:21:34.136 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_enqueued": 0, 2024-09-19T08:21:34.136 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_prioritized": 0, 2024-09-19T08:21:34.136 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_started": 0, 2024-09-19T08:21:34.137 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_completed": 0, 2024-09-19T08:21:34.137 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_quiesce_path": 3, 2024-09-19T08:21:34.137 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_quiesce_inode": 40, 2024-09-19T08:21:34.137 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_enqueue_scrub": 21, 2024-09-19T08:21:34.137 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_exportdir": 0, 2024-09-19T08:21:34.137 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_flush": 0, 2024-09-19T08:21:34.137 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragmentdir": 0, 2024-09-19T08:21:34.137 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragstats": 0, 2024-09-19T08:21:34.137 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_inodestats": 0 2024-09-19T08:21:34.137 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.137 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_log": { 2024-09-19T08:21:34.137 INFO:teuthology.orchestra.run.smithi155.stdout: "evlrg": 0, 2024-09-19T08:21:34.137 INFO:teuthology.orchestra.run.smithi155.stdout: "evadd": 6172, 2024-09-19T08:21:34.137 INFO:teuthology.orchestra.run.smithi155.stdout: "evex": 0, 2024-09-19T08:21:34.138 INFO:teuthology.orchestra.run.smithi155.stdout: "evtrm": 0, 2024-09-19T08:21:34.138 INFO:teuthology.orchestra.run.smithi155.stdout: "ev": 6172, 2024-09-19T08:21:34.138 INFO:teuthology.orchestra.run.smithi155.stdout: "evexg": 0, 2024-09-19T08:21:34.138 INFO:teuthology.orchestra.run.smithi155.stdout: "evexd": 0, 2024-09-19T08:21:34.138 INFO:teuthology.orchestra.run.smithi155.stdout: "segadd": 9, 2024-09-19T08:21:34.138 INFO:teuthology.orchestra.run.smithi155.stdout: "segex": 0, 2024-09-19T08:21:34.138 INFO:teuthology.orchestra.run.smithi155.stdout: "segtrm": 0, 2024-09-19T08:21:34.138 INFO:teuthology.orchestra.run.smithi155.stdout: "seg": 9, 2024-09-19T08:21:34.138 INFO:teuthology.orchestra.run.smithi155.stdout: "segmjr": 2, 2024-09-19T08:21:34.138 INFO:teuthology.orchestra.run.smithi155.stdout: "segexg": 0, 2024-09-19T08:21:34.138 INFO:teuthology.orchestra.run.smithi155.stdout: "segexd": 0, 2024-09-19T08:21:34.138 INFO:teuthology.orchestra.run.smithi155.stdout: "expos": 4194304, 2024-09-19T08:21:34.138 INFO:teuthology.orchestra.run.smithi155.stdout: "wrpos": 19693463, 2024-09-19T08:21:34.138 INFO:teuthology.orchestra.run.smithi155.stdout: "rdpos": 0, 2024-09-19T08:21:34.138 INFO:teuthology.orchestra.run.smithi155.stdout: "jlat": { 2024-09-19T08:21:34.139 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2495, 2024-09-19T08:21:34.139 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 3.812377057, 2024-09-19T08:21:34.139 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001528006 2024-09-19T08:21:34.139 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.139 INFO:teuthology.orchestra.run.smithi155.stdout: "replayed": 0 2024-09-19T08:21:34.139 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.139 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_mem": { 2024-09-19T08:21:34.139 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 26, 2024-09-19T08:21:34.139 INFO:teuthology.orchestra.run.smithi155.stdout: "ino+": 1257, 2024-09-19T08:21:34.139 INFO:teuthology.orchestra.run.smithi155.stdout: "ino-": 1231, 2024-09-19T08:21:34.139 INFO:teuthology.orchestra.run.smithi155.stdout: "dir": 20, 2024-09-19T08:21:34.139 INFO:teuthology.orchestra.run.smithi155.stdout: "dir+": 24, 2024-09-19T08:21:34.139 INFO:teuthology.orchestra.run.smithi155.stdout: "dir-": 4, 2024-09-19T08:21:34.139 INFO:teuthology.orchestra.run.smithi155.stdout: "dn": 33, 2024-09-19T08:21:34.139 INFO:teuthology.orchestra.run.smithi155.stdout: "dn+": 1248, 2024-09-19T08:21:34.140 INFO:teuthology.orchestra.run.smithi155.stdout: "dn-": 1215, 2024-09-19T08:21:34.140 INFO:teuthology.orchestra.run.smithi155.stdout: "cap": 4, 2024-09-19T08:21:34.140 INFO:teuthology.orchestra.run.smithi155.stdout: "cap+": 1232, 2024-09-19T08:21:34.140 INFO:teuthology.orchestra.run.smithi155.stdout: "cap-": 1228, 2024-09-19T08:21:34.140 INFO:teuthology.orchestra.run.smithi155.stdout: "rss": 58260, 2024-09-19T08:21:34.140 INFO:teuthology.orchestra.run.smithi155.stdout: "heap": 231712 2024-09-19T08:21:34.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.140 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_server": { 2024-09-19T08:21:34.140 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_client_request": 2635, 2024-09-19T08:21:34.140 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_server_request": 0, 2024-09-19T08:21:34.140 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_request": 2594, 2024-09-19T08:21:34.140 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_session": 32, 2024-09-19T08:21:34.140 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_peer_request": 0, 2024-09-19T08:21:34.141 INFO:teuthology.orchestra.run.smithi155.stdout: "req_create_latency": { 2024-09-19T08:21:34.141 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1210, 2024-09-19T08:21:34.141 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 1.044717440, 2024-09-19T08:21:34.141 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000863402 2024-09-19T08:21:34.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.141 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getattr_latency": { 2024-09-19T08:21:34.141 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 103, 2024-09-19T08:21:34.141 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.016532691, 2024-09-19T08:21:34.141 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000160511 2024-09-19T08:21:34.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.141 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getfilelock_latency": { 2024-09-19T08:21:34.141 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:34.142 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:34.142 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:34.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.142 INFO:teuthology.orchestra.run.smithi155.stdout: "req_link_latency": { 2024-09-19T08:21:34.142 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:34.142 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:34.142 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:34.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.142 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookup_latency": { 2024-09-19T08:21:34.142 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 14, 2024-09-19T08:21:34.142 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.003824193, 2024-09-19T08:21:34.142 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000273156 2024-09-19T08:21:34.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.143 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookuphash_latency": { 2024-09-19T08:21:34.143 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:34.143 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:34.143 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:34.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.143 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupino_latency": { 2024-09-19T08:21:34.143 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2, 2024-09-19T08:21:34.143 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000406267, 2024-09-19T08:21:34.143 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000203133 2024-09-19T08:21:34.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.143 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupname_latency": { 2024-09-19T08:21:34.143 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:34.143 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:34.143 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:34.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.143 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupparent_latency": { 2024-09-19T08:21:34.144 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:34.144 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:34.144 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:34.144 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.144 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupsnap_latency": { 2024-09-19T08:21:34.144 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:34.144 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:34.144 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:34.144 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.144 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lssnap_latency": { 2024-09-19T08:21:34.144 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 10, 2024-09-19T08:21:34.145 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.001214457, 2024-09-19T08:21:34.145 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000121445 2024-09-19T08:21:34.145 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.145 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mkdir_latency": { 2024-09-19T08:21:34.145 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 12, 2024-09-19T08:21:34.145 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.013270227, 2024-09-19T08:21:34.145 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001105852 2024-09-19T08:21:34.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.146 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mknod_latency": { 2024-09-19T08:21:34.146 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:34.146 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:34.146 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:34.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.146 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mksnap_latency": { 2024-09-19T08:21:34.146 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 10, 2024-09-19T08:21:34.146 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.042704735, 2024-09-19T08:21:34.146 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.004270473 2024-09-19T08:21:34.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.146 INFO:teuthology.orchestra.run.smithi155.stdout: "req_open_latency": { 2024-09-19T08:21:34.146 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2, 2024-09-19T08:21:34.146 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000537113, 2024-09-19T08:21:34.147 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000268556 2024-09-19T08:21:34.147 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.147 INFO:teuthology.orchestra.run.smithi155.stdout: "req_readdir_latency": { 2024-09-19T08:21:34.147 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 5, 2024-09-19T08:21:34.147 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.008937826, 2024-09-19T08:21:34.147 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001787565 2024-09-19T08:21:34.147 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.147 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rename_latency": { 2024-09-19T08:21:34.294 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2, 2024-09-19T08:21:34.294 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.002610654, 2024-09-19T08:21:34.294 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001305327 2024-09-19T08:21:34.295 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.295 INFO:teuthology.orchestra.run.smithi155.stdout: "req_renamesnap_latency": { 2024-09-19T08:21:34.295 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:34.295 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:34.295 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:34.295 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.295 INFO:teuthology.orchestra.run.smithi155.stdout: "req_snapdiff_latency": { 2024-09-19T08:21:34.295 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:34.295 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:34.295 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:34.295 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.295 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmdir_latency": { 2024-09-19T08:21:34.295 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 6, 2024-09-19T08:21:34.296 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.019867313, 2024-09-19T08:21:34.296 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.003311218 2024-09-19T08:21:34.296 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.296 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmsnap_latency": { 2024-09-19T08:21:34.296 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 4, 2024-09-19T08:21:34.296 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.015651723, 2024-09-19T08:21:34.296 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.003912930 2024-09-19T08:21:34.296 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.296 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmxattr_latency": { 2024-09-19T08:21:34.296 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:34.296 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:34.296 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:34.297 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.297 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setattr_latency": { 2024-09-19T08:21:34.297 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1, 2024-09-19T08:21:34.297 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000771798, 2024-09-19T08:21:34.297 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000771798 2024-09-19T08:21:34.297 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.297 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setdirlayout_latency": { 2024-09-19T08:21:34.297 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:34.297 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:34.297 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:34.297 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.297 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setfilelock_latency": { 2024-09-19T08:21:34.298 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:34.298 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:34.298 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:34.298 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.298 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setlayout_latency": { 2024-09-19T08:21:34.298 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:34.298 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:34.298 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:34.298 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.298 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setxattr_latency": { 2024-09-19T08:21:34.298 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 7, 2024-09-19T08:21:34.298 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.017909002, 2024-09-19T08:21:34.299 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.002558428 2024-09-19T08:21:34.299 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.299 INFO:teuthology.orchestra.run.smithi155.stdout: "req_symlink_latency": { 2024-09-19T08:21:34.299 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:34.299 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:34.299 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:34.299 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.299 INFO:teuthology.orchestra.run.smithi155.stdout: "req_unlink_latency": { 2024-09-19T08:21:34.299 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1206, 2024-09-19T08:21:34.299 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 12.579877654, 2024-09-19T08:21:34.299 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.010431075 2024-09-19T08:21:34.299 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.299 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_revoke_eviction": 0, 2024-09-19T08:21:34.299 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_acquisition_throttle": 0, 2024-09-19T08:21:34.300 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getvxattr_latency": { 2024-09-19T08:21:34.300 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:34.300 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:34.300 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:34.300 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T08:21:34.300 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.300 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_sessions": { 2024-09-19T08:21:34.300 INFO:teuthology.orchestra.run.smithi155.stdout: "session_count": 2, 2024-09-19T08:21:34.300 INFO:teuthology.orchestra.run.smithi155.stdout: "session_add": 5, 2024-09-19T08:21:34.300 INFO:teuthology.orchestra.run.smithi155.stdout: "session_remove": 3, 2024-09-19T08:21:34.300 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_open": 2, 2024-09-19T08:21:34.300 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_stale": 0, 2024-09-19T08:21:34.300 INFO:teuthology.orchestra.run.smithi155.stdout: "total_load": 39, 2024-09-19T08:21:34.300 INFO:teuthology.orchestra.run.smithi155.stdout: "average_load": 19, 2024-09-19T08:21:34.301 INFO:teuthology.orchestra.run.smithi155.stdout: "avg_session_uptime": 600, 2024-09-19T08:21:34.301 INFO:teuthology.orchestra.run.smithi155.stdout: "mdthresh_evicted": 0 2024-09-19T08:21:34.301 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.301 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2024-09-19T08:21:34.301 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:21:34.301 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 0, 2024-09-19T08:21:34.301 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:21:34.301 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:21:34.301 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:21:34.301 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:21:34.301 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:21:34.301 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:21:34.301 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:21:34.301 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:21:34.302 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:21:34.302 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:21:34.302 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:21:34.302 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:21:34.302 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:21:34.302 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_items": 0, 2024-09-19T08:21:34.302 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:21:34.302 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_items": 0, 2024-09-19T08:21:34.302 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:21:34.302 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:21:34.302 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:21:34.302 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:21:34.302 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:21:34.302 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:21:34.303 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:21:34.303 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2024-09-19T08:21:34.303 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:21:34.303 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:21:34.303 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:21:34.303 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2024-09-19T08:21:34.303 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2024-09-19T08:21:34.303 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2024-09-19T08:21:34.303 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:21:34.303 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:21:34.303 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:21:34.303 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:21:34.303 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 310870, 2024-09-19T08:21:34.303 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 102, 2024-09-19T08:21:34.304 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:21:34.304 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2024-09-19T08:21:34.304 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2024-09-19T08:21:34.304 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2024-09-19T08:21:34.304 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:21:34.304 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2024-09-19T08:21:34.304 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:21:34.304 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2024-09-19T08:21:34.304 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 8032, 2024-09-19T08:21:34.304 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 177, 2024-09-19T08:21:34.304 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:21:34.304 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:21:34.304 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2024-09-19T08:21:34.304 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2024-09-19T08:21:34.304 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 129714, 2024-09-19T08:21:34.305 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 1004, 2024-09-19T08:21:34.305 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2024-09-19T08:21:34.305 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2024-09-19T08:21:34.305 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2024-09-19T08:21:34.305 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2024-09-19T08:21:34.305 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.305 INFO:teuthology.orchestra.run.smithi155.stdout: "objecter": { 2024-09-19T08:21:34.305 INFO:teuthology.orchestra.run.smithi155.stdout: "op_active": 0, 2024-09-19T08:21:34.305 INFO:teuthology.orchestra.run.smithi155.stdout: "op_laggy": 0, 2024-09-19T08:21:34.305 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send": 6943, 2024-09-19T08:21:34.305 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send_bytes": 15742078, 2024-09-19T08:21:34.305 INFO:teuthology.orchestra.run.smithi155.stdout: "op_resend": 37, 2024-09-19T08:21:34.305 INFO:teuthology.orchestra.run.smithi155.stdout: "op_reply": 6943, 2024-09-19T08:21:34.305 INFO:teuthology.orchestra.run.smithi155.stdout: "op_latency": { 2024-09-19T08:21:34.306 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 6943, 2024-09-19T08:21:34.306 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 35.956263902, 2024-09-19T08:21:34.306 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.005178779 2024-09-19T08:21:34.306 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.306 INFO:teuthology.orchestra.run.smithi155.stdout: "op_inflight": 0, 2024-09-19T08:21:34.306 INFO:teuthology.orchestra.run.smithi155.stdout: "oplen_avg": { 2024-09-19T08:21:34.306 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 6943, 2024-09-19T08:21:34.306 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 7017 2024-09-19T08:21:34.306 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.306 INFO:teuthology.orchestra.run.smithi155.stdout: "op": 6943, 2024-09-19T08:21:34.306 INFO:teuthology.orchestra.run.smithi155.stdout: "op_r": 306, 2024-09-19T08:21:34.306 INFO:teuthology.orchestra.run.smithi155.stdout: "op_w": 6637, 2024-09-19T08:21:34.306 INFO:teuthology.orchestra.run.smithi155.stdout: "op_rmw": 0, 2024-09-19T08:21:34.306 INFO:teuthology.orchestra.run.smithi155.stdout: "op_pg": 0, 2024-09-19T08:21:34.306 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_stat": 0, 2024-09-19T08:21:34.307 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_create": 11, 2024-09-19T08:21:34.307 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_read": 48, 2024-09-19T08:21:34.307 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_write": 2522, 2024-09-19T08:21:34.307 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writefull": 40, 2024-09-19T08:21:34.307 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writesame": 0, 2024-09-19T08:21:34.307 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_append": 0, 2024-09-19T08:21:34.307 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_zero": 0, 2024-09-19T08:21:34.307 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_truncate": 0, 2024-09-19T08:21:34.307 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_delete": 4011, 2024-09-19T08:21:34.307 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_mapext": 0, 2024-09-19T08:21:34.307 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_sparse_read": 0, 2024-09-19T08:21:34.307 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_clonerange": 0, 2024-09-19T08:21:34.307 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_getxattr": 258, 2024-09-19T08:21:34.308 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_setxattr": 22, 2024-09-19T08:21:34.308 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_cmpxattr": 0, 2024-09-19T08:21:34.308 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_rmxattr": 0, 2024-09-19T08:21:34.308 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_resetxattrs": 0, 2024-09-19T08:21:34.308 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_call": 0, 2024-09-19T08:21:34.308 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_watch": 0, 2024-09-19T08:21:34.308 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_notify": 0, 2024-09-19T08:21:34.308 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T08:21:34.308 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls": 0, 2024-09-19T08:21:34.308 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls_filter": 0, 2024-09-19T08:21:34.308 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_other": 0, 2024-09-19T08:21:34.308 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_active": 0, 2024-09-19T08:21:34.309 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_send": 0, 2024-09-19T08:21:34.309 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_resend": 0, 2024-09-19T08:21:34.309 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_ping": 0, 2024-09-19T08:21:34.309 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_active": 0, 2024-09-19T08:21:34.309 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_send": 0, 2024-09-19T08:21:34.309 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_resend": 0, 2024-09-19T08:21:34.309 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_active": 0, 2024-09-19T08:21:34.309 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_send": 0, 2024-09-19T08:21:34.309 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_resend": 0, 2024-09-19T08:21:34.309 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_active": 0, 2024-09-19T08:21:34.309 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_send": 0, 2024-09-19T08:21:34.309 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_resend": 0, 2024-09-19T08:21:34.309 INFO:teuthology.orchestra.run.smithi155.stdout: "command_active": 0, 2024-09-19T08:21:34.309 INFO:teuthology.orchestra.run.smithi155.stdout: "command_send": 0, 2024-09-19T08:21:34.310 INFO:teuthology.orchestra.run.smithi155.stdout: "command_resend": 0, 2024-09-19T08:21:34.310 INFO:teuthology.orchestra.run.smithi155.stdout: "map_epoch": 92, 2024-09-19T08:21:34.310 INFO:teuthology.orchestra.run.smithi155.stdout: "map_full": 0, 2024-09-19T08:21:34.310 INFO:teuthology.orchestra.run.smithi155.stdout: "map_inc": 11, 2024-09-19T08:21:34.310 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_sessions": 12, 2024-09-19T08:21:34.310 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_open": 12, 2024-09-19T08:21:34.310 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_close": 0, 2024-09-19T08:21:34.310 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_laggy": 0, 2024-09-19T08:21:34.310 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_wr": 86, 2024-09-19T08:21:34.310 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_rd": 0, 2024-09-19T08:21:34.310 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_del": 19 2024-09-19T08:21:34.310 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.310 INFO:teuthology.orchestra.run.smithi155.stdout: "oft": { 2024-09-19T08:21:34.311 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_objs": 1, 2024-09-19T08:21:34.311 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_kv_pairs": 0, 2024-09-19T08:21:34.311 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_updates": 0, 2024-09-19T08:21:34.311 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_removes": 0 2024-09-19T08:21:34.311 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.311 INFO:teuthology.orchestra.run.smithi155.stdout: "osd-slow-ops": { 2024-09-19T08:21:34.311 INFO:teuthology.orchestra.run.smithi155.stdout: "slow_ops_count": 44 2024-09-19T08:21:34.311 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.311 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2024-09-19T08:21:34.311 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops": 0, 2024-09-19T08:21:34.311 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops_high_water": 34, 2024-09-19T08:21:34.311 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing": 0, 2024-09-19T08:21:34.311 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_high_water": 16, 2024-09-19T08:21:34.311 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed_ops": 3496, 2024-09-19T08:21:34.312 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 1210, 2024-09-19T08:21:34.312 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_item_in_journal": 0 2024-09-19T08:21:34.312 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.312 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:21:34.312 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T08:21:34.312 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2024-09-19T08:21:34.312 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T08:21:34.312 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 13988, 2024-09-19T08:21:34.312 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 4602013, 2024-09-19T08:21:34.312 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T08:21:34.312 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 13988, 2024-09-19T08:21:34.312 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2024-09-19T08:21:34.312 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2024-09-19T08:21:34.313 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 13988, 2024-09-19T08:21:34.313 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 4602013, 2024-09-19T08:21:34.313 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T08:21:34.313 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:34.313 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:34.313 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:34.313 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T08:21:34.313 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.313 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_bytes": { 2024-09-19T08:21:34.313 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T08:21:34.313 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2024-09-19T08:21:34.313 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T08:21:34.313 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2024-09-19T08:21:34.313 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2024-09-19T08:21:34.314 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T08:21:34.314 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2024-09-19T08:21:34.314 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 6943, 2024-09-19T08:21:34.314 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 15864296, 2024-09-19T08:21:34.314 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 6943, 2024-09-19T08:21:34.314 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 15864296, 2024-09-19T08:21:34.314 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T08:21:34.314 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:34.314 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:34.314 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:34.314 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T08:21:34.314 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.314 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_ops": { 2024-09-19T08:21:34.315 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T08:21:34.315 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 1024, 2024-09-19T08:21:34.315 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T08:21:34.315 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2024-09-19T08:21:34.315 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2024-09-19T08:21:34.315 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T08:21:34.315 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2024-09-19T08:21:34.315 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 6943, 2024-09-19T08:21:34.315 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 6943, 2024-09-19T08:21:34.315 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 6943, 2024-09-19T08:21:34.315 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 6943, 2024-09-19T08:21:34.315 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T08:21:34.315 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:34.316 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:34.316 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:34.316 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T08:21:34.316 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.316 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle": { 2024-09-19T08:21:34.316 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T08:21:34.316 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2024-09-19T08:21:34.316 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T08:21:34.316 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 1210, 2024-09-19T08:21:34.316 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 122218, 2024-09-19T08:21:34.316 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T08:21:34.316 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 1210, 2024-09-19T08:21:34.316 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2024-09-19T08:21:34.317 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2024-09-19T08:21:34.317 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 27, 2024-09-19T08:21:34.317 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 122218, 2024-09-19T08:21:34.317 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T08:21:34.317 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:34.317 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:34.317 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:34.317 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T08:21:34.317 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:34.317 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle-0x5613ee946960": { 2024-09-19T08:21:34.317 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T08:21:34.317 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2024-09-19T08:21:34.317 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T08:21:34.318 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 6172, 2024-09-19T08:21:34.318 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 15499159, 2024-09-19T08:21:34.318 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T08:21:34.318 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 6172, 2024-09-19T08:21:34.318 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2024-09-19T08:21:34.318 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2024-09-19T08:21:34.318 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 2495, 2024-09-19T08:21:34.318 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 15499159, 2024-09-19T08:21:34.318 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T08:21:34.318 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:34.318 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:34.318 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:34.318 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T08:21:34.318 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T08:21:34.319 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-09-19T08:21:34.982 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:34 smithi155 ceph-mon[35362]: pgmap v327: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:21:34.983 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-19T08:21:34.984 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-09-19T08:21:34.984 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-09-19T08:21:34.984 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T08:21:34.984 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T08:21:35.239 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:21:35.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:34 smithi027 ceph-mon[31209]: pgmap v327: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:21:35.257 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:34 smithi203 ceph-mon[35198]: pgmap v327: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:21:35.753 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-09-19T08:21:35.753 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:21:35.753 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 224, 2024-09-19T08:21:35.753 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 211, 2024-09-19T08:21:35.753 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 1588976, 2024-09-19T08:21:35.753 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 128992, 2024-09-19T08:21:35.753 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 4, 2024-09-19T08:21:35.753 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 0, 2024-09-19T08:21:35.753 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.044594589, 2024-09-19T08:21:35.754 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.014990382, 2024-09-19T08:21:35.754 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.043045720, 2024-09-19T08:21:35.754 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:35.754 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:35.754 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 211, 2024-09-19T08:21:35.754 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.018480600, 2024-09-19T08:21:35.754 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000087585 2024-09-19T08:21:35.754 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:35.754 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:35.754 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:35.754 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:35.754 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:35.754 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:35.755 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 1588976, 2024-09-19T08:21:35.755 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 128992 2024-09-19T08:21:35.755 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:35.755 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:21:35.755 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 2, 2024-09-19T08:21:35.755 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 160, 2024-09-19T08:21:35.755 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 320, 2024-09-19T08:21:35.755 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 185296, 2024-09-19T08:21:35.755 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 5, 2024-09-19T08:21:35.755 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 3, 2024-09-19T08:21:35.755 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.012052489, 2024-09-19T08:21:35.756 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.008299595, 2024-09-19T08:21:35.756 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.001376561, 2024-09-19T08:21:35.756 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:35.756 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:35.756 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 157, 2024-09-19T08:21:35.756 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.013732446, 2024-09-19T08:21:35.756 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000087467 2024-09-19T08:21:35.756 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:35.756 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:35.756 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:35.756 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:35.756 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:35.756 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:35.757 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T08:21:35.757 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 185296 2024-09-19T08:21:35.757 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:35.757 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:21:35.757 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 0, 2024-09-19T08:21:35.757 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 2, 2024-09-19T08:21:35.757 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:21:35.757 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 0, 2024-09-19T08:21:35.757 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 2, 2024-09-19T08:21:35.757 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 1, 2024-09-19T08:21:35.757 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.000221915, 2024-09-19T08:21:35.757 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:21:35.758 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.000154046, 2024-09-19T08:21:35.758 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:35.758 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:35.758 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:35.758 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:35.758 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:35.758 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:35.758 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:35.758 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:35.758 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:35.758 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:35.758 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:35.758 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:21:35.758 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:21:35.759 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:35.759 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2024-09-19T08:21:35.759 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 0, 2024-09-19T08:21:35.759 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2024-09-19T08:21:35.759 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:35.759 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2024-09-19T08:21:35.759 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:21:35.759 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 0, 2024-09-19T08:21:35.759 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:21:35.759 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:21:35.759 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:21:35.759 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:21:35.759 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:21:35.760 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:21:35.760 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:21:35.760 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:21:35.760 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:21:35.760 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:21:35.760 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:21:35.760 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:21:35.760 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:21:35.760 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_items": 0, 2024-09-19T08:21:35.760 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:21:35.760 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_items": 0, 2024-09-19T08:21:35.760 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:21:35.761 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:21:35.761 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:21:35.761 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:21:35.761 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:21:35.761 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:21:35.761 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:21:35.761 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2024-09-19T08:21:35.761 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:21:35.761 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:21:35.761 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:21:35.761 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2024-09-19T08:21:35.761 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2024-09-19T08:21:35.761 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2024-09-19T08:21:35.761 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:21:35.762 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:21:35.762 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:21:35.762 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:21:35.762 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 148955, 2024-09-19T08:21:35.762 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 30, 2024-09-19T08:21:35.762 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:21:35.762 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2024-09-19T08:21:35.762 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2024-09-19T08:21:35.762 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2024-09-19T08:21:35.762 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:21:35.762 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2024-09-19T08:21:35.762 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:21:35.762 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2024-09-19T08:21:35.762 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 0, 2024-09-19T08:21:35.763 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 0, 2024-09-19T08:21:35.763 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:21:35.763 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:21:35.763 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2024-09-19T08:21:35.763 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2024-09-19T08:21:35.763 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 928, 2024-09-19T08:21:35.763 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 2, 2024-09-19T08:21:35.763 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2024-09-19T08:21:35.763 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2024-09-19T08:21:35.763 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2024-09-19T08:21:35.763 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2024-09-19T08:21:35.763 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:35.763 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:21:35.763 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T08:21:35.764 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2024-09-19T08:21:35.764 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T08:21:35.764 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 222, 2024-09-19T08:21:35.764 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 1554938, 2024-09-19T08:21:35.764 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T08:21:35.764 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 222, 2024-09-19T08:21:35.764 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2024-09-19T08:21:35.764 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2024-09-19T08:21:35.764 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 222, 2024-09-19T08:21:35.764 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 1554938, 2024-09-19T08:21:35.764 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T08:21:35.764 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:35.764 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:35.764 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:35.765 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T08:21:35.765 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T08:21:35.765 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-09-19T08:21:36.559 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2024-09-19T08:21:36.559 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2024-09-19T08:21:36.559 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2024-09-19T08:21:36.559 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T08:21:36.559 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T08:21:36.808 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:21:37.226 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:36 smithi155 ceph-mon[35362]: pgmap v328: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:37.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:36 smithi027 ceph-mon[31209]: pgmap v328: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:37.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:36 smithi203 ceph-mon[35198]: pgmap v328: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:37.327 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-09-19T08:21:37.327 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:21:37.328 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 222, 2024-09-19T08:21:37.328 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 209, 2024-09-19T08:21:37.328 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 1588432, 2024-09-19T08:21:37.328 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 127712, 2024-09-19T08:21:37.328 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 4, 2024-09-19T08:21:37.328 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 0, 2024-09-19T08:21:37.328 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.045236552, 2024-09-19T08:21:37.328 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.014989978, 2024-09-19T08:21:37.328 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.043882619, 2024-09-19T08:21:37.328 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:37.328 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:37.329 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 209, 2024-09-19T08:21:37.329 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.017589898, 2024-09-19T08:21:37.329 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000084162 2024-09-19T08:21:37.329 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:37.329 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:37.329 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:37.329 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:37.329 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:37.329 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:37.329 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 1588432, 2024-09-19T08:21:37.329 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 127712 2024-09-19T08:21:37.329 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:37.330 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:21:37.330 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 2, 2024-09-19T08:21:37.330 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 158, 2024-09-19T08:21:37.330 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 320, 2024-09-19T08:21:37.330 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 184944, 2024-09-19T08:21:37.330 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 5, 2024-09-19T08:21:37.330 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 3, 2024-09-19T08:21:37.330 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.011909047, 2024-09-19T08:21:37.330 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.007985240, 2024-09-19T08:21:37.330 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.001711388, 2024-09-19T08:21:37.330 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:37.331 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:37.331 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 155, 2024-09-19T08:21:37.331 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.018644769, 2024-09-19T08:21:37.331 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000120288 2024-09-19T08:21:37.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:37.331 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:37.331 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:37.331 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:37.331 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:37.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:37.332 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T08:21:37.332 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 184944 2024-09-19T08:21:37.332 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:37.332 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:21:37.332 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 0, 2024-09-19T08:21:37.332 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 2, 2024-09-19T08:21:37.332 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:21:37.332 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 0, 2024-09-19T08:21:37.332 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 2, 2024-09-19T08:21:37.332 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 1, 2024-09-19T08:21:37.332 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.000268654, 2024-09-19T08:21:37.333 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:21:37.333 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.000203986, 2024-09-19T08:21:37.333 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:37.333 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:37.333 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:37.333 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:37.333 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:37.333 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:37.333 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:37.333 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:37.333 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:37.334 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:37.334 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:37.334 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:21:37.334 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:21:37.334 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:37.334 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2024-09-19T08:21:37.334 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 0, 2024-09-19T08:21:37.334 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2024-09-19T08:21:37.334 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:37.334 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2024-09-19T08:21:37.334 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:21:37.334 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 0, 2024-09-19T08:21:37.335 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:21:37.335 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:21:37.335 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:21:37.335 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:21:37.335 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:21:37.335 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:21:37.335 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:21:37.335 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:21:37.335 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:21:37.335 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:21:37.335 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:21:37.335 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:21:37.336 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:21:37.336 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_items": 0, 2024-09-19T08:21:37.336 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:21:37.336 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_items": 0, 2024-09-19T08:21:37.336 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:21:37.336 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:21:37.336 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:21:37.336 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:21:37.336 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:21:37.336 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:21:37.337 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:21:37.337 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2024-09-19T08:21:37.337 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:21:37.338 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:21:37.338 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:21:37.338 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2024-09-19T08:21:37.338 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2024-09-19T08:21:37.338 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2024-09-19T08:21:37.338 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:21:37.338 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:21:37.338 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:21:37.338 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:21:37.338 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 148977, 2024-09-19T08:21:37.338 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 30, 2024-09-19T08:21:37.338 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:21:37.338 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2024-09-19T08:21:37.338 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2024-09-19T08:21:37.339 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2024-09-19T08:21:37.339 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:21:37.339 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2024-09-19T08:21:37.339 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:21:37.339 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2024-09-19T08:21:37.339 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 0, 2024-09-19T08:21:37.339 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 0, 2024-09-19T08:21:37.339 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:21:37.339 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:21:37.339 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2024-09-19T08:21:37.339 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2024-09-19T08:21:37.339 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 928, 2024-09-19T08:21:37.340 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 2, 2024-09-19T08:21:37.340 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2024-09-19T08:21:37.340 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2024-09-19T08:21:37.340 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2024-09-19T08:21:37.340 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2024-09-19T08:21:37.340 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:37.340 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:21:37.340 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T08:21:37.340 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2024-09-19T08:21:37.340 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T08:21:37.340 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 220, 2024-09-19T08:21:37.340 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 1554678, 2024-09-19T08:21:37.340 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T08:21:37.341 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 220, 2024-09-19T08:21:37.341 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2024-09-19T08:21:37.341 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2024-09-19T08:21:37.341 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 220, 2024-09-19T08:21:37.341 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 1554678, 2024-09-19T08:21:37.341 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T08:21:37.341 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:37.341 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:37.341 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:37.341 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T08:21:37.341 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T08:21:37.341 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-09-19T08:21:38.042 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.h 2024-09-19T08:21:38.042 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.h 2024-09-19T08:21:38.042 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.h 2024-09-19T08:21:38.042 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T08:21:38.043 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T08:21:38.287 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:21:38.802 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-09-19T08:21:38.802 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:21:38.802 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 227, 2024-09-19T08:21:38.802 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 214, 2024-09-19T08:21:38.802 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 1589792, 2024-09-19T08:21:38.802 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 130912, 2024-09-19T08:21:38.802 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 4, 2024-09-19T08:21:38.802 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 0, 2024-09-19T08:21:38.803 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.047037679, 2024-09-19T08:21:38.803 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.015980994, 2024-09-19T08:21:38.803 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.044982913, 2024-09-19T08:21:38.803 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:38.803 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:38.803 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 214, 2024-09-19T08:21:38.803 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.017462271, 2024-09-19T08:21:38.803 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000081599 2024-09-19T08:21:38.803 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:38.803 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:38.803 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:38.803 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:38.804 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:38.804 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:38.804 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 1589792, 2024-09-19T08:21:38.804 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 130912 2024-09-19T08:21:38.804 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:38.804 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:21:38.804 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 2, 2024-09-19T08:21:38.804 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 163, 2024-09-19T08:21:38.804 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 320, 2024-09-19T08:21:38.804 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 185824, 2024-09-19T08:21:38.804 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 5, 2024-09-19T08:21:38.805 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 3, 2024-09-19T08:21:38.805 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.011838641, 2024-09-19T08:21:38.805 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.008045538, 2024-09-19T08:21:38.805 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.001561558, 2024-09-19T08:21:38.805 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:38.805 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:38.805 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 160, 2024-09-19T08:21:38.805 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.020255063, 2024-09-19T08:21:38.805 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000126594 2024-09-19T08:21:38.805 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:38.805 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:38.806 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:38.806 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:38.806 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:38.806 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:38.806 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T08:21:38.806 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 185824 2024-09-19T08:21:38.806 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:38.806 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:21:38.806 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 0, 2024-09-19T08:21:38.806 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 2, 2024-09-19T08:21:38.806 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:21:38.806 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 0, 2024-09-19T08:21:38.807 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 2, 2024-09-19T08:21:38.807 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 1, 2024-09-19T08:21:38.807 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.000299607, 2024-09-19T08:21:38.807 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:21:38.807 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.000222296, 2024-09-19T08:21:38.807 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:38.807 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:38.807 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:38.807 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:38.807 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:38.807 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:38.807 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:38.808 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:38.808 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:38.808 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:38.808 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:38.808 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:21:38.808 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:21:38.808 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:38.808 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2024-09-19T08:21:38.808 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 0, 2024-09-19T08:21:38.808 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2024-09-19T08:21:38.809 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:38.809 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2024-09-19T08:21:38.809 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:21:38.809 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 0, 2024-09-19T08:21:38.809 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:21:38.809 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:21:38.809 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:21:38.809 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:21:38.809 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:21:38.809 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:21:38.809 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:21:38.809 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:21:38.810 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:21:38.810 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:21:38.810 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:21:38.810 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:21:38.810 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:21:38.810 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_items": 0, 2024-09-19T08:21:38.810 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:21:38.810 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_items": 0, 2024-09-19T08:21:38.810 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:21:38.810 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:21:38.810 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:21:38.810 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:21:38.811 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:21:38.811 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:21:38.811 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:21:38.811 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2024-09-19T08:21:38.811 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:21:38.811 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:21:38.811 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:21:38.811 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2024-09-19T08:21:38.811 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2024-09-19T08:21:38.811 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2024-09-19T08:21:38.811 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:21:38.811 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:21:38.811 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:21:38.812 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:21:38.812 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 149017, 2024-09-19T08:21:38.812 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 31, 2024-09-19T08:21:38.812 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:21:38.812 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2024-09-19T08:21:38.812 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2024-09-19T08:21:38.812 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2024-09-19T08:21:38.812 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:21:38.812 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2024-09-19T08:21:38.812 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:21:38.812 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2024-09-19T08:21:38.812 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 0, 2024-09-19T08:21:38.813 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 0, 2024-09-19T08:21:38.813 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:21:38.813 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:21:38.813 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2024-09-19T08:21:38.813 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2024-09-19T08:21:38.813 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 928, 2024-09-19T08:21:38.813 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 2, 2024-09-19T08:21:38.813 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2024-09-19T08:21:38.813 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2024-09-19T08:21:38.813 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2024-09-19T08:21:38.813 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2024-09-19T08:21:38.813 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T08:21:38.814 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:21:38.814 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T08:21:38.814 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2024-09-19T08:21:38.814 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T08:21:38.814 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 225, 2024-09-19T08:21:38.814 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 1555328, 2024-09-19T08:21:38.814 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T08:21:38.814 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 225, 2024-09-19T08:21:38.814 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2024-09-19T08:21:38.814 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2024-09-19T08:21:38.814 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 225, 2024-09-19T08:21:38.814 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 1555328, 2024-09-19T08:21:38.815 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T08:21:38.815 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T08:21:38.815 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T08:21:38.815 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T08:21:38.815 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T08:21:38.815 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T08:21:38.815 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-09-19T08:21:38.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:38 smithi155 ceph-mon[35362]: pgmap v329: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:21:39.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:38 smithi027 ceph-mon[31209]: pgmap v329: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:21:39.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:38 smithi203 ceph-mon[35198]: pgmap v329: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:21:39.492 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-19T08:21:39.492 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-19T08:21:39.493 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-19T08:21:39.493 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T08:21:39.493 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T08:21:39.755 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:21:40.280 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-19T08:21:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:21:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 4, 2024-09-19T08:21:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 4, 2024-09-19T08:21:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 2992, 2024-09-19T08:21:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 448, 2024-09-19T08:21:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 4, 2024-09-19T08:21:40.280 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 0, 2024-09-19T08:21:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.003157129, 2024-09-19T08:21:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.000036936, 2024-09-19T08:21:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.002316170, 2024-09-19T08:21:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 3, 2024-09-19T08:21:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.004112875, 2024-09-19T08:21:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.001370958 2024-09-19T08:21:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:40.281 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T08:21:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T08:21:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:21:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 2, 2024-09-19T08:21:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 160, 2024-09-19T08:21:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 320, 2024-09-19T08:21:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 185296, 2024-09-19T08:21:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 5, 2024-09-19T08:21:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 3, 2024-09-19T08:21:40.282 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.010300450, 2024-09-19T08:21:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.006787118, 2024-09-19T08:21:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.001474567, 2024-09-19T08:21:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 157, 2024-09-19T08:21:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.019181971, 2024-09-19T08:21:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000122178 2024-09-19T08:21:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:40.283 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T08:21:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 185296 2024-09-19T08:21:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:21:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 219, 2024-09-19T08:21:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 208, 2024-09-19T08:21:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 1585712, 2024-09-19T08:21:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 127904, 2024-09-19T08:21:40.284 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 2, 2024-09-19T08:21:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 1, 2024-09-19T08:21:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.041769075, 2024-09-19T08:21:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.015131066, 2024-09-19T08:21:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.039865423, 2024-09-19T08:21:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 207, 2024-09-19T08:21:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.013781987, 2024-09-19T08:21:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000066579 2024-09-19T08:21:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:40.285 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 1585712, 2024-09-19T08:21:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 127904 2024-09-19T08:21:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: "cct": { 2024-09-19T08:21:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: "total_workers": 0, 2024-09-19T08:21:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: "unhealthy_workers": 0 2024-09-19T08:21:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: "mempool": { 2024-09-19T08:21:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:21:40.286 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_items": 0, 2024-09-19T08:21:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:21:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:21:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:21:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:21:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:21:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:21:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:21:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:21:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:21:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:21:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:21:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:21:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:21:40.287 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_items": 0, 2024-09-19T08:21:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:21:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_items": 0, 2024-09-19T08:21:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:21:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:21:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:21:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:21:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:21:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:21:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:21:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_items": 0, 2024-09-19T08:21:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:21:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:21:40.288 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:21:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_items": 0, 2024-09-19T08:21:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_bytes": 0, 2024-09-19T08:21:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_items": 0, 2024-09-19T08:21:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:21:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:21:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:21:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:21:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_bytes": 148994, 2024-09-19T08:21:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_items": 31, 2024-09-19T08:21:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:21:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_items": 0, 2024-09-19T08:21:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_bytes": 0, 2024-09-19T08:21:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_items": 0, 2024-09-19T08:21:40.289 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:21:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_items": 0, 2024-09-19T08:21:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:21:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_items": 0, 2024-09-19T08:21:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_bytes": 0, 2024-09-19T08:21:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_items": 0, 2024-09-19T08:21:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:21:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:21:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_bytes": 0, 2024-09-19T08:21:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_items": 0, 2024-09-19T08:21:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_bytes": 928, 2024-09-19T08:21:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_items": 2, 2024-09-19T08:21:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_bytes": 0, 2024-09-19T08:21:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_items": 0, 2024-09-19T08:21:40.290 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_bytes": 0, 2024-09-19T08:21:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_items": 0 2024-09-19T08:21:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:21:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T08:21:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-09-19T08:21:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T08:21:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 221, 2024-09-19T08:21:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 1554808, 2024-09-19T08:21:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T08:21:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 221, 2024-09-19T08:21:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T08:21:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T08:21:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 221, 2024-09-19T08:21:40.291 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 1554808, 2024-09-19T08:21:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T08:21:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T08:21:40.292 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T08:21:40.292 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-19T08:21:41.098 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.c 2024-09-19T08:21:41.098 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.c 2024-09-19T08:21:41.098 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.c 2024-09-19T08:21:41.098 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T08:21:41.098 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T08:21:41.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:40 smithi155 ceph-mon[35362]: pgmap v330: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:41.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:40 smithi027 ceph-mon[31209]: pgmap v330: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:41.257 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:40 smithi203 ceph-mon[35198]: pgmap v330: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:41.359 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:21:41.911 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-19T08:21:41.911 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:21:41.911 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 224, 2024-09-19T08:21:41.911 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 211, 2024-09-19T08:21:41.911 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 1588976, 2024-09-19T08:21:41.912 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 128992, 2024-09-19T08:21:41.912 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 4, 2024-09-19T08:21:41.912 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 0, 2024-09-19T08:21:41.912 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.045062252, 2024-09-19T08:21:41.912 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.015110998, 2024-09-19T08:21:41.912 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.043594261, 2024-09-19T08:21:41.912 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:41.912 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:41.912 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 211, 2024-09-19T08:21:41.912 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.018575916, 2024-09-19T08:21:41.912 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000088037 2024-09-19T08:21:41.912 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:41.913 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:41.913 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:41.913 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:41.913 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:41.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:41.913 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 1588976, 2024-09-19T08:21:41.913 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 128992 2024-09-19T08:21:41.913 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:41.913 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:21:41.913 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 2, 2024-09-19T08:21:41.913 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 160, 2024-09-19T08:21:41.913 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 320, 2024-09-19T08:21:41.914 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 185296, 2024-09-19T08:21:41.914 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 5, 2024-09-19T08:21:41.914 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 3, 2024-09-19T08:21:41.914 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.012199219, 2024-09-19T08:21:41.914 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.008220301, 2024-09-19T08:21:41.914 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.001611530, 2024-09-19T08:21:41.914 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:41.914 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:41.914 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 157, 2024-09-19T08:21:41.914 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.015756612, 2024-09-19T08:21:41.914 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000100360 2024-09-19T08:21:41.914 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:41.915 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:41.915 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:41.915 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:41.915 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:41.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:41.915 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T08:21:41.915 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 185296 2024-09-19T08:21:41.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:41.915 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:21:41.915 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 0, 2024-09-19T08:21:41.915 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 2, 2024-09-19T08:21:41.915 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:21:41.916 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 0, 2024-09-19T08:21:41.916 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 2, 2024-09-19T08:21:41.916 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 1, 2024-09-19T08:21:41.916 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.000372465, 2024-09-19T08:21:41.916 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:21:41.916 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.000313288, 2024-09-19T08:21:41.916 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:41.916 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:41.916 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:41.916 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:41.916 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:41.916 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:41.917 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:41.917 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:41.917 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:41.917 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:41.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:41.917 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:21:41.917 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:21:41.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:41.917 INFO:teuthology.orchestra.run.smithi203.stdout: "cct": { 2024-09-19T08:21:41.917 INFO:teuthology.orchestra.run.smithi203.stdout: "total_workers": 0, 2024-09-19T08:21:41.917 INFO:teuthology.orchestra.run.smithi203.stdout: "unhealthy_workers": 0 2024-09-19T08:21:41.917 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:41.917 INFO:teuthology.orchestra.run.smithi203.stdout: "mempool": { 2024-09-19T08:21:41.917 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:21:41.917 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_items": 0, 2024-09-19T08:21:41.918 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:21:41.918 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:21:41.918 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:21:41.918 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:21:41.918 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:21:41.918 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:21:41.918 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:21:41.918 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:21:41.918 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:21:41.918 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:21:41.918 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:21:41.918 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:21:41.918 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:21:41.919 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_items": 0, 2024-09-19T08:21:41.919 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:21:41.919 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_items": 0, 2024-09-19T08:21:41.919 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:21:41.919 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:21:41.919 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:21:41.919 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:21:41.919 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:21:41.919 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:21:41.919 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:21:41.919 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_items": 0, 2024-09-19T08:21:41.919 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:21:41.919 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:21:41.920 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:21:41.920 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_items": 0, 2024-09-19T08:21:41.920 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_bytes": 0, 2024-09-19T08:21:41.920 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_items": 0, 2024-09-19T08:21:41.920 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:21:41.920 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:21:41.920 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:21:41.920 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:21:41.920 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_bytes": 148994, 2024-09-19T08:21:41.920 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_items": 31, 2024-09-19T08:21:41.920 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:21:41.920 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_items": 0, 2024-09-19T08:21:41.920 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_bytes": 0, 2024-09-19T08:21:41.921 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_items": 0, 2024-09-19T08:21:41.921 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:21:41.921 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_items": 0, 2024-09-19T08:21:41.921 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:21:41.921 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_items": 0, 2024-09-19T08:21:41.921 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_bytes": 0, 2024-09-19T08:21:41.921 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_items": 0, 2024-09-19T08:21:41.921 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:21:41.921 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:21:41.921 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_bytes": 0, 2024-09-19T08:21:41.921 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_items": 0, 2024-09-19T08:21:41.921 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_bytes": 928, 2024-09-19T08:21:41.922 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_items": 2, 2024-09-19T08:21:41.922 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_bytes": 0, 2024-09-19T08:21:41.922 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_items": 0, 2024-09-19T08:21:41.922 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_bytes": 0, 2024-09-19T08:21:41.922 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_items": 0 2024-09-19T08:21:41.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:41.922 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:21:41.922 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T08:21:41.922 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-09-19T08:21:41.922 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T08:21:41.922 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 222, 2024-09-19T08:21:41.922 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 1554938, 2024-09-19T08:21:41.922 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T08:21:41.922 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 222, 2024-09-19T08:21:41.923 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T08:21:41.923 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T08:21:41.923 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 222, 2024-09-19T08:21:41.923 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 1554938, 2024-09-19T08:21:41.923 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T08:21:41.923 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:41.923 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:41.923 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:41.923 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T08:21:41.923 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T08:21:41.923 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-19T08:21:42.573 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-09-19T08:21:42.573 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-09-19T08:21:42.573 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-09-19T08:21:42.573 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T08:21:42.574 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T08:21:42.824 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:21:43.151 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:42 smithi203 ceph-mon[35198]: pgmap v331: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:43.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:42 smithi155 ceph-mon[35362]: pgmap v331: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:43.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:42 smithi027 ceph-mon[31209]: pgmap v331: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:43.368 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-19T08:21:43.368 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:21:43.368 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 1520, 2024-09-19T08:21:43.368 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 1522, 2024-09-19T08:21:43.368 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 4639651, 2024-09-19T08:21:43.368 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 483370, 2024-09-19T08:21:43.368 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 6, 2024-09-19T08:21:43.369 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 2, 2024-09-19T08:21:43.369 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.167458569, 2024-09-19T08:21:43.369 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.047540459, 2024-09-19T08:21:43.369 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.045814909, 2024-09-19T08:21:43.369 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.059242244, 2024-09-19T08:21:43.369 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:43.369 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 1520, 2024-09-19T08:21:43.369 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.065099314, 2024-09-19T08:21:43.369 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000042828 2024-09-19T08:21:43.369 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.369 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:43.369 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.369 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.370 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.370 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.370 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:21:43.370 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:21:43.370 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.370 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:21:43.370 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 784, 2024-09-19T08:21:43.370 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 770, 2024-09-19T08:21:43.370 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 8861297, 2024-09-19T08:21:43.370 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 304020, 2024-09-19T08:21:43.370 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 4, 2024-09-19T08:21:43.370 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 3, 2024-09-19T08:21:43.370 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.099758450, 2024-09-19T08:21:43.370 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.032857690, 2024-09-19T08:21:43.371 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.057630472, 2024-09-19T08:21:43.371 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.016786494, 2024-09-19T08:21:43.371 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:43.371 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 770, 2024-09-19T08:21:43.371 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.040606133, 2024-09-19T08:21:43.371 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000052735 2024-09-19T08:21:43.371 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.371 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:43.371 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.371 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.371 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.371 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.372 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 1608448, 2024-09-19T08:21:43.372 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 131280 2024-09-19T08:21:43.372 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.372 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:21:43.372 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 245, 2024-09-19T08:21:43.372 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 403, 2024-09-19T08:21:43.372 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 4254617, 2024-09-19T08:21:43.372 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 521915, 2024-09-19T08:21:43.372 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 6, 2024-09-19T08:21:43.372 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 4, 2024-09-19T08:21:43.372 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.034062512, 2024-09-19T08:21:43.372 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.014730421, 2024-09-19T08:21:43.372 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.007879967, 2024-09-19T08:21:43.373 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.007519291, 2024-09-19T08:21:43.373 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:43.373 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 400, 2024-09-19T08:21:43.373 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.027187041, 2024-09-19T08:21:43.373 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000067967 2024-09-19T08:21:43.373 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.373 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:43.373 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.373 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.373 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.373 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.373 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T08:21:43.373 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 444640 2024-09-19T08:21:43.374 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.374 INFO:teuthology.orchestra.run.smithi203.stdout: "cct": { 2024-09-19T08:21:43.374 INFO:teuthology.orchestra.run.smithi203.stdout: "total_workers": 1, 2024-09-19T08:21:43.374 INFO:teuthology.orchestra.run.smithi203.stdout: "unhealthy_workers": 0 2024-09-19T08:21:43.374 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.374 INFO:teuthology.orchestra.run.smithi203.stdout: "finisher-MDSRank": { 2024-09-19T08:21:43.374 INFO:teuthology.orchestra.run.smithi203.stdout: "queue_len": 0, 2024-09-19T08:21:43.374 INFO:teuthology.orchestra.run.smithi203.stdout: "complete_latency": { 2024-09-19T08:21:43.374 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 3803, 2024-09-19T08:21:43.374 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.114535540, 2024-09-19T08:21:43.374 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000030117 2024-09-19T08:21:43.374 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T08:21:43.374 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.374 INFO:teuthology.orchestra.run.smithi203.stdout: "finisher-PurgeQueue": { 2024-09-19T08:21:43.375 INFO:teuthology.orchestra.run.smithi203.stdout: "queue_len": 0, 2024-09-19T08:21:43.375 INFO:teuthology.orchestra.run.smithi203.stdout: "complete_latency": { 2024-09-19T08:21:43.375 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.375 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.375 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.375 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T08:21:43.375 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.375 INFO:teuthology.orchestra.run.smithi203.stdout: "mds": { 2024-09-19T08:21:43.375 INFO:teuthology.orchestra.run.smithi203.stdout: "request": 0, 2024-09-19T08:21:43.375 INFO:teuthology.orchestra.run.smithi203.stdout: "reply": 0, 2024-09-19T08:21:43.375 INFO:teuthology.orchestra.run.smithi203.stdout: "reply_latency": { 2024-09-19T08:21:43.375 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.375 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.375 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.375 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.376 INFO:teuthology.orchestra.run.smithi203.stdout: "slow_reply": 0, 2024-09-19T08:21:43.376 INFO:teuthology.orchestra.run.smithi203.stdout: "forward": 0, 2024-09-19T08:21:43.376 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_fetch_complete": 0, 2024-09-19T08:21:43.376 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_fetch_keys": 0, 2024-09-19T08:21:43.376 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_commit": 0, 2024-09-19T08:21:43.376 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_split": 0, 2024-09-19T08:21:43.376 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_merge": 0, 2024-09-19T08:21:43.376 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes": 1238, 2024-09-19T08:21:43.376 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_top": 0, 2024-09-19T08:21:43.376 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_bottom": 1238, 2024-09-19T08:21:43.376 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_pin_tail": 0, 2024-09-19T08:21:43.376 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_pinned": 1238, 2024-09-19T08:21:43.376 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_expired": 0, 2024-09-19T08:21:43.377 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_with_caps": 0, 2024-09-19T08:21:43.377 INFO:teuthology.orchestra.run.smithi203.stdout: "caps": 0, 2024-09-19T08:21:43.377 INFO:teuthology.orchestra.run.smithi203.stdout: "subtrees": 2, 2024-09-19T08:21:43.377 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse": 0, 2024-09-19T08:21:43.377 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_hit": 0, 2024-09-19T08:21:43.377 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_forward": 0, 2024-09-19T08:21:43.377 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_discover": 0, 2024-09-19T08:21:43.377 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_dir_fetch": 0, 2024-09-19T08:21:43.377 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_remote_ino": 0, 2024-09-19T08:21:43.377 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_lock": 0, 2024-09-19T08:21:43.377 INFO:teuthology.orchestra.run.smithi203.stdout: "load_cent": 0, 2024-09-19T08:21:43.377 INFO:teuthology.orchestra.run.smithi203.stdout: "q": 0, 2024-09-19T08:21:43.378 INFO:teuthology.orchestra.run.smithi203.stdout: "exported": 0, 2024-09-19T08:21:43.378 INFO:teuthology.orchestra.run.smithi203.stdout: "exported_inodes": 0, 2024-09-19T08:21:43.378 INFO:teuthology.orchestra.run.smithi203.stdout: "imported": 0, 2024-09-19T08:21:43.378 INFO:teuthology.orchestra.run.smithi203.stdout: "imported_inodes": 0, 2024-09-19T08:21:43.378 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_dir_fetch": 0, 2024-09-19T08:21:43.378 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_backtrace_fetch": 0, 2024-09-19T08:21:43.378 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_peer_discover": 0, 2024-09-19T08:21:43.378 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rfiles": 4, 2024-09-19T08:21:43.378 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rbytes": 234, 2024-09-19T08:21:43.378 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rsnaps": 6, 2024-09-19T08:21:43.378 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T08:21:43.378 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_set_tag": 0, 2024-09-19T08:21:43.378 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T08:21:43.378 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_inotable_repaired": 0, 2024-09-19T08:21:43.379 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dir_inodes": 0, 2024-09-19T08:21:43.379 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T08:21:43.379 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T08:21:43.379 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_file_inodes": 0, 2024-09-19T08:21:43.379 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_inode_file_caps": 0, 2024-09-19T08:21:43.379 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T08:21:43.379 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_grant": 0, 2024-09-19T08:21:43.379 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T08:21:43.379 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T08:21:43.379 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T08:21:43.379 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_caps": 0, 2024-09-19T08:21:43.379 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_caps_dirty": 0, 2024-09-19T08:21:43.379 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_cap_release": 0, 2024-09-19T08:21:43.379 INFO:teuthology.orchestra.run.smithi203.stdout: "process_request_cap_release": 0 2024-09-19T08:21:43.379 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.380 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_cache": { 2024-09-19T08:21:43.380 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_update": 0, 2024-09-19T08:21:43.380 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_update_receipt": 0, 2024-09-19T08:21:43.380 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_try_discover": 0, 2024-09-19T08:21:43.380 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_send_discover": 0, 2024-09-19T08:21:43.380 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_handle_discover": 0, 2024-09-19T08:21:43.380 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays": 0, 2024-09-19T08:21:43.380 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays_delayed": 0, 2024-09-19T08:21:43.380 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays_enqueuing": 0, 2024-09-19T08:21:43.380 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_created": 0, 2024-09-19T08:21:43.380 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_enqueued": 0, 2024-09-19T08:21:43.380 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_reintegrated": 0, 2024-09-19T08:21:43.380 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_migrated": 0, 2024-09-19T08:21:43.381 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_processing": 0, 2024-09-19T08:21:43.381 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_enqueued": 0, 2024-09-19T08:21:43.381 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_prioritized": 0, 2024-09-19T08:21:43.381 INFO:teuthology.orchestra.run.smithi203.stdout: "recovery_started": 0, 2024-09-19T08:21:43.381 INFO:teuthology.orchestra.run.smithi203.stdout: "recovery_completed": 0, 2024-09-19T08:21:43.381 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_quiesce_path": 0, 2024-09-19T08:21:43.381 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_quiesce_inode": 0, 2024-09-19T08:21:43.381 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T08:21:43.381 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_exportdir": 0, 2024-09-19T08:21:43.381 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_flush": 0, 2024-09-19T08:21:43.381 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_fragmentdir": 0, 2024-09-19T08:21:43.381 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_fragstats": 0, 2024-09-19T08:21:43.381 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_inodestats": 0 2024-09-19T08:21:43.382 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.382 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_log": { 2024-09-19T08:21:43.382 INFO:teuthology.orchestra.run.smithi203.stdout: "evlrg": 0, 2024-09-19T08:21:43.382 INFO:teuthology.orchestra.run.smithi203.stdout: "evadd": 0, 2024-09-19T08:21:43.382 INFO:teuthology.orchestra.run.smithi203.stdout: "evex": 0, 2024-09-19T08:21:43.382 INFO:teuthology.orchestra.run.smithi203.stdout: "evtrm": 0, 2024-09-19T08:21:43.382 INFO:teuthology.orchestra.run.smithi203.stdout: "ev": 6172, 2024-09-19T08:21:43.382 INFO:teuthology.orchestra.run.smithi203.stdout: "evexg": 0, 2024-09-19T08:21:43.382 INFO:teuthology.orchestra.run.smithi203.stdout: "evexd": 0, 2024-09-19T08:21:43.382 INFO:teuthology.orchestra.run.smithi203.stdout: "segadd": 0, 2024-09-19T08:21:43.382 INFO:teuthology.orchestra.run.smithi203.stdout: "segex": 0, 2024-09-19T08:21:43.382 INFO:teuthology.orchestra.run.smithi203.stdout: "segtrm": 0, 2024-09-19T08:21:43.382 INFO:teuthology.orchestra.run.smithi203.stdout: "seg": 9, 2024-09-19T08:21:43.383 INFO:teuthology.orchestra.run.smithi203.stdout: "segmjr": 2, 2024-09-19T08:21:43.383 INFO:teuthology.orchestra.run.smithi203.stdout: "segexg": 0, 2024-09-19T08:21:43.383 INFO:teuthology.orchestra.run.smithi203.stdout: "segexd": 0, 2024-09-19T08:21:43.383 INFO:teuthology.orchestra.run.smithi203.stdout: "expos": 4194304, 2024-09-19T08:21:43.383 INFO:teuthology.orchestra.run.smithi203.stdout: "wrpos": 19693463, 2024-09-19T08:21:43.383 INFO:teuthology.orchestra.run.smithi203.stdout: "rdpos": 19693351, 2024-09-19T08:21:43.383 INFO:teuthology.orchestra.run.smithi203.stdout: "jlat": { 2024-09-19T08:21:43.383 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.383 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.383 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.383 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.383 INFO:teuthology.orchestra.run.smithi203.stdout: "replayed": 6172 2024-09-19T08:21:43.383 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.383 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_mem": { 2024-09-19T08:21:43.384 INFO:teuthology.orchestra.run.smithi203.stdout: "ino": 24, 2024-09-19T08:21:43.384 INFO:teuthology.orchestra.run.smithi203.stdout: "ino+": 1234, 2024-09-19T08:21:43.384 INFO:teuthology.orchestra.run.smithi203.stdout: "ino-": 1210, 2024-09-19T08:21:43.384 INFO:teuthology.orchestra.run.smithi203.stdout: "dir": 18, 2024-09-19T08:21:43.384 INFO:teuthology.orchestra.run.smithi203.stdout: "dir+": 22, 2024-09-19T08:21:43.384 INFO:teuthology.orchestra.run.smithi203.stdout: "dir-": 4, 2024-09-19T08:21:43.384 INFO:teuthology.orchestra.run.smithi203.stdout: "dn": 1238, 2024-09-19T08:21:43.384 INFO:teuthology.orchestra.run.smithi203.stdout: "dn+": 1243, 2024-09-19T08:21:43.384 INFO:teuthology.orchestra.run.smithi203.stdout: "dn-": 5, 2024-09-19T08:21:43.384 INFO:teuthology.orchestra.run.smithi203.stdout: "cap": 0, 2024-09-19T08:21:43.384 INFO:teuthology.orchestra.run.smithi203.stdout: "cap+": 0, 2024-09-19T08:21:43.384 INFO:teuthology.orchestra.run.smithi203.stdout: "cap-": 0, 2024-09-19T08:21:43.384 INFO:teuthology.orchestra.run.smithi203.stdout: "rss": 50712, 2024-09-19T08:21:43.385 INFO:teuthology.orchestra.run.smithi203.stdout: "heap": 215328 2024-09-19T08:21:43.385 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.385 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_server": { 2024-09-19T08:21:43.385 INFO:teuthology.orchestra.run.smithi203.stdout: "dispatch_client_request": 0, 2024-09-19T08:21:43.385 INFO:teuthology.orchestra.run.smithi203.stdout: "dispatch_server_request": 0, 2024-09-19T08:21:43.385 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_request": 0, 2024-09-19T08:21:43.385 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_session": 0, 2024-09-19T08:21:43.385 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_peer_request": 0, 2024-09-19T08:21:43.385 INFO:teuthology.orchestra.run.smithi203.stdout: "req_create_latency": { 2024-09-19T08:21:43.385 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.385 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.385 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.385 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.386 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getattr_latency": { 2024-09-19T08:21:43.386 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.386 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.386 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.386 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.386 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getfilelock_latency": { 2024-09-19T08:21:43.386 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.386 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.386 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.386 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.386 INFO:teuthology.orchestra.run.smithi203.stdout: "req_link_latency": { 2024-09-19T08:21:43.386 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.386 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.387 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.387 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.387 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookup_latency": { 2024-09-19T08:21:43.387 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.387 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.387 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.387 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.387 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookuphash_latency": { 2024-09-19T08:21:43.387 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.387 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.387 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.387 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.387 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupino_latency": { 2024-09-19T08:21:43.387 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.388 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.388 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.388 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.388 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupname_latency": { 2024-09-19T08:21:43.388 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.388 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.388 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.388 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.388 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupparent_latency": { 2024-09-19T08:21:43.388 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.388 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.388 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.388 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.389 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupsnap_latency": { 2024-09-19T08:21:43.389 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.389 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.389 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.389 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.389 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lssnap_latency": { 2024-09-19T08:21:43.389 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.389 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.389 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.389 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.389 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mkdir_latency": { 2024-09-19T08:21:43.390 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.390 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.390 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.390 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.390 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mknod_latency": { 2024-09-19T08:21:43.390 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.390 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.390 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.390 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.391 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mksnap_latency": { 2024-09-19T08:21:43.391 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.391 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.391 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.391 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.391 INFO:teuthology.orchestra.run.smithi203.stdout: "req_open_latency": { 2024-09-19T08:21:43.391 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.391 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.391 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.391 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.391 INFO:teuthology.orchestra.run.smithi203.stdout: "req_readdir_latency": { 2024-09-19T08:21:43.391 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.391 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.391 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.392 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.392 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rename_latency": { 2024-09-19T08:21:43.392 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.392 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.392 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.392 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.392 INFO:teuthology.orchestra.run.smithi203.stdout: "req_renamesnap_latency": { 2024-09-19T08:21:43.392 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.392 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.392 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.392 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.392 INFO:teuthology.orchestra.run.smithi203.stdout: "req_snapdiff_latency": { 2024-09-19T08:21:43.392 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.393 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.393 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.393 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.393 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmdir_latency": { 2024-09-19T08:21:43.393 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.393 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.393 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.393 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.393 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmsnap_latency": { 2024-09-19T08:21:43.393 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.393 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.393 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.393 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.393 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmxattr_latency": { 2024-09-19T08:21:43.394 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.394 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.394 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.394 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.394 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setattr_latency": { 2024-09-19T08:21:43.394 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.394 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.394 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.394 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.394 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setdirlayout_latency": { 2024-09-19T08:21:43.394 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.394 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.394 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.395 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.395 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setfilelock_latency": { 2024-09-19T08:21:43.395 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.395 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.395 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.395 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.395 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setlayout_latency": { 2024-09-19T08:21:43.395 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.395 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.395 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.395 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.395 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setxattr_latency": { 2024-09-19T08:21:43.395 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.396 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.396 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.396 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.396 INFO:teuthology.orchestra.run.smithi203.stdout: "req_symlink_latency": { 2024-09-19T08:21:43.396 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.396 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.396 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.396 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.396 INFO:teuthology.orchestra.run.smithi203.stdout: "req_unlink_latency": { 2024-09-19T08:21:43.396 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.396 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.396 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.396 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.397 INFO:teuthology.orchestra.run.smithi203.stdout: "cap_revoke_eviction": 0, 2024-09-19T08:21:43.397 INFO:teuthology.orchestra.run.smithi203.stdout: "cap_acquisition_throttle": 0, 2024-09-19T08:21:43.397 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getvxattr_latency": { 2024-09-19T08:21:43.397 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.397 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.397 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.397 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T08:21:43.397 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.397 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_sessions": { 2024-09-19T08:21:43.397 INFO:teuthology.orchestra.run.smithi203.stdout: "session_count": 2, 2024-09-19T08:21:43.397 INFO:teuthology.orchestra.run.smithi203.stdout: "session_add": 5, 2024-09-19T08:21:43.397 INFO:teuthology.orchestra.run.smithi203.stdout: "session_remove": 3, 2024-09-19T08:21:43.397 INFO:teuthology.orchestra.run.smithi203.stdout: "sessions_open": 4, 2024-09-19T08:21:43.398 INFO:teuthology.orchestra.run.smithi203.stdout: "sessions_stale": 0, 2024-09-19T08:21:43.398 INFO:teuthology.orchestra.run.smithi203.stdout: "total_load": 0, 2024-09-19T08:21:43.398 INFO:teuthology.orchestra.run.smithi203.stdout: "average_load": 0, 2024-09-19T08:21:43.398 INFO:teuthology.orchestra.run.smithi203.stdout: "avg_session_uptime": 3377, 2024-09-19T08:21:43.398 INFO:teuthology.orchestra.run.smithi203.stdout: "mdthresh_evicted": 0 2024-09-19T08:21:43.398 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.398 INFO:teuthology.orchestra.run.smithi203.stdout: "mempool": { 2024-09-19T08:21:43.398 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:21:43.398 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_items": 0, 2024-09-19T08:21:43.398 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:21:43.398 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:21:43.398 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:21:43.399 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:21:43.399 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:21:43.399 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:21:43.399 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:21:43.399 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:21:43.399 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:21:43.399 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:21:43.399 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:21:43.399 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:21:43.399 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:21:43.399 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_items": 0, 2024-09-19T08:21:43.399 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:21:43.399 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_items": 0, 2024-09-19T08:21:43.399 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:21:43.400 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:21:43.400 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:21:43.400 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:21:43.400 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:21:43.400 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:21:43.400 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:21:43.400 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_items": 0, 2024-09-19T08:21:43.400 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:21:43.400 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:21:43.400 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:21:43.400 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_items": 0, 2024-09-19T08:21:43.400 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_bytes": 0, 2024-09-19T08:21:43.400 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_items": 0, 2024-09-19T08:21:43.401 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:21:43.401 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:21:43.401 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:21:43.401 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:21:43.401 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_bytes": 189593, 2024-09-19T08:21:43.401 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_items": 57, 2024-09-19T08:21:43.401 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:21:43.401 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_items": 0, 2024-09-19T08:21:43.401 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_bytes": 0, 2024-09-19T08:21:43.401 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_items": 0, 2024-09-19T08:21:43.401 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:21:43.401 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_items": 0, 2024-09-19T08:21:43.401 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:21:43.401 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_items": 0, 2024-09-19T08:21:43.401 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_bytes": 8032, 2024-09-19T08:21:43.402 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_items": 177, 2024-09-19T08:21:43.402 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:21:43.402 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:21:43.402 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_bytes": 0, 2024-09-19T08:21:43.402 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_items": 0, 2024-09-19T08:21:43.402 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_bytes": 966874, 2024-09-19T08:21:43.402 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_items": 5517, 2024-09-19T08:21:43.402 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_bytes": 0, 2024-09-19T08:21:43.402 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_items": 0, 2024-09-19T08:21:43.402 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_bytes": 0, 2024-09-19T08:21:43.402 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_items": 0 2024-09-19T08:21:43.402 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.402 INFO:teuthology.orchestra.run.smithi203.stdout: "objecter": { 2024-09-19T08:21:43.403 INFO:teuthology.orchestra.run.smithi203.stdout: "op_active": 0, 2024-09-19T08:21:43.403 INFO:teuthology.orchestra.run.smithi203.stdout: "op_laggy": 0, 2024-09-19T08:21:43.403 INFO:teuthology.orchestra.run.smithi203.stdout: "op_send": 2306, 2024-09-19T08:21:43.403 INFO:teuthology.orchestra.run.smithi203.stdout: "op_send_bytes": 26, 2024-09-19T08:21:43.403 INFO:teuthology.orchestra.run.smithi203.stdout: "op_resend": 4, 2024-09-19T08:21:43.403 INFO:teuthology.orchestra.run.smithi203.stdout: "op_reply": 2306, 2024-09-19T08:21:43.403 INFO:teuthology.orchestra.run.smithi203.stdout: "op_latency": { 2024-09-19T08:21:43.403 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 2306, 2024-09-19T08:21:43.403 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 1.296965895, 2024-09-19T08:21:43.403 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000562431 2024-09-19T08:21:43.403 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.403 INFO:teuthology.orchestra.run.smithi203.stdout: "op_inflight": 0, 2024-09-19T08:21:43.403 INFO:teuthology.orchestra.run.smithi203.stdout: "oplen_avg": { 2024-09-19T08:21:43.403 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 2306, 2024-09-19T08:21:43.404 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 2307 2024-09-19T08:21:43.404 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.404 INFO:teuthology.orchestra.run.smithi203.stdout: "op": 2306, 2024-09-19T08:21:43.404 INFO:teuthology.orchestra.run.smithi203.stdout: "op_r": 2306, 2024-09-19T08:21:43.404 INFO:teuthology.orchestra.run.smithi203.stdout: "op_w": 0, 2024-09-19T08:21:43.404 INFO:teuthology.orchestra.run.smithi203.stdout: "op_rmw": 0, 2024-09-19T08:21:43.404 INFO:teuthology.orchestra.run.smithi203.stdout: "op_pg": 0, 2024-09-19T08:21:43.404 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_stat": 1483, 2024-09-19T08:21:43.404 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_create": 0, 2024-09-19T08:21:43.404 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_read": 820, 2024-09-19T08:21:43.404 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_write": 0, 2024-09-19T08:21:43.404 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_writefull": 0, 2024-09-19T08:21:43.404 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_writesame": 0, 2024-09-19T08:21:43.404 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_append": 0, 2024-09-19T08:21:43.405 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_zero": 0, 2024-09-19T08:21:43.405 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_truncate": 0, 2024-09-19T08:21:43.405 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_delete": 0, 2024-09-19T08:21:43.405 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_mapext": 0, 2024-09-19T08:21:43.405 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_sparse_read": 0, 2024-09-19T08:21:43.405 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_clonerange": 0, 2024-09-19T08:21:43.405 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_getxattr": 2, 2024-09-19T08:21:43.405 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_setxattr": 0, 2024-09-19T08:21:43.405 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_cmpxattr": 0, 2024-09-19T08:21:43.405 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_rmxattr": 0, 2024-09-19T08:21:43.405 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_resetxattrs": 0, 2024-09-19T08:21:43.405 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_call": 0, 2024-09-19T08:21:43.406 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_watch": 0, 2024-09-19T08:21:43.406 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_notify": 0, 2024-09-19T08:21:43.406 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T08:21:43.406 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_pgls": 0, 2024-09-19T08:21:43.406 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_pgls_filter": 0, 2024-09-19T08:21:43.406 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_other": 0, 2024-09-19T08:21:43.406 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_active": 0, 2024-09-19T08:21:43.406 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_send": 0, 2024-09-19T08:21:43.406 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_resend": 0, 2024-09-19T08:21:43.406 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_ping": 0, 2024-09-19T08:21:43.406 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_active": 0, 2024-09-19T08:21:43.406 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_send": 0, 2024-09-19T08:21:43.406 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_resend": 0, 2024-09-19T08:21:43.406 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_active": 0, 2024-09-19T08:21:43.406 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_send": 0, 2024-09-19T08:21:43.407 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_resend": 0, 2024-09-19T08:21:43.407 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_active": 0, 2024-09-19T08:21:43.407 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_send": 0, 2024-09-19T08:21:43.407 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_resend": 0, 2024-09-19T08:21:43.407 INFO:teuthology.orchestra.run.smithi203.stdout: "command_active": 0, 2024-09-19T08:21:43.407 INFO:teuthology.orchestra.run.smithi203.stdout: "command_send": 0, 2024-09-19T08:21:43.407 INFO:teuthology.orchestra.run.smithi203.stdout: "command_resend": 0, 2024-09-19T08:21:43.407 INFO:teuthology.orchestra.run.smithi203.stdout: "map_epoch": 92, 2024-09-19T08:21:43.407 INFO:teuthology.orchestra.run.smithi203.stdout: "map_full": 0, 2024-09-19T08:21:43.407 INFO:teuthology.orchestra.run.smithi203.stdout: "map_inc": 11, 2024-09-19T08:21:43.407 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_sessions": 5, 2024-09-19T08:21:43.407 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_session_open": 5, 2024-09-19T08:21:43.407 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_session_close": 0, 2024-09-19T08:21:43.407 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_laggy": 0, 2024-09-19T08:21:43.408 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_wr": 0, 2024-09-19T08:21:43.408 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_rd": 2, 2024-09-19T08:21:43.408 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_del": 0 2024-09-19T08:21:43.408 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.408 INFO:teuthology.orchestra.run.smithi203.stdout: "oft": { 2024-09-19T08:21:43.408 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_objs": 0, 2024-09-19T08:21:43.408 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_kv_pairs": 0, 2024-09-19T08:21:43.408 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_updates": 0, 2024-09-19T08:21:43.408 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_removes": 0 2024-09-19T08:21:43.408 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.408 INFO:teuthology.orchestra.run.smithi203.stdout: "osd-slow-ops": { 2024-09-19T08:21:43.408 INFO:teuthology.orchestra.run.smithi203.stdout: "slow_ops_count": 0 2024-09-19T08:21:43.408 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.408 INFO:teuthology.orchestra.run.smithi203.stdout: "purge_queue": { 2024-09-19T08:21:43.409 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_ops": 0, 2024-09-19T08:21:43.409 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T08:21:43.409 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing": 0, 2024-09-19T08:21:43.409 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_high_water": 0, 2024-09-19T08:21:43.409 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executed_ops": 0, 2024-09-19T08:21:43.409 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executed": 0, 2024-09-19T08:21:43.409 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_item_in_journal": 0 2024-09-19T08:21:43.409 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.409 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:21:43.409 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T08:21:43.409 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-09-19T08:21:43.409 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T08:21:43.409 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 2545, 2024-09-19T08:21:43.409 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 17511375, 2024-09-19T08:21:43.409 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T08:21:43.410 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 2545, 2024-09-19T08:21:43.410 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T08:21:43.410 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T08:21:43.410 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 2545, 2024-09-19T08:21:43.410 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 17511375, 2024-09-19T08:21:43.410 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T08:21:43.410 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.410 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.410 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.410 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T08:21:43.410 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.410 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-objecter_bytes": { 2024-09-19T08:21:43.411 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T08:21:43.411 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-09-19T08:21:43.411 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T08:21:43.411 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-09-19T08:21:43.411 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-09-19T08:21:43.411 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T08:21:43.411 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-09-19T08:21:43.411 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 2306, 2024-09-19T08:21:43.411 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 15499169, 2024-09-19T08:21:43.411 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 2306, 2024-09-19T08:21:43.411 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 15499169, 2024-09-19T08:21:43.411 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T08:21:43.411 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.411 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.411 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.412 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T08:21:43.412 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.412 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-objecter_ops": { 2024-09-19T08:21:43.412 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T08:21:43.412 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 1024, 2024-09-19T08:21:43.412 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T08:21:43.412 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-09-19T08:21:43.412 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-09-19T08:21:43.412 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T08:21:43.412 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-09-19T08:21:43.412 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 2306, 2024-09-19T08:21:43.412 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 2306, 2024-09-19T08:21:43.413 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 2306, 2024-09-19T08:21:43.413 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 2306, 2024-09-19T08:21:43.413 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T08:21:43.413 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.413 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.413 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.413 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T08:21:43.413 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.413 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-write_buf_throttle": { 2024-09-19T08:21:43.413 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T08:21:43.413 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 3758096384, 2024-09-19T08:21:43.413 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T08:21:43.413 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-09-19T08:21:43.413 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-09-19T08:21:43.414 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T08:21:43.414 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-09-19T08:21:43.414 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T08:21:43.414 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T08:21:43.414 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 0, 2024-09-19T08:21:43.414 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 0, 2024-09-19T08:21:43.414 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T08:21:43.414 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.414 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.414 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.414 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T08:21:43.414 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:43.414 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-write_buf_throttle-0x55fd31b00b40": { 2024-09-19T08:21:43.415 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T08:21:43.415 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 3758096384, 2024-09-19T08:21:43.415 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T08:21:43.415 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-09-19T08:21:43.415 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-09-19T08:21:43.415 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T08:21:43.415 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-09-19T08:21:43.415 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T08:21:43.415 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T08:21:43.415 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 0, 2024-09-19T08:21:43.415 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 0, 2024-09-19T08:21:43.415 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T08:21:43.415 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:43.416 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:43.416 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:43.416 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T08:21:43.416 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T08:21:43.416 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-19T08:21:44.143 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-19T08:21:44.143 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-19T08:21:44.143 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T08:21:44.143 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T08:21:44.144 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T08:21:44.390 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:21:44.918 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-19T08:21:44.919 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:21:44.919 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 0, 2024-09-19T08:21:44.919 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 2, 2024-09-19T08:21:44.919 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:21:44.919 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 0, 2024-09-19T08:21:44.919 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 4, 2024-09-19T08:21:44.919 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 0, 2024-09-19T08:21:44.919 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.000990981, 2024-09-19T08:21:44.919 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:21:44.919 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.000194357, 2024-09-19T08:21:44.919 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:44.919 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:44.920 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:44.920 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:44.920 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:44.920 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:44.920 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:44.920 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:44.921 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:44.921 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:44.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:44.921 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:21:44.921 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:21:44.921 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:44.921 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:21:44.921 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 225, 2024-09-19T08:21:44.921 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 214, 2024-09-19T08:21:44.921 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 1587344, 2024-09-19T08:21:44.921 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 131744, 2024-09-19T08:21:44.921 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 2, 2024-09-19T08:21:44.922 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 1, 2024-09-19T08:21:44.922 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.042482843, 2024-09-19T08:21:44.922 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.015009781, 2024-09-19T08:21:44.922 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.042365806, 2024-09-19T08:21:44.922 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:44.922 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:44.922 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 213, 2024-09-19T08:21:44.922 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.013684291, 2024-09-19T08:21:44.922 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000064245 2024-09-19T08:21:44.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:44.922 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:44.922 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:44.922 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:44.923 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:44.923 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:44.923 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 1587344, 2024-09-19T08:21:44.923 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 131744 2024-09-19T08:21:44.923 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:44.923 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:21:44.923 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 6, 2024-09-19T08:21:44.923 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 166, 2024-09-19T08:21:44.923 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 3312, 2024-09-19T08:21:44.923 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 186448, 2024-09-19T08:21:44.924 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 5, 2024-09-19T08:21:44.924 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 3, 2024-09-19T08:21:44.924 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.013860575, 2024-09-19T08:21:44.924 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.008288882, 2024-09-19T08:21:44.924 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.003548329, 2024-09-19T08:21:44.924 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:21:44.924 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:21:44.924 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 164, 2024-09-19T08:21:44.924 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.022917909, 2024-09-19T08:21:44.924 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000139743 2024-09-19T08:21:44.924 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:44.924 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:21:44.924 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:44.925 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:44.925 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:44.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:44.925 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-19T08:21:44.925 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 186448 2024-09-19T08:21:44.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:44.925 INFO:teuthology.orchestra.run.smithi203.stdout: "cct": { 2024-09-19T08:21:44.925 INFO:teuthology.orchestra.run.smithi203.stdout: "total_workers": 0, 2024-09-19T08:21:44.925 INFO:teuthology.orchestra.run.smithi203.stdout: "unhealthy_workers": 0 2024-09-19T08:21:44.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:44.926 INFO:teuthology.orchestra.run.smithi203.stdout: "mempool": { 2024-09-19T08:21:44.926 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:21:44.926 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_items": 0, 2024-09-19T08:21:44.926 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:21:44.926 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:21:44.926 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:21:44.926 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:21:44.926 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:21:44.926 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:21:44.926 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:21:44.926 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:21:44.926 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:21:44.926 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:21:44.926 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:21:44.927 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:21:44.927 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:21:44.927 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_items": 0, 2024-09-19T08:21:44.927 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:21:44.927 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_items": 0, 2024-09-19T08:21:44.927 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:21:44.927 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:21:44.927 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:21:44.927 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:21:44.927 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:21:44.927 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:21:44.927 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:21:44.927 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_items": 0, 2024-09-19T08:21:44.927 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:21:44.928 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:21:44.928 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:21:44.928 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_items": 0, 2024-09-19T08:21:44.928 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_bytes": 0, 2024-09-19T08:21:44.928 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_items": 0, 2024-09-19T08:21:44.928 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:21:44.928 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:21:44.928 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:21:44.928 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:21:44.928 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_bytes": 149034, 2024-09-19T08:21:44.928 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_items": 32, 2024-09-19T08:21:44.928 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:21:44.928 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_items": 0, 2024-09-19T08:21:44.928 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_bytes": 0, 2024-09-19T08:21:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_items": 0, 2024-09-19T08:21:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:21:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_items": 0, 2024-09-19T08:21:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:21:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_items": 0, 2024-09-19T08:21:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_bytes": 0, 2024-09-19T08:21:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_items": 0, 2024-09-19T08:21:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:21:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:21:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_bytes": 0, 2024-09-19T08:21:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_items": 0, 2024-09-19T08:21:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_bytes": 928, 2024-09-19T08:21:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_items": 2, 2024-09-19T08:21:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_bytes": 0, 2024-09-19T08:21:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_items": 0, 2024-09-19T08:21:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_bytes": 0, 2024-09-19T08:21:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_items": 0 2024-09-19T08:21:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T08:21:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:21:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T08:21:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-09-19T08:21:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T08:21:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 227, 2024-09-19T08:21:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 1555588, 2024-09-19T08:21:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T08:21:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 227, 2024-09-19T08:21:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T08:21:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T08:21:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 227, 2024-09-19T08:21:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 1555588, 2024-09-19T08:21:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T08:21:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T08:21:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T08:21:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T08:21:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T08:21:44.932 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T08:21:44.932 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-19T08:21:44.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:44 smithi155 ceph-mon[35362]: pgmap v332: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:21:45.239 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:44 smithi203 ceph-mon[35198]: pgmap v332: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:21:45.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:44 smithi027 ceph-mon[31209]: pgmap v332: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:21:45.700 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-19T08:21:45.701 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-19T08:21:45.701 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-19T08:21:45.701 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T08:21:45.712 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T08:21:45.712 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-19T08:21:45.712 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:21:45.734 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-19T08:21:45.734 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:21:45.794 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T08:21:46.103 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:21:46.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.586+0000 7f8e98106640 1 -- 172.21.15.27:0/1709391219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e90106f10 msgr2=0x7f8e9010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:46.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.586+0000 7f8e98106640 1 --2- 172.21.15.27:0/1709391219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e90106f10 0x7f8e9010ea90 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009ca0 tx=0x7f8e8802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:21:46.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.586+0000 7f8e98106640 1 -- 172.21.15.27:0/1709391219 shutdown_connections 2024-09-19T08:21:46.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.586+0000 7f8e98106640 1 --2- 172.21.15.27:0/1709391219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e90106f10 0x7f8e9010ea90 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:46.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.586+0000 7f8e98106640 1 --2- 172.21.15.27:0/1709391219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8e90102790 0x7f8e901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.586+0000 7f8e98106640 1 --2- 172.21.15.27:0/1709391219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e90101de0 0x7f8e901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.586+0000 7f8e98106640 1 -- 172.21.15.27:0/1709391219 >> 172.21.15.27:0/1709391219 conn(0x7f8e900fd8c0 msgr2=0x7f8e900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.586+0000 7f8e98106640 1 -- 172.21.15.27:0/1709391219 shutdown_connections 2024-09-19T08:21:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.586+0000 7f8e98106640 1 -- 172.21.15.27:0/1709391219 wait complete. 2024-09-19T08:21:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.587+0000 7f8e98106640 1 Processor -- start 2024-09-19T08:21:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.587+0000 7f8e98106640 1 -- start start 2024-09-19T08:21:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.587+0000 7f8e98106640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8e90101de0 0x7f8e90198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.587+0000 7f8e98106640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e90102790 0x7f8e901988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.587+0000 7f8e98106640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e90106f10 0x7f8e9019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.587+0000 7f8e98106640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8e90111f70 con 0x7f8e90106f10 2024-09-19T08:21:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.587+0000 7f8e98106640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8e90111df0 con 0x7f8e90102790 2024-09-19T08:21:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.587+0000 7f8e98106640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8e901120f0 con 0x7f8e90101de0 2024-09-19T08:21:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.587+0000 7f8e966a3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e90106f10 0x7f8e9019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.587+0000 7f8e966a3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e90106f10 0x7f8e9019cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51646/0 (socket says 172.21.15.27:51646) 2024-09-19T08:21:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.587+0000 7f8e966a3640 1 -- 172.21.15.27:0/502086802 learned_addr learned my addr 172.21.15.27:0/502086802 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.587+0000 7f8e956a1640 1 --2- 172.21.15.27:0/502086802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e90102790 0x7f8e901988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.587+0000 7f8e95ea2640 1 --2- 172.21.15.27:0/502086802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8e90101de0 0x7f8e90198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.588+0000 7f8e966a3640 1 -- 172.21.15.27:0/502086802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8e90101de0 msgr2=0x7f8e90198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.588+0000 7f8e966a3640 1 --2- 172.21.15.27:0/502086802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8e90101de0 0x7f8e90198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.588+0000 7f8e966a3640 1 -- 172.21.15.27:0/502086802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e90102790 msgr2=0x7f8e901988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.588+0000 7f8e966a3640 1 --2- 172.21.15.27:0/502086802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e90102790 0x7f8e901988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.588+0000 7f8e966a3640 1 -- 172.21.15.27:0/502086802 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e9019d340 con 0x7f8e90106f10 2024-09-19T08:21:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.588+0000 7f8e966a3640 1 --2- 172.21.15.27:0/502086802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e90106f10 0x7f8e9019cc60 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f8e88031a20 tx=0x7f8e88031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.588+0000 7f8e82ffd640 1 -- 172.21.15.27:0/502086802 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e88003c30 con 0x7f8e90106f10 2024-09-19T08:21:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.588+0000 7f8e82ffd640 1 -- 172.21.15.27:0/502086802 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e88003dd0 con 0x7f8e90106f10 2024-09-19T08:21:46.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.588+0000 7f8e98106640 1 -- 172.21.15.27:0/502086802 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e9019d5d0 con 0x7f8e90106f10 2024-09-19T08:21:46.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.588+0000 7f8e82ffd640 1 -- 172.21.15.27:0/502086802 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8802fcf0 con 0x7f8e90106f10 2024-09-19T08:21:46.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.588+0000 7f8e98106640 1 -- 172.21.15.27:0/502086802 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e901a4f10 con 0x7f8e90106f10 2024-09-19T08:21:46.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.589+0000 7f8e98106640 1 -- 172.21.15.27:0/502086802 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e901021c0 con 0x7f8e90106f10 2024-09-19T08:21:46.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.590+0000 7f8e82ffd640 1 -- 172.21.15.27:0/502086802 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f8e88004050 con 0x7f8e90106f10 2024-09-19T08:21:46.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.591+0000 7f8e82ffd640 1 --2- 172.21.15.27:0/502086802 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8e7c0a33b0 0x7f8e7c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:46.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.591+0000 7f8e82ffd640 1 -- 172.21.15.27:0/502086802 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f8e880f1050 con 0x7f8e90106f10 2024-09-19T08:21:46.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.591+0000 7f8e95ea2640 1 --2- 172.21.15.27:0/502086802 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8e7c0a33b0 0x7f8e7c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:46.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.591+0000 7f8e95ea2640 1 --2- 172.21.15.27:0/502086802 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8e7c0a33b0 0x7f8e7c0a5870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c0058c0 tx=0x7f8e8c00a2d0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:46.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.595+0000 7f8e82ffd640 1 -- 172.21.15.27:0/502086802 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8e880bdbf0 con 0x7f8e90106f10 2024-09-19T08:21:46.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.783+0000 7f8e98106640 1 -- 172.21.15.27:0/502086802 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8e9010a0f0 con 0x7f8e90106f10 2024-09-19T08:21:46.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.783+0000 7f8e82ffd640 1 -- 172.21.15.27:0/502086802 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v92) ==== 81+0+941 (secure 0 0 0) 0x7f8e8802fe90 con 0x7f8e90106f10 2024-09-19T08:21:46.783 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/4099657868 2024-09-20T08:11:01.318464+0000 2024-09-19T08:21:46.783 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/913696111 2024-09-20T08:11:01.318464+0000 2024-09-19T08:21:46.783 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/1717932879 2024-09-20T08:01:48.686812+0000 2024-09-19T08:21:46.783 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6800/4146960985 2024-09-20T08:01:48.686812+0000 2024-09-19T08:21:46.783 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6801/4146960985 2024-09-20T08:01:48.686812+0000 2024-09-19T08:21:46.784 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/1963219497 2024-09-20T08:01:48.686812+0000 2024-09-19T08:21:46.784 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/416476667 2024-09-20T08:01:48.686812+0000 2024-09-19T08:21:46.784 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/1908865720 2024-09-20T08:02:12.808047+0000 2024-09-19T08:21:46.784 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6801/538175414 2024-09-20T08:02:12.808047+0000 2024-09-19T08:21:46.784 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/1174736321 2024-09-20T08:02:12.808047+0000 2024-09-19T08:21:46.784 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/958829150 2024-09-20T08:02:12.808047+0000 2024-09-19T08:21:46.784 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6800/4220278108 2024-09-20T08:11:01.318464+0000 2024-09-19T08:21:46.784 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6800/538175414 2024-09-20T08:02:12.808047+0000 2024-09-19T08:21:46.784 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/3419400802 2024-09-20T08:11:01.318464+0000 2024-09-19T08:21:46.785 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/1827043850 2024-09-20T08:11:01.318464+0000 2024-09-19T08:21:46.785 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6801/4220278108 2024-09-20T08:11:01.318464+0000 2024-09-19T08:21:46.785 INFO:teuthology.orchestra.run.smithi027.stderr:listed 16 entries 2024-09-19T08:21:46.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.786+0000 7f8e98106640 1 -- 172.21.15.27:0/502086802 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8e7c0a33b0 msgr2=0x7f8e7c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:46.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.786+0000 7f8e98106640 1 --2- 172.21.15.27:0/502086802 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8e7c0a33b0 0x7f8e7c0a5870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c0058c0 tx=0x7f8e8c00a2d0 comp rx=0 tx=0).stop 2024-09-19T08:21:46.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.786+0000 7f8e98106640 1 -- 172.21.15.27:0/502086802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e90106f10 msgr2=0x7f8e9019cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:46.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.786+0000 7f8e98106640 1 --2- 172.21.15.27:0/502086802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e90106f10 0x7f8e9019cc60 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f8e88031a20 tx=0x7f8e88031a50 comp rx=0 tx=0).stop 2024-09-19T08:21:46.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.786+0000 7f8e98106640 1 -- 172.21.15.27:0/502086802 shutdown_connections 2024-09-19T08:21:46.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.786+0000 7f8e98106640 1 --2- 172.21.15.27:0/502086802 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f8e7c0a33b0 0x7f8e7c0a5870 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:46.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.786+0000 7f8e98106640 1 --2- 172.21.15.27:0/502086802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e90106f10 0x7f8e9019cc60 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:46.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.786+0000 7f8e98106640 1 --2- 172.21.15.27:0/502086802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e90102790 0x7f8e901988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:46.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.786+0000 7f8e98106640 1 --2- 172.21.15.27:0/502086802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8e90101de0 0x7f8e90198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:46.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.786+0000 7f8e98106640 1 -- 172.21.15.27:0/502086802 >> 172.21.15.27:0/502086802 conn(0x7f8e900fd8c0 msgr2=0x7f8e900fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:46.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.786+0000 7f8e98106640 1 -- 172.21.15.27:0/502086802 shutdown_connections 2024-09-19T08:21:46.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:46.786+0000 7f8e98106640 1 -- 172.21.15.27:0/502086802 wait complete. 2024-09-19T08:21:47.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:46 smithi027 ceph-mon[31209]: pgmap v333: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:47.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:46 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/502086802' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:21:47.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:46 smithi155 ceph-mon[35362]: pgmap v333: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:47.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:46 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/502086802' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:21:47.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:46 smithi203 ceph-mon[35198]: pgmap v333: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:47.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:46 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/502086802' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:21:47.414 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T08:21:47.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:21:47.414 DEBUG:teuthology.orchestra.run.smithi027:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T08:21:47.471 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2024-09-19T08:21:47.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:21:47.472 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T08:21:47.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:21:47.504 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2024-09-19T08:21:47.561 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T08:21:47.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:21:47.561 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:21:47.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:21:47.629 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link delete ceph-brx 2024-09-19T08:21:47.719 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T08:21:47.732 INFO:tasks.cephadm:Teardown begin 2024-09-19T08:21:47.732 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T08:21:47.732 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:21:47.994 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:21:48.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.472+0000 7faca4c66640 1 -- 172.21.15.27:0/3873516618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faca0106b70 msgr2=0x7faca0106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:48.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.472+0000 7faca4c66640 1 --2- 172.21.15.27:0/3873516618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faca0106b70 0x7faca0106f50 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fac90009900 tx=0x7fac9002a410 comp rx=0 tx=0).stop 2024-09-19T08:21:48.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.473+0000 7faca4c66640 1 -- 172.21.15.27:0/3873516618 shutdown_connections 2024-09-19T08:21:48.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.473+0000 7faca4c66640 1 --2- 172.21.15.27:0/3873516618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faca0100a50 0x7faca01057e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:48.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.473+0000 7faca4c66640 1 --2- 172.21.15.27:0/3873516618 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faca0100090 0x7faca0100510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:48.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.473+0000 7faca4c66640 1 --2- 172.21.15.27:0/3873516618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faca0106b70 0x7faca0106f50 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:48.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.473+0000 7faca4c66640 1 -- 172.21.15.27:0/3873516618 >> 172.21.15.27:0/3873516618 conn(0x7faca0077210 msgr2=0x7faca00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:48.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.473+0000 7faca4c66640 1 -- 172.21.15.27:0/3873516618 shutdown_connections 2024-09-19T08:21:48.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.473+0000 7faca4c66640 1 -- 172.21.15.27:0/3873516618 wait complete. 2024-09-19T08:21:48.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.473+0000 7faca4c66640 1 Processor -- start 2024-09-19T08:21:48.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.473+0000 7faca4c66640 1 -- start start 2024-09-19T08:21:48.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7faca4c66640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faca0100090 0x7faca01a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:48.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7faca4c66640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faca0100a50 0x7faca01a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:48.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7faca4c66640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faca0106b70 0x7faca019e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:48.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7faca4c66640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7faca01185c0 con 0x7faca0100090 2024-09-19T08:21:48.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7faca4c66640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faca0118440 con 0x7faca0100a50 2024-09-19T08:21:48.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7faca4c66640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faca0118740 con 0x7faca0106b70 2024-09-19T08:21:48.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7fac9e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faca0100090 0x7faca01a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:48.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7fac9e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faca0100090 0x7faca01a46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51664/0 (socket says 172.21.15.27:51664) 2024-09-19T08:21:48.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7fac9e59c640 1 -- 172.21.15.27:0/224286582 learned_addr learned my addr 172.21.15.27:0/224286582 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:48.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7fac9ed9d640 1 --2- 172.21.15.27:0/224286582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faca0106b70 0x7faca019e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:48.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7fac9e59c640 1 -- 172.21.15.27:0/224286582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faca0106b70 msgr2=0x7faca019e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:48.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7fac9e59c640 1 --2- 172.21.15.27:0/224286582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faca0106b70 0x7faca019e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:48.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7fac9e59c640 1 -- 172.21.15.27:0/224286582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faca0100a50 msgr2=0x7faca01a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:48.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7fac9e59c640 1 --2- 172.21.15.27:0/224286582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faca0100a50 0x7faca01a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:48.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7fac9e59c640 1 -- 172.21.15.27:0/224286582 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca019efb0 con 0x7faca0100090 2024-09-19T08:21:48.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7fac9e59c640 1 --2- 172.21.15.27:0/224286582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faca0100090 0x7faca01a46c0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fac90006010 tx=0x7fac900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:48.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7fac8f7fe640 1 -- 172.21.15.27:0/224286582 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9003f030 con 0x7faca0100090 2024-09-19T08:21:48.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7fac8f7fe640 1 -- 172.21.15.27:0/224286582 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac90003ce0 con 0x7faca0100090 2024-09-19T08:21:48.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7faca4c66640 1 -- 172.21.15.27:0/224286582 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca019f240 con 0x7faca0100090 2024-09-19T08:21:48.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7fac8f7fe640 1 -- 172.21.15.27:0/224286582 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90035070 con 0x7faca0100090 2024-09-19T08:21:48.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.474+0000 7faca4c66640 1 -- 172.21.15.27:0/224286582 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca01ab590 con 0x7faca0100090 2024-09-19T08:21:48.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.476+0000 7faca4c66640 1 -- 172.21.15.27:0/224286582 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca01057e0 con 0x7faca0100090 2024-09-19T08:21:48.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.477+0000 7fac8f7fe640 1 -- 172.21.15.27:0/224286582 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fac90042030 con 0x7faca0100090 2024-09-19T08:21:48.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.477+0000 7fac8f7fe640 1 --2- 172.21.15.27:0/224286582 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fac880a3430 0x7fac880a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:48.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.477+0000 7fac9dd9b640 1 --2- 172.21.15.27:0/224286582 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fac880a3430 0x7fac880a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:48.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.477+0000 7fac8f7fe640 1 -- 172.21.15.27:0/224286582 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7fac900f0340 con 0x7faca0100090 2024-09-19T08:21:48.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.478+0000 7fac9dd9b640 1 --2- 172.21.15.27:0/224286582 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fac880a3430 0x7fac880a58f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fac94005fd0 tx=0x7fac94005850 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:48.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.482+0000 7fac8f7fe640 1 -- 172.21.15.27:0/224286582 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fac900bce00 con 0x7faca0100090 2024-09-19T08:21:48.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.693+0000 7faca4c66640 1 -- 172.21.15.27:0/224286582 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faca01ab760 con 0x7faca0100090 2024-09-19T08:21:48.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.694+0000 7fac8f7fe640 1 -- 172.21.15.27:0/224286582 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7fac900bc700 con 0x7faca0100090 2024-09-19T08:21:48.694 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:21:48.694 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:21:48.694 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:21:48.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.697+0000 7faca4c66640 1 -- 172.21.15.27:0/224286582 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fac880a3430 msgr2=0x7fac880a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:48.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.697+0000 7faca4c66640 1 --2- 172.21.15.27:0/224286582 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fac880a3430 0x7fac880a58f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fac94005fd0 tx=0x7fac94005850 comp rx=0 tx=0).stop 2024-09-19T08:21:48.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.697+0000 7faca4c66640 1 -- 172.21.15.27:0/224286582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faca0100090 msgr2=0x7faca01a46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:48.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.697+0000 7faca4c66640 1 --2- 172.21.15.27:0/224286582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faca0100090 0x7faca01a46c0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fac90006010 tx=0x7fac900042f0 comp rx=0 tx=0).stop 2024-09-19T08:21:48.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.697+0000 7faca4c66640 1 -- 172.21.15.27:0/224286582 shutdown_connections 2024-09-19T08:21:48.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.697+0000 7faca4c66640 1 --2- 172.21.15.27:0/224286582 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fac880a3430 0x7fac880a58f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:48.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.697+0000 7faca4c66640 1 --2- 172.21.15.27:0/224286582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faca0106b70 0x7faca019e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:48.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.697+0000 7faca4c66640 1 --2- 172.21.15.27:0/224286582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faca0100a50 0x7faca01a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:48.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.697+0000 7faca4c66640 1 --2- 172.21.15.27:0/224286582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faca0100090 0x7faca01a46c0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:48.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.697+0000 7faca4c66640 1 -- 172.21.15.27:0/224286582 >> 172.21.15.27:0/224286582 conn(0x7faca0077210 msgr2=0x7faca01037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:48.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.697+0000 7faca4c66640 1 -- 172.21.15.27:0/224286582 shutdown_connections 2024-09-19T08:21:48.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:48.697+0000 7faca4c66640 1 -- 172.21.15.27:0/224286582 wait complete. 2024-09-19T08:21:49.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:48 smithi027 ceph-mon[31209]: pgmap v334: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:21:49.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:48 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/224286582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:21:49.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:48 smithi155 ceph-mon[35362]: pgmap v334: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:21:49.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:48 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/224286582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:21:49.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:48 smithi203 ceph-mon[35198]: pgmap v334: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:21:49.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:48 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/224286582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:21:49.341 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:21:49.602 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:21:50.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.099+0000 7fcccd4dd640 1 -- 172.21.15.27:0/2014679480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccc8100a90 msgr2=0x7fccc8100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:50.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.099+0000 7fcccd4dd640 1 --2- 172.21.15.27:0/2014679480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccc8100a90 0x7fccc8100ef0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fccbc009930 tx=0x7fccbc02a420 comp rx=0 tx=0).stop 2024-09-19T08:21:50.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.099+0000 7fcccd4dd640 1 -- 172.21.15.27:0/2014679480 shutdown_connections 2024-09-19T08:21:50.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.099+0000 7fcccd4dd640 1 --2- 172.21.15.27:0/2014679480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccc8101430 0x7fccc810d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:50.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.099+0000 7fcccd4dd640 1 --2- 172.21.15.27:0/2014679480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccc8100a90 0x7fccc8100ef0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:50.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.099+0000 7fcccd4dd640 1 --2- 172.21.15.27:0/2014679480 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccc8106a90 0x7fccc8106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:50.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.099+0000 7fcccd4dd640 1 -- 172.21.15.27:0/2014679480 >> 172.21.15.27:0/2014679480 conn(0x7fccc80fc7d0 msgr2=0x7fccc80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:50.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.099+0000 7fcccd4dd640 1 -- 172.21.15.27:0/2014679480 shutdown_connections 2024-09-19T08:21:50.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.100+0000 7fcccd4dd640 1 -- 172.21.15.27:0/2014679480 wait complete. 2024-09-19T08:21:50.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.100+0000 7fcccd4dd640 1 Processor -- start 2024-09-19T08:21:50.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.100+0000 7fcccd4dd640 1 -- start start 2024-09-19T08:21:50.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fcccd4dd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccc8100a90 0x7fccc8198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:50.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fcccd4dd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccc8101430 0x7fccc81989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:50.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fcccd4dd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccc8106a90 0x7fccc819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:50.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fcccd4dd640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fccc8110e50 con 0x7fccc8101430 2024-09-19T08:21:50.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fcccd4dd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fccc8110cd0 con 0x7fccc8106a90 2024-09-19T08:21:50.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fcccd4dd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fccc8110fd0 con 0x7fccc8100a90 2024-09-19T08:21:50.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fccc67fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccc8101430 0x7fccc81989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:50.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fccc67fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccc8101430 0x7fccc81989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51686/0 (socket says 172.21.15.27:51686) 2024-09-19T08:21:50.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fccc67fc640 1 -- 172.21.15.27:0/2873990333 learned_addr learned my addr 172.21.15.27:0/2873990333 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:50.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fccc6ffd640 1 --2- 172.21.15.27:0/2873990333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccc8100a90 0x7fccc8198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:50.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fccc77fe640 1 --2- 172.21.15.27:0/2873990333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccc8106a90 0x7fccc819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:50.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fccc67fc640 1 -- 172.21.15.27:0/2873990333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccc8100a90 msgr2=0x7fccc8198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:50.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fccc67fc640 1 --2- 172.21.15.27:0/2873990333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccc8100a90 0x7fccc8198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:50.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fccc67fc640 1 -- 172.21.15.27:0/2873990333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccc8106a90 msgr2=0x7fccc819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:50.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fccc67fc640 1 --2- 172.21.15.27:0/2873990333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccc8106a90 0x7fccc819cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:50.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fccc67fc640 1 -- 172.21.15.27:0/2873990333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc819d420 con 0x7fccc8101430 2024-09-19T08:21:50.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fccc67fc640 1 --2- 172.21.15.27:0/2873990333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccc8101430 0x7fccc81989b0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fccbc009230 tx=0x7fccbc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:50.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fccaffff640 1 -- 172.21.15.27:0/2873990333 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc03f030 con 0x7fccc8101430 2024-09-19T08:21:50.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fcccd4dd640 1 -- 172.21.15.27:0/2873990333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc819d6b0 con 0x7fccc8101430 2024-09-19T08:21:50.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fccaffff640 1 -- 172.21.15.27:0/2873990333 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccbc003ad0 con 0x7fccc8101430 2024-09-19T08:21:50.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.101+0000 7fccaffff640 1 -- 172.21.15.27:0/2873990333 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc035070 con 0x7fccc8101430 2024-09-19T08:21:50.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.102+0000 7fcccd4dd640 1 -- 172.21.15.27:0/2873990333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc81a4ff0 con 0x7fccc8101430 2024-09-19T08:21:50.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.103+0000 7fcccd4dd640 1 -- 172.21.15.27:0/2873990333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc81021d0 con 0x7fccc8101430 2024-09-19T08:21:50.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.104+0000 7fccaffff640 1 -- 172.21.15.27:0/2873990333 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fccbc042030 con 0x7fccc8101430 2024-09-19T08:21:50.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.104+0000 7fccaffff640 1 --2- 172.21.15.27:0/2873990333 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fccb00a33b0 0x7fccb00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:50.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.105+0000 7fccc6ffd640 1 --2- 172.21.15.27:0/2873990333 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fccb00a33b0 0x7fccb00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:50.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.105+0000 7fccaffff640 1 -- 172.21.15.27:0/2873990333 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7fccbc0f02a0 con 0x7fccc8101430 2024-09-19T08:21:50.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.105+0000 7fccc6ffd640 1 --2- 172.21.15.27:0/2873990333 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fccb00a33b0 0x7fccb00a5870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fccb80058c0 tx=0x7fccb8005be0 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:50.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.109+0000 7fccaffff640 1 -- 172.21.15.27:0/2873990333 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fccbc0bcca0 con 0x7fccc8101430 2024-09-19T08:21:50.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.327+0000 7fcccd4dd640 1 -- 172.21.15.27:0/2873990333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fccc810a060 con 0x7fccc8101430 2024-09-19T08:21:50.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.328+0000 7fccaffff640 1 -- 172.21.15.27:0/2873990333 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11861 (secure 0 0 0) 0x7fccbc0bc5a0 con 0x7fccc8101430 2024-09-19T08:21:50.327 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:21:50.327 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-19T08:09:21:292345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2839073918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2839073918},{"type":"v1","addr":"172.21.15.27:6835","nonce":2839073918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1473265593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1473265593},{"type":"v1","addr":"172.21.15.27:6837","nonce":1473265593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/4163950622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":4163950622},{"type":"v1","addr":"172.21.15.27:6839","nonce":4163950622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/2368031257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":2368031257},{"type":"v1","addr":"172.21.15.27:6841","nonce":2368031257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3132962224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3132962224},{"type":"v1","addr":"172.21.15.203:6833","nonce":3132962224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1589376541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1589376541},{"type":"v1","addr":"172.21.15.155:6833","nonce":1589376541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/3596726506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3596726506},{"type":"v1","addr":"172.21.15.203:6835","nonce":3596726506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3102690439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3102690439},{"type":"v1","addr":"172.21.15.155:6835","nonce":3102690439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3575223508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3575223508},{"type":"v1","addr":"172.21.15.203:6837","nonce":3575223508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/532811783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":532811783},{"type":"v1","addr":"172.21.15.155:6837","nonce":532811783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:09:11.930032+0000","modified":"2024-09-19T08:09:20.890507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6839/1481040099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":1481040099},{"type":"v1","addr":"172.21.15.203:6839","nonce":1481040099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.155:6839/1929184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1929184836},{"type":"v1","addr":"172.21.15.155:6839","nonce":1929184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24482]},"id":1}]} 2024-09-19T08:21:50.328 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-19T08:21:50.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.330+0000 7fcccd4dd640 1 -- 172.21.15.27:0/2873990333 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fccb00a33b0 msgr2=0x7fccb00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:50.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.330+0000 7fcccd4dd640 1 --2- 172.21.15.27:0/2873990333 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fccb00a33b0 0x7fccb00a5870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fccb80058c0 tx=0x7fccb8005be0 comp rx=0 tx=0).stop 2024-09-19T08:21:50.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.330+0000 7fcccd4dd640 1 -- 172.21.15.27:0/2873990333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccc8101430 msgr2=0x7fccc81989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:50.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.330+0000 7fcccd4dd640 1 --2- 172.21.15.27:0/2873990333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccc8101430 0x7fccc81989b0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fccbc009230 tx=0x7fccbc004270 comp rx=0 tx=0).stop 2024-09-19T08:21:50.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.330+0000 7fcccd4dd640 1 -- 172.21.15.27:0/2873990333 shutdown_connections 2024-09-19T08:21:50.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.330+0000 7fcccd4dd640 1 --2- 172.21.15.27:0/2873990333 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fccb00a33b0 0x7fccb00a5870 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:50.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.330+0000 7fcccd4dd640 1 --2- 172.21.15.27:0/2873990333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccc8106a90 0x7fccc819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:50.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.330+0000 7fcccd4dd640 1 --2- 172.21.15.27:0/2873990333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccc8101430 0x7fccc81989b0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:50.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.330+0000 7fcccd4dd640 1 --2- 172.21.15.27:0/2873990333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccc8100a90 0x7fccc8198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:50.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.330+0000 7fcccd4dd640 1 -- 172.21.15.27:0/2873990333 >> 172.21.15.27:0/2873990333 conn(0x7fccc80fc7d0 msgr2=0x7fccc806aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:50.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.330+0000 7fcccd4dd640 1 -- 172.21.15.27:0/2873990333 shutdown_connections 2024-09-19T08:21:50.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:50.330+0000 7fcccd4dd640 1 -- 172.21.15.27:0/2873990333 wait complete. 2024-09-19T08:21:50.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:50 smithi027 ceph-mon[31209]: pgmap v335: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:50.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:50 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2873990333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:21:51.025 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:21:51.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:50 smithi155 ceph-mon[35362]: pgmap v335: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:51.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:50 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2873990333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:21:51.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:50 smithi203 ceph-mon[35198]: pgmap v335: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:51.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:50 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2873990333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:21:51.289 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:21:51.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.851+0000 7fd03dcfc640 1 -- 172.21.15.27:0/2419810584 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd03810c180 msgr2=0x7fd03810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:51.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.851+0000 7fd03dcfc640 1 --2- 172.21.15.27:0/2419810584 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd03810c180 0x7fd03810e610 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fd030009ca0 tx=0x7fd03002a950 comp rx=0 tx=0).stop 2024-09-19T08:21:51.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.851+0000 7fd03dcfc640 1 -- 172.21.15.27:0/2419810584 shutdown_connections 2024-09-19T08:21:51.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.851+0000 7fd03dcfc640 1 --2- 172.21.15.27:0/2419810584 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd03810c180 0x7fd03810e610 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:51.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.851+0000 7fd03dcfc640 1 --2- 172.21.15.27:0/2419810584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd038103700 0x7fd03810bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:51.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.851+0000 7fd03dcfc640 1 --2- 172.21.15.27:0/2419810584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd038102de0 0x7fd0381031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:51.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.851+0000 7fd03dcfc640 1 -- 172.21.15.27:0/2419810584 >> 172.21.15.27:0/2419810584 conn(0x7fd0380fc7a0 msgr2=0x7fd0380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:51.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.851+0000 7fd03dcfc640 1 -- 172.21.15.27:0/2419810584 shutdown_connections 2024-09-19T08:21:51.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.851+0000 7fd03dcfc640 1 -- 172.21.15.27:0/2419810584 wait complete. 2024-09-19T08:21:51.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.852+0000 7fd03dcfc640 1 Processor -- start 2024-09-19T08:21:51.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.852+0000 7fd03dcfc640 1 -- start start 2024-09-19T08:21:51.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.852+0000 7fd03dcfc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd038102de0 0x7fd038198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:51.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.852+0000 7fd03dcfc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd038103700 0x7fd038198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:51.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.852+0000 7fd03dcfc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd03810c180 0x7fd03819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:51.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.852+0000 7fd03dcfc640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd038111f70 con 0x7fd038103700 2024-09-19T08:21:51.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.852+0000 7fd03dcfc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd038111df0 con 0x7fd038102de0 2024-09-19T08:21:51.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.852+0000 7fd03dcfc640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd0381120f0 con 0x7fd03810c180 2024-09-19T08:21:51.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.853+0000 7fd02ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd038103700 0x7fd038198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:51.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.853+0000 7fd02ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd038103700 0x7fd038198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43140/0 (socket says 172.21.15.27:43140) 2024-09-19T08:21:51.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.853+0000 7fd02ffff640 1 -- 172.21.15.27:0/946266304 learned_addr learned my addr 172.21.15.27:0/946266304 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:51.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.853+0000 7fd037fff640 1 --2- 172.21.15.27:0/946266304 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd03810c180 0x7fd03819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:51.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.853+0000 7fd0377fe640 1 --2- 172.21.15.27:0/946266304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd038102de0 0x7fd038198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:51.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.853+0000 7fd02ffff640 1 -- 172.21.15.27:0/946266304 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd03810c180 msgr2=0x7fd03819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:51.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.853+0000 7fd02ffff640 1 --2- 172.21.15.27:0/946266304 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd03810c180 0x7fd03819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:51.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.853+0000 7fd02ffff640 1 -- 172.21.15.27:0/946266304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd038102de0 msgr2=0x7fd038198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:51.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.853+0000 7fd02ffff640 1 --2- 172.21.15.27:0/946266304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd038102de0 0x7fd038198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:51.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.853+0000 7fd02ffff640 1 -- 172.21.15.27:0/946266304 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03819d3c0 con 0x7fd038103700 2024-09-19T08:21:51.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.853+0000 7fd0377fe640 1 --2- 172.21.15.27:0/946266304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd038102de0 0x7fd038198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:21:51.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.853+0000 7fd02ffff640 1 --2- 172.21.15.27:0/946266304 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd038103700 0x7fd038198950 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd02000d950 tx=0x7fd02000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:51.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.853+0000 7fd0357fa640 1 -- 172.21.15.27:0/946266304 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd020017070 con 0x7fd038103700 2024-09-19T08:21:51.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.853+0000 7fd03dcfc640 1 -- 172.21.15.27:0/946266304 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd03819d6b0 con 0x7fd038103700 2024-09-19T08:21:51.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.854+0000 7fd0357fa640 1 -- 172.21.15.27:0/946266304 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd020009c30 con 0x7fd038103700 2024-09-19T08:21:51.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.854+0000 7fd0357fa640 1 -- 172.21.15.27:0/946266304 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02000f6b0 con 0x7fd038103700 2024-09-19T08:21:51.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.854+0000 7fd03dcfc640 1 -- 172.21.15.27:0/946266304 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0381a4f90 con 0x7fd038103700 2024-09-19T08:21:51.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.855+0000 7fd03dcfc640 1 -- 172.21.15.27:0/946266304 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0381031c0 con 0x7fd038103700 2024-09-19T08:21:51.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.856+0000 7fd0357fa640 1 -- 172.21.15.27:0/946266304 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fd0200109d0 con 0x7fd038103700 2024-09-19T08:21:51.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.856+0000 7fd0357fa640 1 --2- 172.21.15.27:0/946266304 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd0240a33b0 0x7fd0240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:51.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.856+0000 7fd0377fe640 1 --2- 172.21.15.27:0/946266304 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd0240a33b0 0x7fd0240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:51.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.856+0000 7fd0357fa640 1 -- 172.21.15.27:0/946266304 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7fd0200cf590 con 0x7fd038103700 2024-09-19T08:21:51.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.857+0000 7fd0377fe640 1 --2- 172.21.15.27:0/946266304 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd0240a33b0 0x7fd0240a5870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd0280058c0 tx=0x7fd028005850 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:51.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:51.861+0000 7fd0357fa640 1 -- 172.21.15.27:0/946266304 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd02009bf90 con 0x7fd038103700 2024-09-19T08:21:52.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:52.037+0000 7fd03dcfc640 1 -- 172.21.15.27:0/946266304 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd038106cd0 con 0x7fd038103700 2024-09-19T08:21:52.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:52.038+0000 7fd0357fa640 1 -- 172.21.15.27:0/946266304 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+23117 (secure 0 0 0) 0x7fd02009b890 con 0x7fd038103700 2024-09-19T08:21:52.038 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-19T08:21:52.038 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":92,"fsid":"35b531b0-765d-11ef-bceb-c7b262605968","created":"2024-09-19T08:01:20.929241+0000","modified":"2024-09-19T08:21:15.826853+0000","last_up_change":"2024-09-19T08:08:17.919001+0000","last_in_change":"2024-09-19T08:07:54.277124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:04:29.312984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:09:08.046858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:09:10.223258+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66fd6732-4cac-4eda-bf06-50638995ee80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6803","nonce":3645201250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6805","nonce":3645201250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6809","nonce":3645201250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3645201250},{"type":"v1","addr":"172.21.15.27:6807","nonce":3645201250}]},"public_addr":"172.21.15.27:6803/3645201250","cluster_addr":"172.21.15.27:6805/3645201250","heartbeat_back_addr":"172.21.15.27:6809/3645201250","heartbeat_front_addr":"172.21.15.27:6807/3645201250","state":["exists","up"]},{"osd":1,"uuid":"36628767-66ac-433b-938e-10e75b51a877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6801","nonce":3977510449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6803","nonce":3977510449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6807","nonce":3977510449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3977510449},{"type":"v1","addr":"172.21.15.155:6805","nonce":3977510449}]},"public_addr":"172.21.15.155:6801/3977510449","cluster_addr":"172.21.15.155:6803/3977510449","heartbeat_back_addr":"172.21.15.155:6807/3977510449","heartbeat_front_addr":"172.21.15.155:6805/3977510449","state":["exists","up"]},{"osd":2,"uuid":"3dc80404-a56b-456a-af02-f01e9c6c6dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6801","nonce":3796057016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6803","nonce":3796057016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6807","nonce":3796057016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3796057016},{"type":"v1","addr":"172.21.15.203:6805","nonce":3796057016}]},"public_addr":"172.21.15.203:6801/3796057016","cluster_addr":"172.21.15.203:6803/3796057016","heartbeat_back_addr":"172.21.15.203:6807/3796057016","heartbeat_front_addr":"172.21.15.203:6805/3796057016","state":["exists","up"]},{"osd":3,"uuid":"a51077d0-5e04-49b5-bb3e-91711cc45ff1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6811","nonce":1608304347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6813","nonce":1608304347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6817","nonce":1608304347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":1608304347},{"type":"v1","addr":"172.21.15.27:6815","nonce":1608304347}]},"public_addr":"172.21.15.27:6811/1608304347","cluster_addr":"172.21.15.27:6813/1608304347","heartbeat_back_addr":"172.21.15.27:6817/1608304347","heartbeat_front_addr":"172.21.15.27:6815/1608304347","state":["exists","up"]},{"osd":4,"uuid":"0df35548-90b4-434d-8d7e-c037072c9ae4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6809","nonce":569913150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6811","nonce":569913150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6815","nonce":569913150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":569913150},{"type":"v1","addr":"172.21.15.155:6813","nonce":569913150}]},"public_addr":"172.21.15.155:6809/569913150","cluster_addr":"172.21.15.155:6811/569913150","heartbeat_back_addr":"172.21.15.155:6815/569913150","heartbeat_front_addr":"172.21.15.155:6813/569913150","state":["exists","up"]},{"osd":5,"uuid":"de193c5f-1019-43e5-9f4f-6c2aaa4330e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6809","nonce":991491203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6811","nonce":991491203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6815","nonce":991491203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":991491203},{"type":"v1","addr":"172.21.15.203:6813","nonce":991491203}]},"public_addr":"172.21.15.203:6809/991491203","cluster_addr":"172.21.15.203:6811/991491203","heartbeat_back_addr":"172.21.15.203:6815/991491203","heartbeat_front_addr":"172.21.15.203:6813/991491203","state":["exists","up"]},{"osd":6,"uuid":"28938e4f-9f22-466f-8cf7-62ee56a0c926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6819","nonce":3516868131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6821","nonce":3516868131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6825","nonce":3516868131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3516868131},{"type":"v1","addr":"172.21.15.27:6823","nonce":3516868131}]},"public_addr":"172.21.15.27:6819/3516868131","cluster_addr":"172.21.15.27:6821/3516868131","heartbeat_back_addr":"172.21.15.27:6825/3516868131","heartbeat_front_addr":"172.21.15.27:6823/3516868131","state":["exists","up"]},{"osd":7,"uuid":"855f1728-be52-4445-8561-a90c08f2b2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6817","nonce":2047506436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6819","nonce":2047506436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6823","nonce":2047506436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2047506436},{"type":"v1","addr":"172.21.15.155:6821","nonce":2047506436}]},"public_addr":"172.21.15.155:6817/2047506436","cluster_addr":"172.21.15.155:6819/2047506436","heartbeat_back_addr":"172.21.15.155:6823/2047506436","heartbeat_front_addr":"172.21.15.155:6821/2047506436","state":["exists","up"]},{"osd":8,"uuid":"5d7a8ffd-a039-403e-8b9a-c80e19fd67ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6817","nonce":199970687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6819","nonce":199970687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6823","nonce":199970687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":199970687},{"type":"v1","addr":"172.21.15.203:6821","nonce":199970687}]},"public_addr":"172.21.15.203:6817/199970687","cluster_addr":"172.21.15.203:6819/199970687","heartbeat_back_addr":"172.21.15.203:6823/199970687","heartbeat_front_addr":"172.21.15.203:6821/199970687","state":["exists","up"]},{"osd":9,"uuid":"cdb90242-80a1-4cef-b5e3-ddecb05664e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6827","nonce":118390483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6829","nonce":118390483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6833","nonce":118390483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":118390483},{"type":"v1","addr":"172.21.15.27:6831","nonce":118390483}]},"public_addr":"172.21.15.27:6827/118390483","cluster_addr":"172.21.15.27:6829/118390483","heartbeat_back_addr":"172.21.15.27:6833/118390483","heartbeat_front_addr":"172.21.15.27:6831/118390483","state":["exists","up"]},{"osd":10,"uuid":"c7f4c9da-d913-47a5-8629-53de21efe8c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6825","nonce":1687418565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6827","nonce":1687418565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6831","nonce":1687418565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1687418565},{"type":"v1","addr":"172.21.15.155:6829","nonce":1687418565}]},"public_addr":"172.21.15.155:6825/1687418565","cluster_addr":"172.21.15.155:6827/1687418565","heartbeat_back_addr":"172.21.15.155:6831/1687418565","heartbeat_front_addr":"172.21.15.155:6829/1687418565","state":["exists","up"]},{"osd":11,"uuid":"45c11a90-585e-46fa-a5a0-51a29e29eba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6825","nonce":224768827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6827","nonce":224768827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6831","nonce":224768827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":224768827},{"type":"v1","addr":"172.21.15.203:6829","nonce":224768827}]},"public_addr":"172.21.15.203:6825/224768827","cluster_addr":"172.21.15.203:6827/224768827","heartbeat_back_addr":"172.21.15.203:6831/224768827","heartbeat_front_addr":"172.21.15.203:6829/224768827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:03:35.559549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:00.526006+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:25.809346+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:04:51.889445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:17.246017+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:05:43.515854+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:08.638182+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:34.653060+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:06:59.469837+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:26.122937+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:07:50.196159+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:08:16.245770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/4099657868":"2024-09-20T08:11:01.318464+0000","172.21.15.27:0/913696111":"2024-09-20T08:11:01.318464+0000","172.21.15.27:0/1717932879":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6800/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:6801/4146960985":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/1963219497":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/416476667":"2024-09-20T08:01:48.686812+0000","172.21.15.27:0/1908865720":"2024-09-20T08:02:12.808047+0000","172.21.15.27:6801/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/1174736321":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/958829150":"2024-09-20T08:02:12.808047+0000","172.21.15.27:6800/4220278108":"2024-09-20T08:11:01.318464+0000","172.21.15.27:6800/538175414":"2024-09-20T08:02:12.808047+0000","172.21.15.27:0/3419400802":"2024-09-20T08:11:01.318464+0000","172.21.15.27:0/1827043850":"2024-09-20T08:11:01.318464+0000","172.21.15.27:6801/4220278108":"2024-09-20T08:11:01.318464+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:21:52.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:52.040+0000 7fd03dcfc640 1 -- 172.21.15.27:0/946266304 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd0240a33b0 msgr2=0x7fd0240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:52.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:52.040+0000 7fd03dcfc640 1 --2- 172.21.15.27:0/946266304 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd0240a33b0 0x7fd0240a5870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd0280058c0 tx=0x7fd028005850 comp rx=0 tx=0).stop 2024-09-19T08:21:52.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:52.040+0000 7fd03dcfc640 1 -- 172.21.15.27:0/946266304 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd038103700 msgr2=0x7fd038198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:52.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:52.040+0000 7fd03dcfc640 1 --2- 172.21.15.27:0/946266304 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd038103700 0x7fd038198950 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd02000d950 tx=0x7fd02000de10 comp rx=0 tx=0).stop 2024-09-19T08:21:52.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:52.041+0000 7fd03dcfc640 1 -- 172.21.15.27:0/946266304 shutdown_connections 2024-09-19T08:21:52.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:52.041+0000 7fd03dcfc640 1 --2- 172.21.15.27:0/946266304 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fd0240a33b0 0x7fd0240a5870 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:52.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:52.041+0000 7fd03dcfc640 1 --2- 172.21.15.27:0/946266304 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd03810c180 0x7fd03819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:52.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:52.041+0000 7fd03dcfc640 1 --2- 172.21.15.27:0/946266304 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd038103700 0x7fd038198950 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:52.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:52.041+0000 7fd03dcfc640 1 --2- 172.21.15.27:0/946266304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd038102de0 0x7fd038198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:52.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:52.041+0000 7fd03dcfc640 1 -- 172.21.15.27:0/946266304 >> 172.21.15.27:0/946266304 conn(0x7fd0380fc7a0 msgr2=0x7fd0380fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:52.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:52.041+0000 7fd03dcfc640 1 -- 172.21.15.27:0/946266304 shutdown_connections 2024-09-19T08:21:52.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:52.041+0000 7fd03dcfc640 1 -- 172.21.15.27:0/946266304 wait complete. 2024-09-19T08:21:52.741 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T08:21:53.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:52 smithi027 ceph-mon[31209]: pgmap v336: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:53.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:52 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/946266304' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:21:53.007 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:21:53.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:52 smithi155 ceph-mon[35362]: pgmap v336: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:53.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:52 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/946266304' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:21:53.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:52 smithi203 ceph-mon[35198]: pgmap v336: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:21:53.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:52 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/946266304' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:21:53.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.504+0000 7f6e3e4c3640 1 -- 172.21.15.27:0/661318468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e38100e20 msgr2=0x7f6e38101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:53.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.504+0000 7f6e3e4c3640 1 --2- 172.21.15.27:0/661318468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e38100e20 0x7f6e38101200 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6e28009900 tx=0x7f6e2802a480 comp rx=0 tx=0).stop 2024-09-19T08:21:53.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.504+0000 7f6e3e4c3640 1 -- 172.21.15.27:0/661318468 shutdown_connections 2024-09-19T08:21:53.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.504+0000 7f6e3e4c3640 1 --2- 172.21.15.27:0/661318468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e38102ef0 0x7f6e3810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:53.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.504+0000 7f6e3e4c3640 1 --2- 172.21.15.27:0/661318468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6e38102570 0x7f6e381029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:53.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.504+0000 7f6e3e4c3640 1 --2- 172.21.15.27:0/661318468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e38100e20 0x7f6e38101200 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:53.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.504+0000 7f6e3e4c3640 1 -- 172.21.15.27:0/661318468 >> 172.21.15.27:0/661318468 conn(0x7f6e380fc7d0 msgr2=0x7f6e380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:53.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.505+0000 7f6e3e4c3640 1 -- 172.21.15.27:0/661318468 shutdown_connections 2024-09-19T08:21:53.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.505+0000 7f6e3e4c3640 1 -- 172.21.15.27:0/661318468 wait complete. 2024-09-19T08:21:53.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.505+0000 7f6e3e4c3640 1 Processor -- start 2024-09-19T08:21:53.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.505+0000 7f6e3e4c3640 1 -- start start 2024-09-19T08:21:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.506+0000 7f6e3e4c3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e38100e20 0x7f6e381992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.506+0000 7f6e3e4c3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6e38102570 0x7f6e38199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.506+0000 7f6e3e4c3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e38102ef0 0x7f6e381a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.506+0000 7f6e3e4c3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6e38110f80 con 0x7f6e38102ef0 2024-09-19T08:21:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.506+0000 7f6e3e4c3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6e38110e00 con 0x7f6e38100e20 2024-09-19T08:21:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.506+0000 7f6e3e4c3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6e38111100 con 0x7f6e38102570 2024-09-19T08:21:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.506+0000 7f6e3ca60640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e38102ef0 0x7f6e381a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.506+0000 7f6e3ca60640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e38102ef0 0x7f6e381a4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43166/0 (socket says 172.21.15.27:43166) 2024-09-19T08:21:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.506+0000 7f6e3ca60640 1 -- 172.21.15.27:0/3286965422 learned_addr learned my addr 172.21.15.27:0/3286965422 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.506+0000 7f6e377fe640 1 --2- 172.21.15.27:0/3286965422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6e38102570 0x7f6e38199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.506+0000 7f6e37fff640 1 --2- 172.21.15.27:0/3286965422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e38100e20 0x7f6e381992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.506+0000 7f6e3ca60640 1 -- 172.21.15.27:0/3286965422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6e38102570 msgr2=0x7f6e38199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.506+0000 7f6e3ca60640 1 --2- 172.21.15.27:0/3286965422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6e38102570 0x7f6e38199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.506+0000 7f6e3ca60640 1 -- 172.21.15.27:0/3286965422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e38100e20 msgr2=0x7f6e381992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.506+0000 7f6e3ca60640 1 --2- 172.21.15.27:0/3286965422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e38100e20 0x7f6e381992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.506+0000 7f6e3ca60640 1 -- 172.21.15.27:0/3286965422 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e381a48b0 con 0x7f6e38102ef0 2024-09-19T08:21:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.506+0000 7f6e37fff640 1 --2- 172.21.15.27:0/3286965422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e38100e20 0x7f6e381992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:21:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.506+0000 7f6e3ca60640 1 --2- 172.21.15.27:0/3286965422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e38102ef0 0x7f6e381a4370 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000cce0 tx=0x7f6e3000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.507+0000 7f6e357fa640 1 -- 172.21.15.27:0/3286965422 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3000f450 con 0x7f6e38102ef0 2024-09-19T08:21:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.507+0000 7f6e357fa640 1 -- 172.21.15.27:0/3286965422 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e3000fad0 con 0x7f6e38102ef0 2024-09-19T08:21:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.507+0000 7f6e3e4c3640 1 -- 172.21.15.27:0/3286965422 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e381a4a80 con 0x7f6e38102ef0 2024-09-19T08:21:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.507+0000 7f6e357fa640 1 -- 172.21.15.27:0/3286965422 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30018c10 con 0x7f6e38102ef0 2024-09-19T08:21:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.507+0000 7f6e3e4c3640 1 -- 172.21.15.27:0/3286965422 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e381a4f40 con 0x7f6e38102ef0 2024-09-19T08:21:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.508+0000 7f6e3e4c3640 1 -- 172.21.15.27:0/3286965422 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e38101200 con 0x7f6e38102ef0 2024-09-19T08:21:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.509+0000 7f6e357fa640 1 -- 172.21.15.27:0/3286965422 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6e3000f5f0 con 0x7f6e38102ef0 2024-09-19T08:21:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.510+0000 7f6e357fa640 1 --2- 172.21.15.27:0/3286965422 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6e200a33b0 0x7f6e200a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.510+0000 7f6e37fff640 1 --2- 172.21.15.27:0/3286965422 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6e200a33b0 0x7f6e200a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.510+0000 7f6e357fa640 1 -- 172.21.15.27:0/3286965422 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f6e300d03e0 con 0x7f6e38102ef0 2024-09-19T08:21:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.510+0000 7f6e37fff640 1 --2- 172.21.15.27:0/3286965422 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6e200a33b0 0x7f6e200a5870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6e28005ab0 tx=0x7f6e28005a20 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.513+0000 7f6e357fa640 1 -- 172.21.15.27:0/3286965422 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6e30014030 con 0x7f6e38102ef0 2024-09-19T08:21:53.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.730+0000 7f6e3e4c3640 1 -- 172.21.15.27:0/3286965422 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6e3806a560 con 0x7f6e38102ef0 2024-09-19T08:21:53.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.732+0000 7f6e357fa640 1 -- 172.21.15.27:0/3286965422 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) ==== 161+0+0 (secure 0 0 0) 0x7f6e3806a560 con 0x7f6e38102ef0 2024-09-19T08:21:53.732 INFO:teuthology.orchestra.run.smithi027.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T08:21:53.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.735+0000 7f6e3e4c3640 1 -- 172.21.15.27:0/3286965422 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6e200a33b0 msgr2=0x7f6e200a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:53.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.735+0000 7f6e3e4c3640 1 --2- 172.21.15.27:0/3286965422 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6e200a33b0 0x7f6e200a5870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6e28005ab0 tx=0x7f6e28005a20 comp rx=0 tx=0).stop 2024-09-19T08:21:53.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.735+0000 7f6e3e4c3640 1 -- 172.21.15.27:0/3286965422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e38102ef0 msgr2=0x7f6e381a4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:53.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.735+0000 7f6e3e4c3640 1 --2- 172.21.15.27:0/3286965422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e38102ef0 0x7f6e381a4370 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000cce0 tx=0x7f6e3000a620 comp rx=0 tx=0).stop 2024-09-19T08:21:53.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.735+0000 7f6e3e4c3640 1 -- 172.21.15.27:0/3286965422 shutdown_connections 2024-09-19T08:21:53.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.735+0000 7f6e3e4c3640 1 --2- 172.21.15.27:0/3286965422 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f6e200a33b0 0x7f6e200a5870 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:53.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.735+0000 7f6e3e4c3640 1 --2- 172.21.15.27:0/3286965422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e38102ef0 0x7f6e381a4370 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:53.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.735+0000 7f6e3e4c3640 1 --2- 172.21.15.27:0/3286965422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6e38102570 0x7f6e38199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:53.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.735+0000 7f6e3e4c3640 1 --2- 172.21.15.27:0/3286965422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e38100e20 0x7f6e381992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:53.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.735+0000 7f6e3e4c3640 1 -- 172.21.15.27:0/3286965422 >> 172.21.15.27:0/3286965422 conn(0x7f6e380fc7d0 msgr2=0x7f6e380fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:53.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.736+0000 7f6e3e4c3640 1 -- 172.21.15.27:0/3286965422 shutdown_connections 2024-09-19T08:21:53.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:53.736+0000 7f6e3e4c3640 1 -- 172.21.15.27:0/3286965422 wait complete. 2024-09-19T08:21:54.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-a[31205]: 2024-09-19T08:21:53.731+0000 7fcd9ceae640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:21:54.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:53 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3286965422' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T08:21:54.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:53 smithi027 ceph-mon[31209]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T08:21:54.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:53 smithi027 ceph-mon[31209]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:21:54.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:53 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3286965422' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T08:21:54.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:53 smithi027 ceph-mon[31209]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T08:21:54.002 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:53 smithi027 ceph-mon[31209]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T08:21:54.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:53 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3286965422' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T08:21:54.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:53 smithi155 ceph-mon[35362]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T08:21:54.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:53 smithi155 ceph-mon[35362]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:21:54.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:53 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3286965422' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T08:21:54.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:53 smithi155 ceph-mon[35362]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T08:21:54.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:53 smithi155 ceph-mon[35362]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T08:21:54.238 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:21:53 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-b[65776]: ignoring --setuser ceph since I am not root 2024-09-19T08:21:54.238 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:21:53 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-b[65776]: ignoring --setgroup ceph since I am not root 2024-09-19T08:21:54.238 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:21:53 smithi155 ceph-mds[65780]: -- 172.21.15.155:0/3641888994 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558eb1b03860 con 0x558eb1ae1400 2024-09-19T08:21:54.238 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:21:53 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-b[65776]: starting mds.b at 2024-09-19T08:21:54.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:53 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3286965422' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T08:21:54.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:53 smithi203 ceph-mon[35198]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T08:21:54.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:53 smithi203 ceph-mon[35198]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:21:54.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:53 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3286965422' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T08:21:54.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:53 smithi203 ceph-mon[35198]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T08:21:54.259 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:53 smithi203 ceph-mon[35198]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T08:21:54.259 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 08:21:53 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-i[65572]: ignoring --setuser ceph since I am not root 2024-09-19T08:21:54.259 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 08:21:53 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-i[65572]: ignoring --setgroup ceph since I am not root 2024-09-19T08:21:54.260 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 08:21:53 smithi203 ceph-mds[65576]: -- 172.21.15.203:0/1847434056 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555acc091860 con 0x555acc06e800 2024-09-19T08:21:54.260 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 08:21:53 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-i[65572]: starting mds.i at 2024-09-19T08:21:54.513 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T08:21:54.773 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:21:55.170 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:54 smithi027 ceph-mon[31209]: pgmap v337: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:21:55.171 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:54 smithi027 ceph-mon[31209]: mds.? [v2:172.21.15.203:6838/1779662227,v1:172.21.15.203:6839/1779662227] up:boot 2024-09-19T08:21:55.171 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:54 smithi027 ceph-mon[31209]: mds.? [v2:172.21.15.155:6838/3050883165,v1:172.21.15.155:6839/3050883165] up:boot 2024-09-19T08:21:55.171 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:54 smithi027 ceph-mon[31209]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T08:21:55.171 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:54 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:21:55.171 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:54 smithi027 ceph-mon[31209]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:21:55.174 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:54 smithi203 ceph-mon[35198]: pgmap v337: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:21:55.174 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:54 smithi203 ceph-mon[35198]: mds.? [v2:172.21.15.203:6838/1779662227,v1:172.21.15.203:6839/1779662227] up:boot 2024-09-19T08:21:55.174 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:54 smithi203 ceph-mon[35198]: mds.? [v2:172.21.15.155:6838/3050883165,v1:172.21.15.155:6839/3050883165] up:boot 2024-09-19T08:21:55.174 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:54 smithi203 ceph-mon[35198]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T08:21:55.174 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:54 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:21:55.174 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:54 smithi203 ceph-mon[35198]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:21:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:54 smithi155 ceph-mon[35362]: pgmap v337: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:21:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:54 smithi155 ceph-mon[35362]: mds.? [v2:172.21.15.203:6838/1779662227,v1:172.21.15.203:6839/1779662227] up:boot 2024-09-19T08:21:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:54 smithi155 ceph-mon[35362]: mds.? [v2:172.21.15.155:6838/3050883165,v1:172.21.15.155:6839/3050883165] up:boot 2024-09-19T08:21:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:54 smithi155 ceph-mon[35362]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T08:21:55.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:54 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:21:55.238 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:54 smithi155 ceph-mon[35362]: from='mgr.15093 172.21.15.27:0/2683267548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:21:55.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.255+0000 7f1b234a1640 1 -- 172.21.15.27:0/616293114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b1c101420 msgr2=0x7f1b1c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:55.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.255+0000 7f1b234a1640 1 --2- 172.21.15.27:0/616293114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b1c101420 0x7f1b1c10d950 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f1b14009cd0 tx=0x7f1b1402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:21:55.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.255+0000 7f1b234a1640 1 -- 172.21.15.27:0/616293114 shutdown_connections 2024-09-19T08:21:55.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.255+0000 7f1b234a1640 1 --2- 172.21.15.27:0/616293114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b1c101420 0x7f1b1c10d950 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:55.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.255+0000 7f1b234a1640 1 --2- 172.21.15.27:0/616293114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b1c100a80 0x7f1b1c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:55.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.255+0000 7f1b234a1640 1 --2- 172.21.15.27:0/616293114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b1c106a80 0x7f1b1c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:55.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.255+0000 7f1b234a1640 1 -- 172.21.15.27:0/616293114 >> 172.21.15.27:0/616293114 conn(0x7f1b1c0fc7a0 msgr2=0x7f1b1c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:55.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.255+0000 7f1b234a1640 1 -- 172.21.15.27:0/616293114 shutdown_connections 2024-09-19T08:21:55.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.255+0000 7f1b234a1640 1 -- 172.21.15.27:0/616293114 wait complete. 2024-09-19T08:21:55.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.255+0000 7f1b234a1640 1 Processor -- start 2024-09-19T08:21:55.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.256+0000 7f1b234a1640 1 -- start start 2024-09-19T08:21:55.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.256+0000 7f1b234a1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b1c100a80 0x7f1b1c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:55.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.256+0000 7f1b234a1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b1c101420 0x7f1b1c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:55.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.256+0000 7f1b234a1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b1c106a80 0x7f1b1c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:55.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.256+0000 7f1b234a1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c111f40 con 0x7f1b1c101420 2024-09-19T08:21:55.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.256+0000 7f1b234a1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c111dc0 con 0x7f1b1c100a80 2024-09-19T08:21:55.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.256+0000 7f1b234a1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c1120c0 con 0x7f1b1c106a80 2024-09-19T08:21:55.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.256+0000 7f1b20a3c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b1c101420 0x7f1b1c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:55.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.256+0000 7f1b20a3c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b1c101420 0x7f1b1c198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43180/0 (socket says 172.21.15.27:43180) 2024-09-19T08:21:55.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.256+0000 7f1b20a3c640 1 -- 172.21.15.27:0/2541807522 learned_addr learned my addr 172.21.15.27:0/2541807522 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:55.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.256+0000 7f1b2123d640 1 --2- 172.21.15.27:0/2541807522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b1c100a80 0x7f1b1c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:55.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.256+0000 7f1b21a3e640 1 --2- 172.21.15.27:0/2541807522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b1c106a80 0x7f1b1c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:55.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.256+0000 7f1b20a3c640 1 -- 172.21.15.27:0/2541807522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b1c106a80 msgr2=0x7f1b1c19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:55.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.256+0000 7f1b20a3c640 1 --2- 172.21.15.27:0/2541807522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b1c106a80 0x7f1b1c19ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:55.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.256+0000 7f1b20a3c640 1 -- 172.21.15.27:0/2541807522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b1c100a80 msgr2=0x7f1b1c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:55.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.256+0000 7f1b20a3c640 1 --2- 172.21.15.27:0/2541807522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b1c100a80 0x7f1b1c198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:55.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.256+0000 7f1b20a3c640 1 -- 172.21.15.27:0/2541807522 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1c19d3d0 con 0x7f1b1c101420 2024-09-19T08:21:55.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.257+0000 7f1b20a3c640 1 --2- 172.21.15.27:0/2541807522 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b1c101420 0x7f1b1c198960 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800e9f0 tx=0x7f1b1800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:55.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.257+0000 7f1b0e7fc640 1 -- 172.21.15.27:0/2541807522 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1800cd80 con 0x7f1b1c101420 2024-09-19T08:21:55.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.257+0000 7f1b0e7fc640 1 -- 172.21.15.27:0/2541807522 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b18005500 con 0x7f1b1c101420 2024-09-19T08:21:55.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.257+0000 7f1b234a1640 1 -- 172.21.15.27:0/2541807522 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b1c19d6c0 con 0x7f1b1c101420 2024-09-19T08:21:55.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.257+0000 7f1b0e7fc640 1 -- 172.21.15.27:0/2541807522 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b18010690 con 0x7f1b1c101420 2024-09-19T08:21:55.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.257+0000 7f1b234a1640 1 -- 172.21.15.27:0/2541807522 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b1c1a4fa0 con 0x7f1b1c101420 2024-09-19T08:21:55.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.258+0000 7f1b234a1640 1 -- 172.21.15.27:0/2541807522 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b1c100ee0 con 0x7f1b1c101420 2024-09-19T08:21:55.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.259+0000 7f1b0e7fc640 1 -- 172.21.15.27:0/2541807522 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f1b180046c0 con 0x7f1b1c101420 2024-09-19T08:21:55.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.260+0000 7f1b0e7fc640 1 --2- 172.21.15.27:0/2541807522 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1b080a3430 0x7f1b080a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:55.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.260+0000 7f1b2123d640 1 --2- 172.21.15.27:0/2541807522 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1b080a3430 0x7f1b080a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:55.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.260+0000 7f1b0e7fc640 1 -- 172.21.15.27:0/2541807522 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8526+0+0 (secure 0 0 0) 0x7f1b180d0280 con 0x7f1b1c101420 2024-09-19T08:21:55.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.260+0000 7f1b2123d640 1 --2- 172.21.15.27:0/2541807522 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1b080a3430 0x7f1b080a58f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009b50 tx=0x7f1b10005f90 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:55.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.263+0000 7f1b0e7fc640 1 -- 172.21.15.27:0/2541807522 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1b18054210 con 0x7f1b1c101420 2024-09-19T08:21:55.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.477+0000 7f1b234a1640 1 -- 172.21.15.27:0/2541807522 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1b1c02d7c0 con 0x7f1b1c101420 2024-09-19T08:21:55.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.928+0000 7f1b0e7fc640 1 -- 172.21.15.27:0/2541807522 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7f1b1809cc60 con 0x7f1b1c101420 2024-09-19T08:21:55.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.932+0000 7f1b234a1640 1 -- 172.21.15.27:0/2541807522 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1b080a3430 msgr2=0x7f1b080a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:55.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.932+0000 7f1b234a1640 1 --2- 172.21.15.27:0/2541807522 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1b080a3430 0x7f1b080a58f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009b50 tx=0x7f1b10005f90 comp rx=0 tx=0).stop 2024-09-19T08:21:55.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.932+0000 7f1b234a1640 1 -- 172.21.15.27:0/2541807522 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b1c101420 msgr2=0x7f1b1c198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:55.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.932+0000 7f1b234a1640 1 --2- 172.21.15.27:0/2541807522 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b1c101420 0x7f1b1c198960 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800e9f0 tx=0x7f1b1800edf0 comp rx=0 tx=0).stop 2024-09-19T08:21:55.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.932+0000 7f1b234a1640 1 -- 172.21.15.27:0/2541807522 shutdown_connections 2024-09-19T08:21:55.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.932+0000 7f1b234a1640 1 --2- 172.21.15.27:0/2541807522 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f1b080a3430 0x7f1b080a58f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:55.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.932+0000 7f1b234a1640 1 --2- 172.21.15.27:0/2541807522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b1c106a80 0x7f1b1c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:55.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.932+0000 7f1b234a1640 1 --2- 172.21.15.27:0/2541807522 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b1c101420 0x7f1b1c198960 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:55.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.932+0000 7f1b234a1640 1 --2- 172.21.15.27:0/2541807522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b1c100a80 0x7f1b1c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:55.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.932+0000 7f1b234a1640 1 -- 172.21.15.27:0/2541807522 >> 172.21.15.27:0/2541807522 conn(0x7f1b1c0fc7a0 msgr2=0x7f1b1c0fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:55.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.932+0000 7f1b234a1640 1 -- 172.21.15.27:0/2541807522 shutdown_connections 2024-09-19T08:21:55.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:55.932+0000 7f1b234a1640 1 -- 172.21.15.27:0/2541807522 wait complete. 2024-09-19T08:21:56.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:55 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2541807522' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:21:56.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:55 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2541807522' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:21:56.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:55 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2541807522' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:21:56.630 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T08:21:56.894 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:21:57.192 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:56 smithi027 ceph-mon[31209]: pgmap v339: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-19T08:21:57.192 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:56 smithi027 ceph-mon[31209]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T08:21:57.193 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:56 smithi027 ceph-mon[31209]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T08:21:57.193 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:56 smithi027 ceph-mon[31209]: Cluster is now healthy 2024-09-19T08:21:57.193 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:56 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/2541807522' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:21:57.193 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:56 smithi027 ceph-mon[31209]: fsmap 12 up:standby 2024-09-19T08:21:57.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:56 smithi155 ceph-mon[35362]: pgmap v339: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-19T08:21:57.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:56 smithi155 ceph-mon[35362]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T08:21:57.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:56 smithi155 ceph-mon[35362]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T08:21:57.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:56 smithi155 ceph-mon[35362]: Cluster is now healthy 2024-09-19T08:21:57.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:56 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/2541807522' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:21:57.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:56 smithi155 ceph-mon[35362]: fsmap 12 up:standby 2024-09-19T08:21:57.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:56 smithi203 ceph-mon[35198]: pgmap v339: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-19T08:21:57.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:56 smithi203 ceph-mon[35198]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T08:21:57.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:56 smithi203 ceph-mon[35198]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T08:21:57.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:56 smithi203 ceph-mon[35198]: Cluster is now healthy 2024-09-19T08:21:57.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:56 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/2541807522' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:21:57.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:56 smithi203 ceph-mon[35198]: fsmap 12 up:standby 2024-09-19T08:21:57.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.384+0000 7fe3c813c640 1 -- 172.21.15.27:0/778034831 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3c01008d0 msgr2=0x7fe3c0100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:57.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.384+0000 7fe3c813c640 1 --2- 172.21.15.27:0/778034831 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3c01008d0 0x7fe3c0100cb0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc009900 tx=0x7fe3bc02a410 comp rx=0 tx=0).stop 2024-09-19T08:21:57.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.384+0000 7fe3c813c640 1 -- 172.21.15.27:0/778034831 shutdown_connections 2024-09-19T08:21:57.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.384+0000 7fe3c813c640 1 --2- 172.21.15.27:0/778034831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3c010e480 0x7fe3c0110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:57.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.384+0000 7fe3c813c640 1 --2- 172.21.15.27:0/778034831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c0101280 0x7fe3c010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:57.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.384+0000 7fe3c813c640 1 --2- 172.21.15.27:0/778034831 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3c01008d0 0x7fe3c0100cb0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:57.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.384+0000 7fe3c813c640 1 -- 172.21.15.27:0/778034831 >> 172.21.15.27:0/778034831 conn(0x7fe3c00fc7a0 msgr2=0x7fe3c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:57.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.384+0000 7fe3c813c640 1 -- 172.21.15.27:0/778034831 shutdown_connections 2024-09-19T08:21:57.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.384+0000 7fe3c813c640 1 -- 172.21.15.27:0/778034831 wait complete. 2024-09-19T08:21:57.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.385+0000 7fe3c813c640 1 Processor -- start 2024-09-19T08:21:57.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.385+0000 7fe3c813c640 1 -- start start 2024-09-19T08:21:57.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.385+0000 7fe3c813c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3c01008d0 0x7fe3c019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:57.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.385+0000 7fe3c813c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3c0101280 0x7fe3c019ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:57.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.385+0000 7fe3c813c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c010e480 0x7fe3c019efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:57.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.385+0000 7fe3c813c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c01141b0 con 0x7fe3c01008d0 2024-09-19T08:21:57.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.385+0000 7fe3c813c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c0114030 con 0x7fe3c010e480 2024-09-19T08:21:57.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.385+0000 7fe3c813c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c0114330 con 0x7fe3c0101280 2024-09-19T08:21:57.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.385+0000 7fe3c5ed8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3c01008d0 0x7fe3c019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:57.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.385+0000 7fe3c5ed8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3c01008d0 0x7fe3c019a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43204/0 (socket says 172.21.15.27:43204) 2024-09-19T08:21:57.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.385+0000 7fe3c5ed8640 1 -- 172.21.15.27:0/1814741117 learned_addr learned my addr 172.21.15.27:0/1814741117 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:57.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.385+0000 7fe3c66d9640 1 --2- 172.21.15.27:0/1814741117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c010e480 0x7fe3c019efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:57.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.385+0000 7fe3c56d7640 1 --2- 172.21.15.27:0/1814741117 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3c0101280 0x7fe3c019ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:57.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.386+0000 7fe3c5ed8640 1 -- 172.21.15.27:0/1814741117 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3c0101280 msgr2=0x7fe3c019ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:57.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.386+0000 7fe3c5ed8640 1 --2- 172.21.15.27:0/1814741117 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3c0101280 0x7fe3c019ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:57.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.386+0000 7fe3c5ed8640 1 -- 172.21.15.27:0/1814741117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c010e480 msgr2=0x7fe3c019efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:57.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.386+0000 7fe3c5ed8640 1 --2- 172.21.15.27:0/1814741117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c010e480 0x7fe3c019efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:57.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.386+0000 7fe3c5ed8640 1 -- 172.21.15.27:0/1814741117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c019f680 con 0x7fe3c01008d0 2024-09-19T08:21:57.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.386+0000 7fe3c5ed8640 1 --2- 172.21.15.27:0/1814741117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3c01008d0 0x7fe3c019a6d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc006010 tx=0x7fe3bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:57.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.386+0000 7fe3b6ffd640 1 -- 172.21.15.27:0/1814741117 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc03f030 con 0x7fe3c01008d0 2024-09-19T08:21:57.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.386+0000 7fe3b6ffd640 1 -- 172.21.15.27:0/1814741117 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3bc003ce0 con 0x7fe3c01008d0 2024-09-19T08:21:57.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.386+0000 7fe3c813c640 1 -- 172.21.15.27:0/1814741117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3c019f910 con 0x7fe3c01008d0 2024-09-19T08:21:57.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.386+0000 7fe3b6ffd640 1 -- 172.21.15.27:0/1814741117 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc035070 con 0x7fe3c01008d0 2024-09-19T08:21:57.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.386+0000 7fe3c813c640 1 -- 172.21.15.27:0/1814741117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3c01a7250 con 0x7fe3c01008d0 2024-09-19T08:21:57.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.387+0000 7fe3c813c640 1 -- 172.21.15.27:0/1814741117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3c006b070 con 0x7fe3c01008d0 2024-09-19T08:21:57.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.388+0000 7fe3b6ffd640 1 -- 172.21.15.27:0/1814741117 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe3bc042030 con 0x7fe3c01008d0 2024-09-19T08:21:57.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.389+0000 7fe3b6ffd640 1 --2- 172.21.15.27:0/1814741117 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe3ac0a33b0 0x7fe3ac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:57.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.389+0000 7fe3c56d7640 1 --2- 172.21.15.27:0/1814741117 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe3ac0a33b0 0x7fe3ac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:57.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.389+0000 7fe3b6ffd640 1 -- 172.21.15.27:0/1814741117 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8526+0+0 (secure 0 0 0) 0x7fe3bc0efe50 con 0x7fe3c01008d0 2024-09-19T08:21:57.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.390+0000 7fe3c56d7640 1 --2- 172.21.15.27:0/1814741117 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe3ac0a33b0 0x7fe3ac0a5870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe3c010ed50 tx=0x7fe3b000b390 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:57.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.394+0000 7fe3b6ffd640 1 -- 172.21.15.27:0/1814741117 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe3bc0bc2a0 con 0x7fe3c01008d0 2024-09-19T08:21:57.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.570+0000 7fe3c813c640 1 -- 172.21.15.27:0/1814741117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe3c0109610 con 0x7fe3c01008d0 2024-09-19T08:21:57.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.935+0000 7fe3b6ffd640 1 -- 172.21.15.27:0/1814741117 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v94) ==== 181+0+0 (secure 0 0 0) 0x7fe3bc0c05a0 con 0x7fe3c01008d0 2024-09-19T08:21:57.935 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' removed 2024-09-19T08:21:57.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.939+0000 7fe3c813c640 1 -- 172.21.15.27:0/1814741117 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe3ac0a33b0 msgr2=0x7fe3ac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:57.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.939+0000 7fe3c813c640 1 --2- 172.21.15.27:0/1814741117 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe3ac0a33b0 0x7fe3ac0a5870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe3c010ed50 tx=0x7fe3b000b390 comp rx=0 tx=0).stop 2024-09-19T08:21:57.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.939+0000 7fe3c813c640 1 -- 172.21.15.27:0/1814741117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3c01008d0 msgr2=0x7fe3c019a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:57.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.939+0000 7fe3c813c640 1 --2- 172.21.15.27:0/1814741117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3c01008d0 0x7fe3c019a6d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc006010 tx=0x7fe3bc0042f0 comp rx=0 tx=0).stop 2024-09-19T08:21:57.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.939+0000 7fe3c813c640 1 -- 172.21.15.27:0/1814741117 shutdown_connections 2024-09-19T08:21:57.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.939+0000 7fe3c813c640 1 --2- 172.21.15.27:0/1814741117 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7fe3ac0a33b0 0x7fe3ac0a5870 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:57.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.939+0000 7fe3c813c640 1 --2- 172.21.15.27:0/1814741117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c010e480 0x7fe3c019efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:57.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.939+0000 7fe3c813c640 1 --2- 172.21.15.27:0/1814741117 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3c0101280 0x7fe3c019ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:57.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.939+0000 7fe3c813c640 1 --2- 172.21.15.27:0/1814741117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3c01008d0 0x7fe3c019a6d0 secure :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc006010 tx=0x7fe3bc0042f0 comp rx=0 tx=0).stop 2024-09-19T08:21:57.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.939+0000 7fe3c813c640 1 -- 172.21.15.27:0/1814741117 >> 172.21.15.27:0/1814741117 conn(0x7fe3c00fc7a0 msgr2=0x7fe3c00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:57.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.939+0000 7fe3c813c640 1 -- 172.21.15.27:0/1814741117 shutdown_connections 2024-09-19T08:21:57.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:57.939+0000 7fe3c813c640 1 -- 172.21.15.27:0/1814741117 wait complete. 2024-09-19T08:21:58.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:57 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1814741117' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:21:58.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:57 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1814741117' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:21:58.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:57 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1814741117' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:21:58.610 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 35b531b0-765d-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T08:21:58.873 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:21:59.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:58 smithi155 ceph-mon[35362]: pgmap v340: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 716 B/s rd, 307 B/s wr, 1 op/s 2024-09-19T08:21:59.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:58 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/1814741117' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:21:59.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:58 smithi155 ceph-mon[35362]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T08:21:59.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:58 smithi027 ceph-mon[31209]: pgmap v340: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 716 B/s rd, 307 B/s wr, 1 op/s 2024-09-19T08:21:59.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:58 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/1814741117' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:21:59.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:58 smithi027 ceph-mon[31209]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T08:21:59.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:58 smithi203 ceph-mon[35198]: pgmap v340: 97 pgs: 97 active+clean; 16 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 716 B/s rd, 307 B/s wr, 1 op/s 2024-09-19T08:21:59.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:58 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/1814741117' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:21:59.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:58 smithi203 ceph-mon[35198]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T08:21:59.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.354+0000 7f0022377640 1 -- 172.21.15.27:0/1561335743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f001c102ef0 msgr2=0x7f001c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:59.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.354+0000 7f0022377640 1 --2- 172.21.15.27:0/1561335743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f001c102ef0 0x7f001c10da40 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f0014009ca0 tx=0x7f001402a950 comp rx=0 tx=0).stop 2024-09-19T08:21:59.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.354+0000 7f0022377640 1 -- 172.21.15.27:0/1561335743 shutdown_connections 2024-09-19T08:21:59.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.354+0000 7f0022377640 1 --2- 172.21.15.27:0/1561335743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f001c102ef0 0x7f001c10da40 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:59.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.354+0000 7f0022377640 1 --2- 172.21.15.27:0/1561335743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f001c102570 0x7f001c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:59.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.354+0000 7f0022377640 1 --2- 172.21.15.27:0/1561335743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f001c100e20 0x7f001c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:59.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.354+0000 7f0022377640 1 -- 172.21.15.27:0/1561335743 >> 172.21.15.27:0/1561335743 conn(0x7f001c0fc7d0 msgr2=0x7f001c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:59.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.354+0000 7f0022377640 1 -- 172.21.15.27:0/1561335743 shutdown_connections 2024-09-19T08:21:59.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.354+0000 7f0022377640 1 -- 172.21.15.27:0/1561335743 wait complete. 2024-09-19T08:21:59.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.354+0000 7f0022377640 1 Processor -- start 2024-09-19T08:21:59.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.354+0000 7f0022377640 1 -- start start 2024-09-19T08:21:59.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.355+0000 7f0022377640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f001c100e20 0x7f001c198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:59.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.355+0000 7f0022377640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f001c102570 0x7f001c1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:59.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.355+0000 7f0022377640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f001c102ef0 0x7f001c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:59.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.355+0000 7f0022377640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f001c110f80 con 0x7f001c100e20 2024-09-19T08:21:59.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.355+0000 7f0022377640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f001c110e00 con 0x7f001c102570 2024-09-19T08:21:59.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.355+0000 7f0022377640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f001c111100 con 0x7f001c102ef0 2024-09-19T08:21:59.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.355+0000 7f001bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f001c100e20 0x7f001c198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:59.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.355+0000 7f001bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f001c100e20 0x7f001c198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43222/0 (socket says 172.21.15.27:43222) 2024-09-19T08:21:59.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.355+0000 7f001bfff640 1 -- 172.21.15.27:0/3740091821 learned_addr learned my addr 172.21.15.27:0/3740091821 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-19T08:21:59.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.355+0000 7f001b7fe640 1 --2- 172.21.15.27:0/3740091821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f001c102570 0x7f001c1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:59.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.355+0000 7f001bfff640 1 -- 172.21.15.27:0/3740091821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f001c102ef0 msgr2=0x7f001c19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:59.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.355+0000 7f0020914640 1 --2- 172.21.15.27:0/3740091821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f001c102ef0 0x7f001c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:59.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.355+0000 7f001bfff640 1 --2- 172.21.15.27:0/3740091821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f001c102ef0 0x7f001c19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:59.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.355+0000 7f001bfff640 1 -- 172.21.15.27:0/3740091821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f001c102570 msgr2=0x7f001c1988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:59.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.355+0000 7f001bfff640 1 --2- 172.21.15.27:0/3740091821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f001c102570 0x7f001c1988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:59.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.355+0000 7f001bfff640 1 -- 172.21.15.27:0/3740091821 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001c19d340 con 0x7f001c100e20 2024-09-19T08:21:59.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.355+0000 7f0020914640 1 --2- 172.21.15.27:0/3740091821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f001c102ef0 0x7f001c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:21:59.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.355+0000 7f001bfff640 1 --2- 172.21.15.27:0/3740091821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f001c100e20 0x7f001c198390 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f000c00c920 tx=0x7f000c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:59.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.356+0000 7f00197fa640 1 -- 172.21.15.27:0/3740091821 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c007c70 con 0x7f001c100e20 2024-09-19T08:21:59.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.356+0000 7f00197fa640 1 -- 172.21.15.27:0/3740091821 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f000c007e10 con 0x7f001c100e20 2024-09-19T08:21:59.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.356+0000 7f0022377640 1 -- 172.21.15.27:0/3740091821 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f001c19d630 con 0x7f001c100e20 2024-09-19T08:21:59.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.356+0000 7f00197fa640 1 -- 172.21.15.27:0/3740091821 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c018890 con 0x7f001c100e20 2024-09-19T08:21:59.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.356+0000 7f0022377640 1 -- 172.21.15.27:0/3740091821 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f001c1a4f10 con 0x7f001c100e20 2024-09-19T08:21:59.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.357+0000 7f0022377640 1 -- 172.21.15.27:0/3740091821 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f001c101200 con 0x7f001c100e20 2024-09-19T08:21:59.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.358+0000 7f00197fa640 1 -- 172.21.15.27:0/3740091821 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f000c018a70 con 0x7f001c100e20 2024-09-19T08:21:59.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.359+0000 7f00197fa640 1 --2- 172.21.15.27:0/3740091821 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f00040a33b0 0x7f00040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:21:59.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.359+0000 7f001b7fe640 1 --2- 172.21.15.27:0/3740091821 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f00040a33b0 0x7f00040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:21:59.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.359+0000 7f00197fa640 1 -- 172.21.15.27:0/3740091821 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8001+0+0 (secure 0 0 0) 0x7f000c0cfc20 con 0x7f001c100e20 2024-09-19T08:21:59.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.360+0000 7f001b7fe640 1 --2- 172.21.15.27:0/3740091821 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f00040a33b0 0x7f00040a5870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f001c105180 tx=0x7f001000b410 comp rx=0 tx=0).ready entity=mgr.15093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:21:59.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.363+0000 7f00197fa640 1 -- 172.21.15.27:0/3740091821 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f000c014030 con 0x7f001c100e20 2024-09-19T08:21:59.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.539+0000 7f0022377640 1 -- 172.21.15.27:0/3740091821 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f001c1996f0 con 0x7f001c100e20 2024-09-19T08:21:59.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.943+0000 7f00197fa640 1 -- 172.21.15.27:0/3740091821 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v95) ==== 169+0+0 (secure 0 0 0) 0x7f000c09c850 con 0x7f001c100e20 2024-09-19T08:21:59.944 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' removed 2024-09-19T08:21:59.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.946+0000 7f0022377640 1 -- 172.21.15.27:0/3740091821 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f00040a33b0 msgr2=0x7f00040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:59.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.946+0000 7f0022377640 1 --2- 172.21.15.27:0/3740091821 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f00040a33b0 0x7f00040a5870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f001c105180 tx=0x7f001000b410 comp rx=0 tx=0).stop 2024-09-19T08:21:59.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.947+0000 7f0022377640 1 -- 172.21.15.27:0/3740091821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f001c100e20 msgr2=0x7f001c198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:21:59.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.947+0000 7f0022377640 1 --2- 172.21.15.27:0/3740091821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f001c100e20 0x7f001c198390 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f000c00c920 tx=0x7f000c00cde0 comp rx=0 tx=0).stop 2024-09-19T08:21:59.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.947+0000 7f0022377640 1 -- 172.21.15.27:0/3740091821 shutdown_connections 2024-09-19T08:21:59.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.947+0000 7f0022377640 1 --2- 172.21.15.27:0/3740091821 >> [v2:172.21.15.27:6800/1578338135,v1:172.21.15.27:6801/1578338135] conn(0x7f00040a33b0 0x7f00040a5870 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:59.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.947+0000 7f0022377640 1 --2- 172.21.15.27:0/3740091821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f001c102ef0 0x7f001c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:59.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.947+0000 7f0022377640 1 --2- 172.21.15.27:0/3740091821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f001c102570 0x7f001c1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:21:59.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.947+0000 7f0022377640 1 --2- 172.21.15.27:0/3740091821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f001c100e20 0x7f001c198390 secure :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f000c00c920 tx=0x7f000c00cde0 comp rx=0 tx=0).stop 2024-09-19T08:21:59.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.947+0000 7f0022377640 1 -- 172.21.15.27:0/3740091821 >> 172.21.15.27:0/3740091821 conn(0x7f001c0fc7d0 msgr2=0x7f001c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:21:59.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.948+0000 7f0022377640 1 -- 172.21.15.27:0/3740091821 shutdown_connections 2024-09-19T08:21:59.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-19T08:21:59.948+0000 7f0022377640 1 -- 172.21.15.27:0/3740091821 wait complete. 2024-09-19T08:22:00.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:21:59 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3740091821' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:22:00.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:21:59 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3740091821' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:22:00.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:21:59 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3740091821' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:22:00.752 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:22:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:22:00.364+0000 7f1a86428640 -1 client.15129: SimpleRADOSStriper: lock: snap_db_v0.db: lock failed: (2) No such file or directory 2024-09-19T08:22:00.752 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:22:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: 2024-09-19T08:22:00.365+0000 7f1a86428640 -1 client.15129: SimpleRADOSStriper: lock: snap_db_v0.db: lock failed: (2) No such file or directory 2024-09-19T08:22:00.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:22:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: Exception in thread Thread-15: 2024-09-19T08:22:00.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:22:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: Traceback (most recent call last): 2024-09-19T08:22:00.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:22:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib64/python3.9/threading.py", line 980, in _bootstrap_inner 2024-09-19T08:22:00.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:22:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: self.run() 2024-09-19T08:22:00.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:22:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/lib64/python3.9/threading.py", line 1306, in run 2024-09-19T08:22:00.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:22:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: self.function(*self.args, **self.kwargs) 2024-09-19T08:22:00.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:22:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: File "/usr/share/ceph/mgr/snap_schedule/fs/schedule_client.py", line 355, in create_scheduled_snapshot 2024-09-19T08:22:00.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:22:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: self.prune_snapshots(sched) 2024-09-19T08:22:00.753 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:22:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x[31437]: UnboundLocalError: local variable 'sched' referenced before assignment 2024-09-19T08:22:00.806 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:22:00.838 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:22:00.867 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:22:00.901 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T08:22:00.902 DEBUG:teuthology.orchestra.run.smithi027:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T08:22:00.920 DEBUG:teuthology.orchestra.run.smithi155:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T08:22:00.937 DEBUG:teuthology.orchestra.run.smithi203:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T08:22:00.960 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T08:22:00.960 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T08:22:00.961 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@mon.a 2024-09-19T08:22:01.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:22:00 smithi155 ceph-mon[35362]: pgmap v342: 65 pgs: 65 active+clean; 577 KiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:22:01.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:22:00 smithi155 ceph-mon[35362]: from='client.? 172.21.15.27:0/3740091821' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:22:01.237 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:22:00 smithi155 ceph-mon[35362]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T08:22:01.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:22:00 smithi027 ceph-mon[31209]: pgmap v342: 65 pgs: 65 active+clean; 577 KiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:22:01.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:22:00 smithi027 ceph-mon[31209]: from='client.? 172.21.15.27:0/3740091821' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:22:01.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:22:00 smithi027 ceph-mon[31209]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T08:22:01.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:22:01 smithi027 systemd[1]: Stopping Ceph mon.a for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:22:01.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:22:00 smithi203 ceph-mon[35198]: pgmap v342: 65 pgs: 65 active+clean; 577 KiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:22:01.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:22:00 smithi203 ceph-mon[35198]: from='client.? 172.21.15.27:0/3740091821' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:22:01.258 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:22:00 smithi203 ceph-mon[35198]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T08:22:01.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:22:01 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-a[31205]: 2024-09-19T08:22:01.278+0000 7fcda26b9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:22:01.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:22:01 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-a[31205]: 2024-09-19T08:22:01.278+0000 7fcda26b9640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T08:22:01.752 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:22:01 smithi027 podman[105023]: 2024-09-19 08:22:01.483840797 +0000 UTC m=+0.327062963 container died e1632427225ee992f26d1beeaafca2e1b19ae237bcea3faea757c52246f95f9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T08:22:02.098 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:22:01 smithi027 podman[105023]: 2024-09-19 08:22:01.860564842 +0000 UTC m=+0.703786999 container cleanup e1632427225ee992f26d1beeaafca2e1b19ae237bcea3faea757c52246f95f9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True) 2024-09-19T08:22:02.098 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:22:01 smithi027 bash[105023]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-a 2024-09-19T08:22:02.349 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T08:22:02.372 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:22:02 smithi027 podman[105036]: 2024-09-19 08:22:02.162632405 +0000 UTC m=+0.675176970 container remove e1632427225ee992f26d1beeaafca2e1b19ae237bcea3faea757c52246f95f9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True) 2024-09-19T08:22:02.373 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:22:02 smithi027 systemd[1]: ceph-35b531b0-765d-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T08:22:02.373 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:22:02 smithi027 systemd[1]: Stopped Ceph mon.a for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:22:02.373 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 19 08:22:02 smithi027 systemd[1]: ceph-35b531b0-765d-11ef-bceb-c7b262605968@mon.a.service: Consumed 20.231s CPU time. 2024-09-19T08:22:02.404 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:22:02.404 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T08:22:02.404 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T08:22:02.405 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@mon.b 2024-09-19T08:22:02.735 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:22:02 smithi155 systemd[1]: Stopping Ceph mon.b for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:22:02.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:22:02 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-b[35358]: 2024-09-19T08:22:02.734+0000 7fe313b0c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:22:02.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:22:02 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-b[35358]: 2024-09-19T08:22:02.734+0000 7fe313b0c640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T08:22:02.987 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:22:02 smithi155 podman[70879]: 2024-09-19 08:22:02.908457021 +0000 UTC m=+0.297793146 container died 5eee4da52791e89a80a4657be24183fed826111245e32506eaaec59b4c49388e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-b, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:22:03.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:22:03 smithi155 podman[70879]: 2024-09-19 08:22:03.310203366 +0000 UTC m=+0.699539490 container cleanup 5eee4da52791e89a80a4657be24183fed826111245e32506eaaec59b4c49388e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-b, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T08:22:03.487 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:22:03 smithi155 bash[70879]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-b 2024-09-19T08:22:03.737 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T08:22:03.788 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:22:03.788 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T08:22:03.788 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T08:22:03.788 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@mon.c 2024-09-19T08:22:04.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:22:03 smithi203 systemd[1]: Stopping Ceph mon.c for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:22:04.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:22:04 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-c[35194]: 2024-09-19T08:22:04.102+0000 7efc93d29640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:22:04.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:22:04 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-c[35194]: 2024-09-19T08:22:04.102+0000 7efc93d29640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T08:22:04.508 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:22:04 smithi203 podman[70842]: 2024-09-19 08:22:04.235973547 +0000 UTC m=+0.252210540 container died 0541a1fc7087a177c1c5ca6b4d9081e452993507af6875b6bfa59c1185e2e198 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-c, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:22:04.912 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:22:04 smithi203 podman[70842]: 2024-09-19 08:22:04.678119268 +0000 UTC m=+0.694356263 container cleanup 0541a1fc7087a177c1c5ca6b4d9081e452993507af6875b6bfa59c1185e2e198 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T08:22:04.913 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:22:04 smithi203 bash[70842]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-c 2024-09-19T08:22:05.150 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T08:22:05.173 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:22:04 smithi203 podman[70854]: 2024-09-19 08:22:04.913496166 +0000 UTC m=+0.669925735 container remove 0541a1fc7087a177c1c5ca6b4d9081e452993507af6875b6bfa59c1185e2e198 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mon-c, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T08:22:05.173 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:22:05 smithi203 systemd[1]: ceph-35b531b0-765d-11ef-bceb-c7b262605968@mon.c.service: Deactivated successfully. 2024-09-19T08:22:05.173 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:22:05 smithi203 systemd[1]: Stopped Ceph mon.c for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:22:05.173 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:22:05 smithi203 systemd[1]: ceph-35b531b0-765d-11ef-bceb-c7b262605968@mon.c.service: Consumed 12.253s CPU time. 2024-09-19T08:22:05.195 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:22:05.195 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T08:22:05.195 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T08:22:05.195 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@mgr.x 2024-09-19T08:22:05.502 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:22:05 smithi027 systemd[1]: Stopping Ceph mgr.x for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:22:05.917 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:22:05 smithi027 podman[105144]: 2024-09-19 08:22:05.597881247 +0000 UTC m=+0.204503736 container died 868aa2f80ed4ee162d66968b98919cd5261dad1286bf241ccdd276d6cbf8a2f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:22:06.252 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:22:06 smithi027 podman[105144]: 2024-09-19 08:22:06.118070761 +0000 UTC m=+0.724693464 container cleanup 868aa2f80ed4ee162d66968b98919cd5261dad1286bf241ccdd276d6cbf8a2f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T08:22:06.252 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:22:06 smithi027 bash[105144]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x 2024-09-19T08:22:06.607 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T08:22:06.630 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:22:06 smithi027 podman[105156]: 2024-09-19 08:22:06.361891043 +0000 UTC m=+0.757622526 container remove 868aa2f80ed4ee162d66968b98919cd5261dad1286bf241ccdd276d6cbf8a2f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-x, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T08:22:06.630 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:22:06 smithi027 systemd[1]: ceph-35b531b0-765d-11ef-bceb-c7b262605968@mgr.x.service: Deactivated successfully. 2024-09-19T08:22:06.630 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:22:06 smithi027 systemd[1]: Stopped Ceph mgr.x for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:22:06.630 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 19 08:22:06 smithi027 systemd[1]: ceph-35b531b0-765d-11ef-bceb-c7b262605968@mgr.x.service: Consumed 53.954s CPU time. 2024-09-19T08:22:06.643 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:22:06.643 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T08:22:06.643 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T08:22:06.643 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@mgr.y 2024-09-19T08:22:06.978 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:22:06 smithi155 systemd[1]: Stopping Ceph mgr.y for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:22:07.237 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:22:06 smithi155 podman[71001]: 2024-09-19 08:22:06.979371168 +0000 UTC m=+0.139602235 container died fdcbf3cd445650728dcbddb2563ae454b9c30f702c98f291f3cb12c376741a50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:22:07.624 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:22:07 smithi155 podman[71001]: 2024-09-19 08:22:07.348852728 +0000 UTC m=+0.509083793 container cleanup fdcbf3cd445650728dcbddb2563ae454b9c30f702c98f291f3cb12c376741a50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T08:22:07.625 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:22:07 smithi155 bash[71001]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-y 2024-09-19T08:22:07.774 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T08:22:07.809 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:22:07.809 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T08:22:07.809 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T08:22:07.809 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@mgr.z 2024-09-19T08:22:08.149 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:22:07 smithi203 systemd[1]: Stopping Ceph mgr.z for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:22:08.442 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:22:08 smithi203 podman[70961]: 2024-09-19 08:22:08.150068112 +0000 UTC m=+0.145163568 container died 8ba3e5d00917c80f6c05c23b6ae92e907fdc23267cd4dae8627d3fabeee024bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T08:22:08.761 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:22:08 smithi203 podman[70961]: 2024-09-19 08:22:08.551006051 +0000 UTC m=+0.546101506 container cleanup 8ba3e5d00917c80f6c05c23b6ae92e907fdc23267cd4dae8627d3fabeee024bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T08:22:08.761 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:22:08 smithi203 bash[70961]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-mgr-z 2024-09-19T08:22:08.980 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T08:22:09.016 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:22:09.016 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T08:22:09.016 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T08:22:09.016 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.0 2024-09-19T08:22:09.348 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:22:09 smithi027 systemd[1]: Stopping Ceph osd.0 for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:22:09.752 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:22:09 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-0[44813]: 2024-09-19T08:22:09.347+0000 7fa0cebdf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:22:09.752 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:22:09 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-0[44813]: 2024-09-19T08:22:09.347+0000 7fa0cebdf640 -1 osd.0 95 *** Got signal Terminated *** 2024-09-19T08:22:09.752 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:22:09 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-0[44813]: 2024-09-19T08:22:09.347+0000 7fa0cebdf640 -1 osd.0 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:22:15.002 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:22:14 smithi027 podman[105267]: 2024-09-19 08:22:14.668122482 +0000 UTC m=+5.440051866 container died 70bab8b2a5bc3900e369b500506bd6fd4127916c5150b3a40438c3fee081c1c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T08:22:15.502 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:22:15 smithi027 podman[105267]: 2024-09-19 08:22:15.265781286 +0000 UTC m=+6.037710670 container cleanup 70bab8b2a5bc3900e369b500506bd6fd4127916c5150b3a40438c3fee081c1c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T08:22:15.502 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:22:15 smithi027 bash[105267]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-0 2024-09-19T08:22:15.852 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:22:15 smithi027 podman[105282]: 2024-09-19 08:22:15.534182268 +0000 UTC m=+0.864533775 container remove 70bab8b2a5bc3900e369b500506bd6fd4127916c5150b3a40438c3fee081c1c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T08:22:16.113 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:22:15 smithi027 podman[105372]: 2024-09-19 08:22:15.755982257 +0000 UTC m=+0.016791856 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:22:16.113 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:22:15 smithi027 podman[105372]: 2024-09-19 08:22:15.993660836 +0000 UTC m=+0.254470427 container create c0553a9f7ea113f4d2813265eb954c17606586a2dd85e077ff1445ddeef9c7b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:22:16.433 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:22:16 smithi027 podman[105372]: 2024-09-19 08:22:16.238463825 +0000 UTC m=+0.499273424 container init c0553a9f7ea113f4d2813265eb954c17606586a2dd85e077ff1445ddeef9c7b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T08:22:16.434 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:22:16 smithi027 podman[105372]: 2024-09-19 08:22:16.242030839 +0000 UTC m=+0.502840438 container start c0553a9f7ea113f4d2813265eb954c17606586a2dd85e077ff1445ddeef9c7b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T08:22:16.434 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:22:16 smithi027 podman[105372]: 2024-09-19 08:22:16.338550956 +0000 UTC m=+0.599360582 container attach c0553a9f7ea113f4d2813265eb954c17606586a2dd85e077ff1445ddeef9c7b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:22:16.734 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 19 08:22:16 smithi027 podman[105372]: 2024-09-19 08:22:16.434688137 +0000 UTC m=+0.695497729 container died c0553a9f7ea113f4d2813265eb954c17606586a2dd85e077ff1445ddeef9c7b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T08:22:17.049 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T08:22:17.091 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:22:17.091 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T08:22:17.091 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T08:22:17.092 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.1 2024-09-19T08:22:17.411 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:22:17 smithi155 systemd[1]: Stopping Ceph osd.1 for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:22:17.737 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:22:17 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-1[39838]: 2024-09-19T08:22:17.411+0000 7fde105bb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:22:17.737 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:22:17 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-1[39838]: 2024-09-19T08:22:17.411+0000 7fde105bb640 -1 osd.1 95 *** Got signal Terminated *** 2024-09-19T08:22:17.737 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:22:17 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-1[39838]: 2024-09-19T08:22:17.411+0000 7fde105bb640 -1 osd.1 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:22:23.144 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:22:22 smithi155 podman[71122]: 2024-09-19 08:22:22.849040381 +0000 UTC m=+5.560449591 container died 143b21f5c7db9b10ee0ecae60d5d574f571279b32e5404de613422f92c5070f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:22:23.487 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:22:23 smithi155 podman[71122]: 2024-09-19 08:22:23.236664961 +0000 UTC m=+5.948074171 container cleanup 143b21f5c7db9b10ee0ecae60d5d574f571279b32e5404de613422f92c5070f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T08:22:23.487 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:22:23 smithi155 bash[71122]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-1 2024-09-19T08:22:23.802 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:22:23 smithi155 podman[71137]: 2024-09-19 08:22:23.488079103 +0000 UTC m=+0.637752078 container remove 143b21f5c7db9b10ee0ecae60d5d574f571279b32e5404de613422f92c5070f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T08:22:24.082 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:22:23 smithi155 podman[71225]: 2024-09-19 08:22:23.705871443 +0000 UTC m=+0.016058999 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:22:24.083 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:22:23 smithi155 podman[71225]: 2024-09-19 08:22:23.83932673 +0000 UTC m=+0.149514314 container create b24450ac8c1e264340f0a46ddb8b193f5f027590a4e4003bb367b8516aad4ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T08:22:24.083 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:22:24 smithi155 podman[71225]: 2024-09-19 08:22:24.083457736 +0000 UTC m=+0.393645277 container init b24450ac8c1e264340f0a46ddb8b193f5f027590a4e4003bb367b8516aad4ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:22:24.487 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:22:24 smithi155 podman[71225]: 2024-09-19 08:22:24.086951777 +0000 UTC m=+0.397139329 container start b24450ac8c1e264340f0a46ddb8b193f5f027590a4e4003bb367b8516aad4ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T08:22:24.487 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:22:24 smithi155 podman[71225]: 2024-09-19 08:22:24.192016441 +0000 UTC m=+0.502203999 container attach b24450ac8c1e264340f0a46ddb8b193f5f027590a4e4003bb367b8516aad4ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T08:22:24.487 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:22:24 smithi155 podman[71225]: 2024-09-19 08:22:24.277540423 +0000 UTC m=+0.587727980 container died b24450ac8c1e264340f0a46ddb8b193f5f027590a4e4003bb367b8516aad4ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T08:22:24.886 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T08:22:24.926 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:22:24.926 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T08:22:24.927 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T08:22:24.927 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.2 2024-09-19T08:22:25.258 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:22:24 smithi203 systemd[1]: Stopping Ceph osd.2 for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:22:25.524 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:22:25 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-2[40193]: 2024-09-19T08:22:25.315+0000 7f853a9bf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:22:25.524 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:22:25 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-2[40193]: 2024-09-19T08:22:25.315+0000 7f853a9bf640 -1 osd.2 95 *** Got signal Terminated *** 2024-09-19T08:22:25.524 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:22:25 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-2[40193]: 2024-09-19T08:22:25.315+0000 7f853a9bf640 -1 osd.2 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:22:31.092 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:22:30 smithi203 podman[71084]: 2024-09-19 08:22:30.78827613 +0000 UTC m=+5.664709575 container died d46f3b451cb0ee359fdb44287f832aa56ee2d8825d97a03bf3728d7f2d16c70d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T08:22:31.476 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:22:31 smithi203 podman[71084]: 2024-09-19 08:22:31.208370998 +0000 UTC m=+6.084804442 container cleanup d46f3b451cb0ee359fdb44287f832aa56ee2d8825d97a03bf3728d7f2d16c70d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T08:22:31.476 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:22:31 smithi203 bash[71084]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-2 2024-09-19T08:22:31.758 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:22:31 smithi203 podman[71112]: 2024-09-19 08:22:31.476759974 +0000 UTC m=+0.684545715 container remove d46f3b451cb0ee359fdb44287f832aa56ee2d8825d97a03bf3728d7f2d16c70d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T08:22:32.225 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:22:31 smithi203 podman[71199]: 2024-09-19 08:22:31.79475559 +0000 UTC m=+0.016407009 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:22:32.225 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:22:31 smithi203 podman[71199]: 2024-09-19 08:22:31.919628134 +0000 UTC m=+0.141279550 container create 1e0745ad8c113c13bfb6fc850dce9339cd7d3638bc7ac9f32a8e6f6e8c024408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T08:22:32.508 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:22:32 smithi203 podman[71199]: 2024-09-19 08:22:32.226224109 +0000 UTC m=+0.447875524 container init 1e0745ad8c113c13bfb6fc850dce9339cd7d3638bc7ac9f32a8e6f6e8c024408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T08:22:32.508 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:22:32 smithi203 podman[71199]: 2024-09-19 08:22:32.229702622 +0000 UTC m=+0.451354049 container start 1e0745ad8c113c13bfb6fc850dce9339cd7d3638bc7ac9f32a8e6f6e8c024408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T08:22:32.509 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:22:32 smithi203 podman[71199]: 2024-09-19 08:22:32.373249467 +0000 UTC m=+0.594900892 container attach 1e0745ad8c113c13bfb6fc850dce9339cd7d3638bc7ac9f32a8e6f6e8c024408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T08:22:32.509 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:22:32 smithi203 podman[71199]: 2024-09-19 08:22:32.417024808 +0000 UTC m=+0.638676227 container died 1e0745ad8c113c13bfb6fc850dce9339cd7d3638bc7ac9f32a8e6f6e8c024408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:22:33.144 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T08:22:33.186 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:22:33.186 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T08:22:33.186 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T08:22:33.186 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.3 2024-09-19T08:22:33.502 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 19 08:22:33 smithi027 systemd[1]: Stopping Ceph osd.3 for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:22:33.775 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 19 08:22:33 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-3[51684]: 2024-09-19T08:22:33.512+0000 7f2681486640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:22:33.776 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 19 08:22:33 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-3[51684]: 2024-09-19T08:22:33.512+0000 7f2681486640 -1 osd.3 95 *** Got signal Terminated *** 2024-09-19T08:22:33.776 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 19 08:22:33 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-3[51684]: 2024-09-19T08:22:33.512+0000 7f2681486640 -1 osd.3 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:22:36.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:35 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:35.794+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:36.258 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:35 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:35.770+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:37.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:36 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:36.788+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:37.258 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:36 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:36.796+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:37.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:37 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:37.778+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:37.987 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:37 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4[46700]: 2024-09-19T08:22:37.590+0000 7f81bc441640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.578296+0000 front 2024-09-19T08:22:12.578184+0000 (oldest deadline 2024-09-19T08:22:36.678223+0000) 2024-09-19T08:22:38.110 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:37 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:37.843+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:38.502 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 19 08:22:38 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-3[51684]: 2024-09-19T08:22:38.039+0000 7f2679a94640 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.058802+0000 front 2024-09-19T08:22:12.058771+0000 (oldest deadline 2024-09-19T08:22:37.959140+0000) 2024-09-19T08:22:38.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:38 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:38.110+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.797462+0000 front 2024-09-19T08:22:12.797474+0000 (oldest deadline 2024-09-19T08:22:38.097261+0000) 2024-09-19T08:22:38.987 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:38 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4[46700]: 2024-09-19T08:22:38.572+0000 7f81bc441640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.578296+0000 front 2024-09-19T08:22:12.578184+0000 (oldest deadline 2024-09-19T08:22:36.678223+0000) 2024-09-19T08:22:38.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:38 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:38.770+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:39.002 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 19 08:22:38 smithi027 podman[105475]: 2024-09-19 08:22:38.860850502 +0000 UTC m=+5.467836010 container died aa09c0a764dd6345716725966edff4beeae8a87177592ff11b472f8164718eae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T08:22:39.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:38 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:38.659+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:39.070 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:38 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:38.817+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:39.502 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 19 08:22:39 smithi027 podman[105475]: 2024-09-19 08:22:39.287724202 +0000 UTC m=+5.894709711 container cleanup aa09c0a764dd6345716725966edff4beeae8a87177592ff11b472f8164718eae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T08:22:39.502 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 19 08:22:39 smithi027 bash[105475]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-3 2024-09-19T08:22:39.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:39 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:39.069+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.797462+0000 front 2024-09-19T08:22:12.797474+0000 (oldest deadline 2024-09-19T08:22:38.097261+0000) 2024-09-19T08:22:39.964 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 19 08:22:39 smithi027 podman[105504]: 2024-09-19 08:22:39.522775312 +0000 UTC m=+0.656870099 container remove aa09c0a764dd6345716725966edff4beeae8a87177592ff11b472f8164718eae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T08:22:39.964 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:39 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:39.673+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:39.964 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:39 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:39.576+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:22:39.987 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:39 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4[46700]: 2024-09-19T08:22:39.586+0000 7f81bc441640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.578296+0000 front 2024-09-19T08:22:12.578184+0000 (oldest deadline 2024-09-19T08:22:36.678223+0000) 2024-09-19T08:22:39.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:39 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:39.800+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:40.104 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:39 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:39.780+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:40.217 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 19 08:22:39 smithi027 podman[105591]: 2024-09-19 08:22:39.867549614 +0000 UTC m=+0.016826955 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:22:40.217 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 19 08:22:39 smithi027 podman[105591]: 2024-09-19 08:22:39.965207033 +0000 UTC m=+0.114484358 container create 9d148ea91074414bfa2dbcbd16fcc8d1a9af7daef7348a0209af70c9ad2af341 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T08:22:40.217 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 19 08:22:40 smithi027 podman[105591]: 2024-09-19 08:22:40.218357759 +0000 UTC m=+0.367635094 container init 9d148ea91074414bfa2dbcbd16fcc8d1a9af7daef7348a0209af70c9ad2af341 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T08:22:40.502 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 19 08:22:40 smithi027 podman[105591]: 2024-09-19 08:22:40.221867045 +0000 UTC m=+0.371144373 container start 9d148ea91074414bfa2dbcbd16fcc8d1a9af7daef7348a0209af70c9ad2af341 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:22:40.502 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 19 08:22:40 smithi027 podman[105591]: 2024-09-19 08:22:40.326893399 +0000 UTC m=+0.476170740 container attach 9d148ea91074414bfa2dbcbd16fcc8d1a9af7daef7348a0209af70c9ad2af341 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T08:22:40.502 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 19 08:22:40 smithi027 podman[105591]: 2024-09-19 08:22:40.416832807 +0000 UTC m=+0.566110133 container died 9d148ea91074414bfa2dbcbd16fcc8d1a9af7daef7348a0209af70c9ad2af341 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T08:22:40.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:40 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:40.104+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.797462+0000 front 2024-09-19T08:22:12.797474+0000 (oldest deadline 2024-09-19T08:22:38.097261+0000) 2024-09-19T08:22:40.987 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:40 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4[46700]: 2024-09-19T08:22:40.557+0000 7f81bc441640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.578296+0000 front 2024-09-19T08:22:12.578184+0000 (oldest deadline 2024-09-19T08:22:36.678223+0000) 2024-09-19T08:22:40.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:40 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:40.789+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:41.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:40 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:40.671+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:41.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:40 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:40.621+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:22:41.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:40 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:40.757+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:41.052 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T08:22:41.096 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:22:41.096 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T08:22:41.096 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T08:22:41.096 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.4 2024-09-19T08:22:41.487 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:41 smithi155 systemd[1]: Stopping Ceph osd.4 for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:22:41.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:41 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:41.087+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.797462+0000 front 2024-09-19T08:22:12.797474+0000 (oldest deadline 2024-09-19T08:22:38.097261+0000) 2024-09-19T08:22:41.797 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:41 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4[46700]: 2024-09-19T08:22:41.514+0000 7f81c3e33640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:22:41.797 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:41 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4[46700]: 2024-09-19T08:22:41.514+0000 7f81c3e33640 -1 osd.4 95 *** Got signal Terminated *** 2024-09-19T08:22:41.797 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:41 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4[46700]: 2024-09-19T08:22:41.514+0000 7f81c3e33640 -1 osd.4 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:22:41.798 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:41 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4[46700]: 2024-09-19T08:22:41.578+0000 7f81bc441640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.578296+0000 front 2024-09-19T08:22:12.578184+0000 (oldest deadline 2024-09-19T08:22:36.678223+0000) 2024-09-19T08:22:42.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:41 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:41.661+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:42.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:41 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:41.614+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:22:42.082 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:41 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:41.786+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:42.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:41 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:41.796+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:42.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:42 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:42.082+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.797462+0000 front 2024-09-19T08:22:12.797474+0000 (oldest deadline 2024-09-19T08:22:38.097261+0000) 2024-09-19T08:22:42.809 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:42 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4[46700]: 2024-09-19T08:22:42.549+0000 7f81bc441640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.578296+0000 front 2024-09-19T08:22:12.578184+0000 (oldest deadline 2024-09-19T08:22:36.678223+0000) 2024-09-19T08:22:43.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:42 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:42.697+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:43.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:42 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:42.605+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:22:43.072 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:42 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:42.787+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:43.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:42 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:42.808+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:43.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:43 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:43.071+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.797462+0000 front 2024-09-19T08:22:12.797474+0000 (oldest deadline 2024-09-19T08:22:38.097261+0000) 2024-09-19T08:22:43.831 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:43 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4[46700]: 2024-09-19T08:22:43.566+0000 7f81bc441640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.578296+0000 front 2024-09-19T08:22:12.578184+0000 (oldest deadline 2024-09-19T08:22:36.678223+0000) 2024-09-19T08:22:44.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:43 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:43.672+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:44.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:43 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:43.672+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.343321+0000 front 2024-09-19T08:22:20.343226+0000 (oldest deadline 2024-09-19T08:22:43.243350+0000) 2024-09-19T08:22:44.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:43 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:43.655+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:22:44.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:43 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:43.655+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:22:44.076 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:43 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:43.765+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:44.076 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:43 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:43.765+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:22:44.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:43 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:43.831+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:44.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:44 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:44.076+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.797462+0000 front 2024-09-19T08:22:12.797474+0000 (oldest deadline 2024-09-19T08:22:38.097261+0000) 2024-09-19T08:22:44.987 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:44 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4[46700]: 2024-09-19T08:22:44.600+0000 7f81bc441640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.578296+0000 front 2024-09-19T08:22:12.578184+0000 (oldest deadline 2024-09-19T08:22:36.678223+0000) 2024-09-19T08:22:44.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:44 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:44.833+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:45.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:44 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:44.672+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:45.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:44 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:44.672+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.343321+0000 front 2024-09-19T08:22:20.343226+0000 (oldest deadline 2024-09-19T08:22:43.243350+0000) 2024-09-19T08:22:45.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:44 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:44.698+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:22:45.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:44 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:44.698+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:22:45.058 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:44 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:44.800+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:45.058 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:44 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:44.800+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:22:45.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:45 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:45.058+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.797462+0000 front 2024-09-19T08:22:12.797474+0000 (oldest deadline 2024-09-19T08:22:38.097261+0000) 2024-09-19T08:22:45.987 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:45 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4[46700]: 2024-09-19T08:22:45.583+0000 7f81bc441640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.578296+0000 front 2024-09-19T08:22:12.578184+0000 (oldest deadline 2024-09-19T08:22:36.678223+0000) 2024-09-19T08:22:45.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:45 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:45.762+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:22:45.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:45 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:45.798+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:46.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:45 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:45.657+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:22:46.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:45 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:45.657+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:22:46.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:45 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:45.646+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:46.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:45 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:45.646+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.343321+0000 front 2024-09-19T08:22:20.343226+0000 (oldest deadline 2024-09-19T08:22:43.243350+0000) 2024-09-19T08:22:46.007 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:45 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:45.753+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:46.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:45 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:45.753+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:22:46.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:46 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:46.092+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.797462+0000 front 2024-09-19T08:22:12.797474+0000 (oldest deadline 2024-09-19T08:22:38.097261+0000) 2024-09-19T08:22:46.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:46 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:46.092+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.998229+0000 front 2024-09-19T08:22:20.998376+0000 (oldest deadline 2024-09-19T08:22:45.598732+0000) 2024-09-19T08:22:47.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:46 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:46.650+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:47.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:46 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:46.650+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.343321+0000 front 2024-09-19T08:22:20.343226+0000 (oldest deadline 2024-09-19T08:22:43.243350+0000) 2024-09-19T08:22:47.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:46 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:46.609+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:22:47.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:46 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:46.609+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:22:47.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:46 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:46.722+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:47.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:46 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:46.722+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:22:47.048 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:46 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:46.770+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:22:47.048 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:46 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:46.783+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:47.349 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:47 smithi155 podman[71340]: 2024-09-19 08:22:47.048794482 +0000 UTC m=+5.749297549 container died a245360cc30d4b2ca161339e171eab772adcac78b8302d37ab0905c2134dc1b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T08:22:47.508 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:47 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:47.316+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:22:47.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:47 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:47.134+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.797462+0000 front 2024-09-19T08:22:12.797474+0000 (oldest deadline 2024-09-19T08:22:38.097261+0000) 2024-09-19T08:22:47.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:47 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:47.134+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.998229+0000 front 2024-09-19T08:22:20.998376+0000 (oldest deadline 2024-09-19T08:22:45.598732+0000) 2024-09-19T08:22:47.691 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:47 smithi155 podman[71340]: 2024-09-19 08:22:47.45702189 +0000 UTC m=+6.157524946 container cleanup a245360cc30d4b2ca161339e171eab772adcac78b8302d37ab0905c2134dc1b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:22:47.691 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:47 smithi155 bash[71340]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4 2024-09-19T08:22:47.987 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:47 smithi155 podman[71358]: 2024-09-19 08:22:47.691699061 +0000 UTC m=+0.637156134 container remove a245360cc30d4b2ca161339e171eab772adcac78b8302d37ab0905c2134dc1b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T08:22:47.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:47 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:47.747+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:22:47.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:47 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:47.832+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:47.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:47 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:47.832+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:22:48.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:47 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:47.592+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:22:48.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:47 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:47.592+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:22:48.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:47 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:47.630+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:48.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:47 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:47.630+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.343321+0000 front 2024-09-19T08:22:20.343226+0000 (oldest deadline 2024-09-19T08:22:43.243350+0000) 2024-09-19T08:22:48.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:47 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:47.708+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:48.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:47 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:47.708+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:22:48.294 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:48 smithi155 podman[71447]: 2024-09-19 08:22:47.906560908 +0000 UTC m=+0.015702044 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:22:48.295 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:48 smithi155 podman[71447]: 2024-09-19 08:22:48.026035301 +0000 UTC m=+0.135176418 container create 102aa0ad5b2e9c3eece0f9f00cec4884c552310415d13b0f079d3dba3866e441 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T08:22:48.508 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:48 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:48.289+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:22:48.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:48 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:48.109+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.797462+0000 front 2024-09-19T08:22:12.797474+0000 (oldest deadline 2024-09-19T08:22:38.097261+0000) 2024-09-19T08:22:48.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:48 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:48.109+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.998229+0000 front 2024-09-19T08:22:20.998376+0000 (oldest deadline 2024-09-19T08:22:45.598732+0000) 2024-09-19T08:22:48.716 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:48 smithi155 podman[71447]: 2024-09-19 08:22:48.295510682 +0000 UTC m=+0.404651807 container init 102aa0ad5b2e9c3eece0f9f00cec4884c552310415d13b0f079d3dba3866e441 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T08:22:48.717 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:48 smithi155 podman[71447]: 2024-09-19 08:22:48.299042373 +0000 UTC m=+0.408183500 container start 102aa0ad5b2e9c3eece0f9f00cec4884c552310415d13b0f079d3dba3866e441 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:22:48.717 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:48 smithi155 podman[71447]: 2024-09-19 08:22:48.403838925 +0000 UTC m=+0.512980053 container attach 102aa0ad5b2e9c3eece0f9f00cec4884c552310415d13b0f079d3dba3866e441 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:22:48.717 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:22:48 smithi155 podman[71447]: 2024-09-19 08:22:48.484087428 +0000 UTC m=+0.593228547 container died 102aa0ad5b2e9c3eece0f9f00cec4884c552310415d13b0f079d3dba3866e441 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T08:22:48.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:48 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:48.716+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:22:48.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:48 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:48.864+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:48.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:48 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:48.864+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:22:49.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:48 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:48.614+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:22:49.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:48 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:48.614+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:22:49.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:48 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:48.586+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:49.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:48 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:48.586+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.343321+0000 front 2024-09-19T08:22:20.343226+0000 (oldest deadline 2024-09-19T08:22:43.243350+0000) 2024-09-19T08:22:49.007 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:48 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:48.691+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:49.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:48 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:48.691+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:22:49.135 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T08:22:49.174 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:22:49.174 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T08:22:49.174 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T08:22:49.174 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.5 2024-09-19T08:22:49.497 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:49 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:49.245+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:22:49.497 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:49 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:49.109+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.797462+0000 front 2024-09-19T08:22:12.797474+0000 (oldest deadline 2024-09-19T08:22:38.097261+0000) 2024-09-19T08:22:49.497 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:49 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:49.109+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.998229+0000 front 2024-09-19T08:22:20.998376+0000 (oldest deadline 2024-09-19T08:22:45.598732+0000) 2024-09-19T08:22:49.497 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:49 smithi203 systemd[1]: Stopping Ceph osd.5 for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:22:49.497 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:49 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:49.497+0000 7f05c3e57640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:22:49.497 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:49 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:49.497+0000 7f05c3e57640 -1 osd.5 95 *** Got signal Terminated *** 2024-09-19T08:22:49.498 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:49 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:49.497+0000 7f05c3e57640 -1 osd.5 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:22:49.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:49 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:49.665+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:49.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:49 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:49.665+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:22:50.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:49 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:49.642+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:22:50.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:49 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:49.642+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:22:50.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:49 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:49.543+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:50.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:49 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:49.543+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.343321+0000 front 2024-09-19T08:22:20.343226+0000 (oldest deadline 2024-09-19T08:22:43.243350+0000) 2024-09-19T08:22:50.237 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:49 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:49.760+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:22:50.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:49 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:49.827+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:50.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:49 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:49.827+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:22:50.508 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:50 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:50.282+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:22:50.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:50 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:50.146+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.797462+0000 front 2024-09-19T08:22:12.797474+0000 (oldest deadline 2024-09-19T08:22:38.097261+0000) 2024-09-19T08:22:50.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:50 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:50.146+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.998229+0000 front 2024-09-19T08:22:20.998376+0000 (oldest deadline 2024-09-19T08:22:45.598732+0000) 2024-09-19T08:22:51.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:50.609+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:22:51.027 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:50.609+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:22:51.027 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:50.567+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:51.027 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:50.567+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.343321+0000 front 2024-09-19T08:22:20.343226+0000 (oldest deadline 2024-09-19T08:22:43.243350+0000) 2024-09-19T08:22:51.028 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:50 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:50.623+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:51.028 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:50 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:50.623+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:22:51.237 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:50 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:50.768+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:22:51.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:50 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:50.805+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:51.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:50 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:50.805+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:22:51.508 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:51 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:51.312+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:22:51.508 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:51 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:51.312+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:22:51.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:51 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:51.106+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.797462+0000 front 2024-09-19T08:22:12.797474+0000 (oldest deadline 2024-09-19T08:22:38.097261+0000) 2024-09-19T08:22:51.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:51 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:51.106+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.998229+0000 front 2024-09-19T08:22:20.998376+0000 (oldest deadline 2024-09-19T08:22:45.598732+0000) 2024-09-19T08:22:51.509 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:51 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:51.106+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.599032+0000 front 2024-09-19T08:22:25.599177+0000 (oldest deadline 2024-09-19T08:22:50.899223+0000) 2024-09-19T08:22:52.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:51 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:51.574+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:22:52.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:51 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:51.574+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:22:52.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:51 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:51.574+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:52.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:51 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:51.574+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.343321+0000 front 2024-09-19T08:22:20.343226+0000 (oldest deadline 2024-09-19T08:22:43.243350+0000) 2024-09-19T08:22:52.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:51 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:51.672+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:52.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:51 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:51.672+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:22:52.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:51 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:51.672+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:22:52.237 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:51 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:51.756+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:22:52.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:51 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:51.767+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:52.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:51 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:51.767+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:22:52.508 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:52 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:52.343+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:22:52.508 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:52 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:52.343+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:22:52.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:52 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:52.128+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.797462+0000 front 2024-09-19T08:22:12.797474+0000 (oldest deadline 2024-09-19T08:22:38.097261+0000) 2024-09-19T08:22:52.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:52 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:52.128+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.998229+0000 front 2024-09-19T08:22:20.998376+0000 (oldest deadline 2024-09-19T08:22:45.598732+0000) 2024-09-19T08:22:52.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:52 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:52.128+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.599032+0000 front 2024-09-19T08:22:25.599177+0000 (oldest deadline 2024-09-19T08:22:50.899223+0000) 2024-09-19T08:22:53.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:52 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:52.599+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:22:53.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:52 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:52.599+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:22:53.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:52 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:52.560+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:53.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:52 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:52.560+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.343321+0000 front 2024-09-19T08:22:20.343226+0000 (oldest deadline 2024-09-19T08:22:43.243350+0000) 2024-09-19T08:22:53.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:52 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:52.678+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:53.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:52 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:52.679+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:22:53.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:52 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:52.679+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:22:53.237 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:52 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:52.779+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:22:53.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:52 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:52.770+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:53.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:52 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:52.770+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:22:53.508 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:53 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:53.364+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:22:53.508 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:53 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:53.364+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:22:53.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:53 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:53.153+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.797462+0000 front 2024-09-19T08:22:12.797474+0000 (oldest deadline 2024-09-19T08:22:38.097261+0000) 2024-09-19T08:22:53.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:53 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:53.153+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.998229+0000 front 2024-09-19T08:22:20.998376+0000 (oldest deadline 2024-09-19T08:22:45.598732+0000) 2024-09-19T08:22:53.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:53 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:53.153+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.599032+0000 front 2024-09-19T08:22:25.599177+0000 (oldest deadline 2024-09-19T08:22:50.899223+0000) 2024-09-19T08:22:54.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:53.634+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:22:54.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:53.634+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:22:54.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:53.579+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:54.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:53.579+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.343321+0000 front 2024-09-19T08:22:20.343226+0000 (oldest deadline 2024-09-19T08:22:43.243350+0000) 2024-09-19T08:22:54.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:53 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:53.579+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:30.245234+0000 front 2024-09-19T08:22:30.245143+0000 (oldest deadline 2024-09-19T08:22:53.145158+0000) 2024-09-19T08:22:54.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:53 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:53.693+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:54.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:53 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:53.693+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:22:54.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:53 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:53.693+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:22:54.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:53 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:53.815+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:54.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:53 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:53.815+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:22:54.238 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:53 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:53.778+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:22:54.508 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:54 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:54.341+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:22:54.508 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:54 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:54.341+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:22:54.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:54 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:54.195+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.797462+0000 front 2024-09-19T08:22:12.797474+0000 (oldest deadline 2024-09-19T08:22:38.097261+0000) 2024-09-19T08:22:54.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:54 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:54.195+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.998229+0000 front 2024-09-19T08:22:20.998376+0000 (oldest deadline 2024-09-19T08:22:45.598732+0000) 2024-09-19T08:22:54.508 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:54 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5[46927]: 2024-09-19T08:22:54.195+0000 7f05bc465640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.599032+0000 front 2024-09-19T08:22:25.599177+0000 (oldest deadline 2024-09-19T08:22:50.899223+0000) 2024-09-19T08:22:55.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:54 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:54.593+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:55.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:54 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:54.593+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.343321+0000 front 2024-09-19T08:22:20.343226+0000 (oldest deadline 2024-09-19T08:22:43.243350+0000) 2024-09-19T08:22:55.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:54 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:54.593+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:30.245234+0000 front 2024-09-19T08:22:30.245143+0000 (oldest deadline 2024-09-19T08:22:53.145158+0000) 2024-09-19T08:22:55.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:54 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:54.601+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:22:55.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:54 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:54.601+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:22:55.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:54 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:54.601+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:22:55.008 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:54 smithi203 podman[71302]: 2024-09-19 08:22:54.846915898 +0000 UTC m=+5.477638489 container died d0732610ef171efb991569e315a8225531d6fcf0b1892313e9e573d5dde48272 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T08:22:55.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:54 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:54.699+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:55.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:54 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:54.699+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:22:55.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:54 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:54.699+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:22:55.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:54 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:54.849+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:55.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:54 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:54.849+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:22:55.237 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:54 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:54.775+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:22:55.237 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:54 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:54.775+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:29.283545+0000 front 2024-09-19T08:22:29.283594+0000 (oldest deadline 2024-09-19T08:22:54.583511+0000) 2024-09-19T08:22:55.615 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:55 smithi203 podman[71302]: 2024-09-19 08:22:55.297733685 +0000 UTC m=+5.928456276 container cleanup d0732610ef171efb991569e315a8225531d6fcf0b1892313e9e573d5dde48272 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T08:22:55.616 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:55 smithi203 bash[71302]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5 2024-09-19T08:22:55.616 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:55 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:55.314+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:22:55.616 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:55 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:55.314+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:22:55.970 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:55 smithi203 podman[71318]: 2024-09-19 08:22:55.616351787 +0000 UTC m=+0.766646084 container remove d0732610ef171efb991569e315a8225531d6fcf0b1892313e9e573d5dde48272 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T08:22:55.971 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:55 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:55.707+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:55.971 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:55 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:55.707+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:22:55.971 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:55 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:55.707+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:22:56.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:55 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:55.571+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:56.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:55 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:55.571+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.343321+0000 front 2024-09-19T08:22:20.343226+0000 (oldest deadline 2024-09-19T08:22:43.243350+0000) 2024-09-19T08:22:56.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:55 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:55.571+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:30.245234+0000 front 2024-09-19T08:22:30.245143+0000 (oldest deadline 2024-09-19T08:22:53.145158+0000) 2024-09-19T08:22:56.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:55 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:55.645+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:22:56.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:55 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:55.645+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:22:56.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:55 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:55.645+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:22:56.237 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:55 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:55.778+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:22:56.237 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:55 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:55.778+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:29.283545+0000 front 2024-09-19T08:22:29.283594+0000 (oldest deadline 2024-09-19T08:22:54.583511+0000) 2024-09-19T08:22:56.238 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:55 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:55.853+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:56.238 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:55 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:55.853+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:22:56.238 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:55 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:55.853+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:22:56.258 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:55 smithi203 podman[71405]: 2024-09-19 08:22:55.874038138 +0000 UTC m=+0.015715050 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:22:56.258 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:56 smithi203 podman[71405]: 2024-09-19 08:22:56.041215785 +0000 UTC m=+0.182892686 container create 9e9a8fb9e07ee294714ab1fee04c09811c1a39b8567641d20256943d0a3162a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T08:22:56.726 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:56 smithi203 podman[71405]: 2024-09-19 08:22:56.303863284 +0000 UTC m=+0.445540191 container init 9e9a8fb9e07ee294714ab1fee04c09811c1a39b8567641d20256943d0a3162a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T08:22:56.726 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:56 smithi203 podman[71405]: 2024-09-19 08:22:56.307168926 +0000 UTC m=+0.448845830 container start 9e9a8fb9e07ee294714ab1fee04c09811c1a39b8567641d20256943d0a3162a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T08:22:56.726 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:56 smithi203 podman[71405]: 2024-09-19 08:22:56.403775039 +0000 UTC m=+0.545451941 container attach 9e9a8fb9e07ee294714ab1fee04c09811c1a39b8567641d20256943d0a3162a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T08:22:56.726 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:22:56 smithi203 podman[71405]: 2024-09-19 08:22:56.493485809 +0000 UTC m=+0.635162720 container died 9e9a8fb9e07ee294714ab1fee04c09811c1a39b8567641d20256943d0a3162a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T08:22:56.726 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:56 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:56.299+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:22:56.726 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:56 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:56.299+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:22:56.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:56 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:56.736+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:22:56.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:56 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:56.736+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:29.283545+0000 front 2024-09-19T08:22:29.283594+0000 (oldest deadline 2024-09-19T08:22:54.583511+0000) 2024-09-19T08:22:56.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:56 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:56.830+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:56.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:56 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:56.830+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:22:56.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:56 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:56.830+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:22:57.001 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:56 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:56.583+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:57.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:56 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:56.583+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.343321+0000 front 2024-09-19T08:22:20.343226+0000 (oldest deadline 2024-09-19T08:22:43.243350+0000) 2024-09-19T08:22:57.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:56 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:56.583+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:30.245234+0000 front 2024-09-19T08:22:30.245143+0000 (oldest deadline 2024-09-19T08:22:53.145158+0000) 2024-09-19T08:22:57.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:56 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:56.678+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:22:57.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:56 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:56.678+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:22:57.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:56 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:56.678+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:22:57.007 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:56 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:56.725+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:57.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:56 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:56.725+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:22:57.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:56 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:56.725+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:22:57.160 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T08:22:57.199 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:22:57.199 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T08:22:57.199 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T08:22:57.199 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.6 2024-09-19T08:22:57.502 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:57 smithi027 systemd[1]: Stopping Ceph osd.6 for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:22:57.508 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:57 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:57.347+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:22:57.508 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:57 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:57.347+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:22:57.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:57 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:57.719+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:22:57.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:57 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:57.719+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:29.283545+0000 front 2024-09-19T08:22:29.283594+0000 (oldest deadline 2024-09-19T08:22:54.583511+0000) 2024-09-19T08:22:57.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:57 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:57.826+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:57.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:57 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:57.826+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:22:57.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:57 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:57.826+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:22:58.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:57 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:57.661+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:22:58.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:57 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:57.661+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:22:58.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:57 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:57.661+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:22:58.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:57 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:57.530+0000 7fd490a8d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:22:58.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:57 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:57.530+0000 7fd490a8d640 -1 osd.6 95 *** Got signal Terminated *** 2024-09-19T08:22:58.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:57 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:57.530+0000 7fd490a8d640 -1 osd.6 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:22:58.003 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:57 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:57.553+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:58.003 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:57 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:57.553+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.343321+0000 front 2024-09-19T08:22:20.343226+0000 (oldest deadline 2024-09-19T08:22:43.243350+0000) 2024-09-19T08:22:58.003 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:57 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:57.553+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:30.245234+0000 front 2024-09-19T08:22:30.245143+0000 (oldest deadline 2024-09-19T08:22:53.145158+0000) 2024-09-19T08:22:58.007 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:57 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:57.702+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:58.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:57 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:57.702+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:22:58.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:57 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:57.702+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:22:58.725 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:58 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:58.326+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:22:58.725 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:58 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:58.326+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:22:58.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:58 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:58.735+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:22:58.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:58 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:58.735+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:29.283545+0000 front 2024-09-19T08:22:29.283594+0000 (oldest deadline 2024-09-19T08:22:54.583511+0000) 2024-09-19T08:22:58.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:58 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:58.784+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:58.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:58 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:58.784+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:22:58.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:58 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:58.784+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:22:59.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:58 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:58.543+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:22:59.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:58 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:58.543+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.343321+0000 front 2024-09-19T08:22:20.343226+0000 (oldest deadline 2024-09-19T08:22:43.243350+0000) 2024-09-19T08:22:59.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:58 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:58.543+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:30.245234+0000 front 2024-09-19T08:22:30.245143+0000 (oldest deadline 2024-09-19T08:22:53.145158+0000) 2024-09-19T08:22:59.003 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:58 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:58.655+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:22:59.003 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:58 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:58.655+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:22:59.003 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:58 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:58.655+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:22:59.007 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:58 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:58.725+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:22:59.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:58 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:58.725+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:22:59.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:58 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:58.725+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:22:59.697 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:59 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:59.297+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:22:59.697 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:59 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:59.297+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:22:59.697 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:22:59 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:22:59.297+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:38.440104+0000 front 2024-09-19T08:22:38.440200+0000 (oldest deadline 2024-09-19T08:22:58.939880+0000) 2024-09-19T08:22:59.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:59 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:59.723+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:22:59.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:59 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:59.723+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:29.283545+0000 front 2024-09-19T08:22:29.283594+0000 (oldest deadline 2024-09-19T08:22:54.583511+0000) 2024-09-19T08:22:59.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:22:59 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:22:59.723+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.684471+0000 front 2024-09-19T08:22:35.684550+0000 (oldest deadline 2024-09-19T08:22:59.184585+0000) 2024-09-19T08:22:59.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:59 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:59.806+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:22:59.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:59 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:59.806+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:22:59.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:22:59 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:22:59.806+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:00.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:59 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:59.506+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:23:00.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:59 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:59.506+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.343321+0000 front 2024-09-19T08:22:20.343226+0000 (oldest deadline 2024-09-19T08:22:43.243350+0000) 2024-09-19T08:23:00.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:22:59 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:22:59.506+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:30.245234+0000 front 2024-09-19T08:22:30.245143+0000 (oldest deadline 2024-09-19T08:22:53.145158+0000) 2024-09-19T08:23:00.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:59 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:59.703+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:00.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:59 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:59.703+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:00.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:59 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:59.703+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:00.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:22:59 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:22:59.703+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:00.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:59 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:59.697+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:00.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:59 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:59.697+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:00.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:22:59 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:22:59.697+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:00.728 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:00 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:00.329+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:23:00.728 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:00 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:00.329+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:23:00.728 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:00 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:00.329+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:38.440104+0000 front 2024-09-19T08:22:38.440200+0000 (oldest deadline 2024-09-19T08:22:58.939880+0000) 2024-09-19T08:23:00.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:00 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:00.729+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:23:00.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:00 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:00.729+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:29.283545+0000 front 2024-09-19T08:22:29.283594+0000 (oldest deadline 2024-09-19T08:22:54.583511+0000) 2024-09-19T08:23:00.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:00 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:00.729+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.684471+0000 front 2024-09-19T08:22:35.684550+0000 (oldest deadline 2024-09-19T08:22:59.184585+0000) 2024-09-19T08:23:00.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:00 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:00.798+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:00.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:00 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:00.798+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:00.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:00 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:00.798+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:00.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:00 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:00.798+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:01.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:23:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:23:00.507+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:23:01.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:23:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:23:00.507+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.343321+0000 front 2024-09-19T08:22:20.343226+0000 (oldest deadline 2024-09-19T08:22:43.243350+0000) 2024-09-19T08:23:01.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:23:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:23:00.507+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:30.245234+0000 front 2024-09-19T08:22:30.245143+0000 (oldest deadline 2024-09-19T08:22:53.145158+0000) 2024-09-19T08:23:01.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:00.722+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:01.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:00.722+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:01.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:00.722+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:01.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:00 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:00.722+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:01.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:00 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:00.728+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:01.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:00 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:00.728+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:01.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:00 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:00.728+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:01.756 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:01 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:01.369+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:23:01.756 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:01 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:01.369+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:23:01.756 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:01 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:01.369+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:38.440104+0000 front 2024-09-19T08:22:38.440200+0000 (oldest deadline 2024-09-19T08:22:58.939880+0000) 2024-09-19T08:23:01.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:01 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:01.707+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:23:01.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:01 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:01.707+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:29.283545+0000 front 2024-09-19T08:22:29.283594+0000 (oldest deadline 2024-09-19T08:22:54.583511+0000) 2024-09-19T08:23:01.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:01 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:01.707+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.684471+0000 front 2024-09-19T08:22:35.684550+0000 (oldest deadline 2024-09-19T08:22:59.184585+0000) 2024-09-19T08:23:01.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:01 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:01.792+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:01.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:01 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:01.792+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:01.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:01 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:01.792+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:01.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:01 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:01.792+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:02.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:23:01 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:23:01.516+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:12.741733+0000 front 2024-09-19T08:22:12.741793+0000 (oldest deadline 2024-09-19T08:22:38.641947+0000) 2024-09-19T08:23:02.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:23:01 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:23:01.516+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.343321+0000 front 2024-09-19T08:22:20.343226+0000 (oldest deadline 2024-09-19T08:22:43.243350+0000) 2024-09-19T08:23:02.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:23:01 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6[58162]: 2024-09-19T08:23:01.516+0000 7fd48d0a3640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:30.245234+0000 front 2024-09-19T08:22:30.245143+0000 (oldest deadline 2024-09-19T08:22:53.145158+0000) 2024-09-19T08:23:02.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:01 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:01.757+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:02.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:01 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:01.757+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:02.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:01 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:01.757+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:02.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:01 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:01.757+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:02.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:01 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:01.756+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:02.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:01 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:01.756+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:02.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:01 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:01.756+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:02.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:01 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:01.756+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:02.758 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:02 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:02.371+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:23:02.758 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:02 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:02.371+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:23:02.758 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:02 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:02.371+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:38.440104+0000 front 2024-09-19T08:22:38.440200+0000 (oldest deadline 2024-09-19T08:22:58.939880+0000) 2024-09-19T08:23:03.002 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:23:02 smithi027 podman[105690]: 2024-09-19 08:23:02.855534801 +0000 UTC m=+5.456307440 container died b646494ce1c41565a6ed3ee96c67946867a61132585db020ed0b47493f623403 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T08:23:03.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:02 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:02.725+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:03.003 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:02 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:02.725+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:03.003 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:02 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:02.725+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:03.003 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:02 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:02.725+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:03.237 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:02 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:02.757+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:23:03.237 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:02 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:02.757+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:29.283545+0000 front 2024-09-19T08:22:29.283594+0000 (oldest deadline 2024-09-19T08:22:54.583511+0000) 2024-09-19T08:23:03.237 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:02 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:02.757+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.684471+0000 front 2024-09-19T08:22:35.684550+0000 (oldest deadline 2024-09-19T08:22:59.184585+0000) 2024-09-19T08:23:03.238 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:02 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:02.757+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:03.238 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:02 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:02.757+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:03.238 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:02 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:02.757+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:03.238 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:02 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:02.757+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:03.258 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:02 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:02.788+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:03.258 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:02 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:02.788+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:03.258 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:02 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:02.788+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:03.258 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:02 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:02.788+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:03.502 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:23:03 smithi027 podman[105690]: 2024-09-19 08:23:03.308827988 +0000 UTC m=+5.909600626 container cleanup b646494ce1c41565a6ed3ee96c67946867a61132585db020ed0b47493f623403 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T08:23:03.502 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:23:03 smithi027 bash[105690]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6 2024-09-19T08:23:03.758 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:03 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:03.326+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:23:03.758 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:03 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:03.326+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:23:03.758 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:03 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:03.326+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:38.440104+0000 front 2024-09-19T08:22:38.440200+0000 (oldest deadline 2024-09-19T08:22:58.939880+0000) 2024-09-19T08:23:03.938 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:23:03 smithi027 podman[105708]: 2024-09-19 08:23:03.610314015 +0000 UTC m=+0.746844579 container remove b646494ce1c41565a6ed3ee96c67946867a61132585db020ed0b47493f623403 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T08:23:03.938 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:03.705+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:03.938 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:03.705+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:03.938 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:03.705+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:03.938 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:03 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:03.705+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:04.196 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:23:03 smithi027 podman[105796]: 2024-09-19 08:23:03.841406253 +0000 UTC m=+0.016432905 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:23:04.197 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:23:03 smithi027 podman[105796]: 2024-09-19 08:23:03.944307605 +0000 UTC m=+0.119334245 container create 1a0924e0fb4c8fb445ae4520bf20437610965722cc580d3fc7188dbb39d79b2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T08:23:04.197 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:23:04 smithi027 podman[105796]: 2024-09-19 08:23:04.197462558 +0000 UTC m=+0.372489205 container init 1a0924e0fb4c8fb445ae4520bf20437610965722cc580d3fc7188dbb39d79b2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True) 2024-09-19T08:23:04.237 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:03 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:03.777+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:23:04.237 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:03 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:03.777+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:29.283545+0000 front 2024-09-19T08:22:29.283594+0000 (oldest deadline 2024-09-19T08:22:54.583511+0000) 2024-09-19T08:23:04.237 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:03 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:03.777+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.684471+0000 front 2024-09-19T08:22:35.684550+0000 (oldest deadline 2024-09-19T08:22:59.184585+0000) 2024-09-19T08:23:04.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:03 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:03.770+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:04.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:03 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:03.770+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:04.238 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:03 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:03.770+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:04.238 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:03 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:03.770+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:04.258 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:03 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:03.762+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:04.258 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:03 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:03.762+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:04.258 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:03 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:03.762+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:04.258 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:03 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:03.762+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:04.502 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:23:04 smithi027 podman[105796]: 2024-09-19 08:23:04.200942507 +0000 UTC m=+0.375969336 container start 1a0924e0fb4c8fb445ae4520bf20437610965722cc580d3fc7188dbb39d79b2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6-deactivate, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T08:23:04.502 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:23:04 smithi027 podman[105796]: 2024-09-19 08:23:04.272203897 +0000 UTC m=+0.447230555 container attach 1a0924e0fb4c8fb445ae4520bf20437610965722cc580d3fc7188dbb39d79b2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T08:23:04.502 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 19 08:23:04 smithi027 podman[105796]: 2024-09-19 08:23:04.397506172 +0000 UTC m=+0.572532815 container died 1a0924e0fb4c8fb445ae4520bf20437610965722cc580d3fc7188dbb39d79b2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T08:23:04.727 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:04 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:04.308+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:23:04.728 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:04 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:04.308+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:23:04.728 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:04 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:04.308+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:38.440104+0000 front 2024-09-19T08:22:38.440200+0000 (oldest deadline 2024-09-19T08:22:58.939880+0000) 2024-09-19T08:23:04.950 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:04 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:04.754+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:04.951 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:04 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:04.754+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:04.951 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:04 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:04.754+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:04.951 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:04 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:04.754+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:04.978 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T08:23:05.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:04 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:04.728+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:05.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:04 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:04.728+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:05.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:04 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:04.728+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:05.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:04 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:04.728+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:05.021 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:23:05.021 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T08:23:05.022 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T08:23:05.022 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.7 2024-09-19T08:23:05.049 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:04 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:04.739+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:23:05.049 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:04 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:04.739+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:29.283545+0000 front 2024-09-19T08:22:29.283594+0000 (oldest deadline 2024-09-19T08:22:54.583511+0000) 2024-09-19T08:23:05.049 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:04 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:04.739+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.684471+0000 front 2024-09-19T08:22:35.684550+0000 (oldest deadline 2024-09-19T08:22:59.184585+0000) 2024-09-19T08:23:05.050 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:04 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:04.755+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:05.050 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:04 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:04.755+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:05.050 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:04 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:04.755+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:05.050 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:04 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:04.755+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:05.326 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:05 smithi155 systemd[1]: Stopping Ceph osd.7 for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:23:05.690 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:05 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:05.326+0000 7f85da513640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:23:05.690 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:05 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:05.326+0000 7f85da513640 -1 osd.7 95 *** Got signal Terminated *** 2024-09-19T08:23:05.690 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:05 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:05.326+0000 7f85da513640 -1 osd.7 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:23:05.690 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:05 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:05.690+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:23:05.690 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:05 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:05.690+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:29.283545+0000 front 2024-09-19T08:22:29.283594+0000 (oldest deadline 2024-09-19T08:22:54.583511+0000) 2024-09-19T08:23:05.691 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:05 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:05.690+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.684471+0000 front 2024-09-19T08:22:35.684550+0000 (oldest deadline 2024-09-19T08:22:59.184585+0000) 2024-09-19T08:23:05.696 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:05 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:05.308+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:23:05.696 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:05 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:05.308+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:23:05.696 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:05 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:05.308+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:38.440104+0000 front 2024-09-19T08:22:38.440200+0000 (oldest deadline 2024-09-19T08:22:58.939880+0000) 2024-09-19T08:23:05.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:05 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:05.791+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:05.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:05 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:05.791+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:05.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:05 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:05.791+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:05.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:05 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:05.791+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:06.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:05 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:05.741+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:06.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:05 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:05.741+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:06.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:05 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:05.741+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:06.003 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:05 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:05.741+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:06.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:05 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:05.696+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:06.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:05 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:05.696+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:06.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:05 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:05.696+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:06.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:05 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:05.696+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:06.680 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:06 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:06.339+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:23:06.680 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:06 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:06.339+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:23:06.681 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:06 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:06.339+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:38.440104+0000 front 2024-09-19T08:22:38.440200+0000 (oldest deadline 2024-09-19T08:22:58.939880+0000) 2024-09-19T08:23:06.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:06 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:06.701+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:23:06.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:06 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:06.701+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:29.283545+0000 front 2024-09-19T08:22:29.283594+0000 (oldest deadline 2024-09-19T08:22:54.583511+0000) 2024-09-19T08:23:06.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:06 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:06.701+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.684471+0000 front 2024-09-19T08:22:35.684550+0000 (oldest deadline 2024-09-19T08:22:59.184585+0000) 2024-09-19T08:23:06.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:06 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:06.755+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:06.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:06 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:06.755+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:06.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:06 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:06.755+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:06.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:06 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:06.755+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:07.001 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:06 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:06.735+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:07.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:06 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:06.735+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:07.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:06 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:06.735+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:07.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:06 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:06.735+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:07.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:06 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:06.680+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:07.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:06 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:06.680+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:07.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:06 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:06.680+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:07.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:06 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:06.680+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:07.696 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:07 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:07.378+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:23:07.697 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:07 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:07.378+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:23:07.697 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:07 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:07.378+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:38.440104+0000 front 2024-09-19T08:22:38.440200+0000 (oldest deadline 2024-09-19T08:22:58.939880+0000) 2024-09-19T08:23:07.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:07 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:07.733+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:07.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:07 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:07.733+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:07.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:07 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:07.733+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:07.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:07 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:07.733+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:07.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:07 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:07.699+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:23:07.988 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:07 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:07.699+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:29.283545+0000 front 2024-09-19T08:22:29.283594+0000 (oldest deadline 2024-09-19T08:22:54.583511+0000) 2024-09-19T08:23:07.988 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:07 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:07.699+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.684471+0000 front 2024-09-19T08:22:35.684550+0000 (oldest deadline 2024-09-19T08:22:59.184585+0000) 2024-09-19T08:23:08.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:07 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:07.696+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:08.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:07 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:07.696+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:08.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:07 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:07.696+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:08.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:07 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:07.696+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:08.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:07 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:07.696+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:08.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:07 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:07.753+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:08.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:07 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:07.753+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:08.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:07 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:07.753+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:08.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:07 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:07.753+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:08.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:07 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:07.753+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:44.820790+0000 front 2024-09-19T08:22:44.820604+0000 (oldest deadline 2024-09-19T08:23:07.120545+0000) 2024-09-19T08:23:08.703 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:08 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:08.330+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:23:08.704 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:08 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:08.330+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:23:08.704 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:08 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:08.330+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:38.440104+0000 front 2024-09-19T08:22:38.440200+0000 (oldest deadline 2024-09-19T08:22:58.939880+0000) 2024-09-19T08:23:08.704 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:08 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:08.330+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.040697+0000 front 2024-09-19T08:22:43.040729+0000 (oldest deadline 2024-09-19T08:23:07.740725+0000) 2024-09-19T08:23:08.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:08 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:08.700+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:23:08.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:08 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:08.700+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:29.283545+0000 front 2024-09-19T08:22:29.283594+0000 (oldest deadline 2024-09-19T08:22:54.583511+0000) 2024-09-19T08:23:08.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:08 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:08.700+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.684471+0000 front 2024-09-19T08:22:35.684550+0000 (oldest deadline 2024-09-19T08:22:59.184585+0000) 2024-09-19T08:23:08.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:08 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:08.725+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:08.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:08 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:08.725+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:08.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:08 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:08.725+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:08.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:08 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:08.725+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:09.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:08 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:08.704+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:09.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:08 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:08.704+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:09.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:08 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:08.704+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:09.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:08 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:08.704+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:09.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:08 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:08.704+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:09.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:08 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:08.789+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:09.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:08 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:08.789+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:09.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:08 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:08.789+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:09.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:08 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:08.789+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:09.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:08 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:08.789+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:44.820790+0000 front 2024-09-19T08:22:44.820604+0000 (oldest deadline 2024-09-19T08:23:07.120545+0000) 2024-09-19T08:23:09.663 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:09 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:09.321+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:23:09.663 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:09 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:09.321+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:23:09.664 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:09 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:09.321+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:38.440104+0000 front 2024-09-19T08:22:38.440200+0000 (oldest deadline 2024-09-19T08:22:58.939880+0000) 2024-09-19T08:23:09.664 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:09 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:09.321+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.040697+0000 front 2024-09-19T08:22:43.040729+0000 (oldest deadline 2024-09-19T08:23:07.740725+0000) 2024-09-19T08:23:09.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:09 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:09.665+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.882502+0000 front 2024-09-19T08:22:19.882417+0000 (oldest deadline 2024-09-19T08:22:45.182588+0000) 2024-09-19T08:23:09.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:09 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:09.665+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:29.283545+0000 front 2024-09-19T08:22:29.283594+0000 (oldest deadline 2024-09-19T08:22:54.583511+0000) 2024-09-19T08:23:09.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:09 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:09.665+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.684471+0000 front 2024-09-19T08:22:35.684550+0000 (oldest deadline 2024-09-19T08:22:59.184585+0000) 2024-09-19T08:23:09.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:09 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T08:23:09.665+0000 7f85d6b29640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.085236+0000 front 2024-09-19T08:22:45.085272+0000 (oldest deadline 2024-09-19T08:23:09.185257+0000) 2024-09-19T08:23:09.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:09 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:09.732+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:09.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:09 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:09.732+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:09.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:09 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:09.732+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:09.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:09 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:09.732+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:10.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:09 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:09.663+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:10.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:09 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:09.663+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:10.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:09 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:09.663+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:10.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:09 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:09.663+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:10.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:09 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:09.663+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:10.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:09 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:09.769+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:10.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:09 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:09.769+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:10.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:09 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:09.769+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:10.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:09 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:09.769+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:10.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:09 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:09.769+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:44.820790+0000 front 2024-09-19T08:22:44.820604+0000 (oldest deadline 2024-09-19T08:23:07.120545+0000) 2024-09-19T08:23:10.319 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:10 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:10.317+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:23:10.319 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:10 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:10.317+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:23:10.319 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:10 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:10.317+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:38.440104+0000 front 2024-09-19T08:22:38.440200+0000 (oldest deadline 2024-09-19T08:22:58.939880+0000) 2024-09-19T08:23:10.319 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:10 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:10.317+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.040697+0000 front 2024-09-19T08:22:43.040729+0000 (oldest deadline 2024-09-19T08:23:07.740725+0000) 2024-09-19T08:23:11.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:10 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:10.722+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:11.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:10 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:10.722+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:11.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:10 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:10.722+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:11.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:10 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:10.722+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:11.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:10 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:10.722+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:44.820790+0000 front 2024-09-19T08:22:44.820604+0000 (oldest deadline 2024-09-19T08:23:07.120545+0000) 2024-09-19T08:23:11.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:10 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:10.631+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:11.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:10 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:10.631+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:11.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:10 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:10.631+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:11.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:10 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:10.631+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:11.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:10 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:10.631+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:11.085 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:10 smithi155 podman[71551]: 2024-09-19 08:23:10.803975065 +0000 UTC m=+5.586175006 container died e56de711f44ca53fba40a349be9f47cb6c778af068413d2874b3678c60763067 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T08:23:11.086 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:10 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:10.776+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:11.086 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:10 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:10.776+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:11.086 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:10 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:10.776+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:11.086 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:10 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:10.776+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:11.086 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:10 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:10.776+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:11.460 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:11 smithi155 podman[71551]: 2024-09-19 08:23:11.184556735 +0000 UTC m=+5.966756677 container cleanup e56de711f44ca53fba40a349be9f47cb6c778af068413d2874b3678c60763067 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:23:11.460 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:11 smithi155 bash[71551]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7 2024-09-19T08:23:11.605 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:11 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:11.344+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:23:11.605 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:11 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:11.344+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:23:11.605 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:11 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:11.344+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:38.440104+0000 front 2024-09-19T08:22:38.440200+0000 (oldest deadline 2024-09-19T08:22:58.939880+0000) 2024-09-19T08:23:11.605 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:11 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:11.344+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.040697+0000 front 2024-09-19T08:22:43.040729+0000 (oldest deadline 2024-09-19T08:23:07.740725+0000) 2024-09-19T08:23:11.737 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:11 smithi155 podman[71579]: 2024-09-19 08:23:11.460881739 +0000 UTC m=+0.658355140 container remove e56de711f44ca53fba40a349be9f47cb6c778af068413d2874b3678c60763067 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T08:23:12.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:11 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:11.685+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:12.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:11 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:11.685+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:12.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:11 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:11.685+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:12.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:11 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:11.685+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:12.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:11 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:11.685+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:44.820790+0000 front 2024-09-19T08:22:44.820604+0000 (oldest deadline 2024-09-19T08:23:07.120545+0000) 2024-09-19T08:23:12.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:11 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:11.605+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:12.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:11 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:11.605+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:12.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:11 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:11.605+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:12.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:11 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:11.605+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:12.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:11 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:11.605+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:12.055 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:11 smithi155 podman[71669]: 2024-09-19 08:23:11.702133959 +0000 UTC m=+0.016033540 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:23:12.055 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:11 smithi155 podman[71669]: 2024-09-19 08:23:11.820099096 +0000 UTC m=+0.133998665 container create 2c6646585bc0a2f955201e3dc10e8f97104c495bdb96b947ac770fc573159202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T08:23:12.055 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:12 smithi155 podman[71669]: 2024-09-19 08:23:12.05584087 +0000 UTC m=+0.369740441 container init 2c6646585bc0a2f955201e3dc10e8f97104c495bdb96b947ac770fc573159202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T08:23:12.055 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:11 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:11.805+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:12.055 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:11 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:11.805+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:12.055 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:11 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:11.805+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:12.056 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:11 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:11.805+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:12.056 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:11 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:11.805+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:12.487 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:12 smithi155 podman[71669]: 2024-09-19 08:23:12.059595405 +0000 UTC m=+0.373494976 container start 2c6646585bc0a2f955201e3dc10e8f97104c495bdb96b947ac770fc573159202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-09-19T08:23:12.488 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:12 smithi155 podman[71669]: 2024-09-19 08:23:12.139153732 +0000 UTC m=+0.453053316 container attach 2c6646585bc0a2f955201e3dc10e8f97104c495bdb96b947ac770fc573159202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True) 2024-09-19T08:23:12.488 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:23:12 smithi155 podman[71669]: 2024-09-19 08:23:12.249146737 +0000 UTC m=+0.563046317 container died 2c6646585bc0a2f955201e3dc10e8f97104c495bdb96b947ac770fc573159202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-7-deactivate, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T08:23:12.629 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:12 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:12.304+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:23:12.629 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:12 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:12.304+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:23:12.629 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:12 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:12.304+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:38.440104+0000 front 2024-09-19T08:22:38.440200+0000 (oldest deadline 2024-09-19T08:22:58.939880+0000) 2024-09-19T08:23:12.630 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:12 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:12.304+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.040697+0000 front 2024-09-19T08:22:43.040729+0000 (oldest deadline 2024-09-19T08:23:07.740725+0000) 2024-09-19T08:23:12.859 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:12 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:12.779+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:12.859 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:12 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:12.779+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:12.859 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:12 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:12.779+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:12.859 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:12 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:12.779+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:12.859 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:12 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:12.779+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:12.888 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T08:23:12.967 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:23:12.968 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T08:23:12.968 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T08:23:12.968 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.8 2024-09-19T08:23:12.995 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:12 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:12.630+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:12.995 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:12 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:12.630+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:12.995 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:12 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:12.630+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:12.995 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:12 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:12.630+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:12.995 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:12 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:12.630+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:13.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:12 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:12.717+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:13.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:12 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:12.717+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:13.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:12 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:12.717+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:13.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:12 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:12.717+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:13.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:12 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:12.717+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:44.820790+0000 front 2024-09-19T08:22:44.820604+0000 (oldest deadline 2024-09-19T08:23:07.120545+0000) 2024-09-19T08:23:13.258 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:13 smithi203 systemd[1]: Stopping Ceph osd.8 for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:23:13.627 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:13.279+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:23:13.627 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:13.279+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:23:13.627 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:13.279+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:38.440104+0000 front 2024-09-19T08:22:38.440200+0000 (oldest deadline 2024-09-19T08:22:58.939880+0000) 2024-09-19T08:23:13.627 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:13.279+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.040697+0000 front 2024-09-19T08:22:43.040729+0000 (oldest deadline 2024-09-19T08:23:07.740725+0000) 2024-09-19T08:23:13.627 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:13.286+0000 7fcfe284d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:23:13.627 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:13.286+0000 7fcfe284d640 -1 osd.8 95 *** Got signal Terminated *** 2024-09-19T08:23:13.627 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:13.286+0000 7fcfe284d640 -1 osd.8 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:23:14.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:13.627+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:14.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:13.627+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:14.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:13.627+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:14.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:13.627+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:14.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:13 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:13.627+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:14.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:13 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:13.791+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:14.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:13 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:13.791+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:14.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:13 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:13.791+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:14.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:13 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:13.791+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:14.238 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:13 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:13.791+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:14.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:13 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:13.765+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:14.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:13 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:13.765+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:14.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:13 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:13.765+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:14.253 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:13 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:13.765+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:14.253 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:13 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:13.765+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:44.820790+0000 front 2024-09-19T08:22:44.820604+0000 (oldest deadline 2024-09-19T08:23:07.120545+0000) 2024-09-19T08:23:14.653 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:14 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:14.321+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:23:14.653 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:14 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:14.321+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:23:14.653 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:14 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:14.321+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:38.440104+0000 front 2024-09-19T08:22:38.440200+0000 (oldest deadline 2024-09-19T08:22:58.939880+0000) 2024-09-19T08:23:14.653 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:14 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:14.321+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.040697+0000 front 2024-09-19T08:22:43.040729+0000 (oldest deadline 2024-09-19T08:23:07.740725+0000) 2024-09-19T08:23:15.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:14.730+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:15.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:14.730+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:15.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:14.730+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:15.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:14.730+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:15.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:14 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:14.730+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:44.820790+0000 front 2024-09-19T08:22:44.820604+0000 (oldest deadline 2024-09-19T08:23:07.120545+0000) 2024-09-19T08:23:15.007 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:14 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:14.652+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:15.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:14 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:14.652+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:15.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:14 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:14.652+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:15.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:14 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:14.652+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:15.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:14 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:14.652+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:15.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:14 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:14.749+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:15.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:14 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:14.749+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:15.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:14 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:14.749+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:15.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:14 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:14.749+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:15.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:14 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:14.749+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:15.631 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:15 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:15.348+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:23:15.631 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:15 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:15.348+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:23:15.631 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:15 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:15.348+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:38.440104+0000 front 2024-09-19T08:22:38.440200+0000 (oldest deadline 2024-09-19T08:22:58.939880+0000) 2024-09-19T08:23:15.631 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:15 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:15.348+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.040697+0000 front 2024-09-19T08:22:43.040729+0000 (oldest deadline 2024-09-19T08:23:07.740725+0000) 2024-09-19T08:23:15.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:15 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:15.723+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:15.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:15 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:15.723+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:15.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:15 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:15.723+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:15.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:15 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:15.723+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:15.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:15 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:15.723+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:15.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:15 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:15.723+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:49.757928+0000 front 2024-09-19T08:22:49.757915+0000 (oldest deadline 2024-09-19T08:23:15.057714+0000) 2024-09-19T08:23:16.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:15 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:15.714+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:16.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:15 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:15.714+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:16.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:15 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:15.714+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:16.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:15 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:15.714+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:16.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:15 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:15.714+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:44.820790+0000 front 2024-09-19T08:22:44.820604+0000 (oldest deadline 2024-09-19T08:23:07.120545+0000) 2024-09-19T08:23:16.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:15 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:15.631+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:16.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:15 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:15.631+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:16.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:15 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:15.631+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:16.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:15 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:15.631+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:16.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:15 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:15.631+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:16.659 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:16 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:16.339+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:23:16.659 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:16 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:16.339+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:23:16.659 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:16 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:16.339+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:38.440104+0000 front 2024-09-19T08:22:38.440200+0000 (oldest deadline 2024-09-19T08:22:58.939880+0000) 2024-09-19T08:23:16.660 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:16 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:16.339+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.040697+0000 front 2024-09-19T08:22:43.040729+0000 (oldest deadline 2024-09-19T08:23:07.740725+0000) 2024-09-19T08:23:16.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:16 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:16.724+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:16.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:16 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:16.724+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:16.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:16 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:16.724+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:16.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:16 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:16.724+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:16.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:16 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:16.724+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:16.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:16 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:16.724+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:49.757928+0000 front 2024-09-19T08:22:49.757915+0000 (oldest deadline 2024-09-19T08:23:15.057714+0000) 2024-09-19T08:23:17.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:16 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:16.722+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:17.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:16 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:16.722+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:17.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:16 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:16.722+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:17.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:16 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:16.722+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:17.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:16 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:16.722+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:44.820790+0000 front 2024-09-19T08:22:44.820604+0000 (oldest deadline 2024-09-19T08:23:07.120545+0000) 2024-09-19T08:23:17.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:16 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:16.659+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:17.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:16 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:16.659+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:17.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:16 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:16.659+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:17.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:16 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:16.659+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:17.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:16 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:16.659+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:17.653 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:17 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:17.347+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:20.837698+0000 front 2024-09-19T08:22:20.837708+0000 (oldest deadline 2024-09-19T08:22:46.737778+0000) 2024-09-19T08:23:17.654 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:17 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:17.347+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:26.738138+0000 front 2024-09-19T08:22:26.738166+0000 (oldest deadline 2024-09-19T08:22:50.838379+0000) 2024-09-19T08:23:17.654 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:17 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:17.347+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:38.440104+0000 front 2024-09-19T08:22:38.440200+0000 (oldest deadline 2024-09-19T08:22:58.939880+0000) 2024-09-19T08:23:17.654 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:17 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8[53584]: 2024-09-19T08:23:17.347+0000 7fcfdae5b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.040697+0000 front 2024-09-19T08:22:43.040729+0000 (oldest deadline 2024-09-19T08:23:07.740725+0000) 2024-09-19T08:23:18.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:17 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:17.718+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:18.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:17 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:17.718+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:18.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:17 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:17.718+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:18.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:17 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:17.718+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:18.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:17 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:17.718+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:44.820790+0000 front 2024-09-19T08:22:44.820604+0000 (oldest deadline 2024-09-19T08:23:07.120545+0000) 2024-09-19T08:23:18.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:17 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:17.653+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:18.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:17 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:17.653+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:18.009 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:17 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:17.653+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:18.009 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:17 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:17.653+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:18.009 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:17 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:17.653+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:18.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:17 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:17.768+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:18.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:17 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:17.768+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:18.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:17 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:17.768+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:18.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:17 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:17.768+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:18.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:17 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:17.768+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:18.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:17 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:17.768+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:49.757928+0000 front 2024-09-19T08:22:49.757915+0000 (oldest deadline 2024-09-19T08:23:15.057714+0000) 2024-09-19T08:23:19.008 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:18 smithi203 podman[71508]: 2024-09-19 08:23:18.790383417 +0000 UTC m=+5.628666493 container died 4ab27f123912e8910c35cd3bfbb44d2c923c788cf9b82c5965fca2a3085dd2a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T08:23:19.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:18 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:18.625+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:19.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:18 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:18.625+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:19.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:18 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:18.625+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:19.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:18 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:18.626+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:19.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:18 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:18.626+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:19.009 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:18 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:18.626+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:19.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:18 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:18.799+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:19.238 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:18 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:18.799+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:19.238 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:18 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:18.799+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:19.238 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:18 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:18.799+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:19.238 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:18 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:18.799+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:19.238 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:18 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:18.799+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:49.757928+0000 front 2024-09-19T08:22:49.757915+0000 (oldest deadline 2024-09-19T08:23:15.057714+0000) 2024-09-19T08:23:19.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:18 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:18.759+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:19.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:18 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:18.759+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:19.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:18 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:18.759+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:19.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:18 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:18.759+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:19.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:18 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:18.759+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:44.820790+0000 front 2024-09-19T08:22:44.820604+0000 (oldest deadline 2024-09-19T08:23:07.120545+0000) 2024-09-19T08:23:19.337 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:19 smithi203 podman[71508]: 2024-09-19 08:23:19.119292119 +0000 UTC m=+5.957575197 container cleanup 4ab27f123912e8910c35cd3bfbb44d2c923c788cf9b82c5965fca2a3085dd2a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:23:19.337 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:19 smithi203 bash[71508]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8 2024-09-19T08:23:19.646 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:19 smithi203 podman[71523]: 2024-09-19 08:23:19.337398954 +0000 UTC m=+0.540529303 container remove 4ab27f123912e8910c35cd3bfbb44d2c923c788cf9b82c5965fca2a3085dd2a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T08:23:19.948 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:19 smithi203 podman[71610]: 2024-09-19 08:23:19.642165872 +0000 UTC m=+0.016291168 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:23:19.948 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:19 smithi203 podman[71610]: 2024-09-19 08:23:19.746605391 +0000 UTC m=+0.120730693 container create 6a23796e1ac5c1a4bd9e5033acfa24da24300253f03a156fc7d985a2a118abb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T08:23:19.948 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:19 smithi203 podman[71610]: 2024-09-19 08:23:19.949248078 +0000 UTC m=+0.323373374 container init 6a23796e1ac5c1a4bd9e5033acfa24da24300253f03a156fc7d985a2a118abb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T08:23:19.949 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:19 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:19.646+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:19.949 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:19 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:19.646+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:19.949 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:19 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:19.646+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:19.949 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:19 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:19.646+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:19.949 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:19 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:19.646+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:19.949 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:19 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:19.646+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:20.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:19 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:19.731+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:20.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:19 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:19.731+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:20.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:19 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:19.731+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:20.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:19 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:19.731+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:20.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:19 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:19.731+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:44.820790+0000 front 2024-09-19T08:22:44.820604+0000 (oldest deadline 2024-09-19T08:23:07.120545+0000) 2024-09-19T08:23:20.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:19 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:19.731+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.922022+0000 front 2024-09-19T08:22:52.922117+0000 (oldest deadline 2024-09-19T08:23:18.821982+0000) 2024-09-19T08:23:20.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:19 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:19.754+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:20.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:19 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:19.754+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:20.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:19 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:19.754+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:20.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:19 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:19.754+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:20.238 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:19 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:19.754+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:20.238 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:19 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:19.754+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:49.757928+0000 front 2024-09-19T08:22:49.757915+0000 (oldest deadline 2024-09-19T08:23:15.057714+0000) 2024-09-19T08:23:20.258 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:19 smithi203 podman[71610]: 2024-09-19 08:23:19.952679098 +0000 UTC m=+0.326804396 container start 6a23796e1ac5c1a4bd9e5033acfa24da24300253f03a156fc7d985a2a118abb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T08:23:20.258 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:20 smithi203 podman[71610]: 2024-09-19 08:23:20.057740229 +0000 UTC m=+0.431865526 container attach 6a23796e1ac5c1a4bd9e5033acfa24da24300253f03a156fc7d985a2a118abb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T08:23:20.259 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:23:20 smithi203 podman[71610]: 2024-09-19 08:23:20.142090231 +0000 UTC m=+0.516215528 container died 6a23796e1ac5c1a4bd9e5033acfa24da24300253f03a156fc7d985a2a118abb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T08:23:20.744 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:20 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:20.617+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:20.744 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:20 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:20.617+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:20.745 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:20 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:20.617+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:20.745 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:20 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:20.617+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:20.745 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:20 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:20.617+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:20.745 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:20 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:20.617+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:20.777 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T08:23:20.856 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:23:20.857 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T08:23:20.857 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T08:23:20.857 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.9 2024-09-19T08:23:20.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:20 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:20.720+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:20.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:20 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:20.720+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:20.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:20 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:20.720+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:20.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:20 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:20.720+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:20.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:20 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:20.720+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:20.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:20 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:20.720+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:49.757928+0000 front 2024-09-19T08:22:49.757915+0000 (oldest deadline 2024-09-19T08:23:15.057714+0000) 2024-09-19T08:23:21.001 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:20 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:20.699+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:21.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:20 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:20.699+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:21.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:20 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:20.699+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:21.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:20 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:20.699+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:21.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:20 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:20.699+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:44.820790+0000 front 2024-09-19T08:22:44.820604+0000 (oldest deadline 2024-09-19T08:23:07.120545+0000) 2024-09-19T08:23:21.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:20 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:20.699+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.922022+0000 front 2024-09-19T08:22:52.922117+0000 (oldest deadline 2024-09-19T08:23:18.821982+0000) 2024-09-19T08:23:21.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:20 smithi027 systemd[1]: Stopping Ceph osd.9 for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:23:21.501 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:21 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:21.153+0000 7f2eb65a1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:23:21.502 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:21 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:21.153+0000 7f2eb65a1640 -1 osd.9 95 *** Got signal Terminated *** 2024-09-19T08:23:21.502 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:21 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:21.153+0000 7f2eb65a1640 -1 osd.9 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:23:21.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:21 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:21.627+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:21.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:21 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:21.627+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:21.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:21 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:21.627+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:21.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:21 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:21.627+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:21.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:21 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:21.627+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:21.759 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:21 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:21.627+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:21.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:21 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:21.710+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:21.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:21 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:21.710+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:21.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:21 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:21.710+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:21.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:21 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:21.710+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:21.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:21 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:21.710+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:21.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:21 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:21.710+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:49.757928+0000 front 2024-09-19T08:22:49.757915+0000 (oldest deadline 2024-09-19T08:23:15.057714+0000) 2024-09-19T08:23:22.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:21 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:21.741+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:22.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:21 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:21.741+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:22.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:21 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:21.741+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:22.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:21 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:21.741+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:22.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:21 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:21.741+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:44.820790+0000 front 2024-09-19T08:22:44.820604+0000 (oldest deadline 2024-09-19T08:23:07.120545+0000) 2024-09-19T08:23:22.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:21 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:21.741+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.922022+0000 front 2024-09-19T08:22:52.922117+0000 (oldest deadline 2024-09-19T08:23:18.821982+0000) 2024-09-19T08:23:23.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:22 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:22.731+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:23.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:22 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:22.731+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:23.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:22 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:22.731+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:23.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:22 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:22.731+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:23.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:22 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:22.731+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:44.820790+0000 front 2024-09-19T08:22:44.820604+0000 (oldest deadline 2024-09-19T08:23:07.120545+0000) 2024-09-19T08:23:23.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:22 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:22.731+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.922022+0000 front 2024-09-19T08:22:52.922117+0000 (oldest deadline 2024-09-19T08:23:18.821982+0000) 2024-09-19T08:23:23.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:22 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:22.659+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:23.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:22 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:22.659+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:23.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:22 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:22.659+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:23.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:22 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:22.659+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:23.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:22 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:22.659+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:23.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:22 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:22.659+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:23.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:22 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:22.750+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:23.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:22 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:22.750+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:23.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:22 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:22.750+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:23.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:22 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:22.750+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:23.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:22 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:22.750+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:23.238 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:22 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:22.750+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:49.757928+0000 front 2024-09-19T08:22:49.757915+0000 (oldest deadline 2024-09-19T08:23:15.057714+0000) 2024-09-19T08:23:23.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:23 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:23.725+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:23.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:23 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:23.725+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:23.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:23 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:23.725+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:23.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:23 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:23.725+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:23.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:23 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:23.725+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:23.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:23 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:23.725+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:49.757928+0000 front 2024-09-19T08:22:49.757915+0000 (oldest deadline 2024-09-19T08:23:15.057714+0000) 2024-09-19T08:23:24.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:23 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:23.704+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:24.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:23 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:23.704+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:24.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:23 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:23.704+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:24.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:23 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:23.704+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:24.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:23 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:23.704+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:44.820790+0000 front 2024-09-19T08:22:44.820604+0000 (oldest deadline 2024-09-19T08:23:07.120545+0000) 2024-09-19T08:23:24.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:23 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:23.704+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.922022+0000 front 2024-09-19T08:22:52.922117+0000 (oldest deadline 2024-09-19T08:23:18.821982+0000) 2024-09-19T08:23:24.003 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:23 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:23.704+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-19T08:22:59.922936+0000 front 2024-09-19T08:22:59.922917+0000 (oldest deadline 2024-09-19T08:23:23.422910+0000) 2024-09-19T08:23:24.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:23 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:23.615+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:24.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:23 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:23.615+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:24.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:23 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:23.615+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:24.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:23 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:23.615+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:24.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:23 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:23.615+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:24.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:23 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:23.615+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:24.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:24 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:24.692+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:24.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:24 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:24.692+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:24.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:24 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:24.692+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:24.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:24 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:24.692+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:24.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:24 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:24.692+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:24.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:24 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:24.692+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:49.757928+0000 front 2024-09-19T08:22:49.757915+0000 (oldest deadline 2024-09-19T08:23:15.057714+0000) 2024-09-19T08:23:25.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:24 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:24.684+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:25.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:24 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:24.684+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:25.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:24 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:24.684+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:25.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:24 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:24.684+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:25.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:24 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:24.684+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:44.820790+0000 front 2024-09-19T08:22:44.820604+0000 (oldest deadline 2024-09-19T08:23:07.120545+0000) 2024-09-19T08:23:25.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:24 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:24.684+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.922022+0000 front 2024-09-19T08:22:52.922117+0000 (oldest deadline 2024-09-19T08:23:18.821982+0000) 2024-09-19T08:23:25.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:24 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:24.684+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-19T08:22:59.922936+0000 front 2024-09-19T08:22:59.922917+0000 (oldest deadline 2024-09-19T08:23:23.422910+0000) 2024-09-19T08:23:25.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:24 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:24.571+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:25.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:24 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:24.571+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:25.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:24 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:24.571+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:25.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:24 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:24.571+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:25.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:24 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:24.571+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:25.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:24 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:24.571+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:25.909 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:25 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:25.583+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:25.909 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:25 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:25.583+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:25.909 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:25 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:25.583+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:25.910 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:25 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:25.583+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:25.910 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:25 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:25.583+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:25.910 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:25 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:25.583+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:25.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:25 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:25.703+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:25.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:25 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:25.703+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:25.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:25 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:25.703+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:25.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:25 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:25.703+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:25.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:25 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:25.703+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:25.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:25 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:25.703+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:49.757928+0000 front 2024-09-19T08:22:49.757915+0000 (oldest deadline 2024-09-19T08:23:15.057714+0000) 2024-09-19T08:23:25.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:25 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:25.703+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-19T08:23:00.859248+0000 front 2024-09-19T08:23:00.859304+0000 (oldest deadline 2024-09-19T08:23:25.559097+0000) 2024-09-19T08:23:26.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:25 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:25.705+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.916477+0000 front 2024-09-19T08:22:13.916372+0000 (oldest deadline 2024-09-19T08:22:39.216593+0000) 2024-09-19T08:23:26.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:25 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:25.705+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:19.217255+0000 front 2024-09-19T08:22:19.217350+0000 (oldest deadline 2024-09-19T08:22:43.317122+0000) 2024-09-19T08:23:26.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:25 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:25.705+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:28.518659+0000 front 2024-09-19T08:22:28.518702+0000 (oldest deadline 2024-09-19T08:22:54.418420+0000) 2024-09-19T08:23:26.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:25 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:25.705+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.519185+0000 front 2024-09-19T08:22:35.519206+0000 (oldest deadline 2024-09-19T08:22:59.019316+0000) 2024-09-19T08:23:26.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:25 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:25.705+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:44.820790+0000 front 2024-09-19T08:22:44.820604+0000 (oldest deadline 2024-09-19T08:23:07.120545+0000) 2024-09-19T08:23:26.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:25 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:25.705+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.922022+0000 front 2024-09-19T08:22:52.922117+0000 (oldest deadline 2024-09-19T08:23:18.821982+0000) 2024-09-19T08:23:26.002 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:25 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9[65156]: 2024-09-19T08:23:25.705+0000 7f2eb2bb7640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-19T08:22:59.922936+0000 front 2024-09-19T08:22:59.922917+0000 (oldest deadline 2024-09-19T08:23:23.422910+0000) 2024-09-19T08:23:26.944 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:26 smithi027 podman[105911]: 2024-09-19 08:23:26.622176829 +0000 UTC m=+5.561539166 container died f76a870aed4e96ea22fd7a6aa13945c714a45a58260c11a9b335fd8b2a75776d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T08:23:26.944 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:26 smithi027 podman[105911]: 2024-09-19 08:23:26.945157945 +0000 UTC m=+5.884520273 container cleanup f76a870aed4e96ea22fd7a6aa13945c714a45a58260c11a9b335fd8b2a75776d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T08:23:26.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:26 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:26.655+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:26.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:26 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:26.655+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:26.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:26 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:26.655+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:26.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:26 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:26.655+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:26.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:26 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:26.655+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:26.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:26 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:26.655+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:49.757928+0000 front 2024-09-19T08:22:49.757915+0000 (oldest deadline 2024-09-19T08:23:15.057714+0000) 2024-09-19T08:23:26.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:26 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:26.655+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-19T08:23:00.859248+0000 front 2024-09-19T08:23:00.859304+0000 (oldest deadline 2024-09-19T08:23:25.559097+0000) 2024-09-19T08:23:27.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:26 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:26.540+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:27.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:26 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:26.540+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:27.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:26 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:26.540+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:27.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:26 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:26.540+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:27.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:26 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:26.540+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:27.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:26 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:26.540+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:27.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:26 smithi027 bash[105911]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9 2024-09-19T08:23:27.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:27 smithi027 podman[105926]: 2024-09-19 08:23:27.138041625 +0000 UTC m=+0.507776418 container remove f76a870aed4e96ea22fd7a6aa13945c714a45a58260c11a9b335fd8b2a75776d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T08:23:27.890 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:27 smithi027 podman[106014]: 2024-09-19 08:23:27.478191142 +0000 UTC m=+0.016740508 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:23:27.891 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:27 smithi027 podman[106014]: 2024-09-19 08:23:27.614065013 +0000 UTC m=+0.152614371 container create b80ad2393e45a5482c0c0ca69ce88a022f8744e27a100a2a1819979779ff9987 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T08:23:27.891 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:27 smithi027 podman[106014]: 2024-09-19 08:23:27.816406932 +0000 UTC m=+0.354956290 container init b80ad2393e45a5482c0c0ca69ce88a022f8744e27a100a2a1819979779ff9987 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:23:27.891 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:27 smithi027 podman[106014]: 2024-09-19 08:23:27.819732898 +0000 UTC m=+0.358282254 container start b80ad2393e45a5482c0c0ca69ce88a022f8744e27a100a2a1819979779ff9987 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T08:23:27.891 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:27 smithi027 podman[106014]: 2024-09-19 08:23:27.891288685 +0000 UTC m=+0.429838039 container attach b80ad2393e45a5482c0c0ca69ce88a022f8744e27a100a2a1819979779ff9987 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:23:27.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:27 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:27.618+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:27.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:27 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:27.618+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:27.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:27 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:27.618+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:27.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:27 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:27.618+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:27.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:27 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:27.618+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:27.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:27 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:27.618+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:49.757928+0000 front 2024-09-19T08:22:49.757915+0000 (oldest deadline 2024-09-19T08:23:15.057714+0000) 2024-09-19T08:23:27.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:27 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:27.618+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-19T08:23:00.859248+0000 front 2024-09-19T08:23:00.859304+0000 (oldest deadline 2024-09-19T08:23:25.559097+0000) 2024-09-19T08:23:28.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:27 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:27.560+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:28.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:27 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:27.560+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:28.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:27 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:27.560+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:28.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:27 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:27.560+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:28.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:27 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:27.560+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:28.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:27 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:27.560+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:28.252 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:28 smithi027 podman[106014]: 2024-09-19 08:23:28.013495056 +0000 UTC m=+0.552044430 container died b80ad2393e45a5482c0c0ca69ce88a022f8744e27a100a2a1819979779ff9987 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T08:23:28.555 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 19 08:23:28 smithi027 podman[106037]: 2024-09-19 08:23:28.536332951 +0000 UTC m=+0.516535947 container remove b80ad2393e45a5482c0c0ca69ce88a022f8744e27a100a2a1819979779ff9987 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-9-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:23:28.561 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T08:23:28.604 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:23:28.604 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T08:23:28.605 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T08:23:28.605 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.10 2024-09-19T08:23:28.895 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:28 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:28.648+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:28.895 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:28 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:28.648+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:28.895 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:28 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:28.648+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:28.895 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:28 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:28.648+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:28.895 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:28 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:28.648+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:28.895 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:28 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:28.648+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:49.757928+0000 front 2024-09-19T08:22:49.757915+0000 (oldest deadline 2024-09-19T08:23:15.057714+0000) 2024-09-19T08:23:28.896 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:28 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:28.648+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-19T08:23:00.859248+0000 front 2024-09-19T08:23:00.859304+0000 (oldest deadline 2024-09-19T08:23:25.559097+0000) 2024-09-19T08:23:28.896 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:28 smithi155 systemd[1]: Stopping Ceph osd.10 for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:23:28.896 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:28 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:28.893+0000 7f877dcf1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:23:28.896 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:28 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:28.893+0000 7f877dcf1640 -1 osd.10 95 *** Got signal Terminated *** 2024-09-19T08:23:28.896 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:28 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:28.893+0000 7f877dcf1640 -1 osd.10 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:23:29.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:28 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:28.544+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:29.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:28 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:28.544+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:29.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:28 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:28.544+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:29.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:28 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:28.544+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:29.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:28 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:28.544+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:29.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:28 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:28.544+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:29.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:29 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:29.655+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:29.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:29 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:29.655+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:29.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:29 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:29.655+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:29.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:29 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:29.655+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:29.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:29 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:29.655+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:29.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:29 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:29.655+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:49.757928+0000 front 2024-09-19T08:22:49.757915+0000 (oldest deadline 2024-09-19T08:23:15.057714+0000) 2024-09-19T08:23:29.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:29 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:29.655+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-19T08:23:00.859248+0000 front 2024-09-19T08:23:00.859304+0000 (oldest deadline 2024-09-19T08:23:25.559097+0000) 2024-09-19T08:23:30.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:29 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:29.537+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:30.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:29 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:29.537+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:30.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:29 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:29.537+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:30.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:29 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:29.537+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:30.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:29 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:29.537+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:30.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:29 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:29.537+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:30.892 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:30 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:30.538+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:30.892 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:30 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:30.538+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:30.892 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:30 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:30.538+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:30.892 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:30 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:30.538+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:30.892 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:30 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:30.538+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:30.892 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:30 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:30.538+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:30.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:30 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:30.639+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:30.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:30 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:30.639+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:30.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:30 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:30.639+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:30.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:30 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:30.639+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:30.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:30 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:30.639+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:30.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:30 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:30.639+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:49.757928+0000 front 2024-09-19T08:22:49.757915+0000 (oldest deadline 2024-09-19T08:23:15.057714+0000) 2024-09-19T08:23:30.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:30 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:30.639+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-19T08:23:00.859248+0000 front 2024-09-19T08:23:00.859304+0000 (oldest deadline 2024-09-19T08:23:25.559097+0000) 2024-09-19T08:23:31.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:31 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:31.584+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:31.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:31 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:31.584+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:31.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:31 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:31.584+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:31.759 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:31 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:31.584+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:31.759 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:31 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:31.584+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:31.759 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:31 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:31.584+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:31.759 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:31 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:31.584+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-19T08:23:08.468467+0000 front 2024-09-19T08:23:08.468523+0000 (oldest deadline 2024-09-19T08:23:31.368420+0000) 2024-09-19T08:23:31.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:31 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:31.596+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:31.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:31 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:31.596+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:31.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:31 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:31.596+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:31.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:31 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:31.596+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:31.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:31 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:31.596+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:31.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:31 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:31.596+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:49.757928+0000 front 2024-09-19T08:22:49.757915+0000 (oldest deadline 2024-09-19T08:23:15.057714+0000) 2024-09-19T08:23:31.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:31 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:31.596+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-19T08:23:00.859248+0000 front 2024-09-19T08:23:00.859304+0000 (oldest deadline 2024-09-19T08:23:25.559097+0000) 2024-09-19T08:23:32.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:32 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:32.579+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:32.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:32 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:32.579+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:32.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:32 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:32.579+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:32.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:32 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:32.579+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:32.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:32 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:32.579+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:32.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:32 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:32.579+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:49.757928+0000 front 2024-09-19T08:22:49.757915+0000 (oldest deadline 2024-09-19T08:23:15.057714+0000) 2024-09-19T08:23:32.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:32 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:32.579+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-19T08:23:00.859248+0000 front 2024-09-19T08:23:00.859304+0000 (oldest deadline 2024-09-19T08:23:25.559097+0000) 2024-09-19T08:23:33.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:32 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:32.617+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:33.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:32 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:32.617+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:33.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:32 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:32.617+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:33.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:32 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:32.617+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:33.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:32 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:32.617+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:33.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:32 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:32.617+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:33.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:32 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:32.617+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-19T08:23:08.468467+0000 front 2024-09-19T08:23:08.468523+0000 (oldest deadline 2024-09-19T08:23:31.368420+0000) 2024-09-19T08:23:33.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:33 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:33.554+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:13.251824+0000 front 2024-09-19T08:22:13.251840+0000 (oldest deadline 2024-09-19T08:22:34.951593+0000) 2024-09-19T08:23:33.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:33 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:33.554+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:21.753777+0000 front 2024-09-19T08:22:21.753753+0000 (oldest deadline 2024-09-19T08:22:47.053872+0000) 2024-09-19T08:23:33.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:33 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:33.554+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:27.554770+0000 front 2024-09-19T08:22:27.554861+0000 (oldest deadline 2024-09-19T08:22:55.755256+0000) 2024-09-19T08:23:33.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:33 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:33.554+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:35.755811+0000 front 2024-09-19T08:22:35.755858+0000 (oldest deadline 2024-09-19T08:22:59.855742+0000) 2024-09-19T08:23:33.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:33 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:33.554+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:45.057160+0000 front 2024-09-19T08:22:45.057209+0000 (oldest deadline 2024-09-19T08:23:09.757297+0000) 2024-09-19T08:23:33.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:33 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:33.554+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:49.757928+0000 front 2024-09-19T08:22:49.757915+0000 (oldest deadline 2024-09-19T08:23:15.057714+0000) 2024-09-19T08:23:33.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:33 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10[60127]: 2024-09-19T08:23:33.554+0000 7f877a307640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-19T08:23:00.859248+0000 front 2024-09-19T08:23:00.859304+0000 (oldest deadline 2024-09-19T08:23:25.559097+0000) 2024-09-19T08:23:34.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:33 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:33.577+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:34.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:33 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:33.577+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:34.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:33 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:33.577+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:34.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:33 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:33.577+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:34.009 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:33 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:33.577+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:34.009 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:33 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:33.577+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:34.009 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:33 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:33.577+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-19T08:23:08.468467+0000 front 2024-09-19T08:23:08.468523+0000 (oldest deadline 2024-09-19T08:23:31.368420+0000) 2024-09-19T08:23:34.712 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:34 smithi155 podman[71772]: 2024-09-19 08:23:34.429240327 +0000 UTC m=+5.630450485 container died 47ece2f80cf2102441f153077a96ac76a884646db8ead3da458299ead5ddaf89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T08:23:34.969 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:34 smithi155 podman[71772]: 2024-09-19 08:23:34.794485143 +0000 UTC m=+5.995695303 container cleanup 47ece2f80cf2102441f153077a96ac76a884646db8ead3da458299ead5ddaf89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T08:23:34.970 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:34 smithi155 bash[71772]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10 2024-09-19T08:23:35.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:34 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:34.547+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:35.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:34 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:34.547+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:35.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:34 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:34.547+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:35.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:34 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:34.547+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:35.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:34 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:34.547+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:35.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:34 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:34.547+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:35.009 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:34 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:34.547+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-19T08:23:08.468467+0000 front 2024-09-19T08:23:08.468523+0000 (oldest deadline 2024-09-19T08:23:31.368420+0000) 2024-09-19T08:23:35.237 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:34 smithi155 podman[71787]: 2024-09-19 08:23:34.970396773 +0000 UTC m=+0.542201048 container remove 47ece2f80cf2102441f153077a96ac76a884646db8ead3da458299ead5ddaf89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T08:23:35.689 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:35 smithi155 podman[71876]: 2024-09-19 08:23:35.313065172 +0000 UTC m=+0.015777359 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:23:35.690 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:35 smithi155 podman[71876]: 2024-09-19 08:23:35.413141403 +0000 UTC m=+0.115853620 container create e829ec7009e0ad0fe5b8cc329c3d7f47374d23f714a10150fb610983a228518f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T08:23:35.690 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:35 smithi155 podman[71876]: 2024-09-19 08:23:35.615365681 +0000 UTC m=+0.318077857 container init e829ec7009e0ad0fe5b8cc329c3d7f47374d23f714a10150fb610983a228518f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10-deactivate, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-19T08:23:35.690 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:35 smithi155 podman[71876]: 2024-09-19 08:23:35.618561128 +0000 UTC m=+0.321273307 container start e829ec7009e0ad0fe5b8cc329c3d7f47374d23f714a10150fb610983a228518f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:23:35.690 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:35 smithi155 podman[71876]: 2024-09-19 08:23:35.690197239 +0000 UTC m=+0.392909433 container attach e829ec7009e0ad0fe5b8cc329c3d7f47374d23f714a10150fb610983a228518f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T08:23:35.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:35 smithi155 podman[71876]: 2024-09-19 08:23:35.805352648 +0000 UTC m=+0.508064823 container died e829ec7009e0ad0fe5b8cc329c3d7f47374d23f714a10150fb610983a228518f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T08:23:36.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:35 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:35.538+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:36.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:35 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:35.538+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:36.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:35 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:35.538+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:36.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:35 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:35.538+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:36.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:35 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:35.538+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:36.009 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:35 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:35.538+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:36.009 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:35 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:35.538+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-19T08:23:08.468467+0000 front 2024-09-19T08:23:08.468523+0000 (oldest deadline 2024-09-19T08:23:31.368420+0000) 2024-09-19T08:23:36.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:23:36 smithi155 podman[71899]: 2024-09-19 08:23:36.326561139 +0000 UTC m=+0.515625641 container remove e829ec7009e0ad0fe5b8cc329c3d7f47374d23f714a10150fb610983a228518f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T08:23:36.352 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T08:23:36.390 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:23:36.390 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T08:23:36.390 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T08:23:36.390 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.11 2024-09-19T08:23:36.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:36 smithi203 systemd[1]: Stopping Ceph osd.11 for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:23:36.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:36 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:36.578+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:36.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:36 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:36.579+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:36.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:36 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:36.579+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:36.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:36 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:36.579+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:36.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:36 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:36.579+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:36.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:36 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:36.579+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:36.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:36 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:36.579+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-19T08:23:08.468467+0000 front 2024-09-19T08:23:08.468523+0000 (oldest deadline 2024-09-19T08:23:31.368420+0000) 2024-09-19T08:23:36.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:36 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:36.732+0000 7f7335cf6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:23:36.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:36 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:36.732+0000 7f7335cf6640 -1 osd.11 95 *** Got signal Terminated *** 2024-09-19T08:23:36.734 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:36 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:36.732+0000 7f7335cf6640 -1 osd.11 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:23:38.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:37 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:37.548+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:38.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:37 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:37.548+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:38.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:37 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:37.548+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:38.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:37 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:37.548+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:38.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:37 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:37.548+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:38.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:37 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:37.548+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:38.008 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:37 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:37.548+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-19T08:23:08.468467+0000 front 2024-09-19T08:23:08.468523+0000 (oldest deadline 2024-09-19T08:23:31.368420+0000) 2024-09-19T08:23:38.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:38 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:38.499+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:38.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:38 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:38.499+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:38.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:38 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:38.499+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:38.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:38 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:38.499+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:38.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:38 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:38.499+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:38.759 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:38 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:38.499+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:38.759 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:38 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:38.499+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-19T08:23:08.468467+0000 front 2024-09-19T08:23:08.468523+0000 (oldest deadline 2024-09-19T08:23:31.368420+0000) 2024-09-19T08:23:39.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:39 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:39.453+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:39.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:39 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:39.453+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:39.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:39 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:39.453+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:39.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:39 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:39.453+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:39.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:39 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:39.453+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:39.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:39 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:39.453+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:39.759 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:39 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:39.453+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-19T08:23:08.468467+0000 front 2024-09-19T08:23:08.468523+0000 (oldest deadline 2024-09-19T08:23:31.368420+0000) 2024-09-19T08:23:40.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:40 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:40.443+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:40.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:40 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:40.443+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:40.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:40 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:40.443+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:40.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:40 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:40.443+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:40.759 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:40 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:40.443+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:40.759 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:40 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:40.443+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:40.759 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:40 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:40.443+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-19T08:23:08.468467+0000 front 2024-09-19T08:23:08.468523+0000 (oldest deadline 2024-09-19T08:23:31.368420+0000) 2024-09-19T08:23:41.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:41 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:41.424+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-19T08:22:09.159182+0000 front 2024-09-19T08:22:09.159274+0000 (oldest deadline 2024-09-19T08:22:35.559846+0000) 2024-09-19T08:23:41.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:41 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:41.424+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T08:22:18.961428+0000 front 2024-09-19T08:22:18.961411+0000 (oldest deadline 2024-09-19T08:22:43.061532+0000) 2024-09-19T08:23:41.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:41 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:41.424+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T08:22:25.862965+0000 front 2024-09-19T08:22:25.863019+0000 (oldest deadline 2024-09-19T08:22:51.063652+0000) 2024-09-19T08:23:41.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:41 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:41.424+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-19T08:22:36.865224+0000 front 2024-09-19T08:22:36.865193+0000 (oldest deadline 2024-09-19T08:23:00.965211+0000) 2024-09-19T08:23:41.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:41 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:41.424+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T08:22:43.866278+0000 front 2024-09-19T08:22:43.866216+0000 (oldest deadline 2024-09-19T08:23:07.366049+0000) 2024-09-19T08:23:41.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:41 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:41.424+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T08:22:52.066710+0000 front 2024-09-19T08:22:52.066743+0000 (oldest deadline 2024-09-19T08:23:17.966768+0000) 2024-09-19T08:23:41.759 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:41 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11[60149]: 2024-09-19T08:23:41.424+0000 7f732e304640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-19T08:23:08.468467+0000 front 2024-09-19T08:23:08.468523+0000 (oldest deadline 2024-09-19T08:23:31.368420+0000) 2024-09-19T08:23:42.422 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:42 smithi203 podman[71725]: 2024-09-19 08:23:42.117632146 +0000 UTC m=+5.521626091 container died 446652cf397581446cbd2c8db6e0cb6dc89c8c99110488d907e212ba0f906e82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True) 2024-09-19T08:23:42.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:42 smithi203 podman[71725]: 2024-09-19 08:23:42.522735935 +0000 UTC m=+5.926729879 container cleanup 446652cf397581446cbd2c8db6e0cb6dc89c8c99110488d907e212ba0f906e82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T08:23:42.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:42 smithi203 bash[71725]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11 2024-09-19T08:23:43.094 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:42 smithi203 podman[71742]: 2024-09-19 08:23:42.765618733 +0000 UTC m=+0.638077321 container remove 446652cf397581446cbd2c8db6e0cb6dc89c8c99110488d907e212ba0f906e82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:23:43.376 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:43 smithi203 podman[71831]: 2024-09-19 08:23:42.997594418 +0000 UTC m=+0.016251550 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:23:43.377 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:43 smithi203 podman[71831]: 2024-09-19 08:23:43.099815518 +0000 UTC m=+0.118472683 container create ca4adef827915172ab9bb75930e523c3e0a42d305a0867f3b41e1a38cd9d0307 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T08:23:43.377 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:43 smithi203 podman[71831]: 2024-09-19 08:23:43.294260253 +0000 UTC m=+0.312917372 container init ca4adef827915172ab9bb75930e523c3e0a42d305a0867f3b41e1a38cd9d0307 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:23:43.377 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:43 smithi203 podman[71831]: 2024-09-19 08:23:43.297555524 +0000 UTC m=+0.316212651 container start ca4adef827915172ab9bb75930e523c3e0a42d305a0867f3b41e1a38cd9d0307 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T08:23:43.377 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:43 smithi203 podman[71831]: 2024-09-19 08:23:43.377514124 +0000 UTC m=+0.396171262 container attach ca4adef827915172ab9bb75930e523c3e0a42d305a0867f3b41e1a38cd9d0307 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T08:23:43.758 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:23:43 smithi203 podman[71831]: 2024-09-19 08:23:43.48300777 +0000 UTC m=+0.501664906 container died ca4adef827915172ab9bb75930e523c3e0a42d305a0867f3b41e1a38cd9d0307 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-19T08:23:44.067 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T08:23:44.108 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:23:44.109 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T08:23:44.109 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T08:23:44.109 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.a 2024-09-19T08:23:44.423 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 19 08:23:44 smithi027 systemd[1]: Stopping Ceph mds.a for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:23:44.752 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 19 08:23:44 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-a[72294]: 2024-09-19T08:23:44.423+0000 7f2e20662640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:23:44.752 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 19 08:23:44 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-a[72294]: 2024-09-19T08:23:44.423+0000 7f2e20662640 -1 mds.a *** got signal Terminated *** 2024-09-19T08:23:45.981 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 19 08:23:45 smithi027 podman[106130]: 2024-09-19 08:23:45.672798017 +0000 UTC m=+1.358873716 container died edf337402a2a9094819b6716611f01a0d1838489653750ee823286bb9d2c4fee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T08:23:46.252 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 19 08:23:46 smithi027 podman[106130]: 2024-09-19 08:23:46.172645118 +0000 UTC m=+1.858720805 container cleanup edf337402a2a9094819b6716611f01a0d1838489653750ee823286bb9d2c4fee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T08:23:46.252 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 19 08:23:46 smithi027 bash[106130]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-a 2024-09-19T08:23:46.572 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T08:23:46.608 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:23:46.608 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T08:23:46.608 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T08:23:46.608 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.d 2024-09-19T08:23:46.943 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 19 08:23:46 smithi027 systemd[1]: Stopping Ceph mds.d for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:23:47.252 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 19 08:23:46 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-d[71007]: 2024-09-19T08:23:46.943+0000 7f8bfe005640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:23:47.252 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 19 08:23:46 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-d[71007]: 2024-09-19T08:23:46.943+0000 7f8bfe005640 -1 mds.d *** got signal Terminated *** 2024-09-19T08:23:49.368 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 19 08:23:49 smithi027 podman[106251]: 2024-09-19 08:23:49.047285259 +0000 UTC m=+2.207238133 container died 42fc02a855731bb53fb62c77ccfbb951c128606cd21b6064daa87febc32f49a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-d, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T08:23:49.744 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 19 08:23:49 smithi027 podman[106251]: 2024-09-19 08:23:49.568517067 +0000 UTC m=+2.728469936 container cleanup 42fc02a855731bb53fb62c77ccfbb951c128606cd21b6064daa87febc32f49a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T08:23:49.744 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 19 08:23:49 smithi027 bash[106251]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-d 2024-09-19T08:23:49.995 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 19 08:23:49 smithi027 podman[106263]: 2024-09-19 08:23:49.745011744 +0000 UTC m=+0.694089412 container remove 42fc02a855731bb53fb62c77ccfbb951c128606cd21b6064daa87febc32f49a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T08:23:49.995 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 19 08:23:49 smithi027 systemd[1]: ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.d.service: Deactivated successfully. 2024-09-19T08:23:49.995 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 19 08:23:49 smithi027 systemd[1]: Stopped Ceph mds.d for 35b531b0-765d-11ef-bceb-c7b262605968. 2024-09-19T08:23:49.995 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 19 08:23:49 smithi027 systemd[1]: ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.d.service: Consumed 1.071s CPU time. 2024-09-19T08:23:49.997 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T08:23:50.031 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:23:50.031 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T08:23:50.031 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T08:23:50.032 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.g 2024-09-19T08:23:50.251 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 19 08:23:50 smithi027 systemd[1]: Stopping Ceph mds.g for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:23:50.752 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 19 08:23:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-g[71879]: 2024-09-19T08:23:50.339+0000 7f2398705640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:23:50.752 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 19 08:23:50 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-g[71879]: 2024-09-19T08:23:50.339+0000 7f2398705640 -1 mds.g *** got signal Terminated *** 2024-09-19T08:23:54.230 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 19 08:23:53 smithi027 podman[106372]: 2024-09-19 08:23:53.910329343 +0000 UTC m=+3.657040220 container died 8cfeaa3e68e8cea35063c61d69ddafa5baf1fcae6d659a63cac10fecb034a154 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-g, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T08:23:54.231 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 19 08:23:54 smithi027 podman[106372]: 2024-09-19 08:23:54.230940834 +0000 UTC m=+3.977651711 container cleanup 8cfeaa3e68e8cea35063c61d69ddafa5baf1fcae6d659a63cac10fecb034a154 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:23:54.501 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 19 08:23:54 smithi027 bash[106372]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-g 2024-09-19T08:23:54.502 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 19 08:23:54 smithi027 podman[106386]: 2024-09-19 08:23:54.415429241 +0000 UTC m=+0.505417771 container remove 8cfeaa3e68e8cea35063c61d69ddafa5baf1fcae6d659a63cac10fecb034a154 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-g, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T08:23:54.668 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T08:23:54.702 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:23:54.702 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T08:23:54.702 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T08:23:54.702 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.j 2024-09-19T08:23:55.002 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 19 08:23:54 smithi027 systemd[1]: Stopping Ceph mds.j for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:23:55.502 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 19 08:23:55 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-j[70582]: 2024-09-19T08:23:55.028+0000 7f4129e3a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:23:55.502 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 19 08:23:55 smithi027 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-j[70582]: 2024-09-19T08:23:55.028+0000 7f4129e3a640 -1 mds.j *** got signal Terminated *** 2024-09-19T08:23:57.718 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 19 08:23:57 smithi027 podman[106492]: 2024-09-19 08:23:57.428362475 +0000 UTC m=+2.503216708 container died b10afa03a215f93f9ea5262c9994402d6c2960ff530cb2db60659099154eee18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:23:58.002 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 19 08:23:57 smithi027 podman[106492]: 2024-09-19 08:23:57.809620392 +0000 UTC m=+2.884474617 container cleanup b10afa03a215f93f9ea5262c9994402d6c2960ff530cb2db60659099154eee18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-j, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T08:23:58.002 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 19 08:23:57 smithi027 bash[106492]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-j 2024-09-19T08:23:58.166 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T08:23:58.200 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:23:58.200 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T08:23:58.200 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T08:23:58.200 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.b 2024-09-19T08:23:58.487 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:23:58 smithi155 systemd[1]: Stopping Ceph mds.b for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:23:58.987 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:23:58 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-b[65776]: 2024-09-19T08:23:58.503+0000 7ff144125640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:23:58.987 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:23:58 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-b[65776]: 2024-09-19T08:23:58.503+0000 7ff144125640 -1 mds.b *** got signal Terminated *** 2024-09-19T08:24:02.052 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:24:01 smithi155 podman[71990]: 2024-09-19 08:24:01.792838881 +0000 UTC m=+3.392723039 container died ff521ea2d6646dc100c76a0667c7b7f4c611eb7685bf532a689806ea181cc87b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-b, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T08:24:02.469 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:24:02 smithi155 podman[71990]: 2024-09-19 08:24:02.152303251 +0000 UTC m=+3.752187415 container cleanup ff521ea2d6646dc100c76a0667c7b7f4c611eb7685bf532a689806ea181cc87b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-b, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T08:24:02.469 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:24:02 smithi155 bash[71990]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-b 2024-09-19T08:24:02.640 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T08:24:02.675 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:24:02.675 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T08:24:02.675 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T08:24:02.676 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.e 2024-09-19T08:24:02.987 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:24:02 smithi155 systemd[1]: Stopping Ceph mds.e for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:24:03.487 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:24:03 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-e[65160]: 2024-09-19T08:24:03.022+0000 7feddd8e6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:24:03.487 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:24:03 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-e[65160]: 2024-09-19T08:24:03.022+0000 7feddd8e6640 -1 mds.e *** got signal Terminated *** 2024-09-19T08:24:07.297 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:24:07 smithi155 podman[72112]: 2024-09-19 08:24:07.036842836 +0000 UTC m=+4.143177923 container died c5f73582f5f337214a12228cf4c8113e37c562af38f5fc690a275722dd091701 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-e, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T08:24:07.673 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:24:07 smithi155 podman[72112]: 2024-09-19 08:24:07.389098108 +0000 UTC m=+4.495433184 container cleanup c5f73582f5f337214a12228cf4c8113e37c562af38f5fc690a275722dd091701 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T08:24:07.673 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:24:07 smithi155 bash[72112]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-e 2024-09-19T08:24:07.831 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T08:24:07.867 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:24:07.867 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T08:24:07.867 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T08:24:07.867 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.h 2024-09-19T08:24:08.218 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:24:07 smithi155 systemd[1]: Stopping Ceph mds.h for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:24:08.487 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:24:08 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-h[65462]: 2024-09-19T08:24:08.218+0000 7f8525e1e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:24:08.487 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:24:08 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-h[65462]: 2024-09-19T08:24:08.218+0000 7f8525e1e640 -1 mds.h *** got signal Terminated *** 2024-09-19T08:24:11.987 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:24:11 smithi155 podman[72243]: 2024-09-19 08:24:11.71928717 +0000 UTC m=+3.604301762 container died ef634561e67b794ebe622d4100f05cb905a2613c987da9bbe0743ac7eda144df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-h, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T08:24:12.394 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:24:12 smithi155 podman[72243]: 2024-09-19 08:24:12.076157374 +0000 UTC m=+3.961171960 container cleanup ef634561e67b794ebe622d4100f05cb905a2613c987da9bbe0743ac7eda144df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T08:24:12.394 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:24:12 smithi155 bash[72243]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-h 2024-09-19T08:24:12.534 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T08:24:12.568 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:24:12.568 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T08:24:12.568 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T08:24:12.569 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.k 2024-09-19T08:24:12.987 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:24:12 smithi155 systemd[1]: Stopping Ceph mds.k for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:24:12.987 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:24:12 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-k[64844]: 2024-09-19T08:24:12.888+0000 7f01c122a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:24:12.987 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:24:12 smithi155 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-k[64844]: 2024-09-19T08:24:12.888+0000 7f01c122a640 -1 mds.k *** got signal Terminated *** 2024-09-19T08:24:14.487 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:24:14 smithi155 podman[72363]: 2024-09-19 08:24:14.228996637 +0000 UTC m=+1.444455676 container died bb25850358b3fff7b914a9ced917440446a360fc91dc5a784ebf1141e89de467 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-k, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T08:24:14.846 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:24:14 smithi155 podman[72363]: 2024-09-19 08:24:14.579807152 +0000 UTC m=+1.795266184 container cleanup bb25850358b3fff7b914a9ced917440446a360fc91dc5a784ebf1141e89de467 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T08:24:14.847 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:24:14 smithi155 bash[72363]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-k 2024-09-19T08:24:15.010 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T08:24:15.044 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:24:15.045 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T08:24:15.045 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T08:24:15.045 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.c 2024-09-19T08:24:15.364 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:24:15 smithi203 systemd[1]: Stopping Ceph mds.c for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:24:15.758 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:24:15 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-c[65268]: 2024-09-19T08:24:15.364+0000 7ff37f99a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:24:15.758 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:24:15 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-c[65268]: 2024-09-19T08:24:15.364+0000 7ff37f99a640 -1 mds.c *** got signal Terminated *** 2024-09-19T08:24:17.258 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:24:16 smithi203 podman[71935]: 2024-09-19 08:24:16.973556532 +0000 UTC m=+1.725882012 container died 710f87852e902214407801f06c15070ab65f83f2369057253881638b09825c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-c, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T08:24:17.614 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:24:17 smithi203 podman[71935]: 2024-09-19 08:24:17.356272115 +0000 UTC m=+2.108597601 container cleanup 710f87852e902214407801f06c15070ab65f83f2369057253881638b09825c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T08:24:17.615 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:24:17 smithi203 bash[71935]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-c 2024-09-19T08:24:17.782 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T08:24:17.818 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:24:17.818 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T08:24:17.818 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T08:24:17.818 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.f 2024-09-19T08:24:18.143 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:24:17 smithi203 systemd[1]: Stopping Ceph mds.f for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:24:18.508 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:24:18 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-f[64963]: 2024-09-19T08:24:18.142+0000 7f22f6ea0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:24:18.508 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:24:18 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-f[64963]: 2024-09-19T08:24:18.142+0000 7f22f6ea0640 -1 mds.f *** got signal Terminated *** 2024-09-19T08:24:22.435 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:24:22 smithi203 podman[72067]: 2024-09-19 08:24:22.148495331 +0000 UTC m=+4.105532948 container died 68d83f6463ba2a0e35abf36fe17323124e854cf954ad3e6af9a7705038dcfc90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T08:24:22.758 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:24:22 smithi203 podman[72067]: 2024-09-19 08:24:22.534933167 +0000 UTC m=+4.491970783 container cleanup 68d83f6463ba2a0e35abf36fe17323124e854cf954ad3e6af9a7705038dcfc90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T08:24:22.758 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:24:22 smithi203 bash[72067]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-f 2024-09-19T08:24:22.964 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T08:24:22.999 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:24:22.999 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T08:24:23.000 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T08:24:23.000 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.i 2024-09-19T08:24:23.258 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 08:24:23 smithi203 systemd[1]: Stopping Ceph mds.i for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:24:23.758 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 08:24:23 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-i[65572]: 2024-09-19T08:24:23.372+0000 7fd39f971640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:24:23.758 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 08:24:23 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-i[65572]: 2024-09-19T08:24:23.372+0000 7fd39f971640 -1 mds.i *** got signal Terminated *** 2024-09-19T08:24:26.065 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 08:24:25 smithi203 podman[72189]: 2024-09-19 08:24:25.799485804 +0000 UTC m=+2.581556376 container died 8ad25670735233cd52cb9fbef5cd88f81853f2f713ab0c772e2889d7f73a5e6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-i, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T08:24:26.424 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 08:24:26 smithi203 podman[72189]: 2024-09-19 08:24:26.164572966 +0000 UTC m=+2.946643535 container cleanup 8ad25670735233cd52cb9fbef5cd88f81853f2f713ab0c772e2889d7f73a5e6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-i, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T08:24:26.424 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 08:24:26 smithi203 bash[72189]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-i 2024-09-19T08:24:26.646 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T08:24:26.678 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:24:26.678 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T08:24:26.679 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T08:24:26.679 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.l 2024-09-19T08:24:26.985 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 08:24:26 smithi203 systemd[1]: Stopping Ceph mds.l for 35b531b0-765d-11ef-bceb-c7b262605968... 2024-09-19T08:24:27.258 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 08:24:26 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-l[64663]: 2024-09-19T08:24:26.985+0000 7f4c81a66640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:24:27.258 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 08:24:26 smithi203 ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-l[64663]: 2024-09-19T08:24:26.985+0000 7f4c81a66640 -1 mds.l *** got signal Terminated *** 2024-09-19T08:24:31.252 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 08:24:30 smithi203 podman[72311]: 2024-09-19 08:24:30.991794558 +0000 UTC m=+4.097015799 container died effc17931e7884df01aaec7d69f55182515ef5f0fb801eb881d83454200a544b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T08:24:31.508 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 08:24:31 smithi203 podman[72311]: 2024-09-19 08:24:31.35188737 +0000 UTC m=+4.457108619 container cleanup effc17931e7884df01aaec7d69f55182515ef5f0fb801eb881d83454200a544b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-l, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:24:31.508 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 08:24:31 smithi203 bash[72311]: ceph-35b531b0-765d-11ef-bceb-c7b262605968-mds-l 2024-09-19T08:24:31.773 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-35b531b0-765d-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T08:24:31.806 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:24:31.806 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T08:24:31.807 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 35b531b0-765d-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T08:24:32.020 INFO:teuthology.orchestra.run.smithi027.stdout:Deleting cluster with fsid: 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:24:34.711 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 35b531b0-765d-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T08:24:34.916 INFO:teuthology.orchestra.run.smithi155.stdout:Deleting cluster with fsid: 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:24:37.335 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 35b531b0-765d-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T08:24:37.536 INFO:teuthology.orchestra.run.smithi203.stdout:Deleting cluster with fsid: 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:24:39.946 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:24:39.982 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:24:40.010 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:24:40.036 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T08:24:40.038 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911834/remote/smithi027/crash 2024-09-19T08:24:40.039 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/crash -- . 2024-09-19T08:24:40.081 INFO:teuthology.orchestra.run.smithi027.stderr:tar: /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T08:24:40.082 INFO:teuthology.orchestra.run.smithi027.stderr:tar: Error is not recoverable: exiting now 2024-09-19T08:24:40.084 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911834/remote/smithi155/crash 2024-09-19T08:24:40.085 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/crash -- . 2024-09-19T08:24:40.121 INFO:teuthology.orchestra.run.smithi155.stderr:tar: /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T08:24:40.122 INFO:teuthology.orchestra.run.smithi155.stderr:tar: Error is not recoverable: exiting now 2024-09-19T08:24:40.123 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911834/remote/smithi203/crash 2024-09-19T08:24:40.124 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/crash -- . 2024-09-19T08:24:40.162 INFO:teuthology.orchestra.run.smithi203.stderr:tar: /var/lib/ceph/35b531b0-765d-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T08:24:40.163 INFO:teuthology.orchestra.run.smithi203.stderr:tar: Error is not recoverable: exiting now 2024-09-19T08:24:40.164 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T08:24:40.164 DEBUG:teuthology.orchestra.run.smithi027:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T08:24:40.208 INFO:tasks.cephadm:Compressing logs... 2024-09-19T08:24:40.209 DEBUG:teuthology.orchestra.run.smithi027:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T08:24:40.251 DEBUG:teuthology.orchestra.run.smithi155:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T08:24:40.253 DEBUG:teuthology.orchestra.run.smithi203:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T08:24:40.278 INFO:teuthology.orchestra.run.smithi155.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T08:24:40.278 INFO:teuthology.orchestra.run.smithi155.stderr:: No such file or directory 2024-09-19T08:24:40.279 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T08:24:40.279 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T08:24:40.279 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.10.log: /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T08:24:40.279 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T08:24:40.279 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T08:24:40.279 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T08:24:40.280 INFO:teuthology.orchestra.run.smithi027.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-19T08:24:40.280 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T08:24:40.280 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T08:24:40.280 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T08:24:40.280 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T08:24:40.280 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T08:24:40.280 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T08:24:40.280 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.audit.log: /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T08:24:40.280 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T08:24:40.280 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T08:24:40.281 INFO:teuthology.orchestra.run.smithi027.stderr: 84.6% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T08:24:40.281 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T08:24:40.282 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.g.log: 90.3% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T08:24:40.282 INFO:teuthology.orchestra.run.smithi203.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T08:24:40.283 INFO:teuthology.orchestra.run.smithi203.stderr:: No such file or directory 2024-09-19T08:24:40.283 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T08:24:40.283 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T08:24:40.283 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T08:24:40.284 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.4.log: 94.5% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T08:24:40.287 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T08:24:40.287 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T08:24:40.287 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T08:24:40.287 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T08:24:40.287 INFO:teuthology.orchestra.run.smithi203.stderr: 82.2% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T08:24:40.287 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.log 2024-09-19T08:24:40.288 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T08:24:40.288 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.5.log: /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.log: 90.4% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T08:24:40.288 INFO:teuthology.orchestra.run.smithi203.stderr: 87.6% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T08:24:40.289 INFO:teuthology.orchestra.run.smithi203.stderr: 90.9% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T08:24:40.290 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T08:24:40.290 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T08:24:40.290 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T08:24:40.290 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.cephadm.log: 82.2% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T08:24:40.291 INFO:teuthology.orchestra.run.smithi027.stderr: 94.6% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T08:24:40.292 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.log 2024-09-19T08:24:40.292 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T08:24:40.292 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.log: gzip 94.6% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T08:24:40.292 INFO:teuthology.orchestra.run.smithi027.stderr: -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T08:24:40.292 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T08:24:40.292 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mgr.x.log: /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.d.log: 87.6% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T08:24:40.292 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T08:24:40.292 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.j.log: 94.5% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T08:24:40.292 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T08:24:40.292 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.3.log: 94.7% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T08:24:40.292 INFO:teuthology.orchestra.run.smithi027.stderr: 90.9% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T08:24:40.293 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.log 2024-09-19T08:24:40.293 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mgr.y.log: 90.9% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T08:24:40.293 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T08:24:40.294 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.log: 87.6% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T08:24:40.297 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T08:24:40.297 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.h.log: 91.8% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T08:24:40.299 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T08:24:40.299 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mon.b.log: 94.5% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T08:24:40.300 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T08:24:40.302 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T08:24:40.302 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T08:24:40.303 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/cephadm.log: 94.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T08:24:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T08:24:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.e.log: 94.5% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T08:24:40.306 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mgr.z.log: 94.6% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T08:24:40.306 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T08:24:40.307 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T08:24:40.312 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.c.log: 94.6% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T08:24:40.312 INFO:teuthology.orchestra.run.smithi203.stderr: 91.9% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T08:24:40.312 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T08:24:40.314 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T08:24:40.315 INFO:teuthology.orchestra.run.smithi203.stderr: 94.6% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T08:24:40.531 INFO:teuthology.orchestra.run.smithi027.stderr: 90.1% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T08:24:40.710 INFO:teuthology.orchestra.run.smithi203.stderr: 91.8% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T08:24:40.717 INFO:teuthology.orchestra.run.smithi203.stderr: 95.8% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T08:24:40.772 INFO:teuthology.orchestra.run.smithi155.stderr: 91.7% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T08:24:41.451 INFO:teuthology.orchestra.run.smithi027.stderr: 92.4% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T08:24:41.481 INFO:teuthology.orchestra.run.smithi027.stderr: 91.6% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T08:24:41.498 INFO:teuthology.orchestra.run.smithi027.stderr: 90.5% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T08:24:41.553 INFO:teuthology.orchestra.run.smithi027.stderr: 92.0% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T08:24:41.659 INFO:teuthology.orchestra.run.smithi203.stderr: 92.2% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T08:24:41.671 INFO:teuthology.orchestra.run.smithi155.stderr: 92.0% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T08:24:41.689 INFO:teuthology.orchestra.run.smithi155.stderr: 92.9% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T08:24:41.698 INFO:teuthology.orchestra.run.smithi203.stderr: 93.0% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T08:24:41.908 INFO:teuthology.orchestra.run.smithi027.stderr: 92.6% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T08:24:41.910 INFO:teuthology.orchestra.run.smithi027.stderr: 2024-09-19T08:24:41.910 INFO:teuthology.orchestra.run.smithi027.stderr:real 0m1.645s 2024-09-19T08:24:41.910 INFO:teuthology.orchestra.run.smithi027.stderr:user 0m6.588s 2024-09-19T08:24:41.910 INFO:teuthology.orchestra.run.smithi027.stderr:sys 0m0.216s 2024-09-19T08:24:42.038 INFO:teuthology.orchestra.run.smithi203.stderr: 92.3% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T08:24:42.128 INFO:teuthology.orchestra.run.smithi155.stderr: 92.1% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T08:24:42.148 INFO:teuthology.orchestra.run.smithi155.stderr: 91.4% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T08:24:43.703 INFO:teuthology.orchestra.run.smithi155.stderr: 93.5% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T08:24:43.731 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-09-19T08:24:43.731 INFO:teuthology.orchestra.run.smithi155.stderr:real 0m3.439s 2024-09-19T08:24:43.732 INFO:teuthology.orchestra.run.smithi155.stderr:user 0m10.130s 2024-09-19T08:24:43.732 INFO:teuthology.orchestra.run.smithi155.stderr:sys 0m0.354s 2024-09-19T08:24:44.122 INFO:teuthology.orchestra.run.smithi203.stderr: 95.1% -- replaced with /var/log/ceph/35b531b0-765d-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T08:24:44.124 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-19T08:24:44.124 INFO:teuthology.orchestra.run.smithi203.stderr:real 0m3.856s 2024-09-19T08:24:44.124 INFO:teuthology.orchestra.run.smithi203.stderr:user 0m8.946s 2024-09-19T08:24:44.124 INFO:teuthology.orchestra.run.smithi203.stderr:sys 0m0.354s 2024-09-19T08:24:44.125 INFO:tasks.cephadm:Archiving logs... 2024-09-19T08:24:44.125 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911834/remote/smithi027/log 2024-09-19T08:24:44.126 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T08:24:45.085 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911834/remote/smithi155/log 2024-09-19T08:24:45.087 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T08:24:46.598 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911834/remote/smithi203/log 2024-09-19T08:24:46.599 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T08:24:47.983 INFO:tasks.cephadm:Removing cluster... 2024-09-19T08:24:47.983 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 35b531b0-765d-11ef-bceb-c7b262605968 --force 2024-09-19T08:24:48.195 INFO:teuthology.orchestra.run.smithi027.stdout:Deleting cluster with fsid: 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:24:48.470 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 35b531b0-765d-11ef-bceb-c7b262605968 --force 2024-09-19T08:24:48.671 INFO:teuthology.orchestra.run.smithi155.stdout:Deleting cluster with fsid: 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:24:48.938 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 35b531b0-765d-11ef-bceb-c7b262605968 --force 2024-09-19T08:24:49.136 INFO:teuthology.orchestra.run.smithi203.stdout:Deleting cluster with fsid: 35b531b0-765d-11ef-bceb-c7b262605968 2024-09-19T08:24:49.406 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T08:24:49.407 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T08:24:49.425 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T08:24:49.443 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T08:24:49.459 INFO:tasks.cephadm:Teardown complete 2024-09-19T08:24:49.459 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T08:24:49.647 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T08:24:49.647 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T08:24:49.650 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T08:24:49.653 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T08:24:49.751 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T08:24:49.762 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T08:24:49.762 DEBUG:teuthology.orchestra.run.smithi027:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:24:49.766 DEBUG:teuthology.orchestra.run.smithi155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:24:49.769 DEBUG:teuthology.orchestra.run.smithi203:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:24:49.780 INFO:teuthology.orchestra.run.smithi027.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:24:49.781 INFO:teuthology.orchestra.run.smithi155.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:24:49.783 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:24:49.785 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:24:49.785 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2024-09-19T08:24:49.785 INFO:teuthology.orchestra.run.smithi155.stdout:^* hv01.front.sepia.ceph.com 3 6 377 23 +1255us[+1275us] +/- 39ms 2024-09-19T08:24:49.785 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 -3542us[-3523us] +/- 62ms 2024-09-19T08:24:49.785 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 +1587us[+1587us] +/- 63ms 2024-09-19T08:24:49.785 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:24:49.787 INFO:teuthology.orchestra.run.smithi027.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:24:49.787 INFO:teuthology.orchestra.run.smithi027.stdout:=============================================================================== 2024-09-19T08:24:49.787 INFO:teuthology.orchestra.run.smithi027.stdout:^* hv01.front.sepia.ceph.com 3 6 377 21 +1242us[+1291us] +/- 39ms 2024-09-19T08:24:49.787 INFO:teuthology.orchestra.run.smithi027.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 24 -3549us[-3501us] +/- 61ms 2024-09-19T08:24:49.787 INFO:teuthology.orchestra.run.smithi027.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 24 +1590us[+1639us] +/- 63ms 2024-09-19T08:24:49.787 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:24:49.788 INFO:teuthology.orchestra.run.smithi203.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:24:49.788 INFO:teuthology.orchestra.run.smithi203.stdout:=============================================================================== 2024-09-19T08:24:49.788 INFO:teuthology.orchestra.run.smithi203.stdout:^* hv01.front.sepia.ceph.com 3 6 377 23 +1230us[+1258us] +/- 39ms 2024-09-19T08:24:49.789 INFO:teuthology.orchestra.run.smithi203.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 25 -3557us[-3528us] +/- 61ms 2024-09-19T08:24:49.789 INFO:teuthology.orchestra.run.smithi203.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 24 +1578us[+1607us] +/- 63ms 2024-09-19T08:24:49.789 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:24:49.789 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T08:24:49.799 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T08:24:49.800 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T08:24:49.867 DEBUG:teuthology.orchestra.run.smithi027:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T08:24:49.956 DEBUG:teuthology.orchestra.run.smithi155:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T08:24:50.024 DEBUG:teuthology.orchestra.run.smithi203:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T08:24:50.094 DEBUG:teuthology.orchestra.run.smithi027:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:24:50.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:24:50.127 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:24:50.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:24:50.157 DEBUG:teuthology.orchestra.run.smithi203:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:24:50.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:24:50.185 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T08:24:50.196 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T08:24:50.206 INFO:teuthology.task.internal:Duration was 1832.151771 seconds 2024-09-19T08:24:50.206 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T08:24:50.217 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T08:24:50.217 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T08:24:50.220 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T08:24:50.222 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T08:24:50.259 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:24:50.261 INFO:teuthology.orchestra.run.smithi027.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:24:50.264 INFO:teuthology.orchestra.run.smithi203.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:24:50.780 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T08:24:50.780 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi027.front.sepia.ceph.com 2024-09-19T08:24:50.780 DEBUG:teuthology.orchestra.run.smithi027:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T08:24:50.804 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi155.front.sepia.ceph.com 2024-09-19T08:24:50.804 DEBUG:teuthology.orchestra.run.smithi155:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T08:24:50.843 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi203.front.sepia.ceph.com 2024-09-19T08:24:50.843 DEBUG:teuthology.orchestra.run.smithi203:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T08:24:50.882 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T08:24:50.882 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T08:24:50.885 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T08:24:50.887 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T08:24:50.951 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T08:24:50.951 DEBUG:teuthology.orchestra.run.smithi027:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T08:24:50.955 DEBUG:teuthology.orchestra.run.smithi155:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T08:24:50.958 DEBUG:teuthology.orchestra.run.smithi203:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T08:24:51.972 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T08:24:51.984 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T08:24:51.984 DEBUG:teuthology.orchestra.run.smithi027:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T08:24:52.011 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T08:24:52.041 DEBUG:teuthology.orchestra.run.smithi203:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T08:24:52.070 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T08:24:52.082 DEBUG:teuthology.orchestra.run.smithi027:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:24:52.085 DEBUG:teuthology.orchestra.run.smithi155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:24:52.088 DEBUG:teuthology.orchestra.run.smithi203:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:24:52.107 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = core 2024-09-19T08:24:52.111 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = core 2024-09-19T08:24:52.138 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = core 2024-09-19T08:24:52.163 DEBUG:teuthology.orchestra.run.smithi027:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:24:52.178 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:24:52.178 DEBUG:teuthology.orchestra.run.smithi155:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:24:52.205 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:24:52.206 DEBUG:teuthology.orchestra.run.smithi203:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:24:52.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:24:52.222 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T08:24:52.235 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T08:24:52.236 DEBUG:teuthology.misc:Transferring archived files from smithi027:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911834/remote/smithi027 2024-09-19T08:24:52.237 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T08:24:52.295 DEBUG:teuthology.misc:Transferring archived files from smithi155:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911834/remote/smithi155 2024-09-19T08:24:52.295 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T08:24:52.333 DEBUG:teuthology.misc:Transferring archived files from smithi203:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911834/remote/smithi203 2024-09-19T08:24:52.333 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T08:24:52.375 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T08:24:52.376 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T08:24:52.378 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T08:24:52.381 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T08:24:52.423 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T08:24:52.437 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T08:24:52.437 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T08:24:52.449 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T08:24:52.449 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T08:24:52.451 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T08:24:52.453 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T08:24:52.465 INFO:teuthology.orchestra.run.smithi027.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 08:24 /home/ubuntu/cephtest 2024-09-19T08:24:52.467 INFO:teuthology.orchestra.run.smithi155.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 08:24 /home/ubuntu/cephtest 2024-09-19T08:24:52.479 INFO:teuthology.orchestra.run.smithi203.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 08:24 /home/ubuntu/cephtest 2024-09-19T08:24:52.481 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T08:24:52.492 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T08:24:52.518 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/direct_io}} duration: 1832.151771068573 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T08:24:52.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T08:24:52.601 INFO:teuthology.run:pass